Below you will find pages that utilize the taxonomy term “llm”
Posts
Oobabooga, GPT4All, and FastChat LLM frontends: ttftw 2023w20
Three things from this week.
I tried out three different ways to use an LLM on my home PC this week. A Large Language Model (LLM) is the kind of ML model that runs inside of ChatGPT and other similar popular chatbots. Running on my home PC lets me see just what they can do and whether they’re useful to me. While there have been a whole lot of different models emerging lately, there are also a few different frontends or user interfaces that can load the model and perform inferences.