Eric Hartford

Eric’s blog is a great read on how to create the uncensored models - link to the original blog here: https://erichartford.com/uncensored-models

I hope your business works out for you and I am willing to believe that AMD has improved somewhat, but I do not believe AMD has improved enough to be worth people’s time when Nvidia is an option. I have heard too many nightmares and it is going to take many people, including people who reported those nightmares, reporting improvements for me to think otherwise. It is not just George Hotz who reported issues. Eric Hartford has been quiet lately, but one of the last comments he made on his blog was not very inspiring: > Know that you are in for rough waters. And even when you arrive - There are lots of optimizations tailored for nVidia GPUs so, even though the hardware may be just as strong spec-wise, in my experience so far, it still may take 2-3 times as long to train on equivalient AMD hardware. (though if you are a super hacker maybe you can fix it!) https://erichartford.com/from-zero-to-fineturning-with-axolotl-on-rocm There has been no follow-up “it works great now”. That said, as for saying you have a conflict of interest, let us consider what a conflict of interest is: https://en.wikipedia.org/wiki/Conflict_of_interest > A conflict of interest (COI) is a situation in which a person or organization is involved in multiple interests, financial or otherwise, and serving one interest could involve working against another. You run a company whose business is dependent entirely on leasing AMD GPUs. Here, you want to say that AMD’s hardware is useful for that purpose…

Ollama is not as powerful as llama.cpp or raw pytorch, but it is almost zero effort to get started. brew install ollama; ollama serve; ollama pull llama3: 8b-v2.9-q5_K_M; ollama run llama3: 8b-v2.9-q5_K_M https://ollama.com/library/dolphin-llama3:8b-v2.9-q5_K_M (It may need to be Q4 or Q3 instead of Q5 depending on how the RAM shakes out. But the Q5_K_M quantization (k-quantization is the term) is generally the best balance of size vs performance vs intelligence if you can run it, followed by Q4_K_M. Running Q6, Q8, or fp16 is of course even better but you’re nowhere near fitting that on 8gb.) https://old.reddit.com/r/LocalLLaMA/comments/1ba55rj/overview_of_gguf_… Dolphin-llama3 is generally more compliant and I’d recommend that over just the base model. It's been fine-tuned to filter out the dumb "sorry I can't do that" battle, and it turns out this also increases the quality of the results (by limiting the space you're generating, you also limit the quality of the results). https://erichartford.com/uncensored-models https://arxiv.org/abs/2308.13449 Most of the time you will want to look for an "instruct" model, if it doesn't have the instruct suffix it'll normally be a "fill in the blank" model that finishes what it thinks is the pattern in the input, rather than generate a textual answer to a question. But ollama typically pulls the instruct models into their repos. (sometimes you will see this even with instruct models, especially if…

> properties like creativity, liveliness, and consistency I don't believe we train The LLMs for those things specifically. It will be interesting to see if some datasets for this appear. I think we can still make huge improvements by just caring about that more. We've got Samantha though, so I hope we will see those attributes too. https://erichartford.com/meet-samantha

"Dolphin, an emulator for Nintendo video games", but in this context it refers to "Dolphin, an open-source and uncensored, and commercially licensed dataset and series of instruct-tuned language models based on Microsoft's Orca paper." https://erichartford.com/dolphin

edit: misread the title The uncensored one [1] - finally gave me instructions for making crack and a bomb. It felt cool that it would answer everything, like a 90s zine. [1] https://huggingface.co/TheBloke/dolphin-2.1-mistral-7B-GGUF Note on that page: This model is uncensored. I have filtered the dataset to remove alignment and bias. This makes the model more compliant. You are advised to implement your own alignment layer before exposing the model as a service. It will be highly compliant to any requests, even unethical ones. Please read my blog post about uncensored models. https://erichartford.com/uncensored-models You are responsible for any content you create using this model. Enjoy responsibly.

I don't think so: https://erichartford.com/uncensored-models#heading-whats-an-uncensored… > Most of these models (for example, Alpaca, Vicuna, WizardLM, MPT-7B-Chat, Wizard-Vicuna, GPT4-X-Vicuna) have some sort of embedded alignment > The reason these models are aligned is that they are trained with data that was generated by ChatGPT, which itself is aligned by an alignment team at OpenAI.

Correct. Eric Hartford's blog post delves into the alignment of open-source LLMs[1]. In essence, models like LLaMA and GPT-Neo-X adopt alignment behaviors from ChatGPT-sourced instruction datasets. To achieve more transparent model responses, one can refine the dataset by removing biases and refusals, then retrain. [1] https://erichartford.com/uncensored-models#heading-ok-so-if-you-are-st…

This post seems to be upvoted for the "uncensored" keyword. But this should be attributed to https://huggingface.co/ehartford and others. See also https://news.ycombinator.com/item?id=36977146 Or better: https://erichartford.com/uncensored-models

Try out Samantha, a llama 33b finetune, which may already be what you want: https://erichartford.com/meet-samantha Run this one on exLLaMA\tui if you happen to have a 3090/4090 to run it on: https://huggingface.co/TheBloke/Samantha-33B-SuperHOT-8K-GPTQ And otherwise this on any decent PC: https://huggingface.co/TheBloke/Samantha-33B-SuperHOT-8K-GGML That would be a good starting point for a finetune if its not quite right.

Here's a good writeup that goes into more depth than most of the READMEs on fine-tuning: https://erichartford.com/uncensored-models

In general, the core language model is simply trained on a very large amount of unannotated text (which is the most time-consuming and expensive part), but a language model is not directly very useful in the role of e.g. a chat agent, it quite literally tries to continue text and that sometimes is what you want and sometimes isn't. The second step is fine-tuning the model on a much smaller set of annotated data which specify that it should actually "do something" in its responses and what it should do; it "teaches" it that it should actually answer the questions instead of e.g. continuing on with a list of more questions in the same vein, and most such training sets also "teach" it that for certain questions the appropriate response is a refusal. If you have the original core model (before that instruction tuning) then you can repeat the same process but instead replace the instruction training set with a different one, so you can "instruct" the model to behave differently. Here is a nice and informative article from Eric Hartford about how he did that to make certain 'uncensored' models - https://erichartford.com/uncensored-models

I compiled this list - https://gist.github.com/TikkunCreation/5de1df7b24800cc05b4823da4116f1a… In particular, you'll probably want to skip to nanoGPT (https://github.com/karpathy/nanoGPT) and then maybe if you are interested in a bit more of the theory, Zero to Hero (https://karpathy.ai/zero-to-hero.html), and his comments in one of the threads linked: https://news.ycombinator.com/item?id=34414716 Fine tuning may also be a faster and better place to start, this is a good guide for fine tuning some publicly released LLMs: https://erichartford.com/uncensored-models