Fine-tuning a CRAZY Local Mistral 7B Model - Step by Step - together.ai

👊 Become a member and get access to GitHub:
   / allaboutai  

📧 Join the newsletter:
https://www.allabtai.com/newsletter/

🌐 My website:
https://www.allabtai.com

In this video i fine tune a Mistral 7B model with a self generated dataset. We will go step-by-step over on how to create the dataset, convert to JSONL, upload it, start the fine-tuning, download the model, convert the model to .gguf and test it.

GH llama.cpp:
https://github.com/ggerganov/llama.cpp

Reddit:
https://www.reddit.com/r/LocalLLaMA/c...

00:00 Local Fine Tune Intro
00:18 Flowchart
01:14 Create Mistral 7B Dataset
05:59 Check Dataset
06:56 Upload Dataset
07:26 Start fine-tune job
10:58 Convert model to gguf
12:39 Testing our fine tuned model
16:09 Conclusion