Good question ty, I think this is not a good repo for that. You should think of micro models maybe more as very young children (kindergarten etc.), they just don't have the raw intelligence of their larger cousins. If you finetune/train it on your own data you'll probably get some amusing parroting that feels like your writing in style, but it will be slop.
To achieve what you're looking for you'd want something more like:
- take your raw data
- add extensive synthetic data generation rewrites on top (tricky, not obvious, researchy)
- finetune a state of the art open LLM on it (e.g. tinker)
- you'd possibly have to mix in a lot of pretraining data to not lose too much raw intelligence during finetuning.
Basically I'd say getting this to work well is still realm of research and not obvious.
Your best non-research bet is just giving all your writing to something like NotebookLM, which RAGs over it (i.e. references it in chunks). Your data makes it into context windows via RAG but doesn't impact the weights. So the model doesn't exactly "know you", but it's maybe the closest you can easily get.
XcsDownload the infographic and white paper on how best-in-class enterprise businesses stay agile in a rapidly changing world. https://t.co/aDe3OCTdNV via @Atlassian
@ParveenKaswan@BirdingBeijing Any idea how much it weighed before and after this epic journey? And after coming onshore, did it stop somewhere or went nonstop to Madhya Pradesh?
4 massive male lions seen on the Sunset Drive yesterday by Jock Safari Lodge.
Seen on the H2-2, near Stolsneks
Tinged by Mayneth- Jock Safari Lodge
(Video)