Weird thing most people don’t believe I can do.
Tell me your company AI use case and I can train an AI model specifically for you.
This is just so good and well built.
Kudos to the dev
danfo.horpey.dev/
19
These songs brings a lot of memories for me.
I didn’t even know who he was when I started listening to him as at 2020. I just found his music and it felt like he was speaking directly to me.
One of the happiest to see his receiving his flowers eventually
This is a real model that you can chat with on Ollama
Just run “Ollama run hf.co/enigmare/nylon-v1” on your terminal
Heads up: it’s one of the worse model you can chat with so don’t get your hopes too high 😁
Also another trick is the software architecture.
Flash attention, compiling, BF16, gradient accumulation and others
56
Also another trick is the software architecture.
Flash attention, compiling, BF16, gradient accumulation and others
I am working on an article on how I spend extremely lean to train models.
One of the trick is extremely high quality of dataset.
Another one is choosing the best hardware even if it’s expensive. This makes training fast and you spend less most times.
Kinda crazy that I trained an AI model with less than $100
From base training to SFT, DPO and RL and it works
Labs spend thousands of dollars to do this and I did with less than $100.
My next model will be trained with less than $2000 total.
enigmare.xyz
Kinda crazy that I trained an AI model with less than $100
From base training to SFT, DPO and RL and it works
Labs spend thousands of dollars to do this and I did with less than $100.
My next model will be trained with less than $2000 total.
enigmare.xyz
In case you looking for something to read about a critical part of building AI models, I wrote a technical report on building a BPE Tokenizer
enigmare.xyz/technical-repor…
22
I haven’t been able to build an intelligent model but I have proudly lay a very solid foundation at which I can stack up and eventually have a model capable of doing intelligent works.
enigmare.xyz
Imagine the USA government decides to block the Nigerian government from using their AI model just because they see us siding with another country
AI is a very powerful tool and we need to start owning our own models. It doesn’t have to be perfect at first but at least it’s ours
1
29




