
Pioneering ethical #GenerativeAI solutions for business transformation and social good. Driving innovation responsibly. #AIForChange #TechWithPurpose
Joined January 2024
- Tweets5
- Following4
- Followers16
- Likes9
FairMind retweeted
Programming is changing so fast... I'm trying VS Code Cursor + Sonnet 3.5 instead of GitHub Copilot again and I think it's now a net win. Just empirically, over the last few days most of my "programming" is now writing English (prompting and then reviewing and editing the generated diffs), and doing a bit of "half-coding" where you write the first chunk of the code you'd like, maybe comment it a bit so the LLM knows what the plan is, and then tab tab tab through completions. Sometimes you get a 100-line diff to your code that nails it, which could have taken 10+ minutes before.
I still don't think I got sufficiently used to all the features. It's a bit like learning to code all over again but I basically can't imagine going back to "unassisted" coding at this point, which was the only possibility just ~3 years ago.
FairMind retweeted

Sebastian Raschka@rasbt13 Jul 2024
๐บ๐ธ
United StatesConnected via United States App StoreAccount-level information, not a live location or per-post device.
If you are looking for something to read this weekend, I am happy to share that Chapter 7 on instruction finetuning LLMs is now finally live on the Manning website: manning.com/books/build-a-laโฆ
This is the longest chapter in the book and takes a from-scratch approach to implementing the instruction finetuning pipeline. This includes everything from input formatting to batching with a custom collate function, masking padding tokens, the training loop itself, and scoring the response quality of the finetuned LLM on a custom test set.
(The exercises include changing prompt styles, instruction masking, and adding LoRA.)
As a side note, it's also the last chapter, and the publisher is currently preparing the layouts for the print version.
PS: After moving, traveling, and returning from the awesome SciPy conference, I am now also super eager to finally type up my notes from recent research papers on the instruction finetuning front. I will share them soon, in the next few days, as a follow-up!
FairMind retweeted
Si chiama Nessi รจ un chatbot basato sullโintelligenza artificiale generativa: a sperimentarlo la Camera di Commercio di Milano per rendere i testi dei bandi piรน comprensibili. Su @wireditalia l'intervista ad @alexio di @FairMindAI ๐
wired.it/article/chatbot-camโฆ
FairMind retweeted
๐ Exciting Milestone at @FairMindAI! ๐
In just two days following the release of the @SapienzaNLP team's Minerva base models, we at #FairMind are thrilled to unveil our latest innovation: ๐ ๐ถ๐ป๐ฒ๐ฟ๐๐ฎ-๐ฏ๐-๐๐ป๐๐๐ฟ๐๐ฐ๐-๐๐ญ.๐ฌ. This new iteration enhances instruction-following capabilities, marking a significant step forward in AI technology.
๐ค๐๐ถ๐ฐ๐ธ ๐๐ป๐๐ถ๐ด๐ต๐๐:
๐ ๐๐ฎ๐๐ฒ ๐ ๐ผ๐ฑ๐ฒ๐น: Minerva-3B-base-v1.0 (Transformer-based, bilingual in Italian and English)
๐ ๐๐ฎ๐๐ฎ ๐จ๐๐ถ๐น๐ถ๐๐ฒ๐ฑ: Italian translation of the Stanford Alpaca-Cleaned dataset, broadening the model's applicability across domains.
๐ฏ ๐ข๐ฏ๐ท๐ฒ๐ฐ๐๐ถ๐๐ฒ: Sharpen the modelโs proficiency in processing and executing complex instructions in Italian.
๐ ๐ฃ๐ฒ๐ฟ๐ณ๐ผ๐ฟ๐บ๐ฎ๐ป๐ฐ๐ฒ:
* Hellaswag_it: 0.5197
* Arc_it: 0.3157
* M_mmlu_it 5-shot: 0.2631
* Average: 0.366
๐ Discover more on our model page: ๐ ๐ถ๐ป๐ฒ๐ฟ๐๐ฎ-๐ฏ๐-๐๐ป๐๐๐ฟ๐๐ฐ๐-๐๐ญ.๐ฌ on Hugging Face: huggingface.co/FairMind/Mineโฆ
#AI #MachineLearning #TechInnovation #StartupLife #ModelRelease



