Security Researcher. Disclaimer: my tweets don't reflect the views of my current or past employers!
Joined September 2009
- Tweets1.3K
- Following341
- Followers652
- Likes129
Decision models (Clef, pplx-decider, d3, H2O-Lightning, d1…) each ship their own runtime: custom PyTorch code, a vLLM shim, CUDA assumptions.
mlx-decision runs all of them on Apple Silicon with #MLX, behind one API. 🧵
Fine-tuning on the Mac: mlx-decision data turns a HF dataset or CSV into labelled examples, training fit fits in minutes, and training eval --compare scores the result against its base.
d1-3B on TREC: 86.6% → 96.4% in 4 min (M5 Pro).
And a local web app (mlx-decision web) to compare models side by side and score datasets with accuracy, a confusion matrix and calibration. Everything it writes is a plain file the CLI reads.
pip install mlx-decision
github.com/armbues/mlx-decis…
Early version bump for SiLLM to 0.1.1 with some bugfixes and support for Llama-3 models.
pypi.org/project/sillm-mlx/
github.com/armbues/SiLLM
Running Llama-3-8B-Instruct on Mac with the SiLLM framework powered by MLX... just took some fiddling with the tokenizer & template to get it to run 😁
I'm excited to share a new open-source project: the Silicon LLM Training & Inference Toolkit, short SiLLM.
Check out the project on Github here:
github.com/armbues/SiLLM
The repository includes several code examples:
- LoRA training with the Nvidia HelpSteer dataset
- DPO Fine-tuning with the DPO Mix 7K dataset
- Implementation of the MMLU Benchmark
- Calculating perplexity scores of a model for a sample dataset
A huge thank you to @awnihannun @angeloskath and the rest of the team for developing the MLX framework that SiLLM relies on! Also big kudos to all the contributors of the MLX Examples project 👏
Armin Buescher retweeted
One of the reasons to attend the #CARO2023 is the food for thought that is delivered in talks, conversations, and of course keynotes. Armin Büscher @armbues will share his technical perspective about innovation and disruption in cybersecurity.
caro2023.org/#c228106
Armin Buescher retweeted
Y’all have a home on Infosec.exchange if you need it ❤️
Armin Buescher retweeted
This file leaked an Security Enterprise Virustotal API Key before！But now it's expired because someone leaked the key😅
ITW:07c4a75b1422a22ec29c5102e0b67055
API Key:d10468bead05da1685629a0abcfed5f963d6adbc7e6bb2b2fc343dbb36be0349
unbelievable！
Armin Buescher retweeted
We just released 1000+ yara rules and 200+ endpoint behavior rules github.com/elastic/protectio…
I'll be traveling to Vegas for #blackhat2022 and #DEFCON next week. Looking forward to hang out with many infosec folks I haven't seen in a long time 🥳