Senior software engineer Automation + applied AI (pharma) Contributor: MLX-Serve, TensorFold, ds4 Local inference · Real hardware · Builders
Joined September 2026
- Tweets1K
- Following472
- Followers2.1K
- Likes6.7K
Pinned Tweet
Building automation and applied AI systems for pharma. Contributing to local inference projects (MLX-Serve and TensorFold).
Obsessed with making models run faster and more reliably on real hardware.
Tinkerers and builders — what are you working on? I’d love to connect.
Sebastian Christiansen retweeted
Following my earlier post about the M5 Ultra 512GB Mac Studio, more than two dozen people asked me to set up crowdfunding for it.
I always try to pay my own way, so asking for help at this scale doesn't come naturally. But I couldn't make the numbers work this time, and my loan got rejected after placing the order.
I'd love to get one for TensorFold and to see how far we can push it.
If you'd like to help towards it, I've put the goal on Ko-fi below. Please only contribute if you're comfortable doing so.
ko-fi.com/ashxhart/goal?g=2
Thank you to everyone who's encouraged me to do this, and to everyone already supporting TensorFold. I'm incredibly grateful and will continue to push TF. ❤️
@TheAhmadOsman @0xSero @ivanfioravanti
Ash makes TensorFold for free but got turned down for a personal loan so can't buy a Mac M5 512GB to do more work on.
What do you guys think? You'd help to promote a crowd fund, wouldn't you?
And if you want to support the developer directly you can do so here
buymeacoffee.com/ashhart
“Still too accessible to JavaScript developers.” 😂😭
We have used Bend2 for the last few weeks. Here is an honest review:
Bend2 is what happens when an inbred type theory autist decides Haskell is for fucking casuals. No type inference. No type classes. No tactics. Want to prove something? Write the fucking proof yourself. Dependent types with absolutely none of the ergonomic bullshit. Also, affine types because apparently full linearity would be too much commitment. The ecosystem is nonexistent, the learning curve is a vertical cliff, and writing trivial programs feels like defending a PhD thesis.
9/10. Still too accessible to JavaScript developers.
scikit-learn API, running on Apple Silicon GPUs through MLX and Metal. mlx-learn claims up to 30x faster training and 300x faster inference with matching results. The Mac story was never only about LLMs. Classical ML just got its own local fast path.
A bank just told the dev behind TensorFold that subs and X income aren't "reliable income", so no loan for a 512GB M5 Ultra. A lot of local Apple Silicon inference runs on one person's credit score. We call it open source. It's really unfunded infrastructure.
Sebastian Christiansen retweeted
@johnternus @AppleSupport @Apple
TensorFold support for Apple devices is doing heavy lifting for Apple’s competitive credibility in AI. Sales are being driven directly because of Ash's support.
Does anyone know Apple dev relations that can organise getting HW into Ash's hands?
I think this is a really interesting use case, but I would like to see truly open source alternatives from top to bottom.
🔥🔥Meet #reGoggles — Open Smart Goggles For Industrial AI Assistance.
For more informations here：seeedstudio.com/regoogles
Built for frontline use, featuring:
👓Goggle-Form Capture and Protection
🔧Modular Expansion
👋Hands-Free Interaction
🔓Open Firmware and SDK
👀Synchronized Multimodal Capture
🌎Universal Connectivity
With a variety of applications：
🏭 Industrial AI Assistance
🤖 Ego Data for Embodied AI
🛠 An Open Platform for Builders
🛠️ Check the landing page for specs, and launch updates: seeedstudio.com/regoogles
📌 Follow our Discord for early access: discord.gg/pkK3KMt6Ja
#SeeedStudio #reGoggles #SmartGlasses #WearableAI #Allwinner #IndustrialWearables #IndustrialAI #PhysicalAI #EmbodiedAI #EdgeAI #ComputerVision #SmartManufacturing #FutureOfWork #WorkplaceSafety #OpenSmartGogglesForIndustrialAIAssistance #TheAIHardwarePartner
Sebastian Christiansen retweeted
DeepSeek V4.1 Flash EXL3 at 2.81bpw is now available.
This is comparable to @MiaAI_lab EXL3 EAQ v1 2.9 bpw but slightly smaller, done by exllama3's experimental branch.
Designed for streaming using my TurboEXL3 fused kernels, I'm able to hit 57tps decode and 1400tps prefill, a roughly 60% and 90% speed up compared to the old version I had. These are preliminary numbers and it will go even faster when released in mlx-serve.
Why make another EXL3? I wanted it quantized using the self corrected experimental branch to compare with existing EXL3 - just happened that this turned out pretty good.
huggingface.co/OpensourceWTF…
Sebastian Christiansen retweeted
Ivan is cooking something for TF 😁
I'm starting to follow the white rabbit now!
Continuous batching is surrounded by mystery and legends for me, especially in the Apple Silicon world.
TensorFold 1.2 with dedicated PR is working much better and now M3 Ultra (in decode) is better than 2xDGX.
Still a long way to go. I'm trying to build a dedicated benchmark for this that I called DecodeWall.
As soon as it's in a good alpha stage, I'll release it!
Just a note... it takes forever. Here I've used 8 parallels requests with 14K tokens each, generating ~6.4K tokens to really stress the machines.
Now let's test GLM 5.3 Flash and improve the code!
MLX-Serve is coming for GGUF on Apple Silicon. Same week Sam calls your home RAM wasteful, MiniMax is thanking the builders squeezing a 428B model onto desks. The cloud wants your memory. We are busy using it.
Sebastian Christiansen retweeted
🚨 JUST IN: The CEO of Vercel says Local AI needs to keep spreading
He's right that the biggest models don't fit on a desk yet.
I've been running open-weight models on my Mac mini and I'm having the time of my life. A Mac Studio is on the way.
Freedom tech.
Own your intelligence.
Anyone that opposes this has something to sell you (perhaps your own intelligence back to you.)
Local models need to continue proliferating. The “absolute unit” massive models may be out of reach for now locally, so your best option is to, indeed, keep your options open. Own your harness, data, connections, runtime: your agents. Embrace open source.
Sebastian Christiansen retweeted
Own your intelligence.
Anyone who opposes this has something to sell you.
Own your intelligence.
Anyone that opposes this has something to sell you (perhaps your own intelligence back to you.)
Local models need to continue proliferating. The “absolute unit” massive models may be out of reach for now locally, so your best option is to, indeed, keep your options open. Own your harness, data, connections, runtime: your agents. Embrace open source.
Sebastian Christiansen retweeted
Today marks exactly 10 years since Hacker T. Dog delivered the greatest unscripted line in British television history.
"We're just normal men... We're just innocent men."
Sebastian Christiansen retweeted
MLX-Serve 26.11.1 - Released, change log & download here: github.com/ddalcu/mlx-serve/… ⭐️ ♥️
And here is my latest AI slop video about hoarding RAM.
