yesterday we released RL projects on TensorTonic.
you build the RL environment, write the agent, and implement Q-learning yourself until the agent learns to reach the goal.
tensortonic.com
We just released a new Multimodal AI project. Train your own tiny CLIP from scratch-
> build the scaled similarity matrix
> write the symmetric contrastive loss
> measure retrieval with recall at K
> classify zero-shot with prompts
> add hard negatives to fix the shortcut
> write the pairwise sigmoid loss
tensortonic.com
8 computer vision concepts worth understanding by implementing them yourself on TensorTonic:
> 2D Convolution - slide a kernel across an image, and work out the output size from padding and stride.
> Max Pooling - shrink a feature map by keeping only the strongest activation in each window.
> Batch Normalization - normalize activations across the batch, then rescale them with learned gamma and beta.
> Intersection over Union - score how well two boxes overlap by dividing the shared area by the combined area.
> Non-Max Suppression - remove duplicate detections by keeping the top-scoring box and dropping the ones that overlap it too much.
> Focal Loss - a cross-entropy variant that down-weights easy examples so the hard, rare ones drive the gradient.
> Dice Loss - train segmentation models on mask overlap, so a tiny object isn’t drowned out by a huge background.
> Receptive Field - compute how much of the input image each output unit can actually see through stacked layers.
link in comments.
almost 400K people have watched Stanford's CS336 on building language models from scratch.
but if you want to know whether you can actually build one, implement each piece yourself on TensorTonic with provided gpus to fine tune your model
tensortonic.com
Every LLM is 8 layers of ideas stacked on top of each other which you can implement on tensortonic:
Layer 1: Gradients
Write a tiny autograd engine. Value nodes, expression graphs, a neuron.
loss.backward() stops being a black box.
Layer 2: Tokens
Train BPE yourself and apply the merges by hand.
Layer 3: The block
RMSNorm, SwiGLU, RoPE, causal grouped-query attention.
Layer 4: Training at scale
FLOP estimates, mixed-precision memory, gradient accumulation.
Layer 5: Attention variants
MHA → MQA → GQA → MLA, then FlashAttention.
Layer 6: Kernels
Softmax, GELU and reductions in CUDA, then again in Triton.
Layer 7: Fine-tuning
QLoRA on Qwen3-4B with real medical Q&A.
Layer 8: Serving
Build your own Qwen3 inference server.
All 8 are graded, runnable problems on TensorTonic.
link in comments.
frontier labs are investing heavily in mechanistic interpretability to understand what’s happening inside neural networks.
we wanted to make these concepts more accessible to people who want to work on the same problems.
our latest release on @TensorTonic lets you build -
> sparse autoencoders from scratch
> inspect the features they learn
> test them through interventions.
tensortonic.com
We're dropping projects on one of these topics. Can you guess which one?
Lucky winners will get early access to it😉
About 950 billion parameters sit idle every time Mistral Large 4 writes a token, and they all stay loaded in GPU memory the whole time.
The model has roughly 1 trillion parameters, but a router sends each token (about a word) to a few “experts” and ignores the rest. Only around 50 billion do any work. The idle ones still have to be in memory in case the next token needs them. One third-party estimate puts the weights at about 1 TB, even in 8-bit.
Sparse experts are part of our Inference Engineering set, 30 problems across 6 sections, if you’d rather build the idea than read about it.
tensortonic.com
TensorTonic retweeted
Replying to @TensorTonic
@TensorTonic is an excellent platform for AI and Data Science students, i have used it for the first time and love it special the problems part
TensorTonic retweeted
Somehow @TensorTonic is the only ML-coding platform that has grasped enough attention from me to keep my streak alive.
Amazing work!!!!!!
TensorTonic retweeted
136 days until GATE DA
>done with perceptron convergence theorem
>started with PCA
>revised some parts of linear algebra
>worked on my project
>solved 6 problems on @TensorTonic
136 days until GATE DA
>Started with Perceptron
>Did 3 problems on @TensorTonic
>worked on my project






















