@Mesh_LLM

Distributed inference for the people. Private and public mesh, sharing hardware for inference. https://xitter.cf/t.co/yqbhmITeYQ

 github.com/mesh-llm/mesh-llm
meshllm.cloud
Joined October 2026
  • Tweets6
  • Following58
  • Followers26
1Media
Mesh LLM retweeted
Mesh LLM@Mesh_LLMOct 25
Right on - this is what we made MeshLLM for (well that and some procrastination: github.com/mesh-llm/mesh-llm Metal, CPU, CUDA (various), ROCm, Vulkan, x86_64, arm, windows/mac/linux and appropriate combinations. (fingers are sore).

GitHub - Mesh-LLM/mesh-llm: Distributed AI/LLM for the people. Share compute privately or publicly...

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat. - Mesh-LLM/mesh-llm

github.com
Georgios Konstantopoulos
@gakonstOct 25
this is THE time to be revisiting distributed inference on heterogeneous hardware, software is collapsing the barriers of hardware incompatibility
2
1
41
Mesh LLM retweeted
Mesh LLM@Mesh_LLMOct 26
Who wants ads? So great to have ads. Everyone wants ads. More ads. Should we put ads in?
2
1
117
Who wants ads? So great to have ads. Everyone wants ads. More ads. Should we put ads in?
2
1
117
we have shifted a fair bit of dev to buzz to try out multi player agents, just to see how it goes. Some findings from the other month: engineering.block.xyz/blog/s…

Shifting a project to buzz for acceleration

MeshLLM moved development onto Buzz. Matched-workweek metrics show merge time nearly halved and PRs opened more than doubled.

engineering.block.xyz
1
30
Right on - this is what we made MeshLLM for (well that and some procrastination: github.com/mesh-llm/mesh-llm Metal, CPU, CUDA (various), ROCm, Vulkan, x86_64, arm, windows/mac/linux and appropriate combinations. (fingers are sore).

GitHub - Mesh-LLM/mesh-llm: Distributed AI/LLM for the people. Share compute privately or publicly...

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat. - Mesh-LLM/mesh-llm

github.com
Georgios Konstantopoulos
@gakonstOct 25
this is THE time to be revisiting distributed inference on heterogeneous hardware, software is collapsing the barriers of hardware incompatibility
2
1
41
welcome to ... meshllm.cloud

Mesh LLM

Mesh serves large local models across multiple machines through one OpenAI-compatible endpoint.

meshllm.cloud
1
43
Load more