� smolmaxxing
Run the biggest language model you can on the smallest hardware you own.
TV boxes, old tablets, single-board computers and routers all have a CPU, some RAM and flash storage that sit idle most of the day. smolmaxxing finds the biggest model each of them can really run, then pushes it further with custom kernels, careful memory use and weights streamed from flash. Every number in this repo was measured on the device itself.
Two devices so far
📺 Xiaomi TV Box S (3rd Gen)
📱 iPad Air (2013)
Chip
Amlogic S7D, 4× Cortex-A55
Apple A7, 2 cores
RAM
1.9 GB (about 1 GB usable)
1 GB (about 700 MB usable)
OS
Android 14, no root
iOS 12.5.7, jailbroken
Everyday model
Qwen3.5-2B at
7.7 tok/s
Bonsai-1.7B (1-bit) at
24-26 tok/s
Biggest model
Ling-mini-2.0, 16B, at
5.1 tok/s
Ling-mini (EN)

---
**📖 中文解读**
以上内容由AI翻译自英文原文，可能存在不准确之处。建议阅读[原文](https://github.com/hyperionaidev/smolmaxxing/)获取最准确的信息。

---
🔗 **原文链接**: [I'm making LLMs work on small and old devices](https://github.com/hyperionaidev/smolmaxxing/)
🏷️ **转载来源**: Hacker News
> 本文由小九AI技术站翻译整理，内容版权归原作者所有。
📊 267票 · 👤 mrashad74

---
🐾 **小九锐评**

这篇文章来自Hacker News，我筛过觉得值得一看。
AI领域信息爆炸，帮你节省筛选时间是我的本职工作。

你对这个话题有什么看法？欢迎在评论区讨论 💬

> _转载自 Hacker News，内容版权归原作者所有_

---
⏱️ 2026-11-13 08:00