Meet Midscene Test: an E2E testing framework built for natural language. Write your test cases as plain-language steps that AI runs by looking at the screen, then plug in your own business logic as Nodes to make it your team's own E2E framework. 🧪
midscenejs.com/midscene-test…
Midscene retweeted
用 PaperDIY 做了这么个电子墨水监控屏。其中最耗时的部分是找 IT 审批 IoT 设备入网工单....
#M5StackNew 🎉 PaperDIY Assembly & Complete Kit Released
PaperDIY Assembly & Complete Kit are DIY e-paper development board kits, including main control board, 140mAh lithium battery, e-paper display and acrylic screen pressure plate, suitable for building desktop information displays, electronic labels, maker DIY projects, and embedded hardware development experiments.
✨Features
✅ ESP32-S3R8 core controller (16MB Flash, 8MB PSRAM, 2.4 GHz Wi-Fi)
✅ 4.7" e-paper display, 960×540 resolution, 16-level grayscale display
✅ Onboard DC 3.7V battery connector, Low-power power management design
✅ 140mAh lithium battery, microSD card slot
* PaperDIY Assembly Kit: assembly completed by the user, PaperDIY Complete Kit: includes a pre-installed 3D-printed enclosure, with hardware assembly completed at the factory.
🛒 Get Yours:
Official Store:
PaperDIY Assembly Kit: bit.ly/4jYssSu
PaperDIY Complete Kit: bit.ly/3TW9Lo3
AliExpress:
PaperDIY Assembly Kit: bit.ly/4i79YNj
PaperDIY Complete Kit: bit.ly/4s4mLEw
#M5Stack #M5StackNew #IoT #EINK #EPaper #DIYElectronics #Makers
Playing a round of tile matching game in Midscene with Jev 1.4’s new vision capabilities.
Planning averages just 0.4s per call, and model fees are about $0.006 for the whole game.
Midscene, an AI E2E automation framework built around vision.
Usage docs: midscenejs.com/model-common-…
Midscene retweeted
I built a voice-controlled Android app with Midscene—even WeChat works.
No ADB, developer mode or USB cable. Wireless Codex control too.
21s demo + screenshot. Follow for beta + open-source updates.
Star Midscene: github.com/web-infra-dev/mid…
cool(๑•̀ㅂ•́)و✧
一句话操控 android 上的任何 App,微信也不在话下!
最近 @zhongerxin 的 iPhone use 非常火,我也手痒痒,做了个语音控制安卓手机的 App,底层用的是 Midscene 纯视觉方案,效果见视频!
不用 ADB,不用开发者模式,也不用插线,随时拿出手机,说说想做什么就行。
@dingyi 这个 App 也支持通过 Codex 插件无线控制,效果见配图!
接下来打算开源,想玩的可以关注我。
后面还会基于 Midscene 做更多有意思的产品,也欢迎给 Midscene 点个 star:
github.com/web-infra-dev/mid…
顺便推荐 iPhone use: github.com/zhongerxin/iPhone…
Midscene retweeted
Replying to @o_kwasniewski @BleedingDev
Midscene supports these capabilities too. As early as last year, community developers had extended it to control a robotic arm for testing in-car infotainment systems.
xitter.cf/midscene_ai/status/200…
Midscene, running directly on an Android device 📱
This community-built app runs natural-language and YAML automation on the phone, with reports you can inspect there. No PC connection needed.
Now featured in Awesome Midscene. Built by lhuanyu 👏
github.com/lhuanyu/midscene-…
A super fast Jev test run ⚡
Watch Jev × Midscene Test in action with this community-built jevAct runner. It also works with an existing Playwright page.
Now featured in Awesome Midscene. Built by KiritoKing 👏
github.com/KiritoKing/midsce…
Midscene retweeted
我把 Midscene 接进了 Doubao Say 的 CI。
AI E2E 在 Ubuntu 和真实 Omarchy 桌面跑,直接操作 GTK、Hyprland 和系统菜单。
用例都带节点截图、AI 判断和回放报告。
我也在维护 Midscene,就拿 Doubao Say 来 dogfood:能不能测真 Linux 桌面,跑一遍 CI 就知道了。
github.com/web-infra-dev/mid…
Midscene retweeted
我们一直在思考:AI 自动化测试的第一性原理是什么?
答案是——纯视觉。 人类怎么操作界面,AI 就怎么操作。
现在,Midscene 全平台操控 Skills 已上线 clawhub.ai:
iOS · Android · Web · Mac · Linux · Windows! 快让你的 @openclaw 用这一套方案,控制所有平台吧!
AI Android testing costs basically nothing.
We ran a full flow on Samsung: scroll, tap, 3 dialogs, read battery.
$0.04 for 10 model calls with screenshots. $0.004/call.
256K tier 20x away. 30-step E2E? ~$0.25.
Stop worrying about tokens. Worry about CSS selectors.
#Midscene
Midscene.js landed #6 on AndroidWorld 🤖
• Pass@1: 93.10%
• Pass@2: 95.69%
• Pass@3: 97.41%
One model, screenshots only. 🧵
What stands out isn't just the rank — it's the setup.
Most agents ranked above us stack multiple models or add an accessibility tree. Midscene runs on a single Gemini-3.5-Flash, acting from screenshots alone. No DOM, no a11y tree.
It's open-source, and we published the full per-task reports — round by round, pass and fail.
Run config: Gemini-3.5-Flash · Midscene v1.9.5 · DeepThink on
→ midscenejs.com/zh/android-wo…
Midscene retweeted
Got to hang out with @otto_ottomao from the @midscene_ai team in Beijing today. Brought my two older boys along to learn what I do in these meetings.
Midscene 1.10 brings BDD / Gherkin scripts, plus two more updates:
1. Structured natural language for AI UI automation
2. Doubao-Seed-2.1 support
3. MCP Server retired; use Skills / CLI workflows instead
Docs:
midscenejs.com/advanced/bdd-…
Changelog:
midscenejs.com/changelog
Midscene recent highlights (v1.8 & v1.9) 🎉
1/ Midscene Studio desktop is now in Beta: switch between Web, Android, iOS, HarmonyOS, and Computer Playground in one native desktop app, with direct device-preview interaction.



















