Your AI Operator for Web, Android, Automation & Testing

Joined April 2024
Meet Midscene Test: an E2E testing framework built for natural language. Write your test cases as plain-language steps that AI runs by looking at the screen, then plug in your own business logic as Nodes to make it your team's own E2E framework. 🧪 midscenejs.com/midscene-test…
1
1
192
Midscene retweeted
用 PaperDIY 做了这么个电子墨水监控屏。其中最耗时的部分是找 IT 审批 IoT 设备入网工单....
#M5StackNew 🎉 PaperDIY Assembly & Complete Kit Released PaperDIY Assembly & Complete Kit are DIY e-paper development board kits, including main control board, 140mAh lithium battery, e-paper display and acrylic screen pressure plate, suitable for building desktop information displays, electronic labels, maker DIY projects, and embedded hardware development experiments. ✨Features ✅ ESP32-S3R8 core controller (16MB Flash, 8MB PSRAM, 2.4 GHz Wi-Fi) ✅ 4.7" e-paper display, 960×540 resolution, 16-level grayscale display ✅ Onboard DC 3.7V battery connector, Low-power power management design ✅ 140mAh lithium battery, microSD card slot * PaperDIY Assembly Kit: assembly completed by the user, PaperDIY Complete Kit: includes a pre-installed 3D-printed enclosure, with hardware assembly completed at the factory. 🛒 Get Yours: Official Store: PaperDIY Assembly Kit: bit.ly/4jYssSu PaperDIY Complete Kit: bit.ly/3TW9Lo3 AliExpress: PaperDIY Assembly Kit: bit.ly/4i79YNj PaperDIY Complete Kit: bit.ly/4s4mLEw #M5Stack #M5StackNew #IoT #EINK #EPaper #DIYElectronics #Makers
1
9
236
Playing a round of tile matching game in Midscene with Jev 1.4’s new vision capabilities. Planning averages just 0.4s per call, and model fees are about $0.006 for the whole game. Midscene, an AI E2E automation framework built around vision.
1
1
1
583
Midscene retweeted
I built a voice-controlled Android app with Midscene—even WeChat works. No ADB, developer mode or USB cable. Wireless Codex control too. 21s demo + screenshot. Follow for beta + open-source updates. Star Midscene: github.com/web-infra-dev/mid…
2
1
2
127
cool(๑•̀ㅂ•́)و✧
一句话操控 android 上的任何 App,微信也不在话下! 最近 @zhongerxin 的 iPhone use 非常火,我也手痒痒,做了个语音控制安卓手机的 App,底层用的是 Midscene 纯视觉方案,效果见视频! 不用 ADB,不用开发者模式,也不用插线,随时拿出手机,说说想做什么就行。 @dingyi 这个 App 也支持通过 Codex 插件无线控制,效果见配图! 接下来打算开源,想玩的可以关注我。 后面还会基于 Midscene 做更多有意思的产品,也欢迎给 Midscene 点个 star: github.com/web-infra-dev/mid… 顺便推荐 iPhone use: github.com/zhongerxin/iPhone…
1
164
Midscene retweeted
Midscene supports these capabilities too. As early as last year, community developers had extended it to control a robotic arm for testing in-car infotainment systems. xitter.cf/midscene_ai/status/200…
Midscene v1.0 Officially Released – Vision-Driven, UI Automation Experience Leap 🤖 Community Case: Using Midscene to Control Robotic Arm, Breaking the Dimensional Barrier, Completing In-Vehicle Infotainment Testing! This is real E2E!!!
1
1
36
Midscene, running directly on an Android device 📱 This community-built app runs natural-language and YAML automation on the phone, with reports you can inspect there. No PC connection needed. Now featured in Awesome Midscene. Built by lhuanyu 👏 github.com/lhuanyu/midscene-…
2
2
454
A super fast Jev test run ⚡ Watch Jev × Midscene Test in action with this community-built jevAct runner. It also works with an existing Playwright page. Now featured in Awesome Midscene. Built by KiritoKing 👏 github.com/KiritoKing/midsce…
1
3
8
866
Midscene retweeted
我把 Midscene 接进了 Doubao Say 的 CI。 AI E2E 在 Ubuntu 和真实 Omarchy 桌面跑,直接操作 GTK、Hyprland 和系统菜单。 用例都带节点截图、AI 判断和回放报告。 我也在维护 Midscene,就拿 Doubao Say 来 dogfood:能不能测真 Linux 桌面,跑一遍 CI 就知道了。 github.com/web-infra-dev/mid…
2
2
2
178
Midscene retweeted
我们一直在思考:AI 自动化测试的第一性原理是什么? 答案是——纯视觉。 人类怎么操作界面,AI 就怎么操作。 现在,Midscene 全平台操控 Skills 已上线 clawhub.ai: iOS · Android · Web · Mac · Linux · Windows! 快让你的 @openclaw 用这一套方案,控制所有平台吧!
11
20
2
208
25,557
AI Android testing costs basically nothing. We ran a full flow on Samsung: scroll, tap, 3 dialogs, read battery. $0.04 for 10 model calls with screenshots. $0.004/call. 256K tier 20x away. 30-step E2E? ~$0.25. Stop worrying about tokens. Worry about CSS selectors. #Midscene
1
409
Midscene.js landed #6 on AndroidWorld 🤖 • Pass@1: 93.10% • Pass@2: 95.69% • Pass@3: 97.41% One model, screenshots only. 🧵
1
283
What stands out isn't just the rank — it's the setup. Most agents ranked above us stack multiple models or add an accessibility tree. Midscene runs on a single Gemini-3.5-Flash, acting from screenshots alone. No DOM, no a11y tree.
1
93
Got to hang out with @otto_ottomao from the @midscene_ai team in Beijing today. Brought my two older boys along to learn what I do in these meetings.
4
66
8,076
Midscene recent highlights (v1.8 & v1.9) 🎉 1/ Midscene Studio desktop is now in Beta: switch between Web, Android, iOS, HarmonyOS, and Computer Playground in one native desktop app, with direct device-preview interaction.
1
2
8
830
5/ Multi-platform support and the toolchain keep improving: iOS can connect to external WDA, sessions and devices are easier to extend, Computer supports RDP connection options, and CLI / MCP / Report received multiple UX improvements.
1
85