
#AR / #VR engineer. Computer Science degree, 30 years+ of programming. 3D/CV/AI enthusiast. #unity since 2009, #AppleVisionPro / Quest. XR engineer at @rezzil
Brazil
Joined February 2020
- Tweets843
- Following471
- Followers531
- Likes18.2K
Samuel Morais ᯅ retweeted
"Apple is counting on integration with the apps people already use on their iPhones to be a key differentiator for the glasses, I’m told. The idea is to make those apps available through Siri, allowing users to get things done without grabbing their phones. Apple believes its large developer ecosystem could give it an advantage over Meta Platforms Inc. and Alphabet Inc.’s Google, potentially providing countless third-party integrations when the glasses go on sale.
Apple wants developers working on those tie-ins now. The company is preparing precise controls for its own apps for the iOS 27.3 release in December and has indicated that outside app support will launch later. The effort is reminiscent of Apple encouraging developers to build augmented reality iPhone apps before it released the Vision Pro headset. Because of this big push for outside Siri apps, Apple continues to aim for a glasses introduction at its developer conference in June 2027.
The thinking inside Apple is that while Meta has the increasingly popular Muse agent, Apple has the App Store. Because the Siri integrations are being developed for the iPhone first, software makers won’t need to build separate applications for the glasses. Instead, developers will be able to make specific functions within their existing apps accessible to Siri, allowing users to complete tasks through voice commands without opening or navigating the apps themselves."
Samuel Morais ᯅ retweeted
4D Gaussian splats, or volumetric video capture, is finally becoming affordable and doable thanks to Apple’s latest innovation. At the recent launch of Apple’s MacBook Pro with PROLED XDR Display, we witnessed an end-to-end workflow that empowers independent artists and filmmakers to capture 4D Gaussian splats with only 9 iPhones, process them on an all-Apple hardware pipeline, and then re-shoot, re-light and re-time them in post with the new touchscreen MacBook Pro and your familiar software package like DaVinci Resolve 21, Unity, Blender and Hudinin.
This video gives you a glimpse of the future of filmmaking that is going to take over Hollywood and change cinema history forever. And we are just at the beginning of immersive filmmaking. Exciting time to be an artist!
Watch the full workflow here: youtu.be/j7MBNCk4DZY
#gaussiansplatting #4dgs
Samuel Morais ᯅ retweeted
“There’s only one winner, and it’s Dom!”
Joe Cole and Owen Hargreaves step into the Virtual Pitch to break down Dominic Calvert-Lewin’s striker instinct 🎯
📺 Stream on TNT Sports & HBO Max: streamonm.ax/4AuN62x
Samuel Morais ᯅ retweeted
AI生成映像で高齢者の転倒シーンを再現し、転倒検知を検証👴🤖
🔹歩行器を使う高齢者の転倒をAIでシミュレーション
🔹カメラ角度や照明、歩行器などの条件を変えて検証
🔹姿勢推定やオプティカルフローで転倒時の動きを評価
Jorge Guevaraさんの開発・検証。
情報元はリプ欄。
This is what I’m talking about!
Congrats, bro!
👏👏👏👏👏👏
GPT-6 Astra turned my room into Studio Ghibli, on Apple Vision Pro 🤯
It constructs virtual objects located and sized exactly as real objects. Then they can be styled however we want, in REAL TIME.
I'll share later how this all works. For now, I just want to say, wow.
4
439
GPT-6 Astra turned my room into Studio Ghibli, on Apple Vision Pro 🤯
It constructs virtual objects located and sized exactly as real objects. Then they can be styled however we want, in REAL TIME.
I'll share later how this all works. For now, I just want to say, wow.
Samuel Morais ᯅ retweeted
Introducing MONAI Physio at #MICCAI2026.
3D and 4D medical images ➡️ personalized cardiac and respiratory digital twins.
This open-source Project MONAI toolkit lets researchers model how the heart beats and lungs move for simulation, visualization, and reproducible research.
Explore the project 👉 nvda.ws/3VLmJFq
This GPT-6 Astra trend, in my opinion, is revealing something interesting:
People are fascinated by 3D.
Not only we, the "enthusiasts".
The "normies" are fascinated too; they just don't know it yet.
3D is the next frontier. And XR will benefit from it soon.
Okay, this is genuinely impressive.
I asked GPT-6 Astra to help me understand my own ankle pain. It gave me a full interactive 3D atlas — bones, ligaments, tendons, real motion axes, sliders for plantarflexion and inversion, and a live readout of what each ligament is doing.
One session.
317
Samuel Morais ᯅ retweeted
GPT-6 changes 3D modeling forever.
It works inside Blender completely autonomously, like an artist: gathers reference photos on its own, builds the scene, renders test frames, checks them against the references, then fixes what's off.
When the scene holds up, it ships it to Unreal Engine 5 as a walkable level.
Clips from the @OpenAI launch. More demos in the thread.
Full announcement: openai.com/index/gpt-6-astra…
Samuel Morais ᯅ retweeted
XREAL Aura reservations hit 10,000 as global launch nears - @GamesBeat share.google/j0bkNNlcjPoTveX…
There will be signs.... 🧐
I dove deeper into the N109 reference
It’s only in a single Private Framework file reserved for Apple Devices with integrated LiDAR sensors
It has the newer “Peridot” sensor, aka Sony IMX591, that started shipping in iPhone 15 Pro and later
M2/M5 Vision Pros use the older one
2
254
Interesting way of having shared co-location using hand tracking as the shared anchor.
EXCLUSIVE: "I tried a groundbreaking new idea for hand tracking that successfully syncs the experience of people in headsets from Apple and Meta." —@hmltn
🔗 goodvirtualreality.com/p/han…
Over the next month or so, we’re likely to see at least four new XR devices announced. Things are about to get busy again.
Interestingly, a few of them seem pretty underestimated right now.
Which one are you most excited about?
By then, I think the way we look at the next phase of XR could be very different from how we see it today. It could be a real inflection point for the industry.
Samuel Morais ᯅ retweeted
This soldiering training is the most impressive and immersive I've ever tried. It is 10x better than a YouTube tutorial video. It really allowed me to see the procedure from all the points of view, and even get super close to get the details.
It is a collaboration between @gracia_vr and Imperial College London: they recorded a soldering session with Gaussian Splatting Videos (4DGS), so that you can enjoy it from your VR headset. You can see the action happening in front of you; you can pause and re-watch what you need, change the point of view, get closer, get more distant. And the quality with which it has been shot is impressive: I enjoyed this experience with my DELL Pro Max Tower T2 with NVIDIA Pro RTX 6000, and I could really see all the small details of the PCB that was being soldered!
I was really impressed by it. But I also noticed some drawbacks. First of all, some scenes have artifacts that make seeing the details of the PCB hard. I think when it comes to training involving small details, the capture and reproduction of the splat should be flawless. Then, as much as I loved it as a passive experience, I would have liked to have also some sort of practice session in VR. The power of VR is to let you learn by doing in full safety, and this kind of training does not exploit it. But maybe the best way to enjoy it would be in MR, where you have this training video close to a real workbench where you do the actual soldering while following the tutorial.
Gaussian Splat can really revolutionize training: this kind of recording is much better than any flatscreen experience, and more accurate than any 3D CGI recostruction. I suggest you give it a go at this experience in the Gracia app (it's free). Then let me know your impressions!
#VirtualReality #training #DellProPrecision #GaussianSplat #technology
[Disclaimer: I'm a DELL Pro Precision Ambassador, and this is why I mentioned the model of my PC. I have been given a PC to do cool tests and share my results on social media. No monetary compensation or sales affiliation is part of the collaboration]
Samuel Morais ᯅ retweeted
品質はまだまだだけどフルスクラッチ・自作の商用利用可能な4DGSシステム出来てきた。3DGS連番のパラパラ漫画方式じゃないし、RTX4090レベルでトレーニング可能。
比較しやすいように試しによく使われてる4dvのcorgiデータでも試した。(自作の撮影の方では36台のXperiaを使ってる)
#4dgs
Samuel Morais ᯅ retweeted
Introducing LiteReality-Agent 🏠🤖✨
An agentic system that turns room scans into realistic, interactable 3D scenes.
No tool currently exists that can turn an entire room scan into an interactable 3D scene, so we built one! 🚀
Scan your room with the app we built, then let LiteReality-Agent turn it into a cool digital copy with articulated assets. 🛋️✨
Have fun! 🚀
🌐 Project page: litereality.github.io/Litere…
💻 Code: github.com/LiteReality/LiteR…
📱 App: apps.apple.com/gb/app/litere…
📝 Blog: litereality.github.io/Litere…
Samuel Morais ᯅ retweeted
People forget that the ONLY place outside of theaters you can see watch true IMAX footage (1.43:1 aspect ratio) is…
in the Apple Vision Pro via the IMAX app
New blog: "Apple Vision Pro—A Revolution for Home Video Formats"
I talk about how AVP has brought certain movie formats (HFR, 4k HDR 3D, 1.43 IMAX) that have never been available outside of a select few theater straight to your face
azadux.blog/2024/09/15/visio…
Samuel Morais ᯅ retweeted
More VisionOS 27 object tracking testing … telemetry of the @FIFAWorldCup soccer ball. #applevisionpro





















