Samuel Morais ᯅ (@SamuelMorais) header
Samuel Morais ᯅ (@SamuelMorais) profile picture

#AR / #VR engineer. Computer Science degree, 30 years+ of programming. 3D/CV/AI enthusiast. #unity since 2009, #AppleVisionPro / Quest. XR engineer at @rezzil

Brazil
Joined February 2020
Photo by Samuel Morais ᯅ (@SamuelMorais)Photo by Samuel Morais ᯅ (@SamuelMorais)Photo by Samuel Morais ᯅ (@SamuelMorais)Photo by Samuel Morais ᯅ (@SamuelMorais)Photo by Samuel Morais ᯅ (@SamuelMorais)Photo by Samuel Morais ᯅ (@SamuelMorais)Photo by Samuel Morais ᯅ (@SamuelMorais)Photo by Samuel Morais ᯅ (@SamuelMorais)Photo by Samuel Morais ᯅ (@SamuelMorais)Photo by Samuel Morais ᯅ (@SamuelMorais)
Samuel Morais ᯅ retweeted
"Apple is counting on integration with the apps people already use on their iPhones to be a key differentiator for the glasses, I’m told. The idea is to make those apps available through Siri, allowing users to get things done without grabbing their phones. Apple believes its large developer ecosystem could give it an advantage over Meta Platforms Inc. and Alphabet Inc.’s Google, potentially providing countless third-party integrations when the glasses go on sale. Apple wants developers working on those tie-ins now. The company is preparing precise controls for its own apps for the iOS 27.3 release in December and has indicated that outside app support will launch later. The effort is reminiscent of Apple encouraging developers to build augmented reality iPhone apps before it released the Vision Pro headset. Because of this big push for outside Siri apps, Apple continues to aim for a glasses introduction at its developer conference in June 2027. The thinking inside Apple is that while Meta has the increasingly popular Muse agent, Apple has the App Store. Because the Siri integrations are being developed for the iPhone first, software makers won’t need to build separate applications for the glasses. Instead, developers will be able to make specific functions within their existing apps accessible to Siri, allowing users to complete tasks through voice commands without opening or navigating the apps themselves."
Apple has wanted to unveil its smart glasses at WWDC 2027 and ship them before year-end. But software is running behind, leaving both targets uncertain despite remaining in place as of today. Much of the hardware is largely finalized.
11
5
25
2,282
Samuel Morais ᯅ retweeted
4D Gaussian splats, or volumetric video capture, is finally becoming affordable and doable thanks to Apple’s latest innovation. At the recent launch of Apple’s MacBook Pro with PROLED XDR Display, we witnessed an end-to-end workflow that empowers independent artists and filmmakers to capture 4D Gaussian splats with only 9 iPhones, process them on an all-Apple hardware pipeline, and then re-shoot, re-light and re-time them in post with the new touchscreen MacBook Pro and your familiar software package like DaVinci Resolve 21, Unity, Blender and Hudinin. This video gives you a glimpse of the future of filmmaking that is going to take over Hollywood and change cinema history forever. And we are just at the beginning of immersive filmmaking. Exciting time to be an artist! Watch the full workflow here: youtu.be/j7MBNCk4DZY #gaussiansplatting #4dgs
3
19
1
105
6,483
Samuel Morais ᯅ retweeted
“There’s only one winner, and it’s Dom!” Joe Cole and Owen Hargreaves step into the Virtual Pitch to break down Dominic Calvert-Lewin’s striker instinct 🎯 📺 Stream on TNT Sports & HBO Max: streamonm.ax/4AuN62x
6
16
6
205
76,456
Samuel Morais ᯅ retweeted
AI生成映像で高齢者の転倒シーンを再現し、転倒検知を検証👴🤖 🔹歩行器を使う高齢者の転倒をAIでシミュレーション 🔹カメラ角度や照明、歩行器などの条件を変えて検証 🔹姿勢推定やオプティカルフローで転倒時の動きを評価 Jorge Guevaraさんの開発・検証。 情報元はリプ欄。
9
55
6
440
26,629
This is what I’m talking about! Congrats, bro! 👏👏👏👏👏👏
GPT-6 Astra turned my room into Studio Ghibli, on Apple Vision Pro 🤯 It constructs virtual objects located and sized exactly as real objects. Then they can be styled however we want, in REAL TIME. I'll share later how this all works. For now, I just want to say, wow.
4
439
Samuel Morais ᯅ retweeted
GPT-6 Astra turned my room into Studio Ghibli, on Apple Vision Pro 🤯 It constructs virtual objects located and sized exactly as real objects. Then they can be styled however we want, in REAL TIME. I'll share later how this all works. For now, I just want to say, wow.
42
84
22
964
83,013
Samuel Morais ᯅ retweeted
Introducing MONAI Physio at #MICCAI2026. 3D and 4D medical images ➡️ personalized cardiac and respiratory digital twins. This open-source Project MONAI toolkit lets researchers model how the heart beats and lungs move for simulation, visualization, and reproducible research. Explore the project 👉 nvda.ws/3VLmJFq
22
104
13
672
56,561
Samuel Morais ᯅ retweeted
100% the best writing on IK I've seen. 👀 theorangeduck.com/page/inver…
21
229
3
2,865
130,621
This GPT-6 Astra trend, in my opinion, is revealing something interesting: People are fascinated by 3D. Not only we, the "enthusiasts". The "normies" are fascinated too; they just don't know it yet. 3D is the next frontier. And XR will benefit from it soon.
Okay, this is genuinely impressive. I asked GPT-6 Astra to help me understand my own ankle pain. It gave me a full interactive 3D atlas — bones, ligaments, tendons, real motion axes, sliders for plantarflexion and inversion, and a live readout of what each ligament is doing. One session.
317
Samuel Morais ᯅ retweeted
GPT-6 changes 3D modeling forever. It works inside Blender completely autonomously, like an artist: gathers reference photos on its own, builds the scene, renders test frames, checks them against the references, then fixes what's off. When the scene holds up, it ships it to Unreal Engine 5 as a walkable level. Clips from the @OpenAI launch. More demos in the thread. Full announcement: openai.com/index/gpt-6-astra…
65
153
26
1,695
161,878
Samuel Morais ᯅ retweeted
ChatGPT moment for world models.
Introducing Atlas: The world's first multimodal world model that generates image and video frames with pixel-perfect camera control and reconstructs them in 3D. Model the world, move the camera, and simulate space & time.
1
4
22
1,288
There will be signs.... 🧐
I dove deeper into the N109 reference It’s only in a single Private Framework file reserved for Apple Devices with integrated LiDAR sensors It has the newer “Peridot” sensor, aka Sony IMX591, that started shipping in iPhone 15 Pro and later M2/M5 Vision Pros use the older one
2
254
Interesting way of having shared co-location using hand tracking as the shared anchor.
EXCLUSIVE: "I tried a groundbreaking new idea for hand tracking that successfully syncs the experience of people in headsets from Apple and Meta." —@hmltn 🔗 goodvirtualreality.com/p/han…
1
6
1,199
Samuel Morais ᯅ retweeted
Over the next month or so, we’re likely to see at least four new XR devices announced. Things are about to get busy again. Interestingly, a few of them seem pretty underestimated right now. Which one are you most excited about? By then, I think the way we look at the next phase of XR could be very different from how we see it today. It could be a real inflection point for the industry.
20
8
1
97
8,372
Samuel Morais ᯅ retweeted
This soldiering training is the most impressive and immersive I've ever tried. It is 10x better than a YouTube tutorial video. It really allowed me to see the procedure from all the points of view, and even get super close to get the details. It is a collaboration between @gracia_vr and Imperial College London: they recorded a soldering session with Gaussian Splatting Videos (4DGS), so that you can enjoy it from your VR headset. You can see the action happening in front of you; you can pause and re-watch what you need, change the point of view, get closer, get more distant. And the quality with which it has been shot is impressive: I enjoyed this experience with my DELL Pro Max Tower T2 with NVIDIA Pro RTX 6000, and I could really see all the small details of the PCB that was being soldered! I was really impressed by it. But I also noticed some drawbacks. First of all, some scenes have artifacts that make seeing the details of the PCB hard. I think when it comes to training involving small details, the capture and reproduction of the splat should be flawless. Then, as much as I loved it as a passive experience, I would have liked to have also some sort of practice session in VR. The power of VR is to let you learn by doing in full safety, and this kind of training does not exploit it. But maybe the best way to enjoy it would be in MR, where you have this training video close to a real workbench where you do the actual soldering while following the tutorial. Gaussian Splat can really revolutionize training: this kind of recording is much better than any flatscreen experience, and more accurate than any 3D CGI recostruction. I suggest you give it a go at this experience in the Gracia app (it's free). Then let me know your impressions! #VirtualReality #training #DellProPrecision #GaussianSplat #technology [Disclaimer: I'm a DELL Pro Precision Ambassador, and this is why I mentioned the model of my PC. I have been given a PC to do cool tests and share my results on social media. No monetary compensation or sales affiliation is part of the collaboration]
11
62
11
531
38,641
Samuel Morais ᯅ retweeted
品質はまだまだだけどフルスクラッチ・自作の商用利用可能な4DGSシステム出来てきた。3DGS連番のパラパラ漫画方式じゃないし、RTX4090レベルでトレーニング可能。 比較しやすいように試しによく使われてる4dvのcorgiデータでも試した。(自作の撮影の方では36台のXperiaを使ってる) #4dgs
7
29
2
247
29,394
Samuel Morais ᯅ retweeted
Introducing LiteReality-Agent 🏠🤖✨ An agentic system that turns room scans into realistic, interactable 3D scenes. No tool currently exists that can turn an entire room scan into an interactable 3D scene, so we built one! 🚀 Scan your room with the app we built, then let LiteReality-Agent turn it into a cool digital copy with articulated assets. 🛋️✨ Have fun! 🚀 🌐 Project page: litereality.github.io/Litere… 💻 Code: github.com/LiteReality/LiteR… 📱 App: apps.apple.com/gb/app/litere… 📝 Blog: litereality.github.io/Litere…
35
129
14
1,115
152,931
Samuel Morais ᯅ retweeted
People forget that the ONLY place outside of theaters you can see watch true IMAX footage (1.43:1 aspect ratio) is… in the Apple Vision Pro via the IMAX app
New blog: "Apple Vision Pro—A Revolution for Home Video Formats" I talk about how AVP has brought certain movie formats (HFR, 4k HDR 3D, 1.43 IMAX) that have never been available outside of a select few theater straight to your face azadux.blog/2024/09/15/visio…
10
6
81
11,768
Samuel Morais ᯅ retweeted
More VisionOS 27 object tracking testing … telemetry of the @FIFAWorldCup soccer ball. #applevisionpro
5
53
6,399