Abdul Rahman retweeted
I spent 10% of my life contributing to the development of the #VisionPro while I worked at Apple as a Neurotechnology Prototyping Researcher in the Technology Development Group. Itβs the longest Iβve ever worked on a single effort. Iβm proud and relieved that itβs finally announced. Iβve been working on AR and VR for ten years, and in many ways, this is a culmination of the whole industry into a single product. Iβm thankful I helped make it real, and Iβm open to consulting and taking calls if youβre looking to enter the space or refine your strategy.
The work I did supported the foundational development of Vision Pro, the mindfulness experiences, ββββββ products, and also more ambitious moonshot research with neurotechnology. Like, predicting youβll click on something before you do, basically mind reading. I was there for 3.5 years and left at the end of 2021, so Iβm excited to experience how the last two years brought everything together. Iβm really curious what made the cut and what will be released later on.
Specifically, Iβm proud of contributing to the initial vision, strategy and direction of the ββββββ program for Vision Pro. The work I did on a small team helped green light that product category, and I think it could have significant global impact one day.
The large majority of work I did at Apple is under NDA, and was spread across a wide range of topics and approaches. But a few things have become public through patents which I can cite and paraphrase below.
Generally as a whole, a lot of the work I did involved detecting the mental state of users based on data from their body and brain when they were in immersive experiences.
So, a user is in a mixed reality or virtual reality experience, and AI models are trying to predict if you are feeling curious, mind wandering, scared, paying attention, remembering a past experience, or some other cognitive state. And these may be inferred through measurements like eye tracking, electrical activity in the brain, heart beats and rhythms, muscle activity, blood density in the brain, blood pressure, skin conductance etc.
There were a lot of tricks involved to make specific predictions possible, which the handful of patents Iβm named on go into detail about. One of the coolest results involved predicting a user was going to click on something before they actually did. That was a ton of work and something Iβm proud of. Your pupil reacts before you click in part because you expect something will happen after you click. So you can create biofeedback with a user's brain by monitoring their eye behavior, and redesigning the UI in real time to create more of this anticipatory pupil response. Itβs a crude brain computer interface via the eyes, but very cool. And Iβd take that over invasive brain surgery any day.
Other tricks to infer cognitive state involved quickly flashing visuals or sounds to a user in ways they may not perceive, and then measuring their reaction to it.
Another patent goes into details about using machine learning and signals from the body and brain to predict how focused, or relaxed you are, or how well you are learning. And then updating virtual environments to enhance those states. So, imagine an adaptive immersive environment that helps you learn, or work, or relax by changing what youβre seeing and hearing in the background.
All of these details are publicly available in patents, and were carefully written to not leak anything. There was a ton of other stuff I was involved with, and hopefully more of it will see the light of day eventually.
A lot of people have waited a long time for this product. But itβs still one step forward on the road to VR. And itβs going to take until the end of this decade for the industry to fully catch up to the grand vision for this tech.
Again, Iβm open to consulting work and taking calls if your business is looking to enter the space or refine your strategy. Mostly, Iβm proud and relieved this has finally been announced. Itβs been over five years since I started working on this, and I spent a significant portion of my life on it, as did an army of other designers and engineers. I hope the whole is greater than the sum of the parts and Vision Pro blows your mind.
Abdul Rahman retweeted
HISTORIC π€―
Luka Doncic becomes the first player EVER to have a 60-20-10 game π
βLife is too short to get bogged down and be discouraged. You have to keep moving. You have to keep going. Put one foot in front of the other, smile and just keep on rolling.β
Abdul Rahman retweeted
Hideo Kojima's ambitious post-apocalyptic epic is getting a sequel, featuring the return of Norman Reedus as Sam and Lea Seydoux as Fragile. #TheGameAwards
Death Stranding 2 Reveal Trailer | The Game Awards 2022
βYou could not help but feel your specklike existence against the immensity of the mountain, the earth, the universe, and yet still feel your own two feet on the talus, reaffirming your presence amid the grandeur.β
- When Breath Becomes Air, Paul Kalanithi
Abdul Rahman retweeted
Rates of anxiety and depression rose by about 25% worldwide in the first year of Covid-19, a report from the WHO shows trib.al/4dmnY5e
Abdul Rahman retweeted
Hereβs my periodic reminder that an individual earning RM4.4k in 2020 is already T20 (RM4.6k in 2019)
Abdul Rahman retweeted
This is actually quite catastrophic.
To give everyone a sense of the scale:
- 50% of working Malaysians earned less than RM2,062 a month in 2020.
- the income drop from 2019 to 2020 has set incomes back ~10 years if you take into account inflation rates.
Mean monthly salaries & wages fell 9.0% in 2020, the first time decline since the series began in 2010.
#StatsMalaysia
#MyCensus2020
#MenghitungMalaysia
#DataAndaMasaDepanKita
#PastikanAndaDibanci
#ARC2021
Abdul Rahman retweeted
When youβre not used to being confident, confidence feels like arrogance.
When youβre used to being passive, assertiveness feels like aggression.
When youβre not used to getting your needs met, prioritizing yourself feels selfish.
Your comfort zone is not a good benchmark. β at Jupiter, FL
Abdul Rahman retweeted
i created the solar watch face as a way for muslims observing ramadan to quickly see the position of the sun and for all to understand the sun's relationship to time. #RamadanMubarak β at San Francisco, CA
Abdul Rahman retweeted
This is my life now. #wfhlife
Abdul Rahman retweeted
The precious video from Aug 2016. When we finally found the office to rent with more staff. As thereβs no hallway, kitchen or conference room we were able to shoot this image. Making this rough pre-visualization to prep for Madsβ performance capture. This was used for Madsβ ref.
Abdul Rahman retweeted
The existing classifications of Malaysian households has limitations in its practice, one of which being not differentiating household sizes. We explain more on whatβs wrong. ow.ly/Ga1x50woatJ | #demarcation #households #income #consumption #malaysia #b40
Abdul Rahman retweeted
"For every hour you spend cycling, you add one hour to your expected healthy lifespan. For every hour you sit in a car, you subtract an hour."*
βProf. John Pucher, Rutgers
* More on the stat here: buff.ly/2HOpqNK
Abdul Rahman retweeted
Beware causal inference with machine learning because the answer isnβt in the training data, and the algorithm can only learn what it sees.
#causalinference #ML #AI
teapawt.net/uzunkokcan/status/1005β¦
































