Abdul Rahman retweeted
I spent 10% of my life contributing to the development of the #VisionPro while I worked at Apple as a Neurotechnology Prototyping Researcher in the Technology Development Group. Itโs the longest Iโve ever worked on a single effort. Iโm proud and relieved that itโs finally announced. Iโve been working on AR and VR for ten years, and in many ways, this is a culmination of the whole industry into a single product. Iโm thankful I helped make it real, and Iโm open to consulting and taking calls if youโre looking to enter the space or refine your strategy.
The work I did supported the foundational development of Vision Pro, the mindfulness experiences, โโโโโโ products, and also more ambitious moonshot research with neurotechnology. Like, predicting youโll click on something before you do, basically mind reading. I was there for 3.5 years and left at the end of 2021, so Iโm excited to experience how the last two years brought everything together. Iโm really curious what made the cut and what will be released later on.
Specifically, Iโm proud of contributing to the initial vision, strategy and direction of the โโโโโโ program for Vision Pro. The work I did on a small team helped green light that product category, and I think it could have significant global impact one day.
The large majority of work I did at Apple is under NDA, and was spread across a wide range of topics and approaches. But a few things have become public through patents which I can cite and paraphrase below.
Generally as a whole, a lot of the work I did involved detecting the mental state of users based on data from their body and brain when they were in immersive experiences.
So, a user is in a mixed reality or virtual reality experience, and AI models are trying to predict if you are feeling curious, mind wandering, scared, paying attention, remembering a past experience, or some other cognitive state. And these may be inferred through measurements like eye tracking, electrical activity in the brain, heart beats and rhythms, muscle activity, blood density in the brain, blood pressure, skin conductance etc.
There were a lot of tricks involved to make specific predictions possible, which the handful of patents Iโm named on go into detail about. One of the coolest results involved predicting a user was going to click on something before they actually did. That was a ton of work and something Iโm proud of. Your pupil reacts before you click in part because you expect something will happen after you click. So you can create biofeedback with a user's brain by monitoring their eye behavior, and redesigning the UI in real time to create more of this anticipatory pupil response. Itโs a crude brain computer interface via the eyes, but very cool. And Iโd take that over invasive brain surgery any day.
Other tricks to infer cognitive state involved quickly flashing visuals or sounds to a user in ways they may not perceive, and then measuring their reaction to it.
Another patent goes into details about using machine learning and signals from the body and brain to predict how focused, or relaxed you are, or how well you are learning. And then updating virtual environments to enhance those states. So, imagine an adaptive immersive environment that helps you learn, or work, or relax by changing what youโre seeing and hearing in the background.
All of these details are publicly available in patents, and were carefully written to not leak anything. There was a ton of other stuff I was involved with, and hopefully more of it will see the light of day eventually.
A lot of people have waited a long time for this product. But itโs still one step forward on the road to VR. And itโs going to take until the end of this decade for the industry to fully catch up to the grand vision for this tech.
Again, Iโm open to consulting work and taking calls if your business is looking to enter the space or refine your strategy. Mostly, Iโm proud and relieved this has finally been announced. Itโs been over five years since I started working on this, and I spent a significant portion of my life on it, as did an army of other designers and engineers. I hope the whole is greater than the sum of the parts and Vision Pro blows your mind.
Abdul Rahman retweeted
HISTORIC ๐คฏ
Luka Doncic becomes the first player EVER to have a 60-20-10 game ๐
Abdul Rahman retweeted
Hideo Kojima's ambitious post-apocalyptic epic is getting a sequel, featuring the return of Norman Reedus as Sam and Lea Seydoux as Fragile. #TheGameAwards
Death Stranding 2 Reveal Trailer | The Game Awards 2022
Abdul Rahman retweeted
Rates of anxiety and depression rose by about 25% worldwide in the first year of Covid-19, a report from the WHO shows trib.al/4dmnY5e
Abdul Rahman retweeted
Hereโs my periodic reminder that an individual earning RM4.4k in 2020 is already T20 (RM4.6k in 2019)
Abdul Rahman retweeted
This is actually quite catastrophic.
To give everyone a sense of the scale:
- 50% of working Malaysians earned less than RM2,062 a month in 2020.
- the income drop from 2019 to 2020 has set incomes back ~10 years if you take into account inflation rates.
Mean monthly salaries & wages fell 9.0% in 2020, the first time decline since the series began in 2010.
#StatsMalaysia
#MyCensus2020
#MenghitungMalaysia
#DataAndaMasaDepanKita
#PastikanAndaDibanci
#ARC2021
Abdul Rahman retweeted
When youโre not used to being confident, confidence feels like arrogance.
When youโre used to being passive, assertiveness feels like aggression.
When youโre not used to getting your needs met, prioritizing yourself feels selfish.
Your comfort zone is not a good benchmark. โ at Jupiter, FL
Abdul Rahman retweeted
i created the solar watch face as a way for muslims observing ramadan to quickly see the position of the sun and for all to understand the sun's relationship to time. #RamadanMubarak โ at San Francisco, CA
Abdul Rahman retweeted
This is my life now. #wfhlife
Abdul Rahman retweeted
The precious video from Aug 2016. When we finally found the office to rent with more staff. As thereโs no hallway, kitchen or conference room we were able to shoot this image. Making this rough pre-visualization to prep for Madsโ performance capture. This was used for Madsโ ref.
Abdul Rahman retweeted
The existing classifications of Malaysian households has limitations in its practice, one of which being not differentiating household sizes. We explain more on whatโs wrong. ow.ly/Ga1x50woatJ | #demarcation #households #income #consumption #malaysia #b40
Abdul Rahman retweeted
"For every hour you spend cycling, you add one hour to your expected healthy lifespan. For every hour you sit in a car, you subtract an hour."*
โProf. John Pucher, Rutgers
* More on the stat here: buff.ly/2HOpqNK
Abdul Rahman retweeted
Beware causal inference with machine learning because the answer isnโt in the training data, and the algorithm can only learn what it sees.
#causalinference #ML #AI
teapawt.net/uzunkokcan/status/1005โฆ
Abdul Rahman retweeted
Japanese car rental companies couldn't figure out why their cars were be rented, but not driven.
So they did a survey to find out:
๐ดnaps
๐จโ๐ปwork
๐ฆstorage
๐ฑcharge phones
๐ฑeat
๐คtalk on the phone
๐บwatch TV
๐dress up for halloween
๐ถpractice rapping
asahi.com/ajw/articles/AJ201โฆ
Abdul Rahman retweeted
The name of the new genre is not made by the creator but it comes after. I know that but I just like to name it as I did in my past titles. Calling it as Social Strand System is similar case when I called Tactical Espionage Action before it was categorized as Stealth Game.๐
Abdul Rahman retweeted
Excellent video from @reneritchie about Facebook and the state of data collection in the modern world. A must watch. youtu.be/bqsxolJ3UvI


































