Senior Deep Learning Research Scientist at @3M Dublin. Engineer with a passion for robotics. I work on 3D mesh Transformers. All views are mine
Dublin City, Ireland or UK
Joined January 2016
- Tweets649
- Following926
- Followers156
- Likes1.3K
Francis Yates retweeted
Most of these signatories have a distorted view of what is coming next with AI.
The distortion is due to their inexperience, naïveté on how difficult the next steps in AI will be, wild overestimates of their employer's lead and their ability to make fast progress, and financial incentives to hinder open source AI platforms (since almost all of them work for providers of proprietary AI systems).
As you and I know, generations after generations of AI researchers have made the same mistake: thinking that human-level AI is "just around the corner" because of some new paradigm they are working on.
They have consistently underestimated how difficult it is because they have an incentive to dismiss the limitations of their favorite paradigm as mere "engineering problems," and they can't foresee the obstacles they'll bump into before bumping onto them.
We are making progress towards human-level AI, but we're still far from it.
Some of us may have vague roadmaps for how to get there. But no one has a credible blueprint, let alone a demonstrable prototype.
Before such a prototype exists (perhaps with the learning abilities of a house cat), regulating AI R&D because of a fear of existential risk is highly premature.
There is nothing wrong with sensible legislation to regulate the *deployment* of AI application.
But legislation that hinders open research and open source AI platforms, and that makes open source AI developers liable for what people do with their code is extremely regressive.
Francis Yates retweeted
I try my best to not talk about Irish politics, but getting sent things like this by my Garda friends just angers me too much. This happened today.
The police (Gardai) in Ireland have been attacked and bullied by scumbags for years now. They know they can get away with it.
Stripped of any power to do anything about it. The Gardai are trained to retreat and not engage when violence breaks out.
This is what happens when you remove your police forces ability to police.
The Gardai voted with an enormous majority vote of no confidence against the head of the Gardai. Our minister for justice ignored them. Overworked, underpayed, and stripped of any protection in policing.
I know policing in America is a sore topic for good reason. Ye are on the other side of the spectrum. Too much power. This is what happens when you swing to the other side. Chaos.
I’m ashamed of how Ireland is being governed. A failed socialist state. It’s why I left, and it’s why I won’t be going back any time soon.
Helen McEntee, you need to resign.
Francis Yates retweeted
Emergent in-context learning with Transformers is exciting! But what is necessary to make neural nets implement general-purpose in-context learning? 2^14 tasks, a large model + memory, and initial memorization to aid generalization.
Full paper arxiv.org/abs/2212.04458
🧵👇(1/9)
Just watched a great interview with Monica Daley @birdBiomechy , super interesting.
youtube.com/watch?v=xnjeVdLH…
Next week I'm going to be joining @3M as a Senior Research Scientist for AI in dental applications. Can't wait, sad to be leaving @VisualAIPeople after 4 great years.
Francis Yates retweeted
One difference between experienced ML researchers with those new to the field is the amount of visualization that one does including visualizing training data, augmentations, parameters, gradients, predictions, etc. A codebase with only end metric plots almost always means bugs.
Francis Yates retweeted
Looks to me like stage 2) argument:
teapawt.net/woj_zaremba/status/151…
Has anyone got any advice/links on optimizing v,v large (2gb+) TF vision models? - for inference/training
Francis Yates retweeted
What's the differences among ...
Latent space, feature space, embedding space, representation space, latent feature, feature embedding, latent representation, embedding representation, latent embedding, and feature representation? 🤔
Francis Yates retweeted
AI isn’t “hijacking” art history, it is providing the tools it needs to scale!
The first automobile was not faster than a horse and carriage, but it had the attributes that allow it to scale. – at Fingal, Ireland
This Post is from an account that no longer exists. Learn more
Francis Yates retweeted
#COP26 has just begun while I started working in the renewable industry today.
As a welcome gift, I'd really appreciate if all the world leaders agreed to dump 30 years of work on my desk.
Big fan of @ramin_m_h talk on the paper 'Liquid Neural Netwoks' about a 'new class of time-continuous recurrent neural network models'. Really good visualisation. youtube.com/watch?v=IlliqYiR…
Francis Yates retweeted
Does my GAN's loss go down every day? No. But does it try its hardest to make its image quality go up over time? Also no
The ability to wrap arbitrary python/NumPy operations within a Tensorflow graph - and save - then serve it, is a massively underrated benefit of Tensorflow. Main changes include changing from python lists to TensorArrays.
Francis Yates retweeted
So many exciting new frontiers in ML, it's hard to give a short list, particularly in new application areas (e.g. in the physical and biological sciences).
But the Big Question is:
"How could machines learn as efficiently as humans and animals?"
This requires new paradigms.
Francis Yates retweeted
We do not have an answer to that question, and the gap to bridge is enormous (how can people learn to drive a car in 20h of practice?)
Decisive advances towards an answer will mark a new era in AI.
That's why I work on self-supervised learning.
It's our best shot at the moment.
Francis Yates retweeted
New preprint: "Impact Invariant Control with Applications to Bipedal Locomotion," by William Yang.
During impacts, robots undergo large and rapid changes in velocity. State estimation, and thus control, in these periods are incredibly difficult. (1/2)
arxiv.org/abs/2103.06907
