Asst prof @tudelftTBM in Data-driven/Algorithmic Systems and Safety, Justice and Sustainability. Former AI Now and Berkeley AI. Board @public_spaces.

The Hague
Joined March 2010
Excited and proud to share a new paper: "Algorithms as Social-Ecological-Technological Systems". @bobirakova and I position the current struggles for Algorithmic Justice (AJ) in relation to the history of Environmental Justice (EJ) struggles. arxiv.org/pdf/2305.05733.pdf
7
21
3
84
13,885
NEW PAPER! 1. Small AI models often perform better than big in context. 2. Obsession w bigness has bad consequences, from climate, to power concentration, to surveillance, to research capture. This & what to do c/o @GaelVaroquaux, @SashaMTL and me ♥️👇 arxiv.org/abs/2409.14160
11
117
15
390
57,536
Finally, the tort question du jour in real life!!!
Family poisoned after using AI-generated mushroom identification book we bought from major online retailer. reddit.com/r/LegalAdviceUK/c…
2
2
10
1,361
🚨 Twitter heeft net stiekem een standaardinstelling geactiveerd om al jouw berichten te ‘mogen’ gebruiken om hun AI-model te trainen. Ze hebben dit nooit aangekondigd of om toestemming gevraagd. Je kunt dit uitschakelen via het web (niet via de app) via een diep weggestopte pagina: xitter.cf/settings/grok_settings Tip: Maak voordat je dit doet een screenshot van de instelling en dien een klacht in bij de Autoriteit Persoonsgegevens: klachten.autoriteitpersoonsg…
95
432
63
615
138,826
Want to know more about AI & climate? Join the next TU Delft AI Lunch on the unprecedented environmental impacts of AI: a transdisciplinary discussion with @grnsurveillance, @OlyaKudina, @junesallou and @roeldobbe on July 2nd. Register via: tudelft.nl/en/events/2024/de…
3
3
507
With the cover all set, I’m delighted to announce my upcoming #book😊 In #Algorithmic Rule by Law, I argue that the uncritical use of algorithmic regulation in public services can erode the rule of law & hurt democracy. Available this Autumn (with CUP): cambridge.org/core/books/alg…
12
49
5
239
21,290
This talk will also be streamed. If you want to tune in, please check the link. Thursday, 13th of June 2024 2pm CET edu.nl/ja4t3
We are super delighted to welcome @davidthewid at @tudelft who will be talking about "AI Supply Chains: Glued to Big Tech, Disavowing War" Location @TPMTUDelft Hall E Thursday, 13th of June You can register here edu.nl/ja4t3 Join us! Paper: journals.sagepub.com/doi/ful…
1
9
15
3,437
Learning from safety engineering, we delve into frameworks, practices, and organizational culture to tackle the challenges of identifying and addressing new harms from ML systems. The Speaker Shalaleh Rismani, AJung Moon and Roel Dobbe are talking about it. #FAcct2024
2
9
1,654
📣FAccT community: 🚨 We are convening an Emergency Meeting for Palestine to discus and organize against our field's complicity in ongoing apartheid and genocide. 🇵🇸 Tomorrow, June 5 at 12:50pm in Grego Room + Zoom, RSVP here: bit.ly/FAccT-Palestine
2
29
10
96
24,918
Finally some answers to the mystery that is Common Crawl - what is it ? Why is it? How can it be curated? What does it do to LLMs? My god this looks useful facctconference.org/static/p…
2
6
25
3,210
I was listening to the latest @dwarkesh_sp with @leopoldasch and I'm just kind of shocking how many times I hear the same take that is an extrapolation of trend lines guaranteeing us "AGI" by making models bigger. Honestly this feels like the prominent intelligence explosion people have a huge blind spot. The exponential is *one way* AGI *could* happen but it requires the log linear graph to continue without interruption. With this logic, we would’ve already had “the big earthquake” a few times in SF / Seattle. There’s nothing assuring scaling to keep working, it’s one narrow path. Log linear lines don't continue forever. They could stop at GPT5 or GPT7, but with each increase in size it seems like the probability of reaching a pinch point will only increase. I can feel the AGI and all that (listening to Leopold describe that is a great insight into the AGI culture at OpenAI), things are coming, the paths are just much more broader than people discuss and state. Feels sort of like smart people have been brainwashed to believe this. It’s a good thought experiment, but it’s certainly not proven reality. At the same time, we have this "right to warn" letter. I think @jachiam0's takes are pretty good on this xitter.cf/jachiam0/status/179801…. There's a weird dominance of "AI Safety Culture." Just because you have the strongest volition of your opinions doesn't mean you have the highest probability of being right. In fact, it's often anti-correlated.
So - there is a letter circulating now from former and current AGI frontier lab staff, advocating for a particular policy around whistleblower protections on safety and risk issues (righttowarn.ai/). I am not a signatory to this letter. Some thoughts.
22
12
2
229
120,617
Glad to see domain specific studies corroborating that LLMs and AI should not be deployed in safety-critical infrastructure, a recent shocking trend in the US. These systems require at least two 9's (99%), and LLMs are worse than random. This is literally life threatening.
Can we really trust AI in critical areas like medical image diagnosis? No, and they are even worse than random. Our latest study, "Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA," uncovers the stark limitations of state-of-the-art models like GPT-4V and Gemini Pro in medical VQA tasks. 🏥📚 Key Findings: 🔍 A simple yet effective probing with adversarial pairs reveals critical gaps in model performance. 🏥 We present the Probing Evaluation for Medical Diagnosis (ProbMed) dataset to rigorously assess LMM performance in medical imaging through probing evaluation and procedural diagnosis. 🩺 Top-performing models like GPT-4V and Gemini Pro perform worse than random guessing on specialized diagnostic questions. Models like LLaVA-Med struggle even with more general questions. Check out the full paper for all the details! 🔗 Website: jackie-2000.github.io/probme… 📄 Paper: arxiv.org/abs/2405.20421 🤖 Data: huggingface.co/datasets/ripp… Kudos to my proud first-year PhD student @qianqi_yan and all collaborators @XuehaiH @xiangyue96! 🧵(1/N)
6
97
4
285
25,314
In Rio de Janeiro voor #FAccT2024. Excited to see old friends and make new ones!
1
11
1,908
Update: This is worse than I thought. Workers in Nigeria, Rwanda, and South Africa are also reporting that they are being blocked from the website or cannot create an account. It's possible that Scale AI suspended Remotasks far beyond just Kenya.
For years I’ve been interviewing data annotation workers who are the lifeblood of the AI industry. For years I’ve heard the same story: the platforms they work for wield total power, leaving them precarious & vulnerable to exploitation. A horrible example of this just happened 1/
5
161
4
354
65,703
Our stressed-out power grids can’t handle the AI revolution and tech companies are deliberately hiding both their bidding and their resource use. Time for standards and transparency to avoid a true crisis and ensure accountability ↘️ on.ft.com/3wSjuzJ
4
55
3
127
24,821
SCOOP: @NIST is facing an internal crisis as staff members and scientists have threatened to resign over the anticipated appointment of Paul Christiano to a crucial position at the agency's newly-formed US AI Safety Institute, sources say. venturebeat.com/ai/nist-staf…
22
42
36
252
251,533
🚨Read this before you use OpenAI for Hiring🚨 @LeonYin @daveyalba and I ran thousands of resume screening tests with GPT-3.5 and GPT-4 and found that the tech will racially discriminate applicants based only on their name. Serious implications. 🧵 1/10 bloom.bg/3It4cE4
65
276
101
711
332,314
A holistic approach to designing, managing, and supervising public algorithmic systems. @roeldobbe emphasizes the importance of considering societal factors in algorithmic decision-making, striving for equitable outcomes. Read his story here: bit.ly/3Zazmq1
2
5
436
Critical reporting as always by Karen Hao. One critical issue, connected with exponential increase in energy use and renewable reliance is how other parts of the economy are pushed back in line to transition and get access to renewables, big tech outbids everyone else.
A big question looms over generative AI: what really is its impact on the environment? I spent months investigating a single campus of Microsoft data centers in the Arizona desert - designated in part for OpenAI - in an attempt to find out. Thread. theatlantic.com/technology/a…
2
349