
UX Researcher @jeffrymconsulting | Human-centered and Responsible AI | Social Psychologist | Opinions are my own
St. Louis, MO
Joined May 2010
- Tweets893
- Following1.3K
- Followers338
- Likes803
You’d think these requirements would’ve existed earlier based on the number of hazing-related deaths over the years, but hooray for Biden signing an anti-hazing bill that mandates institutions to share hazing statistics. wapo.st/41VLjF0
Amy Heger retweeted
New from my team: Synthesis of research on appropriate reliance on generative AI, linked in the MSR blog below. @samirpassi and I will post interesting insights in the coming days.
In this issue: New research on appropriate reliance on generative AI; Power management opportunities for LLMs in the cloud; LLMLingua-2 improves task-agnostic prompt compression; Enhancing COMET to embrace under-resourced African languages. msft.it/6010Y6hCg
Amy Heger retweeted
Replying to @mustafasuleyman @Microsoft
Welcome to Microsoft! Let's talk about building appropriate reliance on our consumer products - so people don't over-trust AI when it's wrong, and don't under-trust either. I lead a cross-company team on this.
Amy Heger retweeted
Lex is right, Sam was wrong.
Our research shows that people don’t really check the work of AIs, once those AIs cross a certain threshold of quality. We found that consultants, for example, “fell asleep at the wheel” and did not look for AI errors. Training didn’t help, either.
The RAI Maturity Model is the most meaningful research project I've worked on. Prioritizing collaboration and communication across disciplines is essential for any org that wants to build AI responsibly. Read more at @mihaela_v's LinkedIn #RAI #maturity
Y'all, I've been doing a series of posts about the RAI Maturity Model on LinkedIn linkedin.com/in/mihaelavorvo…
Today: building a *common language* across disciplines so you can work together.
PhD student internship opportunity - work with our team and MS Office to research GenAI/Copilot usage!
Internship for PhD students: jobs.careers.microsoft.com/g… - Work with my team & with MS Office. I am looking for a social scientist with experience in organizational communication, new employee experience, productivity, mixed-methods field studies.
Amy Heger retweeted
Aether, founded by @erichorvitz and @BradSmi, was the first group to start thinking about Responsible AI at @Microsoft. Our deep thinking continues to influence the company's approach to RAI. See what's top of mind for Aether in Review of 2023 research: aka.ms/AAoiqqy
Amy Heger retweeted
Technology Review's perspective on Google's Gemini model, with comments from @chirag_shah, @emilymbender, @percyliang, and me.
technologyreview.com/2023/12…
Proud to share Microsoft's AI & Productivity research initiative's release of its first public report. The research measures the impact AI-powered tools like Copilot have on productivity and we saw drastic gains in time saved on common info worker tasks tinyurl.com/7dfkvtsj
Interesting work on how the power of prompting can lead a generalist LLM to be a specialist, outperforming a fine-tuned model for medical applications. New great research coming from people on my team at Microsoft.
1/8 We’ve published a study of the power of prompting to unleash expertise from GPT-4 on medical benchmarks without additional fine-tuning or expert-curated prompts: arxiv.org/pdf/2311.16452.pdf
Summary of results:
Amy Heger retweeted
if you’re not in tech then all you need to know about the past weekend is that your tech friends went through like three seasons of succession
Amy Heger retweeted
We’re thrilled to present our new Focus on artificial intelligence - Navigating the AI Frontier. (1/20)
buff.ly/3upNIch
Join me Wednesday as I talk with @HeyMarvinApp about how my colleagues at Microsoft & I created the Responsible AI Maturity Model. Hint: it involved analyzing a huge amount of complex qualitative data and I'll share many of our learnings. Register at: tinyurl.com/5ff2d5nm
I also want to shout out to @mihaela_v Shipi Dhanorkar @samirpassi @RuotongWang1 Zoe Kahn for all your work helping develop the Responsible AI Maturity Model aka.ms/raimm and to the 90+ RAI consultants & AI practitioners we interviewed that made its creation possible!
Amy Heger retweeted
Adding to this how-to steps for RAI red-teaming from our team at Microsoft learn.microsoft.com/en-us/az…
Interestingly, now that #OpenAI has announced their red-teaming effort, I'm being asked even more: "WHAT IS REDTEAMING?" This blog post from @nazneenrajani @natolambert @_lewtun @huggingface should be helpful!
huggingface.co/blog/red-team…
Amy Heger retweeted
Zoom updated its Terms of Service to permit training AI on user content without opt-out, a thread 🧵
Amy Heger retweeted
New paper: Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback
We survey over 250 papers to review challenges with RLHF with a focus on large language models. Highlights in thread 🧵
Amy Heger retweeted
Today is the day that the world's first algorithmic bias auditing law goes into effect in NYC! Has anyone seen one in the wild yet? The law does not exactly make it easy to find them. nbcnews.com/tech/tech-news/n…
Amy Heger retweeted
Woohooo! Our RAI Maturity Model is featured in this update. Find it at aka.ms/raimm @AmyHeger @samirpassi
In this issue: Our new Responsible AI Maturity Model; FoundWright helps “re-find” web pages; Trace-guided Inductive Synthesis of Recursive Functional Programs; a wait-free algorithm for weak reference counting; and new research on concurrency testing. msft.it/6019gscCv




















