Tim Hoyt (@TimHoyt) header
Tim Hoyt (@TimHoyt) profile picture

Interests in AI product management leadership, product strategy, productivity software, adoption and change management of AI in large enterprises.

Miami
Joined April 2009
Photo by Tim Hoyt (@TimHoyt)Photo by Tim Hoyt (@TimHoyt)Photo by Tim Hoyt (@TimHoyt)Photo by Tim Hoyt (@TimHoyt)Photo by Tim Hoyt (@TimHoyt)
AvatarV
We solved character consistency. Forever Avatar V captures you in 15 seconds and holds your identity across every video. Change the look, outfit, and setting to create unlimited versions of you. RT + comment "AvatarV" below and I'll DM 100 credits to test it out (must follow)
31
Tim Hoyt retweeted
We solved character consistency. Forever Avatar V captures you in 15 seconds and holds your identity across every video. Change the look, outfit, and setting to create unlimited versions of you. RT + comment "AvatarV" below and I'll DM 100 credits to test it out (must follow)
1,559
947
476
2,209
805,534
Valuable content for AI builders. Includes the key points from their AI Evals course.
So many people talking about AI evals. @HamelHusain and @sh_reya show me how to actually build one. Live. Hamel and Shreya teach the world’s most popular course on evals, and have long been at the forefront of this emerging and important new skill for AI product builders. I'm so excited to finally have them on the podcast. Learn: 🔸 WTF are evals 🔸 A step-by-step live walkthrough of how to create an eval 🔸 Why evals have become so important 🔸 The debate between “vibes” and systematic evals 🔸 Code-based evals vs. LLM-as-judge 🔸 Why you only need 4-7 evals (not hundreds) 🔸 Building an LLM judge in Google Sheets 🔸 Why you always want to start with error analysis 🔸 Much more Listen now 👇 • YouTube: youtu.be/BsWxPI9UM4c • Spotify: open.spotify.com/episode/235… • Apple: podcasts.apple.com/us/podcas… Thank you to our wonderful sponsors for supporting the podcast: 🏆 @Fin_ai — The #1 AI agent for customer service: fin.ai/lenny 🏆 @dscout — The UX platform to capture insights at every stage: from ideation to production: dscout.com/ 🏆 @mercury — The art of simplified finances: mercury.com/
1
176
Enjoying @HamelHusain and @sh_reya AI Evals for Engineers and PMs course. AI Evals allow you to find problems in an AI agent w/ error analysis, write evals to catch those errors, so that you can iteratively experiment and improve. Well done. maven.com/parlance-labs/eval…
4
6
2,502
The important skills [for managing AI agents] are breaking apart tasks in discrete chunks and pulling the work back together; reviewing the work of AI Agents…for quality and consistency; and having the judgment -and thus domain expertise- to know what good output looks like
At Box, we’re in the early stages of leveraging AI Agents in a variety of internal workflows. We’ve begun building internal Agents on Box to respond to an RFP or review a contract and pull out its critical data to automate a workflow, and we’re testing external Agents in engineering to fix bugs or handle long tail tasks like updating an SDK from a feature request. While we’re in the super early experimentation stage, so far the tests have been quite cool, and there are some fascinating implications for what the future of work could look like. In particular, thus far, AI Agents are extremely ideal for the type of work that we have to spend a meaningful amount of time on, that is often not that enjoyable, and adds very little net new value to the business or project. Important, but not strategic. In the future, the legal ops team will ask an AI Agents to review the contract for any language that deviates from what’s approved; the RFP for a new deal will get automatically generated based on all past responses; the insurance claim will be processed by an AI Agent and then reviewed by a human for final approval; and the IPO prospectus can be written by scouring reams of existing data (David Solomon at Goldman Sachs just called this one out). Interestingly, as we farm out more and more of these tasks to an AI, the role of the human in the work may change, but only moves to higher level work in the workflow. The important skills are breaking apart tasks in discrete chunks and pulling the work back together; reviewing the work of AI Agents, much like a manager would for quality and consistency; and having the judgment -and thus domain expertise- to know what good output looks like and what to improve. We’re still on day 1 on any of this. The tool use for Agents will need to improve, reasoning models will need to continue to get better, cheaper and faster, browser use will likely be a big factor in the future, and agent-to-agent interactions is still unbelievably early. Lots of work for the software industry to get all this right, but it’s incredibly fun in the process as we clearly enter a new era of work.
66
I recommend signing up for this free seminar for #productmanagement tips and mindset
I am hosting a seminar on April 23! Topic: PM Habits We will cover some of my habits related to meetings, reviewing metrics, dealing with Slack, planning time, skills growth, etc and also principles so you can adapt these to your context. Register here: lu.ma/shreyaspmhabits
3
307
Great analysis. The $8 thing falls flat for me, how would it improve what I go to Twitter for. But I’d pay nominally for authentication, I might do a premium tier, and I gladly pay $10 to Super Follow @shreyas
Our Twitter subscriptions plan needs work @elonmusk. I did a pricing study on 54.3k Twitter users to help you Doge Father. TLDR: - Verification should cost much less - Twitter Blue should cost much more - Twitter has a unique opportunity to 10x subscribers Thread time 🧵
1
1
These Twitter lists seem like a solid product engagement loop. I created this carefully curated list of Product Management thought leaders for my own purposes and now this list has twice the followers I do. 🧐 teapawt.net/i/lists/12084429820363…
Same arguments were there in web1. Easy to be a pessimist, harder to filter through the muck to find the diamonds.
This quoted post is unavailable.
1
On role of Product Ops gathered insights: “it is the ongoing aggregation and assimilation of those [quantitative and qualitative] insights, combined with daily interactions with the product teams, that enables strong product leaders and strong product strategies.”
1
PM PLANNING DECK: INSIGHTS This is where we reflect on the past: - What did we launch - What did we learn - What went well / what did not - Data / customer context - Changes in the market
1
1
3
You need: good (written) comms, enough structure to get team to execute coherently but still allow autonomy, mechanism to get what the teams are learning back to (in)validate the strat assumptions & no ego so you actually hear that info
1
4
2
55
Tim Hoyt retweeted
Someone on your team says: “Our goal should be to move Metric X up Y% this half.” Your inclination is to nod, say “Cool” and get on with the actual building. But pause! The goals you agree to determine what you build. So consider them carefully. 8 questions to ask👇
13
209
32
1,353
…just ask users “how would you feel if you could no longer use the product?” and measure the percent who answer “very disappointed.” strong traction almost always exceeds the threshold of 40% of users responding “very disappointed” review.firstround.com/how-su… #ProductManagement
Great idea to extrapolate from a stakeholder request to the underlying problem; document context, audience, assumptions, and biggest risks; then include the initial request as one of the options to solve problem. Forces consideration of alternate solutions and overall strategy
This quoted post is unavailable.
A classic on the fine art of saying “no” as a #productmanager: “This is a really great idea, I can see why our customers would like it. Well done. But we’re not going to build it. Instead, here’s what we’re doing.”. intercom.com/blog/product-st…
A recipe for running a pre-mortem meeting to identify problems prior to launch by @shreyas Language: 🐯 Tigers - A clear threat 📃 Paper Tigers - A threat you are personally not worried about 🐘 Elephants - A concern the team is not talking about coda.io/@shreyas/pre-mortems…
1