Puneet Kohli (@punkohl) header
Puneet Kohli (@punkohl) profile picture

Human Data @careerflow_ai | Prev: @Apple @LeiaInc @Amazon | Tech operator 🚀, Product Shipper 🚢, and AI/ML Implementor 🤖

Palo Alto, CA
Joined June 2013
Photo by Puneet Kohli (@punkohl)Photo by Puneet Kohli (@punkohl)Photo by Puneet Kohli (@punkohl)Photo by Puneet Kohli (@punkohl)Photo by Puneet Kohli (@punkohl)Photo by Puneet Kohli (@punkohl)Photo by Puneet Kohli (@punkohl)Photo by Puneet Kohli (@punkohl)Photo by Puneet Kohli (@punkohl)Photo by Puneet Kohli (@punkohl)
Resume parsing isn’t as simple as it seems. I'm excited to share our work on ResumeBench: a frontier benchmark of how well AI systems parse and extract data from resumes. @llama_index leads the charge, with @reductoai and frontier AI models close behind. Yet even the best system gets only 15% of resumes extracted perfectly 🧵
4
12
27
2,489
In terms of metrics, we've done a comprehensive deep dive into the tradeoffs between accuracy, cost, and latency. @llamaparse Extract Agentic Plus tops the leaderboard with an F1 score of 87.16 and extracts 15% of resumes perfectly, with Extract Agentic being in the same weight class at half the cost. @reductoai Extract is by fast the fastest while suffering on accuracy. @Alibaba_Qwen is the cheapest (~$2 / 1000 pages) for > 80% accuracy.
1
3
86
This work is personally close to my heart as we strive to build better systems that can reliably extract resume content! If you'd like to add your system to the leaderboard, my DMs are open and we'd love to get feedback on our work! You can learn more at: resumebench.ai
2
78
We tech people live in a bubble, and the real world is still largely anti-AI (except using it as glorified search) Saying this as someone who works with domain experts for human data for a living. The amount of "we don't want AI to learn from us" and "F* AI" from real domain experts in insane.
6
315
We at @careerflow_ai independently verified @hark_labs's submission to the Online Mind2Web benchmark as part of our rapidly growing Human Data Labs initiative and collaboration with @OhioState as the official benchmark evaluator. Handoff secured #1 on the benchmark beating foundational models, as well as other great Computer Use agents who we evaluated recently as well. It was a pleasure working with @adcock_brett and team on this. Learn more: careerflow.ai/human-data
Today we're introducing Hark Handoff Handoff has been independently verified as the best internet-use model ever built, outperforming ChatGPT 5.4 & Opus 4.8 While others focus on coding, we focus on everyday life: ordering food, booking flights, shopping, & navigating the web
7
5
1
45
50,255
If you're at AI Engineer World's Fair #aiewf this week and want to talk about human data, RL Envs, or how to create world class datasets - HMU
2
6
321
Me: "I have a whole AI team now" *the AI team in question* 😭😭😭
1
2
551
Having a lot of fun with @linear's new assistant in Slack. Write a detailed human description to the team, tagging the correct team member and just ask Linear to turn it into a ticket and it goes off and does everything for me. I don't even need to open Linear anymore.
1
325
Anyone else facing slowness on their GCP deployed services?
3
319
I’d rather brain rot in my IDE than switch tabs/devices, get sucked into doomscrolling and forget about the task I was waiting on. 10/10 for Chad IDE.
3
726
If you were affected by the recent layoffs at FAIR / MSL @Meta , I'd love to help you with your resume, job search strategy, interview prep; and also connect you to other labs in my network that's hiring (tons of them are on X!). DM me! P.S. Also one month free of @careerflow_ai premium!
2
5
602
Got a chance to share insights on building an HRTech startup with HR Leaders from Brazil 🇧🇷, courtesy of @edugiansante! Using @Apple AirPods 3 Live Translation for the first time, I was able to understand ~80% of a Portuguese presentation. :)
On Monday we welcomed @edugiansante and HR leaders all the way from Brazil 🇧🇷 to Homebrew. Three AI startups pitched, ideas flowed, and connections sparked. Ho Always fun seeing the frontier of tech take shape right here ✨
2
2
6
936
Only in SF: @im_roy_lee @cluely is literally a case study in an international business leaders’ forum
4
1,033
My new most hated phrase is "You're absolutely right!"
1
4
313
This is the kind of PMF we all need #mollytea
346
🎉 Huge congrats to the winners of our Best AI Resume Builders 2025 roundup! 👏 Editor’s Choice: @visualcv 🌟 Best for Beginners:@careerflow_ai These tools are changing the resume game—smart, fast, and job-ready! #ResumeTools
3
3
231