Startup studio located in Columbus, Ohio.

Columbus, OH
Joined June 2018
A workflow can pass every eval in your harness and still bury your reviewers. Task completion asks: did the model produce an output?
1
20
One question for your next eval review: What percent of your eval set is exception cases? If you don't know, that's the answer. AIEngineering LLMOps
2
10,000 clean rows can still fail in production. The real test: if three people handled the same case today, would they make the same call? If not, you don't have a volume problem, you have a consistency problem. horizontwolabs.com/blog/is-o…
Your first AI workflow shipped fine. Your second one is stuck. Same team, same tools, same "AI-ready" data. The difference: workflow one automated an extraction. Workflow two automates a judgment call. Not the same problem.
1
11
Budget season means someone's about to decide which AI line item survives next cycle. Don't let it be the one automating a decision your team has never made the same way twice.
1
1