Principal AI Engineer. I catch agentic AI failures before they cost millions, not after. Evals + agentic systems for regulated enterprise. https://xitter.cf/t.co/wNKtykyGgV

New York, NY
Joined March 2009
Include

Only show posts containing:

Exclude

Hide posts containing:

Time range
-
Minimum likes
Mike Legemah retweeted
One thing I’ve learned today is that a LOT of Airbnb hosts haven’t realized they’re actually in the hospitality industry, not the real estate industry.
222
5,990
138
110,933
1,220,094
Replying to @KanikaTolver
👏🏿👏🏿👏🏿👏🏿👏🏿👏🏿👏🏿👏🏿👏🏿
99
Replying to @KanikaTolver
You ain’t check your message? Lol
1
203
My good sis @KanikaTolver just confirmed what I’ve been telling some people over the last couple of years.
1
1,115
🤣🤣🤣🤣🤣🤣🤣🤣
18
Replying to @QuantaCortex
Yes. I’d want a held-out task set with a single agent, same tools, as the baseline. Compare verified completion, then net out latency, cost and handoff failures, against a threshold set before the run. No clear lift, no extra agent. Isolation or security needs are the exception.
1
1
6
Mike Legemah retweeted
Your review is judged against a rubric. How many lines of it can you back with evidence? LogPact's gap analysis shows which competencies have wins logged and which are empty, while there's still time to fix it. Pro, 14-day trial: logpact.com/?utm_source=x&ut…
1
2
11
Prove a single-agent workflow before you build a multi-agent one. Every extra agent is another handoff to secure and another failure mode to audit. If you need several: delegation never grants permissions, and protocol compliance is not trust.
7
1
6
161
Why do non-US recruiters always think it’s a good idea to call you before they email you a job description? Do they think people are just sitting around doing nothing?
2
1
190
Replying to @LawrenceDCodes
Don’t rub it in lol. Now I might have to fire up the grill
1
9
Replying to @LawrenceDCodes
I need that lol
1
1
12
Mike Legemah retweeted
Unpopular opinion: the brag doc is bad advice. Blank docs need you to remember them. You don't. Smaller works: 1 win, 1 sentence, 60 sec, every day. 30 days → 30 dated wins. Free challenge starts Oct 26: logpact.com/challenge?utm_so…
1
2
48
LLM judge: "summary is grounded." 5-line script: "the claim ID it cites doesn't exist." Believe the script. Deterministic checks first. Judge for the rest, validated against human labels. Evals are release gates, not QA.
1
1
70
Replying to @randomrecruiter
I’m not surprised
36
An agent's identity is not the identity of the person who asked. Agent runs on a broad service account, user has limited access, agent fetches what the user can't see. Confused deputy. Propagate the user's context. Authorize server-side at the resource, every time.
2
1
59
Replying to @randomrecruiter
Oh remind me to tell you what just happened to me this week lol
43
Don't give an agent one autonomy level for every task. L1 read-only L2 reversible prep, human commits L3 controlled execution, approval + checks L4 high-impact, qualified human decides Bind approvals to exact parameters. Change one, re-approve.
2
68