Ayush Anand (@ay_inv) profile picture

Building & shipping AI products end-to-end | Multi-agent · RAG · Full-stack Final-year https://teapawt.net/t.co/E2ct1M8iyf @ Manipal Jaipur | Open to work & collab https://teapawt.net/t.co/TcwLyC7Xno

Jaipur, India
Joined June 2021
Photo by Ayush Anand (@ay_inv)Photo by Ayush Anand (@ay_inv)
Replying to @grok
@grok evaluate this project. What level is it and what is the single biggest gap? github.com/ayushanand27/SMRA
Shipped SMRA (multi-agent stock research) last week. The hard part wasn't the agents. It was making the RAG actually cite filings correctly instead of hallucinating numbers. Still failing on edge cases with Indian company filings. Anyone else fighting citation quality in financial RAG? Demo in replies. #AI #BuildInPublic #RAG
1
5
@grok evaluate this project?
This is the approach I’m moving toward. One shared fact sheet (number + source + filing date) that agents can only cite from. If it’s not in the sheet, say “not found” instead of estimating. Free-text retrieval is where most of the hallucinated numbers are coming from right now.
Replying to @ay_inv
Same fight here. What fixed most of it for me: build one shared fact sheet first (every number with its source + filing date), and agents can only cite from that sheet, never from free-text retrieval. If a number isn't in the sheet, the agent has to say "not found" instead of estimating. Hallucinated figures dropped a lot.
8
Good catch. Idempotency on webhook delivery is one of the first things that breaks in production. Same message arriving twice shouldn’t create duplicate leads or send two follow-ups. Adding a message_id / webhook_id check is on the list for Lead-Agent.
Replying to @ay_inv
For a WhatsApp lead bot, I'd make duplicate webhook delivery one of the first tests. The same message arriving twice shouldn't create two leads or send two follow-ups.
1
34
Yes — that’s the direction. Quote the exact line + have a checker that rejects anything it can’t match back to source. Still failing on some messy Indian filing tables though.
Replying to @ay_inv
Same fight here. One approach worth trying: make the research agent quote the exact filing line next to every number, and have a separate checker reject any figure it can't match back to source. Won't fix bad parsing, but it stops confident made-up numbers reaching a human.
3
Yes — logging every mismatch is how I’m building the test set for the next fix. Still manual on a lot of edge cases right now.
Replying to @ay_inv
Logging every mismatch between a cited figure and the filing gives you the test set for the next fix
1
70
Mostly messy PDF tables + inconsistent section headings across different filings. Mixed language is less of an issue than the layout and naming differences.
Replying to @ay_inv
Messy format and tone beating bad PDF tables is a useful ranking of the pain. For Indian filings, is the tone issue more about mixed English/local language, or inconsistent section headings?
1
Exactly. A citation that exists but doesn’t actually support the claim is worse than no citation. That’s the one I’m trying to catch better in SMRA right now.
Replying to @ay_inv
A citation that exists but doesn't support the sentence it's attached to. That's the one that makes me start checking every other claim.
17
Good point. Right now it helps with the queue + chat before the visit, but it doesn’t yet check which documents are needed for that specific service. That’s a clear next step — add a pre-visit checklist based on the service type so people don’t reach the counter and get sent back.
Replying to @ay_inv
can the chat check which documents someone needs before they take a token? a shorter queue still hurts if you reach the counter and have to come back tomorrow.
3
Good list of questions. One more I keep hitting: how do you stop the agent from leaking secrets while it's helping you ship? Built a small CLI for that — finds leaked keys, checks if they're still live, revokes them, and guards Claude/Cursor from reading .env. pip install leakkill
Since July, our team has had more than 100 calls about AI implementation with CEOs, CFOs, CTOs and PE operating partners. These 12 questions came up most often: 1. “Where do we start?” Where your customer would feel it first. Pick one workflow, run it for a month, then decide what comes next. Start with a long list of ideas and you’ll end up shipping none of them. 2. “Can’t we just build this ourselves with Claude?” For a lot of it, yes. Reports, research, content: get your people using agents every day. You don’t need a firm for that. You need one when the work touches a system of record, patient data or payment data, or when it has to run every day without somebody babysitting it. 3. “How do we measure ROI?” Name the number before you build: days to close, denial rate, hours per onboarding. If nobody can name it, you’re buying a demo. 4. “How do we know the AI is right?” You test it. Build a golden set of answers your business agrees are correct, then score every release against it. Anything below the bar goes to a person. 5. “Who owns it, and who keeps it running?” You do. Your cloud, your repo, your accounts. Before kickoff, name the person on your side who will run it. Make your first AI hire somebody who can operate it and keep it healthy. 6. “Is our data safe?” It should stay in your environment. Ask where it goes, who at the vendor can see it and what the model provider keeps. Expect a plain answer to all three. 7. “Do we have to fix our data first?” Only the data your first workflow touches. Then build in order: a simple pipeline that runs every day, a layer that defines what your numbers mean, and then the agent. One prompt can’t do all three. 8. “What happens to our people?” Start with them. You can’t expect agents to work on top of a team that doesn’t use them. 9. “Which model should we use?” It matters less than you think, and you’ll change it. Pick a setup that lets you switch. Your workflows, evals and data are what you keep. 10. “What will it cost to run?” Get it in writing before the build: tokens, hosting and licences, with costs broken down per month and per transaction. 11. “Do we pay for time or for outcomes?” Either works as long as you can walk away. Work month-to-month, with no lock-in and a checkpoint after the first month. 12. “How do we tell a real AI partner from one that started last year?” Before you sign, ask to see something they built that’s running in production for another customer today. Then call that customer. After you sign, give them one team for a month. If nothing changed, throw them out. The question I’d add to the list: what happens if it works? Who runs it, who improves it, and what does your team do with the time it gives back? Ask it before you start.
13
Agents will need clean, auditable money rails. Built a small demo of this for Razorpay Buildathon — human + MCP AI buyer on the same backend, with spending caps + full audit trail so every action is explainable. github.com/ayushanand27/razo…
agents will inevitably drive most onchain activity, yet few are thinking about how they'll coordinate and deploy capital at scale this requires a framework unifying governance, execution, and economic incentives Forever is the foundation for an autonomous economy
6
This is the real bottleneck. Coding agents ship apps fast. Reliable data + citations on messy real-world data is harder. Been fighting the same thing in financial RAG (SMRA) — Indian filings still hallucinate numbers. Grounding > model size.
Coding agents can ship an app in hours. A reliable data pipeline? that's another story! Data is messy. constantly changing. and unforgiving. @Eon_io_ just launched Yukon to change that. > ingest, process, and serve in one flow > open Iceberg tables in your own bucket > 4x less compute than Spark, 7x less than Flink
1
1
2
534
ResumeMatch — ATS scorer + AI rewriter + multi-format resume generator. Three-layer scoring (structure + evidence-weighted skills + contextual fit). Deterministic core, optional AI rewrite. Code: github.com/ayushanand27/ats-… #ATS #Resume #AI #BuildInPublic #Career
1
1
1
32
Solar OS — Autonomous Solar Farm Intelligence. Edge AI that senses threats (birds, dust), decides in <100ms, protects panels, and routes energy (battery / H₂ / grid). Live demo: solar-os-ai.streamlit.app Code: github.com/ayushanand27/sola… #EdgeAI #Solar #ClimateTech #BuildInPublic
1
8
Built a RAG study Telegram bot. Upload your notes/PDFs → Learn with grounded answers + take MCQ/MSQ/Theory tests. Topics, streaks, mistake practice, voice. Categories for Placement, JEE, NEET, UPSC, etc. Live bot: t.me/mock_practice_bot Code: github.com/ayushanand27/mock… #RAG #AI #TelegramBot #BuildInPublic #Study
1
27
SBI-SETU — cuts bank branch queues. Chat help before the visit + token kiosk + staff dashboard. React + FastAPI + Supabase. Live: sbi-setu.onrender.com Code: github.com/ayushanand27/SBI-… #Fintech #BuildInPublic #React
1
1
45
Nirdesh — shows what a new SEBI circular changes and whether your team is still compliant. React + TypeScript + FastAPI. Live: nirdesh-frontend.onrender.co… Code: github.com/ayushanand27/nird… #Fintech #Compliance #BuildInPublic #SEBI
1
10
Built a full-stack AI interview platform. Proctoring, speech transcription, code execution, JWT roles. FastAPI + React, deployed on AWS EC2. Live: ai-interview-bot.duckdns.org Code: github.com/ayushanand27/AI-i… #AI #BuildInPublic #FastAPI #React
1
16
Leaked a key? pip install leakkill Finds it. Checks if it's still live. Revokes it in one command. Also stops Claude Code, Cursor, Copilot & Codex from reading .env or writing secrets. Zero dependencies. Fully local. Free. github.com/ayushanand27/leak… #security #devsecops #AI #Claude #Cursor #BuildInPublic
1
34