Ercin · AI Architect (@aiarchitect) header
Ercin · AI Architect (@aiarchitect) profile picture

AI Architect · Sovereign AI for regulated banking · LLM red teaming before go-live · https://teapawt.net/t.co/RJq8xP5EKb

Joined April 2015
Photo by Ercin · AI Architect (@aiarchitect)Photo by Ercin · AI Architect (@aiarchitect)Photo by Ercin · AI Architect (@aiarchitect)Photo by Ercin · AI Architect (@aiarchitect)Photo by Ercin · AI Architect (@aiarchitect)Photo by Ercin · AI Architect (@aiarchitect)Photo by Ercin · AI Architect (@aiarchitect)Photo by Ercin · AI Architect (@aiarchitect)Photo by Ercin · AI Architect (@aiarchitect)Photo by Ercin · AI Architect (@aiarchitect)
Here's the thing: the ECB gave significant banks until 31 October 2026 to send their supervisors an action plan against AI-enabled cyber threats. Annex 1, area 2: "Accelerate vulnerability and patch management at scale." Patch speed is now a board question. NOT a ticket queue.
4
3
22
Source: ECB Banking Supervision letter SSM-2026-0301, 7 July 2026. Annex 1 runs from attack surfaces to crisis exercises: bankingsupervision.europa.eu…
5
Look. Your payments agent saw "KYC passed". It did NOT run KYC. It can't verify it. The money moved anyway. SAD! That's Borrowed Clearance. Signed, payload-bound clearance is NEVER inherited. Can't prove the check? Then you don't have it. STOP!
1
17
LOOK at footnote 3 of SR 26-2. That's the US model-risk guidance (17 Apr 2026) that REPLACED SR 11-7. Generative and agentic AI? "Not within the scope of this guidance." OUT! So who tests your bank's LLM? BTW, the same footnote points back to your own risk management. YOU do.
2
19
SR 26-2: federalreserve.gov/supervisi… Footnote 3 is in the attached guidance: federalreserve.gov/supervisi… What testing an LLM before go-live looks like: ercin.info/llm-red-teaming-b…
19
US banks are BLOCKING third-party AI agents from customer accounts. HUGE. Why? Some customers hand the agent their OWN login. The bank can't tell human from bot. Folks, that's not an AI problem. It's IDENTITY. Every agent needs its own scoped credential. Sharing yours? WRONG!
3
1
5
55
"In-country inference" is NOT "everything stays in the UAE." Read the fine print! OpenAI's own page: GPU inference stays in region. Auth, routing, analytics and some CPU work may run outside it. Look, your bank's data-flow diagram needs BOTH boxes. Every time!
1
31
UAE plans to move HALF of federal government operations to agentic AI in two years. HUGE. The minister: audits are "done by agents" and "done by humans." Good! Look, an agent that audits agents can't LEND its check to the next one. Every action needs its OWN signed approval.
1
37
A passing LLM eval is a SNAPSHOT. Not a control. Change the model, prompt, RAG corpus, tools, guardrails or languages? Re-run it. Every time! btw it fits in CI: evaluate() returns GO or NO-GO, pytest fails the build on an open critical. Boring. BEAUTIFUL!
1
2
49
The UAE central bank's AI guidance note (11 Feb 2026) asks for "the clear and immediate ability, with human intervention, to cease use" of an AI system. Here's the deal: if nobody has timed your kill switch, you don't have one. TESTED OR IT DOESN'T EXIST!
1
1
66
Section 6f, CBUAE guidance note on AI and ML: rulebook.centralbank.ae/en/r… Where the kill switch should live (the LLM gateway): huggingface.co/blog/Ercin/so…
1
26
Pass/fail red teaming is LYING to your bank. A harmless slip and a customer-data leak get the SAME score. WRONG! Look, severity is the signal. So I built a free scorer: 9 harm categories, 4 severity levels, 5 go/no-go gates. Open source. Nothing stored. #LLMRedTeaming
2
1
62