Suparna Chowdhury retweeted
AI SYSTEM DESIGN ROADMAP
β
βββ 1. FOUNDATIONS
β βββ AI, ML, Deep Learning & Generative AI
β βββ Mathematics, Statistics & Probability
β βββ Python, NumPy & Pandas
β βββ Neural Networks & Transformers
β βββ LLM Fundamentals & Tokenization
β
βββ 2. AI MODEL ARCHITECTURE
β βββ Model Selection & Evaluation
β βββ LLMs, SLMs & Multimodal Models
β βββ Embedding Models & Rerankers
β βββ Fine-Tuning, LoRA & PEFT
β βββ Model Serving & Inference
β
βββ 3. DATA ENGINEERING
β βββ Data Collection & Ingestion
β βββ Data Cleaning & Preprocessing
β βββ Data Labeling & Governance
β βββ Feature & Embedding Pipelines
β βββ Data Quality & Versioning
β
βββ 4. LLM APPLICATION ARCHITECTURE
β βββ Prompt Engineering
β βββ Structured Outputs & Function Calling
β βββ RAG (Retrieval-Augmented Generation)
β β βββ Document Chunking
β β βββ Embeddings & Vector Databases
β β βββ Hybrid Search & Reranking
β β βββ Retrieval Evaluation
β βββ AI Agents & Tool Use
β βββ Memory & Context Management
β βββ Multi-Agent Systems
β
βββ 5. SYSTEM ARCHITECTURE
β βββ Requirements & Workload Estimation
β βββ Monoliths, Microservices & Modular Design
β βββ API Gateway & Model Gateway
β βββ Synchronous & Asynchronous Processing
β βββ Message Queues & Event-Driven Systems
β βββ Caching & Semantic Caching
β βββ Load Balancing & Autoscaling
β βββ Distributed Systems & Fault Tolerance
β
βββ 6. STORAGE & INFRASTRUCTURE
β βββ SQL & NoSQL Databases
β βββ Vector Databases
β βββ Object Storage & Data Lakes
β βββ GPU / CPU Compute Infrastructure
β βββ Containers & Kubernetes
β βββ Cloud Platforms
β βββ Model Serving Infrastructure
β
βββ 7. AI EVALUATION & OBSERVABILITY
β βββ Offline & Online Evaluation
β βββ Accuracy, Relevance & Groundedness
β βββ Hallucination Detection
β βββ LLM-as-a-Judge
β βββ Tracing & Distributed Logging
β βββ Latency, Throughput & Token Usage
β βββ A/B Testing & Continuous Evaluation
β
βββ 8. SECURITY & GOVERNANCE
β βββ Authentication & Authorization
β βββ Prompt Injection Defense
β βββ Data Privacy & PII Protection
β βββ Secrets & Key Management
β βββ Guardrails & Output Validation
β βββ Model Supply Chain Security
β βββ Responsible AI & Compliance
β
βββ 9. PERFORMANCE & COST OPTIMIZATION
β βββ Quantization & Distillation
β βββ Batching & Parallel Inference
β βββ Model Routing & Cascading
β βββ KV Caching
β βββ GPU Utilization & Throughput
β βββ Token Budget Optimization
β βββ QualityβLatencyβCost Trade-offs
β
βββ 10. MLOps & LLMOps
β βββ CI/CD & Model Versioning
β βββ Automated Testing & Evaluation
β βββ Model Deployment & Rollbacks
β βββ Data & Prompt Versioning
β βββ Drift Detection & Monitoring
β βββ Continuous Improvement
β
βββ 11. END-TO-END AI SYSTEM DESIGN
βββ AI Chatbot / Customer Support
βββ RAG-Based Knowledge Assistant
βββ AI Coding Assistant
βββ AI Search & Recommendation Engine
βββ Document Intelligence Platform
βββ AI Agent / Workflow Automation
βββ Real-Time Voice AI System
βββ Multimodal AI Application
βββ Large-Scale AI Inference Platform
βββ Production-Ready AI SaaS
βββ Requirements & Architecture
βββ Data & Model Pipeline
βββ APIs & Infrastructure
βββ Security & Evaluation
βββ Scaling & Cost Optimization
βββ Reliability & Production Monitoring
Follow @e_opore to learn more. Bookmark and share for more people to master it.
Suparna Chowdhury retweeted
Learn AI for free directly from top companies.
1 - Anthropic:
anthropic.skilljar.com
2 - Google:
grow.google/ai
3 - Meta:
ai.meta.com/resources/
4 - NVIDIA:
developer.nvidia.com/cuda
5 - Microsoft:
learn.microsoft.com/en-us/trβ¦
6 - OpenAI:
academy.openai.com
7 - IBM:
skillsbuild.org
8 - AWS:
skillbuilder.aws
9 - DeepLearning.AI:
deeplearning.ai
10 - Hugging Face:
huggingface.co/learn
Comment "Learning" if you find this helpful.
Repost so others can take help.
Must bookmark for future reference.
Suparna Chowdhury retweeted
Earn $400 per hour by reading books!
I've compiled a guide featuring 20 methods to help you earn $5,000 daily.
Normally priced at $199, But today it's FREE.
To get it: Like this post & RT
Comment 'Book'
I'll DM it to you -->(Must be following)
Suparna Chowdhury retweeted
The US government, citing national security authorities, has issued an export control directive to suspend all access to Fable 5 and Mythos 5 by any foreign national, whether inside or outside the United States, including foreign national Anthropic employees.
The net effect of this order is that we must abruptly disable Fable 5 and Mythos 5 for all our customers to ensure compliance.
Access to all other Claude models is not affected.
We apologize for this disruption to our customers. We believe this is a misunderstanding and are working to restore access as soon as possible.
Read our full statement: anthropic.com/news/fable-mytβ¦
Suparna Chowdhury retweeted
Today I'm publishing a new essay, Policy on the AI Exponential. AI is progressing extremely fastβmuch faster than the policy process was built to handle. The essay lays out where I think the technology is now, and the action needed to close the gap: darioamodei.com/post/policy-β¦
Suparna Chowdhury retweeted
Google released Gemma 4 12B, a multimodal model that runs text, images, and audio on 8GB VRAM!
We'll fine-tune it to master chess and predict the exact next move.
Tech stack:
- @UnslothAI for efficient fine-tuning.
- @huggingface transformers to run it locally.
Let's go! π
Suparna Chowdhury retweeted
You're in a Research Scientist interview at OpenAI.
The interviewer asks:
"How would you expand the context length of an LLM from 2K to 128K tokens?"
You: "I will fine-tune the model on longer docs with 128K context."
Interview over.
Here's what you missed:
Suparna Chowdhury retweeted
π¨Anthropic just showed a 24-minute workshop on how to actually do prompts for Claude.
Taught by the people who built it.
Free. No registration. No paywall.
I've seen $300 courses that don't cover what they teach in the first 8 minutes.
Watch it and bookmark it now!
Suparna Chowdhury retweeted
New blog post: The bug that taught me more about PyTorch than years of using it
started with a simple training loss plateau... ended up digging through optimizer states, memory layouts, kernel dispatch, and finally understanding how PyTorch works!
Suparna Chowdhury retweeted
I just published Mastering SQL: Top Interview Questions and Answers link.medium.com/p9w5lHSvIOb
#SQL #MySQL #SQLInterview #TechCareer #DataScience #DatabaseDesign #TechTips #SQLQueries #Optimization #interviewPreps #DataAnalytics #DataAnalysis #Interview
Suparna Chowdhury retweeted
Check out my latest article on Medium!
The Art of Feature Engineering: Encoding Categorical Variables
link.medium.com/eTmCN981sOb
Learn how to encode it effectively with methods like One-Hot Encoding, Label Encoding, & more!
#MachineLearning #DataScience #DataPreprocessing #AI #ML
Suparna Chowdhury retweeted
Boost your database performance and ensure efficient data retrieval!
Check out my article on Mastering SQL SELECT Query Optimization in MySQL: link.medium.com/KjCkspTjANb
π Learn to use the EXPLAIN clause, leverage indexes, and more!
π Share and follow for more insights! #MySQL
Suparna Chowdhury retweeted
I just published Understanding SQL JOINS link.medium.com/ULAVKpfwkNb
#SQL #DataAnalytics #InterviewTips
Suparna Chowdhury retweeted
Dive into our latest article on SQL window functions!
Learn the key differences and use cases of ROW_NUMBER(), RANK(), and DENSE_RANK() to boost your data analysis skills.
#SQL #DataAnalysis #DataScience
link.medium.com/3mZBAgbefNb
Suparna Chowdhury retweeted
π #SQLChallenge Day 3/30: Problem #25 in Ace the Data Science Interview!
Write a query to get the percentage breakdown of time spent sending vs. opening snaps by age group, rounded to 2 decimal places.
πgithub.com/suchow07/sql-chalβ¦
#SQL #DataAnalytics #DataAnalyst #SQLQueries

















