PORTFOLIO 2026

Samarth
Agarwal

AI Engineer · LLM Evaluation · Edge Systems

Samarth.
Hi, I'm

Samarth
Agarwal.

AI Engineer Backend · Data Pipelines · LLM Systems

I build software, data, and AI systems that hold up in production — reliable backends, measurable pipelines, and applications that actually ship.

2+
Years Experience
6+
Projects Shipped
AI + Data
Specialist
Open to opportunities — MS Data Science, Stony Brook ’26 📍 New York, USA
Samarth Agarwal
Who I Am

About Me

I'm an engineer working across AI, software, and data science, with an MS in Data Science from Stony Brook University and 2+ years of enterprise software experience at Genpact building Salesforce CRM architectures for global clients.

My focus is building systems that are measurable and production-ready — whether that's a backend service, a data pipeline, or an LLM application. I've shipped evaluation frameworks benchmarking GPT-4, Gemini, and LLaMA across normalized metrics, edge-native apps with recursive failover, real-time serverless dashboards, and autonomous multi-agent systems. I care about the parts that decide whether software survives contact with production: clear metrics, sane architecture, and reliability under load.

MS Data Science, Stony Brook University — New York
Ex-Genpact: Senior Associate Software Developer (Salesforce CRM)
GenAI Prompt Engineer Intern @ ARMA AI Labs, California
GSolve.ai ML Hackathon 2023 Winner
Where I've Worked

Experience

2025

Generative AI Prompt Engineer Intern

ARMA AI Labs — California, USA

  • Built a DeepEval-powered evaluation framework establishing reproducible QA pipelines across 7 normalized metrics.
  • Benchmarked GPT-4, Gemini, and LLaMA on 20+ real-world articles, revealing accuracy vs. cost-efficiency trade-offs.
  • Delivered a production model-selection pipeline with dynamic LLM routing.
2022–24

Senior Associate Software Developer

Genpact — India

  • Reduced manual data entry 60% for enterprise clients with scalable Salesforce CRM architectures.
  • Integrated Salesforce with ERP systems over SFTP for low-latency global data consistency.
  • Shipped Lightning Web Components dashboards and resolved production defects.
2021

Machine Learning Engineer Intern

TannMann Foundation — Remote

  • Achieved 96% validation accuracy in brand-logo detection with a TensorFlow pipeline using layer freezing and augmentation.
  • Mitigated early-epoch overfitting for production-ready performance under varying lighting.
Selected Work

Projects

Backend services, data pipelines, and AI systems — each with metrics to back it up.

View Demo ParamMem research dashboard demo
►
01 — AI Research (ICLR 2025)

ParamMem: Parametric Reflective Memory

Novel architecture internalizing error-correction patterns via LoRA adapters and high-temperature sampling (τ > 0.7) — eliminating agent reflection collapse, cutting latency 94% (45.2s → 2.8s on Groq LPUs), and beating Reflexion baselines on HumanEval & GSM8K.

ICLR 2025PyTorchLoRAGroq LPUChromaDB
View Demo PrepGenie interview coach interface
►
02 — Edge AI

PrepGenie: LLM Interview Coach

Edge-native interview platform powered by Cloudflare Python Workers (Pyodide WASM), Cloudflare D1 distributed SQL, and a Gemini → Groq → Mistral recursive failover chain. 40ms TTFB, sub-100ms cold starts, and 99.9% uptime.

Cloudflare WorkersWASM/pypdfCloudflare D1Recursive Failover
View Demo FlowOps AI Deal Desk Interface
►
03 — Enterprise Agentic AI

FlowOps AI: Autonomous CRM Deal Desk

Stateful multi-agent CRM orchestrator built with LangGraph, FastAPI, and React. Automates lead triage, 0-100 BANT scoring, and HITL margin guardrails with real-time Langfuse tracing and 7 DeepEval benchmark metrics.

LangGraphFastAPILangfuse TracingDeepEvalHITL Guardrails
View Demo AI penetration testing framework
►
04 — Security AI

Autonomous AI Penetration Testing

Multi-agent cybersecurity pipeline chaining Recon (Nmap, Shodan API), Vulnerability Scanning (NVD CVE API, CVSS), Exploit Synthesis, and Strategic Reporting powered by Groq Llama-3.1-70B with Gemini fallback and strict SSRF guardrails.

Llama 3.1 70BNVD APICVSSSSRF GuardrailsDocker
View Demo Real-time stocks dashboard
►
05 — Serverless Streaming

Real-Time Stocks Pipeline (MarketPulse)

Migrated from a heavyweight Kafka + Snowflake + Airflow modern data stack to global Cloudflare Workers (V8), D1, R2, React 18, and D3.js. Dynamic edge caching cuts external API load by 90% at $0 idle compute cost.

Cloudflare WorkersD1 SQLiteR2 Object StoreReact 18D3.js
View Demo LLM evaluation framework dashboard
►
06 — LLM Evaluation Pipeline

LLM Content Evaluation Framework

Standardized evaluation engine for professional content rewriting benchmarking GPT-4 (96% factuality), Gemini 2.5 Flash (40x cheaper), and LLaMA 3-70B across 7 normalized metrics (BLEU, ROUGE, BERTScore, DeepEval G-Eval).

DeepEvalLLM-as-JudgeBLEU/BERTScoreMetric Normalization
View Demo GestureSynth hand gesture to MIDI
►
07 — Computer Vision & HCI

GestureSynth: Gestures to MIDI

Vision-based HCI system converting hand kinematics into musical MIDI in real-time at 30 FPS (<80ms latency) using MediaPipe and an adaptive LLM tuning loop that accelerates user learning curves by 40%.

MediaPipeOpenCVMIDIPyQt5HCI Design
Proof of Work

Credentials

🏆
SAP Certified — Generative AI Developer
SAP
Verify on Credly →
☁️
Salesforce Certified AI Associate
Salesforce
Verify on Trailblazer →
🥇
GSolve.ai ML Hackathon 2023 — Winner
Genpact Internal Hackathon
📊
AWS Solutions Architecture · BCG Data Science
Virtual Experience Programs
📈
Purchase Pattern Prediction — Rank 123 / 2000+
Univ.ai Competition
🎓
KPMG Data Analytics · Goldman Sachs SWE
Virtual Experience Programs