Vivek Agarwal

Vivek Agarwal

Infrastructure & AI Engineer @ FinalRoundAI

Currently exploring startups, fintech, distributed systems, and tracing & observability.

What I Care About

Distributed Systems

Building reliable systems where components fail. Focus on observability and fault tolerance.

🧠

AI Infrastructure

Multi-agent orchestration, LLM observability. Making AI debuggable and reliable at scale.

📈

Fintech

Democratizing financial access. Building tools for retail Indian markets.

Experience

FinalRoundAI Sept 2025 – Present

Infrastructure & AI Engineer

  • Architected distributed multi-agent system for Hellyeah AI using Agno orchestration and LangFuse for LLM observability
  • Built RAG pipelines for async evaluations powering AI-driven interview feedback
  • Created MCP-based integrations for agentic control on Google & Meta Ads
  • Managed GitOps (Argo CD) deployments with hybrid observability (Datadog + LGTM)

Stealth Fintech Startup

Co-Founder

  • Architected end-to-end MFT platform for retail Indian markets
  • Built ultra-low-latency (<50ms) UDP market feed using Rust
  • Designed custom MCP server to power AI-driven trading clients with real-time market data
Aspora (Vance) Apr – Sept 2025

DevOps Engineer

  • Designed observability infrastructure for 25+ services (queues, databases, APM, logs)
  • Architected Airflow-orchestrated ETL workflows to Redshift
  • Implemented Debezium-based CDC system for real-time order processing
  • Zero-downtime service migrations with Terraform and Terragrunt
Embeddings Corporation Mar – Apr 2025

Software Engineer

  • Built search-based evaluations using OpenSearch, embedding models, and vector databases for semantic retrieval
  • Worked on LLM and RAG architectures for document Q&A and knowledge retrieval systems
  • Designed evaluation pipelines to benchmark retrieval accuracy and relevance across different embedding strategies
Soundverse AI Mar 2024 – Mar 2025

Backend & DevOps Lead

Dec 2024 – Mar 2025
  • Led complete Soundverse 2.0 rewrite — backend migration from Next.js + MongoDB to FastAPI + PostgreSQL, frontend from Next.js 13 to 14
  • Scaled platform to 385,000+ users with async processing, priority-based queuing, and 100% reliability
  • Architected GPU cluster for LLM model inference with parallelization across worker nodes
  • Managed team of 3 engineers with full technical ownership in absence of CTO

Backend Engineer

Sept – Nov 2024
  • Built acknowledgment-based WebSocket delivery using Redis for reliable cross-platform real-time messaging
  • Redesigned system architecture with the CTO to enable reliable messaging at scale
  • Implemented end-to-end CI/CD with GitHub Actions and production monitoring with Grafana + Prometheus for Celery workers
  • Handled AI traffic via RabbitMQ for async processing

Full Stack Engineer

Mar – Aug 2024
  • Built real-time collaboration for AI Studio enabling seamless teamwork in song creation
  • Developed data attribution platform using Qdrant to track AI model usage for licensed audio
  • Created SEO-optimized, indexed Song & Profile pages for discoverability
  • Redesigned the platform UI and collaborated with Shopflo on end-to-end marketing campaigns
Sigma Cranes & Hoists Jun – Aug 2024

Full Stack Engineer (Freelance)

  • Built an interactive 3D spares purchasing platform for complex industrial crane and hoist machinery, enabling visual part identification and ordering
  • Developed an internal ERP system to digitize decades of legacy paper records and automate procurement, inventory, and workflow management
  • Integrated product catalogs with 3D model viewers so customers could explore machinery components before purchase

Projects

Skills

TypeScript
TypeScript
JavaScript
JavaScript
Rust
Rust
Python
Python
HCL
HCL
React
React
Next.js
Next.js
Node.js
Node.js
FastAPI
FastAPI
Socket.io
Socket.io
Redux
Redux
PostgreSQL
PostgreSQL
MongoDB
MongoDB
Firebase
Firebase
Redis
Redis
Kafka
Kafka
Docker
Docker
Kubernetes
Kubernetes
Terraform
Terraform
AWS
AWS
GCP
GCP
ArgoCD
ArgoCD
Grafana
Grafana
Prometheus
Prometheus

Achievements

Technical

Rashtrapati Bhavan Invite

Rashtrapati Bhavan Invite

Invited by the President of India on the 76th Independence Day. Recognized for outstanding contribution at a national level.

SIH 2024 Winners

SIH 2024 Winners

Won Smart India Hackathon 2024, building a SCADA system for GAIL. Competed against 80,000+ teams nationwide.

Innerve 9.0 Winners

Innerve 9.0 Winners

1st place at Innerve 9.0, Army Institute of Technology. Outperformed 1,250+ teams.

SheCodes 2024 — Blockchain Track

SheCodes 2024 — Blockchain Track

Built a decentralised carbon credits marketplace. Won 1st place in the blockchain track among 70 teams.

Hack Karnataka Winners

Hack Karnataka Winners

Won Hack Karnataka at KLE Technological University with team Luminosity. Organized by Google Developer Group Hubli.

Volunteering

Point Blank — Elite Coding Club, DSCE
Point Blank — Elite Coding Club, DSCE

Part of an elite group of passionate techies — mentored by seniors with 8+ years of industry experience. Learned system design, worked on real projects, and taught juniors from internship and company learnings. Active in "Random & Fresh Blood," a community channel where members discuss everything from SF technologies to compilers. Beyond tech: house parties, treks, and a tight-knit crew that made college memorable.

Literary Society, DSCE — Debate & MUN
Literary Society, DSCE — Debate & MUN

Member for 2 years across the Debate Society and Model United Nations. Attended 30+ college fests, winning at 12–13 per year — debates, extempore, MUN conferences. Built public speaking skills, learned to evaluate the world critically, and formed lasting friendships with seniors and juniors alike.

Get in Touch

Always open for collaborations, discussions, and challenging projects.

Say Hello