Hi, I'm Shantanu Mallik.

Software Systems & PV Engineer.

I build systems that automate the hard parts and let AI handle the rest.

Shantanu Mallik
Shantanu Mallik hiking in the mountains

I'm a Software Systems Engineer who's spent the last several years at the intersection of automation, network validation, and agentic AI. At Ciena, I build the Python-driven platforms and intelligent triage workflows that make complex systems — operating at 1.6 Tbps — verifiable, reliable, and predictable at scale. But the systems I build are only half the story. The other half is the obsessive curiosity that drives me to keep going. I started in SVT and PV engineering — writing test frameworks, debugging protocol behavior, chasing down the exact failure condition in a 400-node fabric — and somewhere along the way became fascinated with what happens when you let language models reason about those failures instead of humans. So I built that too. When I'm away from the terminal, I'm usually somewhere in the mountains. Hiking resets my brain in a way that nothing else does — there's something clarifying about problems with a single, obvious goal: get to the top. I also play guitar, badly enough that it stays humbling and good enough that I keep at it. Both feel like debugging with better scenery. I believe the most interesting work lives at the boundary between what's well-understood and what isn't. That's where I try to spend my time — whether I'm designing a failure-triage agent, tracing a packet through a broken pipeline, or figuring out why a chord progression doesn't resolve the way I expected. If you're building something at that edge — or you're curious about the intersection of systems engineering and AI — I'd genuinely love to talk. Or check out what I do when I'm not at a terminal.

Work — Selected Projects

💻
Featured

Agentic Failure Triage System

LLM-powered root-cause clustering for CI/CD test failures

Designed for large-scale hardware validation environments where thousands of test failures land per build cycle. An agentic workflow ingests structured failure logs from Jenkins CI/CD runs, uses LangGraph to orchestrate multi-step LLM reasoning chains, and produces clustered root-cause summaries with confidence scores and suggested fix paths.

Python LangChain LangGraph OpenAI Jenkins REST APIs Git
💻
Featured

Hardware Validation Platform

Backend platform orchestrating distributed firmware and systems testing

Core backend contributor to a large-scale internal developer platform — a Python service layer that orchestrates automated firmware and system-build validation across distributed high-speed networking hardware. Exposes REST APIs consumed by Jenkins CI/CD pipelines to trigger, monitor, and report on thousands of test runs across hardware variants.

Python REST APIs Jenkins Grafana TestRail CI/CD Linux
💻

FlavorDB & RecipeDB APIs

Data APIs powering 118k+ recipes and 934-ingredient flavour knowledge base

At the Complex Systems Laboratory (IIIT Delhi), built the backend data services underpinning two large-scale research knowledge bases. RecipeDB: queryable API over 118,000+ recipes across 26 global regions. FlavorDB: data models and retrieval APIs for 934 natural ingredients and their flavour molecule profiles — used by food scientists globally.

Python REST APIs Data Modeling Data Pipeline Design PostgreSQL
💻

Freelance Backend Systems

Production APIs and platforms scaled to 50,000+ users

Four years of independent backend engineering across startup and enterprise engagements. Built automation-first APIs eliminating ~95% of clients' manual processing workloads. Delivered complete Python + Flask backends from schema design through cloud deployment, serving 50,000+ active users in production.

Python Flask Ruby on Rails REST APIs PostgreSQL GCP Heroku CI/CD

Skills & Toolkit

What's in the toolkit.

Agentic Ai

Agentic AI Systems 93%
LangChain / LangGraph 89%
LLM Integration 87%
AI Failure Triaging 90%
RAG Pipelines 84%
Prompt Engineering 88%

Backend Engineering

Python 97%
REST API Design 93%
Flask / FastAPI 88%
PostgreSQL 82%
Docker 80%
Linux 87%

Data Engineering

Data Modeling 85%
Data Pipeline Design 83%
Large-Scale Data Analysis 80%

Platform & Ci/cd

Automation 93%
Jenkins CI/CD 90%
Distributed Systems 84%
Grafana 80%
TestRail 78%

Tooling & Cloud

Git / GitHub 92%
GCP 74%
Ruby on Rails 70%
Heroku 72%

Experience

Ciena Jan 2025 — Present

Software Systems Engineer

Built a LangGraph agentic triage system that ingests CI/CD test failures, runs multi-step LLM reasoning chains to cluster root causes, and delivers structured debugging summaries to developers — cutting triage time from hours to minutes. Design and ship Python REST APIs and backend services consumed by Jenkins CI/CD to trigger, orchestrate, and report on firmware and system-build test runs across multiple L2/L3 hardware variants operating at up to 1.6 Tbps — reducing manual testing effort by ~40–50%. Architected Grafana dashboards giving engineering leadership a real-time view of build health, test stability, and platform KPIs across all hardware programs. Led a team of 5 on the orchestration service layer: conducted PR and code reviews, formulated test plans, designed reusable Grafana dashboards, and ran CPU test pipelines across multiple hardware variant programs.

Python LangChain LangGraph REST APIs Jenkins Grafana TestRail CI/CD Git Linux
Complex Systems Laboratory / Foodoscope Jan 2024 — Jan 2025

Research Intern — Backend & Data Engineering

Built APIs and data models for FlavorDB: 934 natural ingredients across 36 categories and their flavour-molecule compositions, used by food scientists globally. Designed the canonical data schema and normalisation layer enabling cross-dataset aggregation for research publications. Designed the data foundation and querying layer for RecipeDB: 118,000+ recipes spanning 26 global regions, with nutritional composition and regional cuisine analytics; standardised metadata across heterogeneous source datasets. Developed backend for DietRx: database linking dietary ingredients to clinical therapeutic evidence by diet–disease associations.

Python REST APIs Data Modeling Data Pipeline Design PostgreSQL
Freelance Apr 2019 — Apr 2023

Software Engineer

Four years of end-to-end ownership delivering production-grade Python and Ruby on Rails systems; backends serving 50,000+ active users in production. Led major platform refactors: security hardening, performance tuning, dependency upgrades. Managed full deployment pipelines on GCP and Heroku; owned full engineering lifecycle solo under commercial timelines.

Python Flask Ruby on Rails REST APIs PostgreSQL Git Linux GCP Heroku CI/CD

Beyond the Code

Hiking

🎸

Guitar

📷

Photography

🧭

Wandering

✈️

Aviation

Get In Touch

📍 Gurugram, Haryana, India