Hi, I'm Shantanu Mallik.

Software Systems Engineer & PV Engineer.

Software Systems Engineer at Ciena — building automation platforms and agentic AI systems for distributed networking infrastructure.

Shantanu Mallik
Shantanu Mallik hiking in the mountains

Software Systems Engineer at Ciena, designing and shipping the internal platform that validates distributed optical networking hardware at 1.6 Tbps scale. My work spans Python backend services, REST APIs integrated into Jenkins CI/CD pipelines, and agentic AI workflows built with LangChain and LangGraph — systems that replace manual engineering effort with structured, machine-driven reasoning. Previously a Research Engineer at IIIT Delhi's Complex Systems Laboratory, and four years as a freelance backend developer shipping production systems to 50,000+ users.

Work — Selected Projects

💻
Featured

Agentic Failure Triage System

LLM-powered root-cause analysis for CI/CD test failures at scale

Built at Ciena to address a core challenge in large-scale hardware validation: extracting signal from thousands of test failures per build cycle. An agentic workflow ingests structured failure logs from Jenkins CI/CD runs, uses LangGraph to orchestrate multi-step LLM reasoning chains, and produces clustered root-cause summaries with confidence scores and suggested remediation paths — compressing engineer triage time from hours to minutes.

Python LangChain LangGraph OpenAI Jenkins REST APIs Git
💻
Featured

Internal Validation Platform

Backend platform orchestrating 1.6 Tbps distributed systems testing

Core backend contributor to Ciena's internal developer platform — a Python service layer that orchestrates automated firmware and system-build validation across distributed networking hardware at up to 1.6 Tbps. Exposes REST APIs consumed by Jenkins CI/CD pipelines to trigger, monitor, and report on thousands of test runs across hardware variants.

Python REST APIs Jenkins Grafana TestRail CI/CD Linux
💻

FlavorDB & RecipeDB APIs

Data APIs powering 118k+ recipes and 934-ingredient flavour knowledge base

At the Complex Systems Laboratory (IIIT Delhi), built the backend data services underpinning two large-scale research knowledge bases. RecipeDB: queryable API over 118,000+ recipes across 26 global regions. FlavorDB: data models and retrieval APIs for 934 natural ingredients and their flavour molecule profiles — used by food scientists globally.

Python REST APIs Data Modeling Data Pipeline Design PostgreSQL
💻

Freelance Backend Systems

Production APIs and platforms scaled to 50,000+ users

Four years of independent backend engineering across startup and enterprise engagements. Built automation-first APIs eliminating ~95% of clients' manual processing workloads. Delivered complete Python + Flask backends from schema design through cloud deployment, serving 50,000+ active users in production.

Python Flask Ruby on Rails REST APIs PostgreSQL GCP Heroku CI/CD

Skills & Toolkit

What's in the toolkit.

Agentic Ai

Agentic AI Systems 93%
LangChain / LangGraph 89%
LLM Integration 87%
AI Failure Triaging 90%
RAG Pipelines 84%
Prompt Engineering 88%

Backend Engineering

Python 97%
REST API Design 93%
Flask / FastAPI 88%
PostgreSQL 82%
Docker 80%
Linux 87%

Data Engineering

Data Modeling 85%
Data Pipeline Design 83%
Large-Scale Data Analysis 80%

Platform & Ci/cd

Automation 93%
Jenkins CI/CD 90%
Distributed Systems 84%
Grafana 80%
TestRail 78%

Tooling & Cloud

Git / GitHub 92%
GCP 74%
Ruby on Rails 70%
Heroku 72%

Experience

Ciena Jan 2025 — Present

Software Systems Engineer

Building the internal platform that validates distributed networking hardware operating at up to 1.6 Tbps. Design and ship Python-based backend services and REST APIs consumed by Jenkins CI/CD pipelines — automating firmware and system-build validation across multiple hardware variants and reducing manual testing effort by 40–50%. Developed an agentic failure triaging system using LangChain and LangGraph that ingests raw test failures, clusters root causes via LLM reasoning chains, and delivers structured debugging summaries — compressing triage time from hours to minutes. Architected Grafana dashboards surfacing build-execution trends, test stability signals, and platform health KPIs for engineering leadership.

Python LangChain LangGraph REST APIs Jenkins Grafana TestRail CI/CD Git Linux
Complex Systems Laboratory / Foodoscope Jan 2024 — Jan 2025

Research Intern

Research Engineer at IIIT Delhi's Complex Systems Laboratory, building backend systems and data APIs for large-scale food, nutrition, and health knowledge bases. FlavorDB: data models and retrieval APIs for 934 natural ingredients and their flavour-molecule compositions. RecipeDB: data pipelines and querying layer for 118,000+ recipes spanning 26 global regions. DietRx: a backend system linking dietary ingredients to peer-reviewed therapeutic evidence.

Python REST APIs Data Modeling Data Pipeline Design PostgreSQL
Freelance Apr 2019 — Apr 2023

Software Engineer

Four years of end-to-end backend engineering delivery across startup and enterprise engagements. Designed and shipped production-grade Python and Ruby on Rails systems serving 50,000+ active users. Built automation-focused APIs that eliminated approximately 95% of clients' manual processing workloads. Managed full deployment pipelines on GCP and Heroku, from schema design through production release.

Python Flask Ruby on Rails REST APIs PostgreSQL Git Linux GCP Heroku CI/CD

Beyond the Code

Hiking

Mountains are the only place I find the same clarity I get from a well-designed system.

Get In Touch

📍 Gurugram, Haryana, India