Featured Projects
Infrastructure blueprints, MLOps GPU inference platforms, continuous integration automation, and enterprise SRE setups.
Multi-Region Auto-Scaling EKS Cluster with GitOps
Production-grade multi-region Amazon EKS deployment using Terraform, ArgoCD, and Istio service mesh supporting 300+ microservices.
Key Capabilities
- •Automated cross-region cluster failover under 60 seconds
- •KEDA event-driven auto-scaling based on SQS queue depth and Prometheus metrics
- •Zero-trust mTLS encryption between microservices via Istio
- •Automated cluster upgrades using Karpenter node auto-provisioning
High-Throughput Distributed LLM Inference Pipeline
Scalable GPU inference platform built with vLLM, NVIDIA Triton Inference Server, and KEDA on Kubernetes for low-latency LLM serving.
Key Capabilities
- •Continuous batching & PagedAttention for 3.5x higher token throughput
- •Dynamic GPU worker auto-scaling from 0 to 16 A10G instances based on queue depth
- •Model weights caching using S3 Mountpoint CSI driver to reduce cold starts by 80%
- •Unified Prometheus telemetry for GPU utilization, memory bandwidth, and TTFT
Zero-Downtime Multi-Cloud CI/CD & DevSecOps Suite
End-to-end continuous deployment pipeline with automated canary analysis, SAST/DAST security scanning, and Vault dynamic secrets.
Key Capabilities
- •Canary deployments with automated rollback on error rate threshold breach (>0.5%)
- •Ephemeral feature environment creation on PR open & teardown on merge
- •HashiCorp Vault AppRole integration for zero hardcoded secrets
- •Reduced deployment pipeline build runtime by 85%
Enterprise Observability & SLO Management Platform
Unified observability architecture aggregating metrics, logs, and distributed traces across hybrid cloud environments using Thanos, Grafana & OpenTelemetry.
Key Capabilities
- •Long-term metrics retention with Thanos storing 2+ years of data on AWS S3
- •Automated SLO/SLA error budget tracking and burn-rate alert notifications
- •OpenTelemetry auto-instrumentation across microservice HTTP/gRPC boundaries
- •Centralized Log aggregation using Grafana Loki handling 50GB/day log volume
Automated Cloud FinOps & Cost Optimization Engine
Automated serverless solution to detect orphaned resources, right-size compute clusters, and enforce AWS/GCP cost budgets automatically.
Key Capabilities
- •Automated shutdown of staging/dev clusters outside business hours
- •Orphaned EBS volume, unattached Elastic IPs, and idle NAT Gateway cleaner
- •Karpenter Spot Instance optimizer achieving 70% compute cost reduction
- •Real-time Slack notification alerts for budget anomaly detections