Back to Portfolio

Balaji Hariharan

AI Solutions Architect & LLM Engineer

Bangalore, India contact@balajihariharan.com balajihariharan.com LinkedIn GitHub
1,359+
Commits
1.9k+
npm Downloads
97%
Coverage
83,153+
Lines of Code
312
PRs Merged
659+
Issues Closed

Summary

AI Solutions Architect and LLM Engineer with 18+ years of enterprise experience spanning RPA, automation, and AI agent infrastructure. Currently building ShackleAI — an Operating System for AI Agents with 11 microservices, multi-agent orchestration, and enterprise governance. Published open-source MCP server with 1.9k+ total npm downloads. Former Managing Director, APAC at Softomotive (acquired by Microsoft → Power Automate). Delivered enterprise solutions for Microsoft, Walmart, Flipkart, Deloitte, Axis Bank, Sanofi, Capgemini. Deep expertise in LLM pipelines, RAG, vector search, multi-provider routing, agent orchestration, and production AI infrastructure.

Technical Skills

LLM / AI Agents
Multi-agent orchestration, MCP Protocol, CrewAI, LiteLLM (100+ providers), RAG, prompt engineering, PII scrubbing
Vector / Embeddings
pgvector, sqlite-vec, OpenAI embeddings, Transformers.js (MiniLM-L6-v2), semantic search
Languages
TypeScript, Python 3.12+, JavaScript (ES2024), SQL, Bash
Backend
Next.js 16, Express 5, FastAPI, Node.js 22, async-first Python
Frontend
React 19, Next.js App Router, Tailwind CSS 4, shadcn/ui, Framer Motion
Databases
PostgreSQL 16, MongoDB, Redis 7, SQLite, Drizzle ORM, Mongoose
Cloud / DevOps
AWS (S3, SES, CloudFront, Route 53, Lightsail), Docker, GitHub Actions, Caddy, CI/CD
Security
AES-256, RBAC + ABAC, JWT, OAuth 2.0, OWASP LLM Top 10, credential vaulting
Observability
OpenTelemetry, per-call LLM cost tracking, audit trails, Playwright E2E, Vitest, pytest
Payments
Stripe, Razorpay, subscription billing, fraud detection

AI Projects & Products

ShackleAI Platform — The Operating System for AI Agents

2025 – Present
Creator & Principal Engineershackleai.com GitHub
Next.js 16 · TypeScript · PostgreSQL + pgvector · Redis · Docker · MCP SDK · OpenTelemetry · Stripe · AWS
  • Architected 11 core microservices: Gateway, ToolCloud, Vault, Memory, Runtime, Identity, Governance, Observatory, Registry, Mesh, LLM Gateway
  • Built multi-engine agent orchestration (CrewAI + OpenClaw) with LLM-driven plan decomposition into sequential/parallel execution steps
  • Designed LLM Gateway with multi-provider routing (OpenAI, Anthropic, Azure, Bedrock), budget enforcement, PII scrubbing, per-call cost tracking
  • Implemented Vault for AES-256 encrypted credential storage with runtime injection into sandboxed agent containers
  • Shipped 142 API routes, 59 migrations, 659+ issues closed, 312+ PRs merged, 213+ unit tests
  • Engineered AI-accelerated dev methodology: 25-agent ecosystem achieving 18 iterations in 3 days, 1,359+ commits across 7 repositories

@shackleai/memory-mcp — Persistent Memory for AI Coding Tools

2025 – Present
Creator & Maintainernpm GitHub
TypeScript · MCP Protocol · SQLite + sqlite-vec · Transformers.js · Semantic Search · Vitest
  • Built the first MCP-native persistent memory server for AI coding assistants (Claude, Cursor, Windsurf, Copilot)
  • Achieved 1.9k+ total npm downloads with 11 MCP tools, zero-config setup, and fully offline embeddings
  • Semantic search via MiniLM-L6-v2 (384-dim) with sqlite-vec; project-scoped memory, TODO tracking, export/import, cloud sync

@shackleai/orchestrator — Open-Source Agent Orchestrator

2026 – Present
Creator & Lead Developernpm GitHub
TypeScript · MCP Protocol · PostgreSQL · Docker · npm Monorepo
  • Open-source multi-agent orchestrator with MCP-native tool infrastructure, 112 PRs merged across 3 milestones
  • Multi-package monorepo (@shackleai/orchestrator, @shackleai/core, @shackleai/db, @shackleai/shared)

ShackleAI FinServ Platform — Open-Source Financial Services

2026 – Present
Architect & Lead Developer
TypeScript · Java · Spring Boot · Next.js · PostgreSQL · Python · Docker
  • Open-source reference platform for banking with ML credit scoring, fraud detection, document AI — 253 commits, 53 PRs merged, 106 issues closed
  • 8 specialized FinTech AI agents (Architect, Backend, Security, Data, Frontend, Docs, DevOps, QA)

ShackleAI Agent Framework — Enterprise Python Orchestration

2025
Architect & Lead DeveloperPyPI
Python 3.12 · AsyncIO · LiteLLM · Pydantic v2 · FastAPI · SQLAlchemy · OpenTelemetry · pytest
  • Async-first multi-agent framework with sequential, parallel, and hierarchical execution modes
  • LiteLLM integration for 100+ LLM providers with per-call cost tracking; 7.9k+ tests at 97% coverage, 37 built-in tools

WhatsApp AI Chat Platform — RAG-Powered Business Assistant

2025
Full-Stack Engineer
Node.js · Express · Next.js · PostgreSQL + pgvector · OpenAI · WhatsApp API · Razorpay
  • End-to-end SaaS: RAG over business catalogs, semantic FAQ, automated payments. 10 phases shipped with multi-tenant handling

Errakaaram — Production E-Commerce Platform

2024 – Present
Creator & Full-Stack Engineererrakaaram.com
Next.js 15 · Express 5 · MongoDB · Redis · AWS · Razorpay · Docker
  • Live e-commerce: 29 data models, 124+ pages, 563 commits across 2 repos. Multi-role system, Razorpay payments, AWS S3 + CloudFront CDN

Professional Experience

Principal Engineer

2022 – Present
Nagarro — Global digital engineering (10,000+ employees)
  • Lead enterprise modernization for large-scale clients, architecting cloud-native and AI-driven platforms
  • Drive technology strategy and hands-on engineering for complex distributed systems

Service Delivery Lead

2019 – 2021
FIS (Fidelity National Information Services) — Fortune 500, global fintech leader
  • Led enterprise automation and service delivery for banking and financial services clients
  • Managed cross-functional teams delivering mission-critical fintech solutions at scale

Managing Director, APAC

2017 – 2019
Softomotive — Acquired by Microsoft (2020) → Microsoft Power Automate
  • Spearheaded APAC expansion for the RPA platform that became Microsoft Power Automate
  • Built Fortune 500 client relationships across banking, retail, and pharma verticals
  • Drove pre-acquisition growth that contributed to Microsoft's strategic acquisition

SAP Technology Consultant

2012 – 2017
Deloitte — Big Four professional services
  • SAP technology consulting for enterprise clients across BFSI, retail, oil & gas, and pharma
  • Large-scale enterprise automation and digital transformation programs

Engineer

2008 – 2010
BGR Energy Systems — Power & infrastructure engineering
  • Engineering role in power systems and industrial automation

Enterprise Clients Served

MicrosoftWalmartFlipkartAxis BankNedbankSanofiDeloitteCapgemini

Domains: BFSI & Core Banking · Retail & E-Commerce · Oil & Gas · Pharma & Logistics · Automobile · Enterprise Automation

Open Source

@shackleai/memory-mcpv0.5.2
MIT

Persistent memory for AI coding tools (Claude, Cursor, Windsurf, Copilot)

1.9k+ total downloads11 MCP toolsSemantic searchZero-configOffline embeddings

Publications & Thought Leadership

“How I Built an MCP Server from Scratch”
Architecture deep-dive: MCP-native memory with SQLite + vector search
2026
“From RPA to AI Agents: 18 Years of Enterprise Automation”
Career perspective on the $20B+ automation market shift
2026
“25 AI Agents Shipping Code 24/7”
Multi-agent orchestration patterns, model selection, CI/CD as safety net
2026

Education

MBA, Finance
2010 – 2012
B.E., Electronics & Instrumentation Engineering
2004 – 2008