Harshul Jain

Harshul Jain

Harshul Jain

Senior Software Engineer · Audible Inc

Twitter / XLinkedInWebsiteBlog

Bio

I'm Harshul, Senior Software Engineer at Audible. I build distributed systems and GenAI platforms at scale - feature stores that handle 100K transactions per second, real-time streaming pipelines, and AI Search serving 10 million users. Outside work, I've reviewed 5 books for Manning, mentored over 300 engineers on Codementor and Topmate, and built AgentShip, an open-source framework agnostic solution for writing and deploying AI agents to production.

Sessions (2)

Day 112:10pm-1:10pmTrack 3
2 hr deep dive on LLM Inference at Scale — Part 1 of 2
Day 11:15pm-2:15pmTrack 3
2 hr deep dive on LLM Inference at Scale — Part 2 of 2

Harshul Jain is a Senior Software Engineer at Audible who builds production LLM serving and ML infrastructure, authored a 12-chapter open-source handbook on LLM inference at scale, and created the AgentShip agent-deployment framework. His AIE World's Fair 2026 sessions are a two-part deep dive on LLM Inference at Scale, offering a hands-on look at the architectural and operational realities of serving LLMs in production from a daily practitioner.

GitHub

@harshuljain13

Recent writing (6)

Public activity researched automatically · as of Jun 2026