Beyond Generation: Fast, Structured AI Decisions with Jev at Glean

Not every step in an AI product needs a full generative LLM call. Many are bounded decisions, like understanding what a user is asking for, picking the best suggestion to show, checking whether an answer's citations hold up, routing to the right tool or model, or deciding if a request needs a guardrail. In this session, I'll walk through how Glean has been exploring Jev across these decisions, what we learned about where fast, confidence-scored decisions shine, and how we evaluate these models before they reach users.