Beginner54m

Building Agentic RAG with Llamaindex

Instructor: Jerry Liu

LlamaIndex logo

Earn an accomplishment with PRO · Updated Oct 7, 2025

  • Beginner
  • 54m
  • 6 Video Lessons
  • 4 Code Examples
  • 1 Graded Assignment PRO
  • Earn an accomplishment with PRO
  • Updated Oct 7, 2025
  • Instructor: Jerry Liu
  • LlamaIndexLlamaIndex
  • Learn more aboutMembership PRO Plan

What you'll learn

  • Learn how to build an agent that can reason over your documents and answer complex questions.

  • Build a router agent that can help you with Q&A and summarization tasks, and extend it to handle passing arguments to this agent.

  • Design a research agent that handles multi-documents and learn about different ways to debug and control this agent.

Course recap

PRO

This course teaches how to build agentic RAG systems using LlamaIndex, progressing from simple routers to full multi-document agents. Students start with a router that dynamically selects between vector search and summarization query engines, then advance to tool-calling agents, and finally build a multi-document research agent.

Concept map

Concepts in Building Agentic RAG with Llamaindex and the courses that connect to themBuilding Agentic RAG with LlamaIndexBuilding Agentic RAG with…Router query engineRetrieval-Augmented GenerationRetrieval-Augmented Gener…Query toolsLLM selectorPydantic selectorSummary indexVector indexAdvanced Retrieval for AIBuilding AI Applications with HaystackBuilding AI Applications…Agentic Knowledge Graph ConstructionAgentic Knowledge Graph C…Build LLM Apps with LangChain.jsBuild LLM Apps with LangC…Agent Memory: Building Memory-Aware AgentsAgent Memory: Building Me…Concepts in Building Agentic RAG with Llamaindex and the courses that connect to themBuilding Agentic RAG with LlamaIndexBuilding Agenti…Router query engineRouter query en…Retrieval-Augmented GenerationRetrieval-Augme…Query toolsLLM selectorPydantic selectorPydantic select…Summary indexVector index

Key concepts

  • Router query engineDynamically selects between query engines (vector search vs summarization) based on the query
  • Retrieval-Augmented GenerationEnhanced with agentic capabilities for dynamic query understanding
  • Query toolsQuery engines wrapped with metadata describing what types of questions they can answer
  • LLM selectorPrompts an LLM to choose which query engine to route to, outputting JSON
  • Pydantic selectorUses function calling APIs to produce structured selection objects
  • Summary indexReturns all nodes for comprehensive summarization
  • Vector indexReturns most similar nodes by embedding similarity for specific questions

Lesson highlights

  1. 1.Router Query Engine — Dynamic routing between vector search and summarization over a single document
  2. 2.Tool Calling — Agents that select and call tools based on query analysis
  3. 3.Building an Agent Reasoning Loop — ReAct-style reasoning with tool use
  4. 4.Multi-Document Agent — Research agent spanning multiple papers with per-document tools
  5. 5.Advanced Patterns — Combining agents with memory and planning
  6. 6.Conclusion

About this course

Join our new short course and learn from Jerry Liu, co-founder and CEO at LlamaIndex to start using agentic RAG, a framework designed to build research agents skilled in tool use, reasoning, and decision-making with your data.

In this course:

  • Build the simplest form of agentic RAG – a router. Given a query, the router will pick one of two query engines, Q&A or summarization, to execute a query over a single document.
  • Add tool calling to your router agent where you will use an LLM to not only pick a function to execute but also infer an argument to pass to the function.
  • Build a research assistant agent. Instead of tool calling in a single-shot setting, an agent is able to reason over tools in multiple steps.
  • Build a multi-document agent where you will learn how to extend the research agent to handle multiple documents.

Unlike the standard RAG pipeline—suitable for simple queries across a few documents—this intelligent approach adapts based on initial findings to enhance further data retrieval. You’ll learn to develop an autonomous research agent, enhancing your ability to engage with and analyze your data comprehensively.

You’ll practice building agents capable of intelligently navigating, summarizing, and comparing information across multiple research papers from arXiv. Additionally, you’ll learn how to debug these agents, ensuring you can guide their actions effectively.

Explore one of the most rapidly advancing applications of agentic AI!

Who should join?

Anyone who has basic Python knowledge and wants to learn how to quickly build agents that can reason over their own documents.

Course Outline

6 Lessons・4 Code Examples
Unlock certificates

Elevate your learning experience with Pro

Upgrade to Pro and gain unlimited accomplishments on your resume

Learn More

Instructor

Jerry Liu

Jerry Liu

Course access is free for a limited time during the DeepLearning.AI learning platform beta!

Want to learn more about Generative AI?

Keep learning with updates on curated AI news, courses, and events, as well as Andrew’s thoughts from DeepLearning.AI!