LESSON 42 / 215·2 min readIntermediate

Agents, chatbots, and workflows

Must knowConcept lesson
01 Understand02 Recall03 Prepare

Words made simple

A few useful meanings before you read the explanation.

Agent
An application that uses a model to choose its next action within defined limits. It can use tools and continue through several steps.
AI
Software techniques for tasks such as recognizing patterns, understanding language or generating content.
Retrieval
Finding and fetching information that is useful for the current question.
More words from this lesson
Deterministic
Following steps or rules defined by code. The model does not decide which step should run next in a deterministic workflow.
State
The data describing where a workflow is now, what it already knows, and what still needs to happen.
Persistence
Saving information so it remains available after a request ends or a process restarts.
Authorization
Checking what that identity is allowed to read or do. Being logged in does not grant access to every record.
Latency
How long a request takes to return a result. Lower latency usually means a shorter wait for the user.

🔴 MUST KNOW · 🟠 SHOULD KNOW for multi-agent systems.

Overview

  • An AI agent is software that uses a model to choose actions toward a goal, observes results, and decides what to do next within application limits.
  • A chatbot describes a conversational interface; it may or may not contain an agent.
  • A workflow defines the execution process, often with steps and transitions chosen by the developer.

Why this matters

Some requests require choosing between searching, using tools, asking for missing information, or escalating.

An everyday example

An assistant can decide which department to contact, while a checklist specifies a fixed onboarding process.

A technical example

“Help me submit a claim” may require policy lookup, a missing-date question, invoice retrieval, and a draft submission.

How it works

  1. Establish goal and allowed tools
  2. Model proposes next step
  3. Backend validates/executes
  4. Model receives observation
  5. Repeat until completion, approval, failure, or budget limit.

Architecture and flow

See the loop below.

The insurance assistant example

A claims assistant gathers information adaptively but the final claim service enforces eligibility and submission rules.

When to use it

Variable language-driven tasks where the next safe step genuinely depends on observations.

When to avoid it

A known “validate → calculate → save” flow should stay ordinary code or a deterministic workflow.

Interview answer

“An agent lets a model choose bounded next actions. I keep permissions, business rules, budgets, and consequential commits outside model discretion.”

Benefits, trade-offs, and production considerations

  • Agent autonomy increases variable latency, cost, and failure paths.
  • Start with one model call or a fixed workflow, then add autonomy only for measured needs.
  • A framework does not define the agent's trust boundary for you.
Architecture at a glanceFollow the arrows to see how the parts connect.

Preparing the architecture diagram…

Read the full diagram flow
flowchart TD
  G[Goal and trusted task state] --> M[Model proposes next step]
  M --> D{Decision type}
  D -->|Read/search| T[Validate and authorize tool]
  T --> O[Observation]
  O --> B{Budget and progress check}
  B -->|Continue| M
  B -->|Stop| E[Escalate or report failure]
  D -->|Missing information| Q[Ask user and persist state]
  D -->|Consequential write| H[Human approval and business validation]
  D -->|Complete| V[Validate final answer]
  • Goal defines success.
  • Trusted task state carries verified progress.
  • The model proposes, the decision branch constrains, and the tool layer enforces permissions.
  • Observations feed the next decision.
  • Budget checks prevent loops; approval and final validation control external effects and user-visible output.
PAUSE & RECALL

Can you explain it without the notes?

Agents, chatbots, and workflows

Use your own words. Explain an example and one limitation before checking the explanation.

Check your explanation

An AI agent is software that uses a model to choose actions toward a goal, observes results, and decides what to do next within application limits. A chatbot describes a conversational interface; it may or may not contain an agent. A workflow defines the…

CONNECT IT TO YOUR INTERVIEW

Turn this concept into a clear answer.

Practice this concept
YOUR NEXT STEP

Keep connecting the ideas.

Next lesson: Agent loop, reasoning/action/observation, and ReAct

Adapted from 13_AI.MD · “Agents, chatbots, and workflows”. Examples are study fragments; framework behavior can depend on your version.