LESSON 04 / 16·2 min readFoundation

What the LLM Does

Must knowConcept lesson
01 Understand02 Recall03 Prepare

The LLM acts as an information extraction layer, not as the authority for workflow execution.

For example, a user might say:

“I noticed a charge of $249.99 that I don't recognize. It happened yesterday.”

The extraction layer might return a candidate structure:

JSON
{
  "intent": "report_unrecognized_transaction",
  "amount": 249.99,
  "currency": "USD",
  "transaction_date_reference": "yesterday",
  "customer_recognizes_transaction": false
}

This output is not automatically trusted. The system must validate the schema, resolve relative dates using a known clock and timezone, match the transaction against authorized records, and ask for clarification when details are missing or ambiguous.

The LLM should not independently:

  • decide whether a dispute qualifies;
  • skip required verification;
  • call a financial action without permission;
  • change workflow state outside approved transitions;
  • invent facts that are not in the user's message or trusted data.

A useful design rule is: extract candidates, validate facts, then evaluate rules.

PAUSE & RECALL

Can you explain it without the notes?

What the LLM Does

Use your own words. Explain an example and one limitation before checking the explanation.

Check your explanation

The LLM acts as an information extraction layer, not as the authority for workflow execution.

CONNECT IT TO YOUR INTERVIEW

Turn this concept into a clear answer.

Practice this concept
YOUR NEXT STEP

Keep connecting the ideas.

Next lesson: What the Deterministic Rules Engine Does

Adapted from 19_deterministic_workflow_engine_learnings.md · “3. What the LLM Does”. Examples are study fragments; framework behavior can depend on your version.