AI EngineeringInterview preparation
Advanced·Concept·2 min read

How much does it cost?

Practice this question
  • Count every model/tool call, embedding/reranking, infrastructure, retries, and review workload.
  • Optimize cost per successful task subject to quality and privacy constraints.
  • Use context selection, templates, smaller models, caching, batching, and strict agent budgets where evaluated.

Budget policy: per-user/tenant limits, bounded step count, total tokens and deadline, overload behavior, and alerts for unusual call amplification.

Adapted from 13_AI.MD · “11. How much does it cost?”. Code examples are study fragments. Difficulty and core labels are editorial estimates; version-specific behavior should be checked against your project.