One search. Connected ideas.
Find the lesson, understand the concept, and prepare your answer.
13 results shown · grouped by type
Lessons5
LiteLLM provides model-access abstraction and proxy/gateway capabilities. Portkey provides an AI gateway and operational controls. Cloud gateways can apply access and model traffic policies within an existing cloud API-management environment; exact AI…
An AI gateway sits between your application and model providers. It can normalize access, choose approved models, enforce quotas, collect usage, and handle eligible fallback. It is similar to an API gateway specialized for model traffic.
AI and LLM fundamentals
Priority key
vLLM is an inference-serving system designed for efficient model execution. Serving techniques such as batching and attention-memory management help multiple requests share expensive hardware. GPU optimization is matching workload, memory, scheduling, and…
Interview questions5
An AI gateway sits between your application and model providers. It can normalize access, choose approved models, enforce quotas, collect usage, and handle eligible fallback. It is similar to an API gateway specialized for model traffic.
LiteLLM provides model-access abstraction and proxy/gateway capabilities. Portkey provides an AI gateway and operational controls. Cloud gateways can apply access and model traffic policies within an existing cloud API-management environment; exact AI…
AI and LLM fundamentals
Priority key
vLLM is an inference-serving system designed for efficient model execution. Serving techniques such as batching and attention-memory management help multiple requests share expensive hardware. GPU optimization is matching workload, memory, scheduling, and…
Modules3
AI Engineering learning module
AI Engineering learning module
AI Engineering learning module