LLM
中等
面试题库
LLM
中等
What is the softmax function, and where is it applied in the Transformer model?
LLM
中等
Explain why self-attention in the decoder is referred to as cross-attention. How does it differ from self-attention in the encoder?
LLM
中等
Explain how masking works in masked self-attention in Transformer
LLM
中等
What is the significance of self-supervised learning in LLM pretraining?
LLM
中等
What are the various bottlenecks in a typical LLM inference pipeline when running on a modern GPU?
LLM
中等
Explain the throughput vs. latency tradeoff in LLM inference
LLM
中等
Differentiate between online and offline LLM inference deployment scenarios and discuss their respective requirements
LLM
中等
What is a system prompt, and how does it differ from a user prompt?
LLM
中等
Why is context length important when designing prompts for LLMs?
LLM
中等
What are the different approaches for choosing examples for few-shot prompting?
LLM
中等