LLM
中等
面试题库
LLM
中等
Explain the reason behind the effectiveness of Chain-of-Thought (CoT) prompting
LLM
中等
What is Chain-of-Thought (CoT) prompting, and when is it most useful?
LLM
中等
What are the possible options for accelerating LLM inference?
LLM
中等
What is mixed precision (e.g., FP16) and why is it used during inference?
LLM
中等
What is continuous batching, and how does it differ from static batching?
LLM
中等
Explain the role of flash attention in reducing memory bottlenecks during inference
LLM
中等
Explain the role of decoding strategy in LLM text generation
LLM
中等
How can techniques like mixture-of-experts (MoE) optimize inference efficiency?
LLM
中等
Explain the trade-offs between batching and latency in LLM serving
LLM
中等
What is the softmax function, and where is it applied in the Transformer model?
LLM
中等