LLM
中等
面试题库
LLM
中等
What is the role of _transformers_ in achieving parallelization in LLMs?
LLM
中等
How do LLMs handle _context_ and _long-term dependencies_ in text?
LLM
中等
What are _positional encodings_ in the context of LLMs?
LLM
中等
Can you explain the concept of _attention mechanisms_ in transformer models?
LLM
中等
What are the main differences between _LLMs_ and traditional _statistical language models_?
LLM
中等
What are _Large Language Models (LLMs)_ and how do they work?
LLM
中等
What is model parallelism, and how is it used in LLM pre-training?
LLM
中等
Explain the concept of Mixture-of-Experts (MoE) architecture and its role in LLM pretraining
LLM
中等
In the context of LLM pretraining, what is scaling law?
LLM
中等
What is catastrophic forgetting, and why is it a concern in fine-tuning?
LLM
中等