Skip to content

Problems Questions Roles Skills Interview Contest Leaderboard

Problems Questions Roles Skills Interview Contest Leaderboard

Home
Skills
Attention

Attention

5 practice items · needed by 2 roles

Easy 0Medium 1Hard 4

Practice questions

Scaling factor in attentionmedium
Parameters in a multi-head attention blockhard
What FlashAttention changeshard
Why attention divides by sqrt(d_k)hard
What the causal mask preventshard

🏆 Attention leaderboard

See who is top in Attention this week.

Roles that use Attention

Machine Learning Engineer3
AI Engineer (LLM & Generative AI)2

Related skills

Transformers Reliability JavaScript Evaluation RAG Deployment Classification Metrics Dynamic Programming Latency Python LLM Serving Embeddings

RED SAG Skills

Free practice for every job role: coding problems, role challenges and mock interviews. Built and managed by RED SAG Fintech Solutions.

Software Engineering

Frontend Developer interview questions
Backend Developer interview questions
Full Stack Developer interview questions
Mobile App Developer interview questions
Game Developer interview questions
Blockchain Developer interview questions

Data, AI & Machine Learning

Machine Learning Engineer interview questions
AI Engineer (LLM & Generative AI) interview questions
Data Scientist interview questions
MLOps Engineer interview questions
Prompt Engineer interview questions
Data Analyst interview questions

Cloud, DevOps & Security

DevOps Engineer interview questions
Cloud Engineer interview questions
Site Reliability Engineer interview questions
Database Administrator interview questions
Cybersecurity Analyst interview questions

© 2026 RED SAG Fintech SolutionsAll roles Coding problems Leaderboard About Careers at RED SAG