Skip to content

Problems QuestionsSkills Interview Contest Leaderboard

Problems QuestionsSkills Interview Contest Leaderboard

Home
Machine Learning Engineer
Questions
Backpropagation

Machine Learning Engineer

Backpropagation questions

4 questions on Backpropagation for machine learning engineers, easiest first.

Easy 2

ReLU gradient below zeroeasy
Chain rule through two linear stepseasy

Hard 2

Gradient of softmax cross-entropyhard
Gradient of a linear layer's weightshard

More Machine Learning Engineer skills

Deep learning and PyTorch 189 Fine-tuning 165 Machine learning 133 Model evaluation 85 Transformers and LLM internals 31 Statistics and probability 24 Rlhf 21 GPUs and distributed training 20 Maths 19 RAG and vector search 16 Model serving and inference 16 LLM evaluation 16 Performance and debugging 15 Training Data 13 Sft 11 Transfer Learning 10 Training Loop 9 Dpo 9 Optimisers 8 Hyperparameters 7 Python and pandas 6 Qlora 6 Data modelling 6 Model monitoring and drift 5

RED SAG Skills

Free practice for every job role: coding problems, role challenges and mock interviews. Built and managed by RED SAG Fintech Solutions.

Software Engineering

Frontend Developer interview questions
Backend Developer interview questions
Full Stack Developer interview questions
Mobile App Developer interview questions
Game Developer interview questions
Blockchain Developer interview questions

Data, AI & Machine Learning

Machine Learning Engineer interview questions
AI Engineer (LLM & Generative AI) interview questions
Data Scientist interview questions
MLOps Engineer interview questions
Prompt Engineer interview questions
Data Analyst interview questions

Cloud, DevOps & Security

DevOps Engineer interview questions
Cloud Engineer interview questions
Site Reliability Engineer interview questions
Database Administrator interview questions
Cybersecurity Analyst interview questions

© 2026 RED SAG Fintech SolutionsAll roles Coding problems Leaderboard About Careers at RED SAG