Data Engineer
Pyspark questions
15 questions on Pyspark for data engineers, easiest first.
Easy 10
- Entry point of a Spark 3+ appeasy
- Adding a constant columneasy
- union() with columns in another ordereasy
- Removing duplicate order idseasy
- Filling nulls per columneasy
- Cut-off values in show()easy
- filter() versus where()easy
- F.coalesce vs df.coalesceeasy
- pandas-style code on a clustereasy
- Row count from sample(0.1)easy