Skip to content
RED SAGSkills
easy5 pts · first answer countsspark

When Spark actually runs

In Spark, which of these lines actually starts a job on the cluster?

df = spark.read.parquet("s3://bucket/sales")   # 1
df2 = df.filter(df.amount > 100)                # 2
df3 = df2.select("region", "amount")           # 3
n = df3.count()                                # 4
Choose one answer

Discussion 0

Join free to post in the discussion.

Related questions