medium10 pts · first answer countssparkspark-iodata-quality
Malformed rows in a JSON feed
A daily JSON feed has a few broken lines. You want the job to keep going, load good rows, and keep the bad lines for review. Which read mode does that?
Discussion 0
Join free to post in the discussion.
Related questions
- When Spark actually runsData Engineer
- What a Spark partition isData Engineer
- Built-in dbt testsData Engineer
- Which quality dimension is brokenData Engineer
- Checking a status columnData Engineer
- Guarding the grain of a tableData Engineer
- Correct numbers that arrive lateData Engineer
- Orders pointing to missing customersData Engineer