medium10 pts · first answer countsdata-pipelinesdata-lakeperformance
Queries slow on a streaming table
A streaming job writes a new file every 30 seconds into a lake table. After a month, queries are slow though the data is only 200 GB. What is the likely issue and fix?
Discussion 0
Join free to post in the discussion.
Related questions
- ETL vs ELTData Engineer
- Idempotent pipelinesData Engineer
- Partitioning a big tableData Engineer
- Data lake vs warehouseData Engineer
- Batch or streaming for a daily reportData Engineer
- Incremental logic for a tiny tableData Engineer
- What SCD Type 1 doesData Engineer
- Keeping the old customer segmentData Engineer