easy5 pts · first answer countspythonpandas

A CSV bigger than memory

A 40 GB CSV file must be processed in Python on a laptop with 16 GB of RAM. What is a sensible approach?

A.Call pd.read_csv on the whole file and hope it fitsB.Open the file in Excel firstC.Read it in chunks (for example pd.read_csv with chunksize) or use an engine like DuckDB or Polars that streams the dataD.Convert every value to a string to save memory

Discussion 0

Join free to post in the discussion.

A CSV bigger than memory

Discussion 0

Related questions