Wei-Meng Lee
Dec 31, 2022

--

I am using the Mac Studio with 32gb ram. If you try to load the CSV all at once, it is likely going to take you more than a few minutes. Try loading the columns you need, and you should get better performance. Or load in chunks - see https://towardsdatascience.com/tips-and-tricks-for-loading-large-csv-files-into-pandas-dataframes-part-2-5fc02fc4e3ab

--

--

Wei-Meng Lee
Wei-Meng Lee

Written by Wei-Meng Lee

ACLP Certified Trainer | Blockchain, Smart Contract, Data Analytics, Machine Learning, Deep Learning, and all things tech (http://calendar.learn2develop.net).

Responses (1)