I have a 40gb OneDrive File with 50ish csv files of data for the last 4 years (one month per csv). So I downloaded a few files, like the latest months, did my analysis and now I just have to clean up the rest and apply my analysis to a large scale. Problem is that I do not want to download the entire library. I mean there has to be a way to do python and pandas on this file without downloading the whole thing. This is the first time I am doing something like this. My old job was multiple analysis of multiple products but at least the files where small (Less than 3 gb). Now my new job is only three things to analyze but the files are huge.
submitted by /u/Butterlover1996
[link] [comments]
r/learnpython I have a 40gb OneDrive File with 50ish csv files of data for the last 4 years (one month per csv). So I downloaded a few files, like the latest months, did my analysis and now I just have to clean up the rest and apply my analysis to a large scale. Problem is that I do not want to download the entire library. I mean there has to be a way to do python and pandas on this file without downloading the whole thing. This is the first time I am doing something like this. My old job was multiple analysis of multiple products but at least the files where small (Less than 3 gb). Now my new job is only three things to analyze but the files are huge. submitted by /u/Butterlover1996 [link] [comments]
I have a 40gb OneDrive File with 50ish csv files of data for the last 4 years (one month per csv). So I downloaded a few files, like the latest months, did my analysis and now I just have to clean up the rest and apply my analysis to a large scale. Problem is that I do not want to download the entire library. I mean there has to be a way to do python and pandas on this file without downloading the whole thing. This is the first time I am doing something like this. My old job was multiple analysis of multiple products but at least the files where small (Less than 3 gb). Now my new job is only three things to analyze but the files are huge.
submitted by /u/Butterlover1996
[link] [comments]