I’m quite new to web scraping so bear with me. I have a ton of pages like this that show a chess player’s results for that month, and my aim is to copy some of the data in that table into a big CSV file for analysis later.
Reading through Automate the Boring Stuff, I use requests.get(url) to get the page down. Using the CSS selector for that table looking through the code, it points to an empty div and a few lines down some JQuery (which I know nothing about). I can’t just use BeautifulSoup to get the table out because it’s being generated dynamically.
Can anyone give me some advice on how to get the data I need?
submitted by /u/RajjSinghh
[link] [comments]
r/learnpython I’m quite new to web scraping so bear with me. I have a ton of pages like this that show a chess player’s results for that month, and my aim is to copy some of the data in that table into a big CSV file for analysis later. Reading through Automate the Boring Stuff, I use requests.get(url) to get the page down. Using the CSS selector for that table looking through the code, it points to an empty div and a few lines down some JQuery (which I know nothing about). I can’t just use BeautifulSoup to get the table out because it’s being generated dynamically. Can anyone give me some advice on how to get the data I need? submitted by /u/RajjSinghh [link] [comments]
I’m quite new to web scraping so bear with me. I have a ton of pages like this that show a chess player’s results for that month, and my aim is to copy some of the data in that table into a big CSV file for analysis later.
Reading through Automate the Boring Stuff, I use requests.get(url) to get the page down. Using the CSS selector for that table looking through the code, it points to an empty div and a few lines down some JQuery (which I know nothing about). I can’t just use BeautifulSoup to get the table out because it’s being generated dynamically.
Can anyone give me some advice on how to get the data I need?
submitted by /u/RajjSinghh
[link] [comments]