How to Scrape Javascript Rendered Websites with Python & Selenium

view-source:https://munchery.com/menus/sf/#/0/dinnerNotice that the data is wrapped by a <script> tag? That data is in JSON format and is rendered to HTML upon loading. We have the option to parse the JSON data, but let’s say we want to extract based on what we see or generated. Let’s write the steps on how we’d do that: Go to www.munchery.com. (be sure to check their robots.txt and terms before p

[khtokage]

最近のECサイトはJavascriptフレームワークが使われてること多いので、こうやらないとスクレイピング出来ないよね。ぶっちゃけ面倒臭いからAPI準備して欲しい。お互いのためにもなるし。