Intro In this article, you will learn about some tools for scraping and parsing data from websites with Ruby, Capybara, Nokogiri, Firefox, and PhantomJS. We will then try out a script that does site scraping by launching a separate web browser. Next up, we’ll launch a headless browser to do the same thing. Finally, we’ll wrap it up in a server side sinatra app for Heroku. Challenge Find active health professionals teaching recent classes Practice scrapping data from websites Search by studio ID on MindBody Online Prereqs Command Line Script using an automated browser instance Let’s check out Kali Yoga Studio in Columbia Heights. We want to see classes that are posted and click on “view class schedule.” We then head off …

Visit site:

Web Scraping: Getting Data from Awfully Complex Websites


Also published on Medium.