How to extract data from websites when no API is available for your needs

Web Scraping with Nokogirl/Kimono by Robert Krabek · 47:44 · Video: CS50 · Watch at the source

In short: When you need to collect internet data but lack an official API, web scraping offers a solution. This video demonstrates how to parse HTML to automate data extraction using the Ruby library Nokogiri and the browser tool Kimono.

Web scraping serves as a method for gathering information by directly parsing the HTML structure of a webpage. This approach bypasses the need for manual data entry, allowing users to pull specific content and organize it into a spreadsheet format.

The video explores two distinct tools for this task: Nokogiri, a library designed for the Ruby programming language, and Kimono, which functions as a Chrome extension for simpler scraping requirements.

Opens the Intellect+ feed with this card first. Swipe up for the next one.

Sources

To cite this card, link to https://intellectplus.co.uk/app/technology-web-scraping-with-nokogirl-kimono-by-robert-krabek.

How we source, check and correct cards: Editorial standards.

General information, not professional advice. Spotted an error? Flag the card or see corrections and complaints.

Intellect Plus is a visual educational discovery platform for exploring fascinating facts and ideas. Brain Food, Not Brain Rot. What is Intellect Plus?

Related

Finding something worth knowing…