Food and Agriculture Organization of the United Nations
    FAO Data Lab

    Scraping data from the web

    The internet grants a wide scope of facts and data sources, which consist in an enormous assortment of dissimilar and poorly organized data. Web scraping involves fetching and extracting those data from web pages, creating properly organized information. Web scraping is usually associated to the Big Data paradigm, considering the variety of data sources. Different procedures have been developed by the DataLab to gather structured information from web pages containing statistical data, or from Social media (Twitter) / media aggregators (Google News).

    Products using data scraping:

    Social media
    Social media: