WebScrape

Web Scraping

Web scraping is a technique used to take things from a web page. We did this in order to grab the lyrics of a particular song from the Genius website.

An issue which was prevelant was the cross origin resource sharing (cors) mechanic. To overcome this, we created a custom endpoint in the backend which enabled cors.

To convert the webscraped information into useable information, a dom-parser was used. From this, we were able to receive certain elements which contained the desired information. However, another issue arose which was that the content of the web page sometimes differed. We solved this by processing the information in two different ways. Note that if the content of the Genius page were to change, the web scrape may fail.