Too Long; Didn't Read
Felix is an entrepreneur currently building a legal tech start-up for document automation. He wants to show you how he developed interesting data science project ideas and implement them step by step. Follow me along on how he explored Germany’s largest travel forum Vielfliegertref. He used scrapy as framework for the following reasons: There was no Javascript enabled elements that were hiding data. The website structure was complex having to go from each forum subject, to all the threads and from all the treads to all post website pages. With scrapy you can easily implement complex logic yielding requests that lead to new callback functions in an organized way.