I have created a simple web spider using Laravel Dusk, this spider goes through all the links in a website and gets its title, content and status code and stores it in the local database.

laravel dusk crawling website

Source Code

https://github.com/tushargugnani/laravel-dusk-spider

Tutorial

https://medium.com/@tushargugnani_54389/crawling-website-using-laravel-dusk-spider-bbbbe487a21

This article is submitted by Tushar Gugnani