I love these sorts of stories reflecting the experiences of practitioners and transferring knowledge to readers quickly and with ease. Thank you for writing this valuable piece clearly and with passion. I also used webscapping in information management for larger projects. I reviewed one of the products I used and documented it on Technology Hits too. I link it here as a reference for interested readrs. https://medium.com/technology-hits/web-scraping-101-functions-use-cases-references-best-practices-b90d732a042

I appreciate your contributions to Technology Hits and look forward to your stories. I updated the submission guidelines today including our strategic directionWe now have an additional focus on Substack to empower our writers like you.

https://medium.com/illumination/technology-hits-new-submission-guidelines-2024-7e96908a388a