Installation Instructions:

cd <installation_dir> pip install -r requirements.txt

Usage

Scrapes the entered URL and all subpages, downloads the text to installation directory.

Made for GeminiProjectAssistant

However, you can also use it manually. python ./docscraper.py And enter the URL you wish to scrape.