Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
About
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Languages
Contributors30
![renovate[bot]](https://avatars.githubusercontent.com/in/2740?v=4)
![dependabot[bot]](https://avatars.githubusercontent.com/in/29110?v=4)
![dependabot-preview[bot]](https://avatars.githubusercontent.com/in/2141?v=4)
Free alternative to Bright Data
crawlee is a free, open-source alternative to Bright Data. Here's why:
- 🕷️ Web scraping automation
- 💻 Node.js & TypeScript
- 🌐 Puppeteer & Playwright
- ⚙️ Proxy rotation included
- 💾 Extract data for AI
