Fossy
fossy
Curated FOSS Directory for Community and Discussion
Back adbar/trafilatura
trafilatura

trafilatura

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

6.1k 380
Apache-2.0
 last commit 2026-06-10
article-extractorcorpus-buildercorpus-toolscrawlerhtml-to-markdownhtml2textllmnews-aggregatornews-crawlernlp
Website Source
Share:

About

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

Languages

Python100%

Contributors30

adbar1419felipehertzer89vbarbaresi12knit-bee11unsleepy227LukasBBAW5phongtnit4andremacola3idoshamun3rgeronimi2deedy52tonyyanga2rmarchei2gremid2+16

No features listed.

Comments Theme
Install
pip
Keywords
article-extractor
corpus-builder
corpus-tools
crawler
html-to-markdown
html2text
llm
news-aggregator
news-crawler
nlp
rag
readability
rss-feed
scraping
tei
text-cleaning
text-extraction
text-mining
text-preprocessing
web-scraping
slug: trafilatura

Sponsored

SponsorSponsorSponsorSponsor
Ad space
300 × 250 (IAB)
Ad space
300 × 250 (IAB)