Usage

Detailed guides for using Trafilatura with Python, on the command-line, with R, and for web data collection tasks.

• Quickstart
  • With Python
  • On the command-line
  • Further steps
• Python usage
  • The Python programming language
  • Step-by-step
  • Extraction settings
  • Input/Output types
  • Navigation
  • Deprecations
• Command-line usage
  • Introduction
  • Quickstart
  • Extraction parameters
  • Process files locally
  • Process a list of links
  • Link discovery
  • Deprecations
  • Further information
• Graphical user interface
  • Installation
  • Getting started
  • Troubleshooting
  • Screenshot
• Usage with R
  • Introduction
  • Installation
  • Download and extraction
  • Other functions
  • Going further
• API
  • Introduction
  • Making JSON requests
  • Examples
  • Further information
• Download web pages
  • With Python
  • On the command-line
  • Enforcing politeness rules
  • Summary
• Web crawling
  • Design decisions
  • With Python
  • On the command-line
  • Further reading
• Deduplication
  • Element and paragraph level
  • Document level
  • Clearing the cache
  • Configuration
• URL management
  • Extracting links from a page
  • Filtering a list of URLs
  • Sampling by domain name
  • Internal vs. external links
  • Blacklisting
  • Storing and reusing URL lists