Welcome to Portia’s documentation!

Contents:

• Installation
  • Docker (recommended)
  • Vagrant
  • Ubuntu
  • Developing Portia using Docker
• Getting Started
  • Creating a spider
  • Creating a sample
  • Configuring your crawler
  • What’s next?
• Examples
  • Crawling paginated listings
  • Selecting elements with CSS and XPath
  • Extracting a single attribute to multiple fields
  • Scraping multiple items from a single page
  • Using Multiple Samples to Deal with Different Layouts
• Projects
  • Versioning
  • Deployment
• Spiders
  • Spider properties
  • Start pages and link crawling
  • Running a spider
  • Minimum items threshold
• Samples
  • What are samples?
  • What are annotations?
  • Annotations
  • Multiple samples
• Items
  • Field types
• FAQ
  • How do I use Crawlera with Portia?
  • Does Portia support AJAX based websites?
  • Does Portia work with large JavaScript frameworks like Ember?
  • Does Portia support sites that require you to log in?
  • Does Portia support content behind search forms?

Indices and tables

• Index
• Module Index
• Search Page