Jump to content

Scrapers: Difference between revisions

From Official Kodi Wiki
← Older edit
Updated for v20
No edit summary
 
Line 76: Line 76:
  category = Matrix_add-on_repository
  category = Matrix_add-on_repository
  category = Album_scraper_add-ons
  category = Album_scraper_add-ons
  notcategory = Outdated
  notcategory = Broken add-ons
</dpl>
</dpl>
|}
|}
Line 87: Line 87:
  category = Nexus_add-on_repository
  category = Nexus_add-on_repository
  category = Album_scraper_add-ons
  category = Album_scraper_add-ons
  notcategory = Outdated
  notcategory = Broken add-ons
</dpl>
</dpl>
|}
|}
Line 98: Line 98:
  category = Omega_add-on_repository
  category = Omega_add-on_repository
  category = Album_scraper_add-ons
  category = Album_scraper_add-ons
  notcategory = Outdated
  notcategory = Broken add-ons
</dpl>
</dpl>
|}
|}
Line 110: Line 110:
  category = Matrix_add-on_repository
  category = Matrix_add-on_repository
  category = Artist_scraper_add-ons
  category = Artist_scraper_add-ons
  notcategory = Outdated
  notcategory = Broken add-ons
</dpl>
</dpl>
|}
|}
Line 121: Line 121:
  category = Nexus_add-on_repository
  category = Nexus_add-on_repository
  category = Artist_scraper_add-ons
  category = Artist_scraper_add-ons
  notcategory = Outdated
  notcategory = Broken add-ons
</dpl>
</dpl>
|}
|}
Line 132: Line 132:
  category = Omega_add-on_repository
  category = Omega_add-on_repository
  category = Artist_scraper_add-ons
  category = Artist_scraper_add-ons
  notcategory = Outdated
  notcategory = Broken add-ons
</dpl>
</dpl>
|}
|}
Line 144: Line 144:
  category = Matrix_add-on_repository
  category = Matrix_add-on_repository
  category = Music_video_scraper_add-ons
  category = Music_video_scraper_add-ons
  notcategory = Outdated
  notcategory = Broken add-ons
</dpl>
</dpl>
|}
|}
Line 155: Line 155:
  category = Nexus_add-on_repository
  category = Nexus_add-on_repository
  category = Music_video_scraper_add-ons
  category = Music_video_scraper_add-ons
  notcategory = Outdated
  notcategory = Broken add-ons
</dpl>
</dpl>
|}
|}
Line 166: Line 166:
  category = Omega_add-on_repository
  category = Omega_add-on_repository
  category = Music_video_scraper_add-ons
  category = Music_video_scraper_add-ons
  notcategory = Outdated
  notcategory = Broken add-ons
</dpl>
</dpl>
|}
|}
Line 178: Line 178:
  category = Matrix_add-on_repository
  category = Matrix_add-on_repository
  category = Movie_scraper_add-ons
  category = Movie_scraper_add-ons
  notcategory = Outdated
  notcategory = Broken add-ons
</dpl>
</dpl>
|}
|}
Line 189: Line 189:
  category = Nexus_add-on_repository
  category = Nexus_add-on_repository
  category = Movie_scraper_add-ons
  category = Movie_scraper_add-ons
  notcategory = Outdated
  notcategory = Broken add-ons
</dpl>
</dpl>
|}
|}
Line 200: Line 200:
  category = Omega_add-on_repository
  category = Omega_add-on_repository
  category = Movie_scraper_add-ons
  category = Movie_scraper_add-ons
  notcategory = Outdated
  notcategory = Broken add-ons
</dpl>
</dpl>
|}
|}
Line 212: Line 212:
  category = Matrix_add-on_repository
  category = Matrix_add-on_repository
  category = TV_scraper_add-ons
  category = TV_scraper_add-ons
  notcategory = Outdated
  notcategory = Broken add-ons
</dpl>
</dpl>
|}
|}
Line 223: Line 223:
  category = Nexus_add-on_repository
  category = Nexus_add-on_repository
  category = TV_scraper_add-ons
  category = TV_scraper_add-ons
  notcategory = Outdated
  notcategory = Broken add-ons
</dpl>
</dpl>
|}
|}
Line 234: Line 234:
  category = Omega_add-on_repository
  category = Omega_add-on_repository
  category = TV_scraper_add-ons
  category = TV_scraper_add-ons
  notcategory = Outdated
  notcategory = Broken add-ons
</dpl>
</dpl>
|}
|}

Latest revision as of 01:33, 24 January 2023

  ▶ Development
▶ Music library
▶ Video library		 ▶ Scrapers


Using Scrapers

Scrapers are used to contact online information providers to download metadata for video and music items that are to be added to the library.

A number of scrapers are installed by default when installing Kodi. Other scrapers are available for installation from the official repository. The tables at the bottom of this page list all official scrapers and their compatability.


Creating your Video Library

Setting up your video library for the first time? Follow this How To guide

Creating your Music Library

Setting up your music library for the first time? Follow this How To guide

Video scraping problems

Something not working as expected? Check this page for common solutions.

Changing Scrapers
List of all Scraper pages


Scraper Development

Historically, Kodi scrapers were XML based. While XML scrapers have been used successfully for well over a decade, their use has been deprecated, since the release of Kodi v19 Matrix, in favour of Python based scrapers.

XML scrapers have become difficult to develop and maintain as they are no longer suited to the advanced REST API's used by the information providers, which results in frequent maintenance and updates to cope with API changes.

The following pages are available to help with the development process of scrapers. Although XML scrapers are deprecated, and no future XML scrapers will be accepted into the official repository, the two pages dedicated to XML scrapers contain useful information.


Developing a Movie scraper in Python
XML Scraper Development

XML scrapers are deprecated. This page may still contain useful development information.

Developing a TV Show scraper in Python
Writing an XML scraper

XML scrapers are deprecated. This page may still contain useful development information.


Official Scrapers

Scrapers compatible with v19 Matrix Scrapers compatible with v20 Nexus Scrapers compatible with v21 Omega
List of Album scrapers

Extension:DynamicPageList3 (DPL3), version 3.6.1: Error: MediaWiki\Extension\DynamicPageList3\Query::buildAndSelect: The DynamicPageList3 extension (version 3.6.1) produced a SQL statement which led to a Database error.<br/>The reason may be an internal error of DynamicPageList3 or an error that you made; especially when using parameters like 'categoryregexp' or 'titleregexp'. Usage of non-greedy <code>*?</code> matching patterns are not supported.<br/>The error message was:<br/><code></code>
List of Album scrapers

Extension:DynamicPageList3 (DPL3), version 3.6.1: Error: MediaWiki\Extension\DynamicPageList3\Query::buildAndSelect: The DynamicPageList3 extension (version 3.6.1) produced a SQL statement which led to a Database error.<br/>The reason may be an internal error of DynamicPageList3 or an error that you made; especially when using parameters like 'categoryregexp' or 'titleregexp'. Usage of non-greedy <code>*?</code> matching patterns are not supported.<br/>The error message was:<br/><code></code>
List of Album scrapers

Extension:DynamicPageList3 (DPL3), version 3.6.1: Error: MediaWiki\Extension\DynamicPageList3\Query::buildAndSelect: The DynamicPageList3 extension (version 3.6.1) produced a SQL statement which led to a Database error.<br/>The reason may be an internal error of DynamicPageList3 or an error that you made; especially when using parameters like 'categoryregexp' or 'titleregexp'. Usage of non-greedy <code>*?</code> matching patterns are not supported.<br/>The error message was:<br/><code></code>

List of Artist scrapers

Extension:DynamicPageList3 (DPL3), version 3.6.1: Error: MediaWiki\Extension\DynamicPageList3\Query::buildAndSelect: The DynamicPageList3 extension (version 3.6.1) produced a SQL statement which led to a Database error.<br/>The reason may be an internal error of DynamicPageList3 or an error that you made; especially when using parameters like 'categoryregexp' or 'titleregexp'. Usage of non-greedy <code>*?</code> matching patterns are not supported.<br/>The error message was:<br/><code></code>
List of Artist scrapers

Extension:DynamicPageList3 (DPL3), version 3.6.1: Error: MediaWiki\Extension\DynamicPageList3\Query::buildAndSelect: The DynamicPageList3 extension (version 3.6.1) produced a SQL statement which led to a Database error.<br/>The reason may be an internal error of DynamicPageList3 or an error that you made; especially when using parameters like 'categoryregexp' or 'titleregexp'. Usage of non-greedy <code>*?</code> matching patterns are not supported.<br/>The error message was:<br/><code></code>
List of Artist scrapers

Extension:DynamicPageList3 (DPL3), version 3.6.1: Error: MediaWiki\Extension\DynamicPageList3\Query::buildAndSelect: The DynamicPageList3 extension (version 3.6.1) produced a SQL statement which led to a Database error.<br/>The reason may be an internal error of DynamicPageList3 or an error that you made; especially when using parameters like 'categoryregexp' or 'titleregexp'. Usage of non-greedy <code>*?</code> matching patterns are not supported.<br/>The error message was:<br/><code></code>

List of Music Video scrapers

Extension:DynamicPageList3 (DPL3), version 3.6.1: Error: MediaWiki\Extension\DynamicPageList3\Query::buildAndSelect: The DynamicPageList3 extension (version 3.6.1) produced a SQL statement which led to a Database error.<br/>The reason may be an internal error of DynamicPageList3 or an error that you made; especially when using parameters like 'categoryregexp' or 'titleregexp'. Usage of non-greedy <code>*?</code> matching patterns are not supported.<br/>The error message was:<br/><code></code>
List of Music Video scrapers

Extension:DynamicPageList3 (DPL3), version 3.6.1: Error: MediaWiki\Extension\DynamicPageList3\Query::buildAndSelect: The DynamicPageList3 extension (version 3.6.1) produced a SQL statement which led to a Database error.<br/>The reason may be an internal error of DynamicPageList3 or an error that you made; especially when using parameters like 'categoryregexp' or 'titleregexp'. Usage of non-greedy <code>*?</code> matching patterns are not supported.<br/>The error message was:<br/><code></code>
List of Music Video scrapers

Extension:DynamicPageList3 (DPL3), version 3.6.1: Error: MediaWiki\Extension\DynamicPageList3\Query::buildAndSelect: The DynamicPageList3 extension (version 3.6.1) produced a SQL statement which led to a Database error.<br/>The reason may be an internal error of DynamicPageList3 or an error that you made; especially when using parameters like 'categoryregexp' or 'titleregexp'. Usage of non-greedy <code>*?</code> matching patterns are not supported.<br/>The error message was:<br/><code></code>

List of Movie scrapers

Extension:DynamicPageList3 (DPL3), version 3.6.1: Error: MediaWiki\Extension\DynamicPageList3\Query::buildAndSelect: The DynamicPageList3 extension (version 3.6.1) produced a SQL statement which led to a Database error.<br/>The reason may be an internal error of DynamicPageList3 or an error that you made; especially when using parameters like 'categoryregexp' or 'titleregexp'. Usage of non-greedy <code>*?</code> matching patterns are not supported.<br/>The error message was:<br/><code></code>
List of Movie scrapers

Extension:DynamicPageList3 (DPL3), version 3.6.1: Error: MediaWiki\Extension\DynamicPageList3\Query::buildAndSelect: The DynamicPageList3 extension (version 3.6.1) produced a SQL statement which led to a Database error.<br/>The reason may be an internal error of DynamicPageList3 or an error that you made; especially when using parameters like 'categoryregexp' or 'titleregexp'. Usage of non-greedy <code>*?</code> matching patterns are not supported.<br/>The error message was:<br/><code></code>
List of Movie scrapers

Extension:DynamicPageList3 (DPL3), version 3.6.1: Error: MediaWiki\Extension\DynamicPageList3\Query::buildAndSelect: The DynamicPageList3 extension (version 3.6.1) produced a SQL statement which led to a Database error.<br/>The reason may be an internal error of DynamicPageList3 or an error that you made; especially when using parameters like 'categoryregexp' or 'titleregexp'. Usage of non-greedy <code>*?</code> matching patterns are not supported.<br/>The error message was:<br/><code></code>

List of TV Show scrapers

Extension:DynamicPageList3 (DPL3), version 3.6.1: Error: MediaWiki\Extension\DynamicPageList3\Query::buildAndSelect: The DynamicPageList3 extension (version 3.6.1) produced a SQL statement which led to a Database error.<br/>The reason may be an internal error of DynamicPageList3 or an error that you made; especially when using parameters like 'categoryregexp' or 'titleregexp'. Usage of non-greedy <code>*?</code> matching patterns are not supported.<br/>The error message was:<br/><code></code>
List of TV Show scrapers

Extension:DynamicPageList3 (DPL3), version 3.6.1: Error: MediaWiki\Extension\DynamicPageList3\Query::buildAndSelect: The DynamicPageList3 extension (version 3.6.1) produced a SQL statement which led to a Database error.<br/>The reason may be an internal error of DynamicPageList3 or an error that you made; especially when using parameters like 'categoryregexp' or 'titleregexp'. Usage of non-greedy <code>*?</code> matching patterns are not supported.<br/>The error message was:<br/><code></code>
List of TV Show scrapers

Extension:DynamicPageList3 (DPL3), version 3.6.1: Error: MediaWiki\Extension\DynamicPageList3\Query::buildAndSelect: The DynamicPageList3 extension (version 3.6.1) produced a SQL statement which led to a Database error.<br/>The reason may be an internal error of DynamicPageList3 or an error that you made; especially when using parameters like 'categoryregexp' or 'titleregexp'. Usage of non-greedy <code>*?</code> matching patterns are not supported.<br/>The error message was:<br/><code></code>


Retrieved from "https://kodi.wiki/index.php?title=Scrapers&oldid=243957"