Official Kodi Wiki - User contributions [en]

Archive:Google Summer of Code/2019

2019-03-04T20:55:50Z

Peak3d: /* Using fuzz testing to fuzz test Kodi */

{{mininav| [[Google Summer of Code]] }}
[[File:GSOC_2016_logo.png|left|150px]]Welcome to the Kodi [http://summerofcode.withgoogle.com Google Summer of Code] ideas page. 

We encourage interested students of all ethnities and genders to review some of the ideas on this page, and then feel free to provide input on any ideas you may have in the '''[https://forum.kodi.tv/forumdisplay.php?fid=293 Kodi GSoC 2019 forum]''' and chat about any project you’d love to cover. To propose a project, see '''[[#Students project proposal ideas]]'''.

From the 25th March to the 9th of April, any interested students may apply at the [http://summerofcode.withgoogle.com GSOC home page] to work with Kodi. After that, Google will notify applicants whether we get to work with each other according to the [http://developers.google.com/open-source/gsoc/timeline GSOC schedule].
{{-}}
{| width="100%"
| align=left |
__TOC__
| align=right |
{{YouTube|kQq0mx-wshk}}
|}
== About Us ==
As there may be many students who have landed here as a result of GSOC, but are unfamiliar with the project, here are a few resources that may help explain what we are about.

:Kodi (formerly known as XBMC) is an award-winning free and open source (GPL) software media player and entertainment hub for digital media, designed around the 10-foot interface (living room) environment. Created in 2003 by a group of like minded programmers, Kodi is a non-profit project run and developed by volunteers located around the world. More than 500 software developers have contributed to Kodi, and 100-plus translators have worked to expand its reach, making it available in more than 60 languages. For more information, see the page '''[[Kodi]]'''.

 
To get an idea of what Kodi is truly capable of, it really must be seen. Check out a few other user-created videos: 
[http://www.youtube.com/watch?v=NcogPuSo-DU Kodi with the default Confluence skin] 
[http://www.youtube.com/watch?v=4asUCtE0ONU Kodi with Aeon Nox skin] 
[http://www.youtube.com/watch?v=4NR57ELY28s Kodi on Raspberry Pi] 
[http://www.youtube.com/watch?v=e_0PB5hfz_k Kodi's new PVR functionality] 
 

Kodi is written primarily in c++ and runs on a variety of platforms including Android, iOS, Linux, OS X, and Windows. It has been ported to work on several low-power platforms including the Raspberry Pi and Android.

Kodi was a mentoring organization in [[Google Summer of Code 2008|2008]], [[Google Summer of Code 2012|2012]], [[Google Summer of Code 2013|2013]], [[Google_Summer_of_Code/2015|2015]], [[Google Summer of Code/2017|2017]], [[Google Summer of Code/2018|2018]], and had team members involved in GSoC for other projects during 2011.

If Kodi is selected as a mentoring organization for 2019, students will need to review the Overview of a good project proposal, follow the outline for proposals when applying, and review the list of project ideas detailed below. Students are welcome to propose ideas outside the list and are encouraged to be as creative as they like.

=== Mentors ===
All mentors and backup mentors are extremely experienced in the Kodi codebase and will thus be able to assist students in getting to know the codebase and in quickly identifying projects that are both achievable for someone unfamiliar with the internal workings of Kodi and desirable to the wider Kodi community.

==Prerequisites==
C++ coding skills, basic familiarity with [[Git usage|Git]], solid understanding and interest in programming. Ability to quickly understand existing code is beneficial.

== Project Proposals ==
=== Overview ===
Qualifications for a good Summer of Code proposal:
* Discrete, well-defined, modular
* Comprised of a series of measurable sub-goals
* Based on open specs that are available free of charge
* Based on complete specs
An example of a good proposal is the implementation of a new feature or function that is not yet available in Kodi.

An example of a less desirable proposal is one that's not as measurable, such as refactoring an existing API. Bad proposals tend to be ones that would require touching a lot of core code.

To re-iterate:
* Localized/isolated code projects = ''good''
* Global code refactoring = ''bad''
* A project should have a set of subgoals, so even if the end goal turns out to be too big some of the parts will be of benefit.
* Not too big! This is an important problem when choosing a project, while it is fun to think about solving a grand project its not always realistic. Its better to finish a smaller project than to start a grand one.

=== Where to submit proposals ===
In addition to submitting to the [https://summerofcode.withgoogle.com/ Google Summer of Code] website, you are highly encouraged to submit your idea/proposal to the [https://forum.kodi.tv/forumdisplay.php?fid=293 Kodi forum] for discussion. Any proposal not submitted to the forum for discussion will likely not be considered.

=== Outline for proposals ===
{{divbox|blue||
PROJECT TITLE GOES HERE

* '''Name:'''
* '''forum/e-mail:'''
* '''Summary:''' A somewhat small but explanatory walk through of the project. It should not be overly detailed just enough to understand the problem trying to be fixed and how this project opt to solve it.
* '''How will I achieve this:''' Explain how the project will be done, what technologies are needed and how to implement them.
* '''What will the project focus on:''' Explain what the project will focus on, what is the important parts of the project.
* '''Benefits:''' Who will benefit and why from this project. Think about what a user or developer may need or do to benefit from it. Why does it benefit many users.
* '''Goals:''' What is the goal of the project, a project may not always solve the problem entirely as it may take to much time. Think hard about what can be accomplished during a summer with your skill and deduct that quite a bit. If the project can't be done after this perhaps its better to opt for a smaller one or one with subgoals.
* '''What does it touch in Kodi:''' Think about what parts of the code this may touch, Kodi is a big application and a lot of the code is spread out and very complex. If a project touches to much it may be impossible to complete.
* '''Requirements:''' What is needed to complete the project, what code language knowledge what hardware etc.
* '''Possible mentors:''' Place to add possible mentors (Team-Kodi will add this).
}}

== Team-Kodi proposal ideas up for discussion ==

=== Explore building binary addons in rust ===
'''Description:''' While Kodi has python addons, it can also handle binary addons. But these need to be build one by one for each platform and also might fail on errors. Rust might help with both of those problems and more. The idea is to use the api we have but via rust ffi and see where that leads us.

'''Expected outcome:''' Documentation and templates on how to use rust with kodi. In the best case also one or two example addons.

'''Skills preferred:''' C++, Rust, C

'''Possible mentors:''' spiff, Razze

'''Difficulty:''' Hard

'''Type:''' Binary addon development

=== Better profile support ===
'''Description:''' Profile support inside Kodi remains extremely hacked together. Improving profile projects would likely be broken down into smaller chunks to make each chunk truly achievable in a summer. Database handling for profiles needs to be reviewed and changed so that the user experience is more streamlined. It should also be possible to better guard code paths that need to check for specific profile rights.

'''Expected outcome:''' Profiles should be more user-friendly than before and not be an afterthought. Being able to easily add more profile features is the big ultimate goal, as we want to support profiles for kids that automatically hide media that's not for them. Just as an example.

'''Skills preferred:''' C++

'''Possible mentors:''' spiff

'''Difficulty:''' Hard

'''Type:''' Core development

=== Replacing depends with a CMake-based system ===

'''Description:''' Kodi has its own system for building the many libraries Kodi depends on that supports most platforms (Linux, Android, OS X, iOS) and cross-compiling called depends. At the moment, it is implemented with autotools and hand-crafted Makefiles. This has lead to a lot of code duplication, poor maintainability, and not being very user-friendly. Also, it does not currently work on Windows. This task would be about replacing the current system with a new implementation in CMake that has better maintainability.

'''Expected outcome:''' A CMake-based dependency build system that offers roughly the same features as depends (i.e. all required libraries covered, diverse platform support, crosscompilation). If the solution can also be applied to Windows by e.g. adding minimal CMake files to replace some UNIX-only build systems, that would be a big plus, but it is not necessary.

'''Skills preferred:''' CMake, shell scripting, general familiarity with UNIX/Linux

'''Possible mentors:''' wsnipex

'''Difficulty:''' Medium

'''Type:''' Infrastructure/Automation

=== Integrate TUF (The Update Framework) ===

'''Description:''' Kodi uses a self-built mechanism for installing and updating add-ons from add-on repositories. Unfortunately, it is not very secure. This project would be about replacing the add-on repository code with the usage of TUF (The Update Framework), a quite recent library that solves many common security problems for updaters. TUF does not currently have a C or C++ implementation. The reference implementation is in Python, which we do not want to integrate with C++ for this core piece of application code. Due to security concerns, we also do not want to implement TUF ourselves. That leaves using rust-tuf, an experimental Rust implementation. First step would be to write a C wrapper library so that we can use it from Kodi.

'''Expected outcome:''' Add-on repository in Kodi using TUF that builds and works on all supported platforms (beware, there are quite a lot) and is integrated into the Kodi add-on infrastructure (i.e. there are also tools to generate valid repositories). It should support all core add-on functionality (be able to list, install, and update add-ons).

'''Skills preferred:''' C++, Rust, Python (for creating the repository the TUF reference implementation could be used)

'''Possible mentors:''' yol

'''Difficulty:''' Hard

'''Type:''' Risky/Exploratory (rust-tuf is unstable and there is also a lot of work to be done on the backend side)

===Add-ons===
====Automatic add-on checker for binary add-ons====
'''Description:''' Kodis add-on checker checks each Kodi add-on PR on GitHub for certain problems, which ultimately makes reviewing Python add-ons easier for the team. But the other type of add-ons, binary add-ons is not being checked so far, which makes reviews and coding guidelines hard to handle. Thus it would be nice to also check those add-ons, either via the current checker written in Python or a new binary add-on specific checker. Goals would include checking the addon.xml, the C++ code and a check for potentially malicious code.

'''Expected outcome:''' Being able to run the checker against all binary repo PRs on GitHub.

'''Skills preferred:''' Python, C++

'''Possible mentors:''' Razze

'''Difficulty:''' Hard

'''Type:''' Low-hanging fruit

====Addon submissions====
'''Description:''' Write a tool or a website to easily submit addons to our addon repo. The tool will need to login at GitHub and send a PR in the name of the author to the correct repo and branch on Kodi's GitHub. The user experience needs to be very good to not keep anyone from submitting. It should also be able to offer some opinions on the code that will be committed before it actually gets sent, so that the most common errors are caught on the client side.

'''Expected outcome:''' A tool that lowers the bar for addon authors to get started with repo submissions, so we get more submissions with better quality.

'''Skills preferred:''' Depending if this will be a standalone tool or an website the choice of technology would be quite different. It would be a new tool, so that's fine. For a website Python/Django, Elixir/Phoenix or something similar would be a good choice. For a standalone tool we might do a full UI in Java or Electron or settle for a command-line interface via JavaScript.

'''Possible mentors:''' Razze

'''Difficulty:''' Easy

'''Type:''' Low-hanging fruit

===Achievements in Retroplayer===
'''Description''': Retroarch has developed support for achievements in certain select libretro cores. This project would consist of porting whatever work might be portable and otherwise integrating the existing libretro achievement system into Kodi's retroplayer implemented using Kodi's UI system. Could be tackled a few different ways, including simply linking the user to the retroachievements.org or creating a full achievement database in Kodi.

'''Expected Outcome''': Users should be able to see their achievements in Kodi. Player manager and Player profile support may be in development concurrently, so thought should be given to those systems.

'''Skills preferred''': C++, python, possibly php

'''Possible mentor''': garbear

'''Difficulty''': medium

'''Type''': Fun/Peripheral

'''Notes''': Garbear has broken down the Retroplayer project into manageable pieces including input, core, game add-ons, peripheral add-ons, netplay, a game library implementation, and shaders to do things like emulate a CRT monitor. This is one example, but many pieces are currently being worked on or are near completion, and many more could use help from a student familiar with the area. Visit the retroplayer section of the Kodi forum to see all the major projects still to do.

===Add a picture library===
'''Description:''' At the moment Kodi has got the concept of libraries for movies, TV shows and music. Libraries are far nicer than directories for users to handle as they keep their data and basically act upon the data that got collected without having to get it on each directory traversal. It also enables filtering, sorting and searches. The project would focus on adding a picture database and getting it filled via file scrapping. When that's done we would progress to write basic library views for pictures.

'''Expected outcome:''' A functional picture library for Kodi with the possibility to scan files and having them added to your library. It should also be possible to look at your files via a library frontend, just like it's possible for TV shows, movies or music.

'''Skills preferred:''' C++, SQLite, MySQL/MariaDB

'''Possible mentors:''' Razze

'''Difficulty:''' Easy

'''Type:''' Core development

===Use machine learning to improve suggestions===
'''Description:''' Kodi currently can't suggest similar media to watch/listen to. It would be possible to just show media that's similar on the base of a tag, but that would be quite rudimentary. Better would be to create something driven by the user or profile that's currently logged in. This would mean that watched/listened and collected data be added to the model and we would serve the best possible suggestion for a user. Machine learning might be the best approach as we would be able to create a model and just ship that model and act on it when Kodi tries to serve suggestions.

'''Expected outcome:''' Far better suggestions than before. Some places might even just get suggestions due to this project, as it did not make much sense to do suggestions before this.

'''Skills preferred:''' Python, TensorFlow, C++, SQLite, MariaDB/MySQL

'''Possible mentors:''' Razze

'''Difficulty:''' Hard

'''Type:''' Risky/Exploratory

===Using fuzz testing to fuzz test Kodi===

'''Description:''' Adding fuzz testing to Kodi would be very valuable to find problems in the current code base. Especially security problems. First step would be choosing a framework either American fuzzy lop, libFuzzer or other similar projects. After we decided on that it would be time to start to fuzz different methods that are widely used in Kodi and try to expose flaws in those. If this leads to success, it should be documented and made repeatable.

'''Expected outcome:''' Being able to easily add more fuzz tests and having the process to do this documented.

'''Skills preferred:''' C++, CMake

'''Possible mentors:''' Razze

'''Difficulty:''' Medium

'''Type:''' Risky/Exploratory

===inputstream.adaptive binary addon===

'''Description:''' inputstream.adaptive is a binary kodi inputstream addon written in C++ and handles multi bitrate streams provided in DASH / Smoothstream manifest or HLS multi bitrate playlists. The addon provides demuxed / encoded packets to kodi and kodi renders the data with its internal videoplayer. Digital Rights Management (DRM) is implemented in inputstream.adaptive to allow playback of protected media. inputstream.adaptive is used by many (> 100) addons to play (legal) encrypted media.
 The addon sources are still hosted in my own git repository (https://github.com/peak3d/inputstream.adaptive) but I'll hand over the sources to kodi repository if someone is interested on working at one of these 2 most urgent topics:

====Bitrate switch====

'''Description:''' In the current inputstream.adaptive implementation a stream resolution / bitrate is selected at start time. Because of network fluctations / manual window / screen changes or performance stats of rendered frames it should be possible to switch seamless to lower / higher stream representations.

'''Expected outcome:''' Automagically select / change seamless stream depending on external factors.

'''Skills preferred:''' C++, CMake

'''Possible mentors:''' peak3d

'''Difficulty:''' Medium

'''Type:''' Media playback

====Read ahead====

'''Description:''' Currently stream segments are downloaded on request (that is kodi is requesting more data to display). Because the kodi videoplayer internal buffer is small (8 seconds), network fluctuation can lead to bad user experience (stream interruption). What users want is that inputstream.adaptive buffers a configurable amount of time ahead to bypass this issue. Buffering ahead in multi bitstream is not only a technical task, there are numerous resolutions / bitrates for the same movie time segment in the manifest from which the "best" one should be buffered. The concept of what to read will be an not trivial engeneering task. Bitrate switch (see previous topic) will be a prerequasite to "Read ahead" because on low network times lower bitrate streams are read compared to good network times.

'''Expected outcome:''' Implementation of read ahead logic for multi bitrate streams, user configurable.

'''Skills preferred:''' C++, CMake

'''Possible mentors:''' peak3d

'''Difficulty:''' Medium

'''Type:''' Media playback

===Other ideas===
These ideas still need expanding and/or assigned a potential mentor. If one of these ideas interests you, feel free to ask for more info in the GSOC 2019 forum area. We may be able to assign a mentor if enough interest is shown
*Visual Studio Code addon to validate/syntax highlight Kodi Addons
*Using fruit or similar to use DI in Kodi and write tests
*High quality scalers for OpenGL(GLSL). Scale Y and UV plane separately
*Support downloading of of media items (the actual file not just the metadata) from another Kodi instance (e.g. through UPnP) into the local library. This could be done in a "send to" way and in a "download" way and it could also be combined with transcoding depending on the target device.
*UPnP device profiles. there's already a PR that goes in that direction and the problem is that right now we can only really provide device specific MIME type hacks but if we have transcoding we'll definitely need this
*Implementing a performance critical element of kodi in rust

=== More ===
We feel it is important to note that, while we are interested in a focus on the listed three areas, we would like to stress passion, expertise, and creativity above all else. If you would like to do something completely different, definitely send in that proposal. The ideas listed above are, as always, merely suggestions. We will be interested in any idea, so long as you can communicate your interest, your background, and your solution the problem.

== Students project proposal ideas ==

Submit your own proposals on the '''[https://forum.kodi.tv/forumdisplay.php?fid=293 Kodi GSoC forum]'''. They can be as big or as small as you feel you can comfortably accomplish between '''PROJECT START DATE''' and '''PROJECT END DATE'''. In the end, it's better to have a smaller, completed project, rather than a larger, incomplete project.

To submit a proposal idea:
# Copy the text from '''[[#Outline for proposals]]'''.
# Create a new forum post '''[https://forum.kodi.tv/forumdisplay.php?fid=293 HERE]''' and paste the text.
# Fill out everything using your specific proposal.

[[Category:Google Summer of Code]]

Samples

2018-10-22T13:06:55Z

Peak3d:

{{mininav| [[Troubleshooting]] {{l2|[[Development builds]] }} }}

{{forum link2|1=Questions? Comments? See the ''[http://forum.kodi.tv/showthread.php?tid=248794 discussion thread]''}}

''(Thanks to hdmkv for putting together these links)''

Kodi users are a demanding bunch when it comes to media players with Kodi & having as-close-to-perfect video playback capabilities as possible. All videos should play smoothly and w/o distracting artifacts such as stutters, frame skips, improper framerates, macroblocking, and audio drop-outs.

Below is a collection of a/v clips for testing, pushing media player capabilities. Not all types, but the most widely used or critical types for home theater enthusiasts. [[w:Fair use|Fair use]] is claimed on all non-[[w:copyleft|copyleft]] clips, as their the purpose is only for testing, technical evaluation, and documentation.

==3D Test Clips==

#[https://drive.google.com/file/d/0BwxFVkl63-lEd2c0ekxfbFd3Tmc/view?usp=sharing MVC 3D ISO Sample #1] (1080p/23.976)
#[https://drive.google.com/file/d/0BwxFVkl63-lEM2xjQndxV3ZzaVE/view?usp=sharing MVC 3D ISO Sample #2 with 3D Subtitles] (1080p/23.976)
#[https://drive.google.com/file/d/0BwxFVkl63-lEMkJTV21JNnhfNlE/view?usp=sharing MVC 3D ISO Sample #3 for Pop-out & Depth Evaluation] (1080p/23.976)
#[https://drive.google.com/file/d/0BwxFVkl63-lEWmRyc0YwUExxX0U/view?usp=sharing MVC 3D ISO Sample #4 for Proper Lip-synch & Clean Graphics Render Verification] (1080p/23.976)
#[https://drive.google.com/file/d/0BwxFVkl63-lETWMzM1dRZF9XMDA/view?usp=sharing MVC 3D MKV] (1080p/23.976)
#[https://drive.google.com/file/d/0BwxFVkl63-lEX3RpYTNEMFZxcjA/view?usp=sharing HSBS (side-by-side)] (MKV @ 1080p/23.976)
#[https://drive.google.com/file/d/0BwxFVkl63-lET0czejJBVXJLSkE/view?usp=sharing HTAB/HOU (top-and-bottom)] (MKV @ 1080p/23.976)

==HD Audio Test Clips==
{{note|To download, hover over link:
* If demo-world, click to go to site, then right-click thumbnail of video there & choose 'Save link as...' to download
* For rest, just click}}

#[https://mega.nz/#!cM9VmBSL!mME5qULH2H5M24vLmjqfZZkaoUjY6RsrGPiw3ultMW0 Dolby Digital Plus 7.1] (M2TS @ 1080p/29.970) ''(thanks wesk05)''
#[http://www.demo-world.eu/download-2d-trailers/?file=dolby_digital_plus_channel_check_lossless-DWEU.mkv&pic=dolby_digital_plus_channel_check_lossless.jpg Dolby Digital Plus 7.1 Channel Check] (MKV @ 1080p/29.970)
#Dolby TrueHD 5.1 (use clip #10 in 'Codecs' section below)
#[http://www.demo-world.eu/download-2d-trailers/?file=dolby_truehd_channel_check_lossless-DWEU.mkv&pic=dolby_truehd_channel_check_lossless.jpg Dolby TrueHD 7.1 Channel Check] (MKV @ 1080p/29.970)
#[http://www.demo-world.eu/download-2d-trailers/?file=dolby_amaze_lossless-DWEU.m2ts&pic=dolby_amaze.jpg Dolby ATMOS 'Amaze' Demo] (M2TS @ 1080p/24.000)
#[https://drive.google.com/open?id=0BwxFVkl63-lENElIcC1xTnF2Yk0 Dolby ATMOS 'Helicopter' Demo] (M2TS @ 1080p/29.970 with DD+ 7.1 secondary track)
#[https://www.demolandia.net/downloads.php?id=236762 Dolby ATMOS 'Audiosphere' Demo] (M2TS @ 1080p/24.000)
#[https://www.demolandia.net/downloads.php?id=52783232 Dolby ATMOS 'Silent' Demo] (M2TS @ 1080p/24.000)
#[https://drive.google.com/file/d/0BwxFVkl63-lEcU1ScWZuMjhpOXM/view?usp=sharing DTS-HD HRA 5.1] (MKV @ 1080p/23.976 VC-1)
#[http://www.demo-world.eu/download-2d-trailers/?file=dts_orchestra_short_lossless-DWEU.mkv&pic=dts_orchestra.jpg DTS-HD HRA 7.1] (MKV @ 1080p/29.970)
#[https://drive.google.com/file/d/0B4nYAKUiVpepY1NuQW5ER3l3SXc/edit?usp=sharing DTS-HD MA 5.1 Channel Check] (M2TS @ 1080p/23.976)
#[https://drive.google.com/file/d/0B67BGVX7nHIlNlJBenpkQkhFXzA/view DTS-HD MA 5.1 24-bit 192kHz audio-only sample] (MKV) ''(thanks HomerJau)''
#[http://www.demo-world.eu/download-2d-trailers/?file=dts_hd_master_audio_sound_check_7_1_lossless-DWEU.mkv&pic=dts_hd_master_audio_sound_check_7_1_lossless.jpg DTS-HD MA 7.1 Speaker Phase] (MKV @ 1080p/23.976)
#[https://drive.google.com/open?id=0Bx63o79bMC7lMEMxUmxzV2NtYTA DTS-HD MA 7.1 'Dredd' Audio Channel Check] (M2TS @ 1080p/23.976) ''(thanks looun)''
#[http://www.demo-world.eu/download-2d-trailers/?file=dts_x_all_around_us_lossless-DWEU.mkv&pic=dts_x_all_around_us.jpg DTS:X 'All Around Us' Demo] (MKV @ 1080p/23.976) ''(thanks wesk05)''
#[https://drive.google.com/open?id=0BwxFVkl63-lEQWNKRnBPUlB3QXc DTS:X 'Gravity' Demo] (MKV @ 1080p/23.976) ''(thanks wesk05; modified to only retain the X track)''
#[https://www.demolandia.net/downloads.php?id=87980801 DTS:X 'Sound Unbound Callout 11.1' Demo] (M2TS @ 1080p/24.000)
#[https://www.demolandia.net/downloads.php?id=69530805 DTS:X 'Listen X Long' Demo] (M2TS @ 1080p/24.000)
#[https://mega.nz/#!0NVhDIbY!D4Fte7Kb7728H9CRY3IVTHJ45ZwkCQiugdFS7pZCN_s DTS:X 'Movement' Demo] (M2TS @ 1080p/23.976) ''(thanks wesk05)''
#[https://mega.nz/#!Rcl1ECiL!pzPT5LvMyYIoKbsm3HdMDi2vO6aPpE8gAjLsSTH1DZg LPCM 5.1] (MKV @ 1080p/23.976) ''(thanks wesk05)''
#[https://drive.google.com/file/d/0BwxFVkl63-lEV2JjazFWQ05OSG8/view?usp=sharing LPCM 7.1] (MKV @ 1080p/23.976)
#[https://www2.iis.fraunhofer.de/AAC/multichannel.html AAC 5.1]
#FLAC 5.1 (use clip #6 in '3D Test Clips' section above)
#[https://drive.google.com/file/d/0B67BGVX7nHIlNlJBenpkQkhFXzA/view FLAC 5.1 24-bit 192kHz audio-only sample] ''(thanks HomerJau)''
#[http://www.2l.no/hires/index.html FLAC many formats]
#[https://www.cybele.de/geraete-software-download FLAC many formats] (bottom of page)

==Codecs, Framerates and Subtitles==

#[https://drive.google.com/file/d/0BwxFVkl63-lERkJRU003ZTd2VEk/view?usp=sharing H.264 1080p/23.976] (MKV)
#[https://drive.google.com/file/d/0BwxFVkl63-lEdzlZZ2lCLTVLa2c/view?usp=sharing H.264 1080p/24.000] (MKV)
#[https://drive.google.com/file/d/0BwxFVkl63-lEbFBzak1sbmU1N0E/view?usp=sharing H.264 1080i/25.000] (MKV)
#[https://drive.google.com/file/d/0BwxFVkl63-lEWDUzUVUtZEw4cDA/view?usp=sharing H.264 1080p/25.000] (MKV)
#[https://mega.nz/#!XI1yiKLA!rF4vweNo_xA7vpSzpLU-JctqfUGZN4vVU1m6WIJ5lT4 H.264 1080i/29.970 4:2:0@High 26Mbps] (C-Band satellite capture in MKV w/DTS-HD MA 2.0 audio, converted from E-AC3) ''(thanks alanisrox69)''
#[http://opencubetech.com/page47/ H.264 1080i/50.000] (download and change .mxf extension to .ts)
#[https://drive.google.com/file/d/0BwxFVkl63-lEbVptTVZ2NENURHM/view?usp=sharing H.264 1080p/50.000] (MKV)
#[https://drive.google.com/file/d/0BwxFVkl63-lEUGZnR1JHUUU0WEk/view?usp=sharing H.264 1080p/59.940] (MKV)
#[https://drive.google.com/file/d/0BwxFVkl63-lETTVtaVV0LUVRZ1k/view?usp=sharing H.264 1080p/60.000] (MKV)
#[https://drive.google.com/file/d/0BwxFVkl63-lETFVpOWRVVGNfeEU/view?usp=sharing VC-1 1080p/23.976] (MKV w/TrueHD 5.1 audio)
#[https://drive.google.com/file/d/0BwxFVkl63-lERnhlY1pHeW5wbjQ/view?usp=sharing VC-1 1080i/29.970] (MKV w/DTS-HD MA 5.1 audio)
#[https://drive.google.com/file/d/0BwxFVkl63-lETXlOa3hEMmVyZGM/view?usp=sharing MPEG2 1080i/29.970] (U.S. ATSC OTA capture, muxed into MKV w/DD5.1 audio)
#[https://mega.nz/#!GJMAADTK!deabwHlqtw2I_ihoY6_0xnxT_1W_d3jpAjnANKRBAzE MPEG2 4:2:0@High 1080i/29.970 36Mbps] (C-Band satellite capture in TS w/DTS-HD MA 5.1 audio, converted from E-AC3) ''(thanks alanisrox69 for #13-15)''
#[https://mega.nz/#!jREAxYgb!MtjBIh1oSJJBZgLT7AcdG88hGCFG-ak7pC2AyjrsaIQ MPEG2 4:2:0@High 720p/59.940 20Mbps] (C-Band satellite capture in TS)
#[https://mega.nz/#!c9dhAaKA!MG5Yi-MJNATE2_KqcnNJZCRKtTWvdjJP1NwG8Ggdw3E MPEG2 4:2:2@High 1080i/29.970 35Mbps] (C-Band satellite capture in TS w/DTS-HD MA 5.1 audio, converted from E-AC3) (most media players can't play this; Sigma SoC-based media players and Intel i3+ NUC's/HTPC's can)
#[https://www.dropbox.com/sh/6iy4gxgsfn14opq/AAAK_L1M_NwZwBPb5IkEPh7Ga?dl=0 Hi10 Anime Samples] ''(thanks Morien)''
#H.265 1080p (medium bitrate) Test #1 [https://drive.google.com/file/d/0B3-obtCH8dE8d04yQnY5ZkFJdVE/view?usp=sharing in ISO], and [https://drive.google.com/file/d/0B3-obtCH8dE8V0NXdi1Jd3NrNkk/view?usp=sharing in MKV] ''(thanks Mike for #16-17)''
#H.265 1080p (medium bitrate) Test #2 [https://drive.google.com/file/d/0B3-obtCH8dE8UnZiV2kyRGZEWW8/view?usp=sharing in ISO], and [https://drive.google.com/file/d/0B3-obtCH8dE8bFdvWVFUMlNjX0E/view?usp=sharing in MKV]
#[https://drive.google.com/file/d/0BwxFVkl63-lEbWhqS284RkpNMXc/view?usp=sharing 2D Forced Subtitles Sample #1 (SRT)]
#[https://drive.google.com/file/d/0BwxFVkl63-lEVEluSFZ4NlhpLUk/view?usp=sharing 2D Forced Subtitles Sample #2 (PGS)]
#3D Subtitles (use clip #2 in '3D Test Clips' section above)

==4K (UltraHD)==
{{note|To download, hover over link:
* If demo-world, click to go to site, then right-click thumbnail of video there & choose 'Save link as...' to download
* For any YouTube video, [https://www.4kdownload.com/products/product-videodownloader use this free tool] to download in original quality}}

#[https://drive.google.com/open?id=0BwxFVkl63-lEY3l3ODJReDg3RzQ H.264 29.970fps, 51Mbps] (in MOV, hdmkv's iPhone 6S raw 4K footage)
#[https://www.youtube.com/watch?v=Ppz41EmaJyU H.264 30.000fps] (in MP4, 4K Test Patterns) (YouTube) ''(thanks hansolo)''
#[http://demo-uhd3d.com/fiche.php?cat=uhd&id=111 H.264 50.000fps] (in MP4, Astra DVB satellite capture sample)
#[http://www.demo-world.eu/download-2d-trailers-uhd/?file=samsung_seven_wonders_of_the_world_china_uhd-DWEU.mkv&pic=samsung_seven_wonders_of_the_world_china.jpg H.264 59.940fps] (in MKV)
#[http://demo-uhd3d.com/fiche.php?cat=uhd&id=101 HEVC 8-bit 29.970fps] (in MP4)
#[http://demo-uhd3d.com/fiche.php?cat=uhd&id=45 HEVC 10-bit 23.976fps] (in TS)
#[http://demo-uhd3d.com/fiche.php?cat=uhd&id=96 HEVC 10-bit 59.940fps] (in TS)
#[https://drive.google.com/open?id=0BwxFVkl63-lEdVBuZkltckdZZ0k HEVC 10-bit 59.940fps] (Korean ATSC 3.0 satellite TV capture sample)
#[http://hdrsamples.com/ HDR 10-bit HEVC 24.000fps] (in MP4, 'Exodus' and 'Life of Pi' samples)
#[https://drive.google.com/open?id=0BwxFVkl63-lEdU9Ma0VYc3YxSVE HDR 10-bit HEVC 25.000fps] (in TS, Astra DVB satellite capture sample; no audio) ''(courtesy WeTek)''
#[http://demo-uhd3d.com/fiche.php?cat=uhd&id=144 HDR 10-bit HEVC 59.940fps] (in MP4, Camp by Sony)
#[https://drive.google.com/open?id=0BwxFVkl63-lEc3k0aldZaGtaVm8 DolbyVision 10-bit HEVC 23.976fps] (in TS, LG Comparison Demo) ''(thanks soyhakan)''
#[https://drive.google.com/open?id=0BwxFVkl63-lEWmNWcGl4eVRWS2M DolbyVision 10-bit HEVC 23.976fps] (in TS, LG Trailer) ''(thanks soyhakan)''
#[https://www.youtube.com/watch?v=s6zR2T9vn2c VP9] (open-source alternative to HEVC) (YouTube)
#[https://mega.nz/#!hJdFEIBI!uSOjZtkkjIVYSfqD9aSfONf1yq__uQvlsf47pCtFvdQ VP9 Profile 2 HDR #1] The World in HDR (in MKV, downloaded from YouTube) ''(thanks wesk05)''
#[https://mega.nz/#!pQEGgRwY!pD9whIlM-U9tJIA-LojxSt582BAZGfdSA5wAQLT06I4 VP9 Profile 2 HDR #2] The Redwoods (in MKV, downloaded from YouTube) ''(thanks wesk05)''
#[https://www.youtube.com/watch?v=nRt4Duf7GoI 5K (5120x2700) 60.000fps] (in MP4) (YouTube)
#[https://www.demolandia.net/downloads.php?id=60876578 HEVC 10-bit 23.976fps] (in MKV)
#[https://www.youtube.com/watch?v=ChOhcHD8fBA 8K (7680x4320) 29.970fps] (in MP4) (YouTube)
#[https://www.demolandia.net/downloads.php?id=73498539 HEVC 10-bit 23.976fps] (in MKV)
#[https://www.demolandia.net/downloads.php?id=99364567 HEVC 10-bit 23.976fps] (in MKV)

==Bitrate Test Clips==
Media players should be able play 70Mbps or better smoothly, w/o stutters for full 1080p, and 108-128Mbps for full 4K

*[http://jell.yfish.us/ Jellyfish, up to 400Mbps] (in H.264 and H.265 HEVC MKV) ''(thanks ScottAllyn01 for your useful site)''
*[http://dl.ganjanetwork.ru/Files/Video%20Test%20Files/Bitrate/Birds/ Birds, up to 90Mbps] (in H.264 MKV or M2TS)

==Resources for Additional Test Clips or Samples==

*[http://bbb3d.renderfarming.net/download.html Big Buck Bunny] (test suite with 2D, 3D and 4K clips)
*[http://www.cnx-software.com/2010/03/17/where-to-get-video-audio-and-image-samples/ CNXSoft's samples/links]
*[http://www.w6rz.net/ W6RZ MPEG2 clips]
*[http://thedigitaltheater.com/index.php/dolby-trailers/ The Digital Theater] (several Dolby ATMOS clips)
*[http://www.demo-world.eu/2d-demo-trailers-hd/ Demo World trailers] (several directly linked to above)
*[https://www.koi-sama.net/files/hi10/ AVC High 10 Profile Anime Samples] ''(thanks Morien)''
*[http://4ksamples.com/ 4Ksamples.com] (movie, sport, nature clips in 4K)
*[https://www.youtube.com/watch?v=k_okcNVZqqI&list=PLD33E5618740295DF Jacob + Katie Schwarz: We See the World in 4K] (beautiful 4K nature videos) (YouTube)
*[https://www.youtube.com/user/aroundtheworld4k Around the World 4K] (Cities worldwide in striking 4K) (YouTube)
*[https://www.youtube.com/channel/UCW35MLO96M_UVG7YzMt1I2A/videos Cities in 4K] (Similar to above) (YouTube)
*[https://www.youtube.com/channel/UC_3n6GTFuC4tTAojueLBTHg/playlists Manufacturer and other demos in 4K] (YouTube)
*[http://www.imaging-resource.com/news/2014/11/19/samsung-nx1-4k-video-samples-and-new-full-res-frame-grabs-available-for-do Imaging Resource 4K Samples] ''(thanks Karnis)''
*[https://www.youtube.com/channel/UCve7_yAZHFNipzeAGBI5t9g/videos The HDR Channel] (YouTube)
*[http://demo-uhd3d.com/ Demo UHD 3D] (various H.265 & H.265 4K clips) ''(thanks wrxtasy)''
*[https://x265.com/hevc-video-files/ x265 HEVC Samples]
*[http://www.evosiastudios.com/category/portfolio/films/ Evosia Studios] (several beautiful 1080p to 4K films)
*[http://www.libde265.org/downloads-videos/ libde265] (1080p to maxed-out 4K samples) ''(thanks Martijn)''
*[http://timestormfilms.net/ Timestorm Films] (4K to 8K videos)
*[http://samples.mplayerhq.hu/ MplayerHQ's library] (many clips)
::{{note|<code>http://samples.mplayerhq.hu</code> can even be added to Kodi as a video source, for easy loading, if you have a fast enough connection.}}
*[https://www.pc-magazin.de/ratgeber/hdr-tv-testfilm-testbild-kostenlos-download-3195250.html PC-Magazin.de/Ratgeber/hdr-tv-testfilm-testbild] (4K HDR / SDR test patterns with german description)

== Library samples ==

=== Ned's fake movie library ===
:A zipped collection of 1,000 empty movie files, with NFO files, poster, and fanart for each entry. Various movies from different years, including sequels/sets, remakes, movies named the same but unrelated, various genres, and so on. Useful for testing things like library scanning speed, library navigation, filtering, etc.

:* https://www.dropbox.com/s/llciqryeqqk4t70/Test%20video%20library.zip?dl=0

=== Music library ===
: Just the one album for now but hope to increase this over time. It's a complete album in MP3 format, tagged with Musicbrainz Picard ID3v2.3 (ID3v1 ID3v2.3) with extra genre, comment and composer tags for testing. Coverart is also included as a folder.jpg file. The album is licensed "Attribution-ShareAlike 3.0 Unported Creative Commons license" by the artist. You can download or pay for the album here if you like it. http://hungrylucy.com/album/pulse-of-the-earth

:* https://www.dropbox.com/s/rk8ue5fs49v5pnm/Creative_Commons_Music.zip?dl=0

=== Fake Sports TV Show library ===
: Here is a fake sports TV show library for use with the Kodi sports scraper. It includes a number of sports folders broken down into seasons and then events. This should work nicely with the current Sports TV scraper on the Kodi forums.

:* https://www.thesportsdb.com/Sports_fake_video_files.zip

=== Homebrew Game Roms ===
: This is a location to find a number of freely licensed "homebrew" console games that can be downloaded for testing with Kodi's upcoming retroplayer feature. They include NES, Gameboy and Snes titles.

:* https://github.com/OpenEmu/OpenEmu-Update/tree/master/Homebrew

== See also ==
* [[Video levels and color space]]

[[Category:Troubleshooting]]