8 Commits

Author SHA1 Message Date
155bd4df49 fix(settings): add AST compatibility for Python 3.12+
All checks were successful
CI / test (push) Successful in 1m5s
- Use `ast.Constant` as primary node for Python 3.8+
- Maintain backward compatibility with `ast.Num`, `ast.Str`, and `ast.NameConstant`
- Prevent crashes on Python 3.12 where legacy nodes were removed
- Add safe handling via `try/except AttributeError`
2026-04-19 22:41:48 -05:00
5577e9e1f2 feat(channels): fix pagination for "Sorted by newest - no shorts"
Some checks failed
CI / test (push) Has been cancelled
Replace UU-uploads playlist workaround (proto field 104) with direct
requests to the channel Videos tab API (tab="videos"), aligning with
Invidious content-type handling. This restores proper continuation
tokens and stable pagination (~30 videos per page).

Update display logic:
- Show channel total upload count as an upper-bound while continuation
  tokens exist.
- On final page, display exact fetched video count.
- Ensure page number never falls below current page (fix page reset to "1").

Maintain separate handling:
- Shorts and streams tabs continue using tab-specific continuation tokens.

Add test:
- TestChannelCtokenV5::test_include_shorts_false_adds_filter

Fixes issue where channels with many Shorts (e.g., Celine Dept) showed
only a few videos and broken pagination under "no shorts" sorting.
2026-04-19 22:34:14 -05:00
3795d9e4ff fix(playlists): make playlist parsing robust against filename and formatting issues
All checks were successful
CI / test (push) Successful in 53s
- Use glob lookup to find playlist files even with trailing spaces in filenames
- Sanitize lines (strip whitespace) before JSON parsing to ignore trailing spaces/empty lines
- Handle JSONDecodeError gracefully to prevent 500 errors from corrupt entries
- Return empty list on FileNotFoundError in read_playlist instead of crashing
- Extract _find_playlist_path and _parse_playlist_lines helpers for reuse
2026-04-05 18:47:21 -05:00
3cf221a1ed minor fix 2026-04-05 18:32:29 -05:00
13a0e6ceed fix(hls): improve audio track selection and auto-detect "Original"
- Auto-select "Original" audio track by default in both native and Plyr HLS players
- Fix native HLS audio selector to use numeric indices instead of string matching
- Robustly detect "original" track by checking both `name` and `lang` attributes
- Fix audio track change handler to correctly switch between available tracks
2026-04-05 18:31:35 -05:00
e8e2aa93d6 fix(channel): fix shorts/streams pagination using continuation tokens
- Add continuation_token_cache to store ctokens between page requests
- Use cached ctoken for page 2+ instead of generating fresh tokens
- Switch shorts/streams to Next/Previous buttons (no page numbers)
- Show "N+ videos" indicator when more pages are available
- Fix UnboundLocalError when page_call was undefined for shorts/streams

The issue was that YouTube's InnerTube API requires continuation tokens
for pagination on shorts/streams tabs, but the code was generating a new
ctoken each time, always returning the same 30 videos.
2026-04-05 18:19:05 -05:00
8403e30b3a Many fixes to i18n 2026-04-05 17:43:01 -05:00
f0649be5de Add HLS support to multi-audio 2026-04-05 14:56:51 -05:00
25 changed files with 353 additions and 753 deletions

381
README.md
View File

@@ -1,313 +1,180 @@
# yt-local # yt-local
[![License: AGPL v3](https://img.shields.io/badge/License-AGPL_v3-blue.svg)](https://www.gnu.org/licenses/agpl-3.0) Fork of [youtube-local](https://github.com/user234683/youtube-local)
[![Python 3.7+](https://img.shields.io/badge/python-3.7+-blue.svg)](https://www.python.org/downloads/)
[![Tests](https://img.shields.io/badge/tests-passing-brightgreen.svg)](https://github.com/user234683/youtube-local)
A privacy-focused, browser-based YouTube client that routes requests through Tor for anonymous viewing—**without compromising on speed or features**. yt-local is a browser-based client written in Python for watching YouTube anonymously and without the lag of the slow page used by YouTube. One of the primary features is that all requests are routed through Tor, except for the video file at googlevideo.com. This is analogous to what HookTube (defunct) and Invidious do, except that you do not have to trust a third-party to respect your privacy. The assumption here is that Google won't put the effort in to incorporate the video file requests into their tracking, as it's not worth pursuing the incredibly small number of users who care about privacy (Tor video routing is also provided as an option). Tor has high latency, so this will not be as fast network-wise as regular YouTube. However, using Tor is optional; when not routing through Tor, video pages may load faster than they do with YouTube's page depending on your browser.
[Features](#features) • [Install](#install) • [Usage](#usage) • [Screenshots](#screenshots) The YouTube API is not used, so no keys or anything are needed. It uses the same requests as the YouTube webpage.
---
> [!NOTE]
> How it works: yt-local mirrors YouTube's web requests (using the same Invidious/InnerTube endpoints as yt-dlp and Invidious) but strips JavaScript and serves a lightweight HTML frontend. No API keys needed.
## Overview
yt-local is a lightweight, self-hosted YouTube client written in Python that gives you:
- **Privacy-first**: All requests route through Tor by default (video optional), keeping you anonymous.
- **Fast page loads**: No lazy-loading, no layout reflows, instant comment rendering.
- **Full control**: Customize subtitles, related videos, comments, and playback speed.
- **High quality**: Supports all YouTube video qualities (144p2160p) via DASH muxing.
- **Zero ads**: Clean interface, no tracking, no sponsored content.
- **Self-hosted**: You control the instance—no third-party trust required.
## Features
| Category | Features |
|---------------|----------------------------------------------------------------------------------------|
| Core | Search, channels, playlists, watch pages, comments, subtitles (auto/manual) |
| Privacy | Optional Tor routing (including video), automatic circuit rotation on 429 errors |
| Local | Local playlists (durable against YouTube deletions), thumbnail caching |
| UI | 3 themes (Light/Gray/Dark), theater mode, custom font selection |
| Config | Fine-grained settings: subtitle mode, comment visibility, sponsorblock integration |
| Performance | No JavaScript required, instant page rendering, rate limiting with exponential backoff |
| Subscriptions | Import from YouTube Takeout (CSV/JSON), tag organization, mute channels |
### Advanced Capabilities
- SponsorBlock integration — skip sponsored segments automatically
- Custom video speeds — 0.25x to 4x playback rate
- Video transcripts — accessible via transcript button
- Video quality muxing — combine separate video/audio streams for non-360p/720p resolutions
- Tor circuit rotation — automatic new identity on rate limiting (429)
- File downloading — download videos/audio (disabled by default, configurable)
## Screenshots ## Screenshots
| Light Theme | Gray Theme | Dark Theme | [Light theme](https://pic.infini.fr/l7WINjzS/0Ru6MrhA.png)
|:-----------------------------------------------------:|:----------------------------------------------------:|:----------------------------------------------------:|
| ![Light](https://pic.infini.fr/l7WINjzS/0Ru6MrhA.png) | ![Gray](https://pic.infini.fr/znnQXWNc/hL78CRzo.png) | ![Dark](https://pic.infini.fr/iXwFtTWv/mt2kS5bv.png) |
| Channel View | Playlist View | [Gray theme](https://pic.infini.fr/znnQXWNc/hL78CRzo.png)
|:-------------------------------------------------------:|:---------------------:|
| ![Channel](https://pic.infini.fr/JsenWVYe/SbdIQlS6.png) | *(similar structure)* |
--- [Dark theme](https://pic.infini.fr/iXwFtTWv/mt2kS5bv.png)
## Install [Channel](https://pic.infini.fr/JsenWVYe/SbdIQlS6.png)
## Features
* Standard pages of YouTube: search, channels, playlists
* Anonymity from Google's tracking by routing requests through Tor
* Local playlists: These solve the two problems with creating playlists on YouTube: (1) they're datamined and (2) videos frequently get deleted by YouTube and lost from the playlist, making it very difficult to find a reupload as the title of the deleted video is not displayed.
* Themes: Light, Gray, and Dark
* Subtitles
* Easily download videos or their audio. (Disabled by default)
* No ads
* View comments
* JavaScript not required
* Theater and non-theater mode
* Subscriptions that are independent from YouTube
* Can import subscriptions from YouTube
* Works by checking channels individually
* Can be set to automatically check channels.
* For efficiency of requests, frequency of checking is based on how quickly channel posts videos
* Can mute channels, so as to have a way to "soft" unsubscribe. Muted channels won't be checked automatically or when using the "Check all" button. Videos from these channels will be hidden.
* Can tag subscriptions to organize them or check specific tags
* Fast page
* No distracting/slow layout rearrangement
* No lazy-loading of comments; they are ready instantly.
* Settings allow fine-tuned control over when/how comments or related videos are shown:
1. Shown by default, with click to hide
2. Hidden by default, with click to show
3. Never shown
* Optionally skip sponsored segments using [SponsorBlock](https://github.com/ajayyy/SponsorBlock)'s API
* Custom video speeds
* Video transcript
* Supports all available video qualities: 144p through 2160p
## Planned features
- [ ] Putting videos from subscriptions or local playlists into the related videos
- [x] Information about video (geographic regions, region of Tor exit node, etc)
- [ ] Ability to delete playlists
- [ ] Auto-saving of local playlist videos
- [ ] Import youtube playlist into a local playlist
- [ ] Rearrange items of local playlist
- [x] Video qualities other than 360p and 720p by muxing video and audio
- [x] Indicate if comments are disabled
- [x] Indicate how many comments a video has
- [ ] Featured channels page
- [ ] Channel comments
- [x] Video transcript
- [x] Automatic Tor circuit change when blocked
- [x] Support &t parameter
- [ ] Subscriptions: Option to mark what has been watched
- [ ] Subscriptions: Option to filter videos based on keywords in title or description
- [ ] Subscriptions: Delete old entries and thumbnails
- [ ] Support for more sites, such as Vimeo, Dailymotion, LBRY, etc.
## Installing
### Windows ### Windows
1. Download the latest [release ZIP](https://github.com/user234683/yt-local/releases) Download the zip file under the Releases page. Unzip it anywhere you choose.
2. Extract to any folder
3. Run `run.bat` to start
### GNU/Linux / macOS ### GNU+Linux/MacOS
```bash Download the tarball under the Releases page and extract it. `cd` into the directory and run
# 1. Clone or extract the release
git clone https://github.com/user234683/yt-local.git
cd yt-local
# 2. Create and activate virtual environment 1. `cd yt-local`
python3 -m venv venv 2. `virtualenv -p python3 venv`
source venv/bin/activate # or `venv\Scripts\activate` on Windows 3. `source venv/bin/activate`
4. `pip install -r requirements.txt`
5. `python server.py`
# 3. Install dependencies
pip install -r requirements.txt
# 4. Run the server **Note**: If pip isn't installed, first try installing it from your package manager. Make sure you install pip for python 3. For example, the package you need on debian is python3-pip rather than python-pip. If your package manager doesn't provide it, try to install it according to [this answer](https://unix.stackexchange.com/a/182467), but make sure you run `python3 get-pip.py` instead of `python get-pip.py`
python3 server.py
```
> [!TIP]
> If `pip` isn't installed, use your distro's package manager (e.g., `sudo apt install python3-pip` on Debian/Ubuntu).
### Portable Mode
To keep settings and data in the same directory as the app:
```bash
# Create an empty settings.txt in the project root
touch settings.txt
python3 server.py
# Data now stored in ./data/ instead of ~/.yt-local/
```
---
## Usage ## Usage
### Basic Access Firstly, if you wish to run this in portable mode, create the empty file "settings.txt" in the program's main directory. If the file is there, settings and data will be stored in the same directory as the program. Otherwise, settings and data will be stored in `C:\Users\[your username]\.yt-local` on Windows and `~/.yt-local` on GNU+Linux/MacOS.
1. Start the server: To run the program on windows, open `run.bat`. On GNU+Linux/MacOS, run `python3 server.py`.
```bash Access youtube URLs by prefixing them with `http://localhost:9010/`.
python3 server.py For instance, `http://localhost:9010/https://www.youtube.com/watch?v=vBgulDeV2RU`
# Server runs on http://127.0.0.1:9010 (configurable in /settings) You can use an addon such as Redirector ([Firefox](https://addons.mozilla.org/en-US/firefox/addon/redirector/)|[Chrome](https://chrome.google.com/webstore/detail/redirector/ocgpenflpmgnfapjedencafcfakcekcd)) to automatically redirect YouTube URLs to yt-local. I use the include pattern `^(https?://(?:[a-zA-Z0-9_-]*\.)?(?:youtube\.com|youtu\.be|youtube-nocookie\.com)/.*)` and redirect pattern `http://localhost:9010/$1` (Make sure you're using regular expression mode).
```
2. Access YouTube via proxy: If you want embeds on web to also redirect to yt-local, make sure "Iframes" is checked under advanced options in your redirector rule. Check test `http://localhost:9010/youtube.com/embed/vBgulDeV2RU`
```bash yt-local can be added as a search engine in firefox to make searching more convenient. See [here](https://support.mozilla.org/en-US/kb/add-or-remove-search-engine-firefox) for information on firefox search plugins.
http://localhost:9010/https://www.youtube.com/watch?v=vBgulDeV2RU
```
All YouTube URLs must be prefixed with `http://localhost:9010/https://`. ### Using Tor
3. (Optional) Use Redirector to auto-redirect YouTube URLs: In the settings page, set "Route Tor" to "On, except video" (the second option). Be sure to save the settings.
- **Firefox**: [Redirector addon](https://addons.mozilla.org/firefox/addon/redirector/) Ensure Tor is listening for Socks5 connections on port 9150. A simple way to accomplish this is by opening the Tor Browser Bundle and leaving it open. However, you will not be accessing the program (at https://localhost:8080) through the Tor Browser. You will use your regular browser for that. Rather, this is just a quick way to give the program access to Tor routing.
- **Chrome**: [Redirector addon](https://chrome.google.com/webstore/detail/redirector/ocgpenflpmgnfapjedencafcfakcekcd)
- **Pattern**: `^(https?://(?:[a-zA-Z0-9_-]*\.)?(?:youtube\.com|youtu\.be|youtube-nocookie\.com)/.*)`
- **Redirect to**: `http://localhost:9010/$1`
> [!NOTE] ### Standalone Tor
> To use embeds on web pages, make sure "Iframes" is checked under advanced options in your redirector rule.
### Tor Routing If you don't want to waste system resources leaving the Tor Browser open in addition to your regular browser, you can configure standalone Tor to run instead using the following instructions.
> [!IMPORTANT] For Windows, to make standalone Tor run at startup, press Windows Key + R and type `shell:startup` to open the Startup folder. Create a new shortcut there. For the command of the shortcut, enter `"C:\[path-to-Tor-Browser-directory]\Tor\tor.exe" SOCKSPort 9150 ControlPort 9151`. You can then launch this shortcut to start it. Alternatively, if something isn't working, to see what's wrong, open `cmd.exe` and go to the directory `C:\[path-to-Tor-Browser-directory]\Tor`. Then run `tor SOCKSPort 9150 ControlPort 9151 | more`. The `more` part at the end is just to make sure any errors are displayed, to fix a bug in Windows cmd where tor doesn't display any output. You can stop tor in the task manager.
> Recommended for privacy. In `/settings`, set **Route Tor** to `"On, except video"` (or `"On, including video"`), then save.
#### Running Tor For Debian/Ubuntu, you can `sudo apt install tor` to install the command line version of Tor, and then run `sudo systemctl start tor` to run it as a background service that will get started during boot as well. However, Tor on the command line uses the port `9050` by default (rather than the 9150 used by the Tor Browser). So you will need to change `Tor port` to 9050 and `Tor control port` to `9051` in yt-local settings page. Additionally, you will need to enable the Tor control port by uncommenting the line `ControlPort 9051`, and setting `CookieAuthentication` to 0 in `/etc/tor/torrc`. If no Tor package is available for your distro, you can configure the `tor` binary located at `./Browser/TorBrowser/Tor/tor` inside the Tor Browser installation location to run at start time, or create a service to do it.
Option A: Tor Browser (easiest) ### Tor video routing
- Launch Tor Browser and leave it running If you wish to route the video through Tor, set "Route Tor" to "On, including video". Because this is bandwidth-intensive, you are strongly encouraged to donate to the [consortium of Tor node operators](https://torservers.net/donate.html). For instance, donations to [NoiseTor](https://noisetor.net/) go straight towards funding nodes. Using their numbers for bandwidth costs, together with an average of 485 kbit/sec for a diverse sample of videos, and assuming n hours of video watched per day, gives $0.03n/month. A $1/month donation will be a very generous amount to not only offset losses, but help keep the network healthy.
- yt-local uses port `9150` (Tor Browser default)
Option B: Standalone Tor In general, Tor video routing will be slower (for instance, moving around in the video is quite slow). I've never seen any signs that watch history in yt-local affects on-site Youtube recommendations. It's likely that requests to googlevideo are logged for some period of time, but are not integrated into Youtube's larger advertisement/recommendation systems, since those presumably depend more heavily on in-page tracking through Javascript rather than CDN requests to googlevideo.
```bash ### Importing subscriptions
# Linux (Debian/Ubuntu)
sudo apt install tor
sudo systemctl enable --now tor
# Configure yt-local ports (if using default Tor ports): 1. Go to the [Google takeout manager](https://takeout.google.com/takeout/custom/youtube).
# Tor port: 9150 2. Log in if asked.
# Tor control port: 9151 3. Click on "All data included", then on "Deselect all", then select only "subscriptions" and click "OK".
``` 4. Click on "Next step" and then on "Create export".
5. Click on the "Download" button after it appears.
> [!WARNING] 6. From the downloaded takeout zip extract the .csv file. It is usually located under `YouTube and YouTube Music/subscriptions/subscriptions.csv`
> Video over Tor is bandwidth-intensive. Consider donating to [Tor node operators](https://torservers.net/donate.html) to sustain the network. 7. Go to the subscriptions manager in yt-local. In the import area, select your .csv file, then press import.
### Import Subscriptions
1. Go to [Google Takeout](https://takeout.google.com/takeout/custom/youtube)
2. Deselect all → select only **Subscriptions** → create export
3. Download and extract `subscriptions.csv` (path: `YouTube and YouTube Music/subscriptions/subscriptions.csv`)
4. In yt-local: **Subscriptions****Import** → upload CSV
> [!IMPORTANT]
> The CSV file must contain columns: `channel_id,channel_name,channel_url`
## Supported formats
Supported subscriptions import formats:
- NewPipe subscriptions export JSON
- Google Takeout CSV - Google Takeout CSV
- Google Takeout JSON (legacy) - Old Google Takeout JSON
- NewPipe JSON export - OPML format from now-removed YouTube subscriptions manager
- OPML (from YouTube's old subscription manager)
--- ## Contributing
## Configuration Pull requests and issues are welcome
Visit `http://localhost:9010/settings` to configure: For coding guidelines and an overview of the software architecture, see the [HACKING.md](docs/HACKING.md) file.
| Setting | Description | ## GPG public KEY
|--------------------|-------------------------------------------------|
| Route Tor | Off / On (except video) / On (including video) |
| Default subtitles | Off / Manual only / Auto + Manual |
| Comments mode | Shown by default / Hidden by default / Never |
| Related videos | Same options as comments |
| Theme | Light / Gray / Dark |
| Font | Browser default / Serif / Sans-serif |
| Default resolution | Auto / 144p2160p |
| SponsorBlock | Enable Sponsored segments skipping |
| Proxy images | Route thumbnails through yt-local (for privacy) |
---
## Troubleshooting
| Issue | Solution |
|------------------------------|----------------------------------------------------------------------------------------------|
| Port already in use | Change `port_number` in `/settings` or kill existing process: `pkill -f "python3 server.py"` |
| 429 Too Many Requests | Enable Tor routing for automatic IP rotation, or wait 5-10 minutes |
| Failed to connect to Tor | Verify Tor is running: `tor --version` or launch Tor Browser |
| Subscriptions not importing | Ensure CSV has columns: `channel_id,channel_name,channel_url` |
| Settings persist across runs | Check `~/.yt-local/settings.txt` (non-portable) or `./settings.txt` (portable) |
---
## Development
### Running Tests
```bash ```bash
source venv/bin/activate # if not already in venv 72CFB264DFC43F63E098F926E607CE7149F4D71C
make test
``` ```
### Project Structure ## Public instances
```bash yt-local is not made to work in public mode, however there is an instance of yt-local in public mode but with less features
yt-local/
├── youtube/ # Core application logic
│ ├── __init__.py # Flask app entry point
│ ├── util.py # HTTP utilities, Tor manager, fetch_url
│ ├── watch.py # Video/playlist page handlers
│ ├── channel.py # Channel page handlers
│ ├── playlist.py # Playlist handlers
│ ├── search.py # Search handlers
│ ├── comments.py # Comment extraction/rendering
│ ├── subscriptions.py # Subscription management + SQLite
│ ├── local_playlist.py # Local playlist CRUD
│ ├── proto.py # YouTube protobuf token generation
│ ├── yt_data_extract/ # Polymer JSON parsing abstractions
│ └── hls_cache.py # HLS audio/video streaming proxy
├── templates/ # Jinja2 HTML templates
├── static/ # CSS/JS assets
├── translations/ # i18n files (Babel)
├── tests/ # pytest test suite
├── server.py # WSGI entry point
├── settings.py # Settings parser + admin page
├── generate_release.py # Windows release builder
└── manage_translations.py # i18n maintenance script
```
> [!NOTE] - <https://m.fridu.us/https://youtube.com>
> For detailed architecture guidance, see [`docs/HACKING.md`](docs/HACKING.md).
### Contributing
Contributions welcome! Please:
1. Read [`docs/HACKING.md`](docs/HACKING.md) for coding guidelines
2. Follow [PEP 8](https://peps.python.org/pep-0008/) style (use `ruff format`)
3. Run tests before submitting: `pytest`
4. Ensure no security issues: `bandit -r .`
5. Update docs for new features
---
## Security Notes
- **No API keys required** — uses same endpoints as public YouTube web interface
- **Tor is optional** — disable in `/settings` if you prefer performance over anonymity
- **Rate limiting handled** — exponential backoff (max 5 retries) with automatic Tor circuit rotation
- **Path traversal protected** — user input validated against regex whitelists (CWE-22)
- **Subprocess calls secure** — build scripts use `subprocess.run([...])` instead of shell (CWE-78)
> [!NOTE]
> GPG key for release verification: `72CFB264DFC43F63E098F926E607CE7149F4D71C`
---
## Public Instances
yt-local is designed for self-hosting.
---
## Donate
This project is 100% free and open-source. If you'd like to support development:
- **Bitcoin**: `1JrC3iqs3PP5Ge1m1vu7WE8LEf4S85eo7y`
- **Tor node donation**: https://torservers.net/donate
---
## License ## License
GNU Affero General Public License v3.0+ This project is licensed under the GNU Affero General Public License v3 (GNU AGPLv3) or any later version.
See [`LICENSE`](LICENSE) for full text. Permission is hereby granted to the youtube-dl project at [https://github.com/ytdl-org/youtube-dl](https://github.com/ytdl-org/youtube-dl) to relicense any portion of this software under the Unlicense, public domain, or whichever license is in use by youtube-dl at the time of relicensing, for the purpose of inclusion of said portion into youtube-dl. Relicensing permission is not granted for any purpose outside of direct inclusion into the [official repository](https://github.com/ytdl-org/youtube-dl) of youtube-dl. If inclusion happens during the process of a pull-request, relicensing happens at the moment the pull request is merged into youtube-dl; until that moment, any cloned repositories of youtube-dl which make use of this software are subject to the terms of the GNU AGPLv3.
### Exception for youtube-dl ## Donate
This project is completely free/Libre and will always be.
Permission is granted to relicense code portions into youtube-dl's license (currently GPL) for direct inclusion into the [official youtube-dl repository](https://github.com/ytdl-org/youtube-dl). This exception **does not apply** to forks or other uses—those remain under AGPLv3. #### Crypto:
- **Bitcoin**: `1JrC3iqs3PP5Ge1m1vu7WE8LEf4S85eo7y`
--- ## Similar projects
- [invidious](https://github.com/iv-org/invidious) Similar to this project, but also allows it to be hosted as a server to serve many users
## Similar Projects - [Yotter](https://github.com/ytorg/Yotter) Similar to this project and to invidious. Also supports Twitter
- [FreeTube](https://github.com/FreeTubeApp/FreeTube) (Similar to this project, but is an electron app outside the browser)
| Project | Type | Notes | - [youtube-local](https://github.com/user234683/youtube-local) first project on which yt-local is based
|--------------------------------------------------------------|----------|--------------------------------------| - [NewPipe](https://newpipe.schabi.org/) (app for android)
| [invidious](https://github.com/iv-org/invidious) | Server | Multi-user instance, REST API | - [mps-youtube](https://github.com/mps-youtube/mps-youtube) (terminal-only program)
| [Yotter](https://github.com/ytorg/Yotter) | Server | YouTube + Twitter integration | - [youtube-viewer](https://github.com/trizen/youtube-viewer)
| [FreeTube](https://github.com/FreeTubeApp/FreeTube) | Desktop | Electron-based client | - [smtube](https://www.smtube.org/)
| [NewPipe](https://newpipe.schabi.org/) | Mobile | Android-only, no JavaScript | - [Minitube](https://flavio.tordini.org/minitube), [github here](https://github.com/flaviotordini/minitube)
| [mps-youtube](https://github.com/mps-youtube/mps-youtube) | Terminal | CLI-based, text UI | - [toogles](https://github.com/mikecrittenden/toogles) (only embeds videos, doesn't use mp4)
| [youtube-local](https://github.com/user234683/youtube-local) | Browser | Original project (base for yt-local) | - [YTLibre](https://git.sr.ht/~heckyel/ytlibre) only extract video
- [youtube-dl](https://rg3.github.io/youtube-dl/), which this project was based off
---
Made for privacy-conscious users
Last updated: 2026-04-19

View File

@@ -1,108 +1,76 @@
# Basic init yt-local for openrc ## Basic init yt-local for openrc
## Prerequisites 1. Write `/etc/init.d/ytlocal` file.
- System with OpenRC installed and configured. ```
- Administrative privileges (doas or sudo). #!/sbin/openrc-run
- `ytlocal` script located at `/usr/sbin/ytlocal` and application files in an accessible directory. # Distributed under the terms of the GNU General Public License v3 or later
name="yt-local"
pidfile="/var/run/ytlocal.pid"
command="/usr/sbin/ytlocal"
## Service Installation depend() {
use net
}
1. **Create the OpenRC service script** `/etc/init.d/ytlocal`: start_pre() {
if [ ! -f /usr/sbin/ytlocal ] ; then
eerror "Please create script file of ytlocal in '/usr/sbin/ytlocal'"
return 1
else
return 0
fi
}
```sh start() {
#!/sbin/openrc-run ebegin "Starting yt-local"
# Distributed under the terms of the GNU General Public License v3 or later start-stop-daemon --start --exec "${command}" --pidfile "${pidfile}"
name="yt-local" eend $?
pidfile="/var/run/ytlocal.pid" }
command="/usr/sbin/ytlocal"
depend() { reload() {
use net ebegin "Reloading ${name}"
} start-stop-daemon --signal HUP --pidfile "${pidfile}"
eend $?
}
start_pre() { stop() {
if [ ! -f /usr/sbin/ytlocal ]; then ebegin "Stopping ${name}"
eerror "Please create script file of ytlocal in '/usr/sbin/ytlocal'" start-stop-daemon --quiet --stop --exec "${command}" --pidfile "${pidfile}"
return 1 eend $?
else }
return 0 ```
fi
}
start() { after, modified execute permissions:
ebegin "Starting yt-local"
start-stop-daemon --start --exec "${command}" --pidfile "${pidfile}"
eend $?
}
reload() { $ doas chmod a+x /etc/init.d/ytlocal
ebegin "Reloading ${name}"
start-stop-daemon --signal HUP --pidfile "${pidfile}"
eend $?
}
stop() {
ebegin "Stopping ${name}"
start-stop-daemon --quiet --stop --exec "${command}" --pidfile "${pidfile}"
eend $?
}
```
> [!NOTE] 2. Write `/usr/sbin/ytlocal` and configure path.
> Ensure the script is executable:
>
> ```sh
> doas chmod a+x /etc/init.d/ytlocal
> ```
2. **Create the executable script** `/usr/sbin/ytlocal`: ```
#!/usr/bin/env bash
```bash cd /home/your-path/ytlocal/ # change me
#!/usr/bin/env bash source venv/bin/activate
python server.py > /dev/null 2>&1 &
echo $! > /var/run/ytlocal.pid
```
# Change the working directory according to your installation path after, modified execute permissions:
# Example: if installed in /usr/local/ytlocal, use:
cd /home/your-path/ytlocal/ # <-- MODIFY TO YOUR PATH
source venv/bin/activate
python server.py > /dev/null 2>&1 &
echo $! > /var/run/ytlocal.pid
```
> [!WARNING] $ doas chmod a+x /usr/sbin/ytlocal
> Run this script only as root or via `doas`, as it writes to `/var/run` and uses network privileges.
> [!TIP]
> To store the PID in a different location, adjust the `pidfile` variable in the service script.
> [!IMPORTANT] 3. OpenRC check
> Verify that the virtual environment (`venv`) is correctly set up and that `python` points to the appropriate version.
> [!CAUTION] - status: `doas rc-service ytlocal status`
> Do not stop the process manually; use OpenRC commands (`rc-service ytlocal stop`) to avoid race conditions. - start: `doas rc-service ytlocal start`
- restart: `doas rc-service ytlocal restart`
- stop: `doas rc-service ytlocal stop`
> [!NOTE] - enable: `doas rc-update add ytlocal default`
> When run with administrative privileges, the configuration is saved in `/root/.yt-local`, which is rootonly. - disable: `doas rc-update del ytlocal`
## Service Management When yt-local is run with administrator privileges,
the configuration file is stored in /root/.yt-local
- **Status**: `doas rc-service ytlocal status`
- **Start**: `doas rc-service ytlocal start`
- **Restart**: `doas rc-service ytlocal restart`
- **Stop**: `doas rc-service ytlocal stop`
- **Enable at boot**: `doas rc-update add ytlocal default`
- **Disable**: `doas rc-update del ytlocal`
## PostInstallation Verification
- Confirm the process is running: `doas rc-service ytlocal status`
- Inspect logs for issues: `doas tail -f /var/log/ytlocal.log` (if logging is configured).
## Troubleshooting Common Issues
- **Service fails to start**: verify script permissions, correct `command=` path, and that the virtualenv exists.
- **Port conflict**: adjust the servers port configuration before launching.
- **Import errors**: ensure all dependencies are installed in the virtual environment.
[!IMPORTANT]
Keep the service script updated when modifying startup logic or adding new dependencies.

View File

@@ -44,10 +44,6 @@ def remove_files_with_extensions(path, extensions):
def download_if_not_exists(file_name, url, sha256=None): def download_if_not_exists(file_name, url, sha256=None):
if not os.path.exists('./' + file_name): if not os.path.exists('./' + file_name):
# Reject non-https URLs so a mistaken constant cannot cause a
# plaintext download (bandit B310 hardening).
if not url.startswith('https://'):
raise Exception('Refusing to download over non-https URL: ' + url)
log('Downloading ' + file_name + '..') log('Downloading ' + file_name + '..')
data = urllib.request.urlopen(url).read() data = urllib.request.urlopen(url).read()
log('Finished downloading ' + file_name) log('Finished downloading ' + file_name)
@@ -62,14 +58,12 @@ def download_if_not_exists(file_name, url, sha256=None):
log('Using existing ' + file_name) log('Using existing ' + file_name)
def wine_run_shell(command): def wine_run_shell(command):
# Keep argv-style invocation (no shell) to avoid command injection.
if os.name == 'posix': if os.name == 'posix':
parts = ['wine'] + command.replace('\\', '/').split() check(os.system('wine ' + command.replace('\\', '/')))
elif os.name == 'nt': elif os.name == 'nt':
parts = command.split() check(os.system(command))
else: else:
raise Exception('Unsupported OS') raise Exception('Unsupported OS')
check(subprocess.run(parts).returncode)
def wine_run(command_parts): def wine_run(command_parts):
if os.name == 'posix': if os.name == 'posix':
@@ -98,20 +92,7 @@ if os.path.exists('./yt-local'):
# confused with working directory. I'm calling it the same thing so it will # confused with working directory. I'm calling it the same thing so it will
# have that name when extracted from the final release zip archive) # have that name when extracted from the final release zip archive)
log('Making copy of yt-local files') log('Making copy of yt-local files')
# Avoid the shell: pipe `git archive` into 7z directly via subprocess. check(os.system('git archive --format tar master | 7z x -si -ttar -oyt-local'))
_git_archive = subprocess.Popen(
['git', 'archive', '--format', 'tar', 'master'],
stdout=subprocess.PIPE,
)
_sevenz = subprocess.Popen(
['7z', 'x', '-si', '-ttar', '-oyt-local'],
stdin=_git_archive.stdout,
)
_git_archive.stdout.close()
_sevenz.wait()
_git_archive.wait()
check(_sevenz.returncode)
check(_git_archive.returncode)
if len(os.listdir('./yt-local')) == 0: if len(os.listdir('./yt-local')) == 0:
raise Exception('Failed to copy yt-local files') raise Exception('Failed to copy yt-local files')
@@ -155,7 +136,7 @@ if os.path.exists('./python'):
log('Extracting python distribution') log('Extracting python distribution')
check_subp(subprocess.run(['7z', '-y', 'x', '-opython', python_dist_name])) check(os.system(r'7z -y x -opython ' + python_dist_name))
log('Executing get-pip.py') log('Executing get-pip.py')
wine_run(['./python/python.exe', '-I', 'get-pip.py']) wine_run(['./python/python.exe', '-I', 'get-pip.py'])
@@ -260,7 +241,7 @@ if os.path.exists('./' + output_filename):
log('Removing previous zipped release') log('Removing previous zipped release')
os.remove('./' + output_filename) os.remove('./' + output_filename)
log('Zipping release') log('Zipping release')
check_subp(subprocess.run(['7z', '-mx=9', 'a', output_filename, './yt-local'])) check(os.system(r'7z -mx=9 a ' + output_filename + ' ./yt-local'))
print('\n') print('\n')
log('Finished') log('Finished')

View File

@@ -1,28 +1,22 @@
#!/usr/bin/env python3 #!/usr/bin/env python3
# E402 is deliberately ignored in this file: `monkey.patch_all()` must run
# before any stdlib networking or gevent-dependent modules are imported.
from gevent import monkey from gevent import monkey
monkey.patch_all() monkey.patch_all()
import gevent.socket
from youtube import yt_app from youtube import yt_app
from youtube import util from youtube import util
# these are just so the files get run - they import yt_app and add routes to it # these are just so the files get run - they import yt_app and add routes to it
from youtube import ( from youtube import watch, search, playlist, channel, local_playlist, comments, subscriptions
watch,
search,
playlist,
channel,
local_playlist,
comments,
subscriptions,
)
import settings import settings
from gevent.pywsgi import WSGIServer from gevent.pywsgi import WSGIServer
import urllib import urllib
import urllib3 import urllib3
import socket
import socks, sockshandler
import subprocess
import re import re
import sys import sys
import time import time
@@ -61,6 +55,8 @@ def proxy_site(env, start_response, video=False):
'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64)', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64)',
'Accept': '*/*', 'Accept': '*/*',
} }
current_range_start = 0
range_end = None
if 'HTTP_RANGE' in env: if 'HTTP_RANGE' in env:
send_headers['Range'] = env['HTTP_RANGE'] send_headers['Range'] = env['HTTP_RANGE']
@@ -278,8 +274,6 @@ class FilteredRequestLog:
if __name__ == '__main__': if __name__ == '__main__':
if settings.allow_foreign_addresses: if settings.allow_foreign_addresses:
# Binding to all interfaces is opt-in via the
# `allow_foreign_addresses` setting and documented as discouraged.
server = WSGIServer(('0.0.0.0', settings.port_number), site_dispatch, server = WSGIServer(('0.0.0.0', settings.port_number), site_dispatch,
log=FilteredRequestLog()) log=FilteredRequestLog())
ip_server = '0.0.0.0' ip_server = '0.0.0.0'

View File

@@ -261,20 +261,10 @@ For security reasons, enabling this is not recommended.''',
'category': 'interface', 'category': 'interface',
}), }),
('native_player_storyboard', {
'type': bool,
'default': False,
'label': 'Storyboard preview (native)',
'comment': '''Show thumbnail preview on hover (native player modes).
Positioning is heuristic; may misalign in Firefox/Safari.
Works best on Chromium browsers.
No effect in Plyr.''',
'category': 'interface',
}),
('use_video_download', { ('use_video_download', {
'type': int, 'type': int,
'default': 0, 'default': 0,
'comment': '',
'options': [ 'options': [
(0, 'Disabled'), (0, 'Disabled'),
(1, 'Enabled'), (1, 'Enabled'),
@@ -481,7 +471,7 @@ upgrade_functions = {
def log_ignored_line(line_number, message): def log_ignored_line(line_number, message):
print('WARNING: Ignoring settings.txt line ' + str(line_number) + ' (' + message + ')') print("WARNING: Ignoring settings.txt line " + str(node.lineno) + " (" + message + ")")
if os.path.isfile("settings.txt"): if os.path.isfile("settings.txt"):
@@ -521,17 +511,17 @@ else:
pass # Removed in Python 3.12+ pass # Removed in Python 3.12+
module_node = ast.parse(settings_text) module_node = ast.parse(settings_text)
for node in module_node.body: for node in module_node.body:
if not isinstance(node, ast.Assign): if type(node) != ast.Assign:
log_ignored_line(node.lineno, 'only assignments are allowed') log_ignored_line(node.lineno, "only assignments are allowed")
continue continue
if len(node.targets) > 1: if len(node.targets) > 1:
log_ignored_line(node.lineno, 'only simple single-variable assignments allowed') log_ignored_line(node.lineno, "only simple single-variable assignments allowed")
continue continue
target = node.targets[0] target = node.targets[0]
if not isinstance(target, ast.Name): if type(target) != ast.Name:
log_ignored_line(node.lineno, 'only simple single-variable assignments allowed') log_ignored_line(node.lineno, "only simple single-variable assignments allowed")
continue continue
if target.id not in acceptable_targets: if target.id not in acceptable_targets:

View File

@@ -11,7 +11,8 @@ import pytest
sys.path.insert(0, os.path.join(os.path.dirname(__file__), '..')) sys.path.insert(0, os.path.join(os.path.dirname(__file__), '..'))
import youtube.proto as proto import youtube.proto as proto
from youtube.yt_data_extract.common import ( from youtube.yt_data_extract.common import (
extract_item_info, extract_items, extract_item_info, extract_items, extract_shorts_lockup_view_model_info,
extract_approx_int,
) )

View File

@@ -39,8 +39,7 @@ class NewIdentityState():
self.new_identities_till_success -= 1 self.new_identities_till_success -= 1
def fetch_url_response(self, *args, **kwargs): def fetch_url_response(self, *args, **kwargs):
def cleanup_func(response): cleanup_func = (lambda r: None)
return None
if self.new_identities_till_success == 0: if self.new_identities_till_success == 0:
return MockResponse(), cleanup_func return MockResponse(), cleanup_func
return MockResponse(body=html429, status=429), cleanup_func return MockResponse(body=html429, status=429), cleanup_func

View File

@@ -1,17 +1,14 @@
import logging
import os
import re
import traceback
from sys import exc_info
import flask
import jinja2
from flask import request
from flask_babel import Babel
from youtube import util from youtube import util
from .get_app_version import app_version from .get_app_version import app_version
import flask
from flask import request
import jinja2
import settings import settings
import traceback
import logging
import re
from sys import exc_info
from flask_babel import Babel
yt_app = flask.Flask(__name__) yt_app = flask.Flask(__name__)
yt_app.config['TEMPLATES_AUTO_RELOAD'] = True yt_app.config['TEMPLATES_AUTO_RELOAD'] = True
@@ -29,6 +26,7 @@ yt_app.logger.addFilter(FetchErrorFilter())
# yt_app.jinja_env.lstrip_blocks = True # yt_app.jinja_env.lstrip_blocks = True
# Configure Babel for i18n # Configure Babel for i18n
import os
yt_app.config['BABEL_DEFAULT_LOCALE'] = 'en' yt_app.config['BABEL_DEFAULT_LOCALE'] = 'en'
# Use absolute path for translations directory to avoid issues with package structure changes # Use absolute path for translations directory to avoid issues with package structure changes
_app_root = os.path.dirname(os.path.dirname(os.path.abspath(__file__))) _app_root = os.path.dirname(os.path.dirname(os.path.abspath(__file__)))

View File

@@ -6,7 +6,9 @@ import settings
import urllib import urllib
import json import json
from string import Template
import youtube.proto as proto import youtube.proto as proto
import html
import math import math
import gevent import gevent
import re import re
@@ -291,7 +293,7 @@ def get_number_of_videos_channel(channel_id):
try: try:
response = util.fetch_url(url, headers_mobile, response = util.fetch_url(url, headers_mobile,
debug_name='number_of_videos', report_text='Got number of videos') debug_name='number_of_videos', report_text='Got number of videos')
except (urllib.error.HTTPError, util.FetchError): except (urllib.error.HTTPError, util.FetchError) as e:
traceback.print_exc() traceback.print_exc()
print("Couldn't retrieve number of videos") print("Couldn't retrieve number of videos")
return 1000 return 1000

View File

@@ -155,35 +155,33 @@ def post_process_comments_info(comments_info):
def video_comments(video_id, sort=0, offset=0, lc='', secret_key=''): def video_comments(video_id, sort=0, offset=0, lc='', secret_key=''):
if not settings.comments_mode:
return {}
# Initialize the result dict up-front so that any exception path below
# can safely attach an 'error' field without risking UnboundLocalError.
comments_info = {'error': None}
try: try:
other_sort_url = ( if settings.comments_mode:
util.URL_ORIGIN + '/comments?ctoken=' comments_info = {'error': None}
+ make_comment_ctoken(video_id, sort=1 - sort, lc=lc) other_sort_url = (
) util.URL_ORIGIN + '/comments?ctoken='
other_sort_text = 'Sort by ' + ('newest' if sort == 0 else 'top') + make_comment_ctoken(video_id, sort=1 - sort, lc=lc)
)
other_sort_text = 'Sort by ' + ('newest' if sort == 0 else 'top')
this_sort_url = (util.URL_ORIGIN this_sort_url = (util.URL_ORIGIN
+ '/comments?ctoken=' + '/comments?ctoken='
+ make_comment_ctoken(video_id, sort=sort, lc=lc)) + make_comment_ctoken(video_id, sort=sort, lc=lc))
comments_info['comment_links'] = [ comments_info['comment_links'] = [
(other_sort_text, other_sort_url), (other_sort_text, other_sort_url),
('Direct link', this_sort_url) ('Direct link', this_sort_url)
] ]
ctoken = make_comment_ctoken(video_id, sort, offset, lc) ctoken = make_comment_ctoken(video_id, sort, offset, lc)
comments_info.update(yt_data_extract.extract_comments_info( comments_info.update(yt_data_extract.extract_comments_info(
request_comments(ctoken), ctoken=ctoken request_comments(ctoken), ctoken=ctoken
)) ))
post_process_comments_info(comments_info) post_process_comments_info(comments_info)
return comments_info return comments_info
else:
return {}
except util.FetchError as e: except util.FetchError as e:
if e.code == '429' and settings.route_tor: if e.code == '429' and settings.route_tor:
comments_info['error'] = 'Error: YouTube blocked the request because the Tor exit node is overutilized.' comments_info['error'] = 'Error: YouTube blocked the request because the Tor exit node is overutilized.'

View File

@@ -1,3 +1 @@
from .get_app_version import app_version from .get_app_version import *
__all__ = ['app_version']

View File

@@ -1,9 +1,11 @@
from __future__ import unicode_literals from __future__ import unicode_literals
import os from subprocess import (
import shutil call,
import subprocess STDOUT
)
from ..version import __version__ from ..version import __version__
import os
import subprocess
def app_version(): def app_version():
@@ -11,46 +13,35 @@ def app_version():
# make minimal environment # make minimal environment
env = {k: os.environ[k] for k in ['SYSTEMROOT', 'PATH'] if k in os.environ} env = {k: os.environ[k] for k in ['SYSTEMROOT', 'PATH'] if k in os.environ}
env.update({'LANGUAGE': 'C', 'LANG': 'C', 'LC_ALL': 'C'}) env.update({'LANGUAGE': 'C', 'LANG': 'C', 'LC_ALL': 'C'})
out = subprocess.Popen(cmd, stdout=subprocess.PIPE, env=env).communicate()[0] out = subprocess.Popen(cmd, stdout=subprocess.PIPE, env=env).communicate()[0]
return out return out
subst_list = { subst_list = {
'version': __version__, "version": __version__,
'branch': None, "branch": None,
'commit': None, "commit": None
} }
# Use shutil.which instead of `command -v`/os.system so we don't spawn a if os.system("command -v git > /dev/null 2>&1") != 0:
# shell (CWE-78 hardening) and so it works cross-platform.
if shutil.which('git') is None:
return subst_list return subst_list
try: if call(["git", "branch"], stderr=STDOUT, stdout=open(os.devnull, 'w')) != 0:
# Check we are inside a git work tree. Using DEVNULL avoids the
# file-handle leak from `open(os.devnull, 'w')`.
rc = subprocess.call(
['git', 'branch'],
stderr=subprocess.DEVNULL,
stdout=subprocess.DEVNULL,
)
except OSError:
return subst_list
if rc != 0:
return subst_list return subst_list
describe = minimal_env_cmd(['git', 'describe', '--tags', '--always']) describe = minimal_env_cmd(["git", "describe", "--tags", "--always"])
git_revision = describe.strip().decode('ascii') git_revision = describe.strip().decode('ascii')
branch = minimal_env_cmd(['git', 'branch']) branch = minimal_env_cmd(["git", "branch"])
git_branch = branch.strip().decode('ascii').replace('* ', '') git_branch = branch.strip().decode('ascii').replace('* ', '')
subst_list.update({ subst_list.update({
'branch': git_branch, "branch": git_branch,
'commit': git_revision, "commit": git_revision
}) })
return subst_list return subst_list
if __name__ == '__main__': if __name__ == "__main__":
app_version() app_version()

View File

@@ -1,42 +1,28 @@
from youtube import util from youtube import util, yt_data_extract
from youtube import yt_app from youtube import yt_app
import settings import settings
import os import os
import json import json
import html
import gevent import gevent
import urllib
import math import math
import glob import glob
import re
import flask import flask
from flask import request from flask import request
playlists_directory = os.path.join(settings.data_dir, 'playlists') playlists_directory = os.path.join(settings.data_dir, "playlists")
thumbnails_directory = os.path.join(settings.data_dir, 'playlist_thumbnails') thumbnails_directory = os.path.join(settings.data_dir, "playlist_thumbnails")
# Whitelist accepted playlist names so user input cannot escape
# `playlists_directory` / `thumbnails_directory` (CWE-22, OWASP A01:2021).
# Allow letters, digits, spaces, dot, dash and underscore.
_PLAYLIST_NAME_RE = re.compile(r'^[\w .\-]{1,128}$')
def _validate_playlist_name(name):
'''Return the stripped name if safe, otherwise abort with 400.'''
if name is None:
flask.abort(400)
name = name.strip()
if not _PLAYLIST_NAME_RE.match(name):
flask.abort(400)
return name
def _find_playlist_path(name): def _find_playlist_path(name):
'''Find playlist file robustly, handling trailing spaces in filenames''' """Find playlist file robustly, handling trailing spaces in filenames"""
name = _validate_playlist_name(name) name = name.strip()
pattern = os.path.join(playlists_directory, name + '*.txt') pattern = os.path.join(playlists_directory, name + "*.txt")
files = glob.glob(pattern) files = glob.glob(pattern)
return files[0] if files else os.path.join(playlists_directory, name + '.txt') return files[0] if files else os.path.join(playlists_directory, name + ".txt")
def _parse_playlist_lines(data): def _parse_playlist_lines(data):
@@ -193,9 +179,8 @@ def path_edit_playlist(playlist_name):
redirect_page_number = min(int(request.values.get('page', 1)), math.ceil(number_of_videos_remaining/50)) redirect_page_number = min(int(request.values.get('page', 1)), math.ceil(number_of_videos_remaining/50))
return flask.redirect(util.URL_ORIGIN + request.path + '?page=' + str(redirect_page_number)) return flask.redirect(util.URL_ORIGIN + request.path + '?page=' + str(redirect_page_number))
elif request.values['action'] == 'remove_playlist': elif request.values['action'] == 'remove_playlist':
safe_name = _validate_playlist_name(playlist_name)
try: try:
os.remove(os.path.join(playlists_directory, safe_name + '.txt')) os.remove(os.path.join(playlists_directory, playlist_name + ".txt"))
except OSError: except OSError:
pass pass
return flask.redirect(util.URL_ORIGIN + '/playlists') return flask.redirect(util.URL_ORIGIN + '/playlists')
@@ -235,17 +220,8 @@ def edit_playlist():
flask.abort(400) flask.abort(400)
_THUMBNAIL_RE = re.compile(r'^[A-Za-z0-9_-]{11}\.jpg$')
@yt_app.route('/data/playlist_thumbnails/<playlist_name>/<thumbnail>') @yt_app.route('/data/playlist_thumbnails/<playlist_name>/<thumbnail>')
def serve_thumbnail(playlist_name, thumbnail): def serve_thumbnail(playlist_name, thumbnail):
# Validate both path components so a crafted URL cannot escape # .. is necessary because flask always uses the application directory at ./youtube, not the working directory
# `thumbnails_directory` via `..` or NUL tricks (CWE-22).
safe_name = _validate_playlist_name(playlist_name)
if not _THUMBNAIL_RE.match(thumbnail):
flask.abort(400)
# .. is necessary because flask always uses the application directory at
# ./youtube, not the working directory.
return flask.send_from_directory( return flask.send_from_directory(
os.path.join('..', thumbnails_directory, safe_name), thumbnail) os.path.join('..', thumbnails_directory, playlist_name), thumbnail)

View File

@@ -3,7 +3,9 @@ from youtube import yt_app
import settings import settings
import base64 import base64
import urllib
import json import json
import string
import gevent import gevent
import math import math
from flask import request, abort from flask import request, abort

View File

@@ -5,6 +5,7 @@ import settings
import json import json
import urllib import urllib
import base64 import base64
import mimetypes
from flask import request from flask import request
import flask import flask
import os import os

View File

@@ -9,8 +9,6 @@
--thumb-background: #222222; --thumb-background: #222222;
--link: #00B0FF; --link: #00B0FF;
--link-visited: #40C4FF; --link-visited: #40C4FF;
--border-color: #333333;
--thead-background: #0a0a0b;
--border-bg: #222222; --border-bg: #222222;
--border-bg-settings: #000000; --border-bg-settings: #000000;
--border-bg-license: #000000; --border-bg-license: #000000;

View File

@@ -9,8 +9,6 @@
--thumb-background: #35404D; --thumb-background: #35404D;
--link: #22AAFF; --link: #22AAFF;
--link-visited: #7755FF; --link-visited: #7755FF;
--border-color: #4A5568;
--thead-background: #1a2530;
--border-bg: #FFFFFF; --border-bg: #FFFFFF;
--border-bg-settings: #FFFFFF; --border-bg-settings: #FFFFFF;
--border-bg-license: #FFFFFF; --border-bg-license: #FFFFFF;

View File

@@ -9,8 +9,6 @@
--thumb-background: #F5F5F5; --thumb-background: #F5F5F5;
--link: #212121; --link: #212121;
--link-visited: #808080; --link-visited: #808080;
--border-color: #CCCCCC;
--thead-background: #d0d0d0;
--border-bg: #212121; --border-bg: #212121;
--border-bg-settings: #91918C; --border-bg-settings: #91918C;
--border-bg-license: #91918C; --border-bg-license: #91918C;

View File

@@ -307,122 +307,18 @@ figure.sc-video {
padding-top: 0.5rem; padding-top: 0.5rem;
padding-bottom: 0.5rem; padding-bottom: 0.5rem;
} }
.v-download { .v-download { grid-area: v-download; }
grid-area: v-download; .v-download > ul.download-dropdown-content {
margin-bottom: 0.5rem; background: var(--secondary-background);
padding-left: 0px;
} }
.v-download details { .v-download > ul.download-dropdown-content > li.download-format {
display: block; list-style: none;
width: 100%;
}
.v-download > summary {
cursor: pointer;
padding: 0.4rem 0; padding: 0.4rem 0;
padding-left: 1rem; padding-left: 1rem;
} }
.v-download > summary.download-dropdown-label { .v-download > ul.download-dropdown-content > li.download-format a.download-link {
cursor: pointer;
-webkit-touch-callout: none;
-webkit-user-select: none;
-khtml-user-select: none;
-moz-user-select: none;
-ms-user-select: none;
user-select: none;
padding-bottom: 6px;
padding-left: .75em;
padding-right: .75em;
padding-top: 6px;
text-align: center;
white-space: nowrap;
background-color: var(--buttom);
border: 1px solid var(--button-border);
color: var(--buttom-text);
border-radius: 5px;
margin-bottom: 0.5rem;
}
.v-download > summary.download-dropdown-label:hover {
background-color: var(--buttom-hover);
}
.v-download > .download-table-container {
background: var(--secondary-background);
max-height: 65vh;
overflow-y: auto;
border: 1px solid var(--button-border);
border-radius: 8px;
box-shadow: 0 4px 12px rgba(0,0,0,0.15);
}
.download-table {
width: 100%;
border-collapse: separate;
border-spacing: 0;
font-size: 0.875rem;
}
.download-table thead {
background: var(--thead-background);
position: sticky;
top: 0;
z-index: 1;
}
.download-table th,
.download-table td {
padding: 0.7rem 0.9rem;
text-align: left;
border-bottom: 1px solid var(--button-border);
}
.download-table th {
font-weight: 600;
font-size: 0.7rem;
text-transform: uppercase;
letter-spacing: 0.8px;
}
.download-table tbody tr {
transition: all 0.2s ease;
}
.download-table tbody tr:hover {
background: var(--primary-background);
}
.download-table a.download-link {
display: inline-block;
padding: 0.4rem 0.85rem;
background: rgba(0,0,0,0.12);
color: var(--buttom-text);
text-decoration: none; text-decoration: none;
border-radius: 5px;
font-weight: 500;
font-size: 0.85rem;
transition: background 0.2s ease;
white-space: nowrap;
}
.download-table a.download-link:hover {
background: rgba(0,0,0,0.28);
color: var(--buttom-text);
}
.download-table tbody tr:last-child td {
border-bottom: none;
}
.download-table td[data-label="Ext"] {
font-family: monospace;
font-size: 0.8rem;
font-weight: 600;
}
.download-table td[data-label="Link"] {
white-space: nowrap;
vertical-align: middle;
}
.download-table td[data-label="Codecs"] {
max-width: 180px;
text-overflow: ellipsis;
overflow: hidden;
font-family: monospace;
font-size: 0.75rem;
}
.download-table td[data-label="Size"] {
font-family: monospace;
font-size: 0.85rem;
}
.download-table td[colspan="3"] {
font-style: italic;
opacity: 0.7;
} }
.v-description { .v-description {

View File

@@ -292,10 +292,7 @@ def youtube_timestamp_to_posix(dumb_timestamp):
def posix_to_dumbed_down(posix_time): def posix_to_dumbed_down(posix_time):
'''Inverse of youtube_timestamp_to_posix.''' '''Inverse of youtube_timestamp_to_posix.'''
delta = int(time.time() - posix_time) delta = int(time.time() - posix_time)
# Guard against future timestamps (clock drift) without relying on assert delta >= 0
# `assert` (which is stripped under `python -O`).
if delta < 0:
delta = 0
if delta == 0: if delta == 0:
return '0 seconds ago' return '0 seconds ago'
@@ -534,8 +531,7 @@ def _get_upstream_videos(channel_id):
return None return None
root = defusedxml.ElementTree.fromstring(feed) root = defusedxml.ElementTree.fromstring(feed)
if remove_bullshit(root.tag) != 'feed': assert remove_bullshit(root.tag) == 'feed'
raise ValueError('Root element is not <feed>')
for entry in root: for entry in root:
if (remove_bullshit(entry.tag) != 'entry'): if (remove_bullshit(entry.tag) != 'entry'):
continue continue
@@ -543,13 +539,13 @@ def _get_upstream_videos(channel_id):
# it's yt:videoId in the xml but the yt: is turned into a namespace which is removed by remove_bullshit # it's yt:videoId in the xml but the yt: is turned into a namespace which is removed by remove_bullshit
video_id_element = find_element(entry, 'videoId') video_id_element = find_element(entry, 'videoId')
time_published_element = find_element(entry, 'published') time_published_element = find_element(entry, 'published')
if video_id_element is None or time_published_element is None: assert video_id_element is not None
raise ValueError('Missing videoId or published element') assert time_published_element is not None
time_published = int(calendar.timegm(time.strptime(time_published_element.text, '%Y-%m-%dT%H:%M:%S+00:00'))) time_published = int(calendar.timegm(time.strptime(time_published_element.text, '%Y-%m-%dT%H:%M:%S+00:00')))
times_published[video_id_element.text] = time_published times_published[video_id_element.text] = time_published
except ValueError: except AssertionError:
print('Failed to read atoma feed for ' + channel_status_name) print('Failed to read atoma feed for ' + channel_status_name)
traceback.print_exc() traceback.print_exc()
except defusedxml.ElementTree.ParseError: except defusedxml.ElementTree.ParseError:
@@ -597,10 +593,7 @@ def _get_upstream_videos(channel_id):
# Special case: none of the videos have a time published. # Special case: none of the videos have a time published.
# In this case, make something up # In this case, make something up
if videos and videos[0]['time_published'] is None: if videos and videos[0]['time_published'] is None:
# Invariant: if the first video has no timestamp, earlier passes assert all(v['time_published'] is None for v in videos)
# ensure all of them are unset. Don't rely on `assert`.
if not all(v['time_published'] is None for v in videos):
raise RuntimeError('Inconsistent time_published state')
now = time.time() now = time.time()
for i in range(len(videos)): for i in range(len(videos)):
# 1 month between videos # 1 month between videos
@@ -815,8 +808,7 @@ def import_subscriptions():
file = file.read().decode('utf-8') file = file.read().decode('utf-8')
try: try:
root = defusedxml.ElementTree.fromstring(file) root = defusedxml.ElementTree.fromstring(file)
if root.tag != 'opml': assert root.tag == 'opml'
raise ValueError('Root element is not <opml>')
channels = [] channels = []
for outline_element in root[0][0]: for outline_element in root[0][0]:
if (outline_element.tag != 'outline') or ('xmlUrl' not in outline_element.attrib): if (outline_element.tag != 'outline') or ('xmlUrl' not in outline_element.attrib):
@@ -827,7 +819,7 @@ def import_subscriptions():
channel_id = channel_rss_url[channel_rss_url.find('channel_id=')+11:].strip() channel_id = channel_rss_url[channel_rss_url.find('channel_id=')+11:].strip()
channels.append((channel_id, channel_name)) channels.append((channel_id, channel_name))
except (ValueError, IndexError, defusedxml.ElementTree.ParseError): except (AssertionError, IndexError, defusedxml.ElementTree.ParseError) as e:
return '400 Bad Request: Unable to read opml xml file, or the file is not the expected format', 400 return '400 Bad Request: Unable to read opml xml file, or the file is not the expected format', 400
elif mime_type in ('text/csv', 'application/vnd.ms-excel'): elif mime_type in ('text/csv', 'application/vnd.ms-excel'):
content = file.read().decode('utf-8') content = file.read().decode('utf-8')
@@ -1079,20 +1071,11 @@ def post_subscriptions_page():
return '', 204 return '', 204
# YouTube video IDs are exactly 11 chars from [A-Za-z0-9_-]. Enforce this
# before using the value in filesystem paths to prevent path traversal
# (CWE-22, OWASP A01:2021).
_VIDEO_ID_RE = re.compile(r'^[A-Za-z0-9_-]{11}$')
@yt_app.route('/data/subscription_thumbnails/<thumbnail>') @yt_app.route('/data/subscription_thumbnails/<thumbnail>')
def serve_subscription_thumbnail(thumbnail): def serve_subscription_thumbnail(thumbnail):
'''Serves thumbnail from disk if it's been saved already. If not, downloads the thumbnail, saves to disk, and serves it.''' '''Serves thumbnail from disk if it's been saved already. If not, downloads the thumbnail, saves to disk, and serves it.'''
if not thumbnail.endswith('.jpg'): assert thumbnail[-4:] == '.jpg'
flask.abort(400)
video_id = thumbnail[0:-4] video_id = thumbnail[0:-4]
if not _VIDEO_ID_RE.match(video_id):
flask.abort(400)
thumbnail_path = os.path.join(thumbnails_directory, thumbnail) thumbnail_path = os.path.join(thumbnails_directory, thumbnail)
if video_id in existing_thumbnails: if video_id in existing_thumbnails:

View File

@@ -105,10 +105,5 @@
{% if use_dash %} {% if use_dash %}
<script src="/youtube.com/static/js/av-merge.js"></script> <script src="/youtube.com/static/js/av-merge.js"></script>
{% endif %} {% endif %}
<!-- Storyboard Preview Thumbnails (native players only; Plyr handles this internally) -->
{% if settings.use_video_player != 2 and settings.native_player_storyboard %}
<script src="/youtube.com/static/js/storyboard-preview.js"></script>
{% endif %}
</body> </body>
</html> </html>

View File

@@ -102,40 +102,22 @@
{% if settings.use_video_download != 0 %} {% if settings.use_video_download != 0 %}
<details class="v-download"> <details class="v-download">
<summary class="download-dropdown-label">{{ _('Download') }}</summary> <summary class="download-dropdown-label">{{ _('Download') }}</summary>
<div class="download-table-container"> <ul class="download-dropdown-content">
<table class="download-table" aria-label="Download formats"> {% for format in download_formats %}
<thead> <li class="download-format">
<tr> <a class="download-link" href="{{ format['url'] }}" download="{{ title }}.{{ format['ext'] }}">
<th scope="col">{{ _('Ext') }}</th> {{ format['ext'] }} {{ format['video_quality'] }} {{ format['audio_quality'] }} {{ format['file_size'] }} {{ format['codecs'] }}
<th scope="col">{{ _('Video') }}</th> </a>
<th scope="col">{{ _('Audio') }}</th> </li>
<th scope="col">{{ _('Size') }}</th> {% endfor %}
<th scope="col">{{ _('Codecs') }}</th> {% for download in other_downloads %}
<th scope="col">{{ _('Link') }}</th> <li class="download-format">
</tr> <a href="{{ download['url'] }}" download>
</thead> {{ download['ext'] }} {{ download['label'] }}
<tbody> </a>
{% for format in download_formats %} </li>
<tr> {% endfor %}
<td data-label="{{ _('Ext') }}">{{ format['ext'] }}</td> </ul>
<td data-label="{{ _('Video') }}">{{ format['video_quality'] }}</td>
<td data-label="{{ _('Audio') }}">{{ format['audio_quality'] }}</td>
<td data-label="{{ _('Size') }}">{{ format['file_size'] }}</td>
<td data-label="{{ _('Codecs') }}">{{ format['codecs'] }}</td>
<td data-label="{{ _('Link') }}"><a class="download-link" href="{{ format['url'] }}" download="{{ title }}.{{ format['ext'] }}" aria-label="{{ _('Download') }} {{ format['ext'] }} {{ format['video_quality'] }} {{ format['audio_quality'] }}">{{ _('Download') }}</a></td>
</tr>
{% endfor %}
{% for download in other_downloads %}
<tr>
<td data-label="{{ _('Ext') }}">{{ download['ext'] }}</td>
<td data-label="{{ _('Video') }}" colspan="3">{{ download['label'] }}</td>
<td data-label="{{ _('Codecs') }}">{{ download.get('codecs', 'N/A') }}</td>
<td data-label="{{ _('Link') }}"><a class="download-link" href="{{ download['url'] }}" download aria-label="{{ _('Download') }} {{ download['label'] }}">{{ _('Download') }}</a></td>
</tr>
{% endfor %}
</tbody>
</table>
</div>
</details> </details>
{% else %} {% else %}
<span class="v-download"></span> <span class="v-download"></span>
@@ -322,8 +304,8 @@
<!-- /plyr --> <!-- /plyr -->
{% endif %} {% endif %}
<!-- Storyboard Preview Thumbnails (native players only; Plyr handles this internally) --> <!-- Storyboard Preview Thumbnails -->
{% if settings.use_video_player != 2 and settings.native_player_storyboard %} {% if settings.use_video_player != 2 %}
<script src="/youtube.com/static/js/storyboard-preview.js"></script> <script src="/youtube.com/static/js/storyboard-preview.js"></script>
{% endif %} {% endif %}

View File

@@ -1,6 +1,5 @@
from datetime import datetime from datetime import datetime
import logging import logging
import random
import settings import settings
import socks import socks
import sockshandler import sockshandler
@@ -20,10 +19,10 @@ import gevent.queue
import gevent.lock import gevent.lock
import collections import collections
import stem import stem
import stem.control
import traceback
logger = logging.getLogger(__name__) logger = logging.getLogger(__name__)
import stem.control
import traceback
# The trouble with the requests library: It ships its own certificate bundle via certifi # The trouble with the requests library: It ships its own certificate bundle via certifi
# instead of using the system certificate store, meaning self-signed certificates # instead of using the system certificate store, meaning self-signed certificates
@@ -55,8 +54,8 @@ logger = logging.getLogger(__name__)
# https://github.com/kennethreitz/requests/issues/2966 # https://github.com/kennethreitz/requests/issues/2966
# Until then, I will use a mix of urllib3 and urllib. # Until then, I will use a mix of urllib3 and urllib.
import urllib3 # noqa: E402 (imported here intentionally after the long note above) import urllib3
import urllib3.contrib.socks # noqa: E402 import urllib3.contrib.socks
URL_ORIGIN = "/https://www.youtube.com" URL_ORIGIN = "/https://www.youtube.com"
@@ -178,6 +177,7 @@ def get_pool(use_tor):
class HTTPAsymmetricCookieProcessor(urllib.request.BaseHandler): class HTTPAsymmetricCookieProcessor(urllib.request.BaseHandler):
'''Separate cookiejars for receiving and sending''' '''Separate cookiejars for receiving and sending'''
def __init__(self, cookiejar_send=None, cookiejar_receive=None): def __init__(self, cookiejar_send=None, cookiejar_receive=None):
import http.cookiejar
self.cookiejar_send = cookiejar_send self.cookiejar_send = cookiejar_send
self.cookiejar_receive = cookiejar_receive self.cookiejar_receive = cookiejar_receive
@@ -208,16 +208,6 @@ class FetchError(Exception):
self.error_message = error_message self.error_message = error_message
def _noop_cleanup(response):
'''No-op cleanup used when the urllib opener owns the response.'''
return None
def _release_conn_cleanup(response):
'''Release the urllib3 pooled connection back to the pool.'''
response.release_conn()
def decode_content(content, encoding_header): def decode_content(content, encoding_header):
encodings = encoding_header.replace(' ', '').split(',') encodings = encoding_header.replace(' ', '').split(',')
for encoding in reversed(encodings): for encoding in reversed(encodings):
@@ -273,7 +263,7 @@ def fetch_url_response(url, headers=(), timeout=15, data=None,
opener = urllib.request.build_opener(cookie_processor) opener = urllib.request.build_opener(cookie_processor)
response = opener.open(req, timeout=timeout) response = opener.open(req, timeout=timeout)
cleanup_func = _noop_cleanup cleanup_func = (lambda r: None)
else: # Use a urllib3 pool. Cookies can't be used since urllib3 doesn't have easy support for them. else: # Use a urllib3 pool. Cookies can't be used since urllib3 doesn't have easy support for them.
# default: Retry.DEFAULT = Retry(3) # default: Retry.DEFAULT = Retry(3)
@@ -307,7 +297,7 @@ def fetch_url_response(url, headers=(), timeout=15, data=None,
error_message=msg) error_message=msg)
else: else:
raise raise
cleanup_func = _release_conn_cleanup cleanup_func = (lambda r: r.release_conn())
return response, cleanup_func return response, cleanup_func
@@ -325,6 +315,8 @@ def fetch_url(url, headers=(), timeout=15, report_text=None, data=None,
Max retries: 5 attempts with exponential backoff Max retries: 5 attempts with exponential backoff
""" """
import random
max_retries = 5 max_retries = 5
base_delay = 1.0 # Base delay in seconds base_delay = 1.0 # Base delay in seconds
@@ -409,7 +401,7 @@ def fetch_url(url, headers=(), timeout=15, report_text=None, data=None,
logger.error(f'Server error {response.status} after {max_retries} retries') logger.error(f'Server error {response.status} after {max_retries} retries')
raise FetchError(str(response.status), reason=response.reason, ip=None) raise FetchError(str(response.status), reason=response.reason, ip=None)
# Exponential backoff for server errors. Non-crypto jitter. # Exponential backoff for server errors
delay = (base_delay * (2 ** attempt)) + random.uniform(0, 1) delay = (base_delay * (2 ** attempt)) + random.uniform(0, 1)
logger.warning(f'Server error ({response.status}). Waiting {delay:.1f}s before retry {attempt + 1}/{max_retries}...') logger.warning(f'Server error ({response.status}). Waiting {delay:.1f}s before retry {attempt + 1}/{max_retries}...')
time.sleep(delay) time.sleep(delay)
@@ -440,7 +432,7 @@ def fetch_url(url, headers=(), timeout=15, report_text=None, data=None,
else: else:
raise raise
# Wait and retry. Non-crypto jitter. # Wait and retry
delay = (base_delay * (2 ** attempt)) + random.uniform(0, 1) delay = (base_delay * (2 ** attempt)) + random.uniform(0, 1)
logger.warning(f'Connection error. Waiting {delay:.1f}s before retry {attempt + 1}/{max_retries}...') logger.warning(f'Connection error. Waiting {delay:.1f}s before retry {attempt + 1}/{max_retries}...')
time.sleep(delay) time.sleep(delay)
@@ -540,30 +532,30 @@ class RateLimitedQueue(gevent.queue.Queue):
def download_thumbnail(save_directory, video_id): def download_thumbnail(save_directory, video_id):
save_location = os.path.join(save_directory, video_id + '.jpg') save_location = os.path.join(save_directory, video_id + ".jpg")
for quality in ('hq720.jpg', 'sddefault.jpg', 'hqdefault.jpg'): for quality in ('hq720.jpg', 'sddefault.jpg', 'hqdefault.jpg'):
url = f'https://i.ytimg.com/vi/{video_id}/{quality}' url = f"https://i.ytimg.com/vi/{video_id}/{quality}"
try: try:
thumbnail = fetch_url(url, report_text='Saved thumbnail: ' + video_id) thumbnail = fetch_url(url, report_text="Saved thumbnail: " + video_id)
except FetchError as e: except FetchError as e:
if '404' in str(e): if '404' in str(e):
continue continue
print('Failed to download thumbnail for ' + video_id + ': ' + str(e)) print("Failed to download thumbnail for " + video_id + ": " + str(e))
return False return False
except urllib.error.HTTPError as e: except urllib.error.HTTPError as e:
if e.code == 404: if e.code == 404:
continue continue
print('Failed to download thumbnail for ' + video_id + ': ' + str(e)) print("Failed to download thumbnail for " + video_id + ": " + str(e))
return False return False
try: try:
with open(save_location, 'wb') as f: f = open(save_location, 'wb')
f.write(thumbnail)
except FileNotFoundError: except FileNotFoundError:
os.makedirs(save_directory, exist_ok=True) os.makedirs(save_directory, exist_ok=True)
with open(save_location, 'wb') as f: f = open(save_location, 'wb')
f.write(thumbnail) f.write(thumbnail)
f.close()
return True return True
print('No thumbnail available for ' + video_id) print("No thumbnail available for " + video_id)
return False return False

View File

@@ -1,3 +1,3 @@
from __future__ import unicode_literals from __future__ import unicode_literals
__version__ = 'v0.5.0' __version__ = 'v0.4.5'

View File

@@ -1,26 +1,27 @@
import json
import logging
import math
import os
import re
import traceback
import urllib
from math import ceil
from types import SimpleNamespace
from urllib.parse import parse_qs, urlencode
import flask
import gevent
import urllib3.exceptions
from flask import request
import youtube import youtube
from youtube import yt_app from youtube import yt_app
from youtube import util, comments, local_playlist, yt_data_extract from youtube import util, comments, local_playlist, yt_data_extract
from youtube.util import time_utc_isoformat
import settings import settings
from flask import request
import flask
import logging
logger = logging.getLogger(__name__) logger = logging.getLogger(__name__)
import json
import gevent
import os
import math
import traceback
import urllib
import re
import urllib3.exceptions
from urllib.parse import parse_qs, urlencode
from types import SimpleNamespace
from math import ceil
try: try:
with open(os.path.join(settings.data_dir, 'decrypt_function_cache.json'), 'r') as f: with open(os.path.join(settings.data_dir, 'decrypt_function_cache.json'), 'r') as f:
@@ -61,9 +62,7 @@ def get_video_sources(info, target_resolution):
continue continue
if not (fmt['init_range'] and fmt['index_range']): if not (fmt['init_range'] and fmt['index_range']):
# Allow HLS-backed audio tracks (served locally, no init/index needed) # Allow HLS-backed audio tracks (served locally, no init/index needed)
url_value = fmt.get('url', '') if not fmt.get('url', '').startswith('http://127.') and not '/ytl-api/' in fmt.get('url', ''):
if (not url_value.startswith('http://127.')
and '/ytl-api/' not in url_value):
continue continue
# Mark as HLS for frontend # Mark as HLS for frontend
fmt['is_hls'] = True fmt['is_hls'] = True
@@ -223,7 +222,7 @@ def lang_in(lang, sequence):
if lang is None: if lang is None:
return False return False
lang = lang[0:2] lang = lang[0:2]
return lang in (item[0:2] for item in sequence) return lang in (l[0:2] for l in sequence)
def lang_eq(lang1, lang2): def lang_eq(lang1, lang2):
@@ -239,9 +238,9 @@ def equiv_lang_in(lang, sequence):
e.g. if lang is en, extracts en-GB from sequence. e.g. if lang is en, extracts en-GB from sequence.
Necessary because if only a specific variant like en-GB is available, can't ask YouTube for simply en. Need to get the available variant.''' Necessary because if only a specific variant like en-GB is available, can't ask YouTube for simply en. Need to get the available variant.'''
lang = lang[0:2] lang = lang[0:2]
for item in sequence: for l in sequence:
if item[0:2] == lang: if l[0:2] == lang:
return item return l
return None return None
@@ -311,15 +310,7 @@ def get_subtitle_sources(info):
sources[-1]['on'] = True sources[-1]['on'] = True
if len(sources) == 0: if len(sources) == 0:
# Invariant: with no caption sources there should be no languages assert len(info['automatic_caption_languages']) == 0 and len(info['manual_caption_languages']) == 0
# either. Don't rely on `assert` which is stripped under `python -O`.
if (len(info['automatic_caption_languages']) != 0
or len(info['manual_caption_languages']) != 0):
logger.warning(
'Unexpected state: no subtitle sources but %d auto / %d manual languages',
len(info['automatic_caption_languages']),
len(info['manual_caption_languages']),
)
return sources return sources
@@ -678,6 +669,7 @@ def format_bytes(bytes):
@yt_app.route('/ytl-api/audio-track-proxy') @yt_app.route('/ytl-api/audio-track-proxy')
def audio_track_proxy(): def audio_track_proxy():
"""Proxy for DASH audio tracks to avoid throttling.""" """Proxy for DASH audio tracks to avoid throttling."""
cache_key = request.args.get('id', '')
audio_url = request.args.get('url', '') audio_url = request.args.get('url', '')
if not audio_url: if not audio_url:
@@ -700,7 +692,7 @@ def audio_track_proxy():
@yt_app.route('/ytl-api/audio-track') @yt_app.route('/ytl-api/audio-track')
def get_audio_track(): def get_audio_track():
"""Proxy HLS audio/video: playlist or individual segment.""" """Proxy HLS audio/video: playlist or individual segment."""
from youtube.hls_cache import get_hls_url from youtube.hls_cache import get_hls_url, _tracks
cache_key = request.args.get('id', '') cache_key = request.args.get('id', '')
seg_url = request.args.get('seg', '') seg_url = request.args.get('seg', '')
@@ -924,7 +916,7 @@ def get_hls_manifest():
flask.abort(404, 'HLS manifest not found') flask.abort(404, 'HLS manifest not found')
try: try:
print('[hls-manifest] Fetching HLS manifest...') print(f'[hls-manifest] Fetching HLS manifest...')
manifest = util.fetch_url(hls_url, manifest = util.fetch_url(hls_url,
headers=(('User-Agent', 'Mozilla/5.0'),), headers=(('User-Agent', 'Mozilla/5.0'),),
debug_name='hls_manifest').decode('utf-8') debug_name='hls_manifest').decode('utf-8')
@@ -1026,8 +1018,7 @@ def get_storyboard_vtt():
for i, board in enumerate(boards): for i, board in enumerate(boards):
*t, _, sigh = board.split("#") *t, _, sigh = board.split("#")
width, height, count, width_cnt, height_cnt, interval = map(int, t) width, height, count, width_cnt, height_cnt, interval = map(int, t)
if height != wanted_height: if height != wanted_height: continue
continue
q['sigh'] = [sigh] q['sigh'] = [sigh]
url = f"{base_url}?{urlencode(q, doseq=True)}" url = f"{base_url}?{urlencode(q, doseq=True)}"
storyboard = SimpleNamespace( storyboard = SimpleNamespace(
@@ -1191,6 +1182,7 @@ def get_watch_page(video_id=None):
uni_sources = video_sources['uni_sources'] uni_sources = video_sources['uni_sources']
pair_sources = video_sources['pair_sources'] pair_sources = video_sources['pair_sources']
pair_idx = video_sources['pair_idx'] pair_idx = video_sources['pair_idx']
audio_track_sources = video_sources['audio_track_sources']
# Build audio tracks list from HLS # Build audio tracks list from HLS
audio_tracks = [] audio_tracks = []