Andreas
693b4ac98b
Add application/vnd.ms-excel as CSV mime type
...
Windows sends application/vnd.ms-excel as MIME Type instead of text/csv
Signed-off-by: Jesús <heckyel@hyperbola.info>
2021-12-31 18:21:37 -05:00
James Taylor
cd3383e6e3
Add NewPipe subscriptions import and export
...
Closes #82
Signed-off-by: Jesús <heckyel@hyperbola.info>
2021-09-01 22:01:05 -05:00
James Taylor
5bf4c284a5
subscriptions: Support new subscriptions.csv format
...
According to
https://github.com/iv-org/invidious/issues/2319
Google Takeout changed the format from json to csv
Signed-off-by: Jesús <heckyel@hyperbola.info>
2021-08-31 18:36:10 -05:00
f5f9b1c181
Cleaner channel-checking console error messages when Tor is closed
...
by James Taylor <user234683@users.noreply.github.com>
2021-07-28 23:45:19 -05:00
7fd2c3474f
Capitalize name app
2021-06-10 16:41:45 -05:00
7feea3f839
Add subscriptions export
...
plus design by heckyel
2021-05-06 15:18:19 -05:00
James Taylor
f7ed8159cd
Channel: use general pbj=1 endpoint to get first page of videos
...
YouTube disabled the browse_ajax endpoint. Quick fix for first
channel page. In general, this will be more robust against api
endpoint changes. As YouTube continues to change api endpoints,
at least the subscriptions and first page will no longer break.
Signed-off-by: Jesús <heckyel@hyperbola.info>
2021-03-03 10:33:45 -05:00
b9a3082e7c
pep8
2020-12-15 21:52:04 -05:00
James Taylor
cc123d6761
Fix author_url not prefixed in subscriptions page
2020-08-11 21:14:13 -07:00
James Taylor
4d3e35c981
Fix old videos appearing in subscriptions when channel deletes vids
...
Example: 30 vids in DB, 1 vid that we previously saw has since been
deleted. Then on checking, the vid in the 30th slot appeared
to be new.
2020-08-03 14:52:55 -07:00
James Taylor
408a9c79ae
Correctly start and stop subscriptions autochecker when it is
...
disabled/enabled in settings.
2020-03-08 21:01:15 -07:00
James Taylor
af334a8ac7
Fix subscriptions new video count when there are deleted videos
...
It would be 30 since the old method looked to see where the latest
video in the database is in the new batch of videos. New method
finds the first video in the new batch which is in the database.
2020-02-27 11:21:42 -08:00
James Taylor
c6fe9b8fc7
Fix subscription checking breaking due to workers crashing
...
The try statement was missing an except clause. So if there
was an exception such as the tor browser being closed or
getting a 429 error during the request, the workers would
crash until there were none left to handle checking.
2020-02-23 10:42:13 -08:00
James Taylor
3beb2809ae
Subscriptions auto-checking: Better console error message for 429 errors
...
Display a descriptive error message instead of a traceback
2020-02-18 22:14:39 -08:00
James Taylor
f787e4e202
Give a proper error message for 429 errors
...
These occur when too many requests are coming from a Tor exit node.
Before, there would be an error page with an exception instructing users to report the issue.
But this is an expected and persistent issue.
2020-01-31 20:06:15 -08:00
James Taylor
c56fc56fa6
Subscriptions: Cleaner error message when checking terminated channels
...
Don't display a nasty traceback in that case.
2019-12-22 19:00:44 -08:00
James Taylor
250723b797
Subscriptions: Make uploader name clickable, with link to channel
2019-12-22 18:51:21 -08:00
James Taylor
b4406df9cf
Merge branch 'modular-data-extract'
...
Commits in this branch are prefixed with "Extraction:"
This branch refactors data extraction. All such functionality has been moved to the yt_data_extract module.
Responses from requests are given to the module and it parses them into a consistent, more useful format.
The dependency on youtube-dl has also been dropped and this functionality has been built from scratch for these reasons:
(1) I've noticed youtube-dl breaks more often than invidious (which uses watch page extraction built from scratch) in response to changes from Youtube, so I'm hoping what I wrote will also be less brittle.
(2) Such breakage is inconvenient because I have to manually merge the fixes since I had to make changes to youtube-dl to make it do things such as extracting related videos.
(3) I have no control over error handling and request pooling with youtube-dl, since it does all the requests (these would require intrusive changes I don't want to maintain).
(4) I will now be able to finally display the number of comments and whether comments are disabled without making additional requests.
2019-12-19 21:33:54 -08:00
James Taylor
d1d908d5b1
Extraction: Move html post processing stuff from yt_data_extract to util
2019-12-19 19:48:53 -08:00
James Taylor
98777ee825
Extraction: Rewrite item_extraction for better error handling and readability, rename extracted names for more consistency
2019-12-18 19:39:16 -08:00
James Taylor
dc6c370152
Extraction: refactor response extraction to work with both mobile & desktop respones, also improve errors
2019-09-19 11:06:34 -07:00
James Taylor
014da8d3ae
Fix list of local playlists not being given on subscriptions page and local playlist page
2019-09-15 15:15:23 -07:00
James Taylor
216231f9a6
Extraction: Proper error handling for terminated or non-existant channels
2019-09-08 17:48:02 -07:00
James Taylor
bd343ed71f
Extraction: Move channel extraction to yt_data_extract
2019-09-08 17:28:11 -07:00
James Taylor
f172b143d6
Subscriptions: order videos by date published when there's too many new videos from a channel
2019-09-07 20:02:45 -07:00
James Taylor
c393031ac5
Subscriptions: autocheck after subscribing to channel
2019-09-03 17:47:23 -07:00
James Taylor
0a590c3364
Subscriptions: Order videos by the time they were added to db
2019-09-03 16:45:19 -07:00
James Taylor
71632a23f5
Subscriptions: Add watched column in database for future feature
2019-08-17 13:54:54 -07:00
James Taylor
d80a8b1c3f
Subscriptions: Hopefully fix autochecking being scheduled in the past
2019-08-17 13:52:32 -07:00
James Taylor
aa5b9efca1
Subscriptions: Don't show videos from muted channels
2019-08-17 12:54:03 -07:00
James Taylor
897755e836
Subscriptions: Add database version
2019-08-17 12:49:36 -07:00
James Taylor
056f6fd2b5
Subscriptions: check channel's atom feed to get exact time published
2019-08-17 00:50:58 -07:00
James Taylor
899b088cdc
Subscriptions: show when video was published
2019-08-16 21:48:40 -07:00
James Taylor
046d7226ea
Subscriptions: improve checking messages, say how many new vids from channel
2019-08-14 18:39:39 -07:00
James Taylor
e2c9081aee
Subscriptions: double auto-check rate
2019-08-14 16:40:42 -07:00
James Taylor
31a04555ae
Subscriptions auto-checking system
2019-08-14 00:12:24 -07:00
James Taylor
de33ee6bb8
When restricting subscriptions to a tag, make that tag unclickable and add link to unrestrict
2019-08-12 15:09:28 -07:00
James Taylor
dd4841901f
Add pagination to subscriptions page
2019-08-12 01:14:11 -07:00
James Taylor
c55955f42d
Set sqlite to respect foreign key constraints
2019-08-11 18:36:44 -07:00
James Taylor
b469536ce6
Ability to only show videos from channels with specific tag
2019-08-11 18:17:19 -07:00
James Taylor
d1ae8dc290
Subscriptions flask port: add missing html info (video url and info dict)
2019-08-11 17:44:11 -07:00
James Taylor
a12b73439a
If thumbnail or thumbnail directory is deleted after having been downloaded, correctly detect it and redownload it
2019-08-11 17:37:42 -07:00
James Taylor
5a6c65774b
Fix bug when thumbnail directory doesn't exist where first downloaded thumbnail is made a directory
2019-08-11 17:27:55 -07:00
James Taylor
42036f92d2
Delete thumbnails from channel when unsubscribing
2019-08-11 17:25:10 -07:00
James Taylor
525ec403c0
Download and save subscription thumbnails when requested by the browser, not preemptively
2019-08-11 17:09:38 -07:00
James Taylor
2617f87e17
Add subscribe button on channels
2019-08-10 18:12:02 -07:00
James Taylor
33bba9762c
Convert subscription manager to flask framework
2019-08-10 17:05:14 -07:00
James Taylor
163814d35c
Convert subscriptions page to flask framework
2019-08-10 00:09:03 -07:00
James Taylor
cc9283ad53
Fix checking specific channels
2019-06-11 01:50:01 -07:00
James Taylor
59fdbda886
Add channel muting
2019-06-11 01:47:06 -07:00