Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Broken] Odysee: Only lists the last 1000 videos #1296

Closed
7 tasks done
christoph-heinrich opened this issue Oct 15, 2021 · 2 comments · May be fixed by #10164
Closed
7 tasks done

[Broken] Odysee: Only lists the last 1000 videos #1296

christoph-heinrich opened this issue Oct 15, 2021 · 2 comments · May be fixed by #10164
Labels
invalid This doesn't seem right site-bug Issue with a specific website

Comments

@christoph-heinrich
Copy link
Contributor

Checklist

  • I'm reporting a broken site support
  • I've verified that I'm running yt-dlp version 2021.10.10
  • I've checked that all provided URLs are alive and playable in a browser
  • I've checked that all URLs and arguments with special characters are properly quoted or escaped
  • I've searched the bugtracker for similar issues including closed ones
  • I've read the opening an issue section in CONTRIBUTING.md
  • I have given an appropriate title to the issue

Verbose log

[debug] Command-line config: ['--ignore-config', '-v', '-F', 'https://odysee.com/@21:7']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] yt-dlp version 2021.10.10 (zip)
[debug] Python version 3.9.7 (CPython 64bit) - Linux-5.14.12-arch1-1-x86_64-with-glibc2.33
[debug] exe versions: ffmpeg 4.4, ffprobe 4.4, rtmpdump 2.4
[debug] Optional libraries: Crypto, mutagen, sqlite, websockets
[debug] ANSI escape support: stdout = False, stderr = False
[debug] Proxy map: {}
[debug] [lbry:channel] Extracting URL: https://odysee.com/@21:7
[lbry:channel] @21#7: Downloading channel JSON metadata
[download] Downloading playlist: 21 Studios
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 1 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 2 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 3 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 4 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 5 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 6 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 7 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 8 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 9 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 10 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 11 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 12 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 13 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 14 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 15 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 16 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 17 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 18 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 19 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 20 JSON metadata
[lbry:channel] 7f1137707c918dab287ac91c9dbb28748696a36b: Downloading page 21 JSON metadata
[lbry:channel] playlist 21 Studios: Downloading 1000 videos
[download] Downloading video 1 of 1000
[debug] [lbry] Extracting URL: https://odysee.com/top-21-tiktok-men-keeping-women-in-2:e9bac2aed179bcabb25c8d8e34b8c328724e41e1
[lbry] top-21-tiktok-men-keeping-women-in-2#e9bac2aed179bcabb25c8d8e34b8c328724e41e1: Downloading stream JSON metadata
[lbry] e9bac2aed179bcabb25c8d8e34b8c328724e41e1: Downloading streaming url JSON metadata
[lbry] top-21-tiktok-men-keeping-women-in-2#e9bac2aed179bcabb25c8d8e34b8c328724e41e1: Downloading streaming redirect url info
[info] Available formats for e9bac2aed179bcabb25c8d8e34b8c328724e41e1:
ID EXT RESOLUTION |  FILESIZE  PROTO | VCODEC  ACODEC
-- --- ---------- - ---------- ----- - ------- -------
0  mp4 1920x1080  |  216.55MiB https | unknown unknown
[download] Downloading video 2 of 1000
[debug] [lbry] Extracting URL: https://odysee.com/donovan-sharpe-admits-he's-super-dumb:03bcbf1b0d53850da48de14b8d8f3904958a7fb9
[lbry] donovan-sharpe-admits-he's-super-dumb#03bcbf1b0d53850da48de14b8d8f3904958a7fb9: Downloading stream JSON metadata
[lbry] 03bcbf1b0d53850da48de14b8d8f3904958a7fb9: Downloading streaming url JSON metadata
[lbry] donovan-sharpe-admits-he's-super-dumb#03bcbf1b0d53850da48de14b8d8f3904958a7fb9: Downloading streaming redirect url info
[info] Available formats for 03bcbf1b0d53850da48de14b8d8f3904958a7fb9:
ID EXT RESOLUTION |  FILESIZE PROTO | VCODEC  ACODEC
-- --- ---------- - --------- ----- - ------- -------
0  mp4 1920x1080  |  22.01MiB https | unknown unknown
.
.
.
[download] Downloading video 999 of 1000
[debug] [lbry] Extracting URL: https://odysee.com/what-exists-because-of-you-zan-perrion:87e04d7c2cc95cf1f33377d9736a77cfc2a53b8f
[lbry] what-exists-because-of-you-zan-perrion#87e04d7c2cc95cf1f33377d9736a77cfc2a53b8f: Downloading stream JSON metadata
[lbry] 87e04d7c2cc95cf1f33377d9736a77cfc2a53b8f: Downloading streaming url JSON metadata
[lbry] what-exists-because-of-you-zan-perrion#87e04d7c2cc95cf1f33377d9736a77cfc2a53b8f: Downloading streaming redirect url info
[info] Available formats for 87e04d7c2cc95cf1f33377d9736a77cfc2a53b8f:
ID EXT RESOLUTION |  FILESIZE PROTO | VCODEC  ACODEC
-- --- ---------- - --------- ----- - ------- -------
0  mp4 1920x1080  |  74.73MiB https | unknown unknown
[download] Downloading video 1000 of 1000
[debug] [lbry] Extracting URL: https://odysee.com/the-3-masculine-style-archetypes-tanner:675a9490d2c78fd61d7d7f0e10d4d9ab46fc93b9
[lbry] the-3-masculine-style-archetypes-tanner#675a9490d2c78fd61d7d7f0e10d4d9ab46fc93b9: Downloading stream JSON metadata
[lbry] 675a9490d2c78fd61d7d7f0e10d4d9ab46fc93b9: Downloading streaming url JSON metadata
[lbry] the-3-masculine-style-archetypes-tanner#675a9490d2c78fd61d7d7f0e10d4d9ab46fc93b9: Downloading streaming redirect url info
[info] Available formats for 675a9490d2c78fd61d7d7f0e10d4d9ab46fc93b9:
ID EXT RESOLUTION |  FILESIZE PROTO | VCODEC  ACODEC
-- --- ---------- - --------- ----- - ------- -------
0  mp4 1280x720   |  17.30MiB https | unknown unknown
[download] Finished downloading playlist: 21 Studios

Description

In June I opened an issue in the youtube-dl repo and the problem still exists. Since development has stopped over there, I'm linking it here.
Btw I didn't explicitly point this out in the other issue, but it doesn't just list the last 1000 videos when running it with -F, but also when trying to download the whole channel (probably uses the same code anyway, just wanted to make sure).
@christoph-heinrich christoph-heinrich added site-bug Issue with a specific website triage Untriaged issue labels Oct 15, 2021
@Ashish0804
Copy link
Contributor

Ashish0804 commented Oct 16, 2021 •
edited
Loading

Even the site only shows 1000 videos
Screenshot from 2021-10-16 09_07_25
Screenshot from 2021-10-16 09_07_16
Screenshot from 2021-10-16 09_10_31

The api gives literally an empty list for page 21 so it's working as expected.
Screenshot from 2021-10-16 09_08_13

Edit: and yes those tags are by the site and not me 🤦🏽‍♂️

@Ashish0804 Ashish0804 added invalid This doesn't seem right and removed triage Untriaged issue labels Oct 16, 2021
@christoph-heinrich
Copy link
Contributor Author

Oh, I didn't realize that. Thanks for looking into this so quickly.

@Synarp Synarp mentioned this issue Jun 12, 2024
Open
8 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
invalid This doesn't seem right site-bug Issue with a specific website
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[LBRY/Odysee] workaround for the 1000 item API-limit Synarp/yt-dlp
2 participants
@christoph-heinrich @Ashish0804