[Crypter & Downloader] Added knigavuhe.org

[EnergoStalin]

Describe the changes

Add simple provider for https://knigavuhe.org so feeding url like this https://knigavuhe.org/book/dopolnitelnye-istorii/ would download a book.

S in SKnigavuhe states for Storage cause i suspect s3 backend judging by subdomain. It serves sole purpose - rewriting name without touching url. Couldn't figure out better way to do it.

Additional references

Maybe i will add proper naming templates to it and more metadata resolving from page but for now it's all what i need.

[pep8speaks]

Hello @EnergoStalin! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

• In the file src/pyload/plugins/downloaders/KnigavuheOrg.py:

Line 11:89: E501 line too long (89 > 88 characters)

We recommend to use black to automatically correct these files.

Comment last updated at 2024-06-08 22:05:20 UTC

[CLAassistant]

All committers have signed the CLA.

[GammaC0de]

__pattern__ must not be surrounded by round brackets

[EnergoStalin]

It's done automatically by black due to line length > 88(89 to be exact). I guess linter will fail if i change that.

[GammaC0de]

Sorry but one more thing: please issue the PR against the develop branch

[EnergoStalin]

Also it suddenly stopped working now with Loaded URL exceeded limit (2000000) exception investigating...

[GammaC0de]

Also it suddenly stopped working now with Loaded URL exceeded limit (2000000) exception investigating...

Probably a solution would be something like:

pyload/src/pyload/plugins/decrypters/MegaCoNzFolder.py

Lines 34 to 44 in 9376854

	def setup(self):
	try:
	self.req.http.close()
	except Exception:
	pass
	self.req.http = HTTPRequest(
	cookies=self.req.cj,
	options=self.pyload.request_factory.get_options(),
	limit=10_000_000,
	)

[EnergoStalin]

Don't think it should be that big not bigger 2GB for sure. Will debug through mitmproxy to see if it actually should be this big.

[EnergoStalin]

Ok it's broken because i renamed Hoster part. When adding S prefix again it works like before. Probably i guessed first time right you cant name it same way expecting to work.

I couldn't figure out how to set filename for url from Decryptor. So this solutions i can think of.

Solutions

• Leave hoster with different name from decrypter. Downsides of this approach would be that you need enable them separately.
• Trick fragment to take priority matching some conditions. So default hoster plugin can be used.
  

  pyload/src/pyload/core/utils/web/parse.py

  Lines 109 to 122 in e65ad80

  	def name(url, safe_name=True):
  	url = format.url(url)
  	up = urllib.parse.urlparse(url)
  	name = up.path.split("/")[-1]
  	if not name:
  	name = up.query.split("=", 1)[::-1][0].split("&", 1)[0]
  	if not name and up.fragment:
  	name = "#" + up.fragment
  	elif name and up.fragment:
  	name += "#" + up.fragment
  	if not name:
  	name = up.netloc.split(".", 1)[0]
  	return safe_nm(name) if safe_name else name

• Fix this bug cause i suspect it is one if you asked me to rename Hoster to the same name seems you unaware of this behaviour
• Allow decrypter decrypt filenames as well

   self.packages.append("", [ (name, url) ], "")

• Write another default hoster flavor which will match urls ending with fragment(#) which likely filename.

[EnergoStalin]

Also it suddenly stopped working now with Loaded URL exceeded limit (2000000) exception investigating...

Probably a solution would be something like:

pyload/src/pyload/plugins/decrypters/MegaCoNzFolder.py

Lines 34 to 44 in 9376854

	def setup(self):
	try:
	self.req.http.close()
	except Exception:
	pass
	self.req.http = HTTPRequest(
	cookies=self.req.cj,
	options=self.pyload.request_factory.get_options(),
	limit=10_000_000,
	)

This is fixing the issue but then it fails unable to resolve BookPlayer data in decrypter.