Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Some scrapers don't work #451

Open
MarkusCrow opened this issue Jun 16, 2024 · 0 comments
Open

[BUG] Some scrapers don't work #451

MarkusCrow opened this issue Jun 16, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@MarkusCrow
Copy link

Describe the bug

This is the complete log:
I see so many errors, how can i fix that?

Loading existing settings
Loading cookie from file
Loading existing course details
Currently enrolled in 1158 courses
idownloadcoupon scraper is running
freebiesglobal scraper is running
tutorialbar scraper is running
discudemy scraper is running
coursevania scraper is running
Page: 1 of 2205 scraped from tutorialbar.com
Page: 1 of 565 scraped from idownloadcoupon
Error while running idownloadcoupon scraper: list index out of range
Traceback (most recent call last):
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\base_scraper.py", line 90, in wrapper
response = await func(self)
^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 36, in run
links = await self.get_links()
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 54, in get_links
udemy_links = await self.gather_udemy_course_links(course_links)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 104, in gather_udemy_course_links
for link in await asyncio.gather(*map(self.get_udemy_course_link, courses))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 93, in get_udemy_course_link
return cls.validate_coupon_url(urllib.parse.unquote(urls[1]))
~~~~^^^
IndexError: list index out of range
Got 12 links from https://www.tutorialbar.com in 1.55 seconds
Error while running coursevania scraper: 'NoneType' object has no attribute 'find'
Traceback (most recent call last):
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\base_scraper.py", line 90, in wrapper
response = await func(self)
^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 38, in run
links = await self.get_links()
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 55, in get_links
links = await self.gather_udemy_course_links(course_links)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 144, in gather_udemy_course_links
for link in await asyncio.gather(*map(self.get_udemy_course_link, courses))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 131, in get_udemy_course_link
soup.find("div", class_="stm-lms-buy-buttons").find("a").get("href")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'find'
Page: 1 of 188 scraped from discudemy.com
Got 15 links from https://discudemy.com in 3.02 seconds
Page: 1 of 2436 scraped from freebiesglobal.com
Got 30 links from https://freebiesglobal.com in 77.88 seconds
Total courses this time: 57
Already enrolled in: 'Deep trance and Advanced Conditioning in Hypnosis'
Already enrolled in: 'iOS, Swift & SwiftUI - Complete iOS App Development'
Already enrolled in: 'The Complete Introduction to Online Course Creation'
Already enrolled in: 'JavaScript for Beginners - The Complete introduction to JS'
Already enrolled in: 'The Complete Introduction to Online Course Creation'
Already enrolled in: 'SAP Ariba : Become Certified Consultant Buying & Invoicing'
Already enrolled in: 'Create Social Network & Community Website With Wordpress'
Already enrolled in: 'The Big Picture of Photography: Social Functions Explained'
Already enrolled in: 'Visualization techniques for Decision Makers and Leaders'
Already enrolled in: 'The Complete Introduction to C++ Programming'
Successfully enrolled: 'MailChimp Email Marketing Masterclass for eCommerce'
Already enrolled in: 'Selling on eBay Complete Course - Start an eBay Business'
Successfully enrolled: 'Google Ads (Adwords) Masterclass - Pay-Per-Click PPC Adverts'
Successfully enrolled: 'Shopify eCommerce Store Masterclass - Start a Business!'
Successfully enrolled: 'Search Engine Optimisation: Grow Free Google SEO Traffic'
Successfully enrolled: 'Agile Fundamentals Certification'
Successfully enrolled: 'Master Scrum Basics'
Already enrolled in: 'Agile Fundamentals Certification'
Successfully enrolled: 'Freelance Mastery with SmartPhone 3D Logo Design'
Successfully enrolled: 'Simple React App from Scratch'
Already enrolled in: 'Build from Scratch a Modern REST API with PHP 8'
Already enrolled in: 'Python And Flask Framework Complete Course'
Already enrolled in: 'JavaScript And PHP And Python Programming Complete Course'
Already enrolled in: 'Most Essential & Popular Excel Formulas And Functions - 2024'
Already enrolled in: 'PyTorch Ultimate 2024: From Basics to Cutting-Edge'
Already enrolled in: 'SAP Ariba : Become Certified Consultant Buying & Invoicing'
Already enrolled in: 'Adobe Lightroom For Absolute Beginners'
Already enrolled in: 'ELISA principals and applications for professionals'
Already enrolled in: 'XSS Survival Guide'
Already enrolled in: 'AZ-900: Microsoft Azure Fundamentals Practice Tests'
Already enrolled in: 'SAP Security Interview Questions Practice Test'
Already enrolled in: 'Ultimate YAML Course : YAML JSON JSONPath Zero - Master'
Already enrolled in: 'Visualization techniques for Decision Makers and Leaders'
Already enrolled in: 'Deep trance and Advanced Conditioning in Hypnosis'
Successfully enrolled: 'poultry farming viral diseases threaten poultry industry'
Successfully enrolled: 'practical clinical chemistry from scratch'
Successfully enrolled: 'Introductory Biology for medical professional'
Successfully enrolled: 'Mastering English Conversation: Essential Phrases for Fluent'
Successfully enrolled: 'GIT and GitHub Basics - Bootcamp'
Successfully enrolled: 'Advanced Python Skills: become a better Python developer'
Successfully enrolled: 'poultry farming Bacterial diseases hindering satisfying prod'
Successfully enrolled: 'Mastering Architectural, Night & HDR Photography'
Already enrolled in: 'Ethical Hacking with Kali Linux 2024'
Already enrolled in: 'C-level management: 100 models for business success - Part 1'
Already enrolled in: 'How neuromarketing can influence buying behavior'
idownloadcoupon scraper is running
freebiesglobal scraper is running
tutorialbar scraper is running
discudemy scraper is running
coursevania scraper is running
Page: 2 of 2205 scraped from tutorialbar.com
Got 12 links from https://www.tutorialbar.com in 1.24 seconds
Page: 2 of 565 scraped from idownloadcoupon
Error while running idownloadcoupon scraper: list index out of range
Traceback (most recent call last):
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\base_scraper.py", line 90, in wrapper
response = await func(self)
^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 36, in run
links = await self.get_links()
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 54, in get_links
udemy_links = await self.gather_udemy_course_links(course_links)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 104, in gather_udemy_course_links
for link in await asyncio.gather(*map(self.get_udemy_course_link, courses))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 93, in get_udemy_course_link
return cls.validate_coupon_url(urllib.parse.unquote(urls[1]))
~~~~^^^
IndexError: list index out of range
Error while running coursevania scraper: 'NoneType' object has no attribute 'find'
Traceback (most recent call last):
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\base_scraper.py", line 90, in wrapper
response = await func(self)
^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 38, in run
links = await self.get_links()
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 55, in get_links
links = await self.gather_udemy_course_links(course_links)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 144, in gather_udemy_course_links
for link in await asyncio.gather(*map(self.get_udemy_course_link, courses))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 131, in get_udemy_course_link
soup.find("div", class_="stm-lms-buy-buttons").find("a").get("href")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'find'
Page: 2 of 188 scraped from discudemy.com
Got 15 links from https://discudemy.com in 3.08 seconds
Error in get request: Response payload is not completed
Error while running freebiesglobal scraper: 'NoneType' object has no attribute 'decode'
Traceback (most recent call last):
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\base_scraper.py", line 90, in wrapper
response = await func(self)
^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\freebiesglobal.py", line 34, in run
links = await self.get_links()
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\freebiesglobal.py", line 52, in get_links
soup = BeautifulSoup(coupons_data.decode("utf-8"), "html.parser")
^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'decode'
Total courses this time: 27
Already enrolled in: 'Comprehensive CompTIA Security+ SY0-701 Practice Exam'
Already enrolled in: 'PERL Interview Questions Practice Test'
Already enrolled in: 'Adobe Premiere Pro CC Video Editing Course For Beginners'
Already enrolled in: 'CIO Chief Information Officer Executive Certification'
Already enrolled in: 'DBT (Data Build Tool) from a Beginner to Expert'
Already enrolled in: 'The Big Picture of Photography: Social Functions Explained'
Already enrolled in: 'Statistical Modeling Mastery: Success Exam Practice Test'
Already enrolled in: '11 Days Math Challenge : Master Basics of Mathematics'
Already enrolled in: 'Salesforce Admin Interview Questions Practice Test'
Already enrolled in: 'Black book for sales - the secrets and tricks of the trade'
Already enrolled in: 'Peak Performance: the 7 essentials for sales supremacy'
Already enrolled in: 'Building a Laravel and React Platform for Selling Pictures'
Already enrolled in: 'APQP - Advanced Product Quality Planning'
Already enrolled in: 'Automate Construction Project with Artificial Intelligence'
Already enrolled in: 'Driving & Enhance E-Commerce Forward with Odoo 17 AI-Powered'
Already enrolled in: 'Supply Chain Operations Specialization, PLM,Odoo 17 Planning'
Already enrolled in: 'Craft a compelling business idea from scratch'
Already enrolled in: 'Revit 2023 Complete Course: Revit from Beginner to Advanced'
Already enrolled in: 'Tailwind CSS en 1h: Maîtriser ce puissant framework CSS'
Already enrolled in: 'Python for Data Science & Machine Learning: Zero to Hero'
Already enrolled in: 'TypeScript for Beginners: Mastering TypeScript Fundamentals'
Already enrolled in: 'WordPress Crash Course: Build any Website in Minutes!'
idownloadcoupon scraper is running
freebiesglobal scraper is running
tutorialbar scraper is running
discudemy scraper is running
coursevania scraper is running
Page: 3 of 2205 scraped from tutorialbar.com
Error while running coursevania scraper: 'NoneType' object has no attribute 'find'
Traceback (most recent call last):
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\base_scraper.py", line 90, in wrapper
response = await func(self)
^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 38, in run
links = await self.get_links()
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 55, in get_links
links = await self.gather_udemy_course_links(course_links)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 144, in gather_udemy_course_links
for link in await asyncio.gather(*map(self.get_udemy_course_link, courses))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 131, in get_udemy_course_link
soup.find("div", class_="stm-lms-buy-buttons").find("a").get("href")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'find'
Got 12 links from https://www.tutorialbar.com in 1.82 seconds
Page: 3 of 565 scraped from idownloadcoupon
Error while running idownloadcoupon scraper: list index out of range
Traceback (most recent call last):
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\base_scraper.py", line 90, in wrapper
response = await func(self)
^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 36, in run
links = await self.get_links()
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 54, in get_links
udemy_links = await self.gather_udemy_course_links(course_links)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 104, in gather_udemy_course_links
for link in await asyncio.gather(*map(self.get_udemy_course_link, courses))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 93, in get_udemy_course_link
return cls.validate_coupon_url(urllib.parse.unquote(urls[1]))
~~~~^^^
IndexError: list index out of range
Page: 3 of 188 scraped from discudemy.com
Got 15 links from https://discudemy.com in 2.74 seconds
Page: 3 of 2436 scraped from freebiesglobal.com
Got 28 links from https://freebiesglobal.com in 109.51 seconds
Total courses this time: 55
Already enrolled in: 'Complete Python For Absolute Beginners'
Already enrolled in: 'Introduction to Risk Management'
Already enrolled in: 'The Concept of Lean management Waste'
Already enrolled in: 'ChatGPT: Complete ChatGPT Guide For Beginners'
Already enrolled in: 'Adobe Premiere Pro CC For Video Editing - Novice to Expert'
Already enrolled in: 'Computer Vision Fundamentals'
Already enrolled in: 'Microsoft Azure: Hands On Training: AZ-900 AZ-104 and AZ-305'
Already enrolled in: 'Ultimate Miro Guide 2024 | Boost Team Productivity'
Already enrolled in: 'Practical MongoDB + PHP: For Absolute Beginners'
Already enrolled in: 'Fiverr Freelancing with SmartPhone Graphic Design Skill'
Already enrolled in: 'Project Finance & Excel: Build Financial Models from Scratch'
Already enrolled in: 'Python GUI Development with Tkinter: Build Pro Desktop Apps!'
Already enrolled in: 'Python per l'apprendimento profondo: Costruire reti neurali'
Already enrolled in: 'Financement de projets & Excel : Modèles en partant de zéro!'
Already enrolled in: 'The Ultimate Excel VBA Course: Learn & Master VBA Fast'
Already enrolled in: 'MySQL pour les débutants: Formation MySQL de A à Z'
Already enrolled in: 'Machine Learning: Aplicado a Python y Data Science'
Already enrolled in: 'Python for Data Visualization: The Complete Masterclass'
Already enrolled in: 'The Complete Vue.JS Course for Beginners: Zero to Mastery'
Already enrolled in: 'Microsoft SQL pour les débutants: Le cours de A à Z'
Already enrolled in: 'Il corso completo di WordPress per principianti: A to Z'
Already enrolled in: 'AutoCAD 2023: Produrre rapidamente incredibili planimetrie'
Already enrolled in: 'Python for Game Programming: Pygame from A to Z'
Already enrolled in: 'Python & TensorFlow: Deep Dive into Machine Learning'
Already enrolled in: 'React.JS for Ecommerce: Building a Store with React.JS'
idownloadcoupon scraper is running
freebiesglobal scraper is running
tutorialbar scraper is running
discudemy scraper is running
coursevania scraper is running
Page: 4 of 2205 scraped from tutorialbar.com
Page: 4 of 188 scraped from discudemy.com
Got 15 links from https://discudemy.com in 0.72 seconds
Got 12 links from https://www.tutorialbar.com in 1.11 seconds
Page: 4 of 565 scraped from idownloadcoupon
Error while running idownloadcoupon scraper: list index out of range
Traceback (most recent call last):
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\base_scraper.py", line 90, in wrapper
response = await func(self)
^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 36, in run
links = await self.get_links()
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 54, in get_links
udemy_links = await self.gather_udemy_course_links(course_links)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 104, in gather_udemy_course_links
for link in await asyncio.gather(*map(self.get_udemy_course_link, courses))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 93, in get_udemy_course_link
return cls.validate_coupon_url(urllib.parse.unquote(urls[1]))
~~~~^^^
IndexError: list index out of range
Error while running coursevania scraper: 'NoneType' object has no attribute 'find'
Traceback (most recent call last):
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\base_scraper.py", line 90, in wrapper
response = await func(self)
^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 38, in run
links = await self.get_links()
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 55, in get_links
links = await self.gather_udemy_course_links(course_links)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 144, in gather_udemy_course_links
for link in await asyncio.gather(*map(self.get_udemy_course_link, courses))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 131, in get_udemy_course_link
soup.find("div", class_="stm-lms-buy-buttons").find("a").get("href")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'find'
Error in get request: Response payload is not completed
Error while running freebiesglobal scraper: 'NoneType' object has no attribute 'decode'
Traceback (most recent call last):
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\base_scraper.py", line 90, in wrapper
response = await func(self)
^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\freebiesglobal.py", line 34, in run
links = await self.get_links()
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\freebiesglobal.py", line 52, in get_links
soup = BeautifulSoup(coupons_data.decode("utf-8"), "html.parser")
^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'decode'
Total courses this time: 27
Already enrolled in: 'Civil & Structural Engineering Lecturer'
Already enrolled in: 'Microsoft Ads MasterClass - All Campaigns & Features'
Already enrolled in: 'Real Estate Investing, Real Estate Marketing & Flipping 2.0'
Already enrolled in: 'Agile Transformation A to Z 2024 | Make Your Company Agile'
Already enrolled in: 'Lean Six Sigma and Agile Methodology in Project Management'
Already enrolled in: 'Becoming an Agile Leader 2024 | Drive Outcomes, Bring Impact'
Already enrolled in: 'MySQL for Beginners: A Complete Training for beginnners'
Already enrolled in: 'The Complete Microsoft SQL Server Course: From A to Z'
Already enrolled in: 'Bootcamp Développeur Web Front-End : HTML, CSS, JS, et React'
Already enrolled in: 'Der komplette WordPress-Kurs für Einsteiger'
Already enrolled in: 'SketchUp 2023: The A-Z Course to Mastering 3D Modeling'
Already enrolled in: 'Excel VBA pour débutants: Formation pas à pas sur Excel VBA'
Already enrolled in: 'TailwindCSS from A to Z: Master TailwindCSS Quickly'
Already enrolled in: 'AutoCAD 2023 MasterClass: Produce Amazing Site Plans Quickly'
Already enrolled in: 'JavaScript pour les débutants : Cours complet pour débutants'
Already enrolled in: 'AutoCAD 2023 en 1h: Maîtrisez les Bases Rapidement'
Already enrolled in: 'The Basics of Linux Command Line'
Already enrolled in: 'kids first steps in English'
idownloadcoupon scraper is running
freebiesglobal scraper is running
tutorialbar scraper is running
discudemy scraper is running
coursevania scraper is running
Page: 5 of 2205 scraped from tutorialbar.com
Stopping loop. We have reached max number of pages to scrape: 5
tutorialbar scraper complete
Got 12 links from https://www.tutorialbar.com in 1.17 seconds
Page: 5 of 565 scraped from idownloadcoupon
Error while running idownloadcoupon scraper: list index out of range
Traceback (most recent call last):
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\base_scraper.py", line 90, in wrapper
response = await func(self)
^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 36, in run
links = await self.get_links()
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 54, in get_links
udemy_links = await self.gather_udemy_course_links(course_links)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 104, in gather_udemy_course_links
for link in await asyncio.gather(*map(self.get_udemy_course_link, courses))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 93, in get_udemy_course_link
return cls.validate_coupon_url(urllib.parse.unquote(urls[1]))
~~~~^^^
IndexError: list index out of range
Error while running coursevania scraper: 'NoneType' object has no attribute 'find'
Traceback (most recent call last):
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\base_scraper.py", line 90, in wrapper
response = await func(self)
^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 38, in run
links = await self.get_links()
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 55, in get_links
links = await self.gather_udemy_course_links(course_links)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 144, in gather_udemy_course_links
for link in await asyncio.gather(*map(self.get_udemy_course_link, courses))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 131, in get_udemy_course_link
soup.find("div", class_="stm-lms-buy-buttons").find("a").get("href")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'find'
Page: 5 of 188 scraped from discudemy.com
Stopping loop. We have reached max number of pages to scrape: 5
discudemy scraper complete
Got 15 links from https://discudemy.com in 2.56 seconds
Error in get request: Response payload is not completed
Error while running freebiesglobal scraper: 'NoneType' object has no attribute 'decode'
Traceback (most recent call last):
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\base_scraper.py", line 90, in wrapper
response = await func(self)
^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\freebiesglobal.py", line 34, in run
links = await self.get_links()
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\freebiesglobal.py", line 52, in get_links
soup = BeautifulSoup(coupons_data.decode("utf-8"), "html.parser")
^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'decode'
Total courses this time: 27
Already enrolled in: 'Oracle Primavera P6: Essentials Training for Project Success'
Already enrolled in: 'Digital Foundations: Exploring IT & Multimedia Fundamentals'
Already enrolled in: 'Ethically Hack the Planet Part 2'
Already enrolled in: 'Analyse de Données avec Python: Numpy, Pandas et Matplotlib'
Already enrolled in: 'Data Manipulation in Python: Master Python, Numpy & Pandas'
Already enrolled in: 'Bootstrap 5 Course: Build Responsive Websites like a Pro'
Already enrolled in: 'Crypto Masterclass: Bitcoin, Altcoins, NFTs, DeFi, Metaverse'
Already enrolled in: 'Bootstrap 5: Créer et Lancer des Sites Web Réactifs'
Already enrolled in: 'Fixed Income Securities: Become a Bond Analyst & Investor'
Already enrolled in: 'Python for OOP: The A-to-Z OOP Python Programming Course'
Already enrolled in: 'Komplett NFT-Kurs: Werden Sie ein NFT-Ersteller und-Investor'
Already enrolled in: 'Python for Deep Learning: Build Neural Networks in Python'
Already enrolled in: 'HTML5 et CSS3 : La Formation Complète'
Already enrolled in: 'Complete Italian for Beginners: Speak Italian like a Pro'
Already enrolled in: 'React.JS Crash Course: The Complete Course for Beginners'
idownloadcoupon scraper is running
freebiesglobal scraper is running
coursevania scraper is running
Error while running coursevania scraper: 'NoneType' object has no attribute 'find'
Traceback (most recent call last):
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\base_scraper.py", line 90, in wrapper
response = await func(self)
^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 38, in run
links = await self.get_links()
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 55, in get_links
links = await self.gather_udemy_course_links(course_links)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 144, in gather_udemy_course_links
for link in await asyncio.gather(*map(self.get_udemy_course_link, courses))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\coursevania.py", line 131, in get_udemy_course_link
soup.find("div", class_="stm-lms-buy-buttons").find("a").get("href")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'find'
Page: 6 of 565 scraped from idownloadcoupon
Error while running idownloadcoupon scraper: list index out of range
Traceback (most recent call last):
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\base_scraper.py", line 90, in wrapper
response = await func(self)
^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 36, in run
links = await self.get_links()
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 54, in get_links
udemy_links = await self.gather_udemy_course_links(course_links)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 104, in gather_udemy_course_links
for link in await asyncio.gather(*map(self.get_udemy_course_link, courses))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\idownloadcoupon.py", line 93, in get_udemy_course_link
return cls.validate_coupon_url(urllib.parse.unquote(urls[1]))
~~~~^^^
IndexError: list index out of range
Error in get request: Response payload is not completed
Error while running freebiesglobal scraper: 'NoneType' object has no attribute 'decode'
Traceback (most recent call last):
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\base_scraper.py", line 90, in wrapper
response = await func(self)
^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\freebiesglobal.py", line 34, in run
links = await self.get_links()
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Python311\Lib\site-packages\udemy_enroller\scrapers\freebiesglobal.py", line 52, in get_links
soup = BeautifulSoup(coupons_data.decode("utf-8"), "html.parser")
^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'decode'
Total courses this time: 0
================== Run Statistics ==================
Enrolled: 16
Unwanted Category: 0
Unwanted Language: 15
Already Claimed: 109
Expired: 52
Total Enrolments: 1174
Savings: €609.84
================== Run Statistics ==================
All scrapers complete

To Reproduce
Steps to reproduce the behavior:

  1. Install repo with pip
  2. Execute udemy_enroller from PowerShell
  3. See error

Expected behavior
All the scrapers works

Desktop (please complete the following information):

  • OS: Windows 11
  • Browser Edge, Firefox
@MarkusCrow MarkusCrow added the bug Something isn't working label Jun 16, 2024
@MarkusCrow MarkusCrow changed the title [BUG] [BUG] Some scrapers don't work Jun 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant