Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / IvanYingX/Urbanoutfitters-Scraper-Project issues and pull requests
#43 - update scraper.py in headless mode
Pull Request -
State: open - Opened by enyikram over 2 years ago
#42 - Implement a method to refresh the product page when a page loading error occurs. Without this the scraper will timeout
Issue -
State: open - Opened by Jimbito over 2 years ago
#41 - Change all xpath locators to ID or TAG_NAME where possible to improve speed, failing that, use CSS
Issue -
State: open - Opened by Jimbito over 2 years ago
#40 - Optimise speed of scraper: disable ads, disable images, refine selenium operations
Issue -
State: open - Opened by Jimbito over 2 years ago
#39 - Scrape 1000 products from male and female
Issue -
State: open - Opened by Jimbito over 2 years ago
#38 - Save all Raw JSON product dicts locally
Issue -
State: open - Opened by Jimbito over 2 years ago
#37 - Integrate pipeline between product JSONS, SQL and amazon RDS.
Issue -
State: open - Opened by Jimbito over 2 years ago
#36 - TEST: upload 100 images to S3 bucket, time the operation & check how much space is occupied
Issue -
State: open - Opened by Jimbito over 2 years ago
#35 - TEST: try scraping 100 products at once, time the operation.
Issue -
State: open - Opened by Jimbito over 2 years ago
#34 - Change check_scraper_ready function to how_many_to_scrape (per gender) which takes integer as input
Issue -
State: open - Opened by Jimbito over 2 years ago
#33 - Scraper class method: navigate to other gender after scraping one
Issue -
State: open - Opened by Jimbito over 2 years ago
#32 - create a file which runs unit tests
Issue -
State: open - Opened by Jimbito over 2 years ago
#31 - create unit tests for individual functions
Issue -
State: open - Opened by Jimbito over 2 years ago
#30 - export sql data to amazon RDS
Issue -
State: open - Opened by enyikram over 2 years ago
#29 - fix issue with product details xpath changing
Issue -
State: open - Opened by Jimbito over 2 years ago
#28 - save page dict to json
Issue -
State: open - Opened by Jimbito over 2 years ago
#27 - Impliment nested function to utilise load_more method
Issue -
State: open - Opened by Jimbito over 2 years ago
#26 - Get scrape_data method working
Issue -
State: open - Opened by Jimbito over 2 years ago
#25 - Fix scrape_href method
Issue -
State: open - Opened by Jimbito over 2 years ago
#24 - Modulate scraper to function on the Uniqlo website
Issue -
State: open - Opened by Jimbito over 2 years ago
#23 - scrape image from product
Issue -
State: open - Opened by Jimbito over 2 years ago
#22 - store images in s3 bucket
Issue -
State: open - Opened by Jimbito over 2 years ago
#21 - store product categories in database
Issue -
State: open - Opened by Jimbito over 2 years ago
#20 - re-brand project as H&M / Uniqlo scraper
Issue -
State: open - Opened by Jimbito over 2 years ago
#19 - Obtain product categories from products
Issue -
State: open - Opened by Jimbito over 2 years ago
#18 - Scraper Class Method: Navigate to gender (all clothng) from homepage
Issue -
State: open - Opened by Jimbito almost 3 years ago
#17 - Scraper Class Method: Navigate to item type, after scraping the current item type
Issue -
State: open - Opened by Jimbito almost 3 years ago
#16 - Scraper Class Method: first image link
Issue -
State: open - Opened by Jimbito almost 3 years ago
#15 - Scraper Class Method: open item from href list
Issue -
State: open - Opened by Jimbito almost 3 years ago
#14 - Scraper Class Method: Scrape product details from product
Issue -
State: open - Opened by Jimbito almost 3 years ago
#13 - Scraper Class Method: Next Item
Issue -
State: open - Opened by Jimbito almost 3 years ago
#12 - Scraper Class Method: next page clicker
Issue -
State: open - Opened by Jimbito almost 3 years ago
#11 - Implement unit test
Issue -
State: open - Opened by IvanYingX almost 3 years ago
#10 - Write Docstrings and Type hints
Issue -
State: open - Opened by IvanYingX almost 3 years ago
#9 - Create SQL database
Issue -
State: open - Opened by IvanYingX almost 3 years ago
#8 - Scraper outline
Pull Request -
State: closed - Opened by dan-bouchard almost 3 years ago
#7 - Creating a scraper Class
Issue -
State: closed - Opened by IvanYingX almost 3 years ago
#6 - Add a README
Issue -
State: open - Opened by dan-bouchard almost 3 years ago
#5 - Familiarize with the website
Issue -
State: closed - Opened by IvanYingX almost 3 years ago
#4 - Set up Cloud Storage
Issue -
State: closed - Opened by IvanYingX almost 3 years ago
#3 - Start Scraping
Issue -
State: open - Opened by IvanYingX almost 3 years ago
#2 - Decide what to Scrape
Issue -
State: closed - Opened by IvanYingX almost 3 years ago
#1 - Everyone clone this repo in their local machine
Issue -
State: closed - Opened by IvanYingX almost 3 years ago