Scraper for finding new products on Shopify websites -- 2

Orçamento $30 - $250 USD
Ofertas 10
Oferta Média $184
Status Closed

All online stores using the Shopify platform have their products listed in a xml file that follows the format: [url removed, login to view]

Here are some examples...

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

I am looking to build a scraper that will automate the task of finding new product links as soon as they are uploaded to the site, and put them in a table showing the website, product name, product ID, url, date added, etc.

I also need the scraper to identify keywords in the product URL and output these "hits" to a separate table, which containing all product links with positive keyword matches.

Other features:

- Scrape multiple sites at once

- Customizable delays for how often it checks the page, so I can leave the program running

- Proxy support

- Simple, but user-friendly GUI

- Copy / paste links from the output window

- Make a sound when a keyword match is found

Get Free Quotes For A Project Like This

Procura ganhar algum dinheiro?

  • Estabeleça seu orçamento e prazo
  • Sublinhe sua proposta
  • Seja pago pelo seu trabalho

Ofertas neste Projeto

  • arhamIT2020 Profile Picture


    Comilla,  Bangladesh

    Dear sir, Greeting from Arham IT 2020 I provide best solutions at fastest speed with cheapest cost. Your satisfaction is my only priority Atiqul is here! I Have 10 years outsourcing work hours live support and quality of work is my main aim. I don't compromise my work quality for money. Here, you can get full support for: =>Data Processing, Data Mining, Data Cleansing (+) =>Manual Data Collection (+) =>Manual Email Collection from different website ( Specific Person's CEO, CFO, President, Director etc +) =>Manta Data Collection (+) => Email Cleansing (+) =>Search Google for Specific Company's Website and details(+) =>Image Collection Projects (+) =>Yellow-page Data Collection (+) =>All kind of Excel work (+) =>Copy typing (+) =>DOC file converting (+) =>All kind of data entry work (+) =>Virtual Assistant (+) =>All kind of PDF Work (+) =>Call Center & Customer Support(+) =>Photoshop,Logo Design,Photo Editing(+) =>Email Marketing,Lead,Internet Marketing(+) You can get full support for social media marketing through Facebook, Twitter, YouTube, Pinterest, Instagram, and Google Plus as well. We can Provide 24/7 days support & 100% satisfactions money back Grantee Thank you, Md . Atiqul Islam. Arham IT 2020

  • wiisetech Profile Picture


    Lahore,  Pakistan

    We are here to provide quality work and reliable solutions for you. * Web Design & Development * Ecommerce Development * Magento * Oscommerce * Zencart * Prestahap * Big Commerce * Wordpress * Adobe Photshop * Logo Design * Webdesign * Data Entry * SEM / SEO * Search Engine Optimization * Database Development * Object-Oriented Programming * Client-Server and Three-Tier Applications * Internet Applications * Network and distributed applications development. * GUI Interfaces design and development * Design patterns * Project Management * Webserver Management, Security & vulnerability Hardware & Operating Systems * Windows NT/2000/XP/2003/7 * Linux

  • Verz1Lka Profile Picture


    Novosibirsk,  Russian Federation

    I use python language and scrapy framework. My scripts works on windows, mac or linux, but linux is preferably. I have more 300 finished projects (google scraping, facebook scraping, yellow pages, linkedinIn, amazon, webshops and other sites with lists of any items). I can scrape secured and protected sites, ii site block IP i can use proxy or TOR, also i can try avoid captcha. I can export data into json, xml, csv (excel), or any database (mysql, mongodb, mssql, etc). I can develop web-interface for management running script (start, stop, etc), using PHP, HTML, JS.

  • vodasaf Profile Picture


    Nairobi,  Kenya

    More than 4 years experience in programming and software engineering. We develop mobile (Windows,ios,Android and USSD), desktop applications and web(ASP.Net MVC, HTML5,). Our main goal is perfection and ensuring customer satisaction through consideration of simpicity in the user interface, and automation. We have developed enterprise systems which include hospital management to insurance brokerage.

  • shivanimishra19 Profile Picture


    New delhi,  India

    We are a group of very sound developers and designers. We are committed to give a quality work with satisfaction to our Clients. We are expertise in: - .Net - C# - Cloud Hosting - Azure - Angular JS - MVC - Selenium - eCommerce - SQL Server - JavaScript - JQuery - CMS - CSS3 - HTML5 - BootStrap Our Services: - WEB DESIGNING - WEB DEVELOPMENT - CMS DEVELOPMENT - DATA ENTRY We have exposure on below domains - eCommerce Applications - Retail and Marketing - Insurance - Window Based Applications We are expert on selling Online products on below market place - - eBay - Amazon We have hands on developing below payment APIs- - PayPal Integration - CyberSource Integration We believe in delivering 100% quality and satisfactory results to our clients.

  • shiva1888 Profile Picture


    Delhi,  India

    More than 5 + years of experience in developing web, desktop and mobile applications in .Net (C#, WPF , Windows forms,WCF, UWP, ASP, Silverlight and MVC), Xamarin, AngularJs, SocketIO, Java, C++, C, Javacript, JQuery, HTML5, Android SDK, Material Design, Bootstrapping, GMS, Swift, Cocoa Touch, UIKit, Multi- threading, cocos2d-x with SQL server and MySql for the platform like Windows 7,10, Mobile, Android, iPhone. Responsibilities and other skills: * Excellent understanding of Software Development Life Cycle * Excellent communication skills, both written and verbal. * Translate designs and wireframes into high quality code. * Build, and maintain high performance, reusable, and reliable code. * Ensure the best possible performance, quality, and responsiveness of the application. * Identify and correct bottlenecks and fix bugs - Help maintain code quality. I strive hard for 100% customer satisfaction and take full responsibility until assigned project complete successfully.

  • micromicro25 Profile Picture


    kathmandu,  Nepal

    VERY much dedicate to my work, hard working person as well. 6 years of working experience in word and excel.(Electrical works) and all-ready work with big project budget up to 500,000 usd (local project). List of things i generally do. #TOP SKILLS#(MANUALLY SCRAPING DATA) # DATA ENTRY#DATA MAKING#DATA MINING#DOCUMENT MAKING# (GOOGLE SEARCH DATA MINING)(#DRAFTING BUILDINGS AND ALL) 1 Convert From PDF to word and word to PDF very instant. 2. Related work to Word, Excel. 3. Also Play with Html, CSS ,Web development,Python. 4. Auto CAD Drawing. 5. Web scraping. 6. copy and paste Data. 7. solar system 8. transformer design/transformer line. 9. CC TV,Fire Alarm system work. 10. BOQ(bill of quantity) making. 11. Plotting With Auto cad to pdf. 12. LOGO DESIGN/WEBSITE DEVELOPMENT ( You Can HIRE me now for the best result) #Things to know about me is that i only do quality work, with 100% accuracy!!

  • mantislin Profile Picture


    ChongQing,  China

    Choice me, and all data are yours. Scraping any data from any website with PHP script, and save data to xls, csv, sql xml or json format. Download images from source websites and save to local folder and zip all images. Automatic scrape data with schedule/cron job.

  • arkdotnetec12 Profile Picture


    islamabad,  Pakistan

    We enjoy the challenges offered with every creative opportunity. Enrich both the business and its customers through effective solutions. Expand creative and technical knowledge and services. Our mission is to provide you with an excellent quality solution at the best price. we provide the following service and we ensure clients satisfaction we believe in making friends not just clients 1. Mobile development a) Android application b) IOS application c) Windows application 2. System application a) Desktop application b) Database application 3. Networking a. Network application b. Network setup and configuration c. Network administration 4. Consulting a) IT consultancy b) Automation consultancy 5). Web services a) Web development b) Web designing c) Web hosting d) Web applications 6). 3d and 2d Graphics, modeling and animation Cinema4D 7). Game Development unity 3D

  • Iamtuheedakram Profile Picture


    Islamabad,  Pakistan

    hey i am over with 3 years of work experience in Software Development with front end and back end. I have worked on quite number of real time projects. i am also expert in scrapping and automation and i have scrapped many difficult sites and have automated them. i have a made a bot for Social site to automate it. i have also expertise to use elite proxies and handle the difficult sites to scrape and automate. i am also expert in web automation using selenium. i can provide you data in any format you prefer such as CSV, xlx or in any database form.