Aggregator scraper trabalhos
Oi Melad B., notei seu perfil e gostaria de te apresentar meu projeto. Podemos discutir quaisquer detalhes pelo chat.
Necessito fazer a extração de HTML de uma página em aspx, que contém possui abas. Só preciso do HTML.
Preciso adicionar um agregador de rss no script Sngine, de forma que no painel de admin eu possa configurar os feeds rss que quero usar, e selecionar a categoria do blog e autor para cada feed em particular. Tb preciso adicionar nas configurações dos usuários, a função de selecionar qual dos feeds eles querem que sejam exibidos na timeline, e quais eles não querem ver. Sngine versão 2.6 O FreshRSS parece bem útil.
Preciso adicionar um agregador de rss no script Sngine, de forma que no painel de admin eu possa configurar os feeds rss que quero usar, e selecionar a categoria do blog e autor para cada feed em particular. Tb preciso adicionar nas configurações dos usuários, a função de selecionar qual dos feeds eles querem que sejam exibidos na timeline, e quais eles não querem ver. Sngine versão 2.6
...site/sistema de comparador de preços (como Buscapé e Zoom) específico para produtos de informática (memórias, hds, fontes, placas de vídeo, etc). O sistema deve possuir um scraper para fazer a busca e indexação dos preços e produtos diretamente nos sites, a cada período determinado. Em um primeiro momento, preciso que sejam indexados estes sites: Kabum, Pichau, Balão da Informática, Megamamute, Waz, Guerra Digital, Terabyte Shop. O site deve ter um design/layout parecido com o Zoom, contendo busca e detalhamento dos produtos buscados (nome, preço, foto, loja). Não é necessário painel de administração, apenas o site e o scraper. O sistema, prefer...
Necessito de um desenvolvedor com experiencia em crawler , O Sistema precisa fazer o Scrap com sabe no codigo EAN ou Nome do Produto . Buscar em lojas virtuais o dados desses produtos , raspar o código fonte das páginas e trazer: um título pra esse produto, descrição do produto, categoria que o mesmo está inserido, imagens e preço. Mostrar após o scraper, a lista com os resultados. Estes campos devem poder ser editados antes de salvar novamente no banco de dados. Ter a função também de gerar um arquivo csv ou xls com resultados em campos (com padrão pré-definido). Este padrão pre-definido deve ter a liberdade de configuração (nome de cada campo). Preferênc...
DESCRIÇÃO: Criação de um programa para coletar dados de empresas do site público da Junta comercial de São Paulo (); ESCOPO: Criação do robo (Web Scraper), considerando o input de dados em um form em pelo menos três campos (município, objeto, empresa ativa (sim/não); O retorno da consulta é uma lista de empresas. Cada empresa da lista deve ser acessada e todas as informações devem ser coletadas (nome, cnpj, endereço, etc.); Ao final de cada consulta, os dados coletados devem ser gravados em um arquivo (txt, csv ou xlsx). Deve-se considerar quebrar os captchas que aparecem na consulta inicial e no acesso ao link de cada empresa. Pode ser utilizada qualquer linguagem de progra...
Tenho um site com Crawler/scraper engine, (Basicamente ele captura imagens de um site e posta no meu,salvando no banco e ja postando, no momento meu site faz isso de alguns sites, preciso adicionar mais 4 sites para copiar as imagens) Meu sistema usa framework laravel.
Preciso de um programador para desenvolver um software busca de expressões a serem buscar na memoria ram física criadas através de aplicações, rodando em ambiente software ter ser executado de tempos em tempos, variando de milisegundos a segundos, e a cada execução criará um LOG com os resultados da procura na memoria ram em um diretório local e também enviará para um servidor. Se possível o software deverá funcionar em Ring3 e ter módulos de persistência e anti kill e anti debug..<br /><br />Exemplo<br /><br />
Preciso de um "motor" ou sistema (Simples), que faça uma busca das melhores tarifas de passagens aéreas nos sites das principais Cias aéreas nacionais (azul, tam,gol,avianca,passaredo), e internacionais (as principais mais conhecidas). Como será usado para um site não comercial (site especializado em ofertas, dicas e noticias de viagens), não preciso de um sistema fabuloso, mas que seja funcional e de fácil manuseio.
Preciso de um "motor" ou sistema (Simples), que faça uma busca das melhores tarifas de passagens aéreas nos sites das principais Cias aéreas nacionais (azul, tam,gol,avianca,passaredo), e internacionais (as principais mais conhecidas). Será implementado em um site especializado em ofertas e promoções, preciso que seja funcional e de fácil manuseio.
Processo: Definir no php proxy ou formas de não identificar o crawler e ser banido o IP. Mesmo sendo url´s distintas, temos urls utilizando o mesmo servidor, que pode identificar e banir o crawler. 1) Lê arquivo .txt com url da loja virtual: a) Http code do site. Se o site estiver online segue para ler as informações. Se o site não estiver gravar no mysql queo site está off. 2) Extrai as seguintes informações da Url Se possível identificar alguns pontos: HTTP/1.1 200 OK Server: nginx X-Powered-By: ASP.NET Trazer essas informações acima e todas as printadas. Por que a importância dessas informações? A intenção é saber o servidor que ele usa, se poss&ia...
...no seguinte app android: 1 - Característica: Opção de curtir igual Do Facebook. - UM BOTÃO DE CURTIR EM CADA OFERTA (O USUARIO PODERÁ CURTIR CADA OFERTA APENAS UM AVEZ E DESCUTIR CASO PRECISE) - MOSTRAR ABAIXO DO BOTÃO A QUANTDIDADE DE USUARIOS QUE JÁ CURTIRAM A DETEMINADA OFERTA EXEMPLO: [BOTÃO CURTIR] 10 PESSOAS JÁ CURTIRAM 2 - Característica: -CRIAR UMA ACTIVITY (TELA) NO APP COM OS SEGUINTES RESULTADOS (LISTA AS OFERTAS QUE AQUELE DETEMINADO USUARIO JÁ CURTIU) - TOCAR EM UMA DETERMINADA OFERTA E IR NA ACTIVITY (TELA) DA OFERTA CORESPONDENTE. OUTRAS INFORMAÇÕES: Api do projeto Goceng ( ) está em PHP e o banco de dados em MYSQL bem documentado
spider scraper site video aranha raspador para local de videos aranha raspador para local de videos aranha raspador para local de videos
spider scraper site video aranha raspador para local de videos aranha raspador para local de videos aranha raspador para local de videos
Preciso de um "motor" ou sistema (Simples), que faça uma busca das melhores tarifas de passagens aéreas nos sites das principais Cias aéreas nacionais (azul, tam,gol,avianca,passaredo), e internacionais (as principais mais conhecidas). Como será usado para um site não comercial (site especializado em ofertas, dicas e noticias de viagens), não preciso de um sistema fabuloso, mas que seja funcional e de fácil manuseio.
I'm starting an online insurance aggregator that caters to both B2B and B2C markets. I am seeking an experienced branding expert to create a compelling and memorable brand name and logo that aligns with my company's vision and values. - Objectives: - Develop a unique and catchy brand name suitable for the insurance industry. - Design a professional and visually appealing logo reflecting our innovative and trustworthy service. - Ideal Candidate: - Proven experience in brand development and logo design, preferably within the insurance or fintech sectors. - A strong portfolio showcasing previous work. - Ability to translate company values and services into a brand identity. - Excellent communication skills to ensure the brand name and logo align with our vision...
I'm in need of a Python script that can crawl through a list of websites provided in an Excel file and export all the webpages it finds into a new Excel file. This task is aimed at scraping the entire content of the websites, not just a specific piece of information. Key Requirements: - The script must be able to read a list of websites from an Excel file. - The script should use natural crawling mechanisms, not sitemap, to find all the webpages on each website. - All the webpages found on the websites should be exported into a new Excel file. The purpose of this script is to aid in analyzing the content of these websites, so it's crucial that all pages are scraped. Ideal Skills: - Proficiency in Python programming, particularly web scraping. - Knowledge of Excel file handlin...
I'm seeking an expert data scraper to compile a comprehensive list of small to medium enterprises (SMEs) across Victoria, NSW, North Queensland, and South Australia. The scope of businesses should focus on restaurants and retail stores. The information needed for each business is as follows: - Business Name - Address - Phone Number - Website - Email Ideal candidate should have robust experience in data collection and validation to ensure the information provided is current and accurate. Proficiency in navigating Australian business directories and databases will be a valuable asset. Your scrupulous attention to detail and commitment to data integrity are critical for this task.
I'm starting an online insurance aggregator that caters to both B2B and B2C markets. I am seeking an experienced branding expert to create a compelling and memorable brand name and logo that aligns with my company's vision and values. - Objectives: - Develop a unique and catchy brand name suitable for the insurance industry. - Design a professional and visually appealing logo reflecting our innovative and trustworthy service. - Ideal Candidate: - Proven experience in brand development and logo design, preferably within the insurance or fintech sectors. - A strong portfolio showcasing previous work. - Ability to translate company values and services into a brand identity. - Excellent communication skills to ensure the brand name and logo align with our vision...
In this project, I am seeking a skilled Python developer with experience in using Playwright to develop a set of flexible data scraper tools. These tools will be deployed to capture data and screenshots from a variety of popularly visited websites such as e-commerce platforms, directories, social media and news sites which includes but not limited to eBay and clinicaltrials.gov. Key functionalities should include: - Capturing various data types such as product details, pricing information, ratings, reviews, and any other elements visible in a full-page screenshot. - Organizing the captured data and screenshots in a clear, easy-to-navigate folder structure. - Being adaptive enough to scrape data from a widely diverse set of websites. To be successful in this role, you should hav...
I am seeking a data aggregator to formulate inclusive and accurate contact lists for my upcoming marketing campaigns. The information required in each list is a blend of phone numbers, email addresses, and the names of company owners. I'll be providing SIC codes as an accurate reference channel for the industries we'll be focusing on. Any freelancer applying for this project should exhibit a well-versed understanding of data aggregation, web scraping, and should be detail-oriented. A knowledge or background in marketing would also be beneficial. Please note information accuracy is paramount, as these lists will directly impact the effectiveness of our campaigns. Your tasks will include: - Gathering the aforementioned contact details - Aligning data with SIC codes provi...
I have a list of 80 directories that require data extraction. I'm looking for an experienced web scraper who can handle this task using Python, Selenium, Php, Puppeteer (JavaScript) and Node.js.
I'm looking for an experienced data scraper who can extract text data from marketing websites for subsequent data analysis.
I need a data scraping tool to pull business names and addresses from Google and Google Maps. - The tool should be able to extract this information in an organized and comprehensive manner, enabling me to create a database for further analysis. Ideal skills and experience for this job include: - Proficiency in web scraping tools and techniques. - Experience working with Google and Google Maps APIs. - Ability to organize and structure data effectively. - Data to be compiled in an excel spreadsheet - Prior knowledge of extracting business information from online sources is a plus. Looking forward to your proposals.
Title: Expert Web Scraper Needed for Advanced Sales Lead Generation Description: We're in search of an expert web scraper proficient in niche database search techniques and advanced web scraping beyond Google and mainstream platforms. The ideal candidate will specialize in extracting company information from platforms like LinkedIn, focusing on contact details for sales lead generation. Key Details: Target Data: Company Information on LinkedIn Purpose: Sales Lead Generation Responsibilities: Utilize advanced web scraping tools and niche database search techniques to extract company information, emphasizing contact details. Ensure accuracy and reliability in gathering and organizing contact information from various sources. Collaborate on developing targeted outreach...
I'm in need of a proficient data scraper to pull a list of specific job titles for my list of Property management companies. I already have the Company name, state, street address, and zip code for these firms, but now I need someone to mine the contacts within them. I would like to start with 150 companies but I will need thousands very soon. This will be an ongoing relationship. Specifics include, but are not limited to: - Facility Managers - Construction Managers - Building Managers - Maintenance Managers You should have experience in data mining and web scraping, showcasing a solid understanding of how to extract specific information from given sources. A background in extracting information specifically for real estate industry firms would be a significant advantage. ...
I need an experienced developer for building a Gmail email scraper/notifier. The ideal candidate should have a strong understanding of data scraping and email handling. The aim of the project is to: - Extract and display specific emails from Gmail in a user-friendly card format within an application grid. - The information to display on each card will include part of email body, phone numbers and web links. The phone numbers should be displayed in a clickable link format so that they seamlessly work with a soft phone application like RingCentral without need to use their API. Emails containing web link will have the option to automatically open the link in new tab in default browser. Skills required: - Proficiency in data scraping - Experience with Gmail API - Excellent knowledge...
You must live in Eastern Europe or Latin America. If you apply I will send you the complete specifications for this project. This project consists of two independent parts: the web scraper and the form filler The Web Scraper and The Form Filler can be used independent of one another. The Web Scraper will perform a Google Search based on the search such as Home inspectors in Portland, Oregon, and then scrape the search results, and then save the search results to… The Form Filler will fill in The Contact Form on each company’s website listed in Range_of_companies_to_contact_in_Companies_which_The_Code_has_not_contacted_which_have_a_contact_form_on_their_website.csv.
I am in need of a skilled developer to create a web-based news aggregator. This aggregator will specifically focus on news from Uganda and the broader East African region. It has to be user-friendly, intuitive, and visually appealing. Key Requirements: - The aggregator should exclusively prioritize text-based news articles. With featured images No video or audio content is to be included. - The platform should support the English language, as it is the primary medium for news in the region. -The platform shall pick news from sites I authorize to avoid fake news The platform should allow reading of articles (1st 3 paragraphs) before referring user to read fulll article at the parent site from where the article originates. The platform should give use ability to read f...
I require a skilled developer to re-design my website, with an emphasis on showcasing my products/services. The updated website needs to have a fresh look while maintaining its initial design consistency. Key tasks include: - Removing obsolete website links and replacing them with relevant ones - Incorporating API scraping for better data handling and integration - Developing a built-in scraper for efficient data extraction - Implementing an escort application form to expand our service offerings - Ensuring rigorous testing and deployment for a seamless user experience The ideal candidate should have comprehensive skills in HTML/CSS, JavaScript frameworks, and CMS like WordPress or Joomla. They should also be proficient in API scraping. A keen eye for design consistency and exper...
Bonjour, Je recherche quelqu'un pour m'aider à créer des workflows pour scraper des sites français réputés pour être difficiles en scraping. Je démarre une nouvelle entreprise et je recherche donc des tarifs compétitifs pour créer ces workflows. Je recherche également une personne sachant travailler sur Octoparse et Python. Si vous avez l'expérience et les compétences pour ce projet, n'hésitez pas à me contacter. Merci d'avance pour votre attention et votre réponse. Cordialement,
I need a professional who can scrape videos. I'm looking for someone who can download videos at its maximum size from websites.
I'm looking for a freelancer who's great at web scraping to help with a project involving a specific website initially, with potential for more. I'll give you the specific data fields to extract. It'd be great if you: Are really good at web scraping and or Python. Know your way around MS SQL Server databases, not essential but definately an advantage. Understand how to extract data effectively. Understand the need for security and captcha integration if needed. Can work quickly since this project is a priority and needs to be done ASAP. Ultimately, I want to be able to manage the code with your ongoing help, so this could lead to a long-term partnership. I'll share the full details when needed. You will provide source code, documentation and deployment information...
I'm seeking a skilled Java developer to create a (Web Scraper and Analyzer) for my project. 1- i need it to work on eclipse 2- i need the program written in a (GENERIC code) 3- you must use data structure 4- i need you to simplify the code for me as you can 5- i need to ask you simple Questions like what data structure did you use, why this data structure not other, and lastly i need the Pros and Cons for the selected data structure.
I need a Python script that will create an endpoint for a Prometheus scraper to pull data from. I have the data already prepared, and it's ready to be pulled. Key Points: - The data to be pulled is in an unspecified format, so the script will need to be able to handle various data formats. - The specific data fields the script should include in the endpoint for the Prometheus scraper are not defined. I'm looking for an experienced Python developer who has worked with Prometheus in the past and has a good understanding of data scraping. Knowledge of various data formats and the ability to handle dynamic data fields will be a big plus.
I'm in need of a skilled web scraper to extract tabular data from a specific website. The task is a one-time project as the data is needed for a one-off analysis. I Need a webscraper to download all data i have credentials for this (but this link will not open other than my laptop . we will discuss all inside data is aroung40GB. you can message for further details Key Requirements: - Data Extraction: The primary goal of this project is to extract tabular data from a website. You will need to develop a custom scraper that can accurately and efficiently extract this data. - Data Formatting: The extracted data should be clean, well-formatted, and easily usable for analysis.
I am seeking a proficient web scraper to extract specific data from The data I need includes venue details and contact information. I require the end product to be delivered as a well-organised Excel file. Key aspects to focus on: * Meticulous detail on venue data * Comprehensive contact information * High level data formatting skills The ideal candidate has demonstrated experience in web scraping, data management and Excel. A background in music or event-based data is a plus. Efficiency, precision and respect for the source website's terms of service are crucial for this project.
Seeking Expert Lead Scraper for Commercial Window Tinters in Brisbane, QLD, Australia Are you a skilled lead scraper with a knack for precision and detail? We're in search of a freelancer who can provide high-quality leads specifically tailored to our requirements. Project Details: Target Location: Brisbane, QLD, Australia Industry: Commercial window tinting Lead Criteria: Business name Phone number Email address Physical address Geographical Range: Within a 50km radius of Brisbane, QLD 250 leads required Requirements: Accuracy: We require active and accurate leads that meet the specified criteria. Delivery Format: Leads must be supplied in an Excel spreadsheet for easy integration into our systems. Timeliness: Prompt delivery of leads is crucial for our business op...
I'm in need of a highly proficient data extraction specialist who can effectively collect details from 8,000 Facebook group members for market research purposes. Your main task will involve extracting the following data: - Member's name - Current job title - Date of group membership - Page URL Key Project Requirements: - All data must be scraped without violating Facebook's terms of service. - Information needs to be organized according to the date of joining the group. - Extracted data should be handed over in the form of an Excel spreadsheet. Skills and Experience: - You need to have proven experience in data scraping, particularly from social media sites like Facebook. - Good knowledge of Excel is required. - Familiarity with the Facebook platform and its data priv...
I will do your project as per your requirments ! I was already done the projects as a web scraper ! Thank you and have a good day !
I need a web scraper to extract text from a provided list of URLs on a Google Sheet. - The URLs will be provided in a list. - The scraping should be done only once. Your tasks: - Scrape the text from the URLs. - Update the Google Sheet with three columns: URL, Title, and Text scraped. - If a URL doesn't contain any text or leads to an error page, please skip it and move on to the next URL. Key skills: - Experience in web scraping. - Proficiency in Google Sheets. - Attention to detail to handle exceptions as per the requirements.
I urgently require a web scraper built to scrape the exercise program layout from a specific fitness website. Your task will be to extract data pertaining to the personal training categories, subcategories, and filters. Specifically, the scraper should be: - Able to extract the training categories and subcategories - Efficient in scraping price filters - Functional and delivered by today The ideal freelancer for this project should have previous experience in creating a web scraper and a strong understanding of data extraction from complex website layouts. Prompt delivery is of the essence for this project.
I'm currently seeking a professional data scraper who can successfully extract specific content from an existing mobile app.
I urgently require a skilled Python developer to build an efficient web scraper for my project. The focus is to scrape text content from various undetermined websites. Ideal Skills & Experience: - Expertise in Python programming and web scraping libraries - Proven experience in extracting, parsing, and staging data - Keen on tight deadlines Key Tasks include: - Developing a performant web scraper - Validate the scraper across multiple website types - Prompt delivery.
I'm looking for a skilled developer who can create a WordPress news site that will automatically scrape news from my own blog websites and update the content on a daily basis. Key Requirements: - The website should scrape news from my blog websites. - The content should be automatically updated on a daily basis. - The news should be categorized into Politics, Technology, and Entertainment. Ideal Skills: - Proficiency in WordPress development. - Experience in web scraping. - Understanding of news categorization. - Time-based content updating automation. I'm open to suggestions on how to make the website more efficient and user-friendly. Please include past projects or relevant experience in your bid.
I'm in need of a competent web scraper that can assist me in collecting Relative Strength Index (RSI) data for data analysis purposes. This project involves automated collection of stock market data with a particular focus on RSI values. The ideal candidate should have: - Proven experience with web scraping - Strong understanding App script Your role will involve configuring and running the web scraping tool, collecting data and preparing this data for analysis. Your ultimate goal will be to provide me with comprehensive RSI values that I can use for relevant data analysis and making informed financial decisions.
I'm looking for a proficient data scraper to collect essential business information from the top 200 Amazon UK Beach Bags & Straw Bags stores. This includes the store's name, phone number, and email addresses. Can you please provide a small sample in excel sheet format with store hyperlink, to make sure we understand each other top Amazon UK Beach Bags & Straw Bags SPECIALISING stores ONLY Ideal Skills and Experience: - Demonstrated experience in data scraping, preferably with a focus on e-commerce stores. - Ability to use various data scraping tools, as the preferred platform was not specified. Application Requirement: - Only applications showcasing the relevant experience will be considered. Please share specific examples of your previous work especially i...
