Find Jobs
Hire Freelancers

Protecting my website from crawler and scraper (30$).

$10-30 USD

Fechado
Publicado há quase 5 anos

$10-30 USD

Pago na entrega
Protecting my website from crawler and scraper (30$). Hello! Thank you for having interest in this topic. As you know, Crawling and scraping have been always generalized. Even if you don't have very deep knowledge about it, you can make your own crawling tool just following a few steps in a tutorial that you could easily see in online. But still, there seem to be a way have a shield, control from it. [login to view URL] This is the website I happened to find accidently. When you navigate to the link and try right-clicking, or Ctrl+Shift+C, or Ctrl+S to download the webpage as html file. This is all blocked. Also it sends the pop-up message "You are not allowed to copy content or view source" I was surprised when I found this website. Because I thought it's technically, impossible. But in this website, not only blocking 'right-clicking', it also blocks to view the source of the webpage. So here I'm questioning specifics below. Question 1. How is protecting as such is possible? How did they install such blocking system to stay away from the crawl bot? Question 2. Do you know exact name of the service that the website is implementing to defend their own content? Question 3. Is it really possible to defend and block crawl/scraping access to your website and domain just like this website, Or it's just blocking it surface and it's actually possible to be by-passed? Question 4. Could you try install the same system as the website? I linked? Question 5. Other theoretical suggestions are welcome. (already built software tool or websites that showing the categorized form webs) Note : If you already have developed a similar task, this would be the best. Reward is only 30$. It's quite small in general view, But in this post I wanna get theoretical structure idea of these. Not demanding to build it right away. If we could get match well in this post by questioning and answering, I will proceed right next procedure to dedicate about building related tool/project/websites with you. :) Thank you for reading! Have a good day and bid me if you think you can complete one. Anytime ! And I am willing to respond very quickly to explain and describe more what I exactly need. also, if you can really make it out well this time in this project, I will promise to carry out further projects with you. Thanks alot.
ID do Projeto: 19303970

Sobre o projeto

7 propostas
Projeto remoto
Ativo há 5 anos

Quer ganhar algum dinheiro?

Benefícios de ofertar no Freelancer

Defina seu orçamento e seu prazo
Seja pago pelo seu trabalho
Descreva sua proposta
É grátis para se inscrever e fazer ofertas em trabalhos
7 freelancers estão ofertando em média $113 USD for esse trabalho
Avatar do Usuário
The approach to your problem is wrong. The truth is that everything can be bypassed in a way or another. The right approach is to make it worthless. All generic solutions that have been suggested can easily be bypassed by professional scrapers. For instance, ip blockers can easily be bypassed using vpn; same for Javascript solutions which disables right-click etc. The only solution is to make scraping worthless. What does it mean? If you use one of the 'generic' solutions (e.g. solutions used by a million other people), then there will probably be a million other people in the world that sooner or later will find the key which opens your door. Why? Because that key doesn't open only your door, but it opens also a million other doors. So it is worth for somebody to spend weeks or months to find that key. But if you use your own NON-GENERIC lock, then you get more security. Why? Well, also your own personalized lock is breakable, just like all the others. But is it worth? I mean, nobody will ever spend months of work just to find a key which opens only ONE door. Do not trust people saying it is an easy task, because it is not. They are just suggesting some of those generic solutions. Contact me if you want to know more.
$35 USD em 3 dias
5,0 (8 avaliações)
3,9
3,9
Avatar do Usuário
Hello, I looked though the website you mentioned. It uses some javascript code to disable the right click on the website. But the security there is very limited. For someone with a little bit understanding of the concepts it can be disabled. I tried to look through the source code of webpage and I am able to crawl it through my custom python script. Apart from disabling right click there is very less security and web crawling and data scraping can be done in the given website easily. If you want to disable data scraping in your own website there are various method in which it can be done. Lets discuss on chat. Thanks
$25 USD em 1 dia
5,0 (3 avaliações)
2,4
2,4
Avatar do Usuário
It is quite simple just capture the response of that website with help of some proxy tools like burp, and many more. you will get all the ideas. This things are implemented in front end codings. You can add it, lot of solutions are available in google. It is a free bidding. Thank You.
$10 USD em 1 dia
0,0 (0 avaliações)
0,0
0,0
Avatar do Usuário
Protecting my website from crawler and scraper (30$). Hello! Question 1. How is protecting as such is possible? How did they install such blocking system to stay away from the crawl bot? - You can disable right clicks or control options using JavaScript Question 2. Do you know exact name of the service that the website is implementing to defend their own content? - .htaccess can be used to block ips and enhance security Question 3. Is it really possible to defend and block crawl/scraping access to your website and domain just like this website, Or it's just blocking it surface and it's actually possible to be by-passed? - disabling right clicks just stopping from surface Question 4. Could you try install the same system as the website? I linked? - Sure
$20 USD em 3 dias
0,0 (0 avaliações)
0,0
0,0

Sobre o cliente

Bandeira do(a) KOREA, REPUBLIC OF
Incheon, Korea, Republic of
5,0
15
Método de pagamento verificado
Membro desde fev. 9, 2019

Verificação do Cliente

Obrigado! Te enviamos um link por e-mail para que você possa reivindicar seu crédito gratuito.
Algo deu errado ao enviar seu e-mail. Por favor, tente novamente.
Usuários Registrados Total de Trabalhos Publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Carregando pré-visualização
Permissão concedida para Geolocalização.
Sua sessão expirou e você foi desconectado. Por favor, faça login novamente.