Find Jobs
Hire Freelancers

C# console app to hit a lot of urls and save response data

$30-250 USD

Concluído
Publicado há mais de 9 anos

$30-250 USD

Pago na entrega
c# console app to hit urls from a txt file and save the response header meta data , we need to store each of the name value pairs from the header in to a column so it can be imported to a database or noSQL system. CSV is fine for output I will be hitting about 50K urls so I need the system to be threaded and use a lot of cores for concurrent connections. Ideally this is a setting in the console before it starts. either by setting concurrent requests or number of cores to occupy
ID do Projeto: 6596321

Sobre o projeto

24 propostas
Projeto remoto
Ativo há 10 anos

Quer ganhar algum dinheiro?

Benefícios de ofertar no Freelancer

Defina seu orçamento e seu prazo
Seja pago pelo seu trabalho
Descreva sua proposta
É grátis para se inscrever e fazer ofertas em trabalhos
Concedido a:
Avatar do Usuário
Hello, I'm Mathieu, a senior C# developer with around 10 years of experience in development with .net framework. I'm also skilled in Asp.Net/C#, WPF, WCF, Winforms, Html4/5, JQuery and much more. I made a lot of multi-threaded applications using ThreadPools or Parallel Framework (4.5). For your application I'd prefer using Parallel because the concurency can be set easilly. I'm new on Freelancer.com so it's quite difficult to get a job as people tend not to trust. But I'll be very grateful if you could give me chance, and you'll not be disappointed because I'm very serious and always want to satisfy 100% ! So please consider my bid. Regards, Mathieu
$50 USD em 3 dias
0,0 (0 avaliações)
0,0
0,0
24 freelancers estão ofertando em média $114 USD for esse trabalho
Avatar do Usuário
Hi, I can make this multi threaded program easily. I will give you a setting form where you can set how many threads you want at a time and output file path. Thanks
$111 USD em 3 dias
5,0 (80 avaliações)
6,4
6,4
Avatar do Usuário
Hello, I have 8 years of experience in .Net Technology. I can use multiple threading for your application. thanks Kalpesh
$98 USD em 3 dias
4,9 (63 avaliações)
5,7
5,7
Avatar do Usuário
Hi sir, I'm C# expert, and I did many projects like this one, so please let me do it. Thanks Mohamed
$155 USD em 3 dias
5,0 (35 avaliações)
5,6
5,6
Avatar do Usuário
Hi Sir, I am ready to work for you.I have 4 years of experience in .net/C#/sql. please see some of my works also check my reviews you will get better idea about my skill.I deliver quality work within time frame. Please visit my profile once. Please see customer feedback of previous work Thanks with regards, Arpit
$100 USD em 3 dias
5,0 (31 avaliações)
5,5
5,5
Avatar do Usuário
Hi sir, I'm interested in your project , I'm expert in c# and Microsoft technologies , about the core and thread the .net use threading bool to run the threads and it allocate cores as it want . I look forward to work for you and I will do my best . Thank you .
$90 USD em 3 dias
4,8 (5 avaliações)
4,0
4,0
Avatar do Usuário
Hello you! i can do it and finish 4 days. Please let me know.I looking forward on work your project. Thanks!
$105 USD em 4 dias
4,8 (16 avaliações)
3,8
3,8
Avatar do Usuário
Hi , I have done this kind of httpRequest projects a lot, because I work in a project where we have lot of Rest service calls, Saving responses and so on. Sure I can use threads. Please contact me for further details. Hope to work with you. Thanks, Ruwan
$111 USD em 3 dias
5,0 (8 avaliações)
3,4
3,4
Avatar do Usuário
I just wrote this in a short program. The 2 day timeline is just so I can make sure I understand exactly what you need in the form of output (which columns for CSV). The number of cores for optimization/parallelism can't be set specifically in .NET as that's a machine-code instruction, but I did parallelize it relatively easily by making the URL loop (one for each URL) reside in a Parallel.ForEach. If you don't want to peg the processor, a max number of concurrent clients is relatively straight forward to do. Since the WebClient class hosts most of this functionality, it's a few hours work to adjust it to the input/output you want. Since you've hired me in the past I got this project via email; it looked interesting so I coded it out to see if I could do it pretty quickly, and it turns out it's a relatively short program to make it work. Best of luck in your search!
$100 USD em 2 dias
5,0 (7 avaliações)
3,4
3,4
Avatar do Usuário
Hello, I read through the job details carefully and I am sure that I can do the project very well. I would love to start working on your project as soon as possible. Best regards, pragmatechdev
$90 USD em 3 dias
5,0 (8 avaliações)
3,1
3,1
Avatar do Usuário
Hi, billy01 i worked with you before in C# programe that get img tages not containg alt attribute i am expert in scrapiing jobs most of my work here is scraping work can do thiis console application using c# payment after job completion by milestone waiting your answer Regards
$100 USD em 2 dias
4,9 (8 avaliações)
3,1
3,1
Avatar do Usuário
Hi My name is Hoai. I come from Viet Nam. I fluent with C# and can do your job. Pls contact me. Thank
$250 USD em 5 dias
4,2 (2 avaliações)
1,2
1,2
Avatar do Usuário
I have worked in multithreading and content-fetching from website. This project is doable for me. Please let me know if you are interested or you would like to negotiate on the bid amount
$55 USD em 2 dias
5,0 (1 avaliação)
0,7
0,7
Avatar do Usuário
I have 5 years of programming experience. I can help you solve this problem. When you work with me you will feel very comfortable.
$90 USD em 3 dias
4,0 (1 avaliação)
0,4
0,4
Avatar do Usuário
Hello, I am a .net developer with 4 years of experience in asp, ado, c#, vb.net and Sql server. I will arrange the order without problems within a specified period. If you would be interested in my offer plese give me more information about the job.
$50 USD em 3 dias
5,0 (1 avaliação)
0,0
0,0
Avatar do Usuário
Hi Bill, I've worked with you before on Json Console App. I'm able to do it in the same day you accept bid. Thanks.
$55 USD em 0 dia
0,0 (0 avaliações)
0,0
0,0
Avatar do Usuário
Hello, I have many years of experience with C# and multithreading. I can create this application for you in a couple of days if t all the requirements are in the project description. If you have more, we could discuss about a better price that could fit between us. Regards, Jacobo
$222 USD em 2 dias
0,0 (0 avaliações)
0,0
0,0
Avatar do Usuário
A proposal has not yet been provided
$111 USD em 12 dias
0,0 (0 avaliações)
0,0
0,0
Avatar do Usuário
Dear sir , I am a .NET developer I can do your project if I have the chance , lets talk in details and start Regards Tariq
$188 USD em 3 dias
0,0 (0 avaliações)
0,0
0,0
Avatar do Usuário
70 $ and i have it ready and tested. So i can send you the project in 0 days. Best regards Krastan Petrov
$77 USD em 0 dia
0,0 (0 avaliações)
0,0
0,0
Avatar do Usuário
I have the basic framework to hit the URL and write the name-value pairs from the headers to a CSV file. It can be delivered within a couple of days of your order. r There are a few questions to be addressed. Some header values have comas(,) within the contents hence we cannot have the output as a CSV file. We need to have some other delimiter like (=>) to identify the columns in the output file. How do we connect the HEADERs with the URL, shall we have the URL as another column, it will repeat for several rows. For using large number of processor cores, the application itself do not have any control and cannot select the number of cores to be used, it OS that decides how much of processor time to be allocated depending on the process running and their priority. We can create a threadpool object within the application. You can set the MAX and MIN threads for the threadpool. VS2012 provides another way to handle parallel running of tasks i.e. ASYNC and AWAIT, with these objects the main thread will not be blocked the application will be very responsive to user actions. Another important issue we need to consider is some of the URLs may fail with certain exceptions, what do we do with such URLs, log into a separate file all such cases?, we can chat over Skype and discuss all such issues to be resolved.
$111 USD em 5 dias
0,0 (0 avaliações)
0,0
0,0

Sobre o cliente

Bandeira do(a) UNITED STATES
Austin, United States
4,9
454
Método de pagamento verificado
Membro desde mai. 9, 2004

Verificação do Cliente

Obrigado! Te enviamos um link por e-mail para que você possa reivindicar seu crédito gratuito.
Algo deu errado ao enviar seu e-mail. Por favor, tente novamente.
Usuários Registrados Total de Trabalhos Publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Carregando pré-visualização
Permissão concedida para Geolocalização.
Sua sessão expirou e você foi desconectado. Por favor, faça login novamente.