Find Jobs
Hire Freelancers

AWS S3 text files to Relational Database

$30-250 AUD

Concluído
Publicado há aproximadamente 7 anos

$30-250 AUD

Pago na entrega
A little background - I am using AWS to manage a mountain bike timing system. Competitors tag on and off a number of different stages and the tag off time minus the tag on time is the stage racetime and the lowest cumulative time over all stages wins. Out on the racecourse, I am using Raspberry Pi's with RFID readers which collect and store data in text files which automatically upload to the AWS S3 bucket. I currently have two files in there: Stage 1 [login to view URL] and Stage 1 Finish.txt. I need to get these files into a database to join with a competitor registration database so I can ultimately compute racetimes in AWS, extract some analytics and allow competitors to search and compare times using their surname or racing number to find their race times. In short, I need help converting these text files into a relational database and this process is automated so that when new items are appended to the text files that they update the database. I think a Data Pipeline is the way to go but happy to listen to alternative recommendations to achieve my ultimate goals as described above. The text file item/row is semi-colon delimited as follows: [login to view URL];1s;2016/12/30;13:56:23.235;00235689 Meaning log information (not needed), 1s (Stage 1 Start), Date, Time to milliseconds and finally the RFID code. Any help with the Data Pipeline (or another alternative) is required as soon as possible. Thanks Steve
ID do Projeto: 12676953

Sobre o projeto

17 propostas
Projeto remoto
Ativo há 7 anos

Quer ganhar algum dinheiro?

Benefícios de ofertar no Freelancer

Defina seu orçamento e seu prazo
Seja pago pelo seu trabalho
Descreva sua proposta
É grátis para se inscrever e fazer ofertas em trabalhos
Concedido a:
Avatar do Usuário
I am highly skilled in the AWS environment. I have been working with AWS for 5 years now and run multiple production workloads across many AWS services. I have both the AWS Devops Engineer and AWS Certified Solutions Architect certifications. I have also passed AWS exams here at Freelancer (in the 99th percentile). I attend the AWS re:Invent conference every year and stay current with their latest services and offerings. If you are serious about finding a real engineer with real-life AWS experience building highly-scalable, fault tolerant applications while following AWS best practices then look no further. I eat, sleep and breathe AWS architecture and work with it every day. I would like to discuss more with you on how exactly the files are uploaded to S3. I can see the upload triggering a Lambda function that would import the data into RDS. Open up a private chat to discuss any specifics. I look forward to hearing from you.
$250 AUD em 3 dias
5,0 (23 avaliações)
5,1
5,1
17 freelancers estão ofertando em média $175 AUD for esse trabalho
Avatar do Usuário
I have 9 years experience in JAVA, J2EE, WebServices and enough experience in AWS webservices. I am not sure if we can dine the pipeline such that it extracts te file and fills the required columns of a relational database. We can use lambda function which can be triggered by S3 action and there we can read the file and process and populate the required relational database.
$166 AUD em 5 dias
4,9 (25 avaliações)
5,6
5,6
Avatar do Usuário
Hi, I have over 7 years of experience as a database developer. I have completed three recent projects. All clients were 100% satisfied as you can see from their reviews. One of the projects I completed recently was very similar to yours. The db was hosted on aws. I created the db, created the schema and procedures, installed the schema. This was for the food app. The client was super happy with the work. I can start your project right away and complete in 3 days.
$170 AUD em 3 dias
5,0 (9 avaliações)
4,2
4,2
Avatar do Usuário
Hello there i have read your description, i will recommend a web application for this, can you please contact to discuss in details? i am waiting for your pm thanks
$250 AUD em 3 dias
4,9 (8 avaliações)
3,7
3,7
Avatar do Usuário
I can write a php script which can load data from text file to database. I would love ot work on something new and good thing ..
$155 AUD em 3 dias
5,0 (14 avaliações)
3,9
3,9
Avatar do Usuário
Hello there. I think lambda could be the solution for you. I can take care of this task if you wish I am an experienced developer with strong aws knowledge
$155 AUD em 3 dias
5,0 (1 avaliação)
3,7
3,7
Avatar do Usuário
i have similar experience working with S3 and mysql db.
$222 AUD em 4 dias
5,0 (1 avaliação)
2,6
2,6
Avatar do Usuário
Hi sir, We assure you the quality of service through various checks that are employed to avoid any compromise on quality of work. Let me introduce my team to you and generally what services we offer to our clients. We are team of expert engineers and developers who are sound experienced in embedded systems (arduino + other microcontrollers), programming, circuit designs, electronics, product designs, pcb layouts, database management, MySQL etc. We offer you our services at very low rates. Please discuss with us in details. We will deliver design and code, if you want us to send you prototype, you have to pay additional charges of prototyping and courier such as dhl etc. We are very friendly in nature and help our clients during and after projects completion. We are flexible in communications and rates. Very much looking forward to hear from you on this in coming days. Regards, Ahmed Lead Technical Engineer Turktroniks
$150 AUD em 8 dias
4,2 (1 avaliação)
3,2
3,2
Avatar do Usuário
Have 4.5 years of experience in Java, REST, Data Structures and Algorithms, SQL and NoSQL(MongoDB, Redis), Spring, Hibernate hence I will be a good help for this project. I had recently worked with Rajhees, C.E.O, MD , Dn Infoway and she had appreciated my work. She is one among the 5 females who have made it big in freelancer. Will continue to work with the same dedication. https://www.freelancer.in/community/freelancing/women-s-day-special-5-freelancers-who-found-success I need some more clarity on the exact requirement.
$155 AUD em 3 dias
0,0 (0 avaliações)
0,0
0,0
Avatar do Usuário
Hello! I can do the job u need. I think Python is the best solution for you as it's covering all your needs. On the other hand maybe it makes sense to use logstash to transform and send data to your database and do all the analytics on-the-fly in browser by calling simple API that is used as proxy to MySql. After project discussion I can suggest the best solution.
$222 AUD em 10 dias
0,0 (0 avaliações)
0,0
0,0

Sobre o cliente

Bandeira do(a) AUSTRALIA
Mandurah, Australia
5,0
20
Método de pagamento verificado
Membro desde out. 12, 2014

Verificação do Cliente

Obrigado! Te enviamos um link por e-mail para que você possa reivindicar seu crédito gratuito.
Algo deu errado ao enviar seu e-mail. Por favor, tente novamente.
Usuários Registrados Total de Trabalhos Publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Carregando pré-visualização
Permissão concedida para Geolocalização.
Sua sessão expirou e você foi desconectado. Por favor, faça login novamente.