AWS Hadoop Spark Mongo DB

Encerrado Postado há 6 anos Pago na entrega
Encerrado Pago na entrega

I have setup AWS cluster with Hadoop, Spark and Mongo DB nodes

I just need help with ingesting raw data into Hadoop and Spark should read and process this data then store in Mongo DB.

Setup ETL pipeline :

Download and unzip the pageview dataset from a website

Ingest the raw data into Hadoop

Use Spark to read data from the Hadoop cluster and compute the per-language statistics

Store the per-language statistics into MongoDB directly from Spark

Write scripts for automation every month once

Amazon Web Services Big Data Sales Hadoop NoSQL Couch & Mongo Spark

ID do Projeto: #15500314

Sobre o projeto

13 propostas Projeto remoto Ativo em há 6 anos

13 freelancers estão ofertando em média $399 nesse trabalho

rutvikparmar

I have previously worked with Big Data Technologies like Spark and Hadoop and being a data scientist i have also worked with NoSQL databases like Cassandra and MongoDB. I can help you with ur project. Relevant Skills Mais

$200 CAD in 3 dias
(14 Comentários)
4.9
mihalm

Hi, I can propose you solution with AWS Pipeline using on-premise or on-demand EMR cluster for processing. Data flow and scheduling options will be fully managed from AWS Console. Relevant Skills and Experience I have Mais

$1722 CAD in 5 dias
(6 Comentários)
4.7
shivampanchal

I have a good hand on working with Advanced Excel, R and Python. I have quite a good knowledge of deep learning Algorithm , have also developed dashboards and Shiny Web Application in R Relevant Skills and Experience Mais

$250 CAD in 3 dias
(6 Comentários)
4.0
nirmaljeetverma

As per my expertise in this field, I can assure you that I can easily do this task. And my only aim is to provide you with the fastest and the best solution for your job. Relevant Skills and Experience Amazon Web Serv Mais

$155 CAD in 3 dias
(16 Comentários)
3.9
gkbhardwaj87

Hi, I have experience in hadoop/spark/java. for more info ping me Relevant Skills and Experience java/hadoop/spark/java Proposed Milestones $222 CAD - final

$222 CAD in 3 dias
(1 Comentário)
3.5
Ankit1007

Dear sir, I have a team of expert developer and designer who can give make any kind of application with their skill set. Relevant Skills and Experience I have seen requirements and I am 100 % sure that I can make i Mais

$155 CAD in 3 dias
(0 Comentários)
0.0
goncalocarito

This work is very similar with the one I did in a past job with the startup company Clickly where I was the main Data Scientist, so I did it before and I believe I am the best person to do it. Stay tuned, I'm still w Mais

$222 CAD in 3 dias
(0 Comentários)
0.0
deepyad

Would like to see current setup through screen sharing before accepting project Relevant Skills and Experience Java / J2EE / AWS 13 Years Exp Proposed Milestones $222 CAD - Would like to see current setup through scr Mais

$222 CAD in 3 dias
(0 Comentários)
0.0
vedprak21

A proposal has not yet been provided

$233 CAD in 3 dias
(0 Comentários)
0.0
datotahost

Hi, We will do this job by weekly $1200 usd .in this we do the hodoop work and informatica or tableau Relevant Skills and Experience hadoop ,informatica,tableau Proposed Milestones $1266 CAD - hadoop ,informatica

$1266 CAD in 7 dias
(0 Comentários)
0.0