Big data project

Hi, I have 8 years of experience and working on hadoop, spark, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud with hadoop, hive, spark and presodb. Worked on multiple etl project like springboot, angular, node, PHP, Kafka, nifi, flume, mapreduce, spark with XML/JSON., Cassandra, mongodb, hbase, redis, oracle, sap hana, ASE.... Many more. Let's discuss the required things in detail. I am committed to work done and strong in issue resolving as well. Thanks

I am currently doing very similar role for other client based on hourly rate and available immediately. Below is my summary. I have extensive Big Data experinece, and designed and delivered a metadata-driven data ingestionI have extensive Big data experience and develped a number of PySpark/Scala framework which ingests data from various data sources to Data Hub (HDFS) then integrates, transforms, and publishes to target sources including Kafka, RDBMS (Teradata, Oracle, and SQL Server) and SFTP, etc. Technologies used for the project including Python, Spark, Spark SQL, Hadoop, HDFS, Hive, Cassandra, Hbase, Kafka, NIFI, and Atlas. I created Scala/PySpark based framework which ingests data from customer rating bureau including Equifax, Illion, and Experian. Designed the entire JSON/XML explosion pattern which involves multi-level JSON/XML explosion and normalized table creation in HDFS platform using Scala/PySpark, Hive, SparkSQL, and Hbase. Created entire downstream conceptual, logical, and physical data models for downstream users including credit risk analysts and data scientists.

Thank you for your attention. I read the project description with interest. I strongly believe I am the proper candidate. I fit all the requirements you mentioned, including Python. I can help you kindly and full time. Please check my profile and past reviews. Let us discuss in more detail through chat. Thanks.

Hi, I am a bigdata developer and a module lead in reputed MNC.i an into the IT industry for more then 12 years. I have tonnes of experience in developing projects using Java,Apache Spark,Hive,Kafka,Scoop,Pig,Scala,aws,Spark streaming and managing cluster on aws cloud and Azure. I Have deployed multiple spark job on HDinsight and communication with data lake 1 and 2. I have my youtube channel too on AWS and BigData with the name of Cloudgeeks. I have delivered multiple lectures on setting up apache Spark on AWS EMR... I can be the best suitable person for your requirements I have also created multiple freelance project on AWS EMR,S3,REKOGNITION, RDS, and many more services Let me know your view Regards,

I am a professional data scientist from Scotland, I have a vast amount of experience working with ML, AI and machine learning projects. I am available to discuss your project further when you are here.

Hi, I have worked with Hadoop and spark. I would like to work on performance comparison between them. Let me know if you want to discuss further. Regards, Monir

I have 15 years of experience out of 4 years dedicate into bigdata applications using hadoop and spark. Worked in a migration project for performance improvement from pig/hive to spark/scala. Also worked on application to tune spark jobs for better utilization of resource and scale jobs in cluster. Surely handle your project nicely and delivered on time .

This is Mohanraj V. I have completed Master of Computer Applications.I have 6 years of IT experience in Data scientist and Hadoop development including Python,HDFS,HIVE, PySpark ,HBase and Experienced in SQL and PL/SQL developments,Unix Shell Scripts,Python programmings. • Experience in multi-tiered distributed environment, OOAD concepts, good understanding of Software Development Lifecycle (SDLC). • Experience implementing Object Oriented Python, Hash Tables (Dictionaries) and Multithreading and MYSQL. • Good knowledge in establishing database connections for Python by configuring packages MySQL-Python. • Implemented ML and DL using Python by usisng problem solving techniques • Strong experience of software development in Python (libraries used: libraries- Beautiful Soup,scikit-learn, NumPy, SciPy, matplotlib, Pandas, urllib2, MySQLdb for database connectivity) and IDEs –Anaconda and Pycharm.

 Expertise in all components of Hadoop Ecosystem- Hive, Hue, Pig, Sqoop, HBase, Flume, Zookeeper, Oozie, Apache Flink and Apache Spark.  Responsible for writing MapReduce programs using Java.  Logical Implementation and interaction with HBase.  Developed MapReduce jobs to automate transfer of data from HBase.  Experience in developing Pig scripts and Hive Query Language.  Performed data analysis using Hive and Pig.  Used Hbase in accordance with PIG/Hive as and when required for real time low latency queries.  Managing and scheduling batch Jobs on a Hadoop Cluster using Oozie.  Expertise in Java/J2EE technologies such as Core Java, Struts, Hibernate, JDBC, JSP, JSTL, HTML, JavaScript, JSON.  Fluent with the core Java concepts like I/O, Multi-threading, Exceptions, RegEx, Collections, Data-structures and serialization.  Experience in Object Oriented Analysis Design (OOAD) and development of software using UML Methodology, good knowledge of J2EE design patterns and Core Java design patterns.

I have experience in real life big data projects. I am certified bigdata consultant. I can build the quality project in less time based on the complexity level you need. I will need more information about your requirements. I am giving average bid price.

Hello Bid. I am computer science engineer and an enthusiast Data analyst. I have experience in Hadoop , Spark, R, Python , Tableau,Excel SQL ,MongoDb and Big Query. I have experience in data cleaning, wrangling, data visualization and statistical analysis. I am basically good with Exploratory Data Analysis . So if you have projects related to any of these technologies you can contact me. Thanks