Hello,
I am an 4+ years experienced Big Data Developer having expertise in big data technology stack. I have designed, developed and implemented projects which include reading of data to spark from various sources such as local file systems, cloud, kafka and kinesis, processing of the data to meet the business requirements using Spark SQL and DML and writing the data to various formats and locations using both PySpark and Scala Spark in my professional career. I also have worked on Spark streaming and Spark Structures streaming projects as well.
I am excited to work on this assignment. Please drop me a message so that we can discuss further in the requirements and come up with an action pan.
Thank you.!