Scala Spark Project to Group Values stored in MySQL and CSV.

All, I need two spark jobs written in Scala to do some groupings on data stored in: Note: Both have the same data stored * Note: For the MySQL, please use SPARKSQL. Note: Please use SBT as build tool for the project (I am happy to provide an example spark-project built with scala, sbt so you can use that as starting point without worrying with all the dependencies and issues) Job #1) Reads from MySQL database and saves output to MySQL database Job #2) Reads from a given directory containing one or more CSV file(s) and saves output to a CSV file in a new directory location. Input of MySQL: [login to view URL]!9/137127/1 Input of CSV: (Attached as: [login to view URL]) I expect that once I run the spark job, it will give me the following output: Output of MySQL: [login to view URL]!9/802f692/1 Output of CSV: (Attached as: [login to view URL]) The groups need to do the following: LOGIC: A: IF field column "message_originator" and "account_id" are same and IF the column value of "start_ts" is in the SAME DAY (unix_epoch_timestamp).... then output 1 row adding the column values of "msg_parts_vol" and "whole_msg_vol" and "freq". Think of it as a summary row of one-or-many-rows. B: In the output result, please use the beginning of date (unix_epoch_timestamp) in the "start_ts" column. C: The spark job should take in two args: (1: start_ts) and (2: end_ts) and then when it queries the MySQL or CSV, it should only process group rows for which "start_ts" falls within that unix_epoch_timestamp. D: The spark job should be able to take in a fixed argument: (eg: LAST_3_DAYS) and it should be able to convert that automatically to unix_epoch_timestamp of current time minus 3 days to work out "start_ts" and "end_ts". To explain this further for example: if at the time of spark job running command current time is: 2020-11-09 13:15:00 UTC and we use "LAST_3_DAYS" then "start_ts" should be (1604620800) which is 2020-11-06 00:00:00 UTC and "end_ts" should be (1604880000) which is 2020-11-09 00:00:00 UTC E: The spark job once it is completed, should store the final rows "end_ts" value in a new table. e.g: [login to view URL]!9/e15c54/1 or if it is CSV then like (Attached as: [login to view URL])