Job Details. Key Responsibilities. Migrate Cascading, Hadoop, and MapReduce workflows to Spark 3. Optimize data pipelines using Spark 3 features like Adaptive Query Execution. (AQE) and Dynamic Partition Pruning. Develop scalable solutions integrated with big data platforms and cloud. environments. Align modernization initiatives with infrastructure teams and organizational goals. Required Skills. 3 years of experience with Apache Spark (Spark 3....
Job Details. Key Responsibilities. Migrate Cascading, Hadoop, and MapReduce workflows to Spark 3. Optimize data pipelines using Spark 3 features like Adaptive Query Execution. (AQE) and Dynamic Partition Pruning. Develop scalable solutions integrated with big data platforms and cloud. environments. Align modernization initiatives with infrastructure teams and organizational goals. Required Skills. 3 years of experience with Apache Spark (Spark 3....