What are the responsibilities and job description for the Data Engineer position at HR Pundits?
Seeking a Senior Java Developer to design and implement high-performance data processing applications. You will bridge the gap between traditional ETL and modern cloud-native big data ecosystems. Technical Stack: Core Development: Java, Scala, Python. Big Data: Spark (Core/SQL/Streaming), Ab Initio (ETL design & integration). Cloud: AWS (S3, EMR, Lambda, Glue). Scripting/Automation: Shell Scripting (Bash), Python.
Job Responsibilities
Ab Initio, spark, scala AWS, python, shell scripting:
Key Responsibilities:
Develop scalable data pipelines using Spark and Scala within AWS.
Integrate legacy Ab Initio workflows with modern cloud-based environments.
Automate system tasks and deployments using Shell Scripting and Python.
Optimize complex SQL queries and data transformations for maximum performance.
Collaborate with stakeholders to translate business requirements into technical specs.