What are the responsibilities and job description for the Sr. AWS Data Engineer position at Cognizant?
Job Summary
The ideal candidate should have expertise in Spark Optimization AWS DevOps AWS Glue Studio AWS Glue ETL AWS Glue Catalog Amazon S3 and Apache Spark. This role involves optimizing data processes and contributing to innovative solutions that drive our companys success.
Responsibilities
The ideal candidate should have expertise in Spark Optimization AWS DevOps AWS Glue Studio AWS Glue ETL AWS Glue Catalog Amazon S3 and Apache Spark. This role involves optimizing data processes and contributing to innovative solutions that drive our companys success.
Responsibilities
- Implement AWS DevOps practices to streamline deployment and operational processes ensuring seamless integration and delivery.
- Utilize AWS Glue Studio to design and manage ETL workflows facilitating efficient data transformation and movement. - Leverage AWS Glue ETL to automate data extraction transformation and loading processes improving data accessibility and usability.
- Manage AWS Glue Catalog to maintain a comprehensive and organized metadata repository ensuring data consistency and discoverability.
- Oversee Amazon S3 storage solutions to ensure secure and scalable data storage enabling efficient data retrieval and management.
- Provide technical guidance and support to team members fostering a collaborative and knowledge-sharing environment.
- Ensure compliance with data security and privacy regulations safeguarding sensitive information and maintaining trust.
- Document and maintain detailed records of data processes and solutions supporting transparency and knowledge retention.
- Technical Skills: AWS Data Pipeline creation AWS Glue Studio Apache Spark AWS DevOps Amazon S3 AWS Glue ETL AWS Glue Catalog Pyspark SQL concepts and Data Modelling concepts.
- Functional Skills: Configuration Management Technology Trends Root Cause Analysis Knowledge Management Requirements Management Test & Defect Management.
- Leadership and Professional development Skills: Execution Excellence Innovation Effective Communication Client Focus Drive results with accountability Drive vision and purpose Build trust collaboration and transparency Promote engagement Drive change and innovation