What are the responsibilities and job description for the Data Engineer (Snowflake, AWS Glue Specialist) position at capgemini?
Responsible for designing developing and maintaining scalable data pipelines and ETL processes using AWS Glue This role involves working closely with data engineers analysts and other IT professionals to ensure data is efficiently integrated transformed and made available for business use
Skills:
Snowflake Snowpark The candidate should have a deep understanding of Snowflake data warehousing platform and be proficient in using Snowpark for data processing and analytics
DBT Experience with DBT Data Build Tool for modeling data and creating data transformation pipelines is a plus
AWS services Airflow The candidate should have hands-on experience with AWS services particularly Apache Airflow for orchestrating complex data workflows and pipelines
AWS services Lambda Proficiency in AWS Lambda for serverless computing and event driven architecture is essential for this role
AWS services Glue The candidate should be well versed in AWS Glue for ETL Extract Transform Load processes and data integration
Fivetran HVR Working knowledge and hands-on experience on Fivetran HVR
Python Strong programming skills in Python are required for developing data pipelines data transformations and automation tasks
Responsibilities:
Design develop and maintain data pipelines and ETL processes using Snowflake AWS services Python and DBT
Collaborate with data scientists and analysts to understand data requirements and implement solutions
Optimize data workflows for performance scalability and reliability
Troubleshoot and resolve data related issues in a timely manner
Stay updated on the latest technologies and best practices in data engineering
Design and implement scalable ETL solutions using AWS Glue
Collaborate with data engineers and analysts to understand data requirements
Develop and manage data extraction transformation and loading processes
Optimize and improve existing data pipelines and ETL workflows
Ensure data quality and integrity during the transformation process
Monitor and troubleshoot issues with ETL jobs
Maintain detailed documentation of data workflows and processes
Stay updated with the latest AWS services and tools
Qualifications:
Bachelors degree in Computer Science Engineering or related field
Proven experience in data engineering roles with a focus on Snowflake AWS services Python and DBT
Strong analytical and problem solving skills
Excellent communication and teamwork abilities
Technical certifications are a plus
Bachelors degree in Computer Science Information Technology or a related field
3 years of experience working with AWS Glue and other AWS data services
Proven experience in designing and maintaining ETL processes
Strong knowledge of SQL and database management
Familiarity with data warehousing concepts and tools
Experience with Python or other scripting languages
Excellent problem solving and analytical skills
Strong communication and teamwork abilities
The pay range that the employer in good faith reasonably expects to pay for this position is $36.98/hour - $57.79/hour. Our benefits include medical, dental, vision and retirement benefits. Applications will be accepted on an ongoing basis.
Tundra Technical Solutions is among North America’s leading providers of Staffing and Consulting Services. Our success and our clients’ success are built on a foundation of service excellence. We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Unincorporated LA County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: client provided property, including hardware (both of which may include data) entrusted to you from theft, loss or damage; return all portable client computer hardware in your possession (including the data contained therein) upon completion of the assignment, and; maintain the confidentiality of client proprietary, confidential, or non-public information. In addition, job duties require access to secure and protected client information technology systems and related data security obligations.
Salary : $37 - $58