What are the responsibilities and job description for the AWS Data Engineering position at LTIMindtree?
Role Description
We are looking for AWS Data Engineer who primarily should have skill on AWS GLUE and AWS EMR
Below Is The Job Description
AWS Data Engineer
Torrance CA Onsite
Experience
5 years of experience in data engineering database design ETL processes and data warehousing
3 years of experience with AWS tools and technologies S3 EMR Glue Athena RedShift RDS Spectrum and Airflow
2 years of experience with CICD tools
Strong knowledge of data storage and processing technologies including databases and data lakes based distributed computing frameworks eg Hadoop Spark
3 in programming languages such as Python Java or Scala
Nice to have Informatica Cloud experience IDMC
Detailed Responsibilities
Develop and Maintain Data Integration Solutions
Design and implement data integration workflows using AWS GlueEMRAWS MWAAAirflow Lambda Redshift
Demonstrate proficiency in Pyspark Apache Spark and Python for data processing large datasets
Ensure data is accurately and efficiently extracted transformed and loaded into target systems
Ensure Data Quality and Integrity
Validate and cleanse data to maintain high data quality
Ensure data quality and integrity by implementing monitoring validation and error handling mechanisms within data pipelines
Optimize Data Integration Processes
Enhance the performance optimization of data workflows to meet SLAs scalability of data integration processes and costefficiency on AWS cloud infrastructure
Identify and resolve performance bottlenecks finetuning queries and optimizing data processing to enhance Redshifts performance
Regularly review and refine integration processes to improve efficiency
Support Business Intelligence and Analytics
Translate business requirements to technical specifications and coded data pipelines
Ensure timely availability of integrated data for business intelligence and analytics
Collaborate with data analysts and business stakeholders to meet their data requirements
Maintain Documentation and Compliance
Document all data integration processes workflows and technical system specifications
Ensure compliance with data governance policies industry standards and regulatory requirements
Skills
Mandatory Skills : Apache Spark,Java,Athena,Aurora,Python,RDS,Redshift,AWS Glue,AWS Lambda,AWS S3,Scala,ANSI-SQL,Aws Step Functions,Python for DATA
Good to Have Skills : Apache Spark, Python, RDS, Redshift, AWS Glue, AWS Lambda, AWS S3, Scala, ANSI-SQL, Aws Step Functions
Other Details
Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree (“LTIM”):
Benefits And Perks
Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting.
LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.
Benefits
Compensation range: $ 100,000.00 to 135,000.00 per year
We are looking for AWS Data Engineer who primarily should have skill on AWS GLUE and AWS EMR
Below Is The Job Description
AWS Data Engineer
Torrance CA Onsite
Experience
5 years of experience in data engineering database design ETL processes and data warehousing
3 years of experience with AWS tools and technologies S3 EMR Glue Athena RedShift RDS Spectrum and Airflow
2 years of experience with CICD tools
Strong knowledge of data storage and processing technologies including databases and data lakes based distributed computing frameworks eg Hadoop Spark
3 in programming languages such as Python Java or Scala
Nice to have Informatica Cloud experience IDMC
Detailed Responsibilities
Develop and Maintain Data Integration Solutions
Design and implement data integration workflows using AWS GlueEMRAWS MWAAAirflow Lambda Redshift
Demonstrate proficiency in Pyspark Apache Spark and Python for data processing large datasets
Ensure data is accurately and efficiently extracted transformed and loaded into target systems
Ensure Data Quality and Integrity
Validate and cleanse data to maintain high data quality
Ensure data quality and integrity by implementing monitoring validation and error handling mechanisms within data pipelines
Optimize Data Integration Processes
Enhance the performance optimization of data workflows to meet SLAs scalability of data integration processes and costefficiency on AWS cloud infrastructure
Identify and resolve performance bottlenecks finetuning queries and optimizing data processing to enhance Redshifts performance
Regularly review and refine integration processes to improve efficiency
Support Business Intelligence and Analytics
Translate business requirements to technical specifications and coded data pipelines
Ensure timely availability of integrated data for business intelligence and analytics
Collaborate with data analysts and business stakeholders to meet their data requirements
Maintain Documentation and Compliance
Document all data integration processes workflows and technical system specifications
Ensure compliance with data governance policies industry standards and regulatory requirements
Skills
Mandatory Skills : Apache Spark,Java,Athena,Aurora,Python,RDS,Redshift,AWS Glue,AWS Lambda,AWS S3,Scala,ANSI-SQL,Aws Step Functions,Python for DATA
Good to Have Skills : Apache Spark, Python, RDS, Redshift, AWS Glue, AWS Lambda, AWS S3, Scala, ANSI-SQL, Aws Step Functions
Other Details
Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree (“LTIM”):
Benefits And Perks
- Comprehensive Medical Plan Covering Medical, Dental, Vision
- Short Term and Long-Term Disability Coverage
- 401(k) Plan with Company match
- Life Insurance
- Vacation Time, Sick Leave, Paid Holidays
- Paid Paternity and Maternity Leave
Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting.
LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.
Benefits
Compensation range: $ 100,000.00 to 135,000.00 per year
Salary : $100,000 - $135,000
