What are the responsibilities and job description for the Senior Big Data QA Engineer- 7+ yrs- New York, United States- Onsite position at iMedhas Consulting Services?
Job Requirements SDETPosition Summary:The SDET (Software Development Engineer in Test) is responsible for ensuring the qualityand reliability of ETL processes and data integration workflows. This role involves designingand implementing automated tests to validate data transformation and migration, as well ascollaborating with data engineers and developers to identify and resolve data quality issues.The ideal candidate will leverage their expertise in ETL testing and data validation toenhance the overall data pipeline performance and integrity. Minimum Qualification:? At least 8 years of IT experience with minimum 5 years of experience in below skills:? Tech Skills? Proficiency in ETL Testing and developing automation framework &testcases in atleast one scripting language.? Strong SQL skills, with experience in handling big data using ETL tools (e.g.,Informatica).? Mandatory work experience with PySpark? Testing experience in cloud environment (AWS)? S3, SSS, Glue, EMR, Data Catalog, Crawler, SQS, ETL Jobs, Event Bridge.? Athena, Redshift Spectrum Databases.? AWS Commands for running the jobs, file process and movements.? Experience with Test Automation and DevOps practices in ETL and Cloud Systems.? Experience with Test Automation and DevOps practices in ETL and Cloud? Work experience in a Big Data ecosystem processing data in datalakehouse.? Familiarity with DBT (Data Build Tool) or similar data transformation tools is aplus.? Experience providing testing oversight in Agile team.? Should have excellent business communication to interact with Business teams andcross-functional teams.Responsibilities:? Review requirements, specifications, and technical design documents to understandand feedback.? Experience in developing and implementing test strategies for complex initiatives.? Estimate, prioritize, plan and coordinate testing activities.? Create automation test framework.? Design, develop and execute automation scripts.? Identify, record, document thoroughly and track bugs.? Strong problem-solving skills, troubleshooting, and root cause analysis skills.? Perform thorough regression testing when bugs are resolved.? Develop and apply testing processes for new and existing features to meet clientneeds.Work Experience 7-10Years