What are the responsibilities and job description for the Data QA (Azure Data Testing/PySpark Automation) position at Ccube?
Hello Sr Data QA Professional!
Nice to Have
• Experience in the Banking/Finance domain
📩 Interested candidates can apply or share their profiles with us at "rahul@ccube.com"
Hope you are doing well!
We are looking for an " Data QA (Azure Data Testing/PySpark Automation) in Indore, MP."
We are looking for an " Data QA (Azure Data Testing/PySpark Automation) in Indore, MP."
Below is the JD for review.
Job Title: Data QA (Big Data Testing/PySpark Automation)
Location: Indore, MP
Full Time
Experience: 5-10 Years
Must have:
Location: Indore, MP
Full Time
Experience: 5-10 Years
Must have:
- ETL/Data Testing/Azure Databricks Azure Data Factory: 5 years (Required)
- Strong SQL Python/Py Spark: 5 years (Required)
- Experienced in end-to-end of ETL (Data Pipeline) QA testing using various technologies in Azure cloud involving ingestion from varied data sources.
- Should be familiar with data warehousing target and intermediate structures ideally in environments using data lakes. Well versed in Databricks, SQL Database, Azure Data Factory, Azure Data Lake
- Must have hands-on experience in PySpark, SparkSQL, T-SQL
- Should be able to go through requirements, design specs and create appropriate test scenarios across various layers/stages of data pipelines.
- Should be able to write reusable PySpark and T-SQL script to validate data across layers.
- Experience of working in Databricks Delta Lake will be highly desirable.
- Ideally should have worked in a team using Agile methodology.
- Appreciation of data, its quality, and its usage for business benefit
- Very good communication and written skills
Nice to Have
• Experience in the Banking/Finance domain
📩 Interested candidates can apply or share their profiles with us at "rahul@ccube.com"