Lead Engineer - Data Engg & AI

Lead Data Quality Engineer

Summary

We are seeking a highly motivated and experienced Lead Data Quality Engineer to drive the implementation and execution of data quality initiatives within our organization. In this leadership role, you will be responsible for leading a team of data quality engineers, defining data quality standards, implementing automated data quality checks, and ensuring the reliability and integrity of our data assets. Experience with SODA (or similar data quality frameworks like Great Expectations, Deequ, etc.) is essential.

Responsibilities

• Utilize the data domain and Critical Data Elements (CDE) inventory provided by the domain architect to develop comprehensive data quality rules.
• Design, implement, and manage data quality rules using Soda, ensuring they are effectively integrated and applied within data pipelines to maintain high data integrity and accuracy.
• Lead and mentor a team of Data Quality Engineers, providing technical guidance and fostering a culture of data quality excellence.
• Define and promote data quality best practices, standards, and procedures across the organization.
• Collaborate with cross-functional teams (e.g., Data Engineering, Data Analytics, Business Intelligence) to ensure data quality is integrated into all data processes.
• Act as a subject matter expert on data quality, providing guidance and support to stakeholders.
• Implement and maintain data quality frameworks and tools, with a focus on SODA (or similar frameworks).
• Configure and customize data quality tools to meet specific business requirements.
• Develop and implement data quality rules, checks, and validations.
• Automate data quality monitoring, alerting, and reporting processes.
• Monitor data quality metrics and KPIs, and track progress against data quality goals.
• (Preferred) Demonstrate deep understanding and hands-on experience with SODA (or similar data quality frameworks).
• Utilize SODA to define data quality checks, configure data sources, and generate data quality reports.
  
  

Experience enabling Data Quality end-to-end for an enterprise is required.

• Hands-on experience working with at least one of the Data Quality Products (SODA or Similar) is required
• (Preferred) Experience integrating with other Data Governance products (Collibra or similar) to provide a seamless Data Quality experience