What are the responsibilities and job description for the Lead Data Engineer position at Conexess Group?
Job Title: Lead Data Engineer
Overview:
The Lead Data Engineer plays a key role in shaping the design, architecture, and strategic direction of mission-critical data systems. This position provides technical leadership, sets standards and best practices, and helps define the roadmap that supports the company's long-term data and analytics vision. The role will also focus on evaluating and integrating data across core business units, enabling more effective decision-making and insights. Responsibilities include the development and documentation of processes for data collection, transformation, and storage to support analytical initiatives.
Key Responsibilities:
Overview:
The Lead Data Engineer plays a key role in shaping the design, architecture, and strategic direction of mission-critical data systems. This position provides technical leadership, sets standards and best practices, and helps define the roadmap that supports the company's long-term data and analytics vision. The role will also focus on evaluating and integrating data across core business units, enabling more effective decision-making and insights. Responsibilities include the development and documentation of processes for data collection, transformation, and storage to support analytical initiatives.
Key Responsibilities:
- Lead the design, prototyping, and development of data solutions for new and ongoing projects.
- Oversee all aspects of data engineering including gathering requirements, ensuring security, aggregating and modeling data, building ETL pipelines, data cleansing, and delivery.
- Review and collaborate with other Data Engineers, ensuring alignment with enterprise standards, internal patterns, and best practices.
- Serve as a key liaison between technical, functional, and business teams, as well as external partners and system integrators.
- Partner with Solution Architects to develop solution proposals and cost estimates for data initiatives.
- Conduct technical design reviews to ensure scalability, alignment with product roadmaps, and fulfillment of business requirements.
- Support data governance efforts by adhering to security policies and compliance standards.
- Proactively identify and resolve data-related issues and performance bottlenecks.
- Maintain detailed documentation of data models, pipelines, and related processes.
- Mentor and support junior team members in their development.
- Deliver work accurately and on time while maintaining high levels of customer service.
- Bachelor’s degree in Computer Science, Data Analytics, Engineering, or a related field.
- At least 7 years of experience in IT systems analysis, application development, or data engineering.
- 7 years of hands-on experience in data engineering, ETL development, data warehousing, or data science.
- 5 years in a technical leadership role such as Tech Lead or Senior Staff Engineer.
- Extensive experience with Microsoft Azure data tools and platforms.
- Strong coding skills in Python and SQL.
- Proficiency with Microsoft data tools including Azure Data Factory, Azure Databricks, Azure SQL, SQL Server, Microsoft Fabric, and Azure Synapse (formerly Azure Data Warehouse).
- Solid understanding of data governance, security, and compliance best practices.
- Excellent analytical, problem-solving, and strategic thinking abilities.
- Ability to troubleshoot and optimize data pipelines for performance and scalability.
- Strong interpersonal, leadership, and communication skills.
- Excellent organizational and time-management abilities with a commitment to meeting deadlines.
- Must be comfortable with hands-on development work and adapting to shifting priorities.
