Summary

We are seeking a highly skilled and experienced Senior Data Engineer to join our team! Our Senior Data Engineers play a critical role in designing, implementing, and maintaining our data infrastructure and data pipelines. They collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to build highly reliable and scalable data pipelines supporting our automation systems. This role uses various methods to transform raw data into useful data systems, create algorithms, and conduct statistical analysis. Our ideal candidate is analytical and forward-thinking, highly detail-oriented, and passionate about solving complex problems with innovative solutions.

Responsibilities

• Develop data models, data schemas, and data storage strategies that support data processing, analytics, and reporting needs.
• Design, implement, and optimize data pipelines, ETL processes, and data integration workflows to extract, transform, and load data from various sources into target systems. Ensure data pipelines are robust, scalable, and efficient.
• Implement data validation, data cleansing, and data profiling techniques to ensure data accuracy, consistency, and integrity.
• Monitor, tune, and optimize data pipelines, data processing workflows, and data storage mechanisms to improve performance, scalability, and efficiency.
• Identify and resolve performance bottlenecks and optimize data retrieval and processing.
• Ensure compliance with relevant regulations (e.g., GDPR, HIPAA) and industry best practices related to data security and privacy.
• Work closely with data scientists, analysts, and business stakeholders to understand analytical requirements and enable efficient data exploration, analysis, and visualization.
• Collaborate on the development of data models and algorithms for advanced analytics and machine learning.
• Create and maintain comprehensive documentation, including technical specifications, data dictionaries, and operational procedures.
• Share knowledge and provide training to team members and stakeholders on data engineering best practices and technologies.

Qualifications

• 5 years of experience as a Data Engineer or similar role.
• Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent work experience.
• Strong knowledge of data engineering concepts, data integration, ETL processes, and data warehousing principles.
• Strong knowledge in Python and experience with SQL and NoSQL databases required.
• Experience with big data technologies and frameworks (e.g., Hadoop, Spark) and cloud-based data platforms (e.g., AWS, Azure, Google Cloud Platform).
• Experience with data visualization tools (e.g., Tableau, Power BI) and data modeling concepts.
• Solid understanding of data governance, data quality, and data management best practices.
• Strong analytical and problem-solving skills with attention to detail.
• Excellent communication and interpersonal skills to collaborate effectively with cross-functional teams and stakeholders.
• Strong leadership skills and the ability to mentor and guide junior team members.
• Passion for growing your skills, tackling interesting work and complex problems.
• Has fun and contributes to a positive culture!