What are the responsibilities and job description for the Onsite - Data Engineer position at MetroSys?
Overview
MetroSys is seeking an experienced Data Engineer with a strong background in Python and Microsoft Azure environments. The ideal candidate will have at least 5 years of experience in building and optimizing data pipelines, managing data storage solutions, and integrating systems through APIs. This role will focus on developing robust data pipelines and warehouse solutions to support enterprise-level data initiatives.
Key Responsibilities
Design, develop, and maintain scalable data pipelines to support analytics, reporting, and operational workloads.
Build and optimize data storage solutions in Microsoft Azure, including Azure Data Lake and related services.
Integrate third-party and internal systems using APIs for data ingestion and synchronization.
Collaborate with data architects, analysts, and business stakeholders to ensure data solutions meet requirements.
Implement best practices for data governance, quality, and security across the pipeline lifecycle.
Monitor, troubleshoot, and improve pipeline performance and reliability.
Qualifications
5 years of hands-on experience as a Data Engineer or similar role.
Strong proficiency with Python for data manipulation, automation, and pipeline development.
Proven experience in Microsoft Azure data services (Azure Data Factory, Data Lake, Synapse, SQL Database).
Solid understanding of data warehouse concepts and storage optimization techniques.
Experience designing and consuming APIs for system integration.
Strong problem-solving skills and ability to work independently in a remote environment.
Preferred Skills:
Knowledge of cloud security practices and compliance requirements.
Familiarity with CI/CD pipelines for data workflows.
Experience with large-scale enterprise data projects.