What are the responsibilities and job description for the ETL Data Engineer position at The Brite Group Incorporated?
ETL Data Engineer
We are seeking an ETL/Data Engineer with expertise in Informatica and Microsoft technologies, particularly Azure cloud, Microsoft Synapse, Azure Purview, Azure AI etc. The ideal candidate will possess strong skills in ETL development, data lake architecture, data catalog, data quality, and data integration as well as proficiency in Python and SQL programming. This role offers the opportunity to work with cutting-edge technologies and contribute to the development of robust data solutions for a Federal Agency.
Responsibilities:
- Design, develop, and maintain data integration solutions using Informatica PowerCenter.
- Implement and optimize data pipelines within Microsoft Synapse Analytics, Azure environment, Erwin, and other ETL technologies.
- Architect and manage data lake infrastructure to support data ingestion, integration, storage, and processing.
- Design and develop data mappings and data catalogs.
- Implement and manage Informatica Data Quality (IDQ) for data validation and standardization.
- Utilize Informatica Power Exchange for efficient data extraction and loading from various sources.
- Manage Master Data Management (MDM) solutions to ensure consistent and high-quality data across systems.
- Collaborate with cross-functional teams to gather requirements and define data integration strategies.
- Develop custom scripts and applications using Python for data transformation and manipulation tasks.
- Ability to create reports and dashboards using tools like Tableau, Power BI, Python, etc.
- Ensure data quality and integrity throughout the data integration process.
- Troubleshoot and resolve issues related to data processing and integration workflows.
- Stay updated with the latest trends and best practices in data integration and cloud technologies.
- Participate in code reviews, documentation, and knowledge-sharing sessions.
Qualifications:
- Bachelor’s degree in computer science, Information Technology, or a related field.
- Minimum 6 years of relevant experience.
- Informatica certification(s) and Microsoft certification(s) in Synapse Analytics and Azure (preferred).
- Proven experience in designing and implementing data integration solutions using Informatica PowerCenter.
- Strong understanding of cloud-based data platforms, particularly Microsoft Azure.
- Hands-on experience with Microsoft Synapse Analytics for data warehousing and analytics.
- Proficiency in Python programming for data manipulation, transformation, and automation tasks.
- Familiarity with data lake architecture and best practices for managing structured and unstructured data.
- Experience with Informatica IDQ, Power Exchange, and MDM.
- Excellent problem-solving skills and attention to detail.
- Ability to work effectively in a fast-paced, collaborative environment.
- Strong communication skills with the ability to articulate technical concepts to non-technical stakeholders.
- US citizen with active Secret clearance
Salary : $130,000 - $140,000