What are the responsibilities and job description for the Data Engineer position at Everest Technologies, Inc.?
Role Overview:We are seeking a highly skilled and motivated Data Engineer to join our team in a critical, urgent role. This position is key to building and maintaining robust data solutions. The ideal candidate will possess a strong foundation in data warehousing principles and a keen design mindset to handle complex data challenges.Key Responsibilities:• Design, build, and maintain scalable and efficient ETL/ELT data pipelines to ingestdata from internal and external sources (e.g., APIs from EPIC, Workday, relationaldatabases, flat files). and data warehouse to ensure data is clean, accessible, and ready for analysis andmodel training.• Collaborate with the Data Analyst and other stakeholders to understand their datarequirements and provide them with clean, well-structured datasets.• Implement data governance, security, and quality controls to ensure data integrityand compliance.• Automate data ingestion, transformation, and validation processes.• Work with our broader IT team to ensure seamless integration of data infrastructurewith existing systems.• Contribute to the evaluation and implementation of new data technologies andtools.Required Skills & Qualifications:• ETL/ELT Development: Strong experience in designing and building data pipelinesusing ETL/ELT tools and frameworks.• SQL: Advanced proficiency in SQL for data manipulation, transformation, andoptimization.• Experience with EPIC EMR and Informatica is required.• Programming: Strong programming skills in Python (or a similar language) forscripting, automation, and data processing.• Data Warehousing: Experience with data warehousing concepts and technologies.• Cloud Computing: Hands-on experience with at least one major cloud platform'sdata services (e.g., Microsoft Azure Data Factory, Azure Fabric, IICS).• Version Control: Proficiency with Git for code management and collaboration.• Problem-Solving: Proven ability to troubleshoot and resolve data pipeline issues.• Data Modeling: Experience with various data modeling techniques (e.g.,dimensional modeling).• Real-time Processing: Familiarity with real-time data streaming technologies (e.g.,Kafka, Azure Event Hubs).• Education: Bachelor's degree in Computer Science, Engineering, or related field.Main Skill Sets Azure: Experience with Microsoft Azure data services.Fabric: Familiarity or experience with Microsoft Fabric.Informatica Cloud or PowerCenter: Hands-on experience with either Informatica Cloud or PowerCenter.Epic Experience: Highly preferred, but not a mandatory requirement.Work Arrangement: The position allows for remote work but local candidates are strongly preferred.
Salary : $110,600 - $132,800