What are the responsibilities and job description for the IT Cloud Data Engineer position at Advocate Health Care?
Major Responsibilities
Drive scope definition, requirements analysis, data and technical design, pipeline build, product configuration, unit testing, and production deployment.
Design scalable ingestion processes to bring on-prem, API drive, 3rd party, end user generated data sources to integrate in common cloud infrastructure.
Design reusable assets, components, standards, frameworks, and processes to accelerate and facilitate data integration projects.
Develop data integration and transformation jobs using Python, SQL and ETL /ELT tools.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
Develop and implement scripts for data process maintenance, monitoring, and performance tuning.
Test and document data processes through data validation and verification procedures.
Ensure delivered solutions meet/perform to technical and functional/non-functional requirements.
Provide technical guidance and mentorship to junior engineers, ensuring best practices in data engineering.
Licensure, Registration, And/or Certification Required
None required.
Education Required
Bachelor's Degree in Computer Science or related field.
Experience Required
Typically requires 5 years of experience in at least two IT disciplines, including database management, cloud engineering, data engineering and middleware technologies. Includes 2 years of work experience with cloud platforms, including experience with data integration, performance optimization, and platform administration.
Knowledge, Skills & Abilities Required
Experience defining, designing, and developing solutions with data integration platforms/tools.
Proven experience building and optimizing data pipelines, and data sets.
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Must have experience in data transformation and data pipeline development using GUI based tools or programming languages like SQL and Python.
Proficiency in Python and SQL for scripting and building data transformation processes is preferred.
Must have experience with DevOps tool chains and processes.
Physical Requirements And Working Conditions
DISCLAIMER
All responsibilities and requirements are subject to possible modification to reasonably accommodate individuals with disabilities.
This job description in no way states or implies that these are the only responsibilities to be performed by an employee occupying this job or position. Employees must follow any other job-related instructions and perform any other job-related duties requested by their leaders.