This is a remote position.

Senior Data Engineer/Data Architect

Project Overview

The agency is the State Medicaid Agency for South Carolina. This agency is focused on the modernization of the State?s Medicaid Management Information System (MMIS). The modernization is a major undertaking and requires major transformation of culture, processes and technology. The modernization program supports the Department?s transition from primarily a fee-for-service payor of claims towards a program and policy driver for health outcomes primarily through managed care programs. The program?s strategy supports significant innovation in MMIS thinking and mindset and is aligned with MMIS innovation at the national level as well.

The Data Operations Hub (DOH) serves as the centralized platform and team responsible for ingesting, validating, transforming, securing, and provisioning all enterprise data to support analytics, reporting, operational efficiency, and regulatory compliance.

Duties/Responsibilities:

The Candidate will be a key member of the Data Operations Hub Team. Your role involves designing, developing, and implementing analytical data solutions that align with the Agency?s strategic goals. You will leverage your expertise in data architecture, data modeling, data migrations and data integration, collaborating with cross-functional teams to achieve target state architecture goals.

Represent the Data Operations Hub team in various forums, advising on Data Solutions.

Lead the design and maintenance of scalable data solutions, including data lakes and warehouses.

Collaborate with cross-functional teams to ensure data product solutions support business needs and enable data-driven decision-making.

Evaluate and select data technologies, driving the adoption of emerging technologies.

Develop architectural models using sparkx, or other data modeling tool available and other artifacts to support data initiatives.

Serve as a subject matter expert in specific areas.

Experience with modern data processing technologies such as Python, Java, Airflow, etc. using data mesh & data lake.

Contribute to the data engineering community and advocate for agency data practices.

Engage in hands-on coding and design to implement production solutions.

Optimize system performance by resolving inefficiencies.

Design reusable data frameworks using new technologies.

Requirements

Education and Certifications:

Bachelor?s or Master?s degree in Computer Science or related field.

Required Skills:

4 years? experience as a Data Engineer or similar role leading technologists to manage, anticipate and solve complex technical items within your domain of expertise

4 years? hands-on experience in system design, application development, and operational stability

4 years? experience and expertise in architecture disciplines and programming languages

4 years? experience and deep knowledge of data architecture, modeling, integration, cloud data services, data domain driven design, best practices, and industry trends in data engineering

4 years? practical experience with AWS/Azure services, and data engineering disciplines

4 years? advanced experience in one or more data engineering disciplines, e.g., ETL/ELT, event processing

4 years? proficiency in SQL, data warehousing solutions and cloud native relational databases, e.g., Snowflake, Athena, Postgres

Preferred Skills:

4 years? business architecture knowledge and experience with architecture assessment frameworks

Additional Skills:

Strong problem-solving, communication, and interpersonal skills

Ability to evaluate and recommend technologies for future state architecture

Benefits