ABOUT VAXCARE

Are you looking for a DevOps role that can meaningfully impact the physical health of the United States' population for the next 20 years? Do you want to provide automation environments and developer workflows that enable us to transform how healthcare vaccinates? VaxCare is a vaccine dispensing platform that leverages proprietary technology to improve immunization rates and overall vaccine program profitability. We are problem solvers at heart. We love to tackle challenges with an analytical spin, and we are constantly looking for ways to employ new technologies to develop tools and solutions that help accomplish our vision of every person fully vaccinated.

THE POSITION

You’ll be a key member of VaxCare’s Market Group, joining our Data Analytics team and reporting to our Data Science Lead. We are seeking a highly skilled and experienced Data Engineer to join our team. As a Data Engineer, you will play a critical role in the design, development, and management of our data processing and analytics infrastructure. The ideal candidate will have extensive hands-on experience working with Spark and Databricks, as well as a strong background in data engineering principles and best practices.

RESPONSIBILITIES

· Design, develop, and maintain scalable and reliable data pipelines on Spark using Databricks.

· Collaborate with cross-functional teams to understand data requirements and translate them into technical specifications.

· Architect and optimize data storage and processing solutions, ensuring scalability and performance.

· Design and Build ETL jobs to support Enterprise data warehouse

· Drive architectural plans and implementation for future data storage, reporting, and analytic solutions

· Implement data quality checks and data cleansing techniques to ensure data integrity.

· Troubleshoot and resolve issues related to data pipelines and data processing.

· Collaborate with data scientists and analysts to understand analytic requirements and implement data transformations.

· Work closely with DevOps and infrastructure teams to ensure smooth deployment and operation of data pipelines.

· Develop and maintain documentation for data pipelines, data models, and infrastructure configurations.

· Keep up to date with the latest advancements in data engineering and apply them to improve our data infrastructure.

EXPERIENCE AND QUALITIES DESIRED

· Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree is preferred

· Minimum of 5 years of experience as a Data Engineer, with a focus on Spark and Databricks.

· Strong programming skills in Python & SQL. Scala Optional.

· Extensive experience with Spark, including batch processing and streaming.

· Hands-on experience with Databricks, including knowledge of notebooks, jobs, and clusters.

· Experience writing and optimizing SQL queries in a business environment with large-scale, complex datasets

· Detailed knowledge of databases like Oracle / DB2 / SQL Server, data warehouse concepts and technical architecture, infrastructure components, ETL and reporting/analytic tools and environments.

· Familiarity with data modeling and data warehousing concepts.

· Experience with cloud platforms such as Azure or AWS.

· Knowledge of DevOps practices and version control systems.

· Strong problem-solving and analytical skills.

· Excellent communication and collaboration abilities.

· Certification in Spark or Databricks is preferred.