What are the responsibilities and job description for the Senior Data Platform Engineer position at Selby Jennings?
About the job
The Role
The Role
We are seeking a remote Senior Data Engineer - Data Platform to help design, build, and operate a modern, secure, cloud‑native data platform supporting healthcare analytics and external data products. This role focuses on enterprise‑scale data engineering, governance, and platform reliability in highly regulated environments.
This is a hands‑on, high‑ownership role with close collaboration across software engineering, analytics, data science, and business teams. You will influence data architecture decisions and play a critical part in how data is delivered, secured, and consumed across the organization.
- Design and implement scalable data warehouse and lakehouse solutions using Databricks
- Build and evolve enterprise‑level medallion architectures optimized for performance and reliability
- Architect, build, and maintain batch and near‑real‑time data pipelines
- Develop ETL/ELT workflows using SQL, Python, Scala, Delta Live Tables, and cloud‑native tooling
- Manage ingestion and transformation of large‑scale structured and unstructured healthcare datasets
- Configure and maintain enterprise data governance, lineage, and data quality frameworks
- Implement strong data security controls for sensitive, identified, and de‑identified PHI/PII data
- Design and maintain standardized data models aligned with healthcare frameworks (e.g., FHIR, OMOP)
- Partner with engineering, analytics, data science, and business stakeholders to gather requirements and deliver solutions
- Build infrastructure‑as‑code using Terraform and support cloud platform deployments
- Support data platform migrations and integrations using tools such as Fivetran and custom solutions
- Monitor, optimize, and improve pipeline reliability, performance, and cost efficiency
- Develop analytics‑enablement tools that help internal teams accelerate insights and product innovation
- Identify and implement platform and process improvements through automation and architectural enhancements
- 5 years of experience designing and building enterprise data platforms (data warehouses, data lakes, or data products)
- Advanced hands‑on experience with Databricks and AWS‑based data solutions
- Strong experience with relational and non‑relational databases (e.g., PostgreSQL, SQL Server, MongoDB)
- Experience managing large, multi‑source healthcare datasets (structured and unstructured)
- Expertise in building, monitoring, and optimizing data pipelines and ETL frameworks
- Experience with data security, governance, performance tuning, and release management
- Familiarity with healthcare interoperability standards (FHIR, C‑CDA, HL7)
- Knowledge of clinical vocabularies and ontologies (ICD‑10, SNOMED, LOINC, RxNorm, NDC)
- Experience deploying infrastructure‑as‑code using Terraform and Git‑based workflows
- Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field
- Experience working within health insurance or life sciences domains
- Exposure to regulated environments requiring strong data privacy and compliance practices
- Cloud architecture or solution certifications (AWS and/or Azure)
Salary : $105,000 - $195,000