What are the responsibilities and job description for the Senior Data Engineer -Medical position at Advantage Technical?
Senior Data Engineer (Hybrid) (Strong Python skills required)
Role Summary
As a Senior Data Engineer, you'll architect, build, and maintain scalable big data infrastructure that powers analytics and decision-making across the organization. You’ll lead the development of data pipelines, APIs, and models that transform raw data into actionable insights—ensuring systems run smoothly and securely in both cloud and on-prem environments.
Key Responsibilities
- Provide strategic guidance on data architecture, modeling, and metadata management to senior IT and business leaders.
- Design and implement data flows across digital products and platforms.
- Participate in data modeling, validation, and performance testing.
- Extract and prepare data to support analytical use cases and ensure development teams have access to required datasets.
- Collaborate with business units to translate CRM and analytics needs into scalable data structures and models.
- Partner with database teams to ensure data quality, accuracy, and integrity.
- Monitor analytics impact on business performance and stay informed on market trends.
- Develop sustainable, next-gen data solutions using modern technologies.
- Build automated, high-volume data pipelines for Hadoop and real-time streaming platforms.
- Create robust, maintainable systems with long-term support in mind.
- Develop data APIs and delivery services for internal operations, customers, and partners.
- Operationalize complex analytical models into production-ready solutions.
- Continuously integrate and deploy code across cloud and on-prem environments.
- Build applications from the ground up using technologies like Scala, Spark, Postgres, AngularJS, and NoSQL.
- Work closely with Product Managers and stakeholders in an agile, collaborative environment.
Education & Experience
- Bachelor’s or Master’s degree in Computer Science, Engineering, Bioinformatics, or related field.
- 5 years of hands-on experience in data engineering.
- Experience with HIPAA-compliant cloud platforms and healthcare data (FHIR, HL7, OMOP).
- Strong skills in PYTHON, SQL, Spark/Scala, and cloud tools like AWS Glue, EMR, S3, Lambda, ECS.
- Expertise in ETL development, data modeling (PostgreSQL, MongoDB), and integration (RESTful APIs, HL7/FHIR).
Tech Stack Highlights
Python | Spark | Scala | Kafka | Flink | AWS | Terraform | Postgres | AngularJS | NoSQL
