What are the responsibilities and job description for the Senior Data Engineer - Databricks position at RADcube?
Job Title: Senior AWS Data Engineer
Location: Indianapolis, IN
Role Overview
We are seeking a highly skilled AWS Data Engineer to support a strategic STRADA Modernization initiative. This role focuses on building and supporting a modern AWS Databricks Lakehouse platform to enable advanced healthcare analytics (RWD/HEOR). The ideal candidate will have strong hands-on experience with AWS, Databricks, and data pipeline development, along with the ability to work closely with both technical and business stakeholders.
Key Responsibilities
Required Qualifications
Location: Indianapolis, IN
Role Overview
We are seeking a highly skilled AWS Data Engineer to support a strategic STRADA Modernization initiative. This role focuses on building and supporting a modern AWS Databricks Lakehouse platform to enable advanced healthcare analytics (RWD/HEOR). The ideal candidate will have strong hands-on experience with AWS, Databricks, and data pipeline development, along with the ability to work closely with both technical and business stakeholders.
Key Responsibilities
- Design, develop, and maintain data ingestion pipelines for real-world data (RWD) sources
- Build and optimize data models within a Databricks Lakehouse architecture
- Ensure data governance, quality, and compliance standards are met
- Optimize cost, performance, and resource utilization across AWS and Databricks
- Collaborate with business and technical stakeholders to translate requirements into scalable solutions
- Provide technical guidance, coding standards, and best practices
- Support knowledge sharing through documentation and training sessions
- Deliver status updates and progress reports to senior leadership
Required Qualifications
- Strong hands-on experience with AWS services (S3, Glue, Lambda, Redshift, etc.)
- Proven experience with Databricks (Delta Lake, notebooks, workflows)
- Expertise in SQL and Python
- Experience building end-to-end ETL/ELT data pipelines
- Strong understanding of data modeling techniques
- Experience with data governance, quality, and compliance frameworks
- Ability to work independently and in a collaborative team environment
- Databricks Certification
- Experience building and managing CI/CD pipelines
- Experience with workflow orchestration tools
- Exposure to data observability and lineage tools
- Experience with monitoring, logging, and observability frameworks
- Experience in Healthcare / Pharma domain
- Exposure to RWD (Real World Data) or HEOR analytics
- Familiarity with Lakehouse architecture / Medallion (Bronze-Silver-Gold) models
- Experience optimizing cost and performance in cloud environments
- Strong communication and stakeholder management skills