What are the responsibilities and job description for the Big Data/Azure Data Engineer Lead with Healthcare PAYER background position at SmartIT Frame?
Job Details
Role: Big Data/Azure Data Engineer Lead with Healthcare PAYER background
Location: Philadelphia, PA (Hybrid Onsite 3 days/week)
Hire type: Contract
Experience: 14 years in Data Engineering with at least 3 years in real-world Azure cloud projects
Job Description:
- We are seeking a Big Data Lead with a strong background in Azure Data Engineering and Healthcare Payer domain expertise.
- The ideal candidate will have deep hands-on experience with Azure ADF, Azure Databricks, PySpark, and Synapse Analytics, along with a proven track record in designing and implementing scalable, secure data pipelines in cloud environments.
Must-Have Skills:
- Azure Data Factory (ADF), Azure Databricks (ADB), Azure Data Lake Gen2
- PySpark, Python, Spark SQL
- Synapse Analytics
- TIDAL Scheduler
- Strong ETL and database design experience
Domain Expertise: Healthcare Payer industry experience is mandatory
Security & Compliance: Experience with PII/PHI data handling, encryption, IAM, and data governance
Leadership: Proven experience leading cloud migration and mentoring teams
Soft Skills: Strong communication, stakeholder collaboration, and problem-solving abilities.