What are the responsibilities and job description for the Senior Data Engineer position at Sovereign Technologies?
Job Description:
What are they looking for:
Dev Engineer capabilities (this is the core of the role)
App dev experience (scripting, especially in python)
Expert in AI or Automation (this would be a huge plus)
NOTE: they understand this might be a unicorn, so these are listed in priority with 2 and 3 being bonuses
Proficient in data manipulation and pipeline development
· Experience processing large datasets in a distributed environment
·Hands-on experience with Databricks notebooks, workflows, and cluster management
· Moderate hands-on experience with S3, Lambda, Glue, and EC2
· Experience scheduling and automating pipelines
· Strong SQL skills for complex data extraction and transformation queries
· Comfortable with version control in a collaborative, shared-repo environment
· Comfortable creating and managing issues and epics
Summary
· Modernize data pipeline from SAS to Python/PySpark on Databricks.
o This Data Engineer will own and evolve our critical HEDIS data pipeline.
§ HEDIS data is delivered to our analytics vendor and used to measure BCBS’s performance across key dimensions of care.
o This role will initially partner with SMEs during a knowledge transfer period. They will eventually take on pipeline ownership.
Salary : $70