What are the responsibilities and job description for the Lead Data Engineer position at Reliable Software Resources?
Job Title: Lead Data Engineer
Location: Eagan, MN (hybrid onsite)
Contract to Hire: 3-6 months
Summary
Modernize data pipeline from SAS to Python/PySpark on Databricks.
This Data Engineer will own and evolve our critical HEDIS data pipeline.
HEDIS data is delivered to our analytics vendor and used to measure BCBS’s performance across key dimensions of care.
This role will initially partner with SMEs during a knowledge transfer period. They will eventually take on pipeline ownership.
What are they looking for:
1. Dev Engineer capabilities (this is the core of the role)
2. App dev experience (scripting, especially in python)
3. Expert in AI or Automation (this would be a huge plus)
Technical Skills
· Proficient in data manipulation and pipeline development
· Experience processing large datasets in a distributed environment
· Hands-on experience with Databricks notebooks, workflows, and cluster management
· Moderate hands-on experience with S3, Lambda, Glue, and EC2
· Experience scheduling and automating pipelines
· Strong SQL skills for complex data extraction and transformation queries
· Comfortable with version control in a collaborative, shared-repo environment
· Comfortable creating and managing issues and epics
Educational Qualifications:
· Required - Bachelor’s degree in Computer Science, Information Technology, Computer Engineering or closely related or equivalent.
· Preferred - Master’s degree in Management Information Systems (MIS), Computer Science, Big Data or Analytics or equivalent.
Travel:
· Open to travel based-up on the nature of the engagement.
Thanks & Regards
Srikanth Donkani
Resource Manager
(w):
(E):
2260 Haggerty Road, Suite 285 Northville, MI 48167
Equal Employment Opportunity
Reliable Software employment does not discriminate on the basis of race, religion, gender, sexual orientation, age or any other basis as covered by federal, state, or local law.
Employment decisions are based solely on qualifications, merit and business needs.