What are the responsibilities and job description for the Senior Databricks Engineer - REMOTE position at Sligo Software Solutions Inc.?
Mandatory Skills
Technical Recruiter
Sligo Software Solutions Inc.
lakshmi@sligosoft.com
www.sligosoft.com
Direct: (518) 675-8512
Office: (518) 444 0459 x 119
Fax : (518) 444 0457
- 7 years of experience in Data Engineering, with strong recent hands-on Databricks experience.
- Strong hands-on experience with Databricks, Apache Spark, PySpark, and Python.
- Strong SQL and data engineering experience.
- Experience building scalable ETL/ELT data pipelines using Databricks.
- Strong experience with Delta Lake and Databricks Lakehouse architecture.
- Experience with Azure Databricks or AWS Databricks.
- Experience with Databricks Workflows, Jobs, notebooks, and performance optimization.
- Experience integrating data from databases, APIs, files, and cloud data sources.
- Experience with CI/CD, Git, and DevOps practices.
- Experience with data modeling, data quality, and data governance.
- Healthcare / Health Insurance experience is highly preferred.
- Must be hands-on development focused; avoid candidates whose background is primarily production support or management.
Technical Recruiter
Sligo Software Solutions Inc.
lakshmi@sligosoft.com
www.sligosoft.com
Direct: (518) 675-8512
Office: (518) 444 0459 x 119
Fax : (518) 444 0457