What are the responsibilities and job description for the Databricks Engineer position at Jobility Talent Solutions?
Core Responsibilities
- Develop, configure, optimize, and maintain Databricks solutions
- Build and optimize data pipelines, notebooks, AI/BI dashboards, and semantic models
- Implement governance and security using Unity Catalog
- Support AI-driven features like Genie Rooms and NL-to-SQL capabilities
- Manage CI/CD, GitHub integration, and environment promotion (Dev/UAT/Prod)
- Work closely with data engineering, analytics, and business teams
- Deliver technical documentation, KT sessions, and production-ready solutions
Must-Have Skills
- Databricks Core
- Strong hands-on experience with Databricks
- Databricks Notebooks
- Delta Lake
- Medallion Architecture (Bronze / Silver / Gold)
- Unity Catalog (governance, lineage, permissions, security)
- Python
- SQL
- YAML
- AI/BI Dashboards in Databricks
- Semantic Modeling
- DevOps / Deployment
- GitHub integration
- CI/CD pipelines
Good-to-Have Skills
- Databricks Agents / Agent Bricks
- Agentic AI workflows
- RAG (Retrieval-Augmented Generation)
- AI orchestration patterns
Nice-to-Have Skills
- Databricks Apps
- Databricks One
- Microsoft Power BI integration