What are the responsibilities and job description for the Senior Databricks Engineer position at TALENT Software Services?
Role : Senior Databricks Engineer
Location : Remote Role
Duration : 6 Months Contract
Role Responsibilities
Lead Developer - Senior Data bricks engineer with ETL and Data engineering exp
We need ETL/ELT Data bricks engineers with Databricks Data engineering professional certification
- 15 experience of hands-on experience in data engineering with a focus on Databricks Independently design, build, and maintain complex, production-grade data pipelines on Databricks.
- Develop efficient ETL/ELT processes with a strong focus on data quality, consistency, and scalability.
- Build reusable frameworks for ingestion, transformation, and reconciliation across enterprise source systems.
- Apply and help improve engineering standards — pipeline architecture, coding standards, and ETL/ELT best practices.
- Strong hands-on background in Databricks, Python (PySpark), and SQL for large-scale data processing, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark Working knowledge of CI/CD pipelines, Git-based branching strategies, and DevOps practices.
- Work within an Agile delivery / Kanban methodology to deliver product increments in iterative cycles.
- Work with product and business partners to define roadmap, communication, architecture, adoption plans, and support models.
- Experience working on real-time data and streaming applications Experience with data modeling for data warehousing Experience in AWS or Azure cloud.
- Prefer associates with Databricks Data engineering certification
Salary : $65 - $75