Databricks Engineer

Databricks Engineer

3–6 Years

Full-Time

Hyderabad / Remote / Hybrid

We are looking for an experienced Databricks Engineer to design, develop, and maintain scalable data engineering solutions using Databricks and cloud-based data platforms. The candidate will work on data pipelines, ETL/ELT processes, data transformation, and analytics solutions.

• Databricks
• Apache Spark / PySpark
• Python
• SQL
• Data Engineering
• ETL / ELT
• Delta Lake
• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS)
• Data Pipelines
• Cloud Data Platforms

• Azure / AWS / GCP
• Data Warehousing
• Apache Kafka
• Git / GitHub
• CI/CD
• REST APIs
• Terraform
• Power BI
• Performance Optimization

• Develop and maintain scalable data pipelines using Databricks and PySpark.
• Design ETL/ELT workflows for processing large datasets.
• Build and optimize Delta Lake tables and data processing jobs.
• Develop data solutions using cloud platforms such as Azure, AWS, or GCP.
• Integrate data from multiple sources into data lake and data warehouse environments.
• Optimize Spark jobs and Databricks workloads for performance and cost.
• Implement data quality, validation, and error-handling processes.
• Collaborate with data scientists, analysts, and application teams.
• Implement CI/CD practices for data engineering workflows.
• Troubleshoot production data pipelines and resolve data-related issues.

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• 3 years of experience in Data Engineering.
• Strong hands-on experience with Databricks, PySpark, Python, and SQL.
• Experience working with cloud data platforms.
• Good understanding of data modeling, ETL/ELT, and data warehousing concepts.
• Strong analytical and problem-solving skills.

• Databricks Certified Data Engineer
• Microsoft Azure Data Engineer Associate
• AWS Certified Data Engineer

Competitive / Based on Experience