What are the responsibilities and job description for the DataBrick Engineer- Visa Independent position at Jobs via Dice?
Mandatory Skills: Databricks Developer, and DataBric Admin ,and Databricks Support.
8 years of experience in data engineering, with at least 3 years on Databricks.
8 years of experience in data engineering, with at least 3 years on Databricks.
- Strong proficiency in PySpark, SQL, and Delta Lake.
- Hands-on experience with Google Cloud Platform Dataproc.
- Responsibilities:**
- **Administration**:
- Lead the installation and configuration of Databricks on Google Cloud Platform cloud platforms.
- Monitor platform health, performance, and cost optimization.
- Implement governance, logging, and auditing mechanisms.
- **Development / Enhancements**:
- Design and develop scalable ETL/ELT pipelines using PySpark, SQL, and Delta Lake.
- Collaborate with data engineers and analysts to enhance data workflows and models.
- Optimize existing notebooks and jobs for performance and reliability.
- **Operations, Support & Troubleshooting**:
- Provide L2/L3 support for Databricks-related issues and incidents.
- Troubleshoot cluster failures, job errors, and performance bottlenecks.
- Maintain technical documentation for platform setup, operations, and development standards