What are the responsibilities and job description for the Databricks Architect position at Talent Groups?
Job Description:
Experience- 12 Years of IT Experience with 5 Years in Databricks Architecture
Databricks Architect who brings both technical expertise and domain knowledge of the drilling business.
We are seeking a highly experienced Databricks Architect with strong expertise in modern data platforms and a deep understanding of the Oil & Gas Drilling business
Key Responsibilities
Architecture & Technology Leadership
- Design and implement enterprise-scale data platforms using Databricks, Azure/AWS cloud technologies, and modern data architectures.
- Define end-to-end data architecture, data models, integration patterns, security, governance, and performance optimization strategies.
- Establish architectural standards, best practices, and implementation frameworks across projects.
- Lead modernization initiatives involving data lakes, lakehouse architecture, real-time analytics, AI/ML enablement, and cloud migration programs.
Technical Skills
- Strong expertise in Databricks Lakehouse Platform.
- Hands-on experience with:
- Apache Spark
- Delta Lake
- Unity Catalog
- Databricks Workflows
- MLflow
- Structured Streaming
- Strong experience with Azure Data Services and/or AWS Data Analytics services.
- Expertise in Data Warehousing, Data Lakes, ETL/ELT, Data Modeling, and Analytics platforms.
- Experience implementing scalable enterprise data architectures.
- Strong knowledge of SQL, Python, Spark, and cloud-native solutions.
Domain Expertise
- Strong understanding of Oil & Gas Drilling Operations.
- Experience working with drilling, well planning, rig performance, production, operational analytics, and drilling data management.
- Ability to engage effectively with drilling business stakeholders and translate business needs into technical solutions.