What are the responsibilities and job description for the Azure Databricks Technical Lead position at SIRITECH SOLUTIONS CORP?
Role
Azure Databricks Technical Lead
Duration
3 Months (Contract with Possible Extension)
City
Boston Area
State
Massachusetts
Title
Azure Databricks Technical Lead
Primary Skills
Azure Databricks, PySpark, Spark SQL, Azure Synapse Analytics, Delta Lake, Azure Data Lake Storage (ADLS), Power BI, Python, Advanced SQL
Secondary Skills
Oracle EBS R12, Oracle PBCS, Data Warehousing, ETL/ELT Pipelines, Data Modeling, Performance Tuning, Lakehouse Architecture, Offshore Team Leadership, Client Stakeholder Management
Total Required Experience in Years: 12 Years
Mode of Work: Remote (Occasional Travel Required)
Job Description
Seeking an experienced Azure Databricks Technical Lead to drive the design, architecture, and implementation of a modern Azure Data Platform. The consultant will work closely with client stakeholders, provide technical leadership, architect scalable data solutions, and mentor offshore development teams.
The ideal candidate will possess deep expertise in Azure Databricks, Azure Synapse Analytics, Lakehouse architecture, enterprise data warehousing, and Power BI while serving as the primary technical lead for client-facing engagements.
Key Responsibilities
Azure Databricks Technical Lead
Duration
3 Months (Contract with Possible Extension)
City
Boston Area
State
Massachusetts
Title
Azure Databricks Technical Lead
Primary Skills
Azure Databricks, PySpark, Spark SQL, Azure Synapse Analytics, Delta Lake, Azure Data Lake Storage (ADLS), Power BI, Python, Advanced SQL
Secondary Skills
Oracle EBS R12, Oracle PBCS, Data Warehousing, ETL/ELT Pipelines, Data Modeling, Performance Tuning, Lakehouse Architecture, Offshore Team Leadership, Client Stakeholder Management
Total Required Experience in Years: 12 Years
Mode of Work: Remote (Occasional Travel Required)
Job Description
Seeking an experienced Azure Databricks Technical Lead to drive the design, architecture, and implementation of a modern Azure Data Platform. The consultant will work closely with client stakeholders, provide technical leadership, architect scalable data solutions, and mentor offshore development teams.
The ideal candidate will possess deep expertise in Azure Databricks, Azure Synapse Analytics, Lakehouse architecture, enterprise data warehousing, and Power BI while serving as the primary technical lead for client-facing engagements.
Key Responsibilities
- Lead Azure Databricks architecture, development, and implementation activities.
- Design and develop scalable ETL/ELT pipelines using PySpark and Spark SQL.
- Build and optimize Lakehouse solutions using Delta Lake and Azure Data Lake Storage (ADLS).
- Design enterprise-grade Azure Synapse Analytics data warehouse solutions.
- Develop and maintain Power BI semantic models, datasets, and dashboards.
- Integrate data from Oracle EBS R12 and Oracle PBCS source systems.
- Perform data modeling, SQL optimization, and performance tuning.
- Lead technical discussions, architecture reviews, and solution design sessions.
- Mentor and guide offshore development teams.
- Support deployment, testing, release management, and production stabilization activities.
- Collaborate with business stakeholders to define data platform requirements and solutions.
- Establish best practices for data engineering, governance, and performance optimization.
- Azure Databricks
- PySpark
- Spark SQL
- Azure Synapse Analytics
- Delta Lake
- Azure Data Lake Storage (ADLS)
- Power BI
- Python
- Advanced SQL
- Data Warehousing
- ETL/ELT Development
- Data Modeling
- Performance Tuning
- Lakehouse Architecture
- Oracle EBS R12
- Oracle PBCS
- Technical Leadership
- Client-Facing Consulting
- Enterprise Azure Data Platform Architecture
- Data Lakehouse Implementations
- Offshore Team Management
- Data Governance
- Cloud Data Migration
- Business Intelligence Architecture
- Solution Design Reviews
- Agile Delivery Methodologies
- 12 years of Data Engineering, Data Warehousing, or Data Architecture experience.
- Expert-level experience with Azure Databricks.
- Strong experience with PySpark and Spark SQL.
- Experience designing Azure Synapse Analytics solutions.
- Experience building Lakehouse architectures using Delta Lake and ADLS.
- Strong Power BI development and semantic modeling experience.
- Experience integrating Oracle EBS R12 and Oracle PBCS data sources.
- Advanced SQL and performance tuning expertise.
- Strong communication and stakeholder management skills.
- Experience leading technical teams and architecture discussions.
- Experience leading enterprise Azure Data Warehouse initiatives.
- Experience managing offshore development teams.
- Strong consulting and client engagement experience.
- Experience supporting production deployments and stabilization activities.
- Azure certifications preferred.
- Azure Data Platform Architecture
- Databricks ETL/ELT Pipelines
- Lakehouse Solutions
- Azure Synapse Data Warehouse Designs
- Power BI Dashboards and Semantic Models
- Data Integration Frameworks
- Technical Design Documents
- Performance Optimization Reports
- Deployment and Release Documentation
- Knowledge Transfer Documentation
- Production Support Documentation
- Bachelor's Degree in Computer Science, Information Systems, Engineering, Data Science, or related field.
- Microsoft Azure Certifications (Preferred)
- Databricks Certifications (Preferred)
- Azure Data Engineer Associate (Preferred)
- Azure Solutions Architect Expert (Preferred)