What are the responsibilities and job description for the Azure Databricks Architect position at KaashTech LLC?
PFB must-have skills list and JD too:
Azure Databricks – Plus 4 years recent experience
ADF 3 years minimum
SQL 3 years minimum
Comm skills – excellent
not mandatory Azure Databricks certification plus
Job Summary:
We are seeking a highly skilled and motivated Technical Team Lead with extensive experience in Azure Databricks to join our dynamic team. The ideal candidate will possess a strong technical background, exceptional leadership abilities, and a passion for driving innovative solutions. As a Technical Team Lead, you will be responsible for guiding a team of developers and engineers in the design, development, and implementation of data driven solutions that leverage Azure Databricks.
Responsibilities:
- Lead and mentor a team of technical professionals, fostering a collaborative and high performance culture.
- Design and implement data processing solutions using Azure Databricks, ensuring scalability and efficiency.
- Collaborate with cross functional teams to gather requirements and translate them into technical specifications.
- Oversee the development lifecycle, from planning and design to deployment and maintenance.
- Conduct code reviews and provide constructive feedback to team members to ensure code quality and adherence to best practices.
- Stay up to date with industry trends and emerging technologies related to Azure Databricks and data engineering.
- Facilitate communication between technical and non technical stakeholders to ensure alignment on project goals.
- Identify and mitigate risks associated with project delivery and team performance.
Mandatory Skills:
- Proven expertise in Azure Databricks, including experience with Spark, data pipelines, and data lakes.
- Strong programming skills in languages such as Python, Scala, or SQL.
- Experience with cloud based data storage solutions, particularly Azure Data Lake Storage and Azure SQL Database.
- Solid understanding of data modeling, ETL processes, and data warehousing concepts.
Demonstrated ability to lead technical teams and manage multiple projects simultaneously.