Principal Engineer

As a Principal Engineer I embedded in the Enterprise Data & Analytics function, you will be responsible for delivery and operations of technologies and platforms required to model, transform, analyze, report, visualize data. You'll provide SME expertise in designing, building, optimizing, streamlining and automating the Azure Databricks platform to enable analytical workloads like Machine Learning (ML), Model Development, Data Insights, Data Science etc. As a Principal Engineer I, you will partner with ML engineers, data scientists, data analysts, and enterprise architects to provide frameworks, set standards, enforce best practices, train and enable users using the Azure Databricks platform. In this role, you'll develop technical skills of one or more junior team-members. -Take assignments that can be worked on individually without supervision, and manage work effort from concept to completion. -Design, build, optimize, automate and maintain the Azure --Databricks platform, ensuring scalability, security, governance and performance. -Design, implement and manage Azure Databricks workspaces, clusters, jobs, access management. -Design, implement and manage policies, monitoring and observability for the Azure Databricks platform. -Implement data analytics principles aimed at business enablement, reliability practices and sound recovery procedures. -Ensure compliance with IT policies, procedures, and industry standards, including reviewing and refining IT control enhancements. -Work closely with business and analytics teams to ensure reliable and governed data access for data needed for -analytics. -Troubleshoot platform issues, optimize performance, and ensure uptime for critical Databricks services. -Stay current on emerging data analytics technologies, recommending enhancements to improve efficiency and governance. -Act as a thought leader on Azure Databricks implementation, usage, end user enablement and training.