What are the responsibilities and job description for the Databricks & Azure Data Platform Principal Engineer position at Axiom Software Solutions Limited?
A senior technical expert responsible for designing, building, and optimizing data solutions using Databricks and Azure Data technologies. This principal engineer oversees the architecture, integration, design, development and deployment of reusable patterns and solutions ensuring that they are scalable, secure and efficient. Also, responsible for managing the platform effectively with automation and leverage emerging capabilities in the marketplace. It requires proven experience of working with developers, analysts, and data scientists to implement data pipelines, real-time analytics machine learning models. This engineer ensures modern best practices are developed and adhered to in a cloud data ecosystem for data governance, data architecture and DataOps, while providing guidance on performance tuning, cost optimization and system reliability.?