What are the responsibilities and job description for the Sr. Data Engineer position at Panex Consulting?
Job/Position Summary Responsibilities: Designs and automates deployment of our distributed system for ingesting and transforming data from various types of sources (relational, event-based, unstructured). Own end-to-end delivery of AI and ML solutions from problem definition to production deployment Build and maintain data pipelines using PySpark and Spark in Azure Databricks Designs and implements framework to continuously monitor and troubleshoot data quality and data integrity issues. Implem