Primary Function: 

At Upland Capital Group, we are on a mission to leverage data to its fullest potential, driving innovation and efficiency across all operations. We are seeking a seasoned Principal Data Engineer to lead the charge in building and supporting our Data Platform and Analytics.

This pivotal role involves designing, building, and maintaining robust data architectures and pipelines, supporting advanced analytics, data integration, and real-time data processing. Your contributions will not only meet current infrastructure demands but also scale for future challenges, aligning closely with the company's broader objectives and playing a key role in our continued growth.

Duties and Responsibilities:

• Lead data migration and integration projects of new structured and semi-structured data sources for the company’s data platform.
• Design and maintain scalable data pipelines and architectures for both real-time and batch data processing.
• Ensure testability, portability, monitoring, reliability, and maintainability of data systems and understand when code is ready for deployment.
• Work closely with business units and technology partners to optimize data utilization and align technology with business objectives.
• Establish data standards and processes to ensure data quality and consistency across platforms.
• Develop comprehensive automated tests to maintain high-quality ETE data pipelines.
• Lead requirement sessions, design reviews, and planning meetings to drive clarity and resolution.
• Perform project management duties as needed, utilizing collaboration tools such as SharePoint, Teams, Confluence, Monday.com, and Jira.
• Proactively meet stakeholder needs with timely and effective solutions.
• Work as a strong team player, comfortable with collaboration, and highly organized.
• Demonstrate strong presentation skills, including the ability to engage with senior leadership and diverse stakeholder groups.
• Collaborate on projects with IT and business stakeholders as needed. Responsibilities may evolve based on business needs.

Describe Specific Requirements:

• 10 years of experience in information technology, with a focus on enterprise data management and engineering.
• Proficient in data architecture, data pipeline construction to accommodate batch and real-time data processing.
• Familiarity with cloud data services (Azure, Snowflake, Big Query, etc.) and implementing big data and NoSQL solutions.
• P&C Insurance industry experience preferred but not required.
• Experience with programming languages such as Java, Scala, Python, PowerShell, Bash, or Golang.
• Experience with workflow orchestration tools like Airflow, Fivetran, Dagster, or DBT.
• Strong background in Agile, DevOps environments.
• Excellent problem-solving, collaboration, and project management skills.