What are the responsibilities and job description for the Principal Data Engineer position at Data Template?
We are seeking a highly motivated and self-driven Data Engineer with a strong background in building scalable batch and streaming data pipelines. The ideal candidate brings deep expertise in Google Cloud Platform (GCP), with hands-on experience in Dataflow, BigQuery, Python, and graph databases such as Neo4j and Google Spanner. Familiarity with orchestration tools like Apache Airflow is essential.
In this role, you will serve as a lead (anchor) engineer, driving the design and delivery of reusable, enterprise-grade data capabilities leveraged across Cotality. You will play a key role in building robust, scalable, and efficient data processing frameworks that support a wide range of business applications and strategic initiatives.
Key Responsibilities
- Design and implement scalable, high-performance data solutions using industry best practices and modern technologies, ensuring optimal integration, reliability, scalability, flexibility, and maintainability
- Translate business requirements and processes into well-architected technical solutions, aligning with enterprise architecture standards and long-term technology strategy
- Define and document solution architecture, technical designs, and requirements to support business objectives while balancing practical implementation and strategic vision
- Provide technical leadership and guidance to engineering and support teams, ensuring alignment with business and IT strategies
- Develop and present architecture and design artifacts to both technical and non-technical stakeholders
- Proactively identify challenges, assess downstream impacts across business domains, and drive solution design through research, validation, and stakeholder consensus
- Apply industry and domain best practices, offering architectural guidance and strategic input to business and technology leadership
- Evaluate the impact of new solutions on existing architecture, ensuring compliance with enterprise standards and governance frameworks
- Contribute to enterprise-wide technology initiatives and support critical issue resolution when needed
- Actively participate in team ceremonies, provide status updates, and support overall project governance and execution
Job Requirements:
Job Qualifications
- Bachelor’s degree in Computer Science, Engineering, or a related discipline (or equivalent work experience)
- 7 years of experience in IT, with strong expertise in data architecture, integrating and analyzing disparate data sources, and driving data quality improvements—preferably within the mortgage, real estate, or insurance domains
- Deep understanding of data modeling techniques to support technology optimization, data consolidation, and strategic architecture planning
- Strong knowledge of the full lifecycle of database, data warehouse, and data mart design and development
- Proven experience in enterprise data architecture, including governance, standards, and strategy development
- Demonstrated ability to resolve complex enterprise-wide data architecture challenges
- Expertise in designing data management solutions aligned with strategic technology roadmaps and emerging industry trends
- Proficiency with data modeling tools and strong experience across SQL and NoSQL technologies
Technical Skills & Experience
- Hands-on experience with cloud platforms such as AWS and Google Cloud Platform (GCP)
- Strong programming skills in Python and PySpark
- Experience with AI development frameworks and lifecycle methodologies (e.g., BMAD, Spec Kit)
- Experience with big data and distributed processing technologies such as Hadoop, Spark, and Elasticsearch
- Working knowledge of modern data platforms, including graph databases (e.g., Neo4j, Google Spanner)
- Experience with data processing and orchestration tools such as Google Cloud Dataflow, Apache Beam, and Apache Airflow
- Ability to develop and document detailed technical designs and specifications
Leadership & Soft Skills
- Proven ability to mentor and guide engineering teams on architectural best practices and technical approaches
- Strong communication skills, with a collaborative mindset and interest in pair programming environments
- Ability to manage multiple projects and priorities in a fast-paced environment
- Excellent organizational, time management, and problem-solving skills
- Strong interpersonal and stakeholder management abilities
- Preferred Qualifications
- Domain experience in Real Estate, Mortgage, or Insurance industries is highly desirable
Required Skills:
Agile Methodology, API Design, Architectural Specifications, Cloud Computing, DevOps, Engineering Leadership, Mentorship, Microservices Architecture, Software Agent, Software Development, Solution Architecture
Optional Skills:
Apache Kafka, Build Management, Code Reviews, Design Principles, Developer Tools, Event Driven Architecture (EDA), Full Stack Development, IT Methodologies, Jenkins (Software), Kubernetes, Object-Oriented Programming (OOP), Process Models, Single Page Application (SPA), Software Design Methodology, Software Modeling Tools, Spring Boot, Spring Framework, Strategic Objectives
Pay: $144,194.66 - $173,653.78 per year
Benefits:
- 401(k)
- Dental insurance
- Flexible schedule
- Parental leave
- Retirement plan
Work Location: Hybrid remote in California City, CA 93505
Salary : $144,195 - $173,654