What are the responsibilities and job description for the Senior Data Engineer position at Candidate Experience site?
Cetera Financial Group is looking for a motivated, innovative data engineer to help shape and extend our data estate as we build the future of fintech. Our modern, cloud-native and AI-enabled data platform optimizes speed, scale and quality with a contemporary design that leverages governed data contracts to drive intelligent, flexible and resilient data pipelines.
This opportunity requires experience with Lakehouse architecture, cloud-native integration patterns, and expertise with the latest data engineering best practices to deliver clean, automated, well-documented and auditable data products for enterprise consumers and analytics. This collaborative role works closely with product owners and engineering leads to translate business and regulatory needs, including data ingestion, lineage, PII protection, and quality goals, into an automated future-forward data platform using AI-powered software engineering to develop secure, extensible and well-tested code within an enterprise data ecosystem.
Responsibilities
Key responsibilities include:
- Design, build and maintain data ingestion, discovery and consumption pipelines across file-based feeds, APIs, change-data-capture and streaming sources, driven by reusable, declarative data contracts
- Collaborate with product owners, engineering leads and data stewards to gather and implement requirements, ensuring data pipelines and contracts reflect prioritized business imperatives
- Own the onboarding of new data sources end-to-end through pipeline development, field mapping, type management, enrichment and quality/privacy rule definitions
- Work with orchestration and metadata systems to process event, dependency and schedule-driven activities
- Support and extend the downstream data models that power business intelligence and reporting
- Apply modern software engineering practices to ensure pipeline changes are well-specified and production ready, backed by automated unit and end-to-end tests
- Use AI-assisted development tools for coding, testing and documentation, while staying accountable for correctness, security and sound architecture
- Participate in CI/CD and DevOps best practices for data platform development, validation and deployment
- Monitor pipeline health and data processing in production, troubleshooting and routing issues to the appropriate remediation process
- Maintain documentation, including operational runbooks, to capture and share data platform knowledge and insights
Experience & Education
- Bachelor’s degree in computer science or equivalent experience
- 5 years of programming experience with an advanced, object-oriented language (Python preferred)
- 4 years of hands-on experience with SQL, writing efficient code for high-volume data processing and supporting high-performing ETL processes, including data quality and testing practices
- 3 years of hands-on experience with data warehousing/Lakehouse design and implementation on cloud-based platforms (e.g. AWS, Databricks, Snowflake)
- Experience with event-driven data ingestion patterns and Lakehouse table formats (e.g. Apache Iceberg)
- Experience with CI/CD and infrastructure-as-code practices
- Experience with Agile development methodologies