Full Lifecycle Data Engineer

Your Responsibilities

We are looking for experienced Full-Lifecycle Data Engineers to design, build, and operate our next-generation data platform. This role owns the full data lifecycle—from ingestion and transformation through modeling, serving, observability, and production operations. Successful candidates combine software engineering, data engineering, and analytics engineering skills to deliver reliable, scalable data products that power analytics, applications, and machine learning.

Key Responsibilities

Data Ingestion & Integration

• Build and maintain scalable batch and streaming data pipelines
• Integrate data from APIs, event streams, databases, SaaS tools, and third-party systems
• Ensure reliable, fault-tolerant ingestion across multiple sources
  
  

Data Processing & Transformation

• Design and implement transformation pipelines using ELT/ETL patterns
• Develop modular, reusable data transformations (Databricks experience a plus)
• Ensure data consistency, correctness, and reproducibility
  
  

Data Storage & Modeling

• Design and maintain data warehouses, lakes, and lakehouse architectures
• Build analytics-ready data models (star schema, wide tables, semantic layers)
• Optimize data structures for performance and cost efficiency
  
  

Data Products & Serving Layer

• Build data services or APIs that expose curated datasets to downstream consumers
• Enable self-serve analytics via BI tools and semantic modeling layers
• Support embedded analytics or product-facing data features when needed
  
  

Orchestration & Reliability

• Own scheduling and orchestration systems
• Implement monitoring, alerting, and data observability practices
• Debug and resolve end-to-end data issues across the stack
  
  

Collaboration & Enablement

• Partner with analytics, product, and engineering teams to define data needs
• Translate business requirements into scalable data solutions
• Support experimentation, reporting, and machine learning workflows
  
  

Qualifications

• Strong programming skills
• Advanced SQL and data modeling expertise
• Experience with data processing frameworks
• Hands-on experience with cloud platforms (Azure)
• Experience with modern data warehouses
• Familiarity with orchestration tools
• Understanding of distributed systems and data architecture patterns
• Ability to build both backend-style data systems and analytics pipelines
  
  

Nice to Have

• Experience building data APIs or internal data services
• Infrastructure-as-code
• CI/CD for data systems
• Experience with ML data pipelines or feature stores
• Front-end exposure for dashboards or internal tools
• Data governance enablement
• Security and privacy (HIPAA)
  
  

Soft Skills

• Comfortable owning ambiguous, end-to-end problems
• Clear communication with both engineers and business users