Lead Data Engineer

Job Details

Mandatory Skills:

Advanced expertise in ETL / ELT pipeline design

Handling

• Batch data processing
• Near real time / streaming data
  
  

Experience with structured and semi structured data

Strong Knowledge Of

• Incremental loading
• CDC (Change Data Capture)
  
  

Pipeline orchestration and dependency management

Strong programming skills in Python or Scala or Java (nice to have)

Performance optimization for large scale data processing

Solid Understanding Of

• Dimensional modeling (Star / Snowflake)
• Normalized and denormalized models
  
  

Strong experience on: Azure, AWS, or GCP

Hands on with Data Warehouses (Snowflake, Synapse, BigQuery, Redshift)

Data Architecture & Solution Design

Design end to end data engineering architectures

Define Scalable Solutions For

• Data lakes / lakehouse
• Data warehouses
• Streaming and real time systems
  
  

Ensure alignment with enterprise architecture, security, and compliance standards

Review and approve technical designs

Data Pipeline Development & Management

Lead development of ETL / ELT pipelines

Handle

• Batch and real time ingestion
• Structured and semi structured data
  
  

Optimize pipelines for performance, reliability, and cost

Manage schema evolution and data dependencies

Data Quality, Reliability & Operations

Establish data quality standards and validation rules

Implement monitoring, alerting, and observability

Perform root cause analysis for data incidents

Drive operational excellence and stability

DevOps / DataOps Enablement

Build CI/CD pipelines for data workloads

Automate testing, deployment, and rollback

Improve reliability through automation

Experience

>11 Years