Senior Cloud Data Engineer – IPaaS & Event-Driven Platform Engineering

This is a remote position.

We are seeking a highly skilled and experienced Senior Cloud Data Engineer to design, develop, and support enterprise-scale iPaaS and event-driven data integration platforms on Microsoft Azure.

This role will focus on building scalable, metadata-driven, and cloud-native integration frameworks supporting enterprise data movement, API orchestration, event processing, and operational workflows across distributed systems.

The ideal candidate will have strong hands-on experience implementing Azure-based iPaaS architectures, event-driven integration patterns, containerized applications, and modern orchestration frameworks involving AKS, messaging platforms, Snowflake, and Astronomer Airflow.

Job Duties

• Design and develop cloud-native iPaaS integration frameworks on Azure
• Implement reusable inbound, outbound, and feedback-driven integration services
• Build scalable API orchestration and event-processing frameworks
• Develop canonical integration patterns and standardized payload models
• Implement event-driven architectures using Logic Apps, Azure Service Bus, Event Grid, or Kafka
• Develop retry, replay, dead-letter, and idempotency frameworks
• Build containerized microservices using Python and Kubernetes-based deployment patterns
• Develop scalable AKS-hosted integration applications
• Build REST APIs and integration services
• Build and support workflow orchestration frameworks using Astronomer Airflow / Apache Airflow
• Develop metadata-driven pipeline orchestration frameworks
• Develop Snowflake integration workflows and operational frameworks
• Develop Cosmos DB integration services and operational frameworks
• Implement centralized logging, audit, and operational monitoring frameworks
  
  

Must Have Qualifications

• 5–8 years of experience in Cloud Data Engineering, Integration Engineering, or Distributed Systems development
• Strong hands-on expertise with Microsoft Azure cloud services
• Strong experience implementing enterprise integration platforms and event-driven workflows
• Hands-on experience with Azure Service Bus, Event Grid, messaging, and asynchronous processing
• Strong understanding of retry frameworks, replay mechanisms, dead-letter handling, and idempotency
• Strong experience with Kubernetes and Azure Kubernetes Service (AKS)
• Hands-on expertise with Docker containerization
• Strong Python development experience
• Experience building REST APIs and event-processing applications
• Strong hands-on experience with Astronomer Airflow / Apache Airflow
• Hands-on experience integrating enterprise data platforms with Snowflake
• Familiarity with deploying applications using Helm Charts and Kubernetes manifests
• Familiarity with CI/CD pipelines and cloud-native deployment practices
  
  

Good To Have Qualifications

• Familiarity with Terraform or Infrastructure as Code concepts
• Exposure to Azure Key Vault and secure secret consumption patterns
• Familiarity with Kafka and real-time streaming architectures
• Exposure to metadata-driven orchestration or integration frameworks
• Experience with monitoring platforms such as Azure Monitor, App Insights, Grafana, or Prometheus
• Familiarity with AI-assisted workflow orchestration or agentic execution frameworks
• Experience with GitOps, Ansible, ARM Templates, or Bicep
• Azure, Kubernetes, or Snowflake certifications
  
  

Preferred Technical Stack

Cloud

Azure

Container Platform

AKS, Docker

Integration & Messaging

Logic Apps, Azure Service Bus, Event Grid, Kafka

Orchestration

Astronomer Airflow, Apache Airflow

Data Platform

Snowflake, CosmosDB

Deployment

Helm Charts, Kubernetes YAML

CI/CD

Azure DevOps, GitHub Actions

Programming

Python, Bash

Monitoring

Azure Monitor, App Insights, Grafana