Azure Data Engineer

Job Description

Title: Azure Data Engineer
Location: Hybrid/New York, NY
Contract Duration: 12 Months

Summary:
We are seeking a Databricks L1 Support Engineer with hands-on experience in Azure Databricks, Azure Data Factory, and cloud infrastructure to support enterprise data platform operations. The ideal candidate will provide first-level application support, onboard Data Landing Zones (DLZ), provision Azure resources using Infrastructure as Code (IaC), automate operational tasks, and collaborate with cross-functional teams to ensure efficient platform support. Experience with Azure, Git, CI/CD pipelines, scripting, and cloud technologies is highly preferred.

Responsibilities:

• Provide first-level support to application teams through the ServiceNow ticketing system.
• Gather business and technical requirements to onboard new Data Landing Zones (DLZ).
• Deploy and configure Azure and Databricks resources using Infrastructure as Code (IaC).
• Execute deployment pipelines and automation scripts to provision or modify cloud resources.
• Troubleshoot Databricks platform and Azure infrastructure-related issues.
• Automate repetitive operational tasks and improve support workflows.
• Collaborate with application, infrastructure, and DevOps teams to resolve support requests.
• Create and maintain technical documentation, support procedures, and knowledge base articles.
• Support source code management using Git, GitHub, or GitLab.
• Assist with CI/CD pipeline execution and deployment automation.
• Ensure secure access management, authentication, and resource governance within the Databricks environment.
• Support continuous improvement initiatives to enhance platform stability and operational efficiency.
  
  Experience:
• 1–3 years of hands-on experience with Azure Databricks.
• 1–3 years of experience working with Azure Data Factory (ADF).
• Experience in application support, production support, or technical operations.
• Hands-on experience with cloud platforms such as Microsoft Azure, AWS, or GCP.
• Experience with Infrastructure as Code (Terraform, Bicep, or AWS CDK).
• Knowledge of CI/CD tools including Azure DevOps, Jenkins, or GitHub Actions.
• Experience with Git, GitHub, or GitLab for source control.
• Proficiency in scripting using Python, PowerShell, or Bash.
• Knowledge of Databricks features including Unity Catalog, RBAC, Delta Sharing, and authentication methods is preferred.
• Strong troubleshooting, communication, and documentation skills.
• Bachelor's degree in Computer Science, Information Technology, or a related technical field preferred.