What are the responsibilities and job description for the Azure Data Engineering Lead position at MethodHub?
Job Title: Azure Data Engineering Specialist
Location: Remote/ Indianapolis, IN
Duration: Fulltime with Client
Job Description:
We are seeking a highly skilled Data Engineering Specialist with above mentioned Primary Skills to join our dynamic team who are at the forefront of enabling enterprises in healthcare sectors. The ideal candidate should be passionate about working on Data Engineering on Azure Cloud with strong focus on DevOps practices in building product for our customers. Effectively Communicate and Collaborate with internal teams and customer to build code leveraging or building low level design documents aligning to standard coding principles and guidelines.
Skills/Experience
• 4 years of experience in Azure Databricks with PySpark and 5 years of experience in Azure Cloud platform
• 3 years of experience in ADF (Azure Data Factory), ADLS Gen 2 and Azure SQL
• 2 years of experience in Databricks workflow & Unity catalog
• 2 years of experience in Python programming & package builds
• Prior experience in working on Agile/Scrum projects with exposure to tools like Jira/Azure DevOps
• Provide constructive feedback during code reviews and be open to receiving feedback on your own code
• Problem-Solving and Analytical Thinking, Capability to troubleshoot and resolve issues efficiently
• Provides regular updates, proactive and due diligent to carry out responsibilities
• Communicate effectively with internal and customer stakeholders
• Communication approach: verbal, emails and instant messages
• Strong interpersonal skills to build and maintain productive relationships with team members
Secondary Skills
• Good to have Azure Entra/AD skills and GitHub Actions
• Good to have orchestration experience using Airflow, Dagster, LogicApp
• Good to have experience working on event-driven architectures using Kafka, Azure Event Hub
• Good to have experience in managing Cloud storage solutions on Azure Data Lake Storage (ADLS)
• Good to have exposure on Google Cloud Pub/Sub; Experience with Google Cloud Storage will be an advantage
• Good to have experience developing and maintaining Change Data Capture (CDC) solutions preferably using Debezium
• Good to have hands-on experience on data migration projects specifically involving Azure Synapse and Databricks Lakehouse
