What are the responsibilities and job description for the Senior DevOps Engineer Azure, Terraform & Databricks position at Jobs via Dice?
Dice is the leading career destination for tech experts at every stage of their careers. Our client, AIT Global, Inc., is seeking the following. Apply via Dice today!
Job Title: Senior DevOps Engineer Azure, Terraform & Databricks
Location: Alpharetta, GA
Must have skills : Data Brick/Kafka
Key Responsibilities:
Job Title: Senior DevOps Engineer Azure, Terraform & Databricks
Location: Alpharetta, GA
Must have skills : Data Brick/Kafka
Key Responsibilities:
- Design, implement, and manage Azure cloud infrastructure for scalable and reliable applications.
- Develop and maintain Terraform scripts for automated infrastructure provisioning and configuration.
- Build and manage big data clusters, including Azure Databricks and On-Premise Hadoop, for advanced analytics and data processing workloads.
- Set up and maintain CI/CD pipelines using GitLab CI and Harness, ensuring robust and automated deployment processes.
- Integrate connectivity between Gitlab CI, Nexus Repository and Harness CD to allow seamless delivery.
- Collaborate with cross-functional teams to improve infrastructure performance, security, and scalability.
- Monitor infrastructure and applications for performance issues, troubleshooting, and resolving incidents.
- Participate in on-call rotations to address critical issues and ensure system reliability.
- Cloud Expertise: Proficiency in Azure cloud services, including virtual networks, storage accounts, WebApp services, Spring Apps, Databricks and Kubernetes (AKS).
- Infrastructure as Code: Deep knowledge of Terraform for IaC implementation and best practices.
- Big Data Technologies: Hands-on experience with Databricks and On-Premise Hadoop for big data workloads.
- CI/CD Tools: Advanced experience with GitLab CI for continuous integration and Harness for deployment automation.
- Artifact Management: Familiarity with Nexus Repository for managing build artifacts.
- Scripting and Automation: Proficiency in Python, Bash, or PowerShell for automation tasks.
- Version Control: Expertise in Git workflows and best practices.