Lead Engineer Data Ops

Verified Job On Employer Career Site

Job Summary:

United Airlines is seeking a talented Lead Engineer for their Data Ops team to drive data-driven insights and innovation. This role involves architecting, developing, and maintaining software solutions in a cloud environment while collaborating with various teams to enable effective data strategies and automation.

Responsibilities:

• Partner with Development team to deploy multiple projects and maintaining software using public clouds such as AWS and Microsoft Azure

• Architecting, developing, deploying, and maintaining software at scale using Java and Spark

• Provide expertise to build frameworks using PySpark which can be used for orchestration, monitoring pipelines and Integrate solutions with other applications and platforms outside the framework

• Responsible for supporting Pre-Prod and Prod environments which includes deployments of application, monitoring of pipelines and resolution, disaster recovery, incident / problem management

• Partner with various teams to define and execute data acquisition, transformation, processing and make data actionable for operational and analytics initiatives that create sustainable revenue and share growth

• Develop and implement innovative solutions leading to automation

• Proficiency with Power BI Tools, DAX, and SQL is crucial

• Use of Agile methodologies to manage projects

• Mentor and train junior engineers

Qualifications:

Required:

• Bachelor’s degree in computer science or related STEM field

• 4-8 years of IT experience supporting critical enterprise infrastructure environments

• 3 years' experience of engineering, architecting, or supporting AWS solutions

• 3 years of development experience using Java, Python, Scala

• 2 years of experience with Big Data technologies like Spark, EMR and streaming technologies like Kafka, Kinesis

• Proficiency in Power BI tools: Strong understanding of Power BI Desktop, Power BI Service, and other related tools.

• Analytical Skills: Ability to analyze data and identify trends and insights.

• DAX Expertise: Proficiency in using DAX formulas for calculations and analysis.

• SQL Knowledge: Understanding of SQL queries for data extraction and manipulation.

• Data Modeling Skills: Ability to design and implement data models for Power BI.

• Experience with infrastructure designs, implementation, and support

• Experience with relational database systems like Redshift, MS SQL Server, Oracle.

• Excellent O/S knowledge and experience in Linux or Windows with basic knowledge of the other. MCSE/RHCE or equivalent level of knowledge preferred

• Experience of implementing and supporting AWS based instances and services (e.g. EC2, S3, EBS, ELB, RDS, IAM, Route53, Cloud front, Elastic cache, WAF etc.)

• Experience of building and maintaining scalable and auto-scaled environments using automation and configuration management tools (e.g. CloudFormation/Terraform and Ansible) beneficial or can be gained

• Scripting ability in one or more of Python, Bash, Perl

• Experience of using Git for version control useful

• Experience of working with or supporting containerized environments (ECS/EKS/Kubernetes/Docker)

• Must be legally authorized to work in the United States for any employer without sponsorship

• Successful completion of interview required to meet job qualification

• Reliable, punctual attendance is an essential function of the position

Preferred:

• AWS Certified Solutions Architect - Associate or Professional

• AWS Certified Specialty certification – (Security or Networking)

• Experience with Data Quality tools including Deequ or Apache Griffin

• Experience building PySpark based services in a production environment

• Strong experience with continuous integration & delivery using Agile methodologies

Company:

United Airlines is an aviation company that provides information on reservations, bookings, and travel services online. Founded in 1926, the company is headquartered in Chicago, Illinois, USA, with a team of 10001 employees. The company is currently Public Company.