Principal Data Engineer The Supply and Partner Data Engineering (SPDE) org is an essential part of Data and AI Platform & Systems within Expedia Group. Our charter is to “Unify and democratize EG supply & partner data into a rich set of data and ML engineering products to improve partner performance & marketplace competitiveness and unlock data analytics & AI across EG”. We work on creating data products and generating ML predictions as part of the Expedia Group Data Platform to support a variety of users and applications including analysts, data scientists, internal engineering teams, product and business partners, senior executives and external EG partners & applications across all travel lines of business and EG brands. Our work spans across a broad set of domains and capabilities including Travel supply/partner data, B2B partner data, EG Competitive Intelligence, Partner Operations data, Marketplace & Yield Data & ML solutions and Partner insights & recommendations. We use a diverse set of technologies including (not limited to) Spark, Scala, KStream, Kafka, EMR, Qubole, Cassandra, Redis, Rest, GraphQL, gRPC and AWS. We are an inclusive, diverse, fun-loving team spanning across 3 continents and are collaborative in moving toward our common goals for solving real customer and business problems with real time data intelligence! The SPDE org delivers data as products that enables many critical strategic and commercial efforts across EG. We provide essential data to own the business for Travel Partner Group and enables multi-million commercial and strategic effects across EG for our travelers and partners. We directly support many cross-EG prioritized and strategic efforts, including Auto Rate Adjustment (driven by our Competitive Intelligence data), Virtual Marketplace Coach (supported by our ML-based recommendations and partner/market insights), Modernizing Search (supported by our Search to Book Attribution data platform) and Revitalize Air (support by our Supply and Partner Attribute Store and related business events). We bring high quality data & ML insights supported by 360 feedback loops, to our travelers and partners that become game changer for our end customers. We are looking for a passionate, inclusive, creative, and collaborative Principal Data Engineer with a strong bias for action & outcomes to join our team! You will be a technology leader for the org, partnering with peer principals/architects, senior leaders and our engineering teams to drive architecture/technology decisions & vision, provide technical guidance to the team/engineers on the ground, POC & establish common patterns, tools & playbooks, design & build solutions to difficult problems and continuously advocate for quality, engineering efficiency and technical excellence. In some ways, be versatile by contributing your skills and time wherever is the greatest need and in whatever capability is required to get things done. As per need, you will likely find yourself involved in all aspects of software development from driving end-to-end architecture alignment with business partners to influencing product/tech vision & scope to getting into the details in actual development/execution of a specific solution. You will proactively identify areas/gaps where improvement is needed that can be a force multiplier for our teams and influence & collaborate with appropriate partners across the business to make it happen. You will lead by example and help mentor & grow the next generation of technical talent! What you’ll do: Partner with technologists across all EG to collaboratively tackle problems, creating an inclusive environment Support and advise EG technologists via a community of practice Build relationships with leaders across the organization to understand business problems and apply a technology lens to tackle them Collectively design a cutting-edge technology stack that is tied to business outcomes and our bottom line Combine, share knowledge, and highlight skills in more than one functional area to promote effectiveness in the department or business unit/function Demonstrate active mentorship and rising talent identification, as well as a positive impact and leadership across the scope of the organization Be recognized for your ability to fill in for peer engineering director as need emerges in setting technical next steps in co-ordination with engineering management Develop the North star vision for the domain in which they are focused, and you will advocate efforts to remove tech roadblocks for their domains for long term success Interpret internal/external business challenges and recommend integration of the appropriate systems, applications, and technology to provide a fully functional solution to a business problem Serve as a specialist in architecting design solution patterns to any use case, considering business needs, application needs and articulating to interested teams and partners Highlight industry leadership in delivering highly available, distributed systems of data extraction, ingestion, and processing of large data sets Identify areas for improvement and develop innovative enhancements using available software development tools following design requirements of customer Campaign for designing efficient software that scalable, resilient, and stable Demonstrate mastery of software design practices, shape coding methodologies and advocate for adoption of new platform technologies Possess a deep knowledge of entire system and demonstrate the ability to jump into code in any component, fire fight and contribute Make an impact on decisions on product direction based on deep subject matter knowledge Utilize professional software engineering practices and standard methodologies for the software development process, including coding standards, code reviews, source control management, build processes, testing, and operations Lead collaboration with key stakeholders and contribute subject matter expertise to develop unique solutions to complex issues Enable optimum organizational efficiency by taking a whole systems approach and think across boundaries to identify which polices/processes should be standardized and which should differ Provide guidance when evaluating the impacts of a solution to ensure linkages between structure, people, process, and technology Advise of industry trends and will develop methods for implementing them in our environment Identify when new trends may be too disruptive for a reasonable implementation or spot the ephemerality of new trends Highlight that technology or automation doesn't tackle every problem Lead solution design trends relating to advancements, innovations and changes in current solution designs considering the latest advancements in software engineering (specifically related to data engineering, cloud data platforms, data models, enterprise information management, business intelligence and data science) Champion prioritized initiatives throughout the local organization and work with others across EG to investigate those initiatives Ensure documentation is not overwhelming or obsolete Communicate verbally and/or written on organization-wide technology choices and design patterns and coach the data engineering community within their domains Who you are: Bachelor's, Master's, Technical degree, or equivalent related professional experience Provides technical assessment and feedback for peers’ performance evaluations Builds high performance, scalable data products Defines data engineering/architecture best practices at a department/organizational level Displays strength in majority of commonly used data technologies and languages such as Python, Scala and/or Java Makes choices across teams to define and apply technology and design standards and best practices Guides others to make well defined technology choices Influences and contributes to the organizational tech strategy and technology choices Follows new industry trends (e.g. DS, ML, Data Engineering) and designs solutions for sophisticated systems to meet ambiguous business needs Creates systems that interact across a business unit Understands systems being created across EG and how own business unit would integrate with them Actively designs and influences sophisticated data system architecture and establishes best practices and recommended tool sets across their domains Establishes standards for operational excellence and code and data quality at a multi-project level Drives principles and practices to guide others in design of software that is easily testable and observable Understands cross-domain capabilities and how they integrate Influences and contributes to product vision of the org and promote that product vision and translate it to technical terms that individual teams/individual contributors can understand You understand data access patterns, streaming technology, data validation, data modeling, data performance, cost optimization Demonstrates experience working cloud providers such as AWS (preferred), Google Cloud, Azure, etc. Experience working with Docker, Kubernetes, Yarn, Qubole, EMR, Databricks or related technologies #L1-OM1 At Expedia Group, we believe in bringing people together and creating an inclusive workplace where everyone belongs and can do their best work. We care about our employees’ safety and wellbeing, so we’re requiring new hires in the U.S. to be fully vaccinated against COVID-19 and present acceptable proof of vaccination before their start date as a condition of employment. Expedia Group will consider requests for a reasonable accommodation as required under applicable law. About Expedia Group Expedia Group (NASDAQ: EXPE) powers travel for everyone, everywhere through our global platform. Driven by the core belief that travel is a force for good, we help people experience the world in new ways and build lasting connections. We provide industry-leading technology solutions to fuel partner growth and success, while facilitating memorable experiences for travelers. Expedia Group's family of brands includes: Brand Expedia®, Hotels.com®, Expedia® Partner Solutions, Vrbo®, trivago®, Orbitz®, Travelocity®, Hotwire®, Wotif®, ebookers®, CheapTickets®, Expedia Group™ Media Solutions, Expedia Local Expert®, CarRentals.com™, and Expedia Cruises™. © 2021 Expedia, Inc. All rights reserved. Trademarks and logos are the property of their respective owners. CST: 2029030-50 Expedia is committed to creating an inclusive work environment with a diverse workforce. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. This employer participates in E-Verify. The employer will provide the Social Security Administration (SSA) and, if necessary, the Department of Homeland Security (DHS) with information from each new employee's I-9 to confirm work authorization.