Demo

Principal Data Engineer

ExecutivePlacements.com
San Francisco, CA Full Time
POSTED ON 1/4/2026
AVAILABLE BEFORE 2/4/2026
Position Overview

We are seeking a Principal Data Engineer to provide technical leadership in designing, building, and scaling data infrastructure that powers machine learning, personalization, and search experiences. You will architect scalable data pipelines in production, drive technical strategy, and mentor engineering teams while partnering with Machine Learning Engineering, Platform Engineering, and Data Science.

Your work will be critical to strategic initiatives including optimization of digital conversion metrics, development of Autodesk Assistant (an LLM-driven chatbot), RAG (Retrieval-Augmented Generation) systems, eCommerce personalization engines, and intelligent search capabilities. As a Principal Engineer, you will set technical direction, establish best practices, and drive innovation across the data engineering organization.

Our team culture is built on collaboration, mutual support, and continuous learning. We emphasize an agile, hands-on, and technical approach at all levels of the team.

Key Responsibilities

  • Define and drive technical architecture for data platforms supporting ML and personalization at scale.
  • Design, build, and maintain highly scalable, low-latency data pipelines supporting real-time ML inference and personalization.
  • Build data pipelines for RAG systems, including vector embeddings and semantic search.
  • Design real-time feature engineering and event processing systems for eCommerce personalization and recommendation engines.
  • Develop sophisticated data models optimized for ML training, real-time inference, and analytics workloads.
  • Implement complex stream processing architectures using technologies like Kafka and Flink.
  • Oversee and optimize database systems (SQL, NoSQL, vector databases) ensuring high performance and scalability.
  • Establish data engineering standards, patterns, and best practices across the organization.
  • Provide technical leadership, guidance, and mentorship to senior and mid-level data engineers.
  • Lead cross-functional teams to deliver complex data engineering solutions in production.

Minimum Qualifications

  • 8 yearsof data engineering experience with at least3 yearsin a senior or lead capacity.
  • Expert-level proficiency in Python, Java, or Scala
  • Deep knowledge of SQL and extensive experience with relational and NoSQL databases
  • Strong expertise in big data technologies (Kafka, Flink, Spark, Parquet, Iceberg, Delta Lake)
  • Advanced experience with ETL orchestration tools like Apache Airflow
  • Extensive experience with cloud platforms (AWS, Azure, or GCP) and their data services
  • Deep understanding of data warehousing solutions like Snowflake, Redshift, or BigQuery
  • Proven expertise in data modeling, data architecture design, and ETL/ELT processes at scale
  • Demonstrated ability to lead technical initiatives and mentor engineering talent
  • Strong communication skills with ability to explain complex technical concepts to diverse audiences.
  • Bachelors degree in computer science, or related field (Master's/PhD strongly preferred)

Preferred Skills & Experience

  • Experience building data pipelines for Retrieval-Augmented Generation, vector databases (Pinecone, Weaviate, Milvus), and semantic search
  • Experience with real-time personalization engines, recommendation systems, feature stores, and A/B testing infrastructure
  • Experience building ML data pipelines, feature engineering systems, and model serving infrastructure
  • Knowledge of search technologies (Elasticsearch, Solr, OpenSearch), relevance tuning, and search analytics
  • Deep experience with event streaming, behavioral analytics, and customer data platforms
  • Experience with A/B testing infrastructure and metrics computation at scale
  • Knowledge of MLOps, model monitoring, and ML pipeline orchestration
  • Knowledge of eCommerce metrics, conversion optimization, and digital analytics

Learn More

About Autodesk

Welcome to Autodesk! Amazing things are created every day with our software from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

We take great pride in our culture here at Autodesk its at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world.

When youre an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!

Benefits

From health and financial benefits to time away and everyday wellness, we give Autodeskers the best, so they can do their best work. Learn more about our benefits in the U.S. by visiting

Salary transparency

Salary is one part of Autodesks competitive compensation package. For U.S.-based roles, we expect a starting base salary between $130,600 and $211,200. Offers are based on the candidates experience and geographic location, and may exceed this range. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.

Equal Employment Opportunity

Salary : $130,600 - $211,200

If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Principal Data Engineer?

Sign up to receive alerts about other jobs on the Principal Data Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$168,522 - $211,152
Income Estimation: 
$189,259 - $248,928
Income Estimation: 
$122,257 - $154,284
Income Estimation: 
$143,391 - $179,890
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at ExecutivePlacements.com

  • ExecutivePlacements.com Fargo, ND
  • Join to apply for the Remote Customer Success Representative role at Forum Communications Co. Get AI-powered advice on this job and more exclusive features... more
  • 13 Days Ago

  • ExecutivePlacements.com Fargo, ND
  • Job Description This role combines flexibility with leadership responsibility. You will oversee team production and development. Bonuses reward consistency... more
  • 13 Days Ago

  • ExecutivePlacements.com Anchorage, AK
  • About The Job Remote Office Data Entry Specialist We strive to operate in an environmentally sustainable manner and promote land-based environmental progra... more
  • 13 Days Ago

  • ExecutivePlacements.com St Marys, AK
  • Seeking Motivated Individuals For Data Entry Type Work From Home Our company is seeking applicants who are motivated to work from home and participate in p... more
  • 13 Days Ago


Not the job you're looking for? Here are some other Principal Data Engineer jobs in the San Francisco, CA area that may be a better fit.

  • Jobright.ai San Francisco, CA
  • Jobright is an AI-powered career platform that helps job seekers discover the top opportunities in the US. We are NOT a staffing agency. Jobright does not ... more
  • 24 Days Ago

  • WEX San Francisco, CA
  • About The Role WEX is transforming into a data-driven enterprise through its modern Data-as-a-Service (DaaS) platform. At the core of this strategy is a ne... more
  • 5 Days Ago

AI Assistant is available now!

Feel free to start your new journey!