Recent Searches

You haven't searched anything yet.

657 Senior Data Engineer Jobs in San Francisco, CA

SET JOB ALERT
Details...
People Data Labs
San Francisco, CA | Full Time
$114k-150k (estimate)
1 Month Ago
Pendulum
San Francisco, CA | Full Time
$115k-149k (estimate)
Just Posted
Tomo Credit
San Francisco, CA | Full Time
$124k-159k (estimate)
3 Days Ago
U.S. Bank
San Francisco, CA | Full Time
$145k-177k (estimate)
2 Days Ago
Archipelago Analytics Inc.
San Francisco, CA | Full Time
$127k-162k (estimate)
3 Days Ago
Sephora
Sephora
San Francisco, CA | Full Time
$137k-172k (estimate)
2 Weeks Ago
EOS
San Francisco, CA | Full Time
$127k-161k (estimate)
3 Weeks Ago
Gantri
San Francisco, CA | Full Time
$127k-161k (estimate)
4 Weeks Ago
Sky Consulting Inc
San Francisco, CA | Full Time
$141k-183k (estimate)
4 Weeks Ago
Apollo.io
San Francisco, CA | Full Time
$127k-162k (estimate)
1 Month Ago
Punch Agency
San Francisco, CA | Full Time
$136k-171k (estimate)
1 Month Ago
Phantom
San Francisco, CA | Full Time
$126k-161k (estimate)
1 Month Ago
The Trade Desk (China)
San Francisco, CA | Full Time
$114k-150k (estimate)
1 Month Ago
Elevano
San Francisco, CA | Full Time
$114k-150k (estimate)
4 Months Ago
SmithRx
San Francisco, CA | Full Time
$121k-154k (estimate)
6 Months Ago
U.S. Bank National Association
San Francisco, CA | Full Time
$141k-171k (estimate)
1 Week Ago
0x
San Francisco, CA | Full Time
$142k-174k (estimate)
2 Weeks Ago
Kandji
San Francisco, CA | Full Time
$142k-174k (estimate)
3 Weeks Ago
Federato
San Francisco, CA | Full Time
$142k-174k (estimate)
1 Month Ago
Pacaso
San Francisco, CA | Full Time
$127k-156k (estimate)
5 Months Ago
Advocate Aurora Health
San Francisco, CA | Full Time
$121k-148k (estimate)
6 Months Ago
Lumos Labs
San Francisco, CA | Contractor|Temporary
$137k-168k (estimate)
3 Weeks Ago
Punch Agency
San Francisco, CA | Full Time
$148k-181k (estimate)
1 Month Ago
Stepping Up Solutions
San Francisco, CA | Full Time
$142k-174k (estimate)
1 Month Ago
Forhyre
San Francisco, CA | Full Time
$142k-174k (estimate)
1 Month Ago
Datavant
San Francisco, CA | Full Time
$148k-185k (estimate)
5 Months Ago
Weights and Biases
San Francisco, CA | Full Time
$142k-174k (estimate)
1 Month Ago
Truckstop
San Francisco, CA | Full Time
$142k-174k (estimate)
1 Month Ago
Senior Data Engineer
People Data Labs San Francisco, CA
$114k-150k (estimate)
Full Time | IT Outsourcing & Consulting 1 Month Ago
Save

sadSorry! This job is no longer available. Please explore similar jobs listed on the left.

People Data Labs is Hiring a Remote Senior Data Engineer

About Us

At People Data Labs, we’re committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education data consumed through our suite of APIs. 

PDL is an innovative, fast-growing, global team backed by world-class investors, including Craft Ventures, Flex Capital, and Founders Fund. We scour the world for people hungry to improve, curious about how things work, and willing to challenge the status quo to build something new and better.

Roles & Responsibilities:

  • Build infrastructure for ingestion, transformation, and loading an exponentially increasing volume of data from a variety of sources using Spark, SQL, AWS, and Databricks
  • Building an organic entity resolution framework capable of correctly merging hundreds of billions of individual entities into a number of clean, consumable datasets.
  • Developing CI/CD pipelines and anomaly detection systems capable of continuously improving the quality of data we're pushing into production.
  • Devising solutions to largely-undefined data engineering and data science problems.
  • Work with stakeholders in Engineering and Product to assist with data-related technical issues and support their infrastructure needs

Technical Requirements

  • 5-7 years industry experience with clear examples of strategic technical problem solving and implementation
  • Strong software development fundamentals.
  • Experience withPython Expertise with Apache Spark (Java, Scala, and/or Python-based)
  • Experience with SQL
  • Experience building scalable data processing systems (e.g., cleaning, transformation) from the ground up.
  • Experience using developer-oriented data pipeline and workflow orchestration (e.g., Airflow (preferred), dbt, dagster or similar)
  • Knowledge of modern data design and storage patterns (e.g., incremental updating, partitioning and segmentation, rebuilds and backfills)
  • Experience working in Databricks (including delta live tables, data lakehouse patterns, etc.)
  • Experience with cloud computing services (AWS (preferred), GCP, Azure or similar)
  • Experience with data warehousing (e.g., Databricks, Snowflake, Redshift, BigQuery, or similar)
  • Understanding of modern data storage formats and tools (e.g., parquet, ORC, Avro, Delta Lake)

Professional Requirements

  • Must thrive in a fast paced environment and be able to work independently
  • Can work effectively remotely (able to be proactive about managing blockers, proactive on reaching out and asking questions, and participating in team activities)
  • Strong written communication skills on Slack/Chat and in documents
  • You are experienced in writing data design docs (pipeline design, dataflow, schema design)
  • You can scope and breakdown projects, communicate and collaborate progress and blockers effectively with your manager, team, and stakeholders

Nice To Haves:

  • Degree in a quantitative discipline such as computer science, mathematics, statistics, or engineering
  • Experience working with entity data (entity resolution / record linkage)
  • Experience working with data acquisition / data integration
  • Expertise with Python and the Python data stack (e.g., numpy, pandas)
  • Experience with streaming platforms (e.g., Kafka)
  • Experience evaluating data quality and maintaining consistently high data standards across new feature releases (e.g., consistency, accuracy, validity, completeness)

Our Benefits

  • Stock
  • Competitive Salaries
  • Unlimited paid time off
  • Medical, dental, & vision insurance 
  • Health, fitness, and office stipends
  • The permanent ability to work wherever and however you want

No C2C, 1099, or Contract-to-Hire. Recruiters need not apply.

People Data Labs does not discriminate on the basis of race, sex, color, religion, age, national origin, marital status, disability, veteran status, genetic information, sexual orientation, gender identity or any other reason prohibited by law in provision of employment opportunities and benefits.

Job Summary

JOB TYPE

Full Time

INDUSTRY

IT Outsourcing & Consulting

SALARY

$114k-150k (estimate)

POST DATE

03/21/2024

EXPIRATION DATE

04/26/2024

WEBSITE

peopledatalabs.com

HEADQUARTERS

SAN FRANCISCO, CA

SIZE

25 - 50

FOUNDED

2015

TYPE

Private

CEO

SEAN THORNE

REVENUE

$5M - $10M

INDUSTRY

IT Outsourcing & Consulting

Related Companies
About People Data Labs

People Data develops APIs to standardize profiles, clean and segment people data to enhance search experience for enterprises and technology companies.

Show more

People Data Labs
Remote | Full Time
$166k-206k (estimate)
1 Week Ago
People Data Labs
Remote | Full Time
$98k-131k (estimate)
1 Week Ago
People Data Labs
Remote | Full Time
$115k-150k (estimate)
4 Weeks Ago

The job skills required for Senior Data Engineer include Written Communication, Problem Solving, etc. Having related job skills and expertise will give you an advantage when applying to be a Senior Data Engineer. That makes you unique and can impact how much salary you can get paid. Below are job openings related to skills required by Senior Data Engineer. Select any job title you are interested in and start to search job requirements.

For the skill of  Written Communication
ICONMA, LLC.
Full Time
$52k-66k (estimate)
Just Posted
For the skill of  Problem Solving
Michael Sullivan & Assoc
Full Time
$62k-81k (estimate)
Just Posted
Show more

The following is the career advancement route for Senior Data Engineer positions, which can be used as a reference in future career path planning. As a Senior Data Engineer, it can be promoted into senior positions as a CAE Designer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Senior Data Engineer. You can explore the career advancement for a Senior Data Engineer below and select your interested title to get hiring information.

Archipelago Analytics Inc.
Full Time
$127k-162k (estimate)
3 Days Ago

If you are interested in becoming a Senior Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Senior Data Engineer for your reference.

Step 1: Understand the job description and responsibilities of an Accountant.

Quotes from people on Senior Data Engineer job description and responsibilities

The Senior Data Engineer builds data processing frameworks that handle the business’s growing database.

03/09/2022: Billings, MT

The Senior Data Engineer owns and extends the business’s data pipeline through the collection, storage, processing, and transformation of large data-sets.

01/05/2022: Melbourne, FL

Create architecture for real-time, big data applications with minimal maintenance effort.

03/23/2022: Benton Harbor, MI

Work with both structured and unstructured data, with focus on ETL (Extract, Transfer, Load) and stabilizing pipelines and code.

01/22/2022: Greenville, MS

Provides successful deployment and provisioning of data solutions to production or other required environments.

01/12/2022: Dothan, AL

Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.

Career tips from people on Senior Data Engineer jobs

Apply for an entry-level data engineer role and gain experience.

02/06/2022: Providence, RI

Earn a bachelor’s degree related to data engineering and begin working on projects.

02/16/2022: Denver, CO

Consider pursuing additional professional engineering or big data certifications.

03/06/2022: Raleigh, NC

Gain knowledge with new data architecture principles and concepts, thorough understanding of layered systems architectures.

01/24/2022: Abilene, TX

Senior data engineers should also have an understanding of other programming languages that help with statistical analysis and modeling, such as Python.

01/02/2022: New York, NY

Step 3: View the best colleges and universities for Senior Data Engineer.

Butler University
Carroll College
Cooper Union
High Point University
Princeton University
Providence College
Show more