Senior Data Engineer 

ActiveState is securing open source software supply chains and enhancing dependency management with an on-demand SaaS Platform and CLI tool that lets DevSecOps automatically build any runtime environment using any open source language ecosystem on any platform. We’re building an ambitious language distribution platform so that no engineer ever has to suffer dependency hell again, and we need your help!

This position is open to full-time telecommuters anywhere in Canada or continental US. You can also choose to work from our headquarters in beautiful Vancouver, BC.

This position is open to experienced candidates with a track record in this area. We’re building up our systems to scale out to more languages and ecosystems, and we’re looking for someone who knows how to find, ingest, analyze, interpret, and improve open source ecosystem data to help us secure the Internet’s source code!

What You’ll be Doing

Our audacious goal is to build all of the open source software released on the internet completely from source, in an automated and repeatable way. As a Senior Data Ingestion Engineer, your challenge is to build repeatable and maintainable data ingestion pipelines where we can make improvements over time to get more and better data.

This position is a mixture of development and operations; good coding skills are a must. We ingest information about open source languages and libraries from all corners of the Internet, including upstream code repositories, public source control hosting systems, and vulnerability tracking systems.

This position is more than ETL; in many circumstances, the data we need is not available in an easily-accessible format and we need to invent ways to get it and get it right, at scale. If this sounds like an intriguing opportunity, we want to talk to you!

YOUR PRIMARY RESPONSIBILITIES INCLUDE:

• Understanding and gathering data from the Internet for open source languages and libraries.

• Improving the quality of our data and pipelines by building automated monitoring and improvements systems that allow our data to get better over time.

• Designing, building, deploying, and managing tools and processes to help colleagues understand data, especially in the context of open source languages, libraries, and build systems.

• Designing, building, and managing ETL and warehousing pipelines, including recommending tools, technologies, and practices for us to adopt.

• Testing and documenting your work.

WHAT’S IN IT FOR YOU 

• Working for a stable and growing company that offers the environment and personal growth potential of a start-up as well as the stability of a successful business with established revenue.

• The chance to grow and grow with a team, as we expand our data portfolio and team.

• The chance to collaborate with a smart, considerate, enthusiastic team of people.

• The chance to work on a project that will change the work lives of developers around the world, including your own!

• Competitive salary and bonus plan.

• Comprehensive benefits package and health/wellness credit program.

REQUIREMENTS

• 3 years of experience with ETL and data management technologies (for example, Airflow, Snowflake, and Matillion), especially for use with unstructured or semi-structured data

• Strong development experience with at least one of the following languages:

• Python

• Go

• Perl

• Ruby

• Java

• Demonstrated ability to develop, customize, deploy, and maintain and develop business intelligence software.

• Experience creating and optimizing data models.

• Demonstrated ability to perform, validate and document both ad hoc and automated data analysis and reporting. Ability to apply statistical methods to data sets is a plus.

• Excellent written and spoken communication skills, both technical and non-technical, including the ability to make data and analysis understandable and relevant to a diverse set of audiences.

ASSETS

If you have experience with any of the following please make sure to highlight it in your cover letter:

• Build engineering, especially for languages such as Java, Go, and Rust

• Open Source projects and culture, especially dependency management and library maintenance

• Data processing, messaging, and workflow technologies such as Kafka, Map/Reduce, Hadoop, Hive, PrestoDB, Luigi, Airflow, Storm, Argo etc.

• PostgreSQL

• Data engineering in cloud environments, especially AWS and GCP

• Kubernetes

• Agile processes, including breaking large projects up into smaller stories, estimation, working in branches (GitHub Flow), code review, and CI

• Practical development in Go, Perl, Python, Tcl, Elm, Java, and Ruby

• Data science and/or machine learning

• Designing and implementing APIs and microservices

WHAT TO EXPECT

We’re a polyglot company and embrace using the best language or tool for the given task at hand. We gladly use Python, Elm, JavaScript, Golang, Bazel, Docker, Kubernetes, Haskell, Airflow, and other modern tools. Quality is as important as speed. We’re building for the long run, so you’ll need to enjoy writing tests and documentation too.

We use open source software whenever possible, and we also like to contribute back to the open source ecosystem. We embrace open sourcing both libraries and tools developed in-house where that makes sense.

Our day to day work practices are centered around GitHub, pull requests, code review, continuous testing, integration, and deployment, and agile development. We coordinate with each other and the rest of the company using Slack for chat, Zoom for video calls and screen sharing, Jira, and Google Drive. We’re always looking to improve our practices and we expect you to help us to do so.

WORKING AT ACTIVESTATE

ActiveState has a collaborative, respectful, and professional culture. We’re all about working together to find the best solutions, and making sure that the experience of doing so is positive for everyone involved. There is a commitment from the CEO on down to making work at ActiveState a great experience for all.

Our company is a team of 65 and growing, with half of the positions in technical roles. We maintain a set of core, overlapping hours, but we’re flexible with specific start and end times and are understanding about appointments and life events.

Our vision is to have an ActiveState solution on every device on every planet, so we certainly don’t lack ambition! But even though we’re ambitious we don’t expect work to become your life. We know you will do your best work in a positive environment free from death marches. For more about working at ActiveState and our Glassdoor rating go to www.activestate.com/careers.

How To Apply

Please submit your contact info, resume, and a cover letter below. Submissions without a cover letter will not be considered. We look forward to hearing from you!
We are committed to creating a welcoming environment for everyone at ActiveState and we welcome applicants from all walks of life.
Even if you don’t feel you meet every exact requirement, we still would love to hear from you and why you think you would be an awesome addition to our team and we encourage you to apply.