Context Labs is seeking a Principal Data Engineer to provide technical expertise to support the deployment of our Decarbonization as a Service™ platform, built on our Immutably™ Data Fabric technology. Working as an integral leader within the development team, the engineer will head all aspects of developing our data processing and management capabilities, provide thought leadership to mentor less senior engineers, and define strategic linkages for data usage across the company’s products. This position will report to the General Manager.

Responsibilities

• Lead data engineering team as a technical authority
• Assemble large, complex data sets that meet functional / non-functional business requirements
• Work independently with subject matter experts to obtain data from different sources, complete data clean up, and build a data dictionary independently
• Deploy and maintain optimal data pipeline architecture
• Integrate back-end data storage including relational database, graph database, key-value storage, and document/blob stores
• Interpret and analyze high-volume, heterogeneous data
• Provide thought leadership and deliver pragmatic solutions for data structures to support complex analytics applications beyond simple CRUD operations
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs
• Work with data analytics experts to strive for greater functionality in our data systems
• Collaborate as a member of an agile team to get products developed and completed with best-in-class software development

Skills and Qualifications

If you think you have what it takes but don't necessarily meet every single point on the job description, please get in touch. We'd love to have a chat and see if you could be a great fit.

We are looking for:

• 10 years of relevant data engineering experience
• Bachelor's degree in Computer Science or related field
• Oil & Gas industry experience in data modeling, data management, or data science is desirable
• Great communication skills
• Exceptional attention to detail and focus on quality
• Advanced working SQL knowledge and experience working with relational databases (Postgres), query authoring (SQL)
• Strong Python proficiency in both the language and ecosystem of Python-related practices and tools
• Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets is strongly preferred
• Solid experience with processes supporting data transformation, data structures, metadata, dependency, and workload management
• Experience with modern data engineering tools (e.g., Spark, Kafka, Pandas, etc.)
• Working familiarity with a variety of databases, AWS S3, AWS Lamda, AWS GLUE, AWS Athena, SageMaker
• Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores
• Proven knowledge and experience implementing the fundamental design patterns and principles needed to build performance-optimized and scalable applications
• Understand complex concepts and be able to weigh trade-offs; think critically when analyzing scenarios with multiple (sometimes competing) requirements
• Experience with Docker-based architectures is preferred
• Proficiency in unit and functional testing
• Experience with source repositories (git/Bitbucket)

Context Labs embraces diversity and equal opportunity. We are committed to building a team that represents a variety of backgrounds, perspectives, and skills. We believe the more inclusive we are, the better our products will be. Context Labs will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, perform essential job functions, and receive other benefits and privileges of employment. If you require accommodation, please contact Erica Mackoff at HR@contextlabs.com.

Important COVID-19 Guidance:

Per Context Labs’ policy, all employees who wish to work in-office or visit one of our offices in-person must be fully vaccinated.

We are a team that is hiring and growing! Learn more about Context Labs here:

www.contextlabs.com

www.sphericalanalytics.io(a Context Labs company)