Senior Data Engineer

Senior Data Engineer

Position Summary

The Senior Data Engineer is responsible for designing, building, and maintaining the end-to-end data ecosystem supporting enterprise analytics. This role oversees ingestion from a SaaS SQL logging platform, manages the AWS-based data lake/warehouse (raw, staged, curated layers), and enables powerful insights through a governed Power BI environment. The ideal candidate brings strong data engineering, cloud architecture, SQL, and business intelligence experience to create a reliable, scalable, and secure data platform.

Key Responsibilities

Data Engineering & Architecture

• Design and maintain data models across raw, staged, and curated layers.
• Develop and optimize ETL/ELT pipelines using AWS Glue, Lambda, and SQL transformations.
• Implement data quality, validation, and monitoring processes.
• Ensure proper logging, exception handling, and workflow automation.

AWS Cloud Platform

• Manage data ingestion into S3 and transformation into Redshift/SQL.
• Configure IAM, security controls, encryption, and access governance.
• Monitor pipeline performance using CloudWatch, CloudTrail, and Step Functions.
• Implement best practices for cost optimization, scalability, and reliability.

Integration & Data Ingestion

• Build integrations with SaaS SQL-based logging systems via APIs, ELT tools, or CDC pipelines.
• Manage incremental loads, upserts, and schema changes.
• Work with vendors to ensure data accessibility and availability.

Business Intelligence Enablement

• Create and manage Power BI datasets, semantic models, and gateways.
• Support report developers with curated, high-quality datasets.
• Develop DAX measures and optimize report refresh and performance.
• Implement governance, RLS, and workspace standards.

DevOps & Delivery

• Use Git-based version control and CI/CD for transformations and pipelines.
• Develop Infrastructure-as-Code (CloudFormation or Terraform) where appropriate.
• Ensure repeatable, documented deployment patterns for data workflows.

Collaboration & Communication

• Partner with business stakeholders to define KPIs and data requirements.
• Provide technical guidance and mentoring to analysts and developers.
• Communicate complex data concepts in clear, concise language.

Required Skills & Qualifications

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field (or equivalent experience).
• 5–8 years of experience in data engineering or analytics platform engineering.
• Strong SQL skills with demonstrated experience in large-scale datasets.
• Hands-on experience with AWS S3, Glue, Lambda, IAM, Redshift/Snowflake/Athena.
• Experience with ELT/ETL development, data quality frameworks, and data modeling.
• Proficiency with Power BI, DAX, semantic models, and dataset optimization.
• Experience with API data ingestion or SaaS data pipelines.
• Knowledge of CI/CD, Git, and automation frameworks.
• Strong analytical, problem-solving, and communication skills.

Preferred Qualifications or Experience

• Master’s degree preferred or considered a plus
• Experience with dbt for SQL modeling.
• Knowledge of event-driven architectures (Kinesis, Kafka).
• Experience with data governance and metadata tools.
• Python proficiency for automation, ingestion, and scripting.

Core Competencies

Functional / Technical Skills

• Designs scalable, cloud-based architecture

Problem Solving

• Resolved systemic integration challenges

Managing Through Systems

• Automates governance, lineage, and observability

Learning on the Fly

• Evaluates and pilots emerging technologies

Drive for Results

• Improves reliability, performance, and SLAs

Job Type: Full-time

Benefits:

• 401(k)
• 401(k) matching
• Dental insurance
• Health insurance
• Life insurance
• Paid time off
• Parental leave
• Vision insurance

Experience:

• Azure platform
• AWS platform
• semantic models

Ability to Relocate:

• Duncan, OK 73533: Relocate before starting work (Preferred)
• Work Location: Hybrid remote in Duncan, OK 73533