What are the responsibilities and job description for the Sr. Data Engineer position at Capstone Logistics, LLC?
Compensation
Shift:
Competitive
Sr. Data Engineer
Azure Databricks - Platform Engineering
Competitive salary/bonus
Remote
Job Summary
The ideal candidate will possess strong background on Data Engineering development technologies & experience with cloud-based resources. The candidate must possess excellent written and verbal communication skills with the ability to collaborate effectively with domain experts and technical experts in the team. This role will be responsible for both team collaboration as well as project initiative ownership and leadership. This role is for contributing to both technical expertise as well as process leadership.
An Azure Databricks Engineer designs, builds, and optimizes scalable data pipelines and lakehouse solutions within the Microsoft Azure ecosystem.
Core Responsibilities
Responsibilities:
Education and/or experience:
Capstone Logistics, LLC is part of The Transportation and Logistics industry which has been designated a "Critical Infrastructure Segment". As a "critical infrastructure industry" worker in the Transportation and Logistics industry, associates are considered exempt from local restrictions such as curfews, shelter-in-place orders, and other mobility restrictions when reporting to, returning from, or performing his or her work functions.
JOB ID:CAP28290
Get job alerts by email. Sign up now! Join Our Talent Network!
Job Snapshot
Employee Type
Full-Time
Street Address
30 Innovation Drive Suite 200
Location
Peachtree Corners, GA (Onsite)
Job Type
Engineering
Experience
Not Specified
Date Posted
06/05/2026
Job ID
28290
Shift:
Competitive
Sr. Data Engineer
Azure Databricks - Platform Engineering
Competitive salary/bonus
Remote
- Sponsorship is not provided now or in the future.***
- No Third-Party Resumes.***
Job Summary
The ideal candidate will possess strong background on Data Engineering development technologies & experience with cloud-based resources. The candidate must possess excellent written and verbal communication skills with the ability to collaborate effectively with domain experts and technical experts in the team. This role will be responsible for both team collaboration as well as project initiative ownership and leadership. This role is for contributing to both technical expertise as well as process leadership.
An Azure Databricks Engineer designs, builds, and optimizes scalable data pipelines and lakehouse solutions within the Microsoft Azure ecosystem.
Core Responsibilities
- Data Engineering & ETL: Develop and maintain batch/streaming data pipelines using Azure Databricks, Azure Data Factory and PowerBI
- Azure Integration: Integrate Databricks with (ADLS), Power-BI, ADO, Key Vault
- Performance Optimization: Optimize Spark jobs, cluster configurations, Serverless Policy & Cost Optimization
- Data Governance & Security: Implement Unity Catalog for access control, data lineage, and security compliance.
- DevOps & Automation: Build CI/CD pipelines for Databricks notebooks and workflows using Azure DevOPS & Terraform.
- Collaboration: Work with data Engineers and analysts to enable AI/ML workloads
- Education: Bachelor’s degree in computer science, Engineering, or a related field.
- Technical Skills: Proficiency in Python (PySpark), SQL.
- Cloud Experience: Strong hands-on experience with Microsoft Azure services.
- CI/CD: Azure DevOPS
- Databricks Expertise: Experience with Delta Lake, Spark SQL, and Databricks Jobs.
- No direct reports but responsible for project ownership which may have reports.
- Responsible for mentoring of Jr. resources.
Responsibilities:
- Understand the business data needs, both current and future to help deliver and guide a data strategy
- Set and ensure proper adherence to strategic and tactical patterns
- Set technical direction for obtaining and implementing technology
- Help evaluate current and future staffing needs
- Drive the creation of new standards and best practices as technology evolves; communicate and drive adoption across the company
- Drive creation of new data capabilities and offerings
- Develop and maintain batch/streaming data pipelines using Azure Databricks, Azure Data Factory and PowerBI
- Integrate Databricks with (ADLS), Power-BI, ADO, Key Vault
- Optimize Spark jobs, cluster configurations, Serverless Policy & Cost Optimization
- Implement Unity Catalog for access control, data lineage, and security compliance.
- Build CI/CD pipelines for Databricks notebooks and workflows using Azure DevOPS & Terraform.
- Work with data Engineers and analysts to enable AI/ML workloads
- Performs Additional Responsibilities As Assigned*
Education and/or experience:
- Bachelor’s Degree in a technical field (statistics, mathematics, science, accounting, finance) or related field
- 4 Heavy Data experience across the full data life cycle
- Experience in architecting enterprise-wide data environments and platforms
- Heavy experience in data movement, transformation, and modeling processes (ELT/ETL)
- 4 years’ experience working with large datasets or database systems
- 2 Years working with cloud data technologies
- Azure Experience
- Proficiency in Python (PySpark), SQL.
- Strong hands-on experience with Microsoft Azure services.
- Azure DevOPS
- Experience with Delta Lake, Spark SQL, and Databricks Jobs.
- Cloud data experience
- Storage, computer, movement orchestration, reporting
- Full data stack experience
- Traditional and modern data warehousing expertise
- Data modeling expertise
- Experience in data lake patterns and process
- Excellent interpersonal and communication skills (written and verbal)
- Demonstrated ability to manage time and prioritize projects to meet deadlines
- Excellent listening, written, and oral communication skills
- Excellent critical thinking skills to help solve business problems and make decisions, paired with a desire to take initiative
- Ability to maintain project plans, resourcing schedules, and forecasted activities
- Ability to work well under continually changing deadlines and priorities
Capstone Logistics, LLC is part of The Transportation and Logistics industry which has been designated a "Critical Infrastructure Segment". As a "critical infrastructure industry" worker in the Transportation and Logistics industry, associates are considered exempt from local restrictions such as curfews, shelter-in-place orders, and other mobility restrictions when reporting to, returning from, or performing his or her work functions.
JOB ID:CAP28290
Get job alerts by email. Sign up now! Join Our Talent Network!
Job Snapshot
Employee Type
Full-Time
Street Address
30 Innovation Drive Suite 200
Location
Peachtree Corners, GA (Onsite)
Job Type
Engineering
Experience
Not Specified
Date Posted
06/05/2026
Job ID
28290