What are the responsibilities and job description for the Data Engineer position at SoTalent?
Job Title: Data Engineer - Databricks
Location: Alpharetta, Georgia, United States
Type: Full Time
Our client is looking for a Data Engineer (Databricks) to help build, scale, and support modern data platforms that power commercial data products and advanced analytics. This role focuses on developing reliable, reusable, and high‑performing data pipelines that enable internal teams and external partners to unlock value from diverse data assets.
This position partners closely with analytics, product, and data stakeholders to transform evolving business needs into production‑ready, scalable data solutions.
Key Responsibilities
- Design and develop scalable data pipelines that integrate proprietary and third‑party data sources.
- Build, optimize, and maintain reliable data transformation workflows with a strong focus on performance and reuse.
- Prepare curated datasets from structured and semi‑structured data for internal analytics and external consumption.
- Use SQL and cloud-based data platforms (Databricks preferred; Snowflake or similar acceptable) to cleanse, standardize, and transform data aligned to business use cases.
- Collaborate with product, analytics, and business teams to translate commercialization goals into scalable data solutions.
- Contribute to data models and reusable pipeline patterns to support future data product growth.
- Partner with application and platform teams to understand upstream systems and implement efficient data flows.
- Monitor data quality, pipeline reliability, and performance across production environments.
Required Qualifications
- Bachelor’s degree in Computer Science, Information Systems, or a related field, or equivalent experience.
- 4 years of experience in data engineering, analytics engineering, or modern cloud data platforms.
- Hands-on experience building and maintaining cloud-based data pipelines.
- Strong SQL skills and experience delivering analytics‑ or product‑ready datasets.
- Experience integrating data from multiple internal and third‑party sources.
- Familiarity with structured and semi‑structured data in batch and/or streaming environments.
- Working knowledge of data modeling concepts and data quality best practices.
- Experience supporting analytics, reporting, or externally facing data use cases.
Preferred Experience
- Hands-on experience with Databricks, including Spark, Delta Lake, workflows, or orchestration tools.
- Interest or experience in data products, data monetization, or commercialization initiatives.
- Experience building production-grade data pipelines in iterative or agile environments.
- Comfort working with ambiguity and evolving requirements.
- Strong ability to translate loosely defined business ideas into structured data outputs.
- Collaborative mindset with a strong sense of ownership and execution focus.
Salary : $106,500 - $177,500