What are the responsibilities and job description for the Senior Data Engineer position at Technogen, Inc.?
TECHNOGEN, Inc. is a Proven Leader in providing full IT Services, Software Development and Solutions for 15 years.
TECHNOGEN is a Small & Woman Owned Minority Business with GSA Advantage Certification. We have offices in VA; MD & Offshore development centers in India. We have successfully executed 100 projects for clients ranging from small business and non-profits to Fortune 50 companies and federal, state and local agencies.
Job Title: Senior Data Engineer
Work location: 4 days/week at the client office in Midtown, Atlanta GA
Local candidates only
Job Description:
Position Overview
We are seeking a Senior Data Engineer to join the core Symphony platform team in an onshore capacity. This is a hands-on development role focused on building, maintaining, and optimizing data pipelines and warehousing solutions. The engineer will work within a local-first development model and is expected to be a strong, independent contributor capable of owning complex workstreams.
We are seeking a Senior Data Engineer to join the core Symphony platform team in an onshore capacity. This is a hands-on development role focused on building, maintaining, and optimizing data pipelines and warehousing solutions. The engineer will work within a local-first development model and is expected to be a strong, independent contributor capable of owning complex workstreams.
Key Responsibilities
Design, develop, and maintain data pipelines using Scala and SQL on Apache Spark
Monitor and support Phase 1 pipelines post go-live
Investigate and remediate pipeline failures, data quality issues, and performance bottlenecks
Lead refactoring and cleanup of existing Phase 1 code
Optimize existing solutions for performance and scalability
Build and contribute to reusable patterns and automation frameworks
Work within metadata-driven architecture
Ensure pipelines are used strictly for scheduling - ETL logic must remain in code
Manage code using GitHub version control
Contribute to discovery sessions to derive requirements directly from data
Design, develop, and maintain data pipelines using Scala and SQL on Apache Spark
Monitor and support Phase 1 pipelines post go-live
Investigate and remediate pipeline failures, data quality issues, and performance bottlenecks
Lead refactoring and cleanup of existing Phase 1 code
Optimize existing solutions for performance and scalability
Build and contribute to reusable patterns and automation frameworks
Work within metadata-driven architecture
Ensure pipelines are used strictly for scheduling - ETL logic must remain in code
Manage code using GitHub version control
Contribute to discovery sessions to derive requirements directly from data
Required Skills & Experience
Must Have:
8 10 years of hands-on data engineering experience
Strong understanding of Apache Spark and its core concepts
Proficiency in Scala and/or Java - code-first approach required
Advanced SQL skills
Experience with Azure Synapse
Working knowledge of GitHub for source control
Experience with data warehousing and large-scale data integration
8 10 years of hands-on data engineering experience
Strong understanding of Apache Spark and its core concepts
Proficiency in Scala and/or Java - code-first approach required
Advanced SQL skills
Experience with Azure Synapse
Working knowledge of GitHub for source control
Experience with data warehousing and large-scale data integration
Nice to Have:
Experience with Microsoft Fabric
Background in marketing data or consumer goods analytics
Familiarity with metadata-driven architectures
Experience with Microsoft Fabric
Background in marketing data or consumer goods analytics
Familiarity with metadata-driven architectures
Non-Negotiables:
Must be a hands-on builder
Must be available to mobilize immediately
Must commit to 4 days/week onshore
Must be a hands-on builder
Must be available to mobilize immediately
Must commit to 4 days/week onshore
Akanksha Agarwal | Sr. US IT Recruiter