What are the responsibilities and job description for the Data Engineer position at Coda Search│Staffing?
Spark / Scala Data Engineer - Streaming Technology Consultant
Location: Onsite - NYC
Contract Opportunity
We are partnering with a leading organization to hire a Spark / Scala Data Engineer to support and enhance a large-scale enterprise data warehouse platform that serves as the single source of truth for financial data across the business.
This role focuses primarily on Spark and Scala development, working within a modern, highly scalable data ecosystem built on technologies such as Spark, Kafka, AWS, and Snowflake. The engineer will contribute to building and optimizing high-volume data pipelines and supporting a streaming data platform used across the enterprise.
The right candidate will bring strong technical expertise while also contributing ideas that improve platform design and overall data architecture.
Principal Responsibilities
- Design, develop, and maintain Spark ETL data pipelines using Scala and Kafka
- Integrate new data feeds and optimize existing data pipelines
- Perform application profiling and performance tuning
- Provide second-line support for data services and related platform components
- Collaborate with cross-functional teams to deliver solutions that handle large volumes of data
- Ensure data is ingested, curated, standardized, stored, and managed appropriately across the platform
- Take end-to-end ownership of development tasks and deliverables
Required Qualifications
- 4 years of hands-on Scala and Apache Spark development experience (including Spark Streaming)
- Experience with automated testing, including unit, integration, and performance testing
- Background in an object-oriented programming language such as Java, C , or C#
- 2 years of professional database development experience across multiple technologies
- Basic knowledge of Kafka and event-driven data pipelines
- Strong analytical and problem-solving skills with the ability to work independently in a fast-paced environment
- Strong communication skills and ability to collaborate with global development teams
Preferred Experience
- Financial services industry experience
- Familiarity with datasets such as Trades, Positions, P&L, Risk Sensitivities, or Reference Data
Technology Exposure
This role offers exposure to a modern technology stack including:
- AWS (EMR, EKS, and other cloud services)
- Snowflake
- Kafka
- Spark / Scala
- Angular and Java for platform enhancements