What are the responsibilities and job description for the Scala Spark Data Developer position at Jobs via Dice?
RESPONSIBILITIES:
Kforce client is in need of a Scala Spark Data Developer to work on-site 4 days a week in Burlington, MA. This is a contract to hire opportunity.
Summary:
The Scala Spark Data Developer will be supporting multiple data use cases, including lift-and-shift initiatives and new pipeline development, on an AWS-based big data platform. The role is hands-on, delivery-focused, and embedded within an environment that has production support already in place, allowing time to learn standardized processes.
Key Responsibilities:
We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.
Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.
This job is not eligible for bonuses, incentives or commissions.
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
By clicking ?Apply Today? you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.
Kforce client is in need of a Scala Spark Data Developer to work on-site 4 days a week in Burlington, MA. This is a contract to hire opportunity.
Summary:
The Scala Spark Data Developer will be supporting multiple data use cases, including lift-and-shift initiatives and new pipeline development, on an AWS-based big data platform. The role is hands-on, delivery-focused, and embedded within an environment that has production support already in place, allowing time to learn standardized processes.
Key Responsibilities:
- Design, develop, and maintain data ingestion and ETL pipelines
- Build and optimize Scala-Spark based data processing jobs
- Support multiple data use cases, including modernization and lift-and-shift efforts
- Implement and maintain business logic within data pipelines
- Work within a standardized data engineering framework while contributing to improvements
- Collaborate with existing teams supporting production workloads
- 7-8 years of overall experience ina Data Development focused role
- Scala and Spark/Secondary preference would be Java with Spark if no Scala
- Databricks experience - Databricks Compute, Databricks Storage
- Hands-on experience designing and developing: Ingestion pipelines, ETL pipelines
- Databricks workspace and cluster configuration and Job scheduling and workflow management
- Airflow experience is preferred
- Solid experience with data pipeline architecture and workflow management
We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.
Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.
This job is not eligible for bonuses, incentives or commissions.
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
By clicking ?Apply Today? you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.