What are the responsibilities and job description for the Senior Databricks Engineer position at Kforce?
Senior Databricks Engineer
Location: Jacksonville, FL
Job Type: Contract
Compensation: $46 - 63 Hourly
JobID: 2170895-JAX
Description
Kforce has a client in Jacksonville, FL that is seeking a Senior Databricks Engineer. Responsibilities:
Pipeline Development & ETL/ELT: Designing, developing, and maintaining high-performance ETL/ELT data pipelines, often utilizing Databricks notebooks, Auto Loader, and Delta Live Tables
Lakehouse Architecture: Implementing data lakehouse solutions using the Medallion Architecture (Bronze, Silver, Gold layers) for raw, cleaned, and business-ready data
Performance Optimization: Tuning Spark jobs and cluster configurations for efficiency and cost reduction, often leveraging the Photon engine
Data Governance & Security: Implementing data security controls, access policies, and data lineage tracking via Unity Catalog
Workflow Orchestration: Scheduling and monitoring batch and streaming data pipelines using Databricks Workflows or Apache Airflow
Collaboration: Working with data scientists and analysts to operationalize ML models, often using MLflow for tracking and deployment
Requirements
Languages: Expert-level proficiency in Python (PySpark) and SQL is essential. Scala is frequently preferred
Databricks Ecosystem: Deep knowledge of Delta Lake, Databricks SQL, Unity Catalog, and Delta Live Tables
Big Data Frameworks: Strong experience with Apache Spark
Cloud Platforms: Hands-on experience with cloud-native storage (ADLS, S3, GCS) on Azure, AWS, or GCP
DevOps/CI/CD: Proficiency in Git, CI/CD pipelines for code deployment, and infrastructure-as-code tools like Terraform
The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.
We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.
Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.
This job is not eligible for bonuses, incentives or commissions.
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
By clicking “Apply Today” you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.