Sr Big Data Engineer/Sr. Data Engineer

Description

Top Skills' Details:

• 10 years of experience acting as a Sr Data Engineer / Big Data Engineer with the ability to develop and build data pipelines.
• 2-3 years of experience working on the databricks platform and Medallion Architecture performing duties like:
• Autoloading
• Lake Flow Connections
• Clusters, Catalogs, and Work spaces
• Building CI/CD Pipelines
• Data Masking
• Data Streaming
• 5 years of experience working on the AWS cloud platform and with AWS technologies. (Azure would also suffice).
• 5 years of experience working with Python coding language, PySpark, and PySQL.
• Ability to work with cross functional teams, business and IT stakeholders.
• Strong business acumen within the HealthCare domain (Health Insurance, Pharmacy, etc..) with knowledge of HIPPA guidelines, PHI/PII
  
  
  

for Data Masking.

Nice To Have:

• If the candidates do not have HealthCare / PHI experience, then Financial Experience is required so they have experience working with PII information.
  
  
  

Position Summary:

The Senior Big Data Engineer drives the design, development, and operational excellence of our data platform built on Databricks and the Delta Lakehouse Architecture. This role requires deep expertise in scalable ETL/ELT, Spark optimization, and modern data governance using Unity Catalog. The Senior Big Data Engineer serves as a technical leader, establishing best practices for code quality, performance, and automated deployments across all

environments.

Responsibilities:

• Design and implement scalable data pipelinesusing Delta Lake and manage enterprise-wide data access, security, and lineageusing Unity Catalog
• Optimize large-scale Spark jobs (PySpark/SQL)and cluster configurations (Photon) to meet stringent SLA and cost performancetargets across all workflows.
• Build resilient data scheduling via Databricks Workflows (Jobs) and establish automated CI/CD pipelines for reliable code promotion across Dev, Staging, and Prod workspaces.
• Migrate data and models from relationaldatabases to Databricks.
• Ensure best practices for development usingindustry standard development patterns.
• Monitor data pipelines performance.
• Partner with Data Management and Full Stackdevelopment engineers to operationalize models with current applications and processes.
• Support existing data pipelines to ensurebusiness continuity.
• Stay updated with the latest trends andtechnologies in data engineering and cloud computing.
• Perform other related duties as assigned.
  
  
  

Requirements:

• Bachelor’s degree is required.
• 5 years of experience in Data Engineering, witha significant focus on data warehousing, ETL/ELT development, and distributedsystems
• 3 years of hands-on experience developingenterprise solutions on the Databricks platform.
• Expertise in PySpark and high-performance SQL
• Deep understanding of Delta Lake architectureand optimal maintenance practices
• Experience with cloud platforms (AWS preferred)and integrating Databricks with native cloud services (S3, Secret Manager, IAM)
• Solid experience implementing CI/CD forDatabricks notebooks and associated libraries.
• Healthcare experience is preferred.
  
  
  

Skills

Python, Data, AWS, databricks, Big Data, SQL, Data warehouse, Azure, ETL, Data architecture

Top Skills Details

Python, Data, AWS, databricks, Big Data

Skills:

Additional Skills & Qualifications

• Strong development experience with: Python,Spark, or similar technologies
• Excellent verbal, communication, negotiation,and presentation skills
• Strong analytical and problem-solving skills
• Ability to work autonomously while collaboratingacross teams to deliver timely projects.
• Ability to explain complex concepts in simple terms.
• Dedicated, hardworking employee who achievesmaximum efficiency and productivity.
• Strong knowledge of domain-based design, datamodeling and data structures
• Strong knowledge of best practice in datamanagement
  
  
  

Core Competencies:

• Communication Skills
• Customer Service
• Building Relationships
• Business Knowledge / Organizational Acumen
• Initiative and Drive
• Leading Self and Others
  
  
  

Experience Level

Expert Level

Job Type & Location

This is a Permanent position based out of Tampa, FL.

Pay And Benefits

The pay range for this position is $140000.00 - $160000.00/yr.

Benefits can be provided upon request

Workplace Type

This is a fully remote position.

Application Deadline

This position is anticipated to close on Apr 6, 2026.

h4>About TEKsystems:

We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.

The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

About TEKsystems And TEKsystems Global Services

We’re a leading provider of business and technology services. We accelerate business transformation for our customers. Our expertise in strategy, design, execution and operations unlocks business value through a range of solutions. We’re a team of 80,000 strong, working with over 6,000 customers, including 80% of the Fortune 500 across North America, Europe and Asia, who partner with us for our scale, full-stack capabilities and speed. We’re strategic thinkers, hands-on collaborators, helping customers capitalize on change and master the momentum of technology. We’re building tomorrow by delivering business outcomes and making positive impacts in our global communities. TEKsystems and TEKsystems Global Services are Allegis Group companies. Learn more at TEKsystems.com.

The company is an equal opportunity employer and will consider all applications without regard to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.