Demo
Salary Resume Critique Job Openings

Big Data Engineer

Purple Drive Technologies LLC
Tampa, FL Other
POSTED ON 12/9/2025 CLOSED ON 12/16/2025

What are the responsibilities and job description for the Big Data Engineer position at Purple Drive Technologies LLC?

Job Details

Job Title: Big Data Engineer

Location: Atlanta, GA / Tampa, FL/ Dallas, TX


Job Summary

We are seeking an experienced Big Data Engineer to design, build, and optimize large-scale data pipelines and distributed systems across cloud and on-prem platforms. The ideal candidate will have strong expertise in Spark, Hadoop ecosystems, cloud data services, ETL/ELT design, streaming platforms, and best practices for scalable data processing.


Responsibilities

  • Design, develop, and maintain big data pipelines using Spark (PySpark/Scala), Hadoop, Kafka, and distributed computing frameworks.

  • Build and optimize ETL/ELT pipelines for structured and unstructured data across cloud and on-prem data platforms.

  • Work with cloud technologies (AWS, Azure, or Google Cloud Platform) including Data Lake, Databricks, EMR, Glue, Dataflow, Synapse, or Snowflake.

  • Develop Delta Lake / Lakehouse architecture for high-performance ingestion and processing.

  • Build real-time streaming solutions using Kafka, Spark Streaming, Kinesis, or Event Hub.

  • Collaborate with data architects, analysts, and application teams to gather data requirements and deliver scalable solutions.

  • Implement and maintain CI/CD pipelines, automated jobs, and orchestration using Airflow/Azure Data Factory/Glue Workflows.

  • Optimize data pipelines for performance, cost efficiency, and reliability.

  • Ensure data quality, validation, governance, and lineage best practices across the ecosystem.

  • Troubleshoot and resolve production issues in a high-availability environment.



Required Skills & Qualifications

  • 5-8 years of experience as a Big Data Engineer or Data Engineer.

  • Strong hands-on skills with Spark (PySpark or Scala), Hadoop, Hive, HDFS, MapReduce.

  • Experience working with Databricks, EMR, Glue, Synapse, DataProc, or equivalent big-data compute engines.

  • Proficiency in Python or Scala for data engineering.

  • Experience with Kafka or other event-streaming technologies.

  • Strong understanding of cloud data architectures (AWS S3/Glue/EMR | Azure ADLS/ADF/Databricks | Google Cloud Platform BigQuery/DataProc).

  • Solid SQL skills and experience with relational NoSQL databases.

  • Experience with version control (Git) and CI/CD tools (Jenkins, Azure DevOps, GitHub Actions).

  • Hands-on experience with Airflow, ADF, or other orchestration and scheduling tools.

  • Familiarity with data modeling, data governance, and best practices for data quality.


Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Big Data engineer
VySystems -
Tampa, FL
View Job Details
Big Data Lead
Mindlance -
Tampa, FL
View Job Details
Big Data developer
Jobs via Dice -
Tampa, FL
View Job Details

Hourly Wage Estimation for Big Data Engineer in Tampa, FL
$39.00 to $51.00
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Big Data Engineer?

Sign up to receive alerts about other jobs on the Big Data Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$92,929 - $122,443
Income Estimation: 
$122,257 - $154,284
Income Estimation: 
$92,929 - $122,443
Income Estimation: 
$122,257 - $154,284
This job has expired.
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Purple Drive Technologies LLC

Refrigeration Technician
Apply
  • Purple Drive Technologies LLC Meridian, MS
  • About the Role: Join a leading field service team supporting Liebert HVAC / Cooling systems. Who We're Looking For: · Age 18 with a valid driver’s license ... more
  • 13 Days Ago
` Fircosoft Product Owner
Apply
  • Purple Drive Technologies LLC Phoenix, AZ
  • Job Details Experience requested: 10 & Above ROLE: Fircosoft Product Owner Description: " **Experience working with Fircosoft Insight & Continuity is manda... more
  • 13 Days Ago
Supervisor – Warehousing
Apply
  • Purple Drive Technologies LLC Ironton, OH
  • Key Responsibilities: Maintain organized material control and accurate system inventory. Lead cycle counting and corrective actions to ensure inventory acc... more
  • 13 Days Ago
Finance Analyst
Apply
  • Purple Drive Technologies LLC Huntington, WV
  • Position SummaryThe Finance Analyst is responsible for analyzing cost and operational data for the Ironton, Ohio manufacturing plant. This role partners cl... more
  • 14 Days Ago
View More Jobs at Purple Drive Technologies LLC

Not the job you're looking for? Here are some other Big Data Engineer jobs in the Tampa, FL area that may be a better fit.

Cloud Big Data Engineer
Apply
  • Comtech LLC Tampa, FL
  • Company Description Comtech LLC is a woman-owned small business focused on delivering end-to-end solutions and products. Since 1998, we have successfully s... more
  • 30 Days Ago
Lead Big Data Engineer
Apply
  • Programmers.io Tampa, FL
  • We are seeking an experienced Big Data Lead to drive the design, development, optimization, and maintenance of large-scale data platforms and Big Data solu... more
  • 8 Days Ago
View More Jobs

AI Assistant is available now!

Feel free to start your new journey!