What are the responsibilities and job description for the Big Data Engineer/Big Data developer-Full time-Hybrid position at Jobs via Dice?
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Visionary Innovative Technology Solutions, is seeking the following. Apply via Dice today!
We are looking for a Big Data Engineer with strong experience in building scalable data pipelines and working with large datasets using modern big data technologies.
Key Responsibilities:
We are looking for a Big Data Engineer with strong experience in building scalable data pipelines and working with large datasets using modern big data technologies.
Key Responsibilities:
- Design and develop data pipelines using Apache Spark and Hadoop ecosystem
- Process and analyze large-scale structured and unstructured data
- Build ETL workflows and optimize data processing jobs
- Integrate data from multiple sources including APIs, databases, and streaming platforms
- Ensure data quality, reliability, and performance
- Collaborate with data scientists and analysts to support business needs
- Monitor and troubleshoot data pipelines in production
- Strong experience in Python/Java/Scala
- Hands-on experience with Apache Spark and Hadoop
- Knowledge of Hive, HDFS, and Kafka
- Strong SQL and data modeling skills
- Experience with Linux and Git