What are the responsibilities and job description for the Senior Data Engineer position at Jobs via Dice?
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Script2IT, is seeking the following. Apply via Dice today!
Position: Senior Data Engineer
Location: Indianapolis, IN (person to travel to Indianapolis, Indiana to meet with client when required)
Duration: 3 months Contract to hire
Looking For People Who Does Not Require Visa Sponsorship.
Here are the specifications:
Key Responsibilities:
Experience in designing and implementation of scalable data pipelines and lakehouse architectures using Databricks
Experience in defining best practices for data ingestion, transformation, and storage
Experience in architecting Databricks solutions on Azure, AWS
Lead the deployment and configuration of Databricks including Unity Catalog
Experience in optimizing Spark jobs and cluster performance
Implement Delta Lake for reliable and performant data lakes
Implement role-based access controls and audit mechanisms
Evaluate emerging technologies and tools to enhance the Databricks ecosystem
Continuously improve performance, cost-efficiency, and scalability of data solutions
Skills And Competencies
Lakehouse Architecture Design
Real-Time Media Content Analytics
MLOps Pipeline Orchestration
Delta Lake
Unity Catalog
MLflow
Databricks SQL
Apache Kafka
Terraform
Required Qualifications:
Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
7 years of experience in data engineering or architecture roles.
3 years of hands-on experience with Databricks and Apache Spark.
Strong proficiency in Python, SQL, and Spark.
Experience with Delta Lake, MLflow, and Unity Catalog.
Familiarity with CI/CD pipelines and DevOps practices in data environments.
Certifications in Databricks, Azure/AWS/Google Cloud Platform.
Experience with real-time data processing (Kafka, Structured Streaming).
Knowledge of machine learning workflows and MLOps.
Position: Senior Data Engineer
Location: Indianapolis, IN (person to travel to Indianapolis, Indiana to meet with client when required)
Duration: 3 months Contract to hire
Looking For People Who Does Not Require Visa Sponsorship.
Here are the specifications:
Key Responsibilities:
Experience in designing and implementation of scalable data pipelines and lakehouse architectures using Databricks
Experience in defining best practices for data ingestion, transformation, and storage
Experience in architecting Databricks solutions on Azure, AWS
Lead the deployment and configuration of Databricks including Unity Catalog
Experience in optimizing Spark jobs and cluster performance
Implement Delta Lake for reliable and performant data lakes
Implement role-based access controls and audit mechanisms
Evaluate emerging technologies and tools to enhance the Databricks ecosystem
Continuously improve performance, cost-efficiency, and scalability of data solutions
Skills And Competencies
Lakehouse Architecture Design
Real-Time Media Content Analytics
MLOps Pipeline Orchestration
Delta Lake
Unity Catalog
MLflow
Databricks SQL
Apache Kafka
Terraform
Required Qualifications:
Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
7 years of experience in data engineering or architecture roles.
3 years of hands-on experience with Databricks and Apache Spark.
Strong proficiency in Python, SQL, and Spark.
Experience with Delta Lake, MLflow, and Unity Catalog.
Familiarity with CI/CD pipelines and DevOps practices in data environments.
Certifications in Databricks, Azure/AWS/Google Cloud Platform.
Experience with real-time data processing (Kafka, Structured Streaming).
Knowledge of machine learning workflows and MLOps.
