What are the responsibilities and job description for the Senior Data Engineer | (Big Data & MLOps) | W2 | Onsite position at Redolent, Inc?
Position: Senior Data Engineer | (Big Data & MLOps) | W2 | Onsite
Location: Onsite 5 days a week Pittsburgh, PA
Develop scalable ETL/ELT solutions using Python, PySpark, Spark, SQL, and Hive
- .Deploy and manage applications in OpenShift/Kubernetes container environments
- .Collaborate with Data Scientists, ML Engineers, and cross-functional teams to operationalize machine learning models
- .Optimize Big Data processing frameworks and improve data platform performance
- .Troubleshoot and resolve issues in Linux/Unix environments
- .Implement best practices for DataOps and MLOps, including CI/CD for data and ML workflows
- .Ensure data quality, reliability, scalability, and security across data platforms
.Required Qualifications
- :Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field
- .5 years of experience as a Data Engineer, Senior Data Engineer, Big Data Engineer, MLOps Engineer, or related role
- .Hands-on experience building Machine Learning pipelines and supporting model deployment and training processes
- .Strong experience with OpenShift, Kubernetes, and container technologies
- .Proficiency in Python and/or PySpark for data engineering and automation tasks
- .Strong experience with SQL, Hive, Spark, and Apache Spark
- .Experience working in Linux/Unix environments
- .Knowledge of DataOps and MLOps methodologies and best practices