What are the responsibilities and job description for the Big Data Engineer position at Jobs via Dice?
Dice is the leading career destination for tech experts at every stage of their careers. Our client, OSI Engineering, Inc., is seeking the following. Apply via Dice today!
A globally leading consumer device company based in Mountain View, CA is seeking a talented Data Engineer to help build secure, scalable cloud services that power the world s best-selling mobile devices. As part of the Knox Cloud Team, you ll play a key role in transforming research projects into production-ready cloud platforms and service infrastructures. We re looking for world-class server software engineers with strong expertise in Big Data infrastructure and data warehousing to join our innovative technology group driving the rapid development of AI-powered, cloud-based, end-to-end mobile applications and services.
Responsibilities Include:
Implement, maintain and evolve big data platform and infrastructure
Responsible for designing, implementing and maintaining backend REST API Services and ETL processes for Predictive Data Modeling, Machine Learning, Personalization, Recommendation, and Business Intelligence system
Perform extensive research and analysis to make optimal architecture and design decisions
Write large amounts of code, perform code reviews, write unit tests and documentation
Interface with other groups including Product Management, QA and Operations
Create quick proof-of-concept prototypes
Work in a scrum team with ML & Cloud Engineers
Candidate Requirements:
Hand-on experience in Big Data technologies like Apache Iceberg (a must-have), Spark, Spark ML, & Kafka
Strong skills in statistical analysis: correlation analysis, regression analysis, univariate and multivariate analysis
Strong skills in algorithms, Data structures, UNIX/Linux, Scripting, Machine Learning (especially classification and unsupervised clustering), Data Modeling, Data warehousing, and Networking
Hands-on experience in building REST API s
Team player with strong communication skills and ability to mentor ML & Cloud engineers in areas of Data Engineering
Desire to learn fast and pick up latest and greatest technologies
MS in Computer Science or equivalent experience
Preferred:
Programming Language: Python
Big Data Technologies: AWS EMR, Iceberg, Spark, Kafka, & YARN
Machine Learning: PyTorch, TensorFlow, Spark ML
REST API: Flask, FastAPI, or Django
Data Quality tools such as Monte Carlo, Great Expectations, or Databand
Experience with teams using MLflow
Type: Contract
Duration: 12 months with extension
Work Location: Mountain View, CA (on-site)
Pay range: $ 80.00 - $ 95.00 (DOE)
A globally leading consumer device company based in Mountain View, CA is seeking a talented Data Engineer to help build secure, scalable cloud services that power the world s best-selling mobile devices. As part of the Knox Cloud Team, you ll play a key role in transforming research projects into production-ready cloud platforms and service infrastructures. We re looking for world-class server software engineers with strong expertise in Big Data infrastructure and data warehousing to join our innovative technology group driving the rapid development of AI-powered, cloud-based, end-to-end mobile applications and services.
Responsibilities Include:
Implement, maintain and evolve big data platform and infrastructure
Responsible for designing, implementing and maintaining backend REST API Services and ETL processes for Predictive Data Modeling, Machine Learning, Personalization, Recommendation, and Business Intelligence system
Perform extensive research and analysis to make optimal architecture and design decisions
Write large amounts of code, perform code reviews, write unit tests and documentation
Interface with other groups including Product Management, QA and Operations
Create quick proof-of-concept prototypes
Work in a scrum team with ML & Cloud Engineers
Candidate Requirements:
Hand-on experience in Big Data technologies like Apache Iceberg (a must-have), Spark, Spark ML, & Kafka
Strong skills in statistical analysis: correlation analysis, regression analysis, univariate and multivariate analysis
Strong skills in algorithms, Data structures, UNIX/Linux, Scripting, Machine Learning (especially classification and unsupervised clustering), Data Modeling, Data warehousing, and Networking
Hands-on experience in building REST API s
Team player with strong communication skills and ability to mentor ML & Cloud engineers in areas of Data Engineering
Desire to learn fast and pick up latest and greatest technologies
MS in Computer Science or equivalent experience
Preferred:
Programming Language: Python
Big Data Technologies: AWS EMR, Iceberg, Spark, Kafka, & YARN
Machine Learning: PyTorch, TensorFlow, Spark ML
REST API: Flask, FastAPI, or Django
Data Quality tools such as Monte Carlo, Great Expectations, or Databand
Experience with teams using MLflow
Type: Contract
Duration: 12 months with extension
Work Location: Mountain View, CA (on-site)
Pay range: $ 80.00 - $ 95.00 (DOE)
Salary : $80 - $95