What are the responsibilities and job description for the Senior IT Data Engineer - Onsite position at VIVA USA INC?
Title: Senior IT Data Engineer - Onsite
Mandatory skills:
application development, data development, Python,
data integration, ingestion tools, Apache NiFi,
SQL, Java, Microsoft SQL Server, distributed data, computing platforms,
Hadoop, MapReduce, Hive, HBase, Kafka, Spark,
Scrum, Kanban methodologies,
UNIX, Linux, basic commands, shell scripting,
continuous integration continuous delivery, CI/CD pipelines, data platform management,
data quality, data pipeline, Cloudera Data Platform, processing systems, data extraction
Description:
Position Requirements:
Participates in the planning and execution of policies, practices, and projects that acquire, control, protect, and enhance the value of data assets. Facilitates obtaining data from a variety of different sources, in the right formats, assuring that it adheres to data quality standards, as well as resolving any information flow and content issues. Builds a robust data pipeline that cleans, transforms, and aggregates unorganized data into databases.
Proficiency in developing, maintaining, monitoring, and the long-term operations of data pipelines or processing systems running in Cloudera Data Platform. Understanding of data extraction, transformation, loading, and performance tuning of solutions utilizing multiple streams of input data code-based, git and DevOps-enabled technologies using Python or SQL such as PySpark, pandas, or dbt
5 years of experience in application/data development (i.e., Python)
5 years of experience with data integration/ingestion tools (i.e., Apache NiFi)
Advanced level knowledge of SQL, Java, Microsoft SQL Server, distributed data/computing platforms (i.e., Apache NiFi, Hadoop, MapReduce, Hive, HBase, Kafka, Spark)
Experience with Scrum and Kanban methodologies
Experience with UNIX/Linux including basic commands and shell scripting
Experience in implementing and maintaining continuous integration continuous delivery (CI/CD) pipelines and data platform management
VIVA USA is an equal opportunity employer and is committed to maintaining a professional working environment that is free from discrimination and unlawful harassment. The Management, contractors, and staff of VIVA USA shall respect others without regard to race, sex, religion, age, color, creed, national or ethnic origin, physical, mental or sensory disability, marital status, sexual orientation, or status as a Vietnam-era, recently separated veteran, Active war time or campaign badge veteran, Armed forces service medal veteran, or disabled veteran. Please contact us at for any complaints, comments and suggestions.
Contact Details :
Account co-ordinator: Binodh M.T,
VIVA USA INC.
3601 Algonquin Road, Suite 425
Rolling Meadows, IL 60008
|