What are the responsibilities and job description for the Data Engineer position at Randstad Digital?
The primary role of the Data Engineer is to function as a critical member of a data team by designing data integration solutions that deliver business value in line with the company's objectives. They are responsible for the design and development of data/batch processing, data manipulation, data mining, and data extraction/transformation/loading into large data domains using Python/Pyspark and AWS tools.
location: Charlotte, North Carolina
job type: Contract
salary: $60 - 66 per hour
work hours: 9am to 6pm
education: Bachelors
responsibilities:
- Minimum 8 years of hands-on data engineering experience in development using Python and Pyspark
- Experience in AWS cloud services like Glue, Lambda, MSK (Kafka), S3, Step functions, RDS, EKS
- Experience in Databases like Postgres, SQL Server, Oracle, Sybase
- Experience with SQL, performance tuning, queries, stored procedures, views, functions, and triggers
- Ability to learn and use AI tools effectively
- Understanding of Data pipelines, ETL processes, CI/CD DevOps process and tools like GitHub, Jenkins
- Knowledge of Data modeling, Warehousing concepts and Agile/SCRUM methodology
- Strong problem-solving and analytical skills
qualifications:
-Developer experience specifically focusing on Data Engineering.
-Hands-on experience in Development using Python and Pyspark as an ETL tool.
-Experience in AWS services like Glue, Lambda, MSK (Kafka), S3, Step functions, RDS, EKS etc.
-Experience in Databases like Postgres, SQL Server, Oracle, Sybase etc.
-Experience with SQL database programming, SQL performance tuning, relational model analysis, queries, stored procedures, views, functions, and triggers.
-Strong technical experience in Design (Mapping specifications, HLD, LLD), Development (Coding, Unit testing).
-Knowledge in developing UNIX scripts, Oracle SQL/PL-SQL.
-Experience with data models, data mining, data analysis and data profiling.
-Experience in working with REST API's.
-Experience in workload automation tools like Control-M, Autosys etc.
-Good knowledge in CI/CD DevOps process and tools like Bitbucket, GitHub, Jenkins.
-Strong experience with Agile/SCRUM methodology.
-Experience with other ETL tools (DataStage, Informatica, Pentaho, etc.).
-Knowledge in MDM, Data warehouse and Data Analytics.
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact
Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).
This posting is open for thirty (30) days.
Salary : $60