What are the responsibilities and job description for the Data Engineer(ETL) W2 Citizens Only position at Learn Beyond Consulting LLC?
The Expertise You Have
Bachelor’s degree in computer science, Information Systems, or a related field
Proven track record in data engineering
10 years’ experience developing Spark Services for Data movement.
Schedule, Monitor and debug ETL Spark Batch.
Hands on Experience with Java clients for consuming REST and SOAP APIs and Scala spark batch application.
Develop, Test, Deploy and maintain ETL Batch Jobs using Apache Spark/EMR Jobs.
Utilizing Apache Spark cluster-computing framework to process big data and write to No-SQL Database ex Cassandra or Yugabyte.
Experience with cloud-based data warehousing and data lake solutions such as Snowflake
Experience with data storage and data management for large datasets like parquet, HDF5, etc.
Proven experience in building and deploying software solutions utilizing public cloud provider services like AWS.
The Skills You Bring
Champions innovative technology solutions to resolve sophisticated business problems
Works across groups to find opportunities for organization-wide technology initiatives
Brings external information, ideas, and expertise back to the team
Good understanding of the software development process including analysis, design, coding, system and user testing, problem resolution and planning
Identify creative ways to drive desired outcomes and promote culture of innovation by setting examples.
Collaborate with peers through code reviews, pair programming or interactive discussions daily.
Ability to work across multiple squads and adaptable to change.
Embrace customer-first mentality and enjoy developing user-friendly internet facing web applications that tackle real life problems.
Have a passion for following outstanding software engineering practices and always looking to improve your engineering skills and industry knowledge.
Bring a data-driven & collaborative approach to decision making, both in day-to-day work and in making strategic trade-offs.
Skills
ETL, Scala, Spark, AWS, Cassandra, Snowflake, Control M
Top Skills Details
ETL,Scala,Spark,AWS,Cassandra,Snowflake,Control M
Salary : $70