What are the responsibilities and job description for the Cloud DevOps Engineer position at CapB InfoteK?
For one of our multiyear projects we are looking for a Cloud DevOps Engineer out of New York City, NYC.
Basic Qualifications (Legislative Requirement)
Basic Qualifications (Legislative Requirement)
- 5 years of experience in Spark/Hadoop
- 5 years of experience programming in Java/Scala
- 5 years of experience in Docker(Swarm/Kubernetes)
- 5 years of experience with Python/Shell Scripting
- Proficient understanding of distributed computing principles
- Proficient understanding of networking principles
- Proficient understanding of performance computing principles
- Experience with NoSQL/Graph databases, such as MongoDB, Ignite, and Druid
- Experience with Hadoop, Docker, Kubernetes, and ELK Stack a plus
- Experience with Hive
- Take ownership of component(s) of the workflows supported within our data ecosystem
- Interact with CM development teams across RBC and understand their application requirements, data access patterns, and assist them with expediting onboarding to various platforms from a engineering and development aspect.
- Design and develop systems that meet our latency, volume, storage and scale expectations to enhance KPI metrics, and monitoring capabilities for use across multiple teams
- Participate in meetings to help influence architectural, engineering, and development decisions
- Follow our Agile software development process with daily scrums and monthly Sprints
- Ability to work collaboratively on a cross-functional team with a wide range of experience levels
- Define best practices for spark usage; work with teams to influence their architecture
- Provide expertise in Spark Performance tuning
- Perform knowledge sharing, conduction education workshops, and train other employees is expected
- Keep pace with emerging technology by researching and evaluating products
- Recognized Big Data & Cloud DevOps Engineer who can helps build components, drive best practices & standards, and provide guidance/insight to partnering Architecture, Development, Engineering, and Operations Team(s) across QTS
- QTS Application Development Team(s)
- QTS Architecture and Engineering Team(s)
- QTS Engineering and Operations Team(s)
- Office Environment.
- Fast Paced.
- Some Overtime & Weekend work.
