Software Development

• Advanced level ability in software development
• Function as member of an agile team by contributing to software builds through consistent development practices (tools, common components, and documentation)
• Participate in code reviews and automated testing.
• Debug basic software components and identify code defects for remediation.
• Enable the deployment, support, and monitoring of software across test, integration, and production environments.
• Automate deployments in test or production environments.
• Automatically scale applications based on demand projections.

Leadership

• Opportunity to lead a small team of developers and empower them to achieve their potential.
• Influence team members with creative changes and improvements by challenging status quo and demonstrating risk taking.

Objectives of this Role

• Develop and implement data pipelines that extracts, transforms, and loads data into an information product that helps to inform the organization in reaching strategic goals.
• Work on ingesting, storing, processing, and analyzing large data sets.
• Create scalable and high-performance web services for tracking data.
• Translate complex technical and functional requirements into detailed designs.
• Investigate and analyze alternative solutions to data storing, processing etc. to ensure most streamlined approaches are implemented.
• Develops and tests software, including ongoing refactoring of code & drives continuous improvement in code structure & quality.
• Primary focus is spent writing code, API specs, conducting code reviews & testing in ongoing sprints or doing proof of concepts/automation tools.
• Functions as a core member of an Agile team driving User story analysis & elaboration, design and development of software applications, testing & builds automation tools.
• Works on a specific platform/product or as part of a dynamic resource pool assigned to projects based on demand and business priority.
• Finds opportunities to adopt innovative technologies.

Minimum Qualifications:

• Over all 6-8 years of experience in Hadoop & Big Data along with 2-3 year of experience in AWS Cloud.
• Demonstrated experience with Agile or other rapid application development methods.
• Minimum 4 years of experience with Big Data Components/Frameworks (Hadoop, HBase, MapReduce, HDFS, Pig, Hive, Sqoop, Flink, oozie, Flink, Spark, etc.) and java programming languages.
• Experience in AWS Redshift, Lake house, Database Migration Service, Glue, EMR, Elastic Compute Cloud (EC2), S3, Relational
• Expert on Distributed ecosystem
• Hands-on experience with programming using Core Java or Python/Scala
• Expert on Hadoop and Spark Architecture and its working principle
• Hands on working experience on Hive, Shell scripting.
• Understanding of data warehousing and data modeling techniques
• Strong data engineering skills on the AWS Cloud Platform is essential.
• Hands-on expertise with application design, software development, and automated testing
• Must have 3 years of demonstrated experience leading teams of engineers.
• Experience with RESTful web services, open API development, and SOA concepts
• Experience with parallel and distributed (multi-tiered) systems, algorithms, message queuing, and relational databases.
• Knowledge of Travel data is a plus.
• Ability to design and develop optimized Data pipelines for batch and real time data processing using Spark/Flink.
• Should have experience in analysis, design, development, testing, and implementation of system applications.
• Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows.
• Excellent technical and analytical proficiency
• Good communication skills
• Excellent Project management skills.
• Results driven.