Job Description:8 years of experience in software development and delivery. 5 of relevant work experience on large scale Data applications.Experience working(or willing to work) with distributed teams in different time zones and offshore teams.Experience building streaming data pipelines using event based models.Strong SQL skillsExperience with programming in languages Python, and scripting tools like Bash, KSH.Good aptitude, strong problem-solving abilities, and analytical skills, ability to take ownership as appropriate.Should be able to do coding, debugging, performance tuning, and deploying apps to a Production environment. Should have good working experience in the bellow technologies and languagesHadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)KafkaSpark StreamingPySparkAirflowGood understanding of Design Patterns in software architecture.Experience working in Agile Methodology.Ability to learn and help the team learn new technologies quickly.Take up the complete planning/design/implementation/UAT/delivery of the project.Excellent communication and coordination skills.Knowledgeable (and preferred hands-on).UNIX environments, different continuous integration tools.Must be able to integrate quickly into the team and work independently towards team goals.Responsibilities:Take the complete responsibility of the project execution.Be accountable for the delivery of the project in the defined timelines with good quality. Define and follow the processes for project execution and delivery.Drive and motivate the team to be agile and follow agile methodology.Guide the team technically and give the team a direction on how to plan, design, implement, and deliver the projects. Define the architecture and discuss the pros-cons of the same with the team.Involve the team during the brainstorming sessions as appropriate.Work with other team leads to get the architecture reviewed.Keep all the stakeholders updated about the project status/risks/issues if there are any. Work closely with the management wherever and whenever required, to ensure smooth execution and delivery of the project.