What are the responsibilities and job description for the Hadoop and PySpark Lead Developer position at Infosys?
Infosys is seeking a Hadoop and PySpark Lead Developer. In this role, one will enable digital transformation for our clients in a global delivery model, research on technologies independently, recommend appropriate solutions and contribute to technology-specific best practices and standards. One will be responsible to interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle. Candidate will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued.
Required Qualifications
Along with competitive pay, as a full-time Infosys employee you are also eligible for the following benefits: -
Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.
Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.
Required Qualifications
- Candidate must be located within commuting distance of Tampa/FL, Irving/TX or be willing to relocate to the area.
- At least 4 years of experience in Information Technology.
- Experience to develop/lead Big Data solutions at enterprise scale with at least one end‑to‑end implementation
- Bachelor’s degree or foreign equivalent required from accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education
- Applicants authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.
- Expertise in software development building large scale distributed data processing systems/application, Data Engineering or large-scale internet systems.
- Strong experience in programming languages: Big Data, Spark/PySpark, SQL, Python, and Shell scripting.
- Good experience with Spark/Hadoop/HDFS architecture, YARN, Confluent Kafka, HBase, Hive, Impala, and NoSQL databases
- Experience with batch processing and AutoSys job scheduling and monitoring
- Performance analysis, troubleshooting, and resolution (including familiarity with Cloudera/Hadoop logs)
- Experience working with Cloudera on open issues leading to cluster configuration changes and implementation. Strong experience with databases such as SQL, Hive, Elasticsearch, HBase, etc.
- Knowledge of Hadoop security, data management, and governance
- Good understanding of data integration, data quality and data architecture. Experience in Relational Modeling, Dimensional Modeling and Modeling of Unstructured Data
Along with competitive pay, as a full-time Infosys employee you are also eligible for the following benefits: -
- Medical/Dental/Vision/Life Insurance
- Long-term/Short-term Disability
- Health and Dependent Care Reimbursement Accounts
- Insurance (Accident, Critical Illness, Hospital Indemnity, Legal)
- 401(k) plan and contributions dependent on salary level
Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.
Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.