Hadoop and PySpark Lead Developer

Hadoop and PySpark Lead Developer Job details Job Role Technology Lead - US Work Location Hartford, CT State / Region / Province Connecticut Country USA Skills Technology|Oracle Apps Technical|Oracle Apps PL/SQL Domain Delivery Interest Group Infosys Limited Company ITL USA Requisition ID 146054BR careerpage.description_page_field_label_field_job_code 835ATHLDUS Technology Lead Infosys is seeking a Hadoop and PySpark Lead Developer. In this role, one will enable digital transformation for our clients in a global delivery model, research on technologies independently, recommend appropriate solutions and contribute to technology-specific best practices and standards. One will be responsible to interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle. Candidate will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued. Required Qualifications: Candidate must be located within commuting distance of Hartford, CT or be willing to relocate to the area. At least 4 years of experience in Information Technology. Experience to develop/lead Big Data solutions at enterprise scale with at least one end‑to‑end implementation Bachelor’s degree or foreign equivalent required from accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education Applicants authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time. Preferred Qualifications: Expertise in software development building large scale distributed data processing systems/application, Data Engineering or large-scale internet systems. Strong experience in programming languages: Big Data, Spark/PySpark, SQL, Python, and Shell scripting. Good experience with Spark/Hadoop/HDFS architecture, YARN, Confluent Kafka, HBase, Hive, Impala, and NoSQL databases Experience with batch processing and AutoSys job scheduling and monitoring Performance analysis, troubleshooting, and resolution (including familiarity with Cloudera/Hadoop logs) Experience working with Cloudera on open issues leading to cluster configuration changes and implementation. Strong experience with databases such as SQL, Hive, Elasticsearch, HBase, etc. Knowledge of Hadoop security, data management, and governance Good understanding of data integration, data quality and data architecture. Experience in Relational Modeling, Dimensional Modeling and Modeling of Unstructured Data The job entails sitting as well as working at a computer for extended periods of time. Should be able to communicate by telephone, email or face to face. Travel may be required as per the job requirements. Along with competitive pay, as a full-time Infosys employee you are also eligible for the following benefits: - Medical/Dental/Vision/Life Insurance Long-term/Short-term Disability Health and Dependent Care Reimbursement Accounts Insurance (Accident, Critical Illness, Hospital Indemnity, Legal) 401(k) plan and contributions dependent on salary level About Us Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem. Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.