What are the responsibilities and job description for the Senior Pyspark Cloudera Developer position at LTIMindtree?
Role description
Role Pyspark Cloudera Developer Senior
Location Bloomington IL USA Remote
Technical Skills Primary
Minimum 5 years of experience in ETL Data Engineering using Pyspark design development
Lead the design and development of enterprisescale data processing pipelines using PySpark and Big Data technologies ensuring high performance and scalability
Define and enforce data engineering standards best practices and governance frameworks across projects
Strong experience and understanding on Data warehousing concepts
Understanding of best practices on Data ingestion Quality and transformation
Experience with Cloudera engine
Experience to enable DevSecOps practices CICD secrets security automation
Ability to developdesign reusable components templates artifacts identify innovation automation and AI opportunities
Technical Skills Secondary Nice to have NOT MANDATORY
Working knowledge on GitLab for code management
Provide technical leadership and mentorship to junior and intermediate developers driving innovation and quality in Big Data solutions
Experience with SQL HQL and Big Data tools
Soft Skills
Strong ability to work with client stakeholders
Ability to have the requirement discussion with the customer stakeholders
Excellent communication analytical and problemsolving skills
leadership and organizational abilities to effectively interact with stakeholders colleagues and other members of the team
Demonstrated ability to be organized and selfdirected
Strong interpersonal skills with the ability to work cross functionally
Experience in Mentoring junior developers with technical support
Responsibilities
Lead requirement gathering and solution design discussions with business stakeholders ensuring alignment with strategic objectives
Lead the development and deployment of PySparkbased data pipelines
Drive project planning estimation and resource allocation managing timelines and deliverables for complex data initiatives
Establish and enforce governance documentation standards and compliance practices for Big Data projects
Act as a primary liaison between business and technical teams ensuring clear communication and prioritization of tasks
Mentor and coach junior and intermediate developers fostering knowledge sharing and continuous improvement within the team
Oversee complex data integration migration and optimization initiatives across cloud and onpremises environments
Participate in Agile ceremonies and ensure timely delivery of tasks
Key Questions
1 Does the candidate have 5 yrs experience working on pyspark development on any Big data platform
2 Does the candidate have any experience with Cloudera platform
3 Does the candidate have experience on DevSec practices on Cloudera
Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree (“LTIM”):
Benefits and Perks:
- Comprehensive Medical Plan Covering Medical, Dental, Vision
- Short Term and Long-Term Disability Coverage
- 401(k) Plan with Company match
- Life Insurance
- Vacation Time, Sick Leave, Paid Holidays
- Paid Paternity and Maternity Leave
The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.
Disclaimer: The compensation and benefits information provided herein is accurate as of the date of
this posting.
LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our
employment decisions are made without regard to race, color, creed, religion, sex (including
pregnancy, childbirth or related medical conditions), gender identity or expression, national origin,
ancestry, age, family-care status, veteran status, marital status, civil union status, domestic
partnership status, military service, handicap or disability or history of handicap or disability, genetic
information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation
or preference, or any other characteristic protected by applicable federal, state, or local law, except
where such considerations are bona fide occupational qualifications permitted by law.
Salary : $100,000 - $130,000