What are the responsibilities and job description for the Databricks + Pyspark/SparkSQL/Python position at capgemini?
We are seeking a highly skilled Onshore Data Engineer with strong expertise in the Azure data ecosystem to design build and maintain scalable data solutions The ideal candidate will have extensive hands-on experience with Azure Databricks PySpark, Spark SQL and Python along with deep knowledge of Azure data integration and DevOps practices This role will work closely with business and technology stakeholders to deliver reliable high performance data pipelines
Key Responsibilities:
Design develop and optimize data pipelines using Azure Databricks PySpark, SparkSQL and Python
Build and maintain data ingestion and orchestration workflows using Azure Data Factory ADF
Develop and integrate APIs to support data exchange across systems and platforms
Implement CICD pipelines using Azure DevOps and GitHub for version control deployment and automation
Collaborate with analytics BI and application teams to support downstream data consumption
Ensure data quality performance security and scalability across platforms
Required Qualifications:
4-5 years of hands-on experience with Azure Databricks
7-8 years of overall experience on the Azure technology stack
Strong proficiency in PySpark, SparkSQL and Python
Hands-on experience in ADF development and DevOps practices
Experience working on recent production grade projects latest engagements preferred
Preferred Qualifications:
Experience in the Banking or Financial Services domain
Strong problem solving and communication skills
Ability to work in a client facing onshore environment
The pay range that the employer in good faith reasonably expects to pay for this position is $56.63/hour - $88.49/hour. Our benefits include medical, dental, vision and retirement benefits. Applications will be accepted on an ongoing basis.
Tundra Technical Solutions is among North America’s leading providers of Staffing and Consulting Services. Our success and our clients’ success are built on a foundation of service excellence. We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Unincorporated LA County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: client provided property, including hardware (both of which may include data) entrusted to you from theft, loss or damage; return all portable client computer hardware in your possession (including the data contained therein) upon completion of the assignment, and; maintain the confidentiality of client proprietary, confidential, or non-public information. In addition, job duties require access to secure and protected client information technology systems and related data security obligations.
Salary : $57 - $88