What are the responsibilities and job description for the Data Engineer position at PGC Digital (America) Inc: CMMI Level 3 Company?
Must Skills: proficient in SQL, Python, Spark within Palantir Foundry environment
Job Summary
Seeking a skilled Data Engineer proficient in SQL Python Spark to design and optimize scalable data solutions within Palantir Foundry environment
Job Description
Must have strong knowledge of SQL Python Spark and Hadoop
Experience with Python Spark and TypeScript for data processing and application development
Optimize performance of data transformations and analytical queries
Collaborate with crossfunctional teams to understand business requirements and translate them into effective data solutions with offshore team
Familiarity with designing and implementing scalable data pipelines and workflows using Palantir Foundry
Working knowledge of Palantir modules such as Contour Quiver Vertex and app development
Develop and maintain data models ontology layers and operational dashboards
Ensure data quality integrity and governance across all Palantirbased solutions
Stay updated with Palantir platform updates and best practices
Desired skills include Workshop level 4 Quiver level 4 AIP level 3 Pipeline Builder level 3 Code Repository level 3 PySpark level 3 and Ontology level 3
Roles and Responsibilities
Design develop and optimize scalable data pipelines and workflows
Collaborate with stakeholders to gather and analyze business requirements
Translate business needs into technical data solutions leveraging Palantir Foundry
Maintain and enhance data models ontology layers and dashboards to support analytics
Monitor and improve data quality integrity and governance standards
Utilize modules like Contour Quiver and Vertex for application development
Participate in code repository management and pipeline building activities
Continuously update skills and knowledge on Palantir platform features and best practices