What are the responsibilities and job description for the Foundry Data Engineer / Architect position at OKAYA INFOCOM?
Palantir Foundry Data Engineer
Oakland, CA
Full Time
Must Have Technical/Functional Skills
We are seeking a Palantir Foundry Data Engineer to design, build, and maintain data pipelines and workflows that power advanced analytics and operational insights for the utility industry. This role focuses on leveraging Palantir Foundry to integrate diverse data sources, ensure data quality, and enable real-time decision-making for grid reliability, asset management, and regulatory compliance.
Technical Expertise
• Hands-on experience with Palantir Foundry development and data integration.
• Strong proficiency in Python, SQL, and Foundry-specific frameworks.
• Knowledge of utility data systems (SCADA, AMI, GIS, OMS).
Experience
• 3 years in data engineering or related roles, preferably in utilities or energy sector.
• Familiarity with cloud platforms (AWS, Azure) and containerization (Docker, Kubernetes).
Soft Skills
• Strong problem-solving and analytical skills.
• Ability to work in cross-functional teams and communicate effectively.
Preferred Qualifications
• Experience with real-time data streaming technologies (Kafka, Spark).
• Knowledge of grid modernization, DER integration, and renewable forecasting.
• Certifications in Palantir Foundry or data engineering.
Roles & Responsibilities
Data Pipeline Development
• Build and optimize ETL workflows in Palantir Foundry for ingesting data from SCADA, AMI, GIS, OMS, and ERP systems.
• Develop scalable pipelines for real-time sensor data and IoT streams.
• Implement data transformations and enrichment to support analytics and reporting.
Integration & Automation
• Integrate structured and unstructured data sources into Foundry.
• Automate data ingestion and validation processes to ensure accuracy and timeliness.
• Collaborate with IT and OT teams to bridge operational and enterprise data systems.
Data Quality & Governance
• Monitor and maintain data integrity across all pipelines.
• Apply data governance standards and ensure compliance with NERC CIP, FERC, and state regulations.
• Implement robust security and access controls within Foundry.
Collaboration & Support
• Work closely with data scientists, analysts, and business teams to deliver reliable datasets for predictive analytics and reporting.
• Provide technical support and documentation for Foundry workflows.
Performance Optimization
• Optimize workflows for high-volume, high-velocity data.
• Troubleshoot and resolve pipeline failures and performance bottlenecks.
Palantir Foundry Data Architect
Oakland, CA
Full Time
Must Have Technical/Functional Skills
We are seeking a highly skilled Palantir Foundry Architect to design, implement, and optimize data solutions using Palantir Foundry. The ideal candidate will have deep expertise in data architecture, integration, and governance, along with strong problem-solving skills to enable scalable and secure data ecosystems.
• Technical Expertise
o Proven experience with Palantir Foundry architecture and development.
o Strong understanding of data modeling, ETL processes, and distributed systems.
o Proficiency in Python, SQL, and Foundry-specific frameworks.
• Experience
o 5 years in data architecture or related roles.
o Hands-on experience with cloud platforms (AWS, Azure, GCP) and containerization (Docker, Kubernetes).
• Soft Skills
o Excellent problem-solving and analytical skills.
o Strong communication and stakeholder management abilities.
• Preferred Qualifications
o Experience with data governance frameworks and security best practices.
o Familiarity with machine learning workflows and data science integration in Foundry.
o Certifications in Palantir Foundry or related technologies.
Roles & Responsibilities
• Data Architecture & Solution Design
o Architect scalable data platforms in Palantir Foundry to support grid operations, outage management, asset health monitoring, and energy forecasting.
o Design workflows and pipelines for real-time and batch data ingestion from SCADA, AMI, GIS, and ERP systems.
o Ensure compliance with NERC, FERC, and state regulatory standards.
• Integration & Development
o Integrate diverse data sources (structured, semi-structured, unstructured) into Foundry.
o Develop custom applications and workflows using Foundry’s APIs and frameworks.
o Collaborate with engineering teams to implement best practices for data ingestion and transformation.
• Governance & Compliance
o Establish data governance standards, access controls, and compliance frameworks.
o Ensure adherence to regulatory requirements (GDPR, CCPA, etc.) and internal policies.
• Stakeholder Collaboration
o Work closely with business analysts, data scientists, and operations teams to translate requirements into technical solutions.
o Provide technical guidance and mentorship to junior team members.
• Performance Optimization
o Monitor and optimize data pipelines for efficiency and reliability.
o Troubleshoot and resolve issues related to data quality, latency, and system performance.
o Optimize data pipelines for high-volume sensor data and IoT streams.
Thanks & Regards,
Anmol Rathor
Senior Talent Acquisition Specialist
USA Okaya Inc.
418 Broadway #7195, Albany, NY 12207
Landline: 1-631-267-4883 Ext: 181
Direct Cell: 631 705 9048
Email: Anmol.r@okayainc.com
LinkedIn: linkedin.com/in/anmol-rathor-21785b1b2