What are the responsibilities and job description for the Foundry Data Engineer position at Nastech Global?
Position: Foundry Data EngineerLocation: Oakland, CA(Onsite)Duration: Fulltime Job DescriptionMust Have Technical/Functional SkillsWe are seeking a Palantir Foundry Data Engineer to design, build, and maintain data pipelines and workflows that power advanced analytics and operational insights for the utility industry. This role focuses on leveraging Palantir Foundry to integrate diverse data sources, ensure data quality, and enable real-time decision-making for grid reliability, asset management, and regulatory compliance. Technical Expertise• Hands-on experience with Palantir Foundry development and data integration.• Strong proficiency in Python, SQL, and Foundry-specific frameworks.• Knowledge of utility data systems (SCADA, AMI, GIS, OMS).Experience• 3 years in data engineering or related roles, preferably in utilities or energy sector.• Familiarity with cloud platforms (AWS, Azure) and containerization (Docker, Kubernetes).Soft Skills• Strong problem-solving and analytical skills.• Ability to work in cross-functional teams and communicate effectively. Preferred Qualifications• Experience with real-time data streaming technologies (Kafka, Spark).• Knowledge of grid modernization, DER integration, and renewable forecasting.• Certifications in Palantir Foundry or data engineering. Roles & ResponsibilitiesData Pipeline Development• Build and optimize ETL workflows in Palantir Foundry for ingesting data from SCADA, AMI, GIS, OMS, and ERP systems.• Develop scalable pipelines for real-time sensor data and IoT streams.• Implement data transformations and enrichment to support analytics and reporting.Integration & Automation• Integrate structured and unstructured data sources into Foundry.• Automate data ingestion and validation processes to ensure accuracy and timeliness.• Collaborate with IT and OT teams to bridge operational and enterprise data systems.Data Quality & Governance• Monitor and maintain data integrity across all pipelines.• Apply data governance standards and ensure compliance with NERC CIP, FERC, and state regulations.• Implement robust security and access controls within Foundry.Collaboration & Support• Work closely with data scientists, analysts, and business teams to deliver reliable datasets for predictive analytics and reporting.• Provide technical support and documentation for Foundry workflows.Performance Optimization• Optimize workflows for high-volume, high-velocity data.• Troubleshoot and resolve pipeline failures and performance bottlenecks.