What are the responsibilities and job description for the Senior Data Engineer position at Byteware Inc.?
Job Title: Senior Data Engineer
Location: New York, NY (2–3 Days Onsite)
Full Time
Required Qualifications
- Bachelor’s degree in Computer Science, Information Systems, Engineering, Data Analytics, or a related field, or equivalent professional experience.
- Three to five years of experience in data engineering, software engineering, analytics engineering, or a related discipline.
- At least one to two years of hands-on experience developing solutions in Palantir Foundry.
- Strong proficiency in SQL and Python.
- Experience building ETL or ELT pipelines and working with large, complex datasets.
- Understanding of relational databases, data modeling, schema design, and data quality principles.
- Experience with source control, code review, testing, and deployment practices.
- Ability to troubleshoot technical issues across data pipelines, integrations, and application layers.
- Strong analytical, communication, and problem-solving skills.
- Ability to work effectively with both technical teams and business stakeholders.
Preferred Qualifications
- Experience developing Foundry Ontology objects, actions, functions, and applications.
- Experience with PySpark, Java, TypeScript, or JavaScript.
- Familiarity with cloud platforms such as AWS, Microsoft Azure, or Google Cloud.
- Experience integrating Foundry with enterprise systems, REST APIs, or data warehouses.
- Knowledge of data governance, metadata management, lineage, access controls, and privacy requirements.
- Experience with Agile or Scrum delivery methodologies.
- Familiarity with CI/CD pipelines and automated testing.
- Palantir Foundry certifications or formal platform training.
- Experience in a regulated industry such as healthcare, financial services, government, or insurance.
Core Competencies
- Data pipeline development
- Palantir Foundry configuration and engineering
- Data modeling and transformation
- Technical troubleshooting
- Data quality and governance
- Business requirements analysis
- Cross-functional collaboration
- Documentation and knowledge sharing
- Secure software development
- Production support and continuous improvement