What are the responsibilities and job description for the Data Engineer position at Custom Goods Logistics?
Summary/Objective:
The Data Engineer will design, build, and maintain scalable data infrastructure and integrations to support enterprise analytics and operational systems. This role focuses on enabling seamless data flow between Warehouse Management Systems (WMS), NetSuite ERP, and other business applications, ensuring high data quality, security, and availability for reporting and decision-making.
Essential Functions:
Build and Maintain Data Infrastructure: Design, construct, and troubleshoot data pipelines, databases, data warehouses, and data lakes to ensure data is accessible and reliable.
Demonstrate to comply with Custom Goods’ Core Behaviors:
This commitment extends to all aspects of Custom Goods’ employment practices including, but not limited to, recruiting, hiring, promoting, transferring, compensation, benefits, training, leaves of absence, termination, and other terms and conditions of employment.
The Data Engineer will design, build, and maintain scalable data infrastructure and integrations to support enterprise analytics and operational systems. This role focuses on enabling seamless data flow between Warehouse Management Systems (WMS), NetSuite ERP, and other business applications, ensuring high data quality, security, and availability for reporting and decision-making.
Essential Functions:
Build and Maintain Data Infrastructure: Design, construct, and troubleshoot data pipelines, databases, data warehouses, and data lakes to ensure data is accessible and reliable.
- Ensure Data Quality and Integrity: Develop ETL processes and implement data cleaning and validation to ensure accuracy and consistency across systems.
- Collaborate with Other Teams: Work with application analysts and business stakeholders to understand their needs and deliver the data solutions required for projects and reports.
- Manage data integration platforms used to ingest customer data into our operational systems
- Implement Security and Compliance: Apply security controls, manage access policies, and ensure compliance with data governance and privacy regulations.
- Monitor database performance and troubleshoot issues
- Develop and manage database maintenance and archiving tools to optimize performance
- Integration & Connectivity: Develop and maintain integrations between WMS/TMS platforms and NetSuite ERP using APIs, SuiteQL, and connectors.
Demonstrate to comply with Custom Goods’ Core Behaviors:
- Servant Leadership
- Passion for Excellence
- Integrity
- Resilient
- Intense Safety Focus
- Trust
- Bachelor’s degree in computer science, Information Systems, Data Analytics, or a related field.
- 7 years of experience in datalake/data warehousing with specific expertise in Microsoft technologies
- Programming and Scripting: Proficiency in Python and experience with SQL for querying databases.
- Experience building SQL procedures to load data into our operational databases
- Knowledge of database architectures, data models, and cloud-based platforms like Fabric, Azure Synapse, etc.
- Proficient in using ETL tools and processes for extracting, transforming, and loading data from various sources.
- ERP & WMS Expertise: Hands-on experience with Warehouse Management Systems and NetSuite ERP integration.
- Experience building dashboards and analytical views using Power BI
This commitment extends to all aspects of Custom Goods’ employment practices including, but not limited to, recruiting, hiring, promoting, transferring, compensation, benefits, training, leaves of absence, termination, and other terms and conditions of employment.