What are the responsibilities and job description for the Data Engineer - Data Science & Technology position at Castleton Commodities International?
At Castleton Commodities International (CCI), we are redefining how data and technology shape the future of energy trading. Our Data Science & Technology team is at the forefront of this transformation, developing systems and innovative tools that empower our front-office teams to better understand market dynamics, forecast prices, and manage risk.
Our commitment to excellence is reflected in a robust, modern, open-source technology stack, empowering us to solve complex, high-impact challenges at scale. From cloud-native infrastructure to machine learning platforms, real-time analytics, and proprietary libraries and APIs, we are passionate about using technology to drive innovation and create a competitive edge in global energy commodity trading and investing. Candidates will gain direct exposure to our commercial investment teams, offering a unique opportunity to see how cutting-edge technology drives strategy and performance in energy markets.
Our Data Engineering team is integral to our mission, ensuring the seamless ingestion and management of data across our platforms. The Data Engineer will play an integral role as the team implements new data management platforms, creates new data ingestion pipelines, and sources new data sets. The role will assist with all aspects of data – from data architecture design to on-going data management and will have significant exposure to our Commercial investing teams globally. This position will play an integral role as the firm continues to expand its use of data for advanced analytics and other commercial purposes.
Responsibilities
CCI offers competitive benefits and programs to support our employees, their families and local communities. These include:
Our commitment to excellence is reflected in a robust, modern, open-source technology stack, empowering us to solve complex, high-impact challenges at scale. From cloud-native infrastructure to machine learning platforms, real-time analytics, and proprietary libraries and APIs, we are passionate about using technology to drive innovation and create a competitive edge in global energy commodity trading and investing. Candidates will gain direct exposure to our commercial investment teams, offering a unique opportunity to see how cutting-edge technology drives strategy and performance in energy markets.
Our Data Engineering team is integral to our mission, ensuring the seamless ingestion and management of data across our platforms. The Data Engineer will play an integral role as the team implements new data management platforms, creates new data ingestion pipelines, and sources new data sets. The role will assist with all aspects of data – from data architecture design to on-going data management and will have significant exposure to our Commercial investing teams globally. This position will play an integral role as the firm continues to expand its use of data for advanced analytics and other commercial purposes.
Responsibilities
- Execute data architecture and data management projects for both new and existing data sources.
- Help transition existing data sets, databases, and code to a new technology stack.
- Manage end to end data ingestion process and publishing to investing teams.
- Own the process of mapping, standardizing, and normalizing data.
- Ad hoc research on project topics such as vendor trends, usage best practices, big data trends, artificial intelligence, vendors, etc.
- Help transition existing data sets, databases, and code to a new technology stack.
- Assess data loads for tactical errors and build out appropriate workflows, as well as create data quality analysis that identifies larger issues in data.
- Actively manage vendors and capture changes in data input proactively.
- Properly prioritize and resolve data issues based on business usage.
- Assist with managing strategic initiatives around big data projects for the commercial (trading) business.
- Partner with commercial teams to gain understanding of current data flow, data architecture, investment process as well as gather functional requirements.
- Assess gaps in current datasets and remediate.
- Bachelor’s degree in Computer Science, Mathematics, Physics, Business Intelligence, or related field of study.
- 3 years of Data Engineering experience specializing in SQL programming, data architecture, and dimension modeling.
- Experience in energy commodities or financial services is nice to have but not required.
- Experience in mapping, standardizing, and normalizing data.
- Experience with ETL/ELT frameworks to write pipelines to load millions/billions of records.
- Advanced skills in writing highly optimized SQL code.
- Experience with relational databases; Snowflake highly preferred.
- Hands-on experience developing data solutions in Python, Pandas, Numpy, etc.
- Ability to communicate and interact with a wide range of data users – from very technical to non-technical.
- Team player who is execution focused, with the ability to handle a rapidly changing set of projects. and priorities, while maintaining strong professional presence.
- Ability to work effectively in a fast-paced, dynamic and high-intensity environment including an open-floor plan, with timely responsiveness and the ability to work beyond normal business hours when required.
CCI offers competitive benefits and programs to support our employees, their families and local communities. These include:
- Competitive comprehensive medical, dental, retirement and life insurance benefits
- Employee assistance & wellness programs
- Parental and family leave policies
- CCI in the Community: Each office has a Charity Committee and as a part of this program employees are allocated 2 days annually to volunteer at the selected charities.
- Charitable contribution match program
- Tuition assistance & reimbursement
- Quarterly Innovation & Collaboration Awards
- Employee discount program, including access to fitness facilities
- Competitive paid time off
- Continued learning opportunities