What are the responsibilities and job description for the Data Engineer III – Streaming & Kafka- Remote position at ConsultNet Technology Services and Solutions?
Data Engineer III – Streaming & Kafka
Remote (working CST)
9- month contract
Pay Rate: $70.00 - $77.00per hr.
This is a highly specialized, high-priority 9-month contract role supporting critical enterprise data initiatives within a large banking organization. The role focuses on real-time data ingestion, event streaming, and modernization of enterprise data pipelines into Snowflake. This position is mission-critical and supports some of the bank's most visible and regulated data programs.
Key Business Initiatives Supported
- Open banking regulatory data ingestion (Kafka-based streaming required)
- Enterprise R2 deposit data initiative (top bank priority)
- Snowflake migration and data lake modernization efforts
- Design, build, and support real-time and batch ingestion pipelines into Snowflake
- Work extensively with Kafka-based event streaming systems
- Support enterprise ingestion from multiple source types:
- Event streams (Kafka)
- RDBMS systems (Oracle, SQL Server)
- Flat files and mainframe extracts
- Build and maintain ingestion pipelines using Python and SQL
- Support complex data transformation and movement across systems
- Work with tools such as Precisely and Click for orchestration
- Load data into Snowflake landing zones and downstream structures
- Ensure reliability and scalability of streaming ingestion pipelines
Required Skills:
- 5 years of relevant experience
- Strong, hands-on Apache Kafka experience (mandatory)
- Advanced SQL (complex joins, optimization, tuning)
- Python development experience
- Snowflake experience
- Experience with big data ecosystems (Cloudera or similar)
- Strong understanding of event-driven architecture and streaming ingestion
Bonus Skills:
- Experience with ingestion tools (Precisely, Click)
- AWS S3 exposure
- Experience with enterprise-scale data pipelines
- Familiarity with GitHub-based development workflows
- Understanding of SharePoint and Jira data ingestion (nice to have)
- Experience working in highly regulated or banking environments
Salary : $70 - $77