What are the responsibilities and job description for the Principal Data Engineer position at CloudHive?
Job Title: Principal Data Engineer
Location: Chicago (Hybrid)
Contract Length: 8-months
One of CloudHive's largest customers operating within the FinTech space requires a Principal Data Engineer with a strong track record of delivering production systems at scale in high-throughput transactional environments.
Requirements:
- Medallion lakehouse architecture (Bronze/Silver/Gold): end-to-end standup and migration ownership in production
- Apache Iceberg: partition evolution, schema evolution, compaction, time travel, and catalog integration
- Aurora MySQL: schema management, CDC via Debezium, binlog replication, and OLTP performance tuning
- DynamoDB: table design, GSIs, TTL lifecycle, and multi-region operational constraints
- Snowflake: anti-pattern identification, cost driver analysis, compute right-sizing, and workload migration to lakehouse
- Kafka / Confluent: topic design, consumer group management, Debezium CDC connectors
- AWS: S3, LakeFormation, Glue, Lambda, IAM; security controls in PCI/PII environments
- dbt: Silver layer transformation orchestration, incremental models, and data quality tests
- Airflow: major version upgrades or migration to AWS MWAA
- PCI-DSS: payments or FinTech compliance experience in a regulated data environment