What are the responsibilities and job description for the Senior Staff Data Engineer position at CME Group?
We are seeking a hands-on Technology Specialist to lead our database modernization efforts as we migrate from legacy on-premise databases to strategic cloud platforms. This role requires deep expertise in Google Cloud Platform - specifically Cloud SQL, AlloyDB, and Bigtable - alongside advanced proficiency in Python for building scalable data pipelines and automation. You will be responsible for tackling systemic performance challenges, managing our database fleet programmatically, and serving as the go-to expert for our development and reliability teams. Your technical leadership will directly ensure our new cloud infrastructure is performant, stable, and built for scale.
Core Responsibilities
CME Group: Where Futures are Made
CME Group is the world’s leading derivatives marketplace. But who we are goes deeper than that. Here, you can impact markets worldwide. Transform industries. And build a career by shaping tomorrow. We invest in your success and you own it – all while working alongside a team of leading experts who inspire you in ways big and small. Problem solvers, difference makers, trailblazers. Those are our people. And we’re looking for more.
At CME Group, we embrace our employees' unique experiences and skills to ensure that everyone’s perspectives are acknowledged and valued. As an equal-opportunity employer, we consider all potential employees without regard to any protected characteristic.
Important Notice: Recruitment fraud is on the rise, with scammers using misleading promises of job offers and interviews to solicit money and personal information from job seekers. CME Group adheres to established procedures designed to maintain trust, confidence and security throughout our recruitment process. Learn more here.
Core Responsibilities
- Cloud Architecture: Design robust, scalable, and cost-effective data architectures on Google Cloud Platform (GCP), focusing on Cloud SQL, AlloyDB, and Bigtable.
- Database Performance & Optimization: Lead performance tuning and optimization efforts for PostgreSQL, diagnosing and resolving complex issues stemming from our legacy Oracle Exadata environment.
- Data Pipeline Development: Build and maintain resilient, cloud-native data pipelines (ETL/ELT) using Python and GCP services such as Dataflow, BigQuery, and Pub/Sub.
- Automation & Infrastructure as Code (IaC): Develop and implement automation in Python for performance monitoring, remediation, and infrastructure management using IaC tools like Terraform.
- Migration & Modernization: Guide the technical execution of migrating large, complex databases from Oracle to PostgreSQL on GCP, ensuring data integrity and performance.
- Mentorship & Guidance: Serve as a subject matter expert and mentor for development and data reliability teams on PostgreSQL and GCP best practices, helping to elevate the team's technical capabilities.
- Experience: 7-10 years of professional experience in a data engineering or database specialist role, with a proven track record of building and maintaining production-grade cloud data systems.
- Google Cloud Platform (GCP) Expertise: Deep, hands-on expertise with GCP, including architecting solutions with BigQuery, Dataflow, Cloud Storage, Pub/Sub, Cloud SQL, and AlloyDB.
- Python Proficiency: 6 years of advanced Python development experience for data processing, automation, and building ETL/ELT pipelines.
- Database Expertise:
- Expert-level knowledge of PostgreSQL internals (query planner, indexing, vacuuming, locking mechanisms) and performance tuning.
- Proven experience migrating large, complex databases from Oracle (ideally Exadata) to PostgreSQL.
- Strong professional experience with other enterprise databases like MS SQL Server.
- DevOps & IaC: Demonstrable experience building CI/CD pipelines (e.g., GitLab CI, Jenkins) and managing infrastructure as code (IaC) with Terraform.
- Experience with data orchestration tools such as Apache Airflow or Cloud Composer.
- Experience with other GCP data services like Bigtable and Memory Store (Redis).
- Experience with enterprise database monitoring and administration tools (e.g., IDERA, SCOM, Oracle OEM).
- Understanding of data privacy and compliance standards (e.g., HIPAA, GDPR).
CME Group: Where Futures are Made
CME Group is the world’s leading derivatives marketplace. But who we are goes deeper than that. Here, you can impact markets worldwide. Transform industries. And build a career by shaping tomorrow. We invest in your success and you own it – all while working alongside a team of leading experts who inspire you in ways big and small. Problem solvers, difference makers, trailblazers. Those are our people. And we’re looking for more.
At CME Group, we embrace our employees' unique experiences and skills to ensure that everyone’s perspectives are acknowledged and valued. As an equal-opportunity employer, we consider all potential employees without regard to any protected characteristic.
Important Notice: Recruitment fraud is on the rise, with scammers using misleading promises of job offers and interviews to solicit money and personal information from job seekers. CME Group adheres to established procedures designed to maintain trust, confidence and security throughout our recruitment process. Learn more here.
Salary : $135,000 - $225,000