What are the responsibilities and job description for the Sr Data Engineer position at IDR, Inc.?
IDR is seeking a Sr Data Engineer to join one of our top clients for an opportunity in Indianapolis, Indiana. In this role, you’ll build and optimize cloud-based data pipelines and curated datasets that power enterprise reporting and analytics. You’ll partner closely with data, BI, and platform teams in a large, fast-moving technology consulting environment.
Position Overview for the Sr Data Engineer:
- Design, build, and support scalable data pipelines in an AWS-based data lake environment
- Implement ingestion and transformation patterns aligned to Bronze/Silver/Gold (medallion) architecture
- Integrate data from SaaS platforms, enterprise systems, and REST APIs for analytics and reporting use cases
- Collaborate with BI/reporting stakeholders to deliver reliable, well-modeled data products
- Contribute to operational excellence through monitoring, documentation, and continuous pipeline optimization
Requirements for the Sr Data Engineer:
- 8 years of hands-on data engineering experience supporting enterprise-scale data pipelines
- Strong Python and SQL skills (PySpark strongly preferred) for data processing and transformation
- AWS data engineering experience (e.g., S3, Glue, Lambda; CDC/replication tools a plus)
- Experience implementing medallion architecture concepts (Bronze/Silver/Gold) and data lake best practices
- Experience with modern data platforms such as Databricks and/or Microsoft Fabric, supporting analytics consumers
What's in it for you?
- Competitive compensation package
- Full Benefits; Medical, Vision, Dental, and more!
- Opportunity to get in with an industry leading organization.
Why IDR?
- 25 Years of Proven Industry Experience in 4 major markets
- Employee Stock Ownership Program
- Dedicated Engagement Manager who is committed to you and your success.
- Medical, Dental, Vision, and Life Insurance
- ClearlyRated's Best of Staffing® Client and Talent Award winner 12 years in a row.
If you want tweaks (more/less technical, different emphasis on AWS vs. Fabric/Databricks), tell me what you want highlighted. Please leave a thumbs up/down on this output so I can match your preferred style next time.