What are the responsibilities and job description for the Data Engineer position at Noise Consulting Group?
Description:
Key Responsibilities
Design, develop, and maintain scalable and robust data pipelines and ETL/ELT workflows Build and optimize data architectures using Databricks and Spark Develop and maintain data models to support analytical and reporting needs Ensure data quality, integrity, and performance across systems Collaborate with data scientists, analysts, and business stakeholders to deliver data solutions Implement and enforce best practices for data engineering, including testing, monitoring, and documentation Optimize large-scale data processing using distributed computing frameworks Support cloud-based data platforms and contribute to platform modernization initiatives Troubleshoot and resolve complex data issues in production environments
Required Qualifications:
- 7 years of experience in Data Engineering or a related field
- Strong expertise in: SQL, Python, Apache Spark, Databricks
- Experience building and optimizing large-scale data processing systems Strong understanding of data warehousing concepts and data modeling Experience working with structured and unstructured data Excellent problem-solving and communication skills
Preferred / Nice-to-Have Skills:
- Version control and CI/CD tools: Git, Jenkins
- Infrastructure as Code: Terraform
- Data integration tools: Informatica Intelligent Data Management Cloud (IDMC)
- Experience with enterprise data platforms such as: Teradata
- Familiarity with cloud environments (Azure, AWS, or Google Cloud Platform)
Work Environment:
Hybrid work model with mandatory in-office presence in St. Louis at least 3 days per week Collaborative, fast-paced environment focused on innovation and data-driven decision-making