Data Engineer

We are seeking an highly skilled data engineering professional who thrives in fast-paced environments, adapts quickly to new technologies, and demonstrates strong analytical and problem-solving skills. You should possess a deep understanding of data structures, algorithms, and modern engineering practices, along with the ability to lead, influence, and communicate effectively across technical and business teams.

Required Experience

• Bachelor’s degree in Computer Science, Data Science, Software Engineering, or related field (or equivalent combination of education and experience)
• 6 years of experience designing and implementing end-to-end data engineering solutions
• Advanced skills in data modeling, data warehousing, and ETL development
• Hands-on experience with ETL tools — Matillion and/or PySpark preferred
• Expertise in building and operating distributed, highly available data systems for large-scale ingestion and processing
• Strong experience with cloud-based scalable data lake solutions (Databricks, Snowflake, AWS)
• Proficiency with big data technologies: Hadoop, Hive, Spark, EMR, and orchestration tools like Airflow
• Strong SQL skills and proficiency in Python and Shell scripting
• Experience with CI/CD tools: GitHub, Jenkins, Terraform, Databricks Asset Bundles

Key Responsibilities

• Define technical requirements, project scope, and estimates; translate backlog items into engineering tasks
• Lead development of technical solutions aligned with architectural standards
• Collaborate with architecture and platform teams; review and validate POCs
• Design and build data products and features within Agile/Scrum frameworks
• Develop distributed data pipelines using modern big data tools
• Conduct data profiling and analysis for scalable solution design
• Drive technical strategies for new initiatives and optimize existing systems
• Troubleshoot complex data issues and perform root cause analysis
• Build utilities, UDFs, and libraries to support scalable data flows
• Implement advanced automation through workflow orchestration tools
• Conduct collaborative design, code, and dataset reviews
• Mentor and guide junior engineers
• Proactively address data quality issues and build automated testing frameworks
• Drive best practices in version control, code review, CI/CD, and cloud development workflows

Characteristics We Value

• Strong collaboration and team-first mindset
• Ability to manage multiple projects in a fast-paced Agile environment
• Excellent communication and problem-solving skills
• Commitment to continuous learning and improvement
• Passion for mentoring and supporting team growth

About Brickred Systems:

Brickred Systems is a global leader in next-generation technology, consulting, and business process service companies. We enable clients to navigate their digital transformation. Brickred Systems delivers a range of consulting services to our clients across multiple industries around the world. Our practices employ highly skilled and experienced individuals with a client-centric passion for innovation and delivery excellence.

With ISO 27001 and ISO 9001 certification and over a decade of experience in managing the systems and workings of global enterprises, we harness the power of cognitive computing hyper-automation, robotics, cloud, analytics, and emerging technologies to help our clients adapt to the digital world and make them successful. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.