Data Engineer

We are seeking a highly motivated Data Engineer – Privacy to join our growing Data & Analytics team. In this role, you will design, develop, and optimize scalable data pipelines and privacy-focused data engineering solutions across cloud and hybrid environments. You will work closely with data engineers, architects, analytics teams, and privacy stakeholders to build secure, governed, and compliant data platforms that support enterprise-scale analytics and privacy initiatives.

This position offers the opportunity to work with modern cloud technologies including Azure, Databricks, Snowflake, ADLS, Oracle, Python, SQL, and emerging AI-driven data engineering capabilities.

Key Responsibilities

Data Engineering & Platform Development

• Design and develop scalable data ingestion and transformation pipelines using Azure Data Factory (ADF).
• Build and optimize ETL/ELT workflows using Azure Databricks, Apache Spark, Snowflake, Oracle, and Python.
• Develop high-performance SQL queries, stored procedures, and data transformation logic.
• Implement data ingestion frameworks utilizing Snowflake features such as:
• Stored Procedures
• Streams
• Tasks
• Snowpipe
• Dynamic Tables
• Iceberg Tables
• Storage Integrations
• Views
• Manage and optimize data storage solutions using Azure Data Lake Storage (ADLS).
• Design and maintain scalable data models supporting analytics and reporting requirements.
• Troubleshoot, diagnose, and resolve data pipeline issues to ensure reliable data delivery.

Privacy & Data Governance

• Build privacy-compliant data engineering solutions at scale.
• Ensure data governance, security, and compliance requirements are met.
• Implement data quality validation, monitoring, and cleansing mechanisms.
• Support privacy-related data processing, auditability, and reporting requirements.

AI-Powered Data Engineering

• Utilize AI productivity tools such as Claude, Cursor, or similar IDE assistants for:
• SQL generation
• Pipeline development
• Code review
• Testing
• Documentation
• Debugging
• Design, build, and operate AI agents that automate privacy data engineering workflows.
• Apply Prompt Engineering, Foundation Models, and Retrieval-Augmented Generation (RAG) techniques to privacy use cases.
• Implement audit logging, observability, and human-in-the-loop controls for AI-assisted workflows.

Engineering Excellence

• Write clean, scalable, secure, and maintainable code.
• Participate in code reviews, testing, documentation, and deployment activities.
• Develop CI/CD pipelines using Azure DevOps or GitLab.
• Collaborate effectively with cross-functional business and technical teams.
• Mentor team members and contribute to continuous improvement initiatives.

Required Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, Information Systems, or a related field.
• 2–3 years of hands-on experience in Data Engineering and ETL development.
• Strong expertise in:
• SQL
• Python
• Azure Data Factory
• Azure Databricks
• Azure Data Lake Storage (ADLS)
• Snowflake
• Oracle
• Experience designing and supporting cloud-based data solutions on Azure.
• Strong understanding of data modeling concepts and best practices.
• Experience building and maintaining data pipelines and ingestion frameworks.
• Knowledge of CI/CD practices using Azure DevOps or GitLab.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and collaboration abilities.

Preferred Qualifications

• Experience with dbt and Azure Flink.
• Experience building vendor-agnostic data platforms using open-source technologies.
• Familiarity with privacy and regulatory compliance frameworks.
• Exposure to AI-enabled software development practices.
• Experience working in Agile environments.

ABOUT BRICKRED SYSTEMS

BrickRed Systems is a global leader in next-generation technology consulting and workforce solutions, specializing in delivering high-quality talent across digital, engineering, marketing, analytics, finance, operations, and business transformation domains.

With a strong emphasis on innovation, scalability, and client success, BrickRed Systems helps organizations solve complex business challenges by providing skilled professionals across strategy, technology, creative, and operational functions. BrickRed fosters a culture of continuous learning, collaboration, and excellence, enabling professionals to contribute to high-impact global initiatives while advancing their careers.