What are the responsibilities and job description for the Senior Data Developer (Azure) position at Jobgether?
This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior Data Developer (Azure) in Brazil.
This role is an opportunity to work at the heart of a data transformation initiative, helping build a modern and scalable data platform for a financial services and asset management environment. You will translate architectural guidelines into robust and efficient data pipelines, enabling structured, reliable, and actionable data across the organization. The environment is highly collaborative, with close interaction with data architects and engineering teams, while still offering autonomy in execution. You will work with cloud-based data technologies to integrate, transform, and organize data coming from multiple structured and unstructured sources. The focus is on building a strong Data Lake/Lakehouse foundation using modern Azure services and best practices in data engineering. This role is ideal for someone who enjoys solving complex data challenges while contributing to a structured and evolving data ecosystem.
- Design and implement ELT/ETL pipelines to ingest, transform, and deliver data from diverse sources such as spreadsheets, SharePoint, and relational databases.
- Build and maintain Data Lake and Lakehouse architectures (Bronze, Silver, Gold layers) using formats such as Delta Lake and Parquet.
- Develop scalable data transformations using PySpark and advanced SQL to support analytical and business use cases.
- Implement efficient data ingestion strategies (full and incremental loads) tailored to different data domains and volumes.
- Ensure data quality by implementing automated validation, testing, and monitoring across pipelines.
- Support data governance, cataloging, lineage, and documentation practices in alignment with architectural standards.
- Guarantee pipeline observability through logging, alerting, and proactive monitoring of data workflows.
- Document data models, transformations, and business rules to ensure traceability and maintainability.
Requirements:
- Proven experience in Data Engineering within cloud environments.
- Strong hands-on experience with PySpark for building distributed data pipelines and transformations.
- Advanced SQL skills for data manipulation, querying, and analytical modeling.
- Experience with Microsoft Azure data services such as Azure Data Factory, ADLS Gen2, and/or Microsoft Fabric.
- Knowledge of data formats such as Delta Lake, Parquet, or ORC.
- Experience with Data Lake, Lakehouse, and Medallion architectures.
- Familiarity with data cataloging and lineage tools, including Unity Catalog (Databricks).
- Experience with Databricks and/or Snowflake is a strong plus.
- Knowledge of Microsoft Fabric components (pipelines, notebooks, lakehouses, dataflows) is a plus.
- Experience with Microsoft Purview for governance and lineage is a plus.
- Familiarity with dbt for transformations and data quality testing is a plus.
- Experience with orchestration tools such as Apache Airflow or Prefect is a plus.
- Understanding of CI/CD, Git workflows, automated testing, and software engineering best practices is a plus.
- Data-related certifications such as DP-700 or equivalent are a plus.
- Exposure to GenAI and agent-based data solutions is a plus.
- Strong analytical thinking, autonomy, and ability to deliver within defined architectural guidelines.
Benefits:
- Health and dental insurance
- Meal and food allowance
- Childcare assistance
- Extended parental leave
- Gym and wellness partnerships (Wellhub/Gympass, TotalPass)
- Profit sharing (PLR)
- Life insurance
- Continuous learning platform (CI&T University)
- Discount club programs
- Online platform for physical and mental well-being
- Pregnancy and responsible parenting courses
- Access to online learning platforms and language training
- Additional wellness, health, and development benefits.
How Jobgether works:
We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.
We appreciate your interest and wish you the best!
Why Apply Through Jobgether?
Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.
#LI-CL1