What are the responsibilities and job description for the Data Engineer position at Recurring Decimal?
Job Summary
Builds, scales, and manages high-performance backend systems and data pipelines to process large volumes of data. Leads technical architecture, mentors engineering teams, and optimizes cloud storage and data solutions for advanced analysis.
Core Responsibilities
- Lead Backend Development: Drive the architecture and implementation of scalable, secure backend systems utilizing Django.
- Build Data Pipelines: Develop robust ETL pipelines, optimizing data storage solutions with Azure Databricks, Delta Lake, and Delta tables.
- Design Scalable APIs: Architect and implement secure, high-performance RESTful APIs and web services.
- Manage Cloud Infrastructure: Integrate and deploy applications seamlessly using Azure Cloud services.
- Optimize Performance: Oversee database management across SQL and NoSQL environments to ensure maximum speed and data quality.
- Guide Engineering Teams: Mentor junior developers, conduct rigorous code reviews, and champion best engineering practices.
- Collaborate Cross-Functionally: Partner with frontend developers, product managers, and stakeholders to deliver comprehensive technical solutions.
Required Qualifications & Skills
- Experience: 10 years of professional backend development experience, with a heavy specialization in Django.
- Education: Bachelor’s degree in Computer Science, Information Technology, or a related field.
- Cloud & Big Data: Proven expertise in Azure Cloud, PySpark, Azure Databricks, Delta Lake, and Delta tables.
- Technical Skills: Advanced Python, SQL/NoSQL databases, Git, and Agile methodologies.
- Core Competencies: Strong ownership mindset, proactive problem-solving, excellent communication skills, and a commitment to delivery.