What are the responsibilities and job description for the Data Architect position at Reqroute, Inc?
Role: Data Architect
Location – Hybrid – Boston, MA (LOCALS ONLY or within 50 miles max)
Experience: 12 Years
Job summary :
Join our dynamic team as an Architect, where you’ll leverage your 10 years of experience to design and implement cutting-edge data solutions. You’ll work with technologies like Azure Synapse, AWS, and Databricks to drive innovation and efficiency. This hybrid role offers the opportunity to make a significant impact on our data strategy and contribute to our company’s success.
Required Skills : Python, Grafana, Datadog, Snowflake, Azure Databricks, PySpark, Apache Airflow, AWS, Apache Hudi, Data Build Tool, DataLake, Airflow, Databricks CLI, Azure Synapse Data Warehouse, Snowflake SQL, Snowflake Tasks, Databricks Unity Catalog Admin, Databricks Delta Lake, Apache Iceberg, Fivetran, AWS / GCP / Azure Cloud, Databricks Assistant
Responsibilities :
- Design and implement scalable data architectures using Azure Synapse and DataLake to optimize data processing and storage solutions.
- Collaborate with cross-functional teams to integrate AWS, GCP, and Azure Cloud services, ensuring seamless data flow and accessibility.
- Develop and maintain data pipelines using PySpark and Python, enhancing data processing efficiency and reliability.
- Utilize Grafana and Datadog for monitoring and performance tuning, ensuring optimal system performance and availability.
- Implement and manage Apache Airflow for orchestrating complex data workflows, improving automation and process efficiency.
- Leverage Apache Hudi and Apache Iceberg for data versioning and time travel capabilities, enhancing data management practices.
- Utilize Data Build Tool and Fivetran for data transformation and integration, streamlining data workflows.
- Optimize Snowflake Tasks and Snowflake SQL for efficient data querying and analysis, driving data-driven decision-making.
- Administer Databricks Unity Catalog and CLI for data governance and management, ensuring data security and compliance.
- Implement Databricks Delta Lake for reliable data lakes, improving data consistency and reliability.
- Utilize Databricks Assistant and Azure Databricks for collaborative data engineering, enhancing team productivity.
- Ensure data solutions align with business objectives, contributing to the companys strategic goals and societal impact.
- Stay updated with industry trends and emerging technologies, driving continuous improvement and innovation.
-Qualifications
- Possess extensive experience with Azure Synapse and DataLake, demonstrating expertise in data architecture design.
- Have a strong background in AWS, GCP, and Azure Cloud services, showcasing proficiency in cloud integration.
- Demonstrate proficiency in PySpark and Python, highlighting skills in data processing and automation.
- Experience with Grafana and Datadog, emphasizing capabilities in system monitoring and performance tuning.
- Proficient in Apache Airflow, showcasing skills in workflow orchestration and process automation.
- Familiarity with Apache Hudi and Apache Iceberg, demonstrating knowledge in data versioning and management.
- Experience with Data Build Tool and Fivetran, highlighting skills in data transformation and integration.
- Proficient in Snowflake SQL and Snowflake Tasks, showcasing expertise in data querying and analysis.
- Experience with Databricks Unity Catalog and CLI, emphasizing skills in data governance and management.
- Familiarity with Databricks Delta Lake, demonstrating knowledge in data lake optimization.
- Experience with Azure Databricks, showcasing skills in collaborative data engineering.
Certifications Required : Azure Solutions Architect Expert, AWS Certified Solutions Architect, Databricks Certified Data Engineer Associate