Role: Data Architect

Job Locations: USA; New York, NY, USA; Boston, MA, USA

Full Time

Required Experience: 10 - 15 Years

Skills : kafka, spark, python, sql, java

• Own the end-to-end architecture of the data platform, ensuring its efficiency, cost-effectiveness, security, and governance.

• Collaborate closely with other engineers to design and build an optimal and cost-efficient platform solution.

• Work in partnership with other engineers and managers to design and develop foundational elements of the platform. Create tools and frameworks that enhance data processing, information retrieval, governance, and data quality in a cost-effective and user-friendly manner.

• Develop platform tools and frameworks to the same standard as seen in open-source projects. Engage closely with the engineering community and open-source them upon reaching maturity.

Requirements

• Bachelor's degree in computer science or Similar discipline.

• 12 years of track record of delivering complex software engineering systems and platforms.

• programming experience using python, sql and java or similar languages

• experience in wide variety of distributed systems and frameworks - such as Apache Spark, Kafka, Airflow, Kubernetes, Cassandra, Druid, Snowflake and more.

• building and maintaining Tier-1 (require 24*7 uptime and strict SLA) data driven applications.

• 5 years of Cloud (AWS preferred) experience.

• Experience in building AI/ML driven platform is a huge plus