What are the responsibilities and job description for the AWS Solution Architect position at Qode?
Role: AWS Solution ArchitectLocation: San Francisco, CAJob Purpose:Designing Solution architecture, and work on Data Ingestion, Preparation, and Transformation. Debugging the production failures and identifying the solution.Developing efficient frameworks for development and testing using (AWS Dynamo DB, EKS, Kafka, Kinesis/Spark/Streaming/Python, etc.) to enable a seamless data ingestion process onto the AWS cloud platform.Enabling Data Governance and Data Discovery PlatformBuilding data processing framework using Spark, Databricks, and pythonExposure to Data Security Framework on the cloudExposure to Data Pipeline Automation using DevOps toolsExposure to Job Monitoring framework along with validations and automationExposure to handling structured, Unstructured, and Streaming datasets.Must have - Technical & Soft SkillsSolid hands-on and Solution Architecting experience in Big-Data Technologies (AWS preferred)Hands-on experience in: AWS Dynamo DB, EKS, Kafka, Kinesis, Glue PySpark, EMR PySparkHands-on experience with programming languages like Python, Scala with Spark.Good command and working experience on Hadoop/Map Reduce, HDFS, Hive, HBase, and No-SQL DatabasesHands-on working experience on any of the data engineering/analytics platforms (Hortonworks/Cloudera/ MapR/ AWS), AWS preferredHands-on experience in Data Ingestion Apache Nifi, Apache Airflow, Sqoop, and OzzieHands-on working experience in data processing at scale with event-driven systems, message queues (Kinesis/Kafka/Flink/Spark Streaming)Hands-on working Experience with AWS Services like EMR, Kinesis, S3, CloudFormation, Glue, API Gateway, Lake FoundationHands-on working Experience with AWS AthenaData Warehouse exposure on Apache Nifi, Apache Airflow, KyloOperationalization of ML models on AWS (e.g. deployment, scheduling, model monitoring etc.)Feature Engineering/Data Processing to be used for Model developmentExperience gathering and processing raw data at scale (including, writing scripts, web scraping, calling APIs, writing SQL queries, etc.)Experience building data pipelines for structured/unstructured, real-time/batch, events/synchronous/ asynchronous using MQ, Kafka, Steam processingHands-on working experience in analyzing source system data and data flows, working with structured and unstructured dataMust be very strong in writing SQL queriesStrengthen the Data engineering team with Big Data solutionsStrong technical, analytical, and problem-solving skillsStrong organizational skills, with the ability to work autonomously as well as in a team-based environmentPleasant Personality, Strong Communication & Interpersonal SkillsCertifications (Preferred)AWS Certified Solution Architect – AssociateAWS Certified Solution Architect – ProfessionalNice to haveScripting: Unix or Shell scriptingExposure to various ETL and Business Intelligence toolsExperience in data warehouse design and best practicesA strong background in troubleshooting and technology support will be beneficial.Educational QualificationA bachelor's degree in computer science, computer engineering, or a related discipline is required to work as a technical leadCertification on AWSIndividuals in this field can further display their leadership skills by completing the Project Management Professional certification offered by the Project Management Institute.
Salary : $140,000 - $200,000