What are the responsibilities and job description for the Data Engineer (Financial domain) position at IPS Technology Services?
Job Tittle: Data EngineerLocation - Boston, MA (Need Local)Visa: USC, GC, H4-EAD, GC-EADMust have: Spark, Scala, AWS, ETL, Python, lambda/glue/s3Key responsibilities: AWS data engineers are responsible for designing and building data pipelines and developing ETL/ELT processes using tools such as AWS Glue, EMR, and Redshift to prepare data for analytics. They integrate data from various sources and create and maintain data models efficient for storage and analysis. Ensuring data quality, security, and compliance through implementing checks, validation processes, and security best practices is also crucial. The role involves monitoring and optimizing data processing jobs and databases for performance, collaborating with stakeholders to understand data requirements, and maintaining and operationalizing existing data solutions.Minimum Skills Required: At least 6 years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution.Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must.Strong Application development experience in Scala/Python.Strong Database SQL experience, preferably Redshift.Experience in Snowflake is an added advantage.Experience with ETL/ELT process and frameworks is a must.Strong background in AWS cloud services like lambda, glue, s3, emr, sns, sqs, cloudwatch, redshiftExpertise in SQL and experience with relational databases like Oracle, MySql, PostgreSQLProficient in Python programming for data engineering tasks, automationsExperience with shell scripting in Linux/Unix environments.Experience with Big Data – Hadoop, SparkFinancial Services experience requiredNice to have - knowledge in Machine Learning models, regression, validationIf you are interested, please send your Updated Resume with the following info at the earliest.Full Legal Name:Current City, State, Zip: Interview Availability:Start availability:Work Authorization:Phone No:Hourly Rate:
Salary : $55 - $65