What are the responsibilities and job description for the Data Engineer Lead position at Next Level Business Services, Inc.?
Job Details
Required Qualifications:
8 years experience with ETL/ELT process and frameworks is a must
8 years expertise in SQL and experience with relational databases like Oracle, MySql, PostgreSQL
5 years proficient in Python and Scala programming for data engineering tasks, automations
8 years strong in GIT repo and CI/CD deployment process
5 years experience with Big Data Hadoop, Spark
Create integration and application technical design documentation.
Conduct peer-reviews of functional design documentation.
Complete development, configuration, test cases and unit testing
Perform code reviews and ensure standards are applied to each solution component.
Resolve complex defects during testing phases and identify root causes.
Drive performance testing.
Production Support: Assist in troubleshooting production environment and tuning environments.
Ensure best practices are followed from a technical perspective during all phases of the project.
Strong Application development experience in Python.
Experience in designing & developing a big data solution using Spark, AWS Glue, Lambda, SNS/SQS, Cloudwatch
Strong Database SQL experience, preferably Redshift.
Experience in Snowflake
5-8 years experience in the following domains:
Asset Management
Financial Services
Investment Management
Hedge Funds