What are the responsibilities and job description for the Data Engineer/Architect position at TechTriad?
Role: Data Engineer/Architect
Location: New York City, NY, 10001- 3 days onsite
Duration: Full-Time
Required Skills: Strong AWS Experience - Glue, Athena, S3, PostgreSQL, Terraform, IAM, Secrets Manager, CDCm Medolian architecture.
The ideal candidate has hands-on experience building modern data pipelines and platforms using Python, SQL, and AWS services such as Glue, Lambda, S3, EMR, Kinesis, and SageMaker. You will work on cloud-native analytics, leveraging open-source tools and machine learning frameworks to optimize data workflows and enhance the delivery of innovative payment and financial solutions.
This role requires a strong foundation in data structures, algorithms, and database management, along with proficiency in data visualization tools like Tableau or AWS QuickSight. You’ll also apply best practices in version control, CI/CD, and Infrastructure as Code using Terraform to manage secure and scalable cloud environments.
Required Qualifications:
• Bachelor’s degree or the equivalent in a scientific or quantitative discipline, such as Mathematics, Engineering, Computer Science, Economics, or Physical Sciences
• 5 years of experience or equivalent in the data engineering/science field as a programmer, analyst, engineer or scientist.
• Hands-on development experience using programming languages, ideally Python, with statistical and data visualization libraries, such as pandas and matplotlib.
• Experience with data structures, algorithms and database query languages, such as SQL.
• Familiarity using git code repositories and interactive editors, such as Jupyter notebooks, Sublime or VS Code.
• Familiarity with cloud services for data management and analysis, such as AWS Glue
• Experience managing a variety of large-scale data sets on Linux, Windows or MacOS.
• Excellent writing and presentation skills