What are the responsibilities and job description for the Sr Data Engineer - 10+ Years - Boston, MA position at Systems Management Group, Inc?
Role: Sr Data Engineer
Location: Boston, MA
Onsite: 4 days a week onsite
Must Have Skills:
2-5 yrs genuine Modern Data Platform engineering experience.
Fabric is strongly preferred, but happy to consider strong Databricks/Snowflake or similar engineers.
Python/Pyspark engineering.
Data processing (ETL/ELT), SQL, Data modeling.
Data architecture concepts/patterns.
Cloud platform engineering/support.
Investment compliance knowledge, financial services, and asset management.
Requirements:
- MS Fabric experience/understanding
- Working experience in Azure for data ingestion
- Azure Data Factory
- API based ingestion
- data storage formats
- warehouse and Lakehouse
- handling csv, Json, parquet file formats
- data modelling
- medallion architecture
- optimized transformations using PySpark
Regards,
Pradeep(@)smg-llc(.)us