What are the responsibilities and job description for the Data Engineer position at Noblesoft Technologies?
Job Description
Job Description
Role - Data Engineer
Location - Redmond, WA
Mandate-
- Strong data engineer with solid Kusto experience
- Resource should have good Microsoft project experience
Job description-
total 8 years of experience
Should have experience in using Pyspark
Working experience on KUSTO for telemetry data
Should be able to write python code in Azure Synapse Notebook.
Good understanding & working experience of Azure Synapse end-to-end.
Should have experience in working with Spark ( structured streaming data - possibly from Event hubs)
Should have experience in handing large volume of data (possibly in 100s of GB).
Should be able to debug and fine tune the jobs / notebook for optimum memory consumption and processing.
Should have knowledge of Data warehousing, data management for efficient data handling.
Should have good knowledge of data modeling & data engineering work
Experience working with large data sets using SQL / Azure Data Lake / PySpark / ADF / Synapse, etc., to derive actionable insights is highly desirable.
They should be productive soonest possible post joining.
Nice To Have
Local Redmond resource / PST working hour resource
Microsoft ecosystem knowledge
