What are the responsibilities and job description for the Data Engineer position at QUANTUM INTEGRATORS?
Job Description
Job ID
QI048
Experience Level
Entry / Early Career (6 months – 1 year)
Location
West Windsor, NJ, USA
Employment Type
Full-Time
About the role
The Data Engineer will design and implement cloud migration strategies, leveraging Microsoft Azure services to move and manage enterprise data. This role involves building data pipelines, transforming and partitioning datasets, and ensuring secure storage and transfer of data. The engineer will work with Azure SQL Database, Azure Data Lake, Azure Data Factory, Azure SQL Data Warehouse, and Azure Blob Storage, implementing best practices for data auditing, masking, and encryption. Frequent travel to client locations may be required.
Key Responsibilities
Design and implement migration strategies for traditional systems to Azure cloud.
Develop pipelines in Azure Data Factory (ADF) using linked services to extract, transform, and load data from multiple sources, including Azure SQL, Blob Storage, and SQL Data Warehouse.
Implement ADF operations and deployment to move data from on-premises to cloud environments.
Develop Spark (PySpark, SQL) notebooks for data transformation, partitioning, and file organization in Azure Data Lake Storage (ADLS).
Ensure data security through auditing, data masking, and encryption for data at rest and in transit.
Collaborate with teams to maintain data quality and optimize pipeline performance.
Frequent travel to unanticipated client locations as required.
Required Qualifications
Master's degree or foreign equivalent in Computer Science, Computer Information Systems, or related field.
Minimum 6 months of relevant work experience in data engineering or cloud data solutions.
Proficiency in Azure cloud services, including ADF, ADLS, Azure SQL, Blob Storage, and Data Warehouse.
Experience with ETL processes and building scalable data pipelines.
Knowledge of Spark (PySpark, SQL) for data transformation and processing.
Preferred Skills
Understanding of data security best practices, including auditing, masking, and encryption.
Strong analytical and problem-solving skills for cloud data environments.
Ability to work independently and collaborate with cross-functional teams.
Familiarity with cloud migration strategies and performance optimization in Azure.
What We Offer
Competitive salary and performance-based bonuses.
Comprehensive health insurance.
Learning and professional development opportunities.
Flexible working hours and remote work options.
Application Process
If you are interested, please send your updated resume to