What are the responsibilities and job description for the Azure Data Engineer position at AppLab Systems, Inc?
Title : Azure Data Engineer
Location - Raleigh, NC ( 5 Days Work from office)
C2C
JD -
Anil Kumar
US IT Recruiter
Contact Details: 609-755-5388
Email: - anil.kumar@applabsystems.com
4365 Route 1 South, Suite 105
Princeton, NJ 08540
www.applabsystems.com
Location - Raleigh, NC ( 5 Days Work from office)
C2C
JD -
- Expert level skills writing and optimizing complex SQL
- Experience with complex data modelling, ETL design, and using large databases in a business environment
- Experience with building data pipelines and applications to stream and process datasets at low latencies
- Fluent with Big Data technologies like Spark, Kafka and Hive
- Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required
- Designing and building of data pipelines using API ingestion and Streaming ingestion methods
- Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential
- Experience in developing NO SQL solutions using Azure Cosmos DB is essential
- Working knowledge of Python is desirable
- Designing and implementing scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure services
- Managing and optimizing data storage using Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Cosmos DB
- Implementing data security measures, including encryption, access controls, and auditing, to protect sensitive information
- Automating data pipelines and workflows to streamline data ingestion, processing, and distribution tasks
- Utilizing Azure's analytics services, such as Azure Synapse Analytics, to provide insights and support data-driven decision-making.
Anil Kumar
US IT Recruiter
Contact Details: 609-755-5388
Email: - anil.kumar@applabsystems.com
4365 Route 1 South, Suite 105
Princeton, NJ 08540
www.applabsystems.com