What are the responsibilities and job description for the Senior Data Engineer – Azure Databricks & SQL Server(Onsite at Chicago,IL) position at E-Solutions, Inc.?
Hi Professionals,
Title: Senior Data Engineer – Azure Databricks & SQL Server(Onsite at Chicago,IL)
Location: Chicago,IL(Onsite)- Needs candidates to go for in – person client interview(Expenses will be Bear by client) and 3 days Work from Office per Week.
JD:
Title: Senior Data Engineer – Azure Databricks & SQL Server(Onsite at Chicago,IL)
Location: Chicago,IL(Onsite)- Needs candidates to go for in – person client interview(Expenses will be Bear by client) and 3 days Work from Office per Week.
JD:
- Strong knowledge of ETL/ELT concepts: pipeline design, incremental loads, data validation, troubleshooting.
- Advanced SQL: CTEs, joins, views, query optimization, performance tuning.
- Python: Production-grade coding, APIs, testing, logging, CI/CD, unit/integration testing, code coverage.
- PySpark: Distributed data processing, performance optimization, debugging, CI/CD, automated testing.
- Azure Data Factory (ADF): Pipeline development, parameterization, triggers, monitoring, error handling, integration with Databricks & ADLS.
- Databricks: Notebooks, jobs/workflows, Delta Lake, cluster/job configuration.
- Azure: ADLS Gen2, Azure Portal, Storage Explorer, Azure SQL, Azure OpenAI integration, Pulumi for infrastructure provisioning.
"Disclaimer: E-Solutions Inc. provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state and local laws. We especially invite women, minorities, veterans, and individuals with disabilities to apply. EEO/AA/M/F/Vet/Disability.”
Senior Data Engineer – Azure Databricks & SQL Server(Onsite at Chicago,IL)1SQL,Azure,Python,etl,Pyspark,Data Engineer,azure data factory,Databricks,adfN/AC2CUnited States