What are the responsibilities and job description for the Sr. Data Engineer with strong SQL and Databricks experience position at People Force Consulting Inc?
Seeking a Senior Data Engineer with deep expertise in SQL Server, Azure SQL, and Databricks to design, optimize, and deliver scalable cloud-based data solutions supporting analytics and enterprise data platforms
Role - Sr. Data Engineer with strong SQL and Databricks experience
Interview process - Inperson ONLY
Experience: - 8 Years
Location: - Chicago, IL (Hybrid 3 days' Work from Office)
Duration: - 6 months contract
Educational Qualifications: -
Engineering Degree BE/ME/BTech/MTech/BSc/MSc.
Technical certification in multiple technologies is desirable.
Roles and Responsibilities
Database Development & Optimization: Design, develop, and maintain complex SQL Server and Azure SQL databases.
Write and optimize advanced T-SQL queries, stored procedures, functions, and views.
Perform query tuning, indexing strategies, and performance optimization for large-scale datasets.
Implement best practices for database security, data integrity, and reliability.
Cloud & Data Platform: Develop and manage data solutions in Azure SQL Database.
Work with Databricks (Apache Spark) to support data transformations, analytics, and largescale data processing.
Integrate Azure SQL with Databricks using Delta Lake, Spark SQL, and PySpark/SQL where applicable.
Support cloud-based data architectures and hybrid data environments.
Data Modelling & Warehousing: Design and maintain relational and dimensional data models.
Implement Slowly Changing Dimensions (SCD) and other data warehousing patterns.
Support ETL/ELT processes and collaborate with data engineering teams.
Collaboration & Leadership: Partner with application developers, data engineers, BI teams, and stakeholders to understand data requirements.
Provide guidance and mentoring to junior developers.
Participate in code reviews and enforce database development standards.
Troubleshoot production issues and provide root cause analysis.
Mandatory skills
10 years of experience as a Database Developer or similar role.
Strong expertise in SQL Server and Azure SQL.
Advanced proficiency in T-SQL, including performance tuning and query optimization.
Hands-on experience with Databricks and Apache Spark.
Solid understanding of data warehousing concepts, dimensional modelling, and SCD.
Experience working in Azure cloud environments.
Strong analytical, problem-solving, and communication skills.