What are the responsibilities and job description for the Azure Data Engineer position at Citadel Information Services Inc?
This is a W2 only position, Please apply only if you can work on our W2
This position requires a face to face interview in Charlotte NC
- 10 years of experience in software development and/or data engineering.
- Strong programming experience with Python and PySpark and related frameworks.
- Proven experience as a Data Engineer or Data Quality Engineer.
- Strong hands-on experience with Microsoft Azure cloud services.
- Experience implementing solutions using:
- Azure Data Factory
- Azure Data Lake Storage Gen2
- Azure Databases
- Azure Databricks
- Data Quality Frameworks/Solutions
- Collibra Data Quality or comparable tools such as Informatica IDQ, IBM, or Ab Initio
- Collibra Data Governance and Data Lineage
- Power BI
- Strong hands-on experience with Azure Databricks.
- Strong SQL skills with relational and/or NoSQL databases.
- Good understanding of ETL/ELT processes and modern data architecture.
- Familiarity with the DevOps lifecycle, including Git, Jenkins, CI/CD, and automated deployment practices.
- Experience developing production-grade, scalable data pipelines and applications.