What are the responsibilities and job description for the Data Engineer (Pyspark, DataBricks, Data Lake) position at TekValue IT Solutions?
Azure Data Engineer
Onsite - Irving, TX
Long Term
Required Skills:
- 4 YEARS OF HANDS-ON EXPERIENCE IN DATA ENGINEERING, INCLUDING DATA LAKE INFRASTRUCTURE, DATA WAREHOUSING, AND DATA ANALYTICS TOOLS.
- CLOUD DATA ENGINEERING EXPERIENCE ON AZURE. DEEP UNDERSTANDING OF AZURE SERVICES LIKE DATA FACTORY, DATABRICKS, AND MACHINE LEARNING. AZURE CERTIFICATION IS A PLUS.
- STRONG PROFICIENCY IN SQL, PYTHON AND PYSPARK. PROVEN ABILITY TO OPTIMIZE SQL QUERIES AND PERFORMANCE TUNE DATA PIPELINES.
- EXPERIENCE IN BUILDING AND OPERATING HIGHLY AVAILABLE, DISTRIBUTED DATA PIPELINES FOR LARGE-SCALE DATA INGESTION, PROCESSING, AND EXTRACTION.
- EXPERIENCE INTEGRATING MULTI-CLOUD SERVICES WITH ON-PREMISES TECHNOLOGIES. STRONG UNDERSTANDING OF DATA MODELING PROCESSES.
- PROVEN ABILITY TO SOLVE COMPLEX DATA PROBLEMS, COLLABORATE EFFECTIVELY WITH CROSS-FUNCTIONAL TEAMS, AND DELIVER HIGH-QUALITY SOLUTIONS.
