What are the responsibilities and job description for the Azure Data Engineer position at Lincoln Softtech LLC?
Big Data Engineer(Azure)
Onsite - Dallas,TX and Chicago,IL
Longterm
Exp : 13 years
Key Skills & Experience
Worked with large and messy data from different sources to find useful insights.
Built data processes to clean, organize, and manage data, including handling metadata and tracking dependencies.
Good at working with different teams and managing projects effectively.
Strong SQL skills with experience using relational databases and writing complex queries.
Familiar with tools like Hadoop, Pig, and Datameer for big data processing.
Built and improved data pipelines and systems to handle big data efficiently.
Investigated data issues to find the root cause and suggest improvements.
Hands-on experience with tools and technologies like:
Hive, Hadoop, Spark, Kafka, Pig, Data Bricks
Azure Synapse, Datameer
SQL and NoSQL databases
Python