What are the responsibilities and job description for the Hiring: Senior Data Engineer for Dallas, TX (Hybrid 3-4 days a week) position at Key2Source INC?
Job Title: Senior Data Engineer (Mortgage domain exp.)
Location: Dallas, TX (Hybrid 3-4 days a week)
Experience: 12 Years
Responsibilities
- Design and Implement scalable solutions for ever-increasing data volumes, using big data/cloud technologies like Pyspark, Kafka, etc.Collaborate with cross-functional teams to understand data requirements and provide effective solutions.
- Implement real-time data ingestion and processing solutions
- Develop and maintain ETL/ELT processes to support data analytics and reporting.
- Implement best practices for data security, integrity, and quality.
- Developing data integration and migration strategies to move data from legacy systems to Cloud
- Monitoring and troubleshooting the performance and availability of the data systems and implementing strategies to improve their reliability and scalability
- Managing security and access controls for the data systems, including managing roles and permissions, implementing encryption, and complying with regulatory requirements.
Requirements
- Bachelor's in Engineering / Master's degree in Computer Science, Information Systems or related field
- Minimum of 12 years of experience in data engineering.
- Experience with databases and data warehouse implementations (Preferred Snowflake, PostGreSQL)
- Strong SQL skills with experience in writing and optimising complex queries
- Working knowledge of Data warehousing, Data Governance, Data Quality and Data Architecture
- Experience in Data Modelling
- Ability to handle large scale structured and unstructured data from internal and third-party sources
- Hands On Experience in Python, Pyspark, Kafka
- Experience with data engineering tools/technologies in Google Cloud Platform Cloud environment
- Proficiency in designing and maintaining scalable data architectures
- Experience with CICD Tools like GitHub
- Experience in the Mortgage domain is highly preferred