What are the responsibilities and job description for the Senior Data Engineer - Big Data position at Raag Solutions?
Seeking Senior Data Engineer - Big Data to join our Information Technology team in Irving. This full-time, on-site position offers an exciting opportunity to architect and build large-scale data solutions that power critical business insights and drive innovation across our technology platforms.
As a Senior Data Engineer specializing in Big Data, you will be responsible for designing, developing, and maintaining robust data pipelines and infrastructure that handle massive volumes of data. You will work closely with data scientists, analysts, and engineering teams to deliver scalable solutions that align with our clients' strategic objectives and industry best practices.
Banking Industry or Financial Industry preferred.
Responsibilities- Design and implement scalable big data pipelines and architectures
- Develop and maintain ETL processes for large-scale data integration
- Optimize data storage and retrieval performance across distributed systems
- Collaborate with data scientists and analysts to support data-driven initiatives
- Build and manage data warehousing solutions and data lakes
- Ensure data quality, integrity, and security across all platforms
- Monitor and troubleshoot data pipeline performance and reliability
- Implement best practices for data governance and compliance
- Mentor junior engineers and share technical expertise
- Stay current with emerging big data technologies and trends
- Participate in code reviews and technical architecture discussions
- Document data engineering processes and system designs
- Bachelor's degree in Computer Science, Engineering, or related field
- 5 years of experience in data engineering or related roles
- Proficiency in big data technologies such as Hadoop, Spark, and Kafka
- Strong experience with SQL and NoSQL databases
- Experience with cloud platforms and distributed computing
- Proficiency in programming languages such as Python, Java, or Scala
- Strong understanding of data modeling and warehouse design principles
- Excellent problem-solving and analytical skills
- Strong communication and collaboration abilities
- Experience with agile development methodologies