What are the responsibilities and job description for the Senior Data Engineer position at Spectra Force?
Job Title – Senior Data Engineer Location – Denver CO (Onsite) Duration – 29 Months Job Description: We are seeking a skilled professional with strong expertise in SQL, Python, Spark, and leading AI/ML frameworks to design and build scalable, intelligent data solutions. The ideal candidate will have hands-on experience with big data platforms and distributed data processing. Key Responsibilities: • Extensive experience in SQL and databases • Develop and optimize scalable data pipelines using Apache Spark • Build and deploy AI/ML models leveraging modern frameworks • Work with large datasets using platforms like Delta Lake and other big data technologies • Manage and integrate multiple databases for efficient data processing • Collaborate with cross-functional teams to deliver data-driven solutions Required Skills: • Strong proficiency in SQL and Spark • Experience with AI/ML frameworks (e.g., TensorFlow, PyTorch, or similar) • Hands-on experience with big data platforms such as Delta Lake • Solid understanding of distributed data processing and database management