What are the responsibilities and job description for the Senior Data Engineer position at Insight Global?
Required Skills & Experience
- Senior-level data engineering experience
- Strong SQL and data warehousing expertise
- Hands-on ETL pipeline design and development
- Solid data modeling skills (normalized, denormalized, OBT schemas)
- Spark theoretical knowledge (PySpark hands-on is a plus)
- Experience working with Databricks
- Strong problem-solving and debugging skills
- Ability to collaborate across time zones (LA, NY, Bangalore)
- Mentorship mindset; comfortable supporting junior engineers
Nice to Have Skills & Experience
- Spark performance tuning experience
- Snowflake experience
- Exposure to AI/ML data pipelines (e.g., LLMs, LangChain, LangGraph)
- Streaming technologies (e.g., Apache Flink – future phase)
- Media & entertainment industry experience
Job Description
Insight Global is seeking a Senior Data Engineer (Full Stack Data Engineer) for a top media and entertainment client. This individual will join a highly visible data engineering team supporting critical analytics and AI initiatives used at the SVP and President level. The role is heavily hands-on, focused on building and scaling batch ETL pipelines using Databricks, Spark, SQL, and Python. The ideal candidate is technically deep, thrives in complex data environments, and enjoys mentoring junior engineers while working closely with data science teams to enable advanced analytics and machine learning use cases.
Day-to-Day:
- Build and maintain batch ETL pipelines in Databricks
- Develop new data pipelines (net-new development, not just maintenance)
- Write complex, high-performance SQL queries
- Perform data modeling to support analytics and data science use cases
- Ensure data quality, governance, and observability
- Integrate and manage complex datasets from multiple sources (TV, digital, ad sales)
- Partner closely with Data Science and AI teams
- Mentor and support early-career and junior engineers
- Collaborate with stakeholders across multiple time zones
Compensation:
$65/hr to $70/hr.
Exact compensation may vary based on several factors, including skills, experience, and education.
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.
Salary : $65 - $70