What are the responsibilities and job description for the Senior Data Engineer position at Eigen X?
We are seeking a passionate and skilled Senior Data Engineer to join our dynamic team in Philadelphia, PA. In this role, you will lead the design and implementation of advanced data pipelines for Business Intelligence (BI) and reporting. Your expertise will transform complex data into actionable insights, driving significant business value for our clients.
Key Responsibilities:
- Design and implement scalable and efficient data pipelines for BI and reporting.
- Define and manage key business metrics, build automated dashboards, and develop analytic self-service capabilities.
- Write comprehensive technical documentation to outline data solutions and architectures.
- Lead requirements gathering, solution design, and implementation for data projects.
- Develop and maintain ETL frameworks for large real-world data (RWD) assets.
- Mentor and guide technical teams, fostering a culture of innovation.
- Stay updated with new technologies and solve complex data problems.
- Facilitate the deployment and integration of AI models, ensuring data quality and compatibility with existing analytics infrastructure.
- Collaborate with cross-functional stakeholders to understand data needs and deliver impactful analytics and reports.
Required Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
- 4 years of SQL experience.
- Experience with data modeling, warehousing, and building ETL pipelines.
- Proficiency in at least one modern scripting or programming language (e.g., Python, Java, Scala, NodeJS).
- Experience working directly with business stakeholders to align data solutions with business needs.
- Working knowledge of Snowflake as a data warehousing solution.
- Experience with workflow orchestration tools like Apache Airflow.
- Knowledge of data transformation tools and frameworks such as dbt (Data Build Tool), PySpark, or Snowpark.
- Experience with open-source table formats (e.g., Apache Iceberg, Delta, Hudi).
- Familiarity with container technologies like Docker and Kubernetes.
- Experience with on-premises and cloud MDM deployments.
Preferred Qualifications:
- Proficiency with data visualization tools (e.g., Tableau, Power BI, Quicksight).
- Certifications in Snowflake or Azure Data Engineering
- Experience with Agile methodologies and project management tools (e.g., Jira).
- Experience deploying and managing data solutions within Azure AI, Azure ML, or similar environments.
- Familiarity with DevOps practices, particularly CI/CD for data solutions.
- Knowledge of emerging data architectures, including Data Mesh, Data Fabric, Multimodal Data Management, and AI/ML integration.
- Familiarity with ETL tools like Informatica and Matillion.
- Previous experience in professional services or consultancy environments.
- Experience in technical pre-sales, solution demos, and proposal development.
Senior Data Engineer
firstPRO, Inc -
Philadelphia, PA
Senior Data Engineer
Audacy, Inc. -
Philadelphia, PA
Senior Data Engineer
Jobs via Dice -
Malvern, PA