What are the responsibilities and job description for the Data Engineer with python and date position at Jobs via Dice?
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Infinity Tech Group Inc, is seeking the following. Apply via Dice today!
Data Engineer (Python | Snowflake / Databricks)
Role Summary:
We are looking for a skilled Data Engineer with strong expertise in Python, data processing, and modern cloud data platforms like Snowflake or Databricks. The role involves building scalable data pipelines, enabling analytics, and supporting data-driven decision-making across the organization.
Key Responsibilities:
Programming & Data
Data Engineer (Python | Snowflake / Databricks)
Role Summary:
We are looking for a skilled Data Engineer with strong expertise in Python, data processing, and modern cloud data platforms like Snowflake or Databricks. The role involves building scalable data pipelines, enabling analytics, and supporting data-driven decision-making across the organization.
Key Responsibilities:
- Design, build, and maintain scalable data pipelines (ETL/ELT)
- Develop data workflows using Python
- Work with large datasets in structured and unstructured formats
- Implement data solutions using Snowflake or Databricks
- Optimize data pipelines for performance, reliability, and cost
- Build and manage data models, data marts, and data lakes
- Integrate data from multiple sources (APIs, databases, streaming)
- Ensure data quality, governance, and security
- Collaborate with data analysts, scientists, and business teams
- Automate workflows using orchestration tools (Airflow, etc.)
Programming & Data
- Strong proficiency in Python
- Experience with:
- Pandas, NumPy, PySpark
- Solid understanding of:
- Data structures & algorithms
- Data processing techniques
- Hands-on with:
- ETL/ELT pipeline development
- Data warehousing concepts
- Batch & streaming data processing
- Experience with at least one:
- Snowflake
- Databricks
- Knowledge of:
- Delta Lake (for Databricks)
- Snowflake features (streams, tasks, warehouses)
- Strong SQL skills
- Experience with:
- Relational DBs (PostgreSQL, MySQL)
- NoSQL (MongoDB – optional)
- Experience in:
- AWS (S3, Glue, Redshift)
- Azure (ADF, ADLS)
- Google Cloud Platform (BigQuery)
- Apache Airflow / Prefect
- Git, CI/CD pipelines
- Docker (good to have)
- 3–8 years in Data Engineering or similar role
- Snowflake SnowPro Certification
- Databricks Certified Data Engineer
- AWS / Azure Data certifications
- Experience with real-time streaming (Kafka, Spark Streaming)
- Knowledge of data governance & catalog tools
- Exposure to Machine Learning pipelines
- Understanding of data security & compliance
- Strong analytical and problem-solving mindset
- Ability to work with cross-functional teams
- Clear communication and documentation skills
- Building data pipelines for analytics dashboards
- Supporting ML models with clean, structured data
- Migrating legacy data warehouses to cloud platforms
- Creating scalable data lake architectures