What are the responsibilities and job description for the Lead Data Engineer / Data Architect_only on W2 position at Chelsoft Solutions Co.?
Position: Lead Data Engineer / Data Architect
Only on W2
Only local to Texas
12 years exp
Overview
We are seeking an experienced professional to lead the design, implementation, and management of enterprise-grade data solutions. The ideal candidate will have deep expertise in data engineering, data architecture, and cloud-based data platforms, enabling scalable analytics and machine learning solutions.
Education & Experience
Only on W2
Only local to Texas
12 years exp
Overview
We are seeking an experienced professional to lead the design, implementation, and management of enterprise-grade data solutions. The ideal candidate will have deep expertise in data engineering, data architecture, and cloud-based data platforms, enabling scalable analytics and machine learning solutions.
Education & Experience
- Bachelor’s degree in Computer Science, Data Science, Engineering, or related field.
- Minimum 10 years in data engineering or architecture roles, with at least 3 years in a lead capacity.
- Proficiency in SQL and Python.
- Strong experience with cloud platforms (AWS, Azure, or GCP) and associated data services.
- Hands-on experience with data warehouses (Snowflake, Redshift, BigQuery), Databricks, and data lakes (S3, ADLS, HDFS).
- Expertise in big data processing frameworks (Spark, Flink).
- Knowledge of real-time streaming architectures (Kafka, Kinesis) and Lambda/Kappa architectures.
- Experience in data modeling, data governance, and ensuring high data quality.
- Hands-on experience with containerization and orchestration (Docker, Kubernetes).
- Ability to design and implement end-to-end data pipelines for batch and real-time processing supporting analytics and ML.
- Lead the architecture, design, and management of enterprise data platforms.
- Ensure reliable, clean, and usable data across the organization.
- Implement scalable data workflows and enforce data governance standards.
- Collaborate with cross-functional teams to enable analytics and machine learning initiatives.