What are the responsibilities and job description for the Data Engineer position at Value Technology Inc?
Job Title: Data Engineer
Location: Charlotte, NC (Hybrid - 3 days in a week)
Job Description:
Value Technology is seeking for a Senior Data Engineer role resource is required at onsite location (Charlotte, NC - North Carolina-USA Onsite location)). Resource will have to work from office for 3 days in a week. Resource is expected to design, build, and maintain scalable data platforms while leading technical decisions.
Key technical skills - required:
- Programming: Python (advanced), SQL (expert level), Scala or Java (often preferred for big data)
- Data Engineering skills required: ETL/ELT pipeline development, Data modelling (star schema, dimensional modelling), Data warehousing (Snowflake, Big-Query, Redshift, Synapse), Data lakes and lake-house architectures
- Big Data Technologies skills required: Apache Spark (essential), Hadoop ecosystem
- Kafka (streaming), Apache Airflow or similar workflow orchestration tools
- Cloud Platforms skills required: AWS (S3, Glue, EMR, Lambda, Redshift), Azure (ADF, Synapse, Databricks), Google Cloud (Big-Query, Dataflow, Data-proc)
- Databases skills required: PostgreSQL, MySQL, NoSQL databases (MongoDB, Cassandra, DynamoDB)
- DevOps & Engineering Practices: Git, CI/CD pipelines, Docker, Kubernetes, Infrastructure as
- Code (Terraform is a plus)
- Data Quality & Governance: Data validation and testing, Metadata management, Security and access control, Monitoring and observability
- Leadership Skills: System design and architecture, Mentoring junior engineers, Stakeholder communication
- Project estimation and technical planning
Nice-to-Have Skills
- Databricks
- DBT (Data Build Tool)
- Delta Lake or Apache Iceberg
- Machine learning data pipelines
- Generative AI and LLM data infrastructure
Salary : $7 - $15