What are the responsibilities and job description for the Big Data Engineer -- Charlotte, NC /Hybrid Onsite/W2/ position at Intellisoft Technologies?
Hi,
Position: Big Data Engineers
Location: Charlotte, NC - hybrid 3x/wk onsite
Duration: 12-24 months
- Top Must-Haves:
- Deep big data engineering expertise — strong PySpark, Scala, SQL, and hands‑on experience with large‑scale data sourcing and conformance.
- Ability to build and support batch data pipelines — including Autosys, Unix shell, GitHub/CI/CD, and comfort with enterprise‑scale performance patterns.
- End‑to‑end ownership — developers must own what they build, including L3 support post–go‑live.
- Experience with complex data modernization (e.g., parsing/mapping large structured/unstructured datasets like Newton wires).
Required Qualifications
- 5 years of experience in Big Data engineering within large enterprise environments.
- Strong hands‑on expertise with PySpark, Scala, Spark, and SQL.
- Proven experience with data sourcing, ingestion, and conformance on distributed data platforms.
- Demonstrated ability to own deliverables end‑to‑end, including production support.
- Experience building and supporting batch pipelines and working with enterprise schedulers (Autosys).
- Proficiency with Unix shell scripting, GitHub, CI/CD pipelines, and Agile development practices.