3 Data Engineer & ETL/Pyspark Developer Jobs in Mc Lean, VA

SORT BY

SET JOB ALERT

OFF

Details...

ETL Developer with IICS, AWS and PySpark(must to have )

Diverse Lynx

Mc Lean, VA | Full Time

$107k-132k (estimate)

1 Week Ago

ETL Developer with IICS, AWS and PySpark

Diverse Lynx

Mc Lean, VA | Full Time

$100k-125k (estimate)

1 Week Ago

Data Engineer & ETL/Pyspark Developer

Diverse Lynx

Mc Lean, VA | Full Time

$126k-155k (estimate)

1 Week Ago

Data Engineer & ETL/Pyspark Developer

$126k-155k (estimate)

Full Time 1 Week Ago

Save

Diverse Lynx is Hiring a Data Engineer & ETL/Pyspark Developer Near Mc Lean, VA

Job details:- Data Engineer & ETL/Pyspark Developer
PySpark Developer (ETL) / Data Engineers:
Contact

expertise in Python, PySpark, ETL processes, CI/CD (Jenkins or GitHub), and experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clientsY
Collaborate with cross-functional teams to understand data requirements and design robust data architecture solutions
Implement ETL processes to extract, transform, and load data from various sources
Ensure data quality, integrity, and consistency throughout the ETL pipelines
Utilize your expertise in Python and PySpark to develop efficient data processing and analysis scripts
Optimize code for performance and scalability, keeping up-to-date with the latest industry best practices
Integrate data from different systems and sources to provide a unified view for analytical purposes
Collaborate with data analysts to implement solutions that meet their data integration needs
Design and implement streaming workflows using PySpark Streaming or other relevant technologies
Develop batch processing workflows for large-scale data processing and analysi
Must have: Python, Spark, Data Processing experience, SQL, AWS, Snowflake

Good to have: Java
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.