What are the responsibilities and job description for the Data Engineer position at Potomac Management Solutions, LLC?
Job Summary
We are hiring an experienced Data Engineer to architect, build, and optimize scalable data pipelines and analytics solutions. The ideal candidate must have hands-on experience with data integration frameworks, data modeling, and distributed data processing, along with a Databricks and/or Palantir certification.
Key Responsibilities
We are hiring an experienced Data Engineer to architect, build, and optimize scalable data pipelines and analytics solutions. The ideal candidate must have hands-on experience with data integration frameworks, data modeling, and distributed data processing, along with a Databricks and/or Palantir certification.
Key Responsibilities
- Design and implement robust, scalable data pipelines using modern data engineering frameworks.
- Build and manage ETL/ELT processes, data lakes, and data warehouses.
- Ensure high performance and availability of enterprise data platforms.
- Collaborate with data scientists and business analysts to deliver analytics-ready data.
- Support data governance, quality, and security compliance.
- Maintain presence on the program for a minimum of one year.
- Bachelor’s degree in Science, Math, Engineering, or Information Systems.
- 7 years of data engineering experience in production environments.
- Databricks and/or Palantir certification (required).
- Proficient in Python, SQL, and Spark.
- Strong understanding of cloud-based data platforms (AWS, Azure, or GCP).
- Demonstrated hands-on coding experience in building and deploying data pipelines.
- Experience with Delta Lake, Apache Airflow, or Kafka.
- Familiarity with data privacy and compliance frameworks (e.g., GDPR, HIPAA).