Your job will be to design, implement, maintain, and monitor data pipelines, both in support of R&D prototypes and production pipelines. You succeed through effective cross functional collaboration in areas such as, but not limited to, development, product, and QA in a dynamic and fast paced environment.

Job Description 

• Perform Database builds, installs, configuration, administration, and troubleshooting of database systems (e.g., MariaDB/MySQL, Postgres, Elasticsearch, Qdrant, Milvus, etc.)
• Ensure data integrity by performing employing data engineering best practices.
• Maintain database and data pipeline documentation, data dictionaries, and system diagrams.

Required Skills 

• Bachelor’s Degree and 12 years of prior relevant experience or Masters with 10 years of prior relevant experience.
• Experience with SQL, NoSQL, and vector databases such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc.
• Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc.
• Experience with DevOps / MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms.
• Must possess an active TS/SCI clearance and the ability to obtain and maintain a TS/SCI with Polygraph.
• Experience with database design, implementation, maintenance, monitoring, performance tuning, and optimization.
• Expertise in data profiling techniques and understanding the content from both a data quality and business perspective.
• Experience with data quality and accuracy evaluation techniques.
• Experience with Agile practices.
• Development experience with Python.
• Experience on data model development, modification and migration, and maintenance.
• Strong verbal and written communication skills.
• Enthusiastic with the ability to work well on a team and a self-starter who can work independently.

Desired Skills 

• Experience supporting data teams and data scientists.
• Experience on a production/ enterprise system.
• Experience in air-gapped environments.
• Application development and deployment in an AWS environment.
• AWS certifications.