Senior Data Engineer with Security Clearance

Are you ready to turn complex data into powerful mission insight? NS2 Mission is seeking an experienced Senior Data Engineer to design, build, and optimize tools, code, and services that support complex data engineering activities across structured and unstructured data sources. This role is positioned in Chantilly, VA and will focus on enabling the ingestion, transformation, and delivery of high-quality data to support mission-critical analytics and decision-making. Key Responsibilities * Design and implement solutions for moving both structured and unstructured data using approved methods.

• Execute data ingestion processes to store data in local or enterprise-level repositories.
• Develop code and tools to format data for exploration and analysis.
• Analyze source data formats and collaborate with Data Scientists and partners to identify optimal transformations and standards aligned with mission objectives.
• Build and maintain ETL pipelines, including one-time and recurring data extraction, formatting, and transformation into enterprise or standalone data models.
• Perform O&M and enhancements to existing ETL processes using best practices and coding standards.
• Develop and deliver documentation for each project, including ETL mappings, user guides, and access instructions.
• Design and optimize scalable data pipelines using technologies such as Spark, Apache Iceberg, Trino, OpenSearch, EMR cloud services, NiFi, and Kubernetes containers.
• Ensure data lineage, pedigree, and security are maintained throughout the lifecycle.
• Clean and preprocess datasets to enable advanced analytics.
• Collaborate with enterprise working groups to advance data standards.
• Partner with engineers, data stewards, and mission stakeholders to derive actionable insights from data assets.
• Work closely with software engineers to update, configure, and maintain data services based on evolving requirements.
• Ensure data quality by collaborating with testing and quality teams to standardize conditioning pipelines.
• Adapt to diverse data types and formats, integrating new platforms and tools as needed. Required Skills & Experience * 10 years of experience in: * Data lifecycle engineering
• Development and maintenance of ETL tools and services
• Cloud and on-premises data storage and processing solutions
• Programming with Python, SQL, Spark, and related languages
• Leveraging COTS and open-source tools such as Elasticsearch and NiFi
• Supporting data workflows within Agile development lifecycles Preferred Skills * Experience applying AI and large language models (LLMs) to accelerate data processing and transformation. Position Clearance Requirement: TS/SCI with an FSP We win with inclusion NS2 Mission's culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone - regardless of background - feels included and can run at their best. At NS2 Mission, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world. NS2 Mission is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with NS2 Mission and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: . Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, age, gender (including pregnancy, childbirth, et al), sexual orientation, gender identity or expression, protected veteran status, or disability, in compliance with applicable federal, state, and local legal requirements.