What are the responsibilities and job description for the Senior Data Engineer position at Analytica?
We are seeking an experienced Senior Data Engineer to build reusable connectors and data pipelines that ingest, validate, normalize, and persist agency data for a Federal data analytics and AI modernization initiative.
The team will deliver a secure, scalable platform that integrates structured and unstructured data, provides data visualization and traceable AI-assisted analytics, and gives examiners centralized tools for search, review, monitoring, and decision support. The platform will support professional judgment and will not replace authoritative agency financial or grants-management systems or execute financial transactions.
- Design, develop, test, and deploy scalable ETL/ELT pipelines for high-volume, multi-source data environments
- Build reusable data connectors and integration services to ingest data from APIs, databases, files, and other enterprise data sources
- Develop and integrate RESTful APIs and data services to support data ingestion, retrieval, transformation, and downstream applications
- Design data transformation and normalization processes for structured and unstructured data
- Implement data quality controls, including validation, reconciliation, deduplication, error handling, and exception management
- Develop automated processes for data lineage, metadata capture, logging, monitoring, and auditability
- Design and optimize data models, schemas, and storage solutions using relational and other appropriate data technologies
- Develop efficient SQL queries, stored procedures, transformations, and data-processing logic for large datasets
- Build and maintain automated CI/CD pipelines for data engineering components and applications
- 7 years of experience in data engineering, data integration, or a related software engineering discipline.
- Demonstrated experience building and maintaining production-grade data pipelines in enterprise environments
- Strong experience with ETL/ELT architecture, data transformation, orchestration, validation, reconciliation, lineage, logging, and monitoring
- Advanced proficiency with SQL and relational databases
- Strong programming experience in Python
- Experience developing and integrating REST APIs and other data integration interfaces
- Experience working with relational databases and data-storage technologies, such as PostgreSQL or Microsoft SQL Server
- Experience with Linux-based development or deployment environments
- Experience with Git-based source control and CI/CD practices
- Experience developing automated tests for data pipelines, APIs, or software components
- Strong communication, documentation, problem-solving, and cross-functional collaboration skills
- U.S. citizenship and ability to obtain and maintain Top Secret eligibility, as required for all contractor personnel supporting the effort
- Active Top Secret clearance highly preferred.
- Experience with Kubernetes, Rancher, Docker, or other container orchestration technologies
- Experience with Jenkins, Azure DevOps, or comparable CI/CD platforms
- Experience with self-hosted Azure DevOps environments
- Experience developing data solutions in secure Federal, on-premises, or hybrid cloud environments
- Experience with PostgreSQL and/or Microsoft SQL Server administration, optimization, or advanced development.
- Experience implementing data catalogs, metadata management, data lineage, or data governance capabilities
- Experience integrating structured and unstructured data across disparate systems
- Experience with event-driven architectures, message queues, or streaming data technologies
- Familiarity with Federal security, privacy, accessibility, and compliance requirements
- Experience supporting Federal financial management, budget execution, grants management, payment systems, award oversight, financial reporting, or financial stewardship is preferred.
- Experience supporting Federal financial management, grants, payment, or award-oversight platforms.