What are the responsibilities and job description for the ETL Architect position at Beacon Systems, Inc?
Job Details
Beacon Systems, Inc, delivers Program Management, Science, Engineering, and Technology Solutions to Federal, Commercial State, and Local Agencies. We are a subsidiary of Radiant Digital Solutions. Our Technology support to many DoD Agencies, NASA, Voice of America, FDA, and State Agencies such as State of FL, RI, MS, ND, VA, and WV extends our delivery of solutions worldwide.
We are looking for a ETL Architect - Tallahassee, FL
If you are interested in applying for this requirement, please do respond with your updated resume.
Job Title: Data Architect, Advanced (ETL Architect)
Work Location: On-site - Tallahassee, Florida
Contract Term: 6 months (Possible one-year renewal, not to exceed 12 months)
Position Overview
We are seeking one full-time, on-site Data Architect, Advanced, working under the role of Extract, Transform, Load (ETL) Architect. The ETL Architect will be responsible for designing, developing, and optimizing enterprise-scale data integration pipelines supporting the Correction Information Management System (CIMS) Data Warehouse and Data Lake on Microsoft Azure.
This role serves as a technical leader and primary point of communication for ETL architecture and data engineering activities, ensuring data integrity, security, performance, and regulatory compliance.
General Experience
- Minimum of seven (7) years of experience working with large and complex database management systems.
Required Qualifications
- Bachelor’s degree from an accredited college or university in Computer Science, Information Systems, or a related field.
- Equivalent work experience may substitute on a year-for-year basis, including experience with Service-Oriented Architecture (SOA) and Microsoft Azure Cloud solutions.
- Seven (7) or more years of experience in ETL development and data engineering.
- Three (3) or more years of hands-on experience with:
- Azure Data Factory (ADF)
- Microsoft Azure Cloud
- Azure Databricks
- Azure Synapse Analytics
- Azure Purview
- Proven experience designing and optimizing large-scale ETL pipelines for high-performance and high-availability environments.
- Strong expertise in Spark, Python, and or Scala for large-scale data transformations.
- Advanced SQL skills with experience handling complex data structures.
- In-depth knowledge of data governance, security controls, and role-based access control (RBAC) within Azure.
- Demonstrated ability to design ETL processes that are resilient, efficient, and compliant with regulatory standards.
Preferred Qualifications
- Microsoft certifications such as:
- Azure Data Engineer Associate
- Azure Solutions Architect Expert
- Azure Fundamentals
- Azure Databricks Data Engineer Associate certification.
Scope of Work and Responsibilities
ETL Pipeline Design and Development
- Design and develop high-performance ETL processes integrating data from multiple sources.
- Build secure, reliable, and efficient pipelines that meet business and operational requirements.
- Use Azure Data Factory to automate and orchestrate data workflows.
Data Integration and Transformation
- Develop and manage complex ETL workflows supporting analytics and reporting.
- Ensure data accuracy, timeliness, validation, and security throughout the pipeline lifecycle.
- Own data quality controls to ensure only trusted data reaches downstream systems.
Cloud Platform Implementation
- Leverage Azure Data Factory, Databricks, Synapse, and Purview to process large volumes of structured and unstructured data.
- Integrate datasets into Azure Synapse Analytics to support enterprise analytics and reporting needs.
Performance Optimization
- Continuously tune and optimize ETL jobs to reduce latency and improve throughput.
- Ensure ETL architecture meets performance, scalability, and availability requirements.
Security and Compliance
- Embed security and compliance controls across all ETL processes.
- Protect sensitive data in alignment with Department data governance standards.
- Use Azure Purview for data governance, lineage tracking, and compliance enforcement.
Collaboration and Leadership
- Work closely with data engineers, analysts, business stakeholders, and security teams.
- Act as a technical leader and mentor, providing guidance on ETL architecture and best practices.
Documentation and Standards
- Develop and maintain detailed documentation for ETL processes and architectures.
- Establish and enforce best practices for ETL development, data handling, and security.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.