What are the responsibilities and job description for the Data Engineer position at Crystal Management | CMIT?
Job Details
|
|
Description
CMiT is seeking an experienced Data Engineer to help lead the analysis, documentation, and migration of a ~2TB Oracle database environment to PostgreSQL. This role involves mapping complex data dependencies across multiple schemas Oracle in legacy data centers to Postgres RDS in AWS environments.
This role offers the opportunity to play a pivotal role in a mission critical database modernization initiative, working with enterprise scale data systems while building expertise in both traditional and cloud-native database technologies.
Responsibilities
- Perform comprehensive analysis of Oracle database structures across multiple schemas and systems
- Map table relationships, constraints, and dependencies within the ~2TB environment
- Document data flows, lineage, and integration points with legacy systems
- Create detailed migration documentation and data dictionaries in Confluence
- Design optimized PostgreSQL target schemas for performance and maintainability
- Develop migration strategies for complex Oracle features (PL/SQL, packages, materialized views)
- Create and execute data migration scripts with comprehensive validation procedures
- Implement hybrid migration approaches for legacy data center and AWS environments
- Design data synchronization strategies between on-premises and cloud environments
- Implement secure data transfer mechanisms and connectivity solutions
- Ensure data consistency and integrity across distributed PostgreSQL deployments
Qualifications
Education/Certification Required
- A minimum of a Bachelor's Degree. Experience or education requirements may be met through an equivalent number of combined years of education or experience.
Required Qualifications
- 5 years Oracle database administration and development experience
- 3 years hands-on PostgreSQL experience with advanced features and performance tuning
- Experience with large-scale database migrations (multi-TB environments)
- Expert-level SQL skills across both Oracle and PostgreSQL platforms
- Proficiency in scripting languages (Python, Bash, PowerShell) for automation
- Experience with database migration tools (AWS DMS, ora2pg, pgloader)
- Knowledge of ETL/ELT tools and data pipeline frameworks
- Hands-on experience with AWS database services (RDS, Aurora PostgreSQL)
- Comfortable with a strong culture of documentation
- Proficiency with Confluence for technical documentation and knowledge management and sharing
- Ability to create clear data flow diagrams and system architecture documentation
- Experience with data lineage tools and dependency mapping
- Proficiency with diagramming tools (Visio, PowerPoint, etc)
- Proven track record of successful Oracle to PostgreSQL migrations
- Experience with legacy enterprise systems and data integration patterns
- Understanding of compliance and audit requirements for data migrations
- Strong collaboration skills with cross-functional teams
- Ability to collaborate with team members to ensure client needs and expectations are met or exceeded. Comfortable working in a remote environment.
- Demonstrates a passion for solving complex software challenges and enjoys working team collaboration.
Preferred Qualifications:
- AWS certifications (Database Specialty, Solutions Architect)
- PostgreSQL and/or Oracle certifications or equivalent expertise
- Experience with data governance and master data management
- Knowledge of performance monitoring tools (CloudWatch, pgAdmin, Oracle Enterprise Manager)
- Ability to obtain DHS/TSA clearance
Clearance Required
- Active TSA clearance required
Crystal Management, LLC provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.
