What are the responsibilities and job description for the Data Engineer II position at ExecutivePlacements.com?
What Youll Be Doing
Designs, implements, and maintains moderately complex data pipelines. Responsibilities include maintenance of database dictionaries, database design, and data integration solutions.
Designs, implements, and maintains moderately complex data pipelines. Responsibilities include maintenance of database dictionaries, database design, and data integration solutions.
- Define requirements based on independent analysis of applications of medium complexity and working with BSAs and end users.
- Design architecture, database schemas and database systems of medium complexity.
- Develop department and process standards and best practices.
- Develop data integration and process requirements based on business process analysis.
- Create and maintain data models and data dictionaries.
- Identify hardware requirements and work with infrastructural resources for implementation and maintenance.
- Determine and forecast needs and allocate resources for upcoming projects.
- Design and develop complex multi-chain data integration processes.
- Review submitted database requests to ensure code quality.
- Coach application developers on best practices for SQL Development balancing performance and total cost of ownership.
- Provide essential data warehouse architecture, design, development and support.
- Provide on-call support as necessary on a rotating schedule.
- Performs other duties as assigned
- Complies with regulatory compliance and assigned training requirements including but not limited to BSA regulations corresponding to their specific job duties. Failure to do so may result in disciplinary and other employment related actions
- Bachelor's Degree or equivalent years of experience required
- 5-7 years of experience in data engineering
- 7-10 years of experience with ETL/ELT and data integration tools
- Comprehensive working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of non-relational database technologies.
- Intermediate in developing Extraction/Transformation/Loading processes for System Integration and Data Intermediate in SQL Server Integration Services, SQL 2012 and above, C# or Java, JavaScript, and Python
- Experience with Snowflake, Boomi, QLIK Replicate
- Functional knowledge of ERwin Data Modeling Suite
- Comprehensive knowledge in Restful and SOAP API creation and consumption
- Comprehensive knowledge of database design and development
- Understanding of TSQL and stored procedure development
- Strong analytical, problem solving and conceptual skills
- Proven and successful accomplishments of manipulating, processing and extracting value from large and disconnected datasets.
- Intermediate knowledge in TFS source control and experience with Azure DevOps
- Experienced in Information Technology Service Management: Data Quality ,Meta Data Management, Master Data Management, Agile Methodology, SCRUM