DATA ENGINEER
100% Remote.
EST Hours.
Project Description* Handle the design and construction of scalable management systems, ensure that all data systems meet company requirements, and also research new uses for data acquisition.
* Required to know and understand the ins and outs of the industry such as data mining practices, algorithms, and how data can be used.
* Design, construct, install, test and maintain data management systems.
* Build high-performance algorithms, predictive models, and prototypes.
* Ensure that all systems meet the business/company requirements as well as industry practices.
* Integrate up-and-coming data management and software engineering technologies into existing data structures.
* Develop set processes for data mining, data modeling, and data production.
* Create custom software components and analytics applications.
* Research new uses for existing data.
* Employ an array of technological languages and tools to connect systems together.
* Collaborate with members of your team (eg, data architects, the IT team, data scientists) on the projects goals.
* Install/update disaster recovery procedures.
* Recommend different ways to constantly improve data reliability and quality.
* Works closely with customers and stakeholders in partnership with Solution architect in an Agile manner to design end to end data solutions.
* This role also works on hand off to support team.
* The Data Engineer should be able to assess the impact of any change to the overall architecture and guide the offshore development team.
* The Data Engineer must be proficient in data management and business intelligence technologies and must be prepared to develop and enforce standards in support of project and continuous improvement initiatives.
* (25%) Collaborate with solution architects to understand the overall solution concept in support of a project or continuous improvement effort.
* Works with customers of Data and Analytics to understand business needs with respect to data and analytics in order to determine optimal solutions.
* (70%) Develop high-level and detailed design documents for projects and continuous improvement efforts and build data solutions.
* Develop data models, meta data support, development and testing for enterprise-wide data lake house.
* (5%) Participate in code reviews with the development team, ensuring adherence to development standard and overall best practices.
* Facilitate software change management acro .
Required Skills:
* Technical Degree or related work experience.
* Experience with non-relational & relational databases (SQL, MySQL, NoSQL, Hadoop, MongoDB, etc.).
* Experience programming and/or architecting a back-end language (Java, J2EE, etc.) .
* Strong sr Data Engineer that has a min of 5-7 years of experience with Databricks as the client have newly started using this tool and need assistance.
* Must have minimum of 5 years of experience in Databricks development.
* Must have strong written and oral communication skills.
* Must have dimensional database and data lake house experience, experience with SQL, experience with both ETL and ELT models, experience with Azure Databricks for ELT, cloud solution architecture and development experience strongly desired.
* This includes data modeling, meta data support, development, testing and implementation.
* CI / CD experience and Virtualization experience desired.
* BI tool experience, Power BI strongly desired.
* Experience working with external service providers desired.
* Experience using Open-source tools for BI / DW development desired.
* Experience working with Agile methodology desired .
This 5 month position starts ASAP.
Please E-MAIL your resume (attachment to email) with rate and availability to Bridget: bridget@alphaconsulting.com (mailto:bridget@alphaconsulting.com)
ALPHA'S REQUIREMENT #23-00450
MUST BE ELIGIBLE TO WORK IN THE U.S. AS AN HOURLY W2 EMPLOYEE