What are the responsibilities and job description for the Senior Data Engineer (Kusto) - Bellevue , WA - Fulltime position at Ztek Consulting INC?
Job Description
Must Have Technical/Functional Skills:
Digital : Microsoft Azure; Kusto; PL/SQL; Digital : Microsoft Power BI; Microsoft SQL Server 2012 Business Intelligence
Required Skills
Associate should be able to create Azure Policies and baseline rules. Also able to handle KPIs and corresponding dashboard development and maintenance. Should have excellent communication to handle the Office Hours or the support work. Design and implement scalable data architectures, ensuring high availability, reliability, and performance of data systems. Strategically architect, design, develop, and implement efficient information systems and/or operations systems in support of core enterprise functions. Understand business requirements, study existing application landscape, and identify redundant/ineffective systems Build, maintain, and optimize data pipelines for extracting, transforming, and loading (ETL/ELT) data from various sources into data warehouses or data lakes. Create data migration/system integration strategies. Conceptualize technical solutions to complex problems and maximize benefit of systems investments. Database Management: Manage and optimize databases (both SQL and NoSQL), ensuring data consistency, quality, and security. Integrate data from disparate sources, including APIs, flat files, and third-party data, ensuring comprehensive data availability for analytics and reporting. Implement and monitor data quality measures to ensure accuracy, completeness, and reliability of data. Design and develop/maintain the reports. Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs. Work closely with clients to gain organizational commitment for all systems and software plans, as well as evaluate and guide the selection of technologies required to complete those plans. Automate repetitive tasks to improve data processing efficiency and reduce manual intervention. Monitor system performance to detect and resolve problems during deployment and support change management. Maintain comprehensive documentation for data processes, systems, and pipelines to facilitate knowledge sharing and onboarding. Design and develop the reports mostly in Power BI.