What are the responsibilities and job description for the Data Engineer position at Shineteck Inc?
Job Description:** Devise a generic framework for preparing data to be fed into machine learning models, ensuring the quality and consistency of the data input. Design and develop complex ETL workflows using Informatica Power Center to integrate data from various sources into Oracle databases. Administer, configure, and maintain Snowflake data warehousing environments in a multicloud setup, ensuring optimal performance and reliability. Collaborate with data engineering and data analytics teams to design and implement data pipelines and ETL processes within Snowflake. Monitor system health and performance using Snowflake's built-in tools and third-party monitoring solutions, proactively addressing issues to maintain uptime. Implement security best practices, including role-based access control, encryption, and auditing, to protect sensitive data. Automate routine tasks using Snowflake's scripting capabilities and external scheduling tools to improve operational efficiency. Implemented advanced transformations and mappings to ensure data accuracy, consistency, and data quality. Optimize Informatica workflows and SQL queries for enhanced performance and efficiency. Utilize Informatica Power Center's error handling and recovery mechanisms to maintain data integrity during ETL processes.
Travel:** Must be willing to travel and relocate to unanticipated client locations in the U.S. every 1-2 years.
Job Requirements: ** Must possess 1 year of experience in the job offered or in a related role. Must also possess experience with AWS Cloud, Azure, Databricks, S3, Spark, Python 3.6, Bigdata, Snowflake, GBQ, GCP, CICD, Kubernates, Gi, Jenkins, JIRA, Airflow, Pyspark, Azure Analysis Services, SSAS, Tableau, Hadoop, Hive, HDFS, Oozie, Shell, HBase, Kakfa, Scala, Elasticsearch, and Splunk.
Keep a pulse on the job market with advanced job matching technology.
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution.
Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right.
Surveys & Data Sets
What is the career path for a Data Engineer?
Sign up to receive alerts about other jobs on the Data Engineer career path by checking the boxes next to the positions that interest you.
