What are the responsibilities and job description for the Senior Data Engineer position at N Consulting Ltd?
Role: Senior Data EngineerLocation : Bangalore Senior Data Engineer – JDExperience: 6–10 YearsRequired Skills:Strong hands-on experience in Python, PySpark, SQL, Hadoop, Snowflake, and AWS.Expertise in designing and developing scalable ETL/ELT pipelines and data processing solutions.Experience working with AWS services such as S3, Glue, EMR, Lambda, Redshift, and Athena.Strong knowledge of Snowflake Data Warehouse, data modeling, performance tuning, and optimization.Experience with Big Data technologies including Hadoop, Hive, and Spark.Advanced SQL skills with experience in query optimization and data warehousing concepts.Knowledge of CI/CD tools, Git, and Agile methodologies.Responsibilities:Build and maintain scalable data pipelines and cloud-based data solutions.Develop and optimize ETL/ELT workflows using PySpark and Python.Manage and enhance Snowflake data warehouse environments.Collaborate with cross-functional teams to support analytics and reporting requirements.Ensure data quality, performance, security, and reliability.
Salary : $1,500,000 - $3,000,000