You haven't searched anything yet.
Job Title: Sr Data Engineer
Location: New York City, NY
Full-time || Onsite
Job Description:
Relevant Experience (in Yrs): 8-10 yrs
Must Have Technical/Functional Skills: Apache Spark, Scala/ Python and PySpark
Experience Required: Min. 5-7 years hands on experience working in data modeling
Roles & Responsibilities:
Work on migrating applications from an on-premises location to the cloud service providers.
Develop products and
services on the latest technologies through contributions in
development, enhancements, testing and implementation.
Develop, modify, extend code for building cloud infrastructure, and automate using CI/CD pipeline.
Partners with business and
peers in the pursuit of solutions that achieve business goals through
an agile software development methodology.
Perform problem analysis, data analysis, reporting, and communication.
Work with peers across the system to define and implement best practices and standards.
Assess applications and help determine the appropriate application infrastructure patterns.
Use best practices and knowledge of internal or external drivers to improve products or services.
What we are looking for:
Hands-on experience in building/implementing cloud platforms/applications on AWS platform.
Experience in developing data pipeline solutions to ingest and exploit new and existing data sources.
Expertise in leveraging SQL, programming language like Python and ETL tools like Databricks
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Expertise in AWS Compute (EC2, EMR), AWS Storage (S3, EBS), AWS Databases (RDS, DynamoDB), AWS Data Integration (Glue).
Advanced understanding of
Container Orchestration services including Docker and Kubernetes, and a
variety of AWS tools and services.
Good understanding of AWS Identify and Access management, AWS Networking and AWS Monitoring tools.
Proficiency in CI/CD and deployment automation using GITLAB pipeline.
Proficiency in Cloud infrastructure provisioning tools e.g., Terraform.
Proficiency in one or more programming languages e.g., Python, Scala.
Note: Interested candidates share your resume to lokesh one at galaxyitech dot com (or) Reach me Four Eight Zero Six Nine Six Five Three Nine Two.
Full Time
IT Outsourcing & Consulting
$130k-162k (estimate)
05/18/2024
05/21/2024
galaxyitech.com
SCOTTSDALE, AZ
50 - 100
2010
SUBBARAMA V K KOMMINE
<$5M
IT Outsourcing & Consulting
The following is the career advancement route for Senior Data Engineer positions, which can be used as a reference in future career path planning. As a Senior Data Engineer, it can be promoted into senior positions as a CAE Designer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Senior Data Engineer. You can explore the career advancement for a Senior Data Engineer below and select your interested title to get hiring information.
If you are interested in becoming a Senior Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Senior Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Senior Data Engineer job description and responsibilities
The Senior Data Engineer builds data processing frameworks that handle the business’s growing database.
03/09/2022: Billings, MT
The Senior Data Engineer owns and extends the business’s data pipeline through the collection, storage, processing, and transformation of large data-sets.
01/05/2022: Melbourne, FL
Create architecture for real-time, big data applications with minimal maintenance effort.
03/23/2022: Benton Harbor, MI
Work with both structured and unstructured data, with focus on ETL (Extract, Transfer, Load) and stabilizing pipelines and code.
01/22/2022: Greenville, MS
Provides successful deployment and provisioning of data solutions to production or other required environments.
01/12/2022: Dothan, AL
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Senior Data Engineer jobs
Apply for an entry-level data engineer role and gain experience.
02/06/2022: Providence, RI
Earn a bachelor’s degree related to data engineering and begin working on projects.
02/16/2022: Denver, CO
Consider pursuing additional professional engineering or big data certifications.
03/06/2022: Raleigh, NC
Gain knowledge with new data architecture principles and concepts, thorough understanding of layered systems architectures.
01/24/2022: Abilene, TX
Senior data engineers should also have an understanding of other programming languages that help with statistical analysis and modeling, such as Python.
01/02/2022: New York, NY
Step 3: View the best colleges and universities for Senior Data Engineer.