You haven't searched anything yet.
Job Title: Data Engineer
Location: Newport Beach, CA
Duration: FTE
Job Description:
Are you someone looking for a challenge to work in a startup environment and innovate in a global environment to help build a SaaS Service to scale? Are you willing to roll up your sleeves and do what it takes to deliver value to Customers?
As we expand our Engineering, we are looking for a Sr. Data Engineer to join us and help build robust data pipelines that is an integral part of our SaaS platform
The role would offer an opportunity to work with cross functional teams in developing and evolving Cloud services powering innovative technology solutions used in the real estate industry.
We are seeking a skilled and experienced Data Engineer to join our dynamic team. The Data Engineer will be responsible for designing, implementing, and maintaining our data infrastructure, pipelines, and systems. This role involves collaborating with cross-functional teams to ensure efficient data flow, data quality, and optimal performance. The ideal candidate should have a strong background in software engineering, database management, and data architecture, along with proficiency in relevant technologies and tools.
Responsibilities:
Lead the design and implementation of robust data pipelines for efficient extraction, transformation, and loading (ETL) of large datasets from diverse sources.
Collaborate with stakeholders to understand business requirements, translating them into scalable data solutions tailored to end-user needs.
Enhance and maintain our data architecture, ensuring scalability, reliability, and performance.
Investigate and resolve data anomalies within ETL pipelines, ensuring data integrity and accuracy.
Develop and maintain documentation for data processes, ensuring clarity and sustainability.
Utilize AWS platform capabilities to architect and operate scalable production solutions.
Implement data security practices and compliance measures to protect sensitive information.
Build and manage data warehouses and data lakes to store and organize large datasets.
Implement data quality checks and procedures to ensure data accuracy and consistency.
Automate data workflows and processes using scripting languages and data pipeline orchestration tools.
Collaborate with business analysts, onboarding teams, and business stakeholders to understand data needs and translate them into technical solutions.
Monitor and troubleshoot data pipelines, identify bottlenecks, and optimize performance of data infrastructure to ensure scalability and efficiency.
Troubleshoot issues with production data and/or inconsistencies and propose sustainable solutions to address them
Document data pipelines and processes for maintainability and knowledge sharing.
Stay updated with emerging technologies and best practices in data engineering, and propose innovative solutions.
Document system architectures, processes, and procedures for knowledge sharing and future reference.
Provide technical guidance and support to junior team members, and contribute to their professional development
Skills and Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent experience).
- A minimum of 5 years of experience as a Data Engineer or similar role.
- Strong proficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL).
- Experience with cloud-based data platforms (e.g., AWS, Azure, Google Cloud Platform).
- Experience with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
- Experience with data ingestion tools (e.g., Fivetran, Stitch, Kafka).
- Programming experience in Python, Java, or similar languages.
- Experience with scripting languages (e.g., Bash, Shell).
- Experience with data workflow management tools (e.g., Airflow, Luigi).
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
- Ability to work independently and as part of a team.
At KAYGEN, we are always looking for dynamic, talented and experienced individuals. We invite you to join our team of talented IT professionals, consulting at client locations across the globe. Our culture is team-orientated; we strive to stand by our core values of respect, honesty and integrity. Our team of experienced staffing experts will work with you to find you the best opportunity. For more information please visit us at Benefits:
Full Time
$126k-155k (estimate)
04/28/2024
06/27/2024
kaygentalent.com
Irvine, PA
25 - 50
The job skills required for Data Engineer include SQL, Python, Data Engineering, AWS, Data Warehouse, Computer Science, etc. Having related job skills and expertise will give you an advantage when applying to be a Data Engineer. That makes you unique and can impact how much salary you can get paid. Below are job openings related to skills required by Data Engineer. Select any job title you are interested in and start to search job requirements.
The following is the career advancement route for Data Engineer positions, which can be used as a reference in future career path planning. As a Data Engineer, it can be promoted into senior positions as a Database Engineer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Data Engineer. You can explore the career advancement for a Data Engineer below and select your interested title to get hiring information.
If you are interested in becoming a Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Data Engineer job description and responsibilities
The data engineer develops and maintains the enterprise data framework for continued use.
03/12/2022: Dothan, AL
A data engineer prepares data for analytical or operational uses.
03/03/2022: Boulder, CO
Data engineers simplify complex data structure and prevent the reduplication of data.
03/28/2022: New Suffolk, NY
Data Engineers are the technical professionals who prepare data that can be used by data scientists for valuable decisions and strategies.
04/13/2022: Harrisburg, PA
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Data Engineer jobs
Changing oil, running basic checks, topping off fluids and checking tire pressure are common job duties.
01/22/2022: Fort Wayne, IN
Oil changes are an essential component of preventative maintenance.
02/26/2022: Newark, NJ
A data engineer should be aligned with a data scientist’s needs while creating a data system.
04/10/2022: Fayetteville, NC
Start with an entry-level position.
02/10/2022: Winston Salem, NC
Consider pursuing additional professional engineering or big data certifications.
03/09/2022: Saginaw, MI
Step 3: View the best colleges and universities for Data Engineer.