3 senior lead data engineer Jobs in providence, ri
Noblesoft Technologies Inc. is Hiring a Data Engineer Near Providence, RI
Location: Providence, Rhode Island/ Remote
Mandatory Skills Gen AI, Data Engineering, ETL Jobs, Snowflake, Azure Cloud
Job Description
- Design, develop, and maintain scalable data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data.
- Implement efficient data processing workflows to support the training and evaluation of solutions using large language models, ensuring reliability, scalability, and performance.
- Addressing issues related to data quality, pipeline failures, or resource contention, ensuring minimal disruption to systems.
- Integrate Large Language Model into data pipeline for natural language processing tasks.
- Working with Snowflake ecosystem
- Deploying, scaling, and monitoring AI solutions on cloud platforms like Snowflake, Azure, AWS, GCP
- Communicating technical and non-technical stakeholders and collaborate with cross-functional teams.
- Cloud cost management and best practices to optimize cloud resource usage and minimize costs.
- Experience working within the Azure ecosystem, including Azure AI Search, Azure Storage Blob, Azure Postgres and understanding how to leverage them for data processing, storage, and analytics tasks.
- Experience with techniques such as data normalization, feature engineering, and data augmentation.
- Ability to preprocess and clean large datasets efficiently using Azure Tools /Python and other data manipulation tools.
- Expertise in working with healthcare data standards (ex. HIPAA and FHIR), sensitive data and data masking techniques to mask personally identifiable information (PII) and protected health information (PHI) is essential.
- In-depth knowledge of search algorithms, indexing techniques, and retrieval models for effective information retrieval tasks. Familiarity with search platforms like Elasticsearch or Azure AI Search is a must.
- Familiarity with chunking techniques and working with vectors and vector databases like Pinecone.
- Experience working within the snowflake ecosystem.
- Be able to implement efficient data processing workflows to support the training and evaluation of solutions using large language models, ensuring reliability, scalability, and performance.
- Ability to proactively identify and address issues related to data quality, pipeline failures, or resource contention, ensuring minimal disruption to systems.
RESUME@NOBLESOFT.COM :: Phone (972) 845 8400
USA :: México :: India :: UK
www.noblesoft.com :: Fax : (972) 845 8053
Inc500 :: Fastest Growing 500 Private Companies in USA
Follow us on Linkedin
Job Summary
Contractor
$120k-148k (estimate)
06/02/2024
11/24/2024
noblesoft.com
Irving, TX
<25
Related Companies
The job skills required for Data Engineer include Python, Data Engineering, AWS, Azure, Data Quality, Data Processing, etc. Having related job skills and expertise will give you an advantage when applying to be a Data Engineer. That makes you unique and can impact how much salary you can get paid. Below are job openings related to skills required by Data Engineer. Select any job title you are interested in and start to search job requirements.
The following is the career advancement route for Data Engineer positions, which can be used as a reference in future career path planning. As a Data Engineer, it can be promoted into senior positions as a Database Engineer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Data Engineer. You can explore the career advancement for a Data Engineer below and select your interested title to get hiring information.
If you are interested in becoming a Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Data Engineer job description and responsibilities
The data engineer develops and maintains the enterprise data framework for continued use.
03/12/2022: Dothan, AL
A data engineer prepares data for analytical or operational uses.
03/03/2022: Boulder, CO
Data engineers simplify complex data structure and prevent the reduplication of data.
03/28/2022: New Suffolk, NY
Data Engineers are the technical professionals who prepare data that can be used by data scientists for valuable decisions and strategies.
04/13/2022: Harrisburg, PA
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Data Engineer jobs
Changing oil, running basic checks, topping off fluids and checking tire pressure are common job duties.
01/22/2022: Fort Wayne, IN
Oil changes are an essential component of preventative maintenance.
02/26/2022: Newark, NJ
A data engineer should be aligned with a data scientist’s needs while creating a data system.
04/10/2022: Fayetteville, NC
Start with an entry-level position.
02/10/2022: Winston Salem, NC
Consider pursuing additional professional engineering or big data certifications.
03/09/2022: Saginaw, MI
Step 3: View the best colleges and universities for Data Engineer.
Similar Jobs
Popular Articles
