25 Horizontal Talent Jobs near me
Horizontal Talent is Hiring a Senior Data Engineer Near Woodbury, MN
Job Details
- Architect and refine our Databricks-centric data platform, emphasizing scalable integrations and advanced entity resolution strategies.
- Lead the charge towards a data mesh infrastructure, promoting domain-centric design and decentralized data management.
- Enhance our DataOps capabilities, emphasizing data observability, discovery, and lineage to maintain data integrity and accuracy.
- Pioneer the adoption of Databricks data lakehouse architectures, focused on simplifying data management and enhancing data processing capabilities.
- Serve as a technical liaison among analytics engineers, BI developers, and analysts within the Databricks environment, integrating solutions like Segment.io.
- Develop and optimize SQL and Python/Scala scripts within Databricks for complex data transformation and integration tasks.
- Work closely with cross-functional teams to align data strategies with operational needs and objectives, incorporating advanced data resolution methodologies.
- Stay at the forefront of industry trends and technological advancements to ensure our Databricks platform remains innovative and effective.
- Bachelor's
- Strong leadership skills and the ability to advocate for best practices in data management and processing.
- 5 years of experience in a data engineering role, with history of implementing data platform modernization
- 2 years of hands on databricks experience.
- In-depth understanding of Databricks, along with experience in other cloud data warehouses like Snowflake, Redshift, Big Query.
- Building data integration and orchestration within the databricks environment, with hands-on experience in technologies such as Delta Live Tables, CDC, dbt, airflow, Segment.io.
- Advanced skills in SQL, Python, and Scala, with an emphasis on their application within Databricks for complex data tasks.
- Knowledge of best practices in version control and CI/CD with Git and GitHub Actions; Agile project management with Jira and Confluence.
- Proficiency with the Azure data suite (Azure SQL, Data Factory, Synapse Analytics, Power BI).
- Solid understanding of data observability, discovery, and lineage, and their application in maintaining high data quality standards.
- Additional experience with AI and ML capabilities in the context of Databricks is a plus.
In addition, Horizontal will provide reasonable accommodations for qualified individuals with disabilities. If you need to request a reasonable accommodation in order to complete the application or interview process, please contact us. All applicants applying must be legally authorized to work in the country of employment.
PandoLogic. Keywords: Data Engineer, Location: WOODBURY, MN - 55129
Job Summary
Full Time
$105k-133k (estimate)
04/29/2024
06/28/2024
horizontaltalent.com
MN
<25
Related Companies
The job skills required for Senior Data Engineer include Leadership, etc. Having related job skills and expertise will give you an advantage when applying to be a Senior Data Engineer. That makes you unique and can impact how much salary you can get paid. Below are job openings related to skills required by Senior Data Engineer. Select any job title you are interested in and start to search job requirements.
The following is the career advancement route for Senior Data Engineer positions, which can be used as a reference in future career path planning. As a Senior Data Engineer, it can be promoted into senior positions as a CAE Designer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Senior Data Engineer. You can explore the career advancement for a Senior Data Engineer below and select your interested title to get hiring information.
If you are interested in becoming a Senior Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Senior Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Senior Data Engineer job description and responsibilities
The Senior Data Engineer builds data processing frameworks that handle the business’s growing database.
03/09/2022: Billings, MT
The Senior Data Engineer owns and extends the business’s data pipeline through the collection, storage, processing, and transformation of large data-sets.
01/05/2022: Melbourne, FL
Create architecture for real-time, big data applications with minimal maintenance effort.
03/23/2022: Benton Harbor, MI
Work with both structured and unstructured data, with focus on ETL (Extract, Transfer, Load) and stabilizing pipelines and code.
01/22/2022: Greenville, MS
Provides successful deployment and provisioning of data solutions to production or other required environments.
01/12/2022: Dothan, AL
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Senior Data Engineer jobs
Apply for an entry-level data engineer role and gain experience.
02/06/2022: Providence, RI
Earn a bachelor’s degree related to data engineering and begin working on projects.
02/16/2022: Denver, CO
Consider pursuing additional professional engineering or big data certifications.
03/06/2022: Raleigh, NC
Gain knowledge with new data architecture principles and concepts, thorough understanding of layered systems architectures.
01/24/2022: Abilene, TX
Senior data engineers should also have an understanding of other programming languages that help with statistical analysis and modeling, such as Python.
01/02/2022: New York, NY
Step 3: View the best colleges and universities for Senior Data Engineer.
Similar Jobs
Popular Articles
