You haven't searched anything yet.
Role : Data Engineer
Position : Fulltime (Onsite) / No C2C & W2
Location : Dallas, TX / Tampa, FL
Skill : Python
Job Description:
Technical/Functional Skills
Frameworks: Spark, PySpark, Python, Apache Airflow and Cassandra, Sprint Boot Micro Services, Apache Camel, Angular 6 UI Framework
DB: Postgres DB, Oracle
DevOps: GITLAB, Jenkins, Maven, Confluence, Jfrog Artifactory, SONARQUBE, JIRA
Experience Required
Must have strong experience in Spark, PySpark, Python, Apache Airflow and Cassandra.
Must have strong experience in Apache Flink, Python, Apache Kafka and Cassandra
.
Build near real time data pipeline with Apache Spark, Pyspark & Python to extract data from NoSQL DBs and Load it into Cassandra Data Enterprise Graph
Build real time data pipeline with Apache Flink, Apache Kafka and Python to extract data from Relational and NoSQL DBs and Load it into Cassandra Data Enterprise Graph
Roles & Responsibilities
o Ability to translate application storyboards and use cases into functional applications
o Build near real time data pipeline with Apache Spark, Pyspark & Python to extract data from NoSQL DBs and Load it into Cassandra Data Enterprise Graph
o Build real time data pipeline with Apache Flink, Apache Kafka and Python to extract data from Relational and NoSQL DBs and Load it into Cassandra Data Enterprise Graph
o Design, build, and maintain efficient, reusable, and reliable Java code
o Ensure the best possible performance, quality, and responsiveness of the applications
o Help maintain code quality, organization, and automatization
o Strong debugging, problem solving and investigative skills. Ability to assimilate disparate information (log files, error messages etc.) and pursue leads to find root cause of problems
o Experience in Agile/Scrum methodology
o Proven ability to create innovative solutions.
o Strong agile/scrum development experience
o Expertise developing web applications and APIs using Micro Services, with demonstrable production-scale experience.
o Web applications development using Java, HTML5, CSS3, JavaScript, jQuery, Angular JS, Spring Boot.
o Skilled n Version control tools e.g., GIT, SVN, etc. to maintain common source Create testing and validation scripts for the features developed.
o Develop the Automation Script for end-to-end verifications
o Create, enhance, debug and execute the Test cases
o Writing unit / Integration tests using JUnit / Mockito for code coverage as per the standards and Log4j 2 for logging.
o Expert in database scripts, stored procedures, functions, triggers etc
Harish
480-992-990
Full Time
IT Outsourcing & Consulting
$100k-123k (estimate)
03/19/2023
04/08/2024
galaxyitech.com
SCOTTSDALE, AZ
50 - 100
2010
SUBBARAMA V K KOMMINE
<$5M
IT Outsourcing & Consulting
The job skills required for Data Engineer include SQL, AWS, Azure, Data Modeling, Data Warehousing, Presentation, etc. Having related job skills and expertise will give you an advantage when applying to be a Data Engineer. That makes you unique and can impact how much salary you can get paid. Below are job openings related to skills required by Data Engineer. Select any job title you are interested in and start to search job requirements.
The following is the career advancement route for Data Engineer positions, which can be used as a reference in future career path planning. As a Data Engineer, it can be promoted into senior positions as a Database Engineer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Data Engineer. You can explore the career advancement for a Data Engineer below and select your interested title to get hiring information.
If you are interested in becoming a Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Data Engineer job description and responsibilities
The data engineer develops and maintains the enterprise data framework for continued use.
03/12/2022: Dothan, AL
A data engineer prepares data for analytical or operational uses.
03/03/2022: Boulder, CO
Data engineers simplify complex data structure and prevent the reduplication of data.
03/28/2022: New Suffolk, NY
Data Engineers are the technical professionals who prepare data that can be used by data scientists for valuable decisions and strategies.
04/13/2022: Harrisburg, PA
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Data Engineer jobs
Changing oil, running basic checks, topping off fluids and checking tire pressure are common job duties.
01/22/2022: Fort Wayne, IN
Oil changes are an essential component of preventative maintenance.
02/26/2022: Newark, NJ
A data engineer should be aligned with a data scientist’s needs while creating a data system.
04/10/2022: Fayetteville, NC
Start with an entry-level position.
02/10/2022: Winston Salem, NC
Consider pursuing additional professional engineering or big data certifications.
03/09/2022: Saginaw, MI
Step 3: View the best colleges and universities for Data Engineer.