What are the responsibilities and job description for the Data Engineer position at Red Arch Solutions?
Position Detail:
As a Data Engineer/Integrator, your role entails collaborating closely with a team of developers to fulfill data integration requirements. This involves writing and maintaining code using an Extract-Transform-Load (ETL) platform to ensure data is transformed into suitable formats as defined by IC ITE initiatives. You will interface with external teams and systems, employing various protocols including HTML and SFTP to collect data efficiently. Additionally, your responsibilities include enhancing the ETL platform by adding features aimed at shortening timelines for future data integration efforts. Beyond coding tasks, you'll develop and maintain software, ensuring seamless integration into a fully functional system. Collaboration with external teams will be necessary to validate data ingest processes. Finally, you'll be responsible for providing comprehensive documentation covering system architecture, development, and any enhancements made throughout the process.
Education and Experience:
- 5 years of professional experience with a Bachelor's degree or equivalent
- 3 years of professional experience with a Master's degree or equivalent
- 10 years of professional experience
- Additional experience will be considered in lieu of a degree
Required Quals:
- Active TS/SCI with with CI Polygraph
- Specialization using the Databricks platform for building, deploying, and managing data and AI solutions
- Experience building ETL pipelines, managing data pipelines, and working with large datasets using tools like Spark, Python, and SQL
- Experience with technologies like Delta Lake, Delta Live Tables, and Databricks Workflows
Desired Quals:
- Experience collaborating with data scientists
- Familiarity with Advana
- Strong Python programming skills
- Solid SQL knowledge for querying and data manipulation
- Cloud platform experience, such as AWS, Azure, etc
Work Location:
Elkridge, MD
Salary range for this position $98,000-$193,000 #CJ
The Red Arch Solutions pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Determination of official compensation or salary relies on several factors including, but not limited to, level of position, job responsibilities, geographic location, scope of relevant work experience, educational background, certifications, contract-specific affordability, organizational requirements, alignment with local internal equity as well as alignment with market data.
Red Arch Solutions Benefits Snapshot:
- 100% paid employee healthcare premiums. CareFirst Advantage Best in Class Benefits.
- HaloScripts Concierge prescription medication service
- Generous PTO.
- 10 % 401K 6% match vested day one and up to 4% profit sharing contribution.
- Annualized bonus compensation.
- Spot bonuses for hard work.
- Tuition reimbursement.
- 529 College Saving Plan.
- College Loan Pay Back Program.
- 11 Paid Federal Holidays
- Generous Referral Bonuses.
Red Arch Solutions provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.
Have more questions about Red Arch? Email us at Careers@RedArchSolutions.com
Salary : $98,000 - $193,000
