What are the responsibilities and job description for the Senior Data Engineer position at Aplomb Technologies?
Overview
Join our innovative team as a Senior Data Engineer and become a driving force behind our data-driven decision-making. In this dynamic role, you will design, develop, and optimize scalable data pipelines and architectures that empower our organization to harness the full potential of big data. Your expertise will enable seamless integration of diverse data sources, ensuring high-quality, reliable data for advanced analytics and business insights. If you thrive in a fast-paced environment and are passionate about transforming complex data into actionable intelligence, this is the opportunity for you!
Duties
- Design, build, and maintain robust data pipelines using ETL (Extract, Transform, Load) processes to facilitate efficient data flow across systems.
- Develop and optimize large-scale data architectures leveraging cloud platforms such as AWS and Azure Data Lake to support enterprise analytics initiatives.
- Collaborate with cross-functional teams to gather requirements and translate them into scalable data solutions utilizing tools like Hadoop, Spark, Apache Hive, and Informatica.
- Implement database design best practices for data warehouses using Microsoft SQL Server, Oracle, and other relational databases to ensure data integrity and performance.
- Develop RESTful APIs for seamless data access and integration with external applications or services.
- Conduct model training and analysis to support advanced analytics projects, ensuring insights are actionable and impactful.
- Write efficient scripts in Python, Bash (Unix shell), Shell Scripting, and VBA to automate workflows and streamline processes.
- Participate actively in Agile development cycles to deliver iterative improvements rapidly while maintaining high standards of quality.
- Collaborate on database design enhancements and ensure compliance with best practices for linked data management.
Skills
- Extensive experience with cloud platforms such as AWS and Azure Data Lake for scalable storage solutions.
- Strong proficiency in programming languages including Java, Python, VBA, Bash (Unix shell), and Shell Scripting.
- Deep understanding of big data technologies like Hadoop, Spark, Apache Hive, and related ecosystems.
- Proven expertise in ETL tools such as Talend and Informatica for efficient data processing workflows.
- Skilled in SQL development across multiple database systems including Microsoft SQL Server, Oracle, and Data Warehouse environments.
- Familiarity with analytics tools like Looker for creating insightful dashboards and reports.
- Knowledge of linked data principles to connect disparate datasets effectively.
- Experience with Model training techniques for predictive analytics applications.
- Strong analysis skills combined with a solid understanding of database design principles to optimize performance.
- Ability to work within Agile teams to deliver continuous improvements in a fast-paced setting.
Embark on a journey where your technical expertise fuels innovative solutions! We’re dedicated to fostering an environment where talented professionals thrive—empowering you to make a real impact through cutting-edge data engineering practices!
Pay: From $50.00 per hour
Benefits:
- 401(k)
Work Location: In person
Salary : $50