What are the responsibilities and job description for the Senior Data Engineer position at Aita Consulting Services,Inc.?
Fulltime Position
4 Days/Week Onsite
Key Responsibilities:
- Create and maintain Data Platform pipelines
- Create Conceptual, Logical, and Physical data models
- Design table structures using DBT and define data pipelines to build performant, reliable, and scalable data solutions in a fast-growing data ecosystem.
- Collaborate with other data engineers, data scientists, and cross-functional teams.
- Fluency with data engineering concepts and platforms (AWS: S3, Lambda, SNS, SQS...; Iceberg), data platforms (Snowflake), governance (data contracts), transformation and orchestration (dbt, Airflow).
- Be an active participant and advocate of agile/scrum ceremonies to collaborate and improve processes for our team
- Collaborate with product managers, architects, and other engineers to drive the success of the Core Data Platform
- Document standards and best practices for pipeline configurations, naming conventions, etc.
- Engage with and understand our customers, forming relationships that allow us to understand and prioritize both innovative new offerings and incremental technology improvements
- Maintain detailed documentation of your work and changes to support data quality and data governance requirements
Qualifications:
- 9 - 13 years of data engineering experience developing data pipelines.
- Strong understanding of data modeling principles, including Dimensional modeling and data normalization principles.
- Proficiency in at least one major programming language (e.g., Python).
- Expert SQL skills and ability to create queries to analyze complex datasets.
- Hands-on production experience with data pipeline orchestration systems such as Airflow for creating and maintaining data pipelines.
- Experience with Snowflake.
- Strong algorithmic problem-solving expertise.
- Comfortable working in a fast-paced and highly collaborative environment.
- Excellent written and verbal communication.
- Advance understanding of OLTP vs OLAP environments.
- Willingness and ability to learn and pick up new skill sets.
- Self-starting problem solver with an eye for detail and excellent analytical and communication skills.
- Familiar with Scrum and Agile methodologies.
- Bachelor’s degree in computer science, Information Systems, or equivalent industry experience.