What are the responsibilities and job description for the Data Engineer position at Luxoft?
Project description
Luxoft is looking for a Senior Data Engineer for development of new application to be used by investors and investment committees to review their portfolio data, tailored to specific user groups.
Responsibilities
- Work with complex data structures and provide innovative ways to a solution for complex data delivery requirements
- Evaluate new and alternative data sources and new integration techniques
- Contribute to data models and designs for the data warehouse
- Establish standards for documentation and ensure your team adheres to those standards
- Influence and develop a thorough understanding of standards and best practices used by your team
Skills
Must have
- Seasoned data engineer who has hands-on experience in AWS to conduct end-to-end data analysis and data pipeline build-out using Python, Glue, S3, Airflow, DBT, Redshift, RDS, etc.
- Extensive Python API design experience, preferably Fast API
- Strong SQL knowledge
Nice to have
- Pyspark
- Databricks
- ETL design