What are the responsibilities and job description for the AWS, Databricks and Spark Technology Architect position at Avance Consulting?
AWS, Databricks, and Spark Technology Architect
Plano Texas
Fulltime
Required Qualifications:
- At least 7 years of Information Technology experience.
- At least 6 years of hands-on experience in architecting solutions on AWS, Databricks, Spark and Object Store.
- Good experience in end-to-end implementation of data warehouse and data marts.
- Strong understanding of Data Warehousing concepts of Data Vault, Dimensional modelling, OLAP design.
- Experience and detailed knowledge with Master Data Management, ETL, Data Quality, metadata management, data profiling, micro-batches, streaming data loads.
- Extensive experience with CI/CD platforms such as GitLab CI, GitHub Actions, AWS CodeBuild, Azure Pipelines, and Jenkins.
- Experience designing and implementing complex solutions for distributed systems.
- Experience in leading and mentoring teams.
- Candidates authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time
Preferred Qualifications:
- Good understanding of data integration, data quality and data architecture
- Experience in Relational Modeling, Dimensional Modeling and Modeling of Unstructured Data
- Strong knowledge and hands-on experience in SQL, Unix shell scripting
- Skilled in scripting languages including Python, Bash, and PowerShell
- Familiarity with log and monitoring solutions
- Experience in utilizing development containers, unit testing/code quality review/linting - standard best practice
- Good understanding of Agile software development frameworks
- Strong communication and Analytical skills
- Ability to work in teams in a diverse, multi-stakeholder environment comprising of Business and Technology teams
- Experience and desire to work in a global delivery environment