Azure Data Engineer at a Major Japanese Bank

SUMMARY:
The Data Engineer designs, develops, and collaborates with a team of Azure Databricks and Actimize specialists, partnering with external vendors to deliver compliance and surveillance solutions. This role is critical to maintaining and enhancing the bank’s fraud detection and prevention platform, ensuring adherence to risk management, legal, and regulatory obligations.



You will combine deep technical expertise in data engineering with strong development skills to customize and optimize the Databricks platform. You will build scalable data pipelines, implement workflows, write custom rules and logic, and troubleshoot complex issues. You will work closely with business units and technical teams to deliver enhancements, perform upgrades, and provide on-call production support in a highly transactional environment.

PRINCIPAL DUTIES & RESPONSIBILITIES:
Design and develop code and configurations for Azure Databricks and Actimize applications, ensuring alignment with business and technical requirements.
Build and optimize data integration pipelines for ingestion, transformation, and storage using Databricks and Azure Data Lake.
Conduct detailed analysis of requirements, incidents, and process flows; prepare clear technical documentation for development and implementation.
Troubleshoot and resolve issues across environments, performing root cause analysis to improve reliability and prevent recurrence.
Deliver timely, high-quality solutions and production support to maintain compliance and customer satisfaction.
Communicate effectively with business users, support teams, vendors, and stakeholders to ensure transparency throughout the project lifecycle.
Manage multiple projects and tasks simultaneously, balancing priorities in a fast-paced environment.
Develop and execute unit and integration test cases to validate changes and releases.
Coordinate and perform system upgrades in collaboration with end users and technical teams.
Act as an escalation point for complex production issues, ensuring minimal business impact.
Participate in system implementations and go-lives, including occasional evening or weekend support for deployments.
Collaborate with cross-functional teams to resolve high-priority incidents and contribute to post-implementation reviews and continuous improvement efforts.
JOB SPECIFICATIONS:
5 years of experience implementing enterprise technologies or vendor platforms.

Bachelor’s degree in Computer Science or related field preferred.

Core Technologies: Azure Databricks, Azure Data Lake, Python, Power BI, Power Apps, SQL Server, Oracle/PL-SQL, SQL stored procedures, Actimize (preferred)

Proven experience in IT development, system design, integration, and data analysis across complex environments.

Strong understanding of relational and SQL database platforms, with proficiency in Oracle or similar technologies.

Familiarity with surveillance and corporate compliance systems.

Ability to manage and prioritize multiple tasks independently in a dynamic environment.

Strong analytical and problem-solving skills with a focus on innovation and efficiency.