You haven't searched anything yet.
Responsibilities:
As a Scala Developer, the candidate will be responsible for developing and implementing scalable data processing solutions using Apache Spark. The ideal candidate should have experience in both batch and real-time data processing, along with a strong background in technologies such as Databricks, Snowflake, Kafka, SQL and Unix. The candidate will work closely with our data engineering and data science teams to design and optimize data pipelines and ensure efficient and reliable data processing. Develop and execute data pipeline testing processes and validate business rules and policies. Ability to design & build real-time applications using Apache Kafka & Spark Streaming. Ability to build abstracted, modularized reusable code components. Collaborating with cross-functional teams to integrate Scala solutions with other systems and technologies. Collaborating with data engineering and data science teams to understand data requirements and design optimal data pipelines. Writing efficient Scala jobs and optimizing Spark code for performance and scalability. Developing and optimizing SQL queries for data extraction, transformation, and loading. Produce unit tests for Scala transformations and helper methods. Ensuring data quality and integrity throughout the data processing pipelines. Monitoring and troubleshooting data processing issues and implementing necessary fixes. Keeping up-to-date with the latest advancements in Scala and big data technologiesFull Time
IT Outsourcing & Consulting
$100k-126k (estimate)
07/13/2023
05/15/2024
itidata.com
NEW YORK, NY
200 - 500
1999
BRIAN VASKE
$10M - $50M
IT Outsourcing & Consulting
ITI Data (formerly Incandescent Technologies, Inc.) is an industry-leading information and big data management solutions firm with business-driven technology designed for the worlds largest banks, financial services, healthcare and telecommunications companies. Headquartered in One World Trade Center at the heart of New York Citys Financial District, ITI has over 400 employees across 11 branch and satellite offices in key international financial services markets including London, Paris, Singapore, Sydney, Melbourne, and Mexico City. Founded in 1999, ITI opened its first office in Chicago with ...a small team delivering groundbreaking, high-performance solutions in credit risk and marketing for FICO, the firms initial cornerstone client. Through client referrals, we then acquired Fortune 100 clients such as Citibank, JPMorgan Chase and Wells Fargo. This organic business growth is a true testament of the reliability, quality work and hands-on experience that ITI delivers to date. We have sustained a proven track record of delivering enterprise business solutions to clients, facing the largest data volumes and the most complex data management requirements. With a broad range of business, operations and technology experience, ITI has been successful at enabling our clients to improve business process efficiency, manage and consolidate enterprise information, and exceed the ROI of their operations and technology initiatives. Our performance has resulted in trusted relationships, with ongoing services to our longest-standing client of over 15 years.
More
Show less
The following is the career advancement route for Scala Developer positions, which can be used as a reference in future career path planning. As a Scala Developer, it can be promoted into senior positions as an E-commerce Site Development Manager that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Scala Developer. You can explore the career advancement for a Scala Developer below and select your interested title to get hiring information.