Real-Time Data Engineer II

Description

What were looking for:As a member of the Data Platform Engineering team, the Real-Time Data Engineer II will work collaboratively to develop an infrastructure that ingests data from disparate sources, processes them real-time and routes them to various target storages and applications, while providing access to high quality data to users, ranging from application developers interested in specific events to data analysts keen on business intelligence to data scientists training ML models.At AppFolio, we paddle as one. We ride and make waves together, with a relentless focus on building great products for the way our customers work and live today and tomorrow. AppFolio is a destination organization where careers are made and accelerated. Here, innovation is a team sport.Your impact:

• Design, build and operate on next generation data pipeline infrastructure based on Apache Kafka and its ecosystem
• Improve data architecture, quality, discoverability and access policies to enable and enforce data governance
• Collaborate with engineers, data analysts and scientists to ensure that our data infrastructure meets the SLOs of our data-intensive customers
• Develop techniques for monitoring the completeness, correctness and reliability of our data sets
• Leverage agile practices, encourage collaboration, prioritization, and urgency to develop at a rapid pace
• Research, share, and recommend new technologies and trends
  
  

Qualifications

• You have hands-on experience with using Apache Kafka in production and have a passion for building a reliable, scalable and fault-tolerant infrastructure.
• You have industry experience with working with real time transformation technologies such as Apache Flink
• You have worked with a variety of data sources, including change data capture systems, data streaming and event sourcing in production.
• You have hands-on experience with data warehouse technology, particularly with Snowflake.
• You embrace the platform-first approach to build standard solutions and self-serve capabilities for engineering teams
• You want to work with a high degree of autonomy, while at the same time working on initiatives of high importance to the company.
• You care about work-life balance and want your company to care about it too; you'll put in the extra hour when needed but won't let it become a habit.
  
  

Must have

• 3 years of experience with Apache Kafka, Kafka Connect and its ecosystem
• 2 years of experience in streaming processing technologies, such as Apache Flink
• 2 years of experience with AWS primitives (IAM, VPC, S3, MSK, EKS, etc.)
• 3 years of experience working with programming languages like Python or Ruby
• Excellent SQL skills with working knowledge of query optimization
• 2 years of experience working with Infrastructure as Code, configuration management, and monitoring tools.
• Bachelors in Computer Science or other quantitative fields.
  
  

Nice to have

• Experience with Debezium connectors
• Experience with large scale Data Lakes and Lake Houses, especially with Apache Iceberg is a plus
• Experience with distributed SQL query engines, such as Trino is a plus
• Experience with containers and container orchestration tools. Docker and Kubernetes experience is desirable.
• Data science skills for analyzing data and communicating with ML engineers are a plus.
  
  

Compensation & BenefitsThe base salary/hourly wage that we reasonably expect to pay for this role is: $104,000 to $130,000.The actual base salary/hourly wage for this role will be determined by a variety of factors, including but not limited to: the candidates skills, education, experience, etc.Please note that base pay is one important aspect of a compelling Total Rewards package. The base pay range indicated here does not include any additional benefits or bonuses that you may be eligible for based on your role and/or employment type.Regular full-time employees are eligible for benefits - .

About AppFolio

AppFolio is the technology leader powering the future of the real estate industry. Our innovative platform and trusted partnership enable our customers to connect communities, increase operational efficiency, and grow their business. For more information about AppFolio, visit appfolio.com.

Why AppFolio

Grow | We enable a culture of high performance, where delivering results is recognized by opportunities for growth and compelling total rewards. Our challenging and meaningful work drive the growth of our business, and ourselves.

Learn | We partner with you to realize your potential by investing in you from the start. We're cultivating a team of big thinkers through coaching and mentorship with our best-in-class leaders, and giving you the time and tools to develop your skills.

Impact | We are creating a world where living in, investing in, managing, and supporting communities feels magical and effortless, freeing people to thrive. We do this by innovating with purpose while cultivating a culture of impact. We learn as much from each other as we do our customers and our communities.

Connect | We excel at hybrid work by fostering an environment that feels flexible, personal and connected, no matter where we are. We create space to fuel innovation and collaboration, and we come together to celebrate, connect, and succeed.

Paddle as One.