Demo

Entry Level AI Software Engineer

IBM
IBM Salary
Durham, NC Full Time
POSTED ON 12/29/2025
AVAILABLE BEFORE 2/9/2026
Introduction

At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems? If so, lets talk

Your Role And Responsibilities

The AI Center of Excellence is seeking a skilled AI Software Engineer to join our team. In this role, you will design, develop, and implement advanced AI solutions using IBM’s Watsonx platform and pretrained models like Granite. You will build scalable and secure applications on IBM Cloud, collaborating with Technical Account Managers, Solution Architects, UX/UI Designers, and other developers to deliver innovative, high-impact solutions.

  • Design, develop, and test AI applications and services.
  • Write clean, efficient, and well-documented code following best practices.
  • Follow security best practices in development to meet IBM’s policies and industry standards.
  • Communicate progress, challenges, and technical decisions effectively to both technical and non-technical stakeholders.
  • Participate in agile/scrum ceremonies, contributing to sprint planning, daily stand-ups, and retrospectives.
  • Collaborate with technical account managers, UX/UI designers, architects, and other stakeholders to integrate AI components seamlessly into the overall solution.
  • Stay updated on emerging trends in generative AI, IBM Cloud services, and relevant technologies.

Preferred Education

Bachelor's Degree

Required Technical And Professional Expertise

  • Experience as a full stack developer with a focus in AI
  • Understanding of backend technologies, including server-side languages (Node.js, Python,Java, etc.) and databases (Cassandra, PostgreSQL, etc.)
  • Experience in web technologies: HTTP, REST, JSON, HTML, Ajax, JavaScript etc.
  • Familiarity with AI/ML frameworks like PyTorch, Hugging Face, or OpenAI API
  • Basic understanding of LLM prompt engineering and retrieval-augmented generation (RAG) techniques
  • Experience with version control systems (Git) and CI/CD pipelines for efficient development workflows
  • Strong analytical and problem-solving abilities to address technical challenges effectively
  • Strong collaboration skills, having worked effectively with design and engineering teams
  • Effective verbal and written communication skills in English

Preferred Technical And Professional Experience

  • Hands on experience with the Watsonx product portfolio and IBM Cloud Infrastructure
  • Experience in deploying and fine-tuning models like Granite, Mistral, or Llama 3
  • Hands-on experience with containerization tools like Docker or Kubernetes
  • Understanding of the micro-services architecture and modern cloud programming practices
  • Experience in using messaging brokers like RabbitMQ, Kafka etc.
  • Operating Systems (such as Red Hat, Ubuntu, etc.)
  • Experience with build tools like Maven/Gradle
  • Experience with automated testing (JUnit, Selenium and/or Puppeteer)
  • Experience with agile development methodologies

Salary.com Estimation for Entry Level AI Software Engineer in Durham, NC
$102,370 to $128,162
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Entry Level AI Software Engineer?

Sign up to receive alerts about other jobs on the Entry Level AI Software Engineer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$72,538 - $87,299
Income Estimation: 
$88,790 - $110,816
Income Estimation: 
$73,727 - $94,067
Income Estimation: 
$88,984 - $115,784
Income Estimation: 
$92,017 - $124,111
Income Estimation: 
$90,707 - $120,959
Income Estimation: 
$91,486 - $118,193
Income Estimation: 
$92,017 - $124,111
Income Estimation: 
$111,369 - $141,168
Income Estimation: 
$117,871 - $153,580
Income Estimation: 
$109,939 - $144,341
Income Estimation: 
$114,500 - $144,633
Income Estimation: 
$144,503 - $184,592
Income Estimation: 
$150,756 - $194,140
Income Estimation: 
$172,191 - $221,861
Income Estimation: 
$114,549 - $164,025
Income Estimation: 
$153,752 - $200,235
Income Estimation: 
$117,871 - $153,580
Income Estimation: 
$131,745 - $167,716
Income Estimation: 
$144,503 - $184,592
Income Estimation: 
$102,541 - $137,871
Income Estimation: 
$153,752 - $200,235
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at IBM

  • IBM Washington, DC
  • Introduction Technology sales at IBM is evolving its way of working to break beyond boundaries with innovative approaches. Preferring to 'show' vs. 'tell',... more
  • 12 Days Ago

  • IBM Washington, DC
  • Introduction A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe. You'll work with vision... more
  • 12 Days Ago

  • IBM Washington, DC
  • Introduction A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe. You'll work with vision... more
  • 12 Days Ago

  • IBM Huntsville, AL
  • Introduction A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe. You'll work with vision... more
  • 12 Days Ago


Not the job you're looking for? Here are some other Entry Level AI Software Engineer jobs in the Durham, NC area that may be a better fit.

  • Lensa Durham, NC
  • Lensa is a career site that helps job seekers find great jobs in the US. We are not a staffing firm or agency. Lensa does not hire directly for these jobs,... more
  • 14 Days Ago

  • MetLife, Inc Cary, NC
  • Description and Requirements The Team You Will Join When you join MetLife’s US Technology team, you’ll be part of a forward-thinking group dedicated to sha... more
  • 23 Days Ago

AI Assistant is available now!

Feel free to start your new journey!