Demo

Principal Software Developer

Octave
Madison, AL Full Time
POSTED ON 5/30/2026
AVAILABLE BEFORE 7/3/2026
Job Location (Short): Houston, Texas-USA | Madison, Alabama-USA

Workplace Type: Remote

Req Id: 2909

Responsibilities

Position Overview

We are seeking a motivated AI/ML Engineer to build reliable, scalable systems and Generative AI and Agentic AI features, and build and deploy data-driven solutions for our document-based compliance management platform. This role requires a technical expert who can develop, deploy, and maintain ML systems in production environments.

Key Responsibilities

  • Build and deploy Generative AI features using foundation models (AWS Bedrock, OpenAI, Anthropic Claude) and inference pipelines with optimization of latency and cost
  • Design agentic AI systems that autonomously handle compliance workflows, document review, regulatory mapping, and multi-step reasoning tasks
  • Integrate comprehensive LLM evaluation frameworks with development and production systems
  • Build and operate end-to-end MLOps pipelines, deployment systems, monitoring, and rollbacks workflows
  • Implement explainability frameworks (SHAP/LIME) and monitoring dashboards ensuring transparency and regulatory adherence
  • Collaborate with cross-functional teams to translate business needs into ML solutions and communicate insights to stakeholders

Education / Qualifications

Technical Skills

  • Python (5 years): Production-level experience with Pandas, NumPy, scikit-learn, XGBoost, TensorFlow/PyTorch, Hugging Face Transformers, FastAPI/Flask, MLflow, and pytest
  • SQL: Advanced proficiency with complex queries, window functions, and optimization
  • Machine Learning & NLP: Strong foundation in supervised/unsupervised learning, deep learning, document understanding, text classification, and semantic analysis
  • Generative AI & LLMs: Hands-on experience with foundation models (GPT, Claude, Llama), prompt engineering, RAG architectures, and vector databases (Pinecone, Weaviate, Chroma)
  • MLOps & ModelOps: End-to-end experience with ML pipelines, model versioning, feature stores, drift detection, CI/CD for ML, and Docker containerization
  • LLM Evaluation: Experience with evaluation frameworks (RAGAS, DeepEval), custom metrics, benchmark datasets, and human-in-the-loop validation
  • Cloud & AWS: Experience with AWS services including SageMaker, Bedrock, S3, Lambda, EC2, and CloudWatch
  • Statistics & Experimentation: Strong foundation in statistics, A/B testing, causal inference, and experimental design
  • Visualization: Proficiency with Tableau, Power BI, or Python visualization libraries

Experience & Education

  • 5 years in data science, ML engineering, or related roles
  • 3 years building NLP/generative AI applications and implementing MLOps in production
  • Bachelor's or Master's degree in Data Science, Computer Science, Statistics, or related field
  • Track record of deploying ML systems processing large-scale datasets with proper monitoring and governance

Preferred Qualifications

  • Experience with agentic AI frameworks (LangGraph, LangChain, AutoGen, CrewAI) ?
  • Knowledge of Life Sciences/regulated industries (FDA, EMA, ISO, GxP) and compliance management systems
  • Familiarity with big data tools (Spark, Databricks, Snowflake), orchestration (Airflow, Kubeflow), and monitoring tools (Datadog, Prometheus)
  • Experience with LLM fine-tuning, document processing libraries, multi-modal AI, or distributed training
  • Understanding of ML governance, bias detection, model risk management, and data privacy regulations (GDPR, CCPA, HIPAA)
  • Experience working in agile environments with Jira
  • AWS ML certifications or similar credentials

Key Competencies

  • Strong communication skills explaining complex models to technical and nontechnical audiences
  • Ability to work independently and collaboratively in fast-paced environments
  • Proven ability to convert POCs into production-grade solutions
  • Understanding of ethical AI and building trustworthy, explainable systems for regulated environments

What You'll Build

  • LLM evaluation frameworks ensuring 95% accuracy for compliance-critical features
  • Prompts for LLMs to achieve specific, high-quality outcomes
  • Agentic AI systems autonomously handling document review and compliance workflows
  • GenAI document understanding features processing millions of regulatory documents
  • Predictive models identifying compliance risks before they occur
  • Real-time semantic search and explainable ML systems meeting regulatory requirements
  • Production MLOps pipelines supporting dozens of models with automated monitoring and retraining

Growth Opportunities

  • Drive adoption of emerging AI technologies and establish best practices
  • Mentor ML engineers
  • Shape AI/ML roadmap and establish center of excellence for compliance AI
  • Collaborate with product leadership on long-term vision for AI-powered compliance

About Octave

Octave provides mission-critical software that empowers organizations to make informed decisions across every stage of the asset lifecycle - Design, Build, Operate and Protect - where performance, safety, and reliability are non-negotiable and failure is not an option.

Turning complex operational data into actionable intelligence, Octave connects expertise, real-world conditions and enterprise-scale insight to improve performance, resilience and incident response where it matters most.

Octave has more than 7,000 employees in 45 countries. Learn more at octave.com and follow us on LinkedIn.

Why work for Octave?

All in. Always forward. That's the way we do things around here. We put trust in our people because we believe it's the best way to unleash potential, bring ideas to life, and keep moving ahead. And it's why we're committed to creating an environment that's truly supportive, providing you with the resources you need to support your ambitions, no matter who you are or where you are in the world.

Everyone is welcome

At Octave, we believe that diverse and inclusive teams are critical to the success of our people and our business. Here, everyone is welcome. As an inclusive workplace, we don't discriminate. In fact, we embrace differences and are fully committed to creating equal opportunities, an inclusive environment, and fairness for all.

Respect is the cornerstone of how we operate, so speak up and be yourself. You're valued here.

Salary.com Estimation for Principal Software Developer in Madison, AL
$143,892 to $174,218
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

What is the career path for a Principal Software Developer?

Sign up to receive alerts about other jobs on the Principal Software Developer career path by checking the boxes next to the positions that interest you.
Income Estimation: 
$176,149 - $220,529
Income Estimation: 
$156,679 - $196,968
Income Estimation: 
$101,387 - $124,118
Income Estimation: 
$119,030 - $151,900
Employees: Get a Salary Increase
View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

Job openings at Octave

  • Octave Madison, WI
  • Job Location (Short): Calgary, Canada | Madison, United States Workplace Type: Remote Req Id: 2609 Responsibilities Octave is seeking an Implementation Con... more
  • 1 Day Ago

  • Octave Madison, WI
  • Job Location (Short): Atlanta, United States | Madison, United States Workplace Type: Hybrid Req Id: 2748 Responsibilities Octave is looking for a Senior S... more
  • 1 Day Ago

  • Octave Raleigh, NC
  • About the Company: Octave is a modern behavioral health practice creating a new standard for care delivery that’s both high-quality and accessible. With in... more
  • 1 Day Ago

  • Octave Chicago, IL
  • About the Company: Octave is a modern behavioral health practice creating a new standard for care delivery that’s both high-quality and accessible. With in... more
  • 1 Day Ago


Not the job you're looking for? Here are some other Principal Software Developer jobs in the Madison, AL area that may be a better fit.

  • Client Server Software Solutions Huntsville, AL
  • ROLE: Software Developer-SR The Senior Software Developers lead the design, development, and implementation of enterprise IT solutions supporting USASMDC m... more
  • 2 Months Ago

  • Client Server Software Solutions Huntsville, AL
  • The Senior Software Developers (KMST) specialize in developing, automating, and supporting Knowledge Management Support Tools. Responsibilities include bui... more
  • 2 Months Ago

AI Assistant is available now!

Feel free to start your new journey!