What are the responsibilities and job description for the AI Engineer position at Underdog.io -Apply to top tech jobs in 60 seconds. A place where companies apply to you?
Senior AI Developer
Location: New York City, NY
Build AI That Actually Helps Humans
We’re a fast-growing automation startup backed by top-tier investors. Our mission: transform how Managed Service Providers (MSPs) work by eliminating mundane tasks through intelligent tools. We’re seeking an AI engineer who cares about why AI matters—not just how to build it. If you’re tired of shipping LLM demos that never help real users, join us to build agentic AI that gives overwhelmed IT engineers their time back.
Underdog.io is a modern recruiting platform. This role is being filled through Underdog.io — a invite-only network of vetted startups and high-growth companies. You won't go through a staffing agency or get passed around. Your resume goes directly to our hiring team and is reviewed by a real human. Your profile is completely confidential. If there's a good fit, you'll hear from us directly — no middleman, no black hole.
What You’ll Do
- Design and ship AI features that solve real MSP pain points: natural-language workflow creation, autonomous agents, and context-aware task automation.
- Build agentic systems that act responsibly—knowing when to automate, ask for input, or escalate to humans.
- Optimize production-grade AI: Tune prompts, RAG pipelines, and inference stacks (OpenAI, Claude, open-source LLMs) for speed, cost, and reliability.
- Integrate AI into core workflows using tools like LangChain, LlamaIndex, and custom orchestration layers.
- Collaborate cross-functionally to transform prototypes into features that ship.
- Solve hard problems: Balance autonomy with safety, reduce hallucinations, and embed empathy into AI interactions.
Tech Stack You’ll Use
- Core: Python, FastAPI, Celery, PostgreSQL, React
- AI/ML: OpenAI, Anthropic, Mistral/LLaMA, LangChain, Pinecone, Huggingface
- Infra: AWS/Azure, Kubernetes, Docker, Redis
- Observability: LLM telemetry, cost optimization
Who You Are
- 5 years in software engineering, including 2 years shipping production AI/ML systems (not just prototypes).
- Proven expertise in:
- LLM integration (RAG, agentic)
- Designing human-AI interaction patterns (escalation, guardrails)
- Building with frameworks like LangChain or custom orchestration
- Builder mindset: You prioritize user impact over model hype.
- MSP empathy: You intuitively grasp IT engineers’ pain points (bonus: RPA/automation experience).
- Communication skills: Translate technical complexity into user value.
Above & Beyond
- Experience fine-tuning/hosting open-source LLMs
- Contributions to AI open-source projects (e.g., LangChain agents)
- Observability and cost optimization for AI inference
- Background in automation, agent-based systems, or MSP workflows
Why Join
- Solve meaningful problems: Your AI features directly help overworked engineers.
- Ownership & impact: Autonomy to shape high-stakes AI decisions.
- Competitive comp: Salary equity benefits in a scaling startup.
- Remote-first culture: Collaborate with execution-obsessed builders.
- No fluff, just shipping: We value clarity and results over demos.
For AI Builders Who Hate Hallucinations
If you want to build AI that actually works—and see it change how thousands of IT professionals operate—apply now. Let’s create tools that augment humans, not replace them.
Note: No visa sponsorship.