AI Backend Engineer (Agent Systems) - Ruby

About RubyRuby is building vertical-specific AI agents for go-to-market (GTM) teams, backed by leading investors such as Inovia and NJP and used by customers at F1000 companies. Our team combines deep LLM expertise with domain knowledge to build a product that is practical, scalable, and reliable. The founding team has worked at companies like Snowflake and Salesforce in senior roles.Were growing our engineering team and looking for someone who thrives at the intersection of AI reasoning, backend systems, and automation.About The RoleAs an AI Backend Engineer, youll design and implement systems that power intelligent agents and AI capable of reasoning, using tools, and orchestrating multi-step workflows.Youll work closely with our applied AI and product teams to ship reliable, production-ready agent services built on top of cutting-edge models from OpenAI, Anthropic, and Gemini.What Youll DoDesign and implement multi-step reasoning architectures and tool-calling agents using OpenAI, Anthropic, and Gemini APIs.Build modular, scalable backend services with FastAPI (or similar frameworks), managing state, retries, and parallel execution.Integrate external tools and APIs such as GitHub, cloud providers, and databases into agent workflows using structured outputs.Develop workflow orchestration logic with async execution, background tasks, and queues (Redis, Celery, SQS).Manage CI/CD pipelines, containerized deployments (Docker), and Infrastructure as Code setups for production environments.Monitor and optimize system reliability, performance, and observability for live agent systems.What Were Looking ForExperience designing or contributing to AI agent systems with multi-step reasoning or tool use.Strong Python backend engineering skills (FastAPI preferred).Experience with async programming, task queues, and state management.Hands-on with cloud deployment, CI/CD, Docker, and Infrastructure as Code.A practical mindset focused on reusing existing APIs and libraries to ship fast, reliable systems instead of reinventing the wheel.Bonus PointsFamiliarity with LangChain, LlamaIndex, or CrewAI-style orchestration frameworks.Experience with vector databases, retrieval-augmented generation (RAG), or LLM observability.Previous work on AI developer tools or production LLM applications.Why Join UsLearn from proven founders: Youll be part of a small, high-velocity team building the next generation of applied AI systems with founders who have seen it all from idea to IPO.Focus on craft: We value curiosity, clarity, and craft and were looking for engineers who care about solving real problems with elegant, reliable code.Make an impact: Youll be part of a small team and have an outsized impact. Be valued: We offer highly market-competitive compensation.