Backend Engineer, AI Systems

About the role

ActAI is building proactive AI‑native applications that simplify everyday tasks. As a Backend Engineer, AI Systems you will own the inference and orchestration layer that powers every AI interaction, ensuring low latency, reliability and cost‑effectiveness for real‑world users.

Key responsibilities

• Design, build, and operate backend systems that serve AI‑powered features in production.
• Create inference pipelines and orchestration layers handling multi‑step workflows, tool calls, and retries.
• Manage the full lifecycle of AI requests, including routing, caching, batching, streaming, and state management.
• Optimize latency, throughput, and cost across model inference and downstream services.
• Ensure system reliability despite non‑deterministic model behavior and external dependencies.
• Implement observability (logging, tracing, debugging) for AI outputs and failures.
• Collaborate with ML and product teams to translate model capabilities into stable production APIs.

Required profile

• Strong backend engineering fundamentals in production environments.
• Experience running high‑throughput, low‑latency services.
• Familiarity with AI inference patterns such as LLMs, embeddings, and multimodal models.
• Comfortable debugging distributed systems under load.
• Bias toward shipping and learning from production behavior.

Required skills

• Python
• Node.js
• PyTorch
• OpenAI
• Anthropic
• SQL
• NoSQL
• Kubernetes
• Docker