Backend and DevOps Engineer, AI/LLM
Build and operate production AI systems, combining Python backend development with cloud infrastructure and DevOps work. This full-time, office-based role is based in Tel Aviv.
Responsabilidades
- Build and maintain cloud infrastructure with Terraform, including environments, networking, storage, and access management.
- Develop and maintain CI/CD pipelines for automated testing, Docker image builds, deployments, and rollbacks.
- Implement monitoring, logging, and alerting; troubleshoot production issues; and improve reliability, performance, and cost efficiency.
- Manage secrets, identities, permissions, and secure communication between services.
- Develop Python and FastAPI backend services, including REST APIs, asynchronous workflows, queues, and background jobs.
- Integrate language models into applications using tool calling, structured outputs, streaming, and conversation-context management.
- Build document-processing, knowledge-retrieval, and RAG workflows connecting language models to enterprise information.
- Integrate internal enterprise systems and external services.
- Write automated tests and evaluate AI workflows for quality, reliability, latency, and token usage.
Requisitos
- At least three years of hands-on experience developing Python backend services and operating them in production.
- Practical experience with at least one major cloud provider: Azure, AWS, or GCP.
- Hands-on experience with Terraform, Docker, Linux, and CI/CD pipelines.
- Experience with REST APIs, asynchronous programming, relational databases such as PostgreSQL, and message queues.
- Practical experience building LLM applications and integrating model APIs.
- Understanding of authentication, authorization, secrets management, and service security.
- Ability to work independently, navigate existing codebases, and troubleshoot across application and infrastructure layers.
- Ability to write clear, maintainable code and collaborate effectively.
Se valora
- Around five years of relevant backend, DevOps, or hybrid engineering experience.
- Azure experience, especially Container Apps, Key Vault, Microsoft Entra ID, and Service Bus.
- Experience building AI agents and using tool calling or the Model Context Protocol (MCP).
- Experience with RAG, embeddings, vector search, and pgvector.
- Familiarity with OpenTelemetry, Grafana, and distributed-system monitoring.
- Experience integrating with Microsoft Graph and Microsoft 365.