Senior Backend / LLM Ops Engineer

Overview

Our client is seeking a Senior Backend Engineer with hands-on experience in LLM Ops to lead the development of AI-powered capabilities within a cutting-edge low-code platform for financial technology. This role combines deep backend expertise with applied experience in designing, integrating, and optimizing AI agent workflows to deliver automation and intelligence across large-scale systems.

Challenges you would face

Design and implement AI-driven backend architectures to enhance low-code platform functionality
Develop and optimize AI agent pipelines leveraging large language models and cloud-based AI services
Build evaluation frameworks to assess and improve the quality of AI-generated outputs
Collaborate with cross-functional teams to integrate AI workflows into core product systems
Establish and document best practices for LLM Ops, including model monitoring, versioning, and continuous improvement
Design and manage scalable RESTful APIs and backend services for AI and data processing
Implement robust data models, schema validation, and workflow automation for complex use cases

The ideal candidate

Advanced degree in Computer Science or related field
8+ years of backend development experience with proven expertise in AI agent workflows
Proficiency in TypeScript and Node.js, with strong understanding of RESTful API design
Hands-on experience integrating large language models (GPT, Claude, Gemini, Grok)
Strong background in LLM Ops, model evaluation, and workflow pipeline design
Knowledge of version control systems (Git) and prompt versioning best practices
Experience with AWS cloud infrastructure and PostgreSQL databases
Deep understanding of software development principles, authentication, and authorization mechanisms

Plus

Experience with AI frameworks such as LangChain, LlamaIndex, Haystack, or FlowWise
Python proficiency with ML/AI libraries like PyTorch, TensorFlow, or Pandas
Previous experience in financial services or low-code platforms
Strong communication skills and the ability to mentor others on AI systems and practices
Enthusiasm for innovation, ethical AI, and building scalable automation tools

Senior Backend/LLM Ops Engineer