Software Engineer - AI Infrastructure

We're seeking a software engineer to support our AI infrastructure team, helping build and maintain the foundation for advanced AI capabilities. Your role will involve developing high-quality tools and applications that enable seamless and efficient use of AI across the organization.

Responsibilities:

Develop high-quality AI tools and applications for workforce use
Ensure high availability, reliability, performance, and security of AI tools
Modify FOSS to accommodate customer’s use cases
Engage with customers, conducting requirements elicitation and developing solutions
Maintain existing customer-facing infrastructure and applications, ensuring reliable services
Serve as a technical lead for AI Tools and Applications initiatives, coordinating work across teams
Provide coaching, feedback, and support to assigned team members
Navigate ambiguity and define solutions for complex requirements
Establish new technical policies, standards, and governance frameworks where gaps exist
Drive adoption of new technologies and practices across engineering teams
Implement monitoring, logging, and observability solutions for AI services
Communicate effectively with stakeholders at multiple organizational levels

Required Skills:

Expertise in UI/UX principles
Significant experience using LLMs as part of a code solution workflow
Ability to learn new technologies quickly
Mastery of Python
Demonstrate willingness to lead and manage multiple junior developers
Familiarity with AWS or other cloud service providers
Experience with Kubernetes/Helm
Familiarity with Argo CD and/or other CI/CD frameworks
Experience supporting production software using SRE best practices
Experience with Docker and containerization

Nice to Have:

Experience with LLM UI Open-Source software such as OpenWebUI
Proficiency with Kubernetes/Helm
Proficiency with Argo CD and/or other CI/CD frameworks
Familiarity with customer requirements elicitation, community outreach, and integration
Experience hosting LLM models

Experience Required: 12 years with Bachelor's degree in a technical field, or 16 years without degree

Location: Columbia, MD

Clearance: TS/SCI with Polygraph required

Salary Range: $204,000 - $247,000

Senior Software Engineer – Tools and Applications