Senior Software Engineer

Join us in building the next generation of AI infrastructure that will power innovation across our organization. We’re seeking a senior software engineer to support our AI infrastructure team. In this role, you’ll help build and maintain the foundation for AI capabilities while supporting a broader ecosystem of AI-enabled applications.

Responsibilities:

Lead the evaluation, configuration, and deployment of inference models for our users.
Mentor engineers and grow development best practices and standards for the team.
Develop in-house services and techniques to guarantee continual high-quality inference service.
Collaborate with other teams to establish solid infrastructure for our services and integrate LLM-powered tools.
Support short-term, high-priority inference needs from stakeholders through coordinated efforts.

Required Skills:

Experience with Python or other modern programming languages.
Experience with Argo CD or other CI/CD frameworks.
Familiarity with Kubernetes/Helm.
Experience with AWS or another cloud service provider.
Strong communication skills and ability to mentor other engineers.
Excellent leadership and stakeholder management skills.

Nice to Have:

Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
Familiarity with Site Reliability Engineering (SRE) best practices for production software support.
Knowledge of Elastic, Grafana/Prometheus, or other observability frameworks and practices.

Experience Required: 12 years with Bachelor’s degree in a technical field, or 16 years without degree

Location: Columbia, MD

Clearance: TS/SCI with Polygraph required

Salary Range: $204,000 - $247,000

Senior Software Engineer – Inference