Key Responsibilities:

● Code Generation & Refinement: Directly write, evaluate, and rewrite code to solve complex, real-world problems. This is not just a
management role; it is a critical hands-on position.

● Code Validation: Develop and implement sophisticated frameworks to rate and evaluate the quality of code responses generated by our
models. This includes creating automated test suites and benchmarks.

● Code Quality and Efficiency: Analyze and improve the efficiency and correctness of both human-written and model-generated code.

● Cross-Functional Collaboration: Partner with research, engineering, and product teams to integrate feedback and drive improvements in code-centric models.

Required Skills and Qualifications:

● Role: Tech Lead / Senior Software Engineer

● Experience: Proven track record (7 - 10+ years) of building and shipping complex software solutions.

● Languages (Priority):

○ Python, Java, C, C++, JavaScript: Strong proficiency in at least one of these languages for evaluating and rewriting model-generated code in diverse environments.

● Code Evaluation: Experience in creating comprehensive test harnesses, evaluating code for correctness, efficiency, and security, and defining code quality metrics.

● GenAI Experience (Preferred): Familiarity with LLMs and the challenges of code generation, fine-tuning, and evaluation.

Why This Role is Critical for Our Success:

A Tech Lead with this specific skill set will be a force multiplier for our team. By combining coding proficiency with the ability to build evaluation frameworks, this individual will:

1. Accelerate Development: Drastically reduce the time it takes to validate and refine code-generating models.

2. Ensure Quality: Guarantee that the code produced by our models is robust, secure, and production-ready.

3. Drive Innovation: Provide the deep technical insights needed to solve the most challenging and complex GenAI code use cases

Preferred skills:

● priority languages: Python, Java, C, C++, Javascript

● domain expertise: stem fields, data analysis / data science, data visualization

● other requirements: familiarity with web visualization platforms, data analysis libraries, SQL/databases, JSON, HTML, markdown.

● seniority: tech lead level - we are seeing increasing demand for smaller datasets with high complexity.

We could also be interested in "technical raters" that are not properly coders but have expertise on Javascript/JSON, HTML and markdown. We
sometimes get tasks that are good fits for the super raters if not for the fact that they include some JSON or HTML for formatting output that they are
not familiar with.

Tech Lead for GenAI Code Initiatives