Tech Lead for GenAI Code Initiatives

Key Responsibilities:

● Code Generation & Refinement: Directly write, evaluate, and rewrite code to solve
complex, real-world problems. This is not just a management role; it is a critical hands-
on position.
● Code Validation: Develop and implement sophisticated frameworks to rate and
evaluate the quality of code responses generated by our models. This includes creating
automated test suites and benchmarks.
● Code Quality and Efficiency: Analyze and improve the efficiency and correctness of
both human-written and model-generated code.
● Cross-Functional Collaboration: Partner with research, engineering, and product
teams to integrate feedback and drive improvements in code-centric models.
Required Skills and Qualifications:
● Role: Tech Lead / Senior Software Engineer
● Experience: Proven track record (7 - 10+ years) of building and shipping complex
software solutions.

● Languages (Priority):

○ Python, Java, C, C++, JavaScript: Strong proficiency in at least one of these
languages for evaluating and rewriting model-generated code in diverse
environments.
● Code Evaluation: Experience in creating comprehensive test harnesses, evaluating
code for correctness, efficiency, and security, and defining code quality metrics.
● GenAI Experience (Preferred): Familiarity with LLMs and the challenges of code
generation, fine-tuning, and evaluation.

Why This Role is Critical for Our Success:

A Tech Lead with this specific skill set will be a force multiplier for our team. By combining
coding proficiency with the ability to build evaluation frameworks, this individual will:

1. Accelerate Development: Drastically reduce the time it takes to validate and refine
code-generating models.
2. Ensure Quality: Guarantee that the code produced by our models is robust, secure,
and production-ready.
3. Drive Innovation: Provide the deep technical insights needed to solve the most
challenging and complex GenAI code use cases.

Preferred skills:

● priority languages: Python, Java, C, C++, Javascript
● domain expertise: stem fields, data analysis / data science, data visualization

other requirements: familiarity with web visualization platforms, data analysis libraries,SQL/databases, JSON, HTML, markdown.
seniority: tech lead level - we are seeing increasing demand for smaller datasets with high complexity.

We could also be interested in "technical raters" that are not properly coders but have expertise on Javascript/JSON, HTML and markdown. We sometimes get tasks that are good fits for the super raters if not for the fact that they include some JSON or HTML for formatting output that they are not familiar with.

Coding rater(Cloud)