Data Closed‑Loop Engineer

Key Responsibilities

Design, develop, and maintain end‑to‑end data pipelines supporting large‑scale autonomous‑driving simulations.
Implement active‑learning loops and data versioning strategies to continuously improve perception models.
Collaborate with AI research and vehicle‑control teams to ingest, process, and curate high‑velocity sensor data.
Build and optimize cloud‑native services using Kubernetes, Airflow, Argo, Dagster, and Ray for scalable execution.
Develop and maintain distributed computing jobs on Spark, Flink, and Ray to handle petabyte‑scale data workloads.
Integrate vector‑search and scene‑mining techniques for rapid retrieval of relevant driving scenarios.
Monitor performance metrics, troubleshoot bottlenecks, and continuously optimize for latency and throughput.
Ensure data integrity and compliance through rigorous testing, documentation, and version control.
Participate in cross‑functional agile ceremonies and contribute to technical roadmap planning.

Bachelor’s degree or higher in Computer Science, Electrical Engineering, Robotics, or a related field.
3 years of hands‑on experience building data pipelines and backend services for AI‑driven applications.
Proficiency in Python and Go (or Java) for high‑performance data processing.
Strong experience with container orchestration (Kubernetes) and workflow orchestration tools (Airflow, Argo, Dagster).
Deep understanding of distributed computing frameworks such as Spark, Flink, and Ray.
Experience with data versioning, ingestion, and active‑learning frameworks.
Knowledge of cloud‑scale simulation environments and performance optimization techniques.
Excellent problem‑solving skills and ability to work in a fast‑paced, cross‑functional startup environment.

Hands‑on with AI coding tools and vector‑search technologies.
Familiarity with scene mining and autonomous‑driving datasets.
Experience deploying and managing large‑scale data pipelines on public or private cloud platforms.
Understanding of autonomous vehicle control loops, sensor fusion, and perception pipelines.
Outstanding communication skills in English; Japanese language proficiency is a plus.