Training & evaluation data

Data for models that code, act, and move.

Koyalab produces verified datasets for coding models, AI agents and embodied systems — built by specialists and checked by execution wherever the result can be run.

  1. 01Coding
  2. 02Agents
  3. 03Embodied

/ What we build

Three domains where better data moves the frontier.

01

Coding

Code that has to run, not just read well.

Professional engineers write and repair real software tasks — from single functions to repository-scale changes. Every solution ships with the tests that prove it, and every review explains why one patch beats another.

  • Repository-level issue resolution
  • Verified solutions with unit tests
  • Code review and pairwise critique
  • Multi-language SFT and RL tasks
  • Coding benchmarks and hold-out evals

✓ executed in sandbox · tests pass · reviewer sign-off

02

Agents

Trajectories for models that take actions.

We record and grade complete multi-step episodes: an agent reading a goal, calling tools, browsing, operating software and recovering from mistakes. We also build the environments and reward rubrics those agents are trained against.

  • Tool-use and function-calling trajectories
  • Browser and computer-use demonstrations
  • Step-level process rewards and error labels
  • Task environments and graders
  • Agent evaluation suites

✓ replayable episode · per-step labels · outcome verified

03

Embodied

Data for robots and the physical world.

Teleoperated demonstrations, egocentric video and dense action annotation for manipulation and navigation. Collected with trained operators under controlled protocols, segmented into reusable skills, and aligned across sensors.

  • Teleoperation demonstrations
  • Egocentric video with action labels
  • Task and sub-skill segmentation
  • Pose, contact and 3D annotation
  • Sim and real-world evaluation sets

✓ synced sensors · protocol logged · QA sampled

/ How a project runs

Small batches. Tight specs. Nothing ships unchecked.

  1. 01

    Scope

    We start from your model's failure cases and agree on a written spec: task mix, difficulty, format and acceptance criteria.

  2. 02

    Build

    We set up the environments, rubrics and tooling the work needs — sandboxes for code, harnesses for agents, rigs for robots.

  3. 03

    Produce

    Vetted specialists produce the data in small, reviewed batches so the spec can tighten as early results come in.

  4. 04

    Verify

    Automatic checks run first, then independent human review. Only units that pass both are delivered, with their full audit trail.

/ Sample unit

What one agent episode looks like.

Every step is recorded, replayable and labelled. Mistakes are kept and marked, because recovery is part of what a model needs to learn.

episode / customer-ops / 000231illustrative
  1. goalRefund order #4471 and notify the customer
  2. step 1search_orders(id=4471) → found, status=shipped
  3. step 2get_policy('refunds') → eligible within 30 days
  4. step 3issue_refund(4471, full) → error: payment lockedrecovered
  5. step 4unlock_payment(4471) → issue_refund(4471, full) → ok
  6. step 5send_email(customer, template='refund_done') → ok
outcome
success
steps
5 · 1 error
grader
rubric v3
review
2 of 2 pass
Simplified for display. Delivered episodes include full observations, tool outputs and reviewer notes.

Verifiable by default

Where a result can be executed, replayed or measured, we check it that way before a person ever signs it off.

Specialists, not crowds

Engineers, researchers and trained operators who understand the domain — each accountable for the work they submit.

Your spec, your data

Datasets are built to order for your team, delivered in your format, and never resold.

/ Contact

Tell us where your model falls short.

hello@koyalab.org

We reply within one business day.