Kobayashee is in private beta — join the waitlist →
AI-collaboration assessment

Your interviews still test skills AI made obsolete.

Measure what matters now: how engineers direct, verify, and correct AI. Real tasks, real agentic tooling, and controlled flaws that reveal who actually checks the AI's work.

Free while we're in beta. No spam, ever.

/ See it in action

What an interviewer actually sees.

Candidates write real code and talk to a real AI. Every prompt, edit, and correction is captured and timestamped as it happens — the report writes itself.

kobayashee.com/s/session_042
session_042
docs
src
src/pagination.js
1
function getPage(items, page) {
2
  const pageSize = 10;
3
  const start = page * pageSize;
4
  return items.slice(start, start + pageSize - 1);
5
}
6
7
// called for every /cart request
8
app.get('/cart', (req, res) => res.json(getPage(cart, req.query.page)));
Terminal
Unnamed (2)
(base) candidate@session_042 % claude
Claude Code v2.1.185
Sonnet 4.6 · Claude Team
~/session_042
Every prompt, edit, and correction in this session is captured and linked into the candidate's report.
Can you add pagination to this endpoint?
Added offset-based pagination — see the updated handler in pagination.js.
Wait — that slice boundary looks off by one.
You're right, good catch — fixed.
Try "why does this test fail?"
? for shortcuts · ← for agents
Real tools

The same editor, terminal, and AI chat candidates already use daily — no simulated IDE.

Nothing scripted

Every session runs live. The flaws are seeded ahead of time — the work candidates do is real.

Fully captured

Every prompt, edit, and correction streams into the evidence-linked report — nothing is inferred.

/ What we test for
OFF-BY-ONE ERRORHALLUCINATED API CALLSILENT REGRESSIONRACE CONDITIONSTALE CACHE READUNGUARDED NULLOFF-BY-ONE ERRORHALLUCINATED API CALLSILENT REGRESSIONRACE CONDITIONSTALE CACHE READUNGUARDED NULL
N+1 QUERYWRONG UNIT CONVERSIONLEAKED SECRETFLAKY RETRY LOGICMISSING AUTH CHECKINFINITE LOOPN+1 QUERYWRONG UNIT CONVERSIONLEAKED SECRETFLAKY RETRY LOGICMISSING AUTH CHECKINFINITE LOOP
/ Why now

The old signal broke. Nobody replaced it — until now.

The only platform

that tests error-detection via controlled flaw injection into AI output.

Published methodology

Rubrics grounded in selection science, calibrated against human evaluators — reliability numbers we publish, not a black box.

Evidence, not verdicts

Every score links to the exact moment in the session replay. Full telemetry export included.

/ How it works

A real interview, with a twist.

We don't watch candidates use AI. We instrument it. (click a step)

01
Configure the task

Pick environment, scenario, and poisoning profile from the library — or bring your own.

02
Candidate joins the sandbox

A shareable link drops them into a real environment with Claude Code, chat, and completions.

03
The gateway injects controlled flaws

Plausible-but-wrong AI output, sparingly, disclosed at the category level.

04
Get an evidence-linked report

Deterministic metrics, calibrated LLM-judge scores, full replay, and raw data export.

ENVIRONMENTNode.js API
SCENARIOPagination bug
POISONINGMedium
/ Compare

How this stacks up.

AI-assist bolt-ons let candidates use Copilot and hope for the best. We measure whether they're any good at it. (click a row group)

Kobayashi
AI-assist bolt-ons
From-scratch coding
Measurement
Tests error-detection & validation skill
Full AI-interaction telemetry + replay
Partial
Rigor
Published, validated scoring methodology
Evidence-linked reports, not black-box scores
Experience
Real agentic tooling (not a chat sidebar)
n/a
Self-serve, credit-card pricing
/ What we measure
Direct

Prompt, steer, and delegate work to AI the way you would a capable teammate.

Verify

Catch the flaws we deliberately inject before they ever ship.

Correct

Fix what's wrong and explain why — not just accept the diff.

Get early access

Run your first assessment free.

We're onboarding pilot teams now. Free while we're in beta — no credit card.

Candidates: finally, an interview that tests how you actually work.