Research workflow

How LLM Peers research works — step by step

Every run follows the same deliberation architecture: clarify the brief, optionally ground it in live web context, generate independent council answers, blind peer-review them with a multi-criteria scorecard, then synthesize one chairman decision brief. This page maps the full path — from your question to the artifact you act on.

Shorter guide

Workflow diagram

Click any step to jump to the detailed explanation. Dashed boxes are optional; solid stages always run when prior steps succeed.

Assistant message status flow

Each run writes progress to Firestore so the UI updates live.

  1. pending
  2. running
  3. awaiting_intake
  4. running
  5. complete
Billing touchpoints
  • Free entitlement consumed when the run starts (not on resume from intake)
  • Premium reserves wallet balance up front, settles actual usage + platform fee at end
  • Per-stage cost report: intake, web, stage1, stage2, stage3, title

Peer review rubric

Stage 2 scores every anonymized draft on these dimensions (1–5). Weights are configurable in admin; defaults favor correctness and actionability.

  • Correctness

    Sound reasoning and defensible claims

  • Completeness

    Covers constraints and material angles

  • Actionability

    Clear next steps someone can execute

  • Risk coverage

    Failure modes and edge cases named

  • Grounding

    Uses available evidence; avoids invention

Step-by-step detail

Step 01

Ask your question

Sign in with Google and write one difficult question — a real decision with trade-offs, constraints, and consequences. LLM Peers creates a research conversation: your message plus an assistant placeholder that fills in stage by stage as the council runs.

  • One question per run; follow-ups start a new research engagement in the same thread
  • Progress streams to Firestore — no black-box polling or SSE
  • You can leave mid-run; you are emailed when the decision brief is ready

Step 02

Choose Free or Premium Research

There is no subscription tier. Free Research uses welcome credits, then one run every 24 hours with an efficient multi-lab council. Premium Research draws from a prepaid wallet and unlocks research panels, custom peers, frontier models, and deeper token budgets.

  • Free: 3 welcome runs, then 1 every 24h
  • Premium: pay model usage + 12% platform fee from wallet
  • Premium: pick a research panel (strategy, GTM, finance, adversarial, etc.) or customize peers + chairman
  • Depth: Standard, Deep, or Maximum — scales stage token budgets

Step 03

Clarify with intake (when needed)

Before the council spends tokens, an intake agent may ask 1–5 focused clarifying questions — single choice, multi-select, or short text. Answers are woven into the deliberation brief. If your question is already specific enough, intake is skipped.

  • Run may pause with status awaiting_intake until you answer or skip
  • Resuming after intake does not re-bill the Free Research entitlement
  • Follow-up runs can use prior research context from the same conversation

Step 04

Gather web context (optional)

When web research is enabled, a dedicated search agent collects a current briefing from public sources — market context, dates, disagreements across sources, and markdown source links. That briefing is attached to every councilor's prompt so models deliberate from shared external context.

  • Reduces silent disagreement about facts that live outside training data
  • Sources are inspectable in the Web research stage of the inspector
  • Chairman synthesis can cite sources when facts are time-sensitive

Step 05

Stage 1 — AI Council (independent answers)

Each councilor model answers alone — no peeking at peer drafts. Prompts ask for decision-grade depth: recommendation, analysis, risks, alternatives, and next steps. Each draft ends with a structured extract (recommendation, key claims, assumptions, risks, actions) used later for agreement mapping.

  • Parallel generation — every model sees the same question + web briefing
  • Free runs use efficient multi-lab peers; Premium uses your panel or custom lineup
  • Failures are isolated — other councilors can still complete the run
  • Stage 1 results persist immediately to your assistant message

Step 06

Stage 2 — Peer review & deliberation scorecard

Successful drafts are anonymized (Response A, B, C…). Each councilor reviews every draft against shared criteria, scores them 1–5 on five rubric dimensions, names strongest assumptions and missed risks, then submits an ordinal ranking. Self-votes are excluded from the aggregate by default.

  • Rubric dimensions: correctness, completeness, actionability, risk coverage, grounding
  • Composite score blends weighted rubric averages with ordinal peer rank
  • Agreement map clusters recommendations, surfaces contested claims and assumption ledger
  • You see per-reviewer prose, extracted rankings, scorecard bars, and why the leader won

Step 07

Stage 3 — Chairman decision brief

A chairman agent receives all council drafts, peer rankings, the deliberation scorecard, and the agreement/dissent map. It produces one structured brief with verdict, why this won, ranked options, where peers agreed and disagreed, assumptions you are accepting, risks, next action, and open questions.

  • Chairman weighs scorecard substance — not model brand prestige
  • Can correct consensus errors when evidence supports a minority path
  • Premium runs may use a frontier chairman; Free uses an efficient default
  • Final brief is the artifact you export, share, or take into a meeting

Step 08

After the run

The conversation title is generated, status moves to complete, and Premium wallet usage is settled with a receipt. Inspect every stage in the workflow inspector, publish a public research link, or ask a follow-up that builds on prior context.

  • Timeline shows each phase: intake → web → stage1 → stage2 → stage3 → title
  • Public share exposes decision, drafts, scorecard, and sources (no billing)
  • Premium receipt breaks down model usage and platform fee per stage
  • Challenge assumptions before you commit — the brief is decision support, not authority

What gets saved

Progressive persistence — each phase writes to your assistant message as it completes.

PhaseWhat persists
Intakequestions, answers, skipped
Webbriefing, sources[], model
Stage 1per-model response, structured extract
Stage 2ranking prose, peer_scores[], parsed_ranking
Metadatascorecard, agreement_map, aggregate_rankings, label_to_model
Stage 3chairman model, decision brief
Billingcost report, wallet receipt (Premium)

Email when ready

Leave during a long run — you get a link to the completed research conversation.

Public research share

Publish a read-only case with decision, drafts, scorecard, and sources — without re-running the board.