Research workflow

How LLM Peers research works — step by step

Every run follows the same deliberation architecture: clarify the brief, optionally ground it in live web context and your own files or links, generate independent council answers, blind peer-review them with a multi-criteria scorecard, then synthesize one chairman decision brief. This page maps the full path — from your question to the artifact you act on.

Shorter guide

Workflow diagram

Click any step to jump to the detailed explanation. Dashed boxes are optional; solid stages always run when prior steps succeed.

Assistant message status flow

Each run writes progress to Firestore so the UI updates live.

  1. pending
  2. running
  3. awaiting_intake
  4. running
  5. complete
Billing touchpoints
  • Free entitlement consumed when the run starts (not on resume from intake)
  • Premium reserves wallet balance up front, settles actual usage + platform fee at end
  • Per-stage cost report: intake, web, knowledge, stage1, stage2, stage3, title
My sources pipeline

How private context moves from upload to a citable research briefing.

  1. 01

    Add

    Upload a file or paste a public URL in My sources / Attach sources.

  2. 02

    Extract

    Cloud processing parses PDFs, Office, sheets, images (OCR), and web pages into segments.

  3. 03

    Ready

    Inspect segments, citations, and coverage. Failed items stay out of research until fixed.

  4. 04

    Attach & cite

    On Premium, select Ready sources. Council + chairman get a shared briefing with [Doc: …] keys.

Peer review rubric

Stage 2 scores every anonymized draft on these dimensions (1–5). Weights are configurable in admin; defaults favor correctness and actionability.

  • Correctness

    Sound reasoning and defensible claims

  • Completeness

    Covers constraints and material angles

  • Actionability

    Clear next steps someone can execute

  • Risk coverage

    Failure modes and edge cases named

  • Grounding

    Uses available evidence; avoids invention

Step-by-step detail

Step 01

Ask your question

Sign in with Google and write one difficult question — a real decision with trade-offs, constraints, and consequences. LLM Peers creates a research conversation: your message plus an assistant placeholder that fills in stage by stage as the council runs.

  • One question per run; follow-ups start a new research engagement in the same thread
  • Progress streams to Firestore — no black-box polling or SSE
  • You can leave mid-run; you are emailed when the decision brief is ready

Step 02

Choose Free or Premium Research

There is no subscription tier. Free Research uses welcome credits, then one run every 24 hours with an efficient multi-lab council. Premium Research draws from a prepaid wallet and unlocks research panels, custom peers, frontier models, and deeper token budgets.

  • Free: 3 welcome runs, then 1 every 24h
  • Premium: pay model usage + 12% platform fee from wallet
  • Premium: pick a research panel (industry, role, or decision mode) or customize peers + chairman
  • Premium: attach My sources — files, images, and public links as citable context
  • Depth: Standard, Deep, or Maximum — scales stage token budgets

Step 03

Clarify with intake (when needed)

Before the council spends tokens, an intake agent may ask 1–5 focused clarifying questions — single choice, multi-select, or short text. Answers are woven into the deliberation brief. If your question is already specific enough, intake is skipped.

  • Run may pause with status awaiting_intake until you answer or skip
  • Resuming after intake does not re-bill the Free Research entitlement
  • Follow-up runs can use prior research context from the same conversation

Step 04

Gather web context (optional)

When web research is enabled, a dedicated search agent collects a current briefing from public sources — market context, dates, disagreements across sources, and markdown source links. That briefing is attached to every councilor's prompt so models deliberate from shared external context.

  • Reduces silent disagreement about facts that live outside training data
  • Sources are inspectable in the Web research stage of the inspector
  • Chairman synthesis can cite sources when facts are time-sensitive

Step 05

Attach My sources (Premium)

On Premium runs you can ground the council in your own context — PDFs, Word, PowerPoint, Excel/CSV, text, images, and public URLs — from My sources. Each item is uploaded or linked once, extracted into citable segments, then attached to a research run so every peer and the chairman share the same private briefing.

  • Upload files (documents up to 25 MB, images up to 10 MB) or paste a public link
  • Server-side extraction: PDFs/Office/text parsers, vision OCR for images, Readability + Markdown for URLs
  • Status moves uploading → processing → ready (or error); only Ready sources attach to research
  • At run time, selected segments become a knowledge briefing with [Doc: filename, locator] citation keys
  • Premium only — Free Research cannot attach My sources

Step 06

Stage 1 — AI Council (independent answers)

Each councilor model answers alone — no peeking at peer drafts. Prompts ask for decision-grade depth: recommendation, analysis, risks, alternatives, and next steps. Each draft ends with a structured extract (recommendation, key claims, assumptions, risks, actions) used later for agreement mapping.

  • Parallel generation — every model sees the same question + web + My sources briefing
  • Free runs use efficient multi-lab peers; Premium uses your panel or custom lineup
  • Failures are isolated — other councilors can still complete the run
  • Stage 1 results persist immediately to your assistant message

Step 07

Stage 2 — Peer review & deliberation scorecard

Successful drafts are anonymized (Response A, B, C…). Each councilor reviews every draft against shared criteria, scores them 1–5 on five rubric dimensions, names strongest assumptions and missed risks, then submits an ordinal ranking. Self-votes are excluded from the aggregate by default.

  • Rubric dimensions: correctness, completeness, actionability, risk coverage, grounding
  • Composite score blends weighted rubric averages with ordinal peer rank
  • Agreement map clusters recommendations, surfaces contested claims and assumption ledger
  • You see per-reviewer prose, extracted rankings, scorecard bars, and why the leader won

Step 08

Stage 3 — Chairman decision brief

A chairman agent receives all council drafts, peer rankings, the deliberation scorecard, and the agreement/dissent map. It produces one structured brief with verdict, why this won, ranked options, where peers agreed and disagreed, assumptions you are accepting, risks, next action, and open questions.

  • Chairman weighs scorecard substance — not model brand prestige
  • Can correct consensus errors when evidence supports a minority path
  • Premium runs may use a frontier chairman; Free uses an efficient default
  • Final brief is the artifact you export, share, or take into a meeting

Step 09

After the run

The conversation title is generated, status moves to complete, and Premium wallet usage is settled with a receipt. Inspect every stage in the workflow inspector, publish a public research link, or ask a follow-up that builds on prior context.

  • Timeline shows each phase: intake → web → knowledge → stage1 → stage2 → stage3 → title
  • Public share exposes decision, drafts, scorecard, and sources (no billing)
  • Premium receipt breaks down model usage and platform fee per stage
  • Challenge assumptions before you commit — the brief is decision support, not authority

What gets saved

Progressive persistence — each phase writes to your assistant message as it completes.

PhaseWhat persists
Intakequestions, answers, skipped
Webbriefing, sources[], model
My sourcesknowledgeDocumentIds, knowledgeContext briefing + coverage
Stage 1per-model response, structured extract
Stage 2ranking prose, peer_scores[], parsed_ranking
Metadatascorecard, agreement_map, aggregate_rankings, label_to_model
Stage 3chairman model, decision brief
Billingcost report, wallet receipt (Premium)

Email when ready

Leave during a long run — you get a link to the completed research conversation.

Public research share

Publish a read-only case with decision, drafts, scorecard, and sources — without re-running the board.