Polyman Documentation - v3.1.0
    Preparing search index...

    Interface SolutionTestReport

    Report emitted by polyman test <solution> --json: the run report of the target solution, each test judged by the checker against the main solution's output, plus whether the verdicts match the solution's tag. SolutionTestReport

    interface SolutionTestReport {
        schemaVersion: 1;
        polymanVersion: string;
        ok: boolean;
        solution: string;
        tag: SolutionTag | null;
        tests: TestResult[];
        summary: { total: number; byVerdict: Partial<Record<TestVerdict, number>> };
        errors: string[];
        command: "test";
        exitCode: number;
        durationMs: number;
        mainSolution: string | null;
        matchesTag: boolean;
        reason: string;
    }

    Hierarchy

    • Omit<RunReport, "command">
      • SolutionTestReport
    Index
    schemaVersion: 1
    polymanVersion: string
    ok: boolean
    solution: string
    tag: SolutionTag | null
    tests: TestResult[]
    summary: { total: number; byVerdict: Partial<Record<TestVerdict, number>> }
    errors: string[]
    command: "test"
    exitCode: number
    durationMs: number
    mainSolution: string | null

    Name of the MA solution, null when the command stopped before finding it

    matchesTag: boolean

    Whether the verdicts satisfy the tag

    reason: string

    Human explanation of matchesTag