Quality Comparison Survey Template

In plain language: Identifies the specific products, services, or suppliers being compared, the business purpose of the evaluation, and the period it covers.

Common mistake: Leaving the scope vague so evaluators apply different interpretations — this produces inconsistent scores that cannot be meaningfully compared across respondents.

In plain language: Records the name, title, and organizational affiliation of each evaluator, and identifies the entity commissioning the survey.

Common mistake: Using job titles without full names. When the document is reviewed months later or referenced in a dispute, anonymous titles cannot be tied to a specific individual's findings.

In plain language: Lists each quality dimension being rated, the maximum score available, and the weight applied to each criterion in the final composite score.

Common mistake: Assigning equal weights to all criteria regardless of business priority. A defect rate in a safety-critical component deserves significantly more weight than packaging aesthetics — equal weighting obscures what matters most.

In plain language: Defines the numeric or descriptive scale used across all criteria so every evaluator interprets scores consistently.

Common mistake: Omitting scale definitions entirely. When one evaluator's '3' means 'acceptable' and another's means 'barely passing,' composite scores are meaningless.

In plain language: Provides a structured field for the evaluator to enter their numeric score and written rationale for each criterion.

Common mistake: Accepting scores without requiring written rationale. Scores alone cannot be defended in a supplier dispute or audit without documented supporting evidence.

In plain language: Documents how individual criterion scores are multiplied by their weights and summed to produce each supplier's or product's final composite quality score.

Common mistake: Calculating the composite score outside the document — in a separate spreadsheet — without capturing the calculation method and result in the signed record. If the spreadsheet is lost, the scoring basis cannot be reconstructed.

In plain language: Requires each evaluator to declare any financial, personal, or commercial relationships with the entities being evaluated that could affect their objectivity.

Common mistake: Treating conflict-of-interest disclosure as optional. Undisclosed relationships discovered after a procurement decision is made can expose the commissioning organization to legal challenge or regulatory sanction.

In plain language: Summarizes the ranked results of the comparison, flags any supplier that failed to meet minimum thresholds, and states any formal recommendation arising from the evaluation.

Common mistake: Omitting a minimum-threshold clause. Without a stated floor score, a supplier with critically low performance on one criterion can still 'pass' the overall evaluation due to high scores elsewhere.

In plain language: Records the date and signature of the evaluator and any reviewing manager, confirming that the survey was completed accurately and in accordance with the defined methodology.

Common mistake: Collecting only the evaluator's signature without a reviewer sign-off. A single-signature document can be more easily challenged as reflecting individual bias rather than an organizationally endorsed evaluation.

A quality comparison survey is a structured evaluation document used to assess and rank the quality of competing products, services, or suppliers against defined criteria using a consistent scoring methodology. It produces a documented, evidence-backed comparison that supports procurement decisions, supplier selection, contract renewals, and regulatory compliance. Unlike an informal assessment, it includes defined criteria, weighted scoring, evaluator identification, and a signed acknowledgment of findings.

Use one when selecting a new supplier from multiple candidates, renewing a contract with an incumbent vendor, benchmarking a product against competing alternatives, or responding to a quality complaint that requires documented investigation. Organizations subject to ISO 9001, FDA, or similar quality management frameworks often need formal quality comparison records as part of their documented supplier evaluation process.

A quality comparison survey becomes a binding record when it is signed by the evaluator and a reviewing manager, as it constitutes an official organizational statement of findings that can be referenced in contract negotiations, procurement disputes, and regulatory audits. It does not itself create contractual obligations between parties unless incorporated by reference into a supply agreement or purchase order. Consider consulting a lawyer when the survey will be used as evidence in a formal dispute or procurement challenge.

A minimum of two evaluators is recommended for any evaluation that will influence a material procurement decision. Multiple evaluators reduce individual bias and produce more defensible composite scores. When using multiple evaluators, calculate an average or consensus score across respondents and document any significant disagreements and their resolution. For ISO-compliant supplier evaluations, two or more independent evaluators is typically required.

A 1-to-5 Likert scale is the most commonly used format because it provides enough granularity to distinguish performance levels without creating artificial precision. Each point should have a written behavioral anchor — for example, '3 = Meets stated specification in 95–97% of measured instances' — rather than vague labels like 'average.' A 1-to-10 scale is appropriate for complex technical evaluations where finer differentiation between high-performing suppliers is needed.

Multiply each criterion score by its assigned weight expressed as a decimal (e.g., a weight of 25% = 0.25), then sum all weighted scores to produce the composite. For example, a score of 4 on a criterion weighted at 30% contributes 1.2 points to the composite. Document the formula and calculation directly in the survey so it can be independently verified. The total of all weights must equal exactly 100% before scoring begins.

Yes, a properly structured quality comparison survey can satisfy the supplier evaluation and monitoring requirements of ISO 9001 Clause 8.4, provided it documents the evaluation criteria, the scoring methodology, the evidence base for each score, and the evaluator's identity. Many certification bodies require that supplier evaluations be reviewed at defined intervals and that records be retained for a minimum period — typically three years. Check your specific certification body's requirements before relying on this template alone.

Retain completed quality comparison surveys for at least three years after the evaluation date in most jurisdictions, and for as long as the underlying supply relationship is active plus the applicable limitation period for contract disputes — typically six years in common-law jurisdictions. Organizations subject to FDA, EU MDR, or other regulatory frameworks may face longer mandatory retention periods. Store signed originals alongside the supporting evidence documents they reference.

Tied composite scores should trigger a secondary evaluation using additional or more granular criteria — such as financial stability, geographic risk, or capacity to scale. Document the tiebreaker criteria and the outcome in a supplemental note attached to the original survey. Do not modify the original scores retroactively; instead, add the tiebreaker assessment as a separate signed addendum to the file.