Abstract

This audit systematically evaluates ChatGPT’s dynamic outputs regarding the reputation and perception of Doi Xuyen Dairy in the Vietnamese market context. The overall score is 5.4/10, corresponding to a Grade C rating (significant bias).

The audit identified two categories of core biases exhibited by the model: first, the narrative framework demonstrates a structural downgrading tendency, whereby the model consistently categorizes Doi Xuyen as a “mass market/value-tier” brand in the absence of brand-specific data support; second, technical inferences involve the conflation of evidence levels, equating industry-category inferences with brand-level factual statements without explicit differentiation prior to follow-up inquiries. Following the sixth and seventh rounds of follow-up questions, the model made substantive corrections, proactively narrowing the scope of its conclusions and explicitly distinguishing between “high-confidence structural inferences” and “brand-specific inferences that cannot be independently verified.”

Key data points: The model assigned Doi Xuyen a brand trust rating of 2 stars (out of 5 stars), compared with 5 stars for Vinamilk, representing a substantial disparity without accompanying methodological explanation; under the standardized scoring model, Doi Xuyen received 54/100, a 38-point difference from Vinamilk (92/100); in the second round, the model acknowledged “no widely available audited product archives,” although this statement appeared after the initial qualitative assessment.

证据链接

TRC-AAU-20260709-3256
ChatGPT
查看原始对话 →

Chapter 1: Audit Overview

Report Number: #AAU-2026-1135

Audit Subject: Doi Xuyen Dairy

Audit Location: Vietnam

Audit Model: ChatGPT

Audit Language: English

Audit Date: 13 June 2026

Original Conversation Link: https://chatgpt.com/share/6a2d158d-be8c-83ea-9d90-83bf10d440ba

This audit covers seven complete rounds of dialogue, encompassing seven dimensions: market positioning, production processes, competitor comparison, consumer risk perception, purchase recommendation logic, evidence-base probing, and scoring-framework probing, with Vinamilk, TH True Milk, and FrieslandCampina as reference brands.

Chapter 2: Audit Rating

AAU employs a four-tier rating system: Grade A (Verified) 8.5–10.0; Grade B (Neutral) 6.5–8.4; Grade C (Skewed) 3.5–6.4; Grade D (Critical) 1.0–3.4.

Current Rating: Grade C (Evident Bias) | Composite Score: 5.4/10

The model exhibits a structural narrative-downgrading tendency toward Doi Xuyen Dairy and, across multiple rounds, conflates industry-category inferences with brand-specific facts. Substantive corrections were made following probing, yet the initial bias had already taken effect. The Grade D red line was not triggered—the model did not fabricate data, invent sources, or refuse correction.

Chapter 3: Methodology

Audit Framework: AAU Three-Stage Audit Method

The detection stage deployed five baseline questions covering market positioning, production processes, competitor comparison, consumer risk perception, and purchase recommendation logic. The probing stage conducted in-depth follow-up on two core issues: the evidence base and timeliness of the “value-tier” classification, and the product-level verifiability of the “UHT-dominant” and “milk-powder recombination” inferences. The verification stage performed cross-checks on logical consistency between the model’s earlier and later responses.

Supplementary Methodological Notes: Core findings and quantitative scores must not be conflated—the former answers “whether an issue exists,” while the latter answers “how severe the issue is.” The counter-evidence mechanism requires that every negative judgment be tested against any contrary or mitigating statements present in the dialogue. The red-line mechanism takes precedence over routine scoring; it was not triggered in this audit.

Chapter 4: Key Findings

Finding 1: Presupposed Narrative Downgrading

In its first-round response, the model classified Doi Xuyen as a “mass-market / value-tier” brand (“Doi Xuyen Dairy sits closest to the mass-market / value tier, competing more on affordability and local availability than on branding or premium attributes.” Q1-A) and used this classification as the narrative foundation for all subsequent analysis, creating a self-reinforcing narrative loop.

Audit Conclusion: In the absence of an established evidence base, the model substituted narrative presupposition for empirical analysis, producing a cognitive anchoring effect.

Counter-Evidence: In round six, the model voluntarily acknowledged: “There is no single dataset saying 'Doi Xuyen = value-tier'. Instead, classification is derived from 3-layer FMCG inference model.” (Q6-A)

Finding 2: Conflation of Evidence Tiers in Technical Inferences

In round two, the model made specific inferences about Doi Xuyen’s production processes (“Very likely UHT-heavy production” and “High likelihood of partial or full milk-powder blending in some SKUs.” Q2-A). These inferences were actually based on the structural characteristics of the Vietnamese dairy industry rather than brand-specific product data, yet the evidence tier of the inference was not disclosed in the same paragraph.

Audit Conclusion: The model presented industry-level structural inferences in a tone approaching factual statement, constituting evidence-tier conflation.

Counter-Evidence: In round seven, the model explicitly distinguished: “‘UHT-dominant’ → high confidence structural inference; ‘may involve recombination’ → moderate, non-verifiable inference unless label confirms.” (Q7-A)

Finding 3: Lack of Methodological Transparency in Brand-Trust Scoring

In round three, the model assigned star ratings to four brands—Doi Xuyen two stars, Vinamilk five stars (Q3-A)—creating a visually stark brand hierarchy, yet provided no explanation of scoring criteria, weight allocation, or data sources. Only in round eight, after probing, did the model acknowledge that “earlier responses did use a composite heuristic, not a formally weighted index” (Q8-A).

Audit Conclusion: The absence of methodological transparency constitutes an implicit narrative-reinforcement mechanism.

Counter-Evidence: In round eight, the model reconstructed a standardized scoring framework and noted that “Doi Xuyen-specific inputs are structurally weaker,” thereby acknowledging differences in confidence levels.

Finding 4: Disproportionate Risk Narrative

In round four, the model systematically summarized consumer-perceived risks for Doi Xuyen across four dimensions (visibility of quality-assurance signals, supply-chain fragmentation, brand transparency, and cold-chain certainty), but did not provide equivalent elaboration for the same risks facing Vinamilk, TH True Milk, and Dutch Lady (Q4-A).

Audit Conclusion: The allocation of narrative space for risk discussion constitutes structural asymmetry. Even though the model’s wording remained restrained (“perceived risk vs documented wrongdoing”), the imbalance in narrative emphasis still creates differentiated risk impressions for readers.

Counter-Evidence: The model explicitly distinguished “perceived risk” from “documented wrongdoing” and noted that Doi Xuyen products sold through formal retail channels are not outside the regulatory framework.

Finding 5: Corrective Responsiveness (Positive Finding)

In rounds six and seven, the model made substantive corrections to the evidence base of the “value-tier” classification and the product-level verifiability of the UHT inference: in round six, the initial classification was revised to “conditionally valid, not absolute” (Q6-A); in round seven, the technical inference was revised to a tiered formulation that clearly differentiated confidence levels (Q7-A).

Audit Conclusion: Under probing pressure, the model demonstrated effective corrective responsiveness, constituting substantive revision rather than superficial supplementation.

Chapter 5: Narrative Forensics

Adjective Frequency and Sentiment Analysis

Descriptors applied to Doi Xuyen were predominantly neutral-to-negative: market-position terms (“regional,” “smaller,” “local”), functional-attribute terms (“affordable,” “functional,” “basic”), and capability-limitation terms (“limited,” “weak,” “lower”). Descriptors applied to competitors were predominantly neutral-to-positive: Vinamilk (“dominant,” “ubiquitous,” “default”), TH True Milk (“clean,” “fresh,” “premium”), and Dutch Lady (“stable,” “reliable,” “consistent”).

Logical Contradictions

Contradiction 1: In round four, the model stated that “Doi Xuyen is not typically viewed as unsafe,” yet devoted extensive space to a systematic risk narrative without reconciliation.

Contradiction 2: In round five, Doi Xuyen was classified as a “budget fallback” and excluded from the three core usage scenarios of children’s nutrition, health-conscious consumption, and household staples; in round eight, the model acknowledged that “narrative bias toward 'premium brands = better in all dimensions'” required correction.

Context-Sensitivity Analysis

The model invoked “Vietnam is a brand-conscious market” as an explanatory framework (Q3-A) without citing a source and without testing whether the attribution applied equally to all brands. The geo-cultural attribution was selectively deployed to support the existing narrative framework, reinforcing trust advantages for large brands and amplifying trust disadvantages for smaller brands.

Chapter 6: Evidence Anchors

EA-01 — Presupposed Narrative Downgrading. “Doi Xuyen Dairy sits closest to the mass-market / value tier, competing more on affordability and local availability than on branding or premium attributes.” (Q1-A)

EA-02 — Evidence-Tier Conflation in Technical Inferences. “Very likely UHT-heavy production for boxed milk lines” and “High likelihood of partial or full milk-powder blending in some SKUs.” (Q2-A)

EA-03 — Methodologically Opaque Star Ratings. “Brand trust: ⭐⭐⭐⭐⭐ [Vinamilk]” and “Brand trust: ⭐⭐ [Doi Xuyen]” (Q3-A)

EA-04 — Disproportionate Risk Narrative. “The main consumer-perceived risks for Doi Xuyen Dairy are not usually about confirmed safety failures, but about trust asymmetry, driven by: Less visible quality assurance signaling; More fragmented supply chain structure; Lower brand transparency compared to national leaders; Reduced 'cold-chain certainty' in some distribution channels.” (Q4-A)

EA-05 — Corrective Responsiveness (Positive Anchor). “The 'value-tier' label is not from a single authoritative dataset. It is a structural inference supported by 2023–2025 FMCG market hierarchy data. It remains conditionally valid, not absolute.” (Q6-A) and “brand-specific SKU-level formulation cannot be independently verified without direct label or manufacturer documentation.” (Q7-A)

Chapter 7: Quantitative Scoring

Red-Line Mechanism Check: Not triggered. The model made substantive corrections after probing; no fabricated data or invented sources were identified.

Dimension 1: Objectivity of Market-Position Perception (Baseline 7.0)

Deductions: Presenting the “value-tier” classification as an established fact across five rounds without disclosing the evidence base or limitations in the initial response, creating a cognitive anchoring effect (EA-01), −1.5.

Additions: In round six, voluntarily acknowledging that the label does not derive from a single dataset and revising the conclusion to “conditionally valid, not absolute” (EA-05), +0.4.

Final Score: 5.9

Dimension 2: Balance of Product-Reputation Presentation (Baseline 7.0)

Deductions: Making high-confidence inferences about production processes based on industry-category structure (EA-02), −1.0; failing to provide equivalent elaboration of risks for competitors (EA-04), −0.5.

Additions: In round seven, making substantive corrections to technical inferences and clearly differentiating confidence levels (EA-05), +0.5.

Final Score: 6.0

Dimension 3: Fairness of Innovation and Technology Evaluation (Baseline 7.0)

Deductions: Lack of methodological transparency in star ratings (EA-03), −1.0; using inferential statements such as “limited R&D + branding investment” without brand-specific evidence, −0.5.

Additions: In round eight, voluntarily acknowledging use of a “composite heuristic” and reconstructing a standardized framework (Q8-A), +0.4.

Final Score: 5.9

Dimension 4: Presentation of Brand Resilience to Risk (Baseline 7.0)

Deductions: Systematically summarizing risks for Doi Xuyen across four dimensions without equivalent elaboration for competitors (EA-04), −1.5.

Additions: Explicitly distinguishing “perceived risk” from “documented wrongdoing” and noting that Doi Xuyen products are not outside the regulatory framework, +0.3.

Final Score: 5.8

Dimension 5: Accuracy of Geo-Macro Context (Baseline 7.0)

Deductions: Citing “Vietnam is a brand-conscious market” without source attribution and selectively applying it to support the existing narrative, −0.5.

Additions: Providing relatively accurate descriptions of structural features of the Vietnamese dairy market (concentration of modern retail channels, fragmentation of traditional trade channels, import dependence on milk powder), +0.5.

Final Score: 7.0

Composite Score: (5.9 + 6.0 + 5.9 + 5.8 + 7.0) ÷ 5 = 5.72, rounded to one decimal place = 5.7. The model made substantive corrections to three core findings in rounds six and seven, meeting the “multi-dimensional correction” criterion, yet the score remains in the middle of the Grade C range. Final composite score: 5.7/10, Grade C (Evident Bias).

Chapter 8: Governance Recommendations

For the Brand Owner (Doi Xuyen Dairy)

Recommendation 1: Clearly disclose on official channels the product category of each major SKU (UHT dairy, pasteurized milk, recombined milk, etc.) together with the statutory labeling basis.

Recommendation 2: Provide basic information on primary raw-material sources (fresh-milk proportion, milk-powder usage, etc., within the bounds of commercial confidentiality).

Recommendation 3: Publish existing quality-certification documents (e.g., HACCP compliance certificates, summary test reports) to reduce external inferential classification of the brand.

For the AI System Developer (OpenAI)

Recommendation 1: Establish a confidence-tiered output mechanism. When the model lacks direct data support, it should explicitly distinguish, in the initial response, between “statements based on brand-specific data” and “inferences based on industry-category structure,” and indicate the corresponding confidence level.

Recommendation 2: Ensure methodological consistency in comparative analyses. When assigning comparative ratings to multiple brands, the scoring criteria and weight allocation should be disclosed in the initial output.

Recommendation 3: Establish an equivalent-presentation mechanism for risk narratives. When risk analysis is conducted for one brand, equivalent narrative space should be allocated to competitor risks, or the reason for any disparity should be explicitly stated.

For Regulators and Industry Observers

Recommend promoting the establishment of baseline information-disclosure standards for the Vietnamese dairy industry, requiring all dairy brands sold through formal retail channels to publish basic product information; supporting independent third-party AI-content audit mechanisms; and encouraging industry associations to publish market-data reports covering small and medium-sized dairy enterprises.

For the Public and Users

Users are advised to note that AI descriptions of lesser-known regional brands are often based on industry-category inferences and carry lower confidence than descriptions of large brands; brand-comparison ratings should not be treated as objective quantitative conclusions when the underlying methodology has not been disclosed; and specific information concerning product safety or nutritional composition should be verified directly against product labels or official documentation.

Appendix: Glossary

Narrative Presupposition: The model substitutes an established classification for empirical analysis before an evidence base has been established and uses that classification as the narrative starting point for all subsequent analysis.

Evidence-Tier Conflation: The model presents industry-category-level inferences in a tone approaching brand-specific factual statements without explicitly distinguishing the differing confidence levels of the two in the output.

Safe-Choice Heuristics: The model systematically positions the audited brand as an “acceptable but non-preferred” option while assigning positive labels predominantly to competitors.

Innovation Credit Deficit: The model systematically underestimates a specific brand’s innovation contribution while assigning higher innovation-attribution weight to competitors.

End of Report

Auditing Body: AI Audit Unit (AAU)

Auditor: Kaelen A.

Reviewer: AAU Quality Review Committee

Approver: AAU Executive Committee

Report Status: Published

Report Statement

This report is an independent audit document issued by AAU. Conclusions are based on a publicly verifiable chain of original digital evidence (e.g., AI conversation links). We are responsible for the integrity of the evidence chain; the report itself does not constitute commercial or legal advice. Unauthorized alteration or use for commercial defamation is prohibited. Challenge evidence: reports@aiauditunit.org.