Skip to main content

Blog

CMC Documents QC: Source Data Verification Using AI and Rules-Based Approaches

Category:

CMC documents play a critical role in quality. Documents often contain information derived from multiple source systems, including LIMS, Manufacturing, Stability test systems and other databases.

A key quality control (QC) challenge is ensuring that the information presented in these documents accurately reflects the underlying source data.

Even when a document is well written, complete, and internally consistent, it may still contain errors if the underlying values, dates, CMC events, or interpretations do not match the source records.

Effective CMC document QC must therefore prioritize source data verification (SDV): systematically verifying that information reported in a CMC document is accurate, traceable, and supported by the original source evidence.

A Practical Workflow for Source Data Verification

Retrieve the corresponding source evidence

For each extracted element, identify the corresponding source record.

Source retrieval may involve several systems, excels, validated data extracts, or document repositories.

Matching should use reliable identifiers and contextual information. A source match should not be based solely on semantic similarity. Two records may discuss the same quality data while referring to different dates, assessments, or episodes.

If the correct source cannot be identified confidently, the result should be marked as requiring review rather than treated as verified.

Compare the document value with the source value

Once the source record has been identified, compare the reported information with the authoritative source.

Different data types require different verification methods:
  • Exact values: Compare identifiers, coded terms, dates, numerical values, and categorical fields.
  • Numerical values: Consider units, rounding, precision, decimal separators, and approved conversions.
  • Dates and timelines: Account for documented corrections, time zones where relevant, and approved date conventions.
  • Derived values: Recalculate using approved specifications and verify the input values.
  • Narrative statements: Determine whether the statement accurately represents the source evidence without introducing unsupported facts or changing Quality meaning.

Resolve findings through controlled human review

Not every difference is an error. Some differences result from approved data transformations, source updates, quality interpretation, or legitimate differences in reporting conventions.

The reviewer should determine whether the document requires correction, the source record requires clarification through the appropriate process, or the discrepancy is justified and can be closed with documented rationale.

The system should preserve the original finding and its resolution rather than silently overwriting the result.

AI Versus Rules-Based Approaches for Source Data Verification

Both approaches can support SDV, but they solve different problems

Rules-based verification

Rules-based verification uses predefined conditions to compare source data with information reported in a CMC document.

Advantages

Rules are deterministic, repeatable, and generally easier to explain and validate. When the correct source record and approved comparison logic are established, the same input should produce the same result. This makes rules particularly suitable for high-volume checks involving structured data and explicit requirements.

Rules can also support controlled execution, predictable audit trails, and clear acceptance criteria.

Limitations

Rules are only as good as their specifications and source mappings. They may fail when document layouts change, data structures differ, or a comparison requires CMC context. Exact-match rules can generate false positives when valid transformations or paraphrasing occur. Conversely, a rule may miss an error if the relevant field or comparison condition was never defined.

Rules can also become expensive to maintain when different document types require different extraction methods and comparison logic.

AI-based verification

AI-based verification uses language models or other AI techniques to extract information, interpret Quality statements, and assess whether the reported content is supported by source evidence.

Advantages

AI is particularly useful for unstructured or semi-structured CMC summaries. It can help identify relevant statements, link them to candidate source passages, interpret paraphrased information, and flag discrepancies that depend on context rather than exact equality.

It can also reduce manual effort in reviewing lengthy narratives and complex documents.

Limitations

AI can misinterpret quality terminology, select the wrong source record, overlook a qualification, or generate an unsupported discrepancy. It may also produce different results across runs or model versions.

Semantic similarity does not prove that a statement is correct. A narrative can sound plausible and still contain an incorrect date, time one/stability, laboratory data, or outcome.

Why a Hybrid Approach Is the Most Practical Solution

For CMC document QC, the most effective approach is generally to combine rules-based verification with AI-assisted interpretation.

A practical hybrid workflow would operate as follows:
  • Document processing: Identify the document type, version, structure, and relevant sections.
  • Information extraction: Use rules, templates, or AI to extract the factual statements and data elements requiring verification.
  • Source matching: Retrieve candidate source records using reliable identifiers, metadata, and approved mappings.
  • Rules-based comparison: Verify exact values, dates, units, calculations, and other explicitly defined requirements.
  • AI-assisted comparison: Assess narrative statements, contextual differences, paraphrasing, and potential changes in quality meaning.
  • Evidence-based finding generation: Link each finding to the exact document passage and source record, including relevant values and locations.
  • Risk-based human review: Route unresolved, ambiguous, high-risk, and significant findings to qualified reviewers.
  • Controlled resolution: Record the decision, rationale, corrective action, reviewer, and closure status in an auditable workflow.

Rules-based methods provide reliability and repeatability for clearly defined comparisons. AI can extend QC to narrative interpretation and contextual discrepancies that are difficult to capture through predefined rules. Neither approach is sufficient on its own for every verification scenario.

A well-designed hybrid solution combines deterministic comparisons, AI-assisted interpretation, explicit source traceability, and qualified human review.

The guiding principle is simple: verify against the source, use rules for deterministic accuracy, use AI to interpret context, and retain human oversight for consequential decisions.

Looking to simplify source data verification across your CMC documents? See how our QC Automation solution balances deterministic rules with AI context to keep your data accurate, traceable, and audit-ready.

Share the Blog :

Previous Post

Next Post

Related Posts

Clinical Documents QC: Source Data Ve…

Clinical documents play a critical role in demonstrating the safet…

Reg Operations: Why Rules-Based Syste…

From regulatory submission management and document classification …

Clinical Documents QC: AI and Rules-B…

Clinical documents play a critical role in demonstrating the safet…

CONNECT WITH US

    Subscribe
    The First Step

    Let's talk about how DDi can help you