Back to Blog
AI

No One Can Review Every Journal Entry: Upgrading Internal Audit with Machine Learning Anomaly Detection

Sampling 300 of 300,000 journal entries will most likely miss the few that matter. This post explains how to combine unsupervised anomaly detection with rules, and how to deliver risk rankings and explanations sized to what auditors can review.

POLYGLOTSOFT Tech Team2026-10-117 min read4
Anomaly DetectionInternal AuditJournal Entry TestingMachine LearningERP

The Limits of Sample-Based Auditing

Suppose a company posts 300,000 journal entries a year and its internal audit team samples 300 of them. That is a review rate of 0.1%. If 30 problematic entries (0.01%) are hidden in the population, the chance that a random sample of 300 contains none of them is about 97%. Sampling works well for confirming that controls operate as designed, but it is a poor tool for finding a handful of abnormal transactions.

That is why many organizations add rule-based checks: weekend or late-night postings, amounts ending in 000, amounts just under an approval limit. Rules alone still fall short.

  • They only catch known patterns. Anyone who knows the rules can step around them.
  • A single condition is usually innocent. Weekend postings are routine at period close, so one rule can flag thousands of entries and produce a list nobody reads.
  • What Makes an Entry "Anomalous"

    Anomalies show up in combinations of conditions, not in any single one.

  • Amount: values outside the usual range for that account or vendor, repeated amounts just below a limit
  • Timing: postings right before or after close, large gaps between posting date and document date
  • Account pairing: debit and credit accounts that rarely appear together
  • Preparer: a user posting to accounts they do not normally handle, a high share of manual entries
  • Approval path: the same person preparing and approving, or an unusually short approval time
  • A flagged entry is not proof of fraud. Input errors, deliberate fraud, and legitimate business exceptions call for different responses: correction and training, investigation, or a refinement of the rules. The model's job ends at shortlisting entries worth a look. The judgment belongs to the auditor.

    Choosing a Model: Starting Without Labels

    Most companies have almost no entries confirmed as fraudulent, so the realistic starting point is unsupervised anomaly detection, which needs no labels.

  • Isolation Forest: treats records that are easy to isolate through random splits as anomalies. It trains quickly and suits tabular journal data.
  • Autoencoder: learns to reconstruct normal entries and flags those with high reconstruction error. It is strong when categorical patterns such as account pairings are complex.
  • Existing rules are not thrown away. They become features or are blended into the score. Once auditors have confirmed a few hundred cases, a supervised model such as gradient boosting can be added, while the unsupervised model stays in place to catch new types of anomaly.

    Keeping False Positives Manageable

    The threshold should come from human capacity, not from the model. Two auditors reviewing 25 entries a day handle 50 a day, or 1,000 over 20 working days a month. With 25,000 entries a month, they can look at the top 4%. So instead of cutting at a fixed threshold, deliver a ranked list of the top N entries by risk score, and measure success by the share of those N that led to real action.

    A bare score forces the auditor to take the entry apart from scratch. Feature contributions such as SHAP values let the system show two or three reasons with each flag, for example "preparer does not normally use this account" or "approved within 2 minutes". That shortens review time and builds trust in the results.

    Operations and Data Preparation

  • Data extraction: you need journal headers and lines, approval history, user and authorization master data, and vendor master data. Approval history often lives in a separate workflow system, so confirm the linking key first.
  • Periodic retraining: retrain quarterly or semiannually, and always after a reorganization or a chart-of-accounts change. Closing months and ordinary months have different distributions, so period characteristics belong in the features.
  • Feedback loop: record each review outcome as error, suspected fraud, or normal exception. These records become the labels for the next model, and recurring normal exceptions become exclusion rules.
  • How POLYGLOTSOFT Helps

    POLYGLOTSOFT builds this in stages: integrating ERP journal and approval data, developing the anomaly detection model, and delivering a review screen where auditors see each flagged entry with its reasons and record their findings. We recommend validating detection results on one to two years of historical data before expanding into ongoing operation. If you are considering moving internal audit toward full-population testing, contact POLYGLOTSOFT.

    Need Technical Consultation?

    Our expert consultants in smart factory, AI, and logistics automation will analyze your requirements.

    Request Free Consultation