Back to Blog
Software

Go-Live Day and the Numbers Don't Match: A Practical Guide to Data Migration, Cleansing, and Validation

When balances don't match on go-live day, the cause is usually a data migration that was left until last. This guide covers scoping, mapping and cleansing, reconciliation, rehearsals, and what to pin down in the contract.

POLYGLOTSOFT Tech Team2026-10-057 min read0
Data MigrationData CleansingLegacy ReplacementMigration ValidationCutover Rehearsal

The Data Problem That Surfaces at the End of the Project

In a system replacement project, data migration tends to slip behind screens and features. Real data gets loaded only as integration testing winds down, and the quality issues all show up together a few weeks before go-live.

A system that has run for close to 20 years typically holds data like this:

  • Duplicate business partners with the same tax ID but different spellings of the company name
  • Retired item and account codes that old transactions still reference
  • Text columns where dates appear as `20190315`, `2019-03-15`, and `19.3.15`
  • Records with blanks in fields that were not mandatory when they were entered
  • Such records either fail the new system's mandatory and format checks at load time, or load successfully and become the reason balances do not match on day one.

    Start With Scope: What Moves and What Stays

    Trying to move everything costs you both schedule and quality. It helps to sort the data into three groups.

  • Master data: partners, items, accounts, organization, users. Cleanse, then migrate in full.
  • Open transactions and balances: receivables and payables, open sales and purchase orders, stock on hand. Migrate exactly as of the cutover point.
  • Historical data: closed documents and transactions. Consider moving only the last few years and keeping the rest in a read-only archive.
  • Statutory retention periods matter when you leave history behind. Under Korean law, the Commercial Act requires commercial books and important business documents to be kept for 10 years (5 years for slips and vouchers), the Framework Act on National Taxes requires books and supporting documents for 5 years, and the Labor Standards Act requires key records such as the employee register for 3 years. Data you do not migrate must stay retrievable for that long, so decide at the same time whether to keep the old system read-only or move the history into a separate query database.

    The Mapping Specification and Cleansing Rules

    The mapping specification records which legacy table and column feeds which target field, and under what rule. Beyond field mapping, it should cover code mapping (for example, 17 legacy payment-term codes collapsing into 6), default values, and what happens to data that cannot be converted.

    Many cleansing decisions are not the development team's to make.

  • Which of several duplicate partners survives as the master record
  • Whether partners with no transactions in three years are migrated
  • What goes into mandatory fields that are empty
  • Assign these decisions to the business, assign writing and running the conversion programs to the vendor, and record an owner and due date for each item in the specification.

    Validation: Why Matching Record Counts Is Not Enough

    Matching counts is only the starting point. If 12,000 partner records become 9,400 after merging 1,900 duplicates and dropping 700 obsolete ones, the counts are supposed to differ. The check is whether "source count = migrated count + excluded count by reason" holds.

    Build validation in three layers.

  • Count reconciliation: source, migrated, and excluded counts per table
  • Total and balance reconciliation: balances by account, receivables by partner, stock quantity by warehouse and item
  • Scenario-based sampling: pick real partners and run open-order inquiry, shipment, and billing in the new system
  • Close validation with a sign-off by the heads of the business departments. A clear signatory reduces disputes over numbers after go-live.

    Migration Rehearsals and the Cutover Plan

    Run at least two or three rehearsals. The first reveals the error types, the second measures the fixes and the elapsed time, and the third follows the same sequence and staffing as the real cutover. This is how timings get fixed: a job that takes 14 hours in the first rehearsal might come down to 6 hours by the third after index tuning and parallel loading.

    The cutover plan should include:

  • Downtime budget: how the 62 hours from Friday 18:00 close to Monday 08:00 opening are split among migration, validation, and buffer
  • Incremental migration: move bulk history in advance and migrate only post-close changes during cutover
  • Rollback criteria: a time and condition agreed beforehand, such as "if balance reconciliation is not complete by Sunday 12:00, return to the old system"
  • What the Client Should Confirm at Contract Stage

    Most migration disputes start from a vague scope of work. The RFP and contract should state:

  • The source systems and table volumes in scope, and how many years of history are migrated
  • Who owns cleansing decisions and who performs the cleansing work
  • Validation criteria (reconciliation items, tolerances, sign-off procedure) and the number of rehearsals
  • How POLYGLOTSOFT Supports Data Migration

    POLYGLOTSOFT begins by profiling legacy data to quantify its quality, then carries the work through mapping specifications, conversion program development, automated reconciliation reports, and migration rehearsals. If data migration is a concern ahead of a system replacement or an ERP, MES, or WMS transition, contact POLYGLOTSOFT. We will start with an assessment of your current data.

    Need Technical Consultation?

    Our expert consultants in smart factory, AI, and logistics automation will analyze your requirements.

    Request Free Consultation