Back to Blog
Data Quality by Kofi Mensah

An Institutional Data Quality Framework for Real-World Asset Portfolios

Data quality for institutional RWA portfolios is not a pipeline configuration. It is a set of invariants your data must satisfy before reconciliation is even attempted. Here is how to define and enforce them.

An Institutional Data Quality Framework for Real-World Asset Portfolios

Data quality frameworks in financial services tend to focus on completeness and accuracy: are all the required fields populated, and are the values correct? Those properties matter, but they are insufficient for institutional ownership records at a real-world asset portfolio. The relevant data quality standard for RWA ownership records is not whether individual records look correct in isolation. It is whether the records collectively satisfy a set of invariants that the reconciliation process can rely on.

An invariant, in this context, is a property that must be true for the data to be usable in a specific way. If any invariant is violated, the downstream process that depends on it either produces wrong results silently or fails noisily. The silent failure case is worse. Here is the framework we apply to institutional RWA ownership records at OpenAssets.

Category One: Identifier Completeness and Consistency

Every position record must carry at least one identifier that maps unambiguously to a canonical instrument within the system's reference data. An identifier is not just a non-null value in an identifier field. It is a value that resolves to a known instrument in the reference data, where the instrument record includes the asset class, the issuer, the relevant jurisdiction, and any applicable regulatory identifiers.

The consistency requirement extends across record sets. If position record A and position record B in different custodian feeds both refer to the same instrument, they must carry identifiers that resolve to the same canonical instrument entry. If they resolve to different instruments, or if one resolves and one does not, the reconciliation process cannot compare them meaningfully.

Identifier consistency failures are among the most common source of spurious reconciliation breaks. A tokenized infrastructure fund might be identified by its internal code in one custodian feed and by its ISIN in another. Both identifiers are legitimate. If the mapping between them is absent or stale, the reconciliation will generate breaks that are not genuine discrepancies. These breaks require human investigation to close, and they often reach month-end queues because the root cause is not obvious from the break itself.

The data quality check here is: for every position record in every feed, does the identifier resolve to a canonical instrument in the reference database, and does that resolution produce the same canonical instrument as any other identifier for the same instrument in any other feed? This is not a check that can be done field by field. It requires a cross-feed comparison, which means it needs to be part of the ingest validation rather than a standalone data quality sweep.

Category Two: Temporal Validity and Snapshot Labeling

Ownership records are point-in-time snapshots. A position record that says Account A holds X units of Asset Y is only meaningful relative to a specific moment in time. Data quality for position records requires that every record carry an explicit snapshot timestamp, that the timestamp is accurate, and that records from different sources with the same nominal period can be compared on a consistent temporal basis.

The failure mode here is subtle. Custodians take end-of-day snapshots at different times, using different settlement conventions. One custodian's December 31 snapshot captures positions as of 5:00 PM EST using trade-date settlement. Another's captures positions as of midnight UTC using settlement-date booking. A naive comparison treats both as the same point in time because both are labeled December 31. They are not the same point in time, and comparing them without accounting for the temporal and settlement convention difference will produce timing breaks on any positions where activity occurred during the relevant window.

The temporal validity check requires that every feed's snapshot metadata is documented: the exact time of snapshot, the time zone, and the settlement convention used. This metadata must be part of the record schema, not in a separate documentation file that has to be looked up manually. When the reconciliation engine applies temporal adjustments for timing break classification, it reads this metadata from the record rather than relying on feed-level configuration that may be out of date.

Category Three: Cross-Record Referential Integrity

An ownership record does not stand alone. It is connected to a series of transaction records that explain how the ownership came to be, a set of corporate action records that explain any adjustments, and an account record that describes the holder. The referential integrity requirement is that every record that purports to reference another record actually resolves to a record that exists and is consistent.

In practice, this means: every position record carries an account identifier that resolves to an account in the account register. Every transaction record carries an instrument identifier that resolves to an instrument in the reference data. Every corporate action adjustment carries a reference to the corporate action event record. If any of these references are broken, the record is orphaned and cannot be used in aggregate calculations or audit reconstruction without manual investigation.

Orphaned records are a common problem in systems that have grown over time through the integration of multiple data sources. A feed that was integrated two years ago may reference account identifiers that were valid at the time but have since been superseded by account restructuring. If the reference database was updated without reconciling existing records, a significant portion of those records may now carry references that do not resolve. The data looks correct at the field level but is broken at the relational level.

Category Four: Corporate Action Completeness

The ownership record for any instrument that has been through corporate action events is only correct if all applicable events have been applied and applied consistently across all record sets. A position that appears to show a quantity discrepancy between two custodian feeds is often not a discrepancy in the position at all. It is a corporate action event that one custodian has applied and another has not.

Data quality for ownership records therefore requires maintaining a corporate action event register that tracks, for each instrument in the portfolio, every event that has occurred during the period, the effective date, and whether the event has been confirmed as applied in each custodian's records. A reconciliation process that does not explicitly account for corporate action status will conflate corporate action lags with genuine discrepancies.

The check is: for every instrument in the portfolio, is the corporate action event register complete as of the current snapshot date, and does each custodian feed's position quantity reflect the expected post-event state? This cannot be checked passively. It requires an active comparison of expected post-event quantities against observed quantities, which means the corporate action event data has to be maintained separately from the position data and linked to it through the instrument identifier.

Category Five: Provenance Traceability

Every derived value in the ownership record system, every reconciled position, every aggregate holding total, every reported quantity, must be traceable to the source records that produced it. Provenance traceability is not primarily a compliance property, though it is that too. It is a data quality property that determines whether the system can detect and explain its own errors.

When a reconciled position turns out to be wrong, the investigation requires tracing back through the derivation chain: which source records were combined, what transformations were applied, what matching logic was used, where in the chain the error originated. Without provenance metadata carried on every derived record, this reconstruction requires a developer to manually trace the pipeline, which is expensive and not always reliable when the pipeline has been modified since the records were produced.

Provenance metadata should be a required field on every record that results from a transformation or reconciliation. It should identify the source record IDs, the processing step, and the transformation parameters. This is additional storage cost. It is much less expensive than the investigation and audit costs of operating without it.

Applying the Framework: Where to Start

Not all five categories are equally urgent for every portfolio. The right prioritization depends on where the current failure modes are concentrated. For portfolios that have high break volumes with slow resolution, the likely culprits are Category One (identifier consistency) and Category Two (temporal validity). For portfolios that are passing reconciliation cleanly but producing aggregate figures that occasionally cannot be explained, the likely issue is Category Three or Four. For portfolios undergoing regulatory review, Category Five is the immediate priority.

We are not suggesting that all five categories need to be addressed simultaneously before any data quality improvement is possible. Start where the current pain is highest. Build each category's invariants into the validation layer so they are enforced at ingest rather than discovered at reconciliation. The framework is a complete picture of what institutional ownership data quality requires. The implementation path through it can be incremental.

See OpenAssets in practice

Request early access to see how the platform handles your specific custody structure and reconciliation workflow.

Request Early Access

More from the OpenAssets Blog