Skip to content

Data & BI

Data and BI, modeled as first-class architecture.

This is not only an AI platform. Ingestion, transformation, the lakehouse, the warehouse, the semantic layer and BI are modeled together - with contracts, lineage, quality and ownership as part of the design.

Data warehouse & BI

From operational systems to analytics - one pipeline.

Every stage is a modeled component, and the governance attributes cut across all of them.

  1. Operational Systems
  2. Ingestion
  3. ETL / ELT
  4. Data Quality
  5. Data Lake / Lakehouse
  6. Data Warehouse
  7. Data Mart
  8. Semantic Layer
  9. BI / Analytics

Cross-cutting

  • Data contracts
  • Classification
  • Lineage
  • Freshness
  • Governance
  • Quality
  • Metadata
  • Ownership

From the reference model

The data plane of a real reference architecture.

The data pipeline and its governance facets - ownership, classification, quality, freshness and retention - projected from the same model that drives the interactive blueprint.

Pipeline

  1. Ingestion Pipeline

    Azure

  2. Lakehouse

    Azure

  3. Data Warehouse

    Azure

  4. Semantic Layer

    Azure

  5. BI / Analytics

    Azure

  6. Vector Store

    AWS

Data governance

Data domainOwnerClassificationQualityFreshnessRetention
Enterprise DocumentsKnowledge ManagementconfidentialValidated on ingestDaily7 years
Operational RecordsBusiness OperationsconfidentialContract-checkedHourly5 years
Analytics MartsAnalyticsinternalTested transformsDaily3 years
Agent MemoryAI PlatformconfidentialEphemeralReal-time30 days
Projected from the reference model

Lineage, ownership, classification, quality and retention travel with the data in thereference model - not tracked in a separate spreadsheet.

Contracts & quality

Data contracts, quality checks and freshness SLAs are modeled at the boundary, so downstream consumers can trust what they receive.

Lineage & metadata

Lineage, classification and metadata travel with the data, making impact analysis and governance tractable.

Ownership & governance

Data ownership and governance policies are explicit, so accountability doesn't evaporate as data moves.

Design the data platform as a system.