Skip to content

๐Ÿ—๏ธ Epic 3 โ€” MDM & Data Warehouse Build

ID Task Status Deliverable / Reference
E3-1 Create master products list โœ… dim_master_products โ€” 18,906 golden records ยท ETL 4
E3-2 Detect strings (regex) causing name mismatch โœ… Normalization: UPPER, *โ†’X, strip spaces ยท ETL 4.1
E3-3 Extract all products from all sources โœ… Staging + bridge from das-db.products (47,121 rows audited)
E3-4 Detect UOMs ๐Ÿšง Source: product_units, master_product_units
E3-5 Define Base UOMs ๐Ÿ“‹ Base = PCS; standardize decimals via precision
E3-6 Create auto-generated SKU for DW ๐Ÿ“‹ Design pattern: [BU]-[CAT]-[SEQ]-[UOM] (chronological)
E3-7 Design SKU generating system ๐Ÿ“‹ Chronological + Product + UOM + BU segments
E3-8 Create mapping across analytical dimensions โœ… bridge_product_mapping + map_product_master ยท ETL 4โ€“5
E3-9 Create conversion factors per SKU & BU ๐Ÿ“‹ Source: product_conversion_links (qty โ†’ to_qty)

UOM & Conversion Design (Planned)

graph LR
    P[BU product<br/>products.id] -->|map_product_master| M[master_product_id]
    P -->|product_conversion_links| U[base UOM qty]
    M --> F[fact_saless.quantity<br/>normalized to base UOM]

Rules carried from Pipeline A

Matching priority: barcode โ†’ sku. Golden record order: is_active DESC โ†’ updated_at DESC โ†’ created_at DESC โ†’ id DESC.