Ingestion and the Shipment Model
Feeds land raw, are cleaned and deduplicated, and are modelled into one shipment record with tests on every join, so a broken source fails loudly instead of quietly. The pipeline covers:
- TMS, WMS and ERP reads on a schedule
- Streaming GPS, ELD and telematics events
- Carrier and courier APIs, EDI and emailed status files
- Port, terminal and customs status
- One shipment ID across order, tracking and container numbers
- dbt models with tests on keys, freshness and values

