Pipeline Runs:
Active Alarms 13
Details
critical
Step 8 predictions do not match Step 9 output rows
s8_predictions_generated=6221960, s9_rows_output=15960680
Widget: s9_rows_output
critical
Neighbor search sales pool is empty
sales_ids_count=0 at snapshot=2025-09-01
critical
Fallback prediction rate is high
fallback_rate=0.9824, high_threshold=0.5, critical_threshold=0.9
Widget: s8_fallback_rate
critical
Raw prediction monotonicity violation rate is high
violation_rate=0.9899, high_threshold=0.05, critical_threshold=0.2
Widget: s9_monotonicity_violation_rate
critical
QA outlier percentage is high
qa_outlier_pct=60.7, high_threshold=20.0, critical_threshold=40.0
Widget: s9_qa_outlier_pct
high
eBay feed is stale
eBay hours since last sale=34.9
Widget: s1_ebay_staleness_alert
high
Market index lags sales dates
index_max_date=2026-03-17, max_sale_date=2026-03-23, lag_days=6
high
Today dollar volume dropped sharply vs recent comparison points
today_dollar=643.04, ref_dollar=2110202.52, ratio_threshold=0.25
Widget: sales_comparison
high
Today sales volume dropped sharply vs recent comparison points
today_volume=12, ref_volume=14055, ratio_threshold=0.3
Widget: sales_comparison
high
Average neighbors per query is low
avg_neighbors_per_query=22.78, threshold=45.00
Widget: s5_avg_neighbors_per_query
high
Too many non-sales neighbors skipped per query
avg_skipped=134.24, threshold=50.0
Widget: s5_avg_skipped_per_query
high
Catalog neighbor coverage is low
coverage_pct=98.16, threshold=99.0
Widget: s5_catalog_coverage_pct
medium
Extreme prices detected
Extreme price count=16
Widget: s1_extreme_prices_count
Metrics (103)
Pipeline Started
2026-03-24 10:47:51
Sales Before 9/1/2025
152527
Total Dropped Sales Before 9/1/2025
152527
eBay Fixed-Price Records Downloaded
1022416
PWCC Fixed-Price Records Downloaded
103134
Total Fixed-Price Records Downloaded
1125550
Total Records Downloaded
1177387
Ebay Records Downloaded
909320
PWCC Records Downloaded
268067
Most Recent eBay Sale Date
2026-03-23
Most Recent PWCC Sale Date
2026-03-19
Days Since Last Sale
1
eBay Data Stale (>24h) Alarm
1
eBay Hours Since Last Sale
34.9000
PWCC Data Stale (>168h)
0
PWCC Hours Since Last Sale
107.3000
Extreme Prices (<$0.01 or >$100K) Alarm
16
Extreme Prices in Last 24h (%)
0.0000
Step 1 Duration
304.6000
Step 2 Input Rows
270520
Empty Embedding Text Count
0
Empty Embedding Text Percentage
0.0000
Avg Embedding Text Length
67.2000
Cards Embedded
270520
Embedding Dimension
1024
Step 2 Duration
136.2000
Active Sale Days (Last 28d)
28
Max Gap Between Active Sale Days (Last 28d)
2
Median Days Between Sales (Top 100 Cards)
0.0000
Today Unique Card Share
1.0000
Total Filtered Records
6907321
Historical Rows Exported
685361
Today Rows Generated
6221960
Step 3 Duration
1368.0000
Cards with Sales (Training Set)
53290
Cards with Sales Ratio
0.1970
Total Cards Embedded
270520
Final Training Loss
0.0020
Final Validation Loss
0.0038
Step 4 Duration
122.1000
Total Catalog Cards (Query Set)
270520
Cards with Neighbors
265553
Catalog Coverage (%) Alarm
98.1600
Total Neighbor Pairs
6049098
Database Size (Unified Embeddings)
270520
Average Neighbors Per Query Alarm
22.7800
Avg Non-Sales Neighbors Skipped Per Query Alarm
134.2400
Number of Neighbor Snapshots
9
Step 5 Duration
598.0000
Historical Rows Input
685361
Today Rows Input
6221960
Historical Log Rows with Neighbors
685361
Today Log Rows with Neighbors
6221960
Historical Rows with Neighbors
685361
Today Rows with Neighbors
6221960
Step 6 Duration
902.0000
Search/Training Jobs
6
Validation Rows
80042
Validation Non-Zero Target Rows
80042
Validation MdAPE
16.1600
Validation MAPE
32.2700
Bins Skipped Due to Low Sample Count
0
Bin Models Trained
5
Fallback Model Saved
1
Step 7 Models Trained
6
Mean Calibration MdAPE
16.1600
Mean Calibration MAPE
32.2700
Step 7 Duration
26.0000
Predictions Generated
6221960
Bin-Routed Predictions
109314
Fallback Predictions
6112646
Unrouted Predictions
0
Dataset Alignment Mismatch Count
0
Fallback Prediction Rate Alarm
0.9824
Non-Finite Predictions Count
0
Prediction Min
2.0771
Prediction Max
40126.5859
Prediction Mean
82.1717
Prediction Median
31.9691
Prediction Std Dev
261.6881
Negative Predictions Count
0
Negative Predictions Rate
0.0000
Step 8 Duration
62.7000
Rows Input Before QA
6221960
Total Grade/Company Groups
811560
Monotonicity Violations (prediction)
803333
Monotonicity Violation Rate Alarm
0.9899
Post-Sort Monotonicity Violations
0
Prediction Interval Violations
0
Unrouted Predictions After QA
0
Duplicate Prediction Keys
0
Rows Output After QA Alarm
15960680
QA Compared Rows
34253
QA Outliers (>20% diff)
20790
QA Outlier Percentage Alarm
60.7000
Step 9 Duration
299.9000
Documents Uploaded
15960680
Documents Expected
15960680
Upload Enabled
1
Step 10 Duration
2426.0000
Pipeline Ended
2026-03-24 12:32:10
Pipeline Total Duration (sec)
6259.9000
Active Alarms Count
13
Charts (7)
eBay Grade Distribution bar
g10g9g8g10pristineg7g6g8_5g9_5g5g40500001000001500002000002500003000003500004000004500004233724233722445802445808727987279463454634530838308381883718837129021290211989119899983998353915391
PWCC Grade Distribution bar
g10g9g10pristineg8g9_5g8_5authenticg7g6g7_501000020000300004000050000600007000080000900001000009046790467536935369334660346601973519735151291512911927119271134611346788978894957495732983298
Sales Per Day line
datesales
2026-02-232699
2026-02-243394
2026-02-253374
2026-02-263218
2026-02-272490
2026-02-284196
2026-03-0110372
2026-03-028468
2026-03-032240
2026-03-043319

Showing 10 of 28 rows

Dollar Volume Per Day line
datedollar_volume
2026-02-23831035.5900
2026-02-24725498.0400
2026-02-251052976.1800
2026-02-26752269.9000
2026-02-27527005.7500
2026-02-28645628.9300
2026-03-013768756.3500
2026-03-021186947.1000
2026-03-03684122.1500
2026-03-04989435.1800

Showing 10 of 28 rows

Median Sales Price Per Day line
datemedian_price
2026-02-2356.0000
2026-02-2444.5000
2026-02-2571.0000
2026-02-2645.4700
2026-02-2758.0000
2026-02-2843.2500
2026-03-0154.0000
2026-03-0227.6000
2026-03-0369.0000
2026-03-0462.0000

Showing 10 of 28 rows

Sales Price Distribution (2026-03-23) bar
$0-1$1-10$10-100$100-1K$1K-10K$10K+0.02.04.06.08.010.012.000001111110000
Sales Grade Distribution (2026-03-23) bar
Grade 7Grade 8Grade 9Grade 100.000.400.801.201.602.002.402.803.203.604.0033114444
Tables (8)
Data Anomalies
TypeCount
Zero-bid auctions644
Single-bid auctions72,281
eBay Missing Data
FieldCountPct
gemrate_id00.00%
grade110.00%
price00.00%
PWCC Missing Data
FieldCountPct
gemrate_id00.00%
grade10.00%
price00.00%
Marketplace Breakdown
SourceRecordsShare
eBay90932077.2000
PWCC26806722.8000
Sales Concentration Per Day
datetotal_salesunique_cards
2026-03-231212
2026-03-221414
2026-03-2021541476
2026-03-1930171843
2026-03-1837892408
2026-03-1731492083
2026-03-16140556545
2026-03-1584214940
2026-03-1437002383
2026-03-1329691944
2026-03-1233802033
2026-03-1124391684
2026-03-1026651632
2026-03-0980174914
2026-03-08118206266
2026-03-0740222480
2026-03-0627031786
2026-03-0530051867
2026-03-0433192175
2026-03-0322401564
2026-03-0284685166
2026-03-01103725884
2026-02-2841962546
2026-02-2724901665
2026-02-2632182077
2026-02-2533742211
2026-02-2433942182
2026-02-2326991880
Sales Comparison: Today vs 7d vs 28d Ago Alarm
perioddatevolumedollar_total
Today2026-03-2312643.0400
7 Days Ago2026-03-16140552110202.5200
28 Days Ago2026-02-232699831035.5900
Pipeline Step Summary
StepStatus
Step 1: DownloadRan
Step 2: Text EmbeddingRan
Step 3: Feature PrepRan
Step 4: Price EmbeddingRan
Step 5: Neighbor SearchRan
Step 6: Neighbor PricesRan
Step 7: Train ModelRan
Step 8: InferenceRan
Step 9: QARan
Step 10: UploadRan
Active Alarms Summary
severityalarm_idtitlesource_widget_idreason
criticala_cross_s8_to_s9_row_count_mismatchStep 8 predictions do not match Step 9 output rowss9_rows_outputs8_predictions_generated=6221960, s9_rows_output=15960680
criticala_s5_sales_pool_emptyNeighbor search sales pool is emptyNonesales_ids_count=0 at snapshot=2025-09-01
criticala_s8_fallback_rate_highFallback prediction rate is highs8_fallback_ratefallback_rate=0.9824, high_threshold=0.5, critical_threshold=0.9
criticala_s9_monotonicity_violation_rate_highRaw prediction monotonicity violation rate is highs9_monotonicity_violation_rateviolation_rate=0.9899, high_threshold=0.05, critical_threshold=0.2
criticala_s9_qa_outlier_pct_highQA outlier percentage is highs9_qa_outlier_pctqa_outlier_pct=60.7, high_threshold=20.0, critical_threshold=40.0
higha_s1_ebay_stalenesseBay feed is stales1_ebay_staleness_alerteBay hours since last sale=34.9
higha_s1_index_stale_vs_salesMarket index lags sales datesNoneindex_max_date=2026-03-17, max_sale_date=2026-03-23, lag_days=6
higha_s3_today_dollar_dropToday dollar volume dropped sharply vs recent comparison pointssales_comparisontoday_dollar=643.04, ref_dollar=2110202.52, ratio_threshold=0.25
higha_s3_today_volume_dropToday sales volume dropped sharply vs recent comparison pointssales_comparisontoday_volume=12, ref_volume=14055, ratio_threshold=0.3
higha_s5_avg_neighbors_per_query_lowAverage neighbors per query is lows5_avg_neighbors_per_queryavg_neighbors_per_query=22.78, threshold=45.00
higha_s5_avg_skipped_per_query_highToo many non-sales neighbors skipped per querys5_avg_skipped_per_queryavg_skipped=134.24, threshold=50.0
higha_s5_catalog_coverage_lowCatalog neighbor coverage is lows5_catalog_coverage_pctcoverage_pct=98.16, threshold=99.0
mediuma_s1_extreme_prices_presentExtreme prices detecteds1_extreme_prices_countExtreme price count=16