TowerWatch QA Station — droplet report

generated 2026-07-19 12:10 UTC · tw-analysis-1 · refreshes every 12h

Canary (last 12h)

probeokruns(12h)p95failures
campus_live100.0%3600.15s0
cf_buildings100.0%3600.64s0
cf_simstate100.0%3600.14s0
gridwatch_disp100.0%3600.24s0
gridwatch_vals100.0%3604.72s0
health100.0%3600.44s0
predictions100.0%3600.16s0
rmi_snapshot100.0%3600.21s0
transmission100.0%3607.47s0

Open bugs

38 open / 38 total

statusxsourcekinddetail
new12pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_electrical_infrastructure_tags.json?_t=1783969602187 -> 404
new12pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_operational_tags.json?_t=1783969602186 -> 404
new12pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_drift_baseline_tags.json?_t=1783969602185 -> 404
new12pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_fire_smoke_fault_tags.json?_t=1783969602186 -> 404
new12pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_campus_kpi_tags.json?_t=1783969602184 -> 404
new12pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_hvac_plant_tags.json?_t=1783969602186 -> 404
new12pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_power_quality_tags.json?_t=1783969602186 -> 404
new12pageauditpage-load-errorwaterwatch: Page.goto: Timeout 90000ms exceeded. Call log: - navigating to "https://tower-watch.com/static/ucd-waterwatch.html", waiting until "netw
new12pageauditpage-api-failurefirewatch: https://tower-watch.com/api/simcity/realtime/satellite-fires.geojson -> 404
new12pageauditpage-api-failurefirewatch: https://tower-watch.com/api/simcity/realtime/fire-perimeters.geojson -> 404
new6workflowbuilding-page-endpoint-downbuilding.html dependency /api/simcity/building-live.json -> 404 (probe: Walker Hall)
new6workflowbuilding-page-endpoint-downbuilding.html dependency /api/simcity/building-dashboard-spec.json -> 404 (probe: Walker Hall)
new6workflowbuilding-page-endpoint-downbuilding.html dependency /api/simcity/building-polygon.geojson -> 404 (probe: Walker Hall)
new6workflowbuilding-page-endpoint-downbuilding.html dependency /api/simcity/building-tags.json -> 404 (probe: Walker Hall)
new4regressionsimstate-regressionR3b_donut_arcs_track_slider FAILED post-deploy on https://tower-watch.com/simstate (state: {"duck": [5, 5], "demand": "27.0 GW", "donut_len": 10})
new3regressionpage-regressioninsights: top_consumers_populated — assertion falsy on https://tower-watch.com/static/insights
new2regressionpage-regressiongaswatch: gas_points_layer_alive — assertion falsy on https://tower-watch.com/static/ucd-gaswatch
new2regressionpage-regressiongaswatch: gas_leaks_layer_alive — assertion falsy on https://tower-watch.com/static/ucd-gaswatch
new2regressionpage-regressiongaswatch: labels_overlay — assertion falsy on https://tower-watch.com/static/ucd-gaswatch
new2pageauditpage-load-errorsimstate: Page.goto: Timeout 90000ms exceeded. Call log: - navigating to "https://tower-watch.com/simstate", waiting until "networkidle"
new2pageauditpage-api-failuresimstate: https://tower-watch.com/api/simcity/carto_layers/davis_grid_topology.geojson -> 502
new1pageauditpage-perf-regressionsimstate: 11.7s vs baseline median 3.26s (>1.6x)
new1anomalycoverage-regressionlive cards 199 -> 159 (staged-release stop-rule signal)
new1regressionpage-regressioninsights: console_clean — load-error:Page.evaluate: TypeError: Failed to execute 'getComputedStyle' on 'Window': parameter 1 is not of type 'Element'.
new1regressionpage-regressioninsights: page_load — assertion falsy on https://tower-watch.com/static/insights
new1regressionsimstate-regressionR3d_arcs_correct_at_load FAILED post-deploy on https://tower-watch.com/simstate (state: {"duck": [17, 17], "demand": "42.4 GW", "donut_len": 8})
new1pageauditpage-api-failuresimstate: https://tower-watch.com/api/simcity/carto_layers/ucd_building_demand_predictions.geojson -> 502
new1pageauditpage-api-failuresimstate: https://tower-watch.com/api/simcity/carto_layers/ucd_parcels.geojson -> 502
new1pageauditpage-api-failuresimstate: https://tower-watch.com/api/simcity/carto_layers/ucd_misc_utilities.geojson -> 502
new1manualstat-tile-bindingSimState CA Demand tile shows -- despite rich demand.json: updateStatsDisplay strict current/previous-Pacific-hour match misses whenever CAISO actuals
new1manualdead-featureMOER(CA) tile can never render: /api/simcity/caiso/moer.json is a permanent unhydrated stub (moer:null). Hide tile+layer until a real carbon-intensity
new1manualdead-featureTodays X Intel box: unwanted feature, grok-x-summary.json has no credits/summary dir. Remove div+fetch (WS-1c).
new1manualperf-architectureSimState eagerly bulk-loads all 104 carto layers (~35MB ucd_* incl. duplicates: energy_timeline fetched 2x, footprints==buildings-polygons) BEFORE ca_
new1manualchart-window-truncation/api/simcity/building-chart.json truncates at 600 rows from the WRONG end for long windows: hours=72 returns oldest 600 samples (newest ~6h silently d
new1pageauditpage-load-errorfirewatch: Page.goto: Timeout 90000ms exceeded. Call log: - navigating to "https://tower-watch.com/static/firewatch.html", waiting until "networkidl
new1pageauditpage-api-failurefirewatch: https://tower-watch.com/api/firewatch/cameras.geojson -> 502
new1manualbuilding-page-endpoint-downbuilding.html's primary live-value call /api/simcity/building-live.json -> 404 on BOTH Azure origin and CF edge; route defined nowhere in repo (main,
new1manualbuilding-page-endpoint-downbuilding.html calls /api/simcity/building-dashboard-spec.json -> 404 everywhere (route not defined in any lineage). Dashboard spec block of the buildi

Alerts (last 12h)

sourcekinddetail
pageauditpage-api-failurefirewatch: https://tower-watch.com/api/simcity/realtime/fire-perimeters.geojson -> 404
pageauditpage-api-failurefirewatch: https://tower-watch.com/api/simcity/realtime/satellite-fires.geojson -> 404
pageauditpage-load-errorwaterwatch: Page.goto: Timeout 90000ms exceeded. Call log: - navigating to "https://tower-watch.com/static/ucd-waterwatch.html", waiting until "networkidle"
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_hvac_plant_tags.json?_t=1784462858038 -> 404
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_fire_smoke_fault_tags.json?_t=1784462858037 -> 404
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_drift_baseline_tags.json?_t=1784462858037 -> 404
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_power_quality_tags.json?_t=1784462858037 -> 404
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_operational_tags.json?_t=1784462858037 -> 404
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_campus_kpi_tags.json?_t=1784462858035 -> 404
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_electrical_infrastructure_tags.json?_t=1784462858038 -> 404

Page audits

pageloadbaselineapi callsfailures
anomalies0.75s0.79s20
campus_health0.83s0.855s87
firewatch7.66s8.11s652
gridwatch3.23s3.44s60
hub0.72s0.8200000000000001s30
simstate2.82s3.36s1000
transit6.97s7.12s570
ucd_simcity3.3s4.69s750
waterwatch82.0s—s590

Building workflow

last run 2026-07-18T13:20:01Z: 1191 buildings, caan-live 199, lane mismatches 0, browser pages 15, new incongruities 4

Capture

fire-camera frames saved (12h): 11520 (corpus 16G); unitrans snapshots: 300