TowerWatch QA Station — droplet report

generated 2026-07-17 12:10 UTC · tw-analysis-1 · refreshes every 12h

Canary (last 12h)

probeokruns(12h)p95failures
campus_live100.0%3600.16s0
cf_buildings100.0%3600.62s0
cf_simstate100.0%3600.14s0
gridwatch_disp100.0%3600.23s0
gridwatch_vals100.0%3604.88s0
health100.0%3600.38s0
predictions100.0%3600.17s0
rmi_snapshot100.0%3600.24s0
transmission100.0%3607.24s0

Open bugs

37 open / 37 total

statusxsourcekinddetail
new8pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_electrical_infrastructure_tags.json?_t=1783969602187 -> 404
new8pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_operational_tags.json?_t=1783969602186 -> 404
new8pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_drift_baseline_tags.json?_t=1783969602185 -> 404
new8pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_fire_smoke_fault_tags.json?_t=1783969602186 -> 404
new8pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_campus_kpi_tags.json?_t=1783969602184 -> 404
new8pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_hvac_plant_tags.json?_t=1783969602186 -> 404
new8pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_power_quality_tags.json?_t=1783969602186 -> 404
new8pageauditpage-load-errorwaterwatch: Page.goto: Timeout 90000ms exceeded. Call log: - navigating to "https://tower-watch.com/static/ucd-waterwatch.html", waiting until "netw
new8pageauditpage-api-failurefirewatch: https://tower-watch.com/api/simcity/realtime/satellite-fires.geojson -> 404
new8pageauditpage-api-failurefirewatch: https://tower-watch.com/api/simcity/realtime/fire-perimeters.geojson -> 404
new4workflowbuilding-page-endpoint-downbuilding.html dependency /api/simcity/building-live.json -> 404 (probe: Walker Hall)
new4workflowbuilding-page-endpoint-downbuilding.html dependency /api/simcity/building-dashboard-spec.json -> 404 (probe: Walker Hall)
new4workflowbuilding-page-endpoint-downbuilding.html dependency /api/simcity/building-polygon.geojson -> 404 (probe: Walker Hall)
new4workflowbuilding-page-endpoint-downbuilding.html dependency /api/simcity/building-tags.json -> 404 (probe: Walker Hall)
new3regressionpage-regressioninsights: top_consumers_populated — assertion falsy on https://tower-watch.com/static/insights
new2regressionsimstate-regressionR3b_donut_arcs_track_slider FAILED post-deploy on https://tower-watch.com/simstate (state: {"duck": [5, 5], "demand": "27.0 GW", "donut_len": 10})
new2regressionpage-regressiongaswatch: gas_points_layer_alive — assertion falsy on https://tower-watch.com/static/ucd-gaswatch
new2regressionpage-regressiongaswatch: gas_leaks_layer_alive — assertion falsy on https://tower-watch.com/static/ucd-gaswatch
new2regressionpage-regressiongaswatch: labels_overlay — assertion falsy on https://tower-watch.com/static/ucd-gaswatch
new2pageauditpage-load-errorsimstate: Page.goto: Timeout 90000ms exceeded. Call log: - navigating to "https://tower-watch.com/simstate", waiting until "networkidle"
new2pageauditpage-api-failuresimstate: https://tower-watch.com/api/simcity/carto_layers/davis_grid_topology.geojson -> 502
new1anomalycoverage-regressionlive cards 199 -> 159 (staged-release stop-rule signal)
new1regressionpage-regressioninsights: console_clean — load-error:Page.evaluate: TypeError: Failed to execute 'getComputedStyle' on 'Window': parameter 1 is not of type 'Element'.
new1regressionpage-regressioninsights: page_load — assertion falsy on https://tower-watch.com/static/insights
new1regressionsimstate-regressionR3d_arcs_correct_at_load FAILED post-deploy on https://tower-watch.com/simstate (state: {"duck": [17, 17], "demand": "42.4 GW", "donut_len": 8})
new1pageauditpage-api-failuresimstate: https://tower-watch.com/api/simcity/carto_layers/ucd_building_demand_predictions.geojson -> 502
new1pageauditpage-api-failuresimstate: https://tower-watch.com/api/simcity/carto_layers/ucd_parcels.geojson -> 502
new1pageauditpage-api-failuresimstate: https://tower-watch.com/api/simcity/carto_layers/ucd_misc_utilities.geojson -> 502
new1manualstat-tile-bindingSimState CA Demand tile shows -- despite rich demand.json: updateStatsDisplay strict current/previous-Pacific-hour match misses whenever CAISO actuals
new1manualdead-featureMOER(CA) tile can never render: /api/simcity/caiso/moer.json is a permanent unhydrated stub (moer:null). Hide tile+layer until a real carbon-intensity
new1manualdead-featureTodays X Intel box: unwanted feature, grok-x-summary.json has no credits/summary dir. Remove div+fetch (WS-1c).
new1manualperf-architectureSimState eagerly bulk-loads all 104 carto layers (~35MB ucd_* incl. duplicates: energy_timeline fetched 2x, footprints==buildings-polygons) BEFORE ca_
new1manualchart-window-truncation/api/simcity/building-chart.json truncates at 600 rows from the WRONG end for long windows: hours=72 returns oldest 600 samples (newest ~6h silently d
new1pageauditpage-load-errorfirewatch: Page.goto: Timeout 90000ms exceeded. Call log: - navigating to "https://tower-watch.com/static/firewatch.html", waiting until "networkidl
new1pageauditpage-api-failurefirewatch: https://tower-watch.com/api/firewatch/cameras.geojson -> 502
new1manualbuilding-page-endpoint-downbuilding.html's primary live-value call /api/simcity/building-live.json -> 404 on BOTH Azure origin and CF edge; route defined nowhere in repo (main,
new1manualbuilding-page-endpoint-downbuilding.html calls /api/simcity/building-dashboard-spec.json -> 404 everywhere (route not defined in any lineage). Dashboard spec block of the buildi

Alerts (last 12h)

sourcekinddetail
pageauditpage-api-failurefirewatch: https://tower-watch.com/api/simcity/realtime/satellite-fires.geojson -> 404
pageauditpage-api-failurefirewatch: https://tower-watch.com/api/simcity/realtime/fire-perimeters.geojson -> 404
pageauditpage-load-errorwaterwatch: Page.goto: Timeout 90000ms exceeded. Call log: - navigating to "https://tower-watch.com/static/ucd-waterwatch.html", waiting until "networkidle"
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_power_quality_tags.json?_t=1784290048513 -> 404
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_campus_kpi_tags.json?_t=1784290048511 -> 404
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_drift_baseline_tags.json?_t=1784290048512 -> 404
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_electrical_infrastructure_tags.json?_t=1784290048513 -> 404
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_hvac_plant_tags.json?_t=1784290048513 -> 404
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_fire_smoke_fault_tags.json?_t=1784290048513 -> 404
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_operational_tags.json?_t=1784290048513 -> 404

Page audits

pageloadbaselineapi callsfailures
anomalies0.84s0.785s20
campus_health0.86s0.885s87
firewatch2.33s8.55s702
gridwatch3.46s3.485s60
hub0.84s0.795s30
simstate2.84s3.45s1000
transit2.27s7.135s520
ucd_simcity4.31s4.640000000000001s740
waterwatch82.01s—s590

Building workflow

last run 2026-07-16T13:20:01Z: 1191 buildings, caan-live 161, lane mismatches 0, browser pages 15, new incongruities 4

Capture

fire-camera frames saved (12h): 11598 (corpus 11G); unitrans snapshots: 300