TowerWatch QA Station — droplet report

generated 2026-07-17 00:10 UTC · tw-analysis-1 · refreshes every 12h

Canary (last 12h)

probeokruns(12h)p95failures
campus_live100.0%50.14s0
cf_buildings100.0%50.29s0
cf_simstate100.0%50.17s0
gridwatch_disp100.0%50.31s0
gridwatch_vals100.0%54.42s0
health100.0%50.48s0
predictions100.0%50.15s0
rmi_snapshot100.0%50.30s0
transmission100.0%59.47s0

Open bugs

37 open / 37 total

statusxsourcekinddetail
new7pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_electrical_infrastructure_tags.json?_t=1783969602187 -> 404
new7pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_operational_tags.json?_t=1783969602186 -> 404
new7pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_drift_baseline_tags.json?_t=1783969602185 -> 404
new7pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_fire_smoke_fault_tags.json?_t=1783969602186 -> 404
new7pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_campus_kpi_tags.json?_t=1783969602184 -> 404
new7pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_hvac_plant_tags.json?_t=1783969602186 -> 404
new7pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_power_quality_tags.json?_t=1783969602186 -> 404
new7pageauditpage-load-errorwaterwatch: Page.goto: Timeout 90000ms exceeded. Call log: - navigating to "https://tower-watch.com/static/ucd-waterwatch.html", waiting until "netw
new7pageauditpage-api-failurefirewatch: https://tower-watch.com/api/simcity/realtime/satellite-fires.geojson -> 404
new7pageauditpage-api-failurefirewatch: https://tower-watch.com/api/simcity/realtime/fire-perimeters.geojson -> 404
new4workflowbuilding-page-endpoint-downbuilding.html dependency /api/simcity/building-live.json -> 404 (probe: Walker Hall)
new4workflowbuilding-page-endpoint-downbuilding.html dependency /api/simcity/building-dashboard-spec.json -> 404 (probe: Walker Hall)
new4workflowbuilding-page-endpoint-downbuilding.html dependency /api/simcity/building-polygon.geojson -> 404 (probe: Walker Hall)
new4workflowbuilding-page-endpoint-downbuilding.html dependency /api/simcity/building-tags.json -> 404 (probe: Walker Hall)
new3regressionpage-regressioninsights: top_consumers_populated — assertion falsy on https://tower-watch.com/static/insights
new2regressionsimstate-regressionR3b_donut_arcs_track_slider FAILED post-deploy on https://tower-watch.com/simstate (state: {"duck": [5, 5], "demand": "27.0 GW", "donut_len": 10})
new2regressionpage-regressiongaswatch: gas_points_layer_alive — assertion falsy on https://tower-watch.com/static/ucd-gaswatch
new2regressionpage-regressiongaswatch: gas_leaks_layer_alive — assertion falsy on https://tower-watch.com/static/ucd-gaswatch
new2regressionpage-regressiongaswatch: labels_overlay — assertion falsy on https://tower-watch.com/static/ucd-gaswatch
new2pageauditpage-load-errorsimstate: Page.goto: Timeout 90000ms exceeded. Call log: - navigating to "https://tower-watch.com/simstate", waiting until "networkidle"
new2pageauditpage-api-failuresimstate: https://tower-watch.com/api/simcity/carto_layers/davis_grid_topology.geojson -> 502
new1anomalycoverage-regressionlive cards 199 -> 159 (staged-release stop-rule signal)
new1regressionpage-regressioninsights: console_clean — load-error:Page.evaluate: TypeError: Failed to execute 'getComputedStyle' on 'Window': parameter 1 is not of type 'Element'.
new1regressionpage-regressioninsights: page_load — assertion falsy on https://tower-watch.com/static/insights
new1regressionsimstate-regressionR3d_arcs_correct_at_load FAILED post-deploy on https://tower-watch.com/simstate (state: {"duck": [17, 17], "demand": "42.4 GW", "donut_len": 8})
new1pageauditpage-api-failuresimstate: https://tower-watch.com/api/simcity/carto_layers/ucd_building_demand_predictions.geojson -> 502
new1pageauditpage-api-failuresimstate: https://tower-watch.com/api/simcity/carto_layers/ucd_parcels.geojson -> 502
new1pageauditpage-api-failuresimstate: https://tower-watch.com/api/simcity/carto_layers/ucd_misc_utilities.geojson -> 502
new1manualstat-tile-bindingSimState CA Demand tile shows -- despite rich demand.json: updateStatsDisplay strict current/previous-Pacific-hour match misses whenever CAISO actuals
new1manualdead-featureMOER(CA) tile can never render: /api/simcity/caiso/moer.json is a permanent unhydrated stub (moer:null). Hide tile+layer until a real carbon-intensity
new1manualdead-featureTodays X Intel box: unwanted feature, grok-x-summary.json has no credits/summary dir. Remove div+fetch (WS-1c).
new1manualperf-architectureSimState eagerly bulk-loads all 104 carto layers (~35MB ucd_* incl. duplicates: energy_timeline fetched 2x, footprints==buildings-polygons) BEFORE ca_
new1manualchart-window-truncation/api/simcity/building-chart.json truncates at 600 rows from the WRONG end for long windows: hours=72 returns oldest 600 samples (newest ~6h silently d
new1pageauditpage-load-errorfirewatch: Page.goto: Timeout 90000ms exceeded. Call log: - navigating to "https://tower-watch.com/static/firewatch.html", waiting until "networkidl
new1pageauditpage-api-failurefirewatch: https://tower-watch.com/api/firewatch/cameras.geojson -> 502
new1manualbuilding-page-endpoint-downbuilding.html's primary live-value call /api/simcity/building-live.json -> 404 on BOTH Azure origin and CF edge; route defined nowhere in repo (main,
new1manualbuilding-page-endpoint-downbuilding.html calls /api/simcity/building-dashboard-spec.json -> 404 everywhere (route not defined in any lineage). Dashboard spec block of the buildi

Alerts (last 12h)

sourcekinddetail
anomalycoverage-regressionlive cards 199 -> 159 (staged-release stop-rule signal)
pageauditpage-api-failurefirewatch: https://tower-watch.com/api/simcity/realtime/satellite-fires.geojson -> 404
pageauditpage-api-failurefirewatch: https://tower-watch.com/api/simcity/realtime/fire-perimeters.geojson -> 404
pageauditpage-load-errorwaterwatch: Page.goto: Timeout 90000ms exceeded. Call log: - navigating to "https://tower-watch.com/static/ucd-waterwatch.html", waiting until "networkidle"
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_operational_tags.json?_t=1784246862352 -> 404
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_power_quality_tags.json?_t=1784246862352 -> 404
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_electrical_infrastructure_tags.json?_t=1784246862352 -> 404
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_drift_baseline_tags.json?_t=1784246862351 -> 404
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_fire_smoke_fault_tags.json?_t=1784246862352 -> 404
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_campus_kpi_tags.json?_t=1784246862349 -> 404
pageauditpage-api-failurecampus_health: https://tower-watch.com/api/campus-health/live_hvac_plant_tags.json?_t=1784246862352 -> 404
workflowbuilding-page-endpoint-downbuilding.html dependency /api/simcity/building-live.json -> 404 (probe: Walker Hall)
workflowbuilding-page-endpoint-downbuilding.html dependency /api/simcity/building-dashboard-spec.json -> 404 (probe: Walker Hall)
workflowbuilding-page-endpoint-downbuilding.html dependency /api/simcity/building-polygon.geojson -> 404 (probe: Walker Hall)
workflowbuilding-page-endpoint-downbuilding.html dependency /api/simcity/building-tags.json -> 404 (probe: Walker Hall)

Page audits

pageloadbaselineapi callsfailures
anomalies0.82s0.78s20
campus_health0.86s0.89s87
firewatch8.3s8.940000000000001s652
gridwatch3.4s3.55s60
hub0.95s0.79s30
simstate3.26s3.64s1000
transit7.0s7.14s580
ucd_simcity6.18s4.63s740
waterwatch82.01s—s590

Building workflow

last run 2026-07-16T13:20:01Z: 1191 buildings, caan-live 161, lane mismatches 0, browser pages 15, new incongruities 4

Capture

fire-camera frames saved (12h): 11598 (corpus 9.0G); unitrans snapshots: 300