these 21 derivations will be built: /nix/store/0m3isipiklp2kr6q6sn5al34frdy3ajv-fleet-alert-responses.json.drv /nix/store/0n6w3ffcwx0y3p3f2ll6y95f4pnncsi7-fleet-alert-responses.json.drv /nix/store/14lpvmf30ahi7pvacjr1lp420kvf9549-fleet-alert-responses.json.drv /nix/store/5hgky0nz8l9rzpmjzxw9cgsk9xj5vnn4-fleet-alert-responses.json.drv /nix/store/5zxxjr52y3dfnx2x7pnhyildb6jysp11-fleet-alert-responses.json.drv /nix/store/9kpj9rczfy4jy6l1sm5x7zwnlci5rn0z-fleet-alert-responses.json.drv /nix/store/aw8ghk3na45g5wsgg2z89v4nk1n7nx8i-fleet-alert-responses.json.drv /nix/store/blxcfzra1sqsa4q45brlwrajs3n6j481-fleet-alert-responses.json.drv /nix/store/c6s8s70wrxyqxiqhciwmgnmdr7rnclmd-fleet-alert-responses.json.drv /nix/store/gancbd53frq3lyv792vpa6yhjc6cyjax-fleet-alert-responses.json.drv /nix/store/h4rpv40ryw1svs03ry3dgggs3ivwky25-fleet-alert-responses.json.drv /nix/store/iarmgwf3i8bnzqy9qx6qcg9v5mcnrvzm-fleet-alert-check-config.json.drv /nix/store/rsgnf1y4kq8z0n3abc0pnhqgclvc3895-fleet-alert-responses.json.drv /nix/store/vcm8ar69sz19v8abg8zmw9llzx6q26g6-fleet-alert-check-config.json.drv /nix/store/xdxkx5jkv3m9ahdmqmy1dbck00mv0kll-fleet-alert-responses.json.drv /nix/store/y527zg8p0pdxlrfc03506zdlvnz94xbh-fleet-alert-responses.json.drv /nix/store/i0h0w36qb2whmpvwa4jlv8rall0j933a-fleet-alert-fixtures.drv /nix/store/kyl2hhhryknmyjsrjvadr48giskbqjm1-fleet-alert-rules.yaml.drv /nix/store/w8bmv331f06dkwf2vy9fnc3g5d6cf10l-fleet-alert-rules-malformed.yaml.drv /nix/store/wap7sfmawcwlfgafc13lcnl8shl9jzyn-fleet-alert-promtool.drv /nix/store/17z31n57a34xiy0djad1b6hr97z44vv0-fleet-alert.drv building '/nix/store/iarmgwf3i8bnzqy9qx6qcg9v5mcnrvzm-fleet-alert-check-config.json.drv' building '/nix/store/vcm8ar69sz19v8abg8zmw9llzx6q26g6-fleet-alert-check-config.json.drv' building '/nix/store/0m3isipiklp2kr6q6sn5al34frdy3ajv-fleet-alert-responses.json.drv' building '/nix/store/0n6w3ffcwx0y3p3f2ll6y95f4pnncsi7-fleet-alert-responses.json.drv' building '/nix/store/14lpvmf30ahi7pvacjr1lp420kvf9549-fleet-alert-responses.json.drv' building '/nix/store/5hgky0nz8l9rzpmjzxw9cgsk9xj5vnn4-fleet-alert-responses.json.drv' building '/nix/store/5zxxjr52y3dfnx2x7pnhyildb6jysp11-fleet-alert-responses.json.drv' building '/nix/store/9kpj9rczfy4jy6l1sm5x7zwnlci5rn0z-fleet-alert-responses.json.drv' building '/nix/store/aw8ghk3na45g5wsgg2z89v4nk1n7nx8i-fleet-alert-responses.json.drv' building '/nix/store/blxcfzra1sqsa4q45brlwrajs3n6j481-fleet-alert-responses.json.drv' building '/nix/store/c6s8s70wrxyqxiqhciwmgnmdr7rnclmd-fleet-alert-responses.json.drv' building '/nix/store/gancbd53frq3lyv792vpa6yhjc6cyjax-fleet-alert-responses.json.drv' building '/nix/store/h4rpv40ryw1svs03ry3dgggs3ivwky25-fleet-alert-responses.json.drv' building '/nix/store/rsgnf1y4kq8z0n3abc0pnhqgclvc3895-fleet-alert-responses.json.drv' building '/nix/store/xdxkx5jkv3m9ahdmqmy1dbck00mv0kll-fleet-alert-responses.json.drv' building '/nix/store/y527zg8p0pdxlrfc03506zdlvnz94xbh-fleet-alert-responses.json.drv' fleet-alert-check-config.json> structuredAttrs is enabled fleet-alert-check-config.json> structuredAttrs is enabled fleet-alert-responses.json> structuredAttrs is enabled fleet-alert-responses.json> structuredAttrs is enabled fleet-alert-responses.json> structuredAttrs is enabled fleet-alert-responses.json> structuredAttrs is enabled fleet-alert-responses.json> structuredAttrs is enabled fleet-alert-responses.json> structuredAttrs is enabled fleet-alert-responses.json> structuredAttrs is enabled fleet-alert-responses.json> structuredAttrs is enabled fleet-alert-responses.json> structuredAttrs is enabled fleet-alert-responses.json> structuredAttrs is enabled fleet-alert-responses.json> structuredAttrs is enabled fleet-alert-responses.json> structuredAttrs is enabled fleet-alert-responses.json> structuredAttrs is enabled building '/nix/store/w8bmv331f06dkwf2vy9fnc3g5d6cf10l-fleet-alert-rules-malformed.yaml.drv' building '/nix/store/kyl2hhhryknmyjsrjvadr48giskbqjm1-fleet-alert-rules.yaml.drv' fleet-alert-responses.json> structuredAttrs is enabled fleet-alert-rules-malformed.yaml> structuredAttrs is enabled building '/nix/store/i0h0w36qb2whmpvwa4jlv8rall0j933a-fleet-alert-fixtures.drv' fleet-alert-rules.yaml> structuredAttrs is enabled building '/nix/store/wap7sfmawcwlfgafc13lcnl8shl9jzyn-fleet-alert-promtool.drv' fleet-alert-fixtures> --- the fixture server refuses other paths, databases and accounts, and detects two open requests fleet-alert-promtool> Checking /nix/store/avsb7lv8xhrzjhzf0w4jxrlnl9nl0ipg-fleet-alert-rules.yaml fleet-alert-promtool> SUCCESS: 7 rules found fleet-alert-promtool> fleet-alert-promtool> Checking /nix/store/5lrlzh41gq1fsyyl11fyp51dhwcsh1pc-fleet-alert-rules-malformed.yaml fleet-alert-promtool> FAILED: fleet-alert-promtool> /nix/store/5lrlzh41gq1fsyyl11fyp51dhwcsh1pc-fleet-alert-rules-malformed.yaml: 1:758: group "fleet-alert", rule 2, "HostOOMKill": could not parse expression: 1:39: parse error: unclosed left parenthesis fleet-alert-promtool> mutant malformedExpression rejected fleet-alert-fixtures> ok: fixture server refusals and the concurrency guard fleet-alert-fixtures> --- HostMemoryPressure fires once after its for of 5 min and resolves once 5 min after it clears fleet-alert-fixtures> --- HostOOMKill fires once after its for of 0 min and resolves once 5 min after it clears fleet-alert-fixtures> --- a failed state for every notified unit posts no SystemdUnitFailed, and nginx, not notified, posts one fleet-alert-fixtures> --- a store error freezes a firing HostOOMKill, raises StoreQueryFailing after 3 min, heartbeats, and resumes fleet-alert-fixtures> --- stibnite falls silent with HostOOMKill firing, posts nothing until it reports, then resolves once fleet-alert-fixtures> --- HostOOMKill last seen before 7 runs of store error resolves 5 min after the store answers again, not on its first answer fleet-alert-fixtures> --- HostOOMKill on stibnite last seen before 7 silent runs resolves 5 min after stibnite reports again, not on its first report fleet-alert-fixtures> --- node_vmstat_oom_kill empty for 30 min while magnetite reports raises one RuleSignalMissing fleet-alert-fixtures> --- magnetite silent for 40 min while the store answers raises RuleSignalMissing magnetite 10 min after it last reported, none for node_vmstat_oom_kill, and resolves when it reports again fleet-alert-fixtures> --- WeeklyPipelineTest posts once at 09:02 New York time on both sides of the daylight-saving change, never at 08:59, 09:06 or 09:02 EDT clock time in EST fleet-alert-fixtures> --- 11 instances within 24 h post all 11 FIRINGs and exactly one AlertBudgetExceeded fleet-alert-fixtures> --- 4 instances on stibnite within 24 h post exactly one AlertBudgetExceeded fleet-alert-fixtures> --- 10 FAILED lines of the last 24 h and one FIRING exceed the budget fleet-alert-fixtures> --- FAILED lines older than 24 h are not counted fleet-alert-fixtures> --- an existing failed.log that cannot be read fails the run before any post fleet-alert-fixtures> --- a failed heartbeat fails the run, and the FIRING it left pending is posted once on the next run fleet-alert-fixtures> === mutant forZero fleet-alert-fixtures> --- HostMemoryPressure fires once after its for of 5 min and resolves once 5 min after it clears fleet-alert-fixtures> --- /nix/store/6y66jscp5h48z98aiwfi48jrqx1x1a4x-fleet-alert-expected 1970-01-01 00:00:01.000000000 +0000 fleet-alert-fixtures> +++ /build/tmp.bIpDcUkE7j/actual 2026-10-22 01:05:49.052437165 +0000 fleet-alert-fixtures> @@ -1,2 +1,2 @@ fleet-alert-fixtures> -5 [FIRING] HostMemoryPressure magnetite default fleet-alert-fixtures> +0 [FIRING] HostMemoryPressure magnetite default fleet-alert-fixtures> 11 [RESOLVED] HostMemoryPressure magnetite default fleet-alert-fixtures> MISS HostMemoryPressure fires once after its for of 5 min and resolves once 5 min after it clears: the alert posts differ from the expected list fleet-alert-fixtures> mutant forZero rejected: HostMemoryPressure fires once after its for of 5 min and resolves once 5 min after it clears: the alert posts differ from the expected list fleet-alert-fixtures> === mutant noAbsenceFreeze fleet-alert-fixtures> --- stibnite falls silent with HostOOMKill firing, posts nothing until it reports, then resolves once fleet-alert-fixtures> --- /nix/store/wc7jnmxya82m0in69d63pn82jb07r6b5-fleet-alert-expected 1970-01-01 00:00:01.000000000 +0000 fleet-alert-fixtures> +++ /build/tmp.sgLVkgpbar/actual 2026-10-22 01:06:02.000475079 +0000 fleet-alert-fixtures> @@ -1,2 +1,4 @@ fleet-alert-fixtures> 0 [FIRING] HostOOMKill stibnite high fleet-alert-fixtures> +5 [RESOLVED] HostOOMKill stibnite high fleet-alert-fixtures> +11 [FIRING] HostOOMKill stibnite high fleet-alert-fixtures> 16 [RESOLVED] HostOOMKill stibnite high fleet-alert-fixtures> MISS stibnite falls silent with HostOOMKill firing, posts nothing until it reports, then resolves once: the alert posts differ from the expected list fleet-alert-fixtures> mutant noAbsenceFreeze rejected: stibnite falls silent with HostOOMKill firing, posts nothing until it reports, then resolves once: the alert posts differ from the expected list fleet-alert-fixtures> === mutant noHostsUpdate fleet-alert-fixtures> --- magnetite silent for 40 min while the store answers raises RuleSignalMissing magnetite 10 min after it last reported, none for node_vmstat_oom_kill, and resolves when it reports again fleet-alert-fixtures> --- /nix/store/j8qp89cn45j5s16cl1v27ck5pdpwf368-fleet-alert-expected 1970-01-01 00:00:01.000000000 +0000 fleet-alert-fixtures> +++ /build/tmp.KiFppcPt4k/actual 2026-10-22 01:06:11.108501595 +0000 fleet-alert-fixtures> @@ -1,2 +1,2 @@ fleet-alert-fixtures> -3 [FIRING] RuleSignalMissing magnetite default fleet-alert-fixtures> +2 [FIRING] RuleSignalMissing magnetite default fleet-alert-fixtures> 10 [RESOLVED] RuleSignalMissing magnetite default fleet-alert-fixtures> MISS magnetite silent for 40 min while the store answers raises RuleSignalMissing magnetite 10 min after it last reported, none for node_vmstat_oom_kill, and resolves when it reports again: the alert posts differ from the expected list fleet-alert-fixtures> mutant noHostsUpdate rejected: magnetite silent for 40 min while the store answers raises RuleSignalMissing magnetite 10 min after it last reported, none for node_vmstat_oom_kill, and resolves when it reports again: the alert posts differ from the expected list fleet-alert-fixtures> === mutant noStateWrite fleet-alert-fixtures> --- HostOOMKill fires once after its for of 0 min and resolves once 5 min after it clears fleet-alert-fixtures> MISS HostOOMKill fires once after its for of 0 min and resolves once 5 min after it clears: run 0 exited 2, expected 0: jq: error: Could not open file /build/tmp.Ocv26IgyFO/state.json: No such file or directory fleet-alert-fixtures> MISS HostOOMKill fires once after its for of 0 min and resolves once 5 min after it clears: run 1 exited 2, expected 0: jq: error: Could not open file /build/tmp.Ocv26IgyFO/state.json: No such file or directory fleet-alert-fixtures> --- /nix/store/6grbrjs6fqnl7rfkpg165dxa6zlnjdha-fleet-alert-expected 1970-01-01 00:00:01.000000000 +0000 fleet-alert-fixtures> +++ /build/tmp.Ocv26IgyFO/actual 2026-10-22 01:06:14.113510316 +0000 fleet-alert-fixtures> @@ -1,2 +1,2 @@ fleet-alert-fixtures> 0 [FIRING] HostOOMKill magnetite high fleet-alert-fixtures> -6 [RESOLVED] HostOOMKill magnetite high fleet-alert-fixtures> +1 [FIRING] HostOOMKill magnetite high fleet-alert-fixtures> MISS HostOOMKill fires once after its for of 0 min and resolves once 5 min after it clears: the alert posts differ from the expected list fleet-alert-fixtures> mutant noStateWrite rejected: HostOOMKill fires once after its for of 0 min and resolves once 5 min after it clears: run 0 exited 2, expected 0: jq: error: Could not open file /build/tmp.Ocv26IgyFO/state.json: No such file or directory fleet-alert-fixtures> === mutant noStoreFreeze fleet-alert-fixtures> --- a store error freezes a firing HostOOMKill, raises StoreQueryFailing after 3 min, heartbeats, and resumes fleet-alert-fixtures> --- /nix/store/n6m027z9nnbx170kn9hmzcy6793i91nc-fleet-alert-expected 1970-01-01 00:00:01.000000000 +0000 fleet-alert-fixtures> +++ /build/tmp.cug8nhuaz5/actual 2026-10-22 01:06:25.901544397 +0000 fleet-alert-fixtures> @@ -1,4 +1,4 @@ fleet-alert-fixtures> 0 [FIRING] HostOOMKill magnetite high fleet-alert-fixtures> 4 [FIRING] StoreQueryFailing high fleet-alert-fixtures> +5 [RESOLVED] HostOOMKill magnetite high fleet-alert-fixtures> 13 [RESOLVED] StoreQueryFailing high fleet-alert-fixtures> -14 [RESOLVED] HostOOMKill magnetite high fleet-alert-fixtures> MISS a store error freezes a firing HostOOMKill, raises StoreQueryFailing after 3 min, heartbeats, and resumes: the alert posts differ from the expected list fleet-alert-fixtures> mutant noStoreFreeze rejected: a store error freezes a firing HostOOMKill, raises StoreQueryFailing after 3 min, heartbeats, and resumes: the alert posts differ from the expected list fleet-alert-fixtures> ok: every leg passed building '/nix/store/17z31n57a34xiy0djad1b6hr97z44vv0-fleet-alert.drv' upload niks3: ok