You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-27 - 03:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Sat Dec 27, 2025 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2868324131,0sleep20-21swapper/219:10:112
2873723728,0sleep10-21swapper/119:10:461
2858523625,0sleep00-21swapper/019:09:010
2865923324,0sleep30-21swapper/319:09:523
8305060,0irq/26-0000:00:16307-21idleruntime-cro21:51:112
339960,0migration/39592-21sh23:33:363
339960,0migration/3417-21sh22:36:233
339960,0migration/326811-21taskset23:42:023
339960,0migration/324825-21sh21:55:093
339960,0migration/323758-21sh23:23:033
339960,0migration/315578-21sh21:13:453
339960,0migration/313976-21sh22:24:403
339960,0migration/31295-21sh23:30:243
29815060,0irq/29-eth0-tx-5604-21sh22:21:112
29815060,0irq/29-eth0-tx-25421-21cut23:26:242
29805060,0irq/28-eth0-rx-25341-21irqrtprio22:31:303
29805060,0irq/28-eth0-rx-14256-21iostat23:01:303
29805060,0irq/28-eth0-rx-13742-21cut00:31:303
288409960,0cyclictest0-21swapper/100:25:171
288399960,0cyclictest0-21swapper/021:50:480
288399960,0cyclictest0-21swapper/021:34:150
288399960,0cyclictest0-21swapper/021:16:260
19160,0ktimersoftd/10-21swapper/122:37:191
149960,0migration/020327-21sh00:34:530
4150,0ktimersoftd/00-21swapper/023:56:090
339950,0migration/38269-21fschecks_count19:41:253
339950,0migration/37318-21taskset19:40:033
339950,0migration/37102-21munin-node21:06:353
339950,0migration/35119-21idleruntime22:56:273
339950,0migration/34385-21sh20:46:233
339950,0migration/331720-21ntp_kernel_pll_20:16:333
339950,0migration/330613-21kernelversion19:11:283
339950,0migration/330117-21fschecks_time20:41:253
339950,0migration/324331-21munin-node00:01:273
339950,0migration/322398-21irqcore00:36:273
339950,0migration/316851-21kthreadcore22:06:313
339950,0migration/313985-21munin-node21:46:343
339950,0migration/313289-21kthreadcore22:41:303
339950,0migration/31062-21missed_timers22:51:313
329950,0watchdog/34246-21hddtemp_smartct21:26:263
329950,0watchdog/326067-21ssh22:48:353
329950,0watchdog/318976-21cut20:31:303
329950,0watchdog/318385-21fschecks_time00:16:273
329950,0watchdog/310590-21kthreadcore00:11:313
29815050,0irq/29-eth0-tx-8834-21kthreadcore21:26:312
29815050,0irq/29-eth0-tx-8010-21kthreadcore00:26:312
29815050,0irq/29-eth0-tx-737-21munin-node21:06:270
29815050,0irq/29-eth0-tx-30046-21tr22:51:292
29815050,0irq/29-eth0-tx-25575-21munin-node19:31:310
29815050,0irq/29-eth0-tx-16798-21ssh00:14:412
29815050,0irq/29-eth0-tx-0-21swapper/223:12:162
29815050,0irq/29-eth0-tx-0-21swapper/222:56:262
29815050,0irq/29-eth0-tx-0-21swapper/222:33:552
29815050,0irq/29-eth0-tx-0-21swapper/021:11:340
29815050,0irq/29-eth0-tx-0-21swapper/019:40:210
29805050,0irq/28-eth0-rx-6314-21runrttasks23:06:213
29805050,0irq/28-eth0-rx-618-21cat21:41:273
29805050,0irq/28-eth0-rx-6004-21ssh23:13:183
29805050,0irq/28-eth0-rx-4280-21hddtemp_smartct00:26:273
29805050,0irq/28-eth0-rx-32484-21ntp_kernel_pll_21:21:303
29805050,0irq/28-eth0-rx-30101-21ssh21:39:523
29805050,0irq/28-eth0-rx-26873-21cpu00:21:233
29805050,0irq/28-eth0-rx-18792-21kthreadcore21:16:293
29805050,0irq/28-eth0-rx-16496-21kthreadcore21:31:303
29805050,0irq/28-eth0-rx-0-21swapper/323:54:033
29805050,0irq/28-eth0-rx-0-21swapper/323:49:403
29805050,0irq/28-eth0-rx-0-21swapper/323:16:253
29805050,0irq/28-eth0-rx-0-21swapper/322:28:353
29805050,0irq/28-eth0-rx-0-21swapper/322:17:493
29805050,0irq/28-eth0-rx-0-21swapper/321:56:163
29805050,0irq/28-eth0-rx-0-21swapper/300:06:353
288419955,0cyclictest7869-21diskmemload22:00:462
288419955,0cyclictest0-21swapper/221:38:322
288419950,0cyclictest0-21swapper/223:31:542
288419950,0cyclictest0-21swapper/222:48:142
288419950,0cyclictest0-21swapper/220:16:342
288419950,0cyclictest0-21swapper/200:35:262
288409955,0cyclictest0-21swapper/123:39:051
288409955,0cyclictest0-21swapper/122:18:221
288409955,0cyclictest0-21swapper/122:09:131
288409955,0cyclictest0-21swapper/100:08:151
288399955,0cyclictest0-21swapper/023:10:350
288399955,0cyclictest0-21swapper/022:27:040
288399955,0cyclictest0-21swapper/020:41:260
288399955,0cyclictest0-21swapper/000:01:590
288399950,0cyclictest0-21swapper/021:26:130
288399950,0cyclictest0-21swapper/000:17:070
259950,0migration/231091-21sh00:04:172
259950,0migration/228780-21sh23:46:172
259950,0migration/227745-21unixbench-2d00:36:372
259950,0migration/22582-21kthreadcore00:06:312
259950,0migration/224171-21kthreadcore19:51:282
259950,0migration/222648-21sh22:29:012
259950,0migration/218821-21kthreadcore23:21:282
259950,0migration/217839-21sh23:37:022
259950,0migration/212784-21kthreadcore20:26:302
259950,0migration/212784-21kthreadcore20:26:302
249950,0watchdog/29704-21irqstats21:11:302
249950,0watchdog/226000-21sh21:21:062
249950,0watchdog/215919-21kthreadcore23:01:312
249950,0watchdog/214127-21kthreadcore22:06:312
179950,0migration/1634-21munin-node19:36:231
179950,0migration/15832-21kthreadcore20:01:291
179950,0migration/13307-21aten2.4-expect21:26:231
179950,0migration/13123-21latency_hist00:26:121
179950,0migration/120550-21kthreadcore22:46:321
179950,0migration/113308-21kthreadcore19:21:281
179950,0migration/111816-21munin-node23:51:381
149950,0migration/09806-21gltestperf00:11:280
149950,0migration/06712-21sh00:06:530
149950,0migration/032715-21kthreadcore19:11:290
149950,0migration/030996-21aten_r1power_fr23:11:240
149950,0migration/029343-21sh21:21:270
149950,0migration/028230-21diskmemload23:26:300
149950,0migration/025711-21latency_hist20:16:120
149950,0migration/025327-21kthreadcore22:11:300
149950,0migration/025259-21kthreadcore21:36:320
149950,0migration/023876-21sh23:23:200
149950,0migration/022878-21fschecks_count20:36:250
149950,0migration/021856-21latency_hist19:51:110
149950,0migration/020531-21kthreadcore19:26:280
149950,0migration/012376-21fschecks_time20:51:260
149950,0migration/011450-21munin-node20:06:210
149950,0migration/010332-21fschecks_time22:41:260
8305040,0irq/26-0000:00:0-21swapper/221:21:112
339940,0migration/37550-21kthreadcore19:16:283
339940,0migration/325481-21kthreadcore19:51:283
339940,0migration/325021-21taskset19:27:303
339940,0migration/317895-21diskmemload23:37:113
339940,0migration/312878-21kthreadcore20:26:303
339940,0migration/312878-21kthreadcore20:26:303
339940,0migration/312506-21if_eth120:06:253
329940,0watchdog/326950-21smartctl21:01:263
329940,0watchdog/30-21swapper/323:56:313
329940,0watchdog/30-21swapper/320:56:303
329940,0watchdog/30-21swapper/320:51:303
329940,0watchdog/30-21swapper/320:21:303
29815040,0irq/29-eth0-tx-7869-21diskmemload21:31:522
29815040,0irq/29-eth0-tx-5375-21ssh23:51:202
29815040,0irq/29-eth0-tx-0-21swapper/222:36:122
29815040,0irq/29-eth0-tx-0-21swapper/222:21:132
29815040,0irq/29-eth0-tx-0-21swapper/222:11:172
29815040,0irq/29-eth0-tx-0-21swapper/221:52:042
29815040,0irq/29-eth0-tx-0-21swapper/221:41:182
29815040,0irq/29-eth0-tx-0-21swapper/200:21:222
29815040,0irq/29-eth0-tx-0-21swapper/020:46:230
29815040,0irq/29-eth0-tx-0-21swapper/020:31:320
29815040,0irq/29-eth0-tx-0-21swapper/019:41:320
29805040,0irq/28-eth0-rx-0-21swapper/322:11:113
29805040,0irq/28-eth0-rx-0-21swapper/322:01:263
29805040,0irq/28-eth0-rx-0-21swapper/320:36:293
29805040,0irq/28-eth0-rx-0-21swapper/320:01:243
29805040,0irq/28-eth0-rx-0-21swapper/319:56:313
288419943,0cyclictest5309-21awk20:01:282
288419943,0cyclictest3571-21lldpd20:21:362
288419943,0cyclictest3571-21lldpd19:27:352
288419943,0cyclictest30295-21awk19:56:272
288419943,0cyclictest30232-21awk19:11:272
288419943,0cyclictest25052-21sed20:11:362
288419943,0cyclictest15432-21awk23:56:292
288409944,0cyclictest0-21swapper/122:57:091
288409944,0cyclictest0-21swapper/121:25:331
288409944,0cyclictest0-21swapper/121:01:161
288409943,0cyclictest4968-21awk19:16:261
288409943,0cyclictest23411-21awk20:36:271
288409943,0cyclictest20932-21awk23:41:271
288409943,0cyclictest1894-21awk21:06:281
288409943,0cyclictest16036-21awk19:46:291
288409943,0cyclictest1555-21awk20:21:261
288409943,0cyclictest13675-21awk21:31:281
288409943,0cyclictest13375-21awk00:31:281
288399944,0cyclictest0-21swapper/022:35:160
288399944,0cyclictest0-21swapper/022:22:300
288399944,0cyclictest0-21swapper/021:59:380
288399944,0cyclictest0-21swapper/021:41:400
288399943,0cyclictest5203-21awk22:56:280
288399943,0cyclictest3524-21snmpd23:59:370
288399943,0cyclictest3524-21snmpd21:01:180
288399943,0cyclictest3250-21irqbalance23:16:180
288399943,0cyclictest3250-21irqbalance23:03:080
288399943,0cyclictest3250-21irqbalance22:08:180
288399943,0cyclictest3250-21irqbalance20:56:180
288399943,0cyclictest3250-21irqbalance20:27:080
288399943,0cyclictest3250-21irqbalance20:27:080
288399943,0cyclictest3250-21irqbalance20:21:380
288399943,0cyclictest3250-21irqbalance19:51:370
288399943,0cyclictest3250-21irqbalance00:21:380
288399943,0cyclictest27153-21sadc22:51:110
288399943,0cyclictest21069-21awk23:41:280
288399943,0cyclictest17670-21awk21:51:250
288399943,0cyclictest12334-21awk19:21:270
259940,0migration/29577-21kthreadcore20:46:292
259940,0migration/28826-21unixbench-2d22:01:372
259940,0migration/27472-21taskset23:16:152
259940,0migration/27101-21runrttasks19:37:382
259940,0migration/2622-21kthreadcore20:41:292
259940,0migration/24783-21fschecks_time19:16:242
259940,0migration/229946-21kthreadcore19:31:282
259940,0migration/227279-21kthreadcore20:36:292
259940,0migration/222317-21kthreadcore23:41:292
259940,0migration/222078-21munin-node23:06:222
259940,0migration/219957-21kthreadcore00:16:312
259940,0migration/217698-21kthreadcore20:31:302
259940,0migration/215183-21kthreadcore20:51:302
259940,0migration/213649-21kthreadcore20:06:272
249940,0watchdog/229996-21cut21:01:302
249940,0watchdog/22888-21kthreadcore21:06:302
249940,0watchdog/221525-21cut20:56:302
249940,0watchdog/220932-21port_sshpriv19:46:342
249940,0watchdog/217742-21yum19:21:382
249940,0watchdog/210561-21smartctl22:41:272
179940,0migration/19854-21kthreadcore22:21:331
179940,0migration/19690-21aten_r1power_po22:41:241
179940,0migration/18928-21taskset23:31:591
179940,0migration/131721-21rt-features23:26:341
179940,0migration/130760-21sh22:31:531
179940,0migration/130379-21kthreadcore22:51:291
179940,0migration/128818-21taskset19:53:541
179940,0migration/126877-21kthreadcore21:36:331
179940,0migration/126341-21fschecks_count20:16:251
179940,0migration/124717-21irqrtprio00:01:291
179940,0migration/124237-21kthreadcore00:36:291
179940,0migration/123365-21irqrtprio23:06:271
179940,0migration/12283-21kthreadcore19:56:301
179940,0migration/121556-21kthreadcore23:21:291
179940,0migration/121528-21kthreadcore20:11:281
179940,0migration/120258-21kthreadcore19:26:281
179940,0migration/120103-21kthreadcore22:26:311
179940,0migration/118401-21runrttasks20:54:511
179940,0migration/115131-21ksmtuned23:56:271
179940,0migration/111610-21kthreadcore00:11:311
169940,0watchdog/17691-21ssh21:46:221
169940,0watchdog/132266-21munin-node21:41:261
169940,0watchdog/122821-21ps21:51:301
169940,0watchdog/116242-21ssh21:15:061
169940,0watchdog/113716-21fschecks_time23:01:271
169940,0watchdog/10-21swapper/122:03:391
169940,0watchdog/10-21swapper/121:17:461
169940,0watchdog/10-21swapper/120:56:301
169940,0watchdog/10-21swapper/120:31:341
169940,0watchdog/10-21swapper/120:26:301
169940,0watchdog/10-21swapper/120:26:301
169940,0watchdog/10-21swapper/100:16:271
149940,0migration/09053-21kthreadcore20:01:300
149940,0migration/04145-21fschecks_time00:26:260
149940,0migration/031626-21kthreadcore23:46:300
149940,0migration/029673-21df_abs19:56:240
149940,0migration/029512-21kthreadcore22:51:290
149940,0migration/028267-21sh00:37:340
149940,0migration/02696-21fschecks_count22:01:250
149940,0migration/023751-21kthreadcore20:11:280
149940,0migration/016206-21kthreadcore23:36:280
8305030,0irq/26-0000:00:0-21swapper/319:21:373
339930,0migration/325099-21munin-node20:11:363
329930,0watchdog/30-21swapper/319:31:263
29815030,0irq/29-eth0-tx-0-21swapper/019:16:220
29805030,0irq/28-eth0-rx-0-21swapper/319:46:253
288419932,0cyclictest13881-21sensors19:41:332
288409933,0cyclictest3571-21lldpd20:46:371
288409932,0cyclictest7523-21munin-node23:16:291
288409932,0cyclictest3571-21lldpd21:56:391
288409932,0cyclictest31785-21sensors19:31:321
288409932,0cyclictest30591-21awk20:41:271
288409932,0cyclictest29885-21awk23:46:271
288409932,0cyclictest21433-21ethtool22:11:271
288409931,0cyclictest0-21swapper/123:11:251
288399932,0cyclictest30311-21awk22:16:280
288399930,0cyclictest904-21diskstats22:36:260
288399930,0cyclictest2852-21perl23:31:260
169930,0watchdog/10-21swapper/120:06:261
169930,0watchdog/10-21swapper/119:43:341
288409920,0cyclictest0-21swapper/119:11:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional