You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 08:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Sat Jul 18, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1640524940,0sleep20-21swapper/219:27:002
1628424434,0sleep30-21swapper/319:25:373
1624723829,0sleep10-21swapper/119:25:111
1612922925,0sleep00-21swapper/019:23:450
339970,0migration/328045-21munin-node23:48:153
165579976,0cyclictest0-21swapper/200:02:372
165579970,0cyclictest2248-40yum-updatesd-he21:28:252
165579970,0cyclictest16889-21grep23:08:132
35160,0ktimersoftd/30-21swapper/322:46:153
35160,0ktimersoftd/30-21swapper/322:02:343
339960,0migration/36099-21sh22:27:023
339960,0migration/33290-21sh22:58:543
339960,0migration/329063-21sh21:43:253
339960,0migration/322858-21missed_timers00:03:143
339960,0migration/320545-21sh22:17:303
339960,0migration/32004-21sh00:12:253
339960,0migration/312853-21if_eth1.200:18:143
339960,0migration/310950-21sh23:38:443
29815060,0irq/29-eth0-tx-0-21swapper/019:35:260
29805060,0irq/28-eth0-rx-4194-21irqstats00:13:133
29805060,0irq/28-eth0-rx-31664-21grep23:33:133
29805060,0irq/28-eth0-rx-29542-21sed21:28:133
19160,0ktimersoftd/10-21swapper/100:35:211
165579960,0cyclictest0-21swapper/222:03:352
149960,0migration/07831-21munin-run21:52:560
149960,0migration/027696-21sh00:23:580
149960,0migration/023143-21kthreadcore22:18:140
149960,0migration/019184-21gltestperf23:28:110
149960,0migration/017082-21sh00:53:350
149960,0migration/016616-21kthreadcore21:18:140
8305050,0irq/26-0000:00:6199-21kthreadcore20:03:143
339950,0migration/39259-21aten_r1power_en23:23:073
339950,0migration/39176-21munin-node20:48:203
339950,0migration/37623-21kthreadcore23:03:143
339950,0migration/33422-21kthreadcore19:38:133
339950,0migration/328780-21idleruntime20:43:113
339950,0migration/326658-21kthreadcore00:43:123
339950,0migration/326399-21latency20:38:143
339950,0migration/325825-21kernelversion21:03:133
339950,0migration/324539-21fschecks_count19:33:113
339950,0migration/324502-21idleruntime23:13:133
339950,0migration/318657-21kthreadcore21:18:153
339950,0migration/316154-21kthreadcore23:08:133
339950,0migration/316138-21munin-node22:33:083
339950,0migration/315138-21taskset22:32:053
339950,0migration/313638-21kthreadcore23:58:153
339950,0migration/313196-21kthreadcore00:53:143
339950,0migration/312592-21kthreadcore20:08:133
339950,0migration/31150-21munin-node19:58:143
329950,0watchdog/39717-21sh00:52:203
329950,0watchdog/332613-21python22:03:193
329950,0watchdog/332362-21hwlatdetect21:48:113
329950,0watchdog/323983-21sh00:42:283
329950,0watchdog/317771-21perl20:13:113
329950,0watchdog/317133-21kthreadcore20:33:153
329950,0watchdog/315420-21ssh21:54:433
329950,0watchdog/31146-21if_err_eth1.223:18:113
329950,0watchdog/310903-21kthreadcore21:13:153
329950,0watchdog/30-21swapper/323:53:033
329950,0watchdog/30-21swapper/320:58:153
329950,0watchdog/30-21swapper/300:33:163
29815050,0irq/29-eth0-tx-8529-21ssh00:49:382
29815050,0irq/29-eth0-tx-8117-21munin-node21:53:142
29815050,0irq/29-eth0-tx-6462-21munin-node00:33:092
29815050,0irq/29-eth0-tx-32329-21awk23:53:132
29815050,0irq/29-eth0-tx-30862-21python00:43:172
29815050,0irq/29-eth0-tx-23712-21sed23:48:132
29815050,0irq/29-eth0-tx-23245-21rm22:35:002
29815050,0irq/29-eth0-tx-17086-21munin-node20:58:080
29815050,0irq/29-eth0-tx-1481-21munin-node22:43:222
29815050,0irq/29-eth0-tx-0-21swapper/223:38:132
29815050,0irq/29-eth0-tx-0-21swapper/223:18:142
29815050,0irq/29-eth0-tx-0-21swapper/221:58:042
29815050,0irq/29-eth0-tx-0-21swapper/221:49:502
29815050,0irq/29-eth0-tx-0-21swapper/200:15:492
29805050,0irq/28-eth0-rx-32051-21grep00:28:143
29805050,0irq/28-eth0-rx-3061-21aten_r1power_vo22:08:093
29805050,0irq/28-eth0-rx-25031-40yum-updatesd-he23:28:273
29805050,0irq/28-eth0-rx-0-21swapper/322:48:023
29805050,0irq/28-eth0-rx-0-21swapper/322:38:093
29805050,0irq/28-eth0-rx-0-21swapper/321:38:173
29805050,0irq/28-eth0-rx-0-21swapper/321:23:083
29805050,0irq/28-eth0-rx-0-21swapper/300:25:523
259950,0migration/28516-21kthreadcore22:28:132
259950,0migration/23515-21gltestperf20:48:082
259950,0migration/228017-21cpuspeed_turbos20:43:092
259950,0migration/227904-21kthreadcore23:13:162
259950,0migration/226757-21sendmail_mailqu20:38:172
259950,0migration/226443-21sh22:53:352
259950,0migration/217765-21gltestperf00:03:092
259950,0migration/216863-21munin-run20:57:562
259950,0migration/214955-21kthreadcore22:48:152
249950,0watchdog/230775-21basename00:28:122
249950,0watchdog/226687-21missed_timers00:23:162
249950,0watchdog/223466-21kthreadcore23:28:152
249950,0watchdog/20-21swapper/221:08:112
179950,0migration/16048-21kthreadcore22:43:141
179950,0migration/126909-21sh22:54:391
179950,0migration/121501-21needreboot00:38:161
179950,0migration/112142-21ntp_offset20:28:141
179950,0migration/111715-21sendmail_mailqu23:03:181
165579955,0cyclictest0-21swapper/223:34:232
165579955,0cyclictest0-21swapper/222:38:442
165579955,0cyclictest0-21swapper/222:13:022
165579955,0cyclictest0-21swapper/221:46:052
165579950,0cyclictest0-21swapper/223:26:402
165579950,0cyclictest0-21swapper/200:54:192
165559955,0cyclictest0-21swapper/023:08:240
165559955,0cyclictest0-21swapper/022:34:210
165559955,0cyclictest0-21swapper/000:13:410
165559953,0cyclictest3589-21kworker/0:221:54:250
165559953,0cyclictest28456-21kworker/0:023:58:260
165559953,0cyclictest28456-21kworker/0:023:55:140
165559953,0cyclictest28456-21kworker/0:023:49:440
165559953,0cyclictest26914-21kworker/0:000:48:260
165559953,0cyclictest26914-21kworker/0:000:39:440
165559953,0cyclictest26914-21kworker/0:000:20:440
165559953,0cyclictest22169-21kworker/0:123:37:440
165559953,0cyclictest22169-21kworker/0:123:26:140
165559953,0cyclictest22169-21kworker/0:122:58:440
165559953,0cyclictest17846-21kworker/0:200:03:120
169950,0watchdog/122213-21kthreadcore20:58:151
169950,0watchdog/119321-21sh22:14:431
149950,0migration/09835-21kthreadcore22:28:140
149950,0migration/0895-21sh22:04:080
149950,0migration/07129-21sh23:18:550
149950,0migration/06239-21kthreadcore23:38:140
149950,0migration/05562-21munin-node21:33:130
149950,0migration/03435-21sh21:31:300
149950,0migration/031969-21kthreadcore20:43:150
149950,0migration/030348-21kthreadcore00:43:130
149950,0migration/030295-21sh23:13:390
149950,0migration/028028-21kthreadcore21:43:150
149950,0migration/026521-21latency21:23:150
149950,0migration/025998-21munin-node22:38:110
149950,0migration/023521-21kthreadcore19:53:120
149950,0migration/02190-21fschecks_time22:43:100
149950,0migration/020674-21aten_r1power_vo20:38:080
149950,0migration/019736-21aten_r1power_fr22:53:060
149950,0migration/01686-21kthreadcore22:23:130
149950,0migration/016533-21kthreadcore23:43:160
149950,0migration/016058-21kthreadcore21:38:130
149950,0migration/015798-21kthreadcore20:33:140
149950,0migration/012958-21taskset19:47:280
149950,0migration/012388-21kthreadcore22:48:140
149950,0migration/012247-21cpu22:13:090
149950,0migration/011539-21taskset22:12:320
149950,0migration/010219-21kthreadcore23:03:140
8305040,0irq/26-0000:00:0-21swapper/322:17:563
339940,0migration/37781-21kthreadcore20:28:123
339940,0migration/330948-21taskset20:21:423
339940,0migration/322430-21kthreadcore19:53:123
339940,0migration/320535-21fschecks_time22:53:093
339940,0migration/313543-21taskset23:43:113
329940,0watchdog/30-21swapper/321:08:113
29815040,0irq/29-eth0-tx-9985-21ssh22:09:002
29815040,0irq/29-eth0-tx-22342-21ssh00:38:422
29815040,0irq/29-eth0-tx-0-21swapper/222:58:132
29815040,0irq/29-eth0-tx-0-21swapper/222:22:582
29815040,0irq/29-eth0-tx-0-21swapper/221:38:332
29815040,0irq/29-eth0-tx-0-21swapper/200:18:292
29815040,0irq/29-eth0-tx-0-21swapper/200:08:102
29815040,0irq/29-eth0-tx-0-21swapper/020:53:310
29805040,0irq/28-eth0-rx-0-21swapper/321:33:153
29805040,0irq/28-eth0-rx-0-21swapper/319:28:123
259940,0migration/27326-21kthreadcore21:33:142
259940,0migration/25969-21fschecks_count23:03:092
259940,0migration/25118-21timerandwakeup19:38:202
259940,0migration/226392-21kthreadcore22:18:152
259940,0migration/221316-21kthreadcore19:28:132
259940,0migration/219131-21missed_timers23:43:172
249940,0watchdog/27327-21smartctl21:13:112
249940,0watchdog/26350-21df19:43:072
249940,0watchdog/2310462chrt20:22:512
179940,0migration/19910-21fschecks_time23:23:101
179940,0migration/1429-21kthreadcore23:33:131
179940,0migration/13394-21hddtemp_smartct20:03:101
179940,0migration/131829-21kthreadcore20:43:151
179940,0migration/129482-21kthreadcore22:03:141
179940,0migration/123972-21kthreadcore22:18:141
179940,0migration/123199-21kthreadcore00:23:141
179940,0migration/122892-21sh22:34:111
179940,0migration/122410-21kthreadcore20:38:131
179940,0migration/119410-21kthreadcore20:13:151
179940,0migration/118501-21kthreadcore19:48:141
179940,0migration/117615-21munin-node00:18:191
179940,0migration/112959-21runrttasks21:14:051
179940,0migration/112335-21kthreadcore23:58:151
179940,0migration/110711-21df_abs00:53:101
165579943,0cyclictest3571-21lldpd19:37:532
165579943,0cyclictest3524-21snmpd20:32:112
165579943,0cyclictest3524-21snmpd20:12:112
165579943,0cyclictest3524-21snmpd20:03:402
165579943,0cyclictest21834-21awk21:23:122
165579943,0cyclictest17958-21awk20:13:122
165579943,0cyclictest14712-21awk21:18:122
165569944,0cyclictest0-21swapper/121:57:321
165569943,0cyclictest7136-21awk19:43:101
165569943,0cyclictest4082-21awk22:08:131
165569943,0cyclictest3571-21lldpd21:04:531
165569943,0cyclictest3571-21lldpd20:19:231
165569943,0cyclictest3524-21snmpd22:27:561
165569943,0cyclictest3524-21snmpd21:58:561
165569943,0cyclictest3524-21snmpd21:39:561
165569943,0cyclictest3524-21snmpd21:34:411
165569943,0cyclictest3524-21snmpd21:29:261
165569943,0cyclictest3524-21snmpd21:23:111
165569943,0cyclictest3524-21snmpd19:38:101
165569943,0cyclictest3250-21irqbalance00:46:431
165569943,0cyclictest32497-21awk21:48:121
165569943,0cyclictest27011-21awk00:08:131
165569943,0cyclictest26047-21awk22:38:111
165569943,0cyclictest24595-21awk23:13:141
165569943,0cyclictest23202-21awk23:48:121
165569940,0cyclictest0-21swapper/119:58:201
165559944,0cyclictest24985-21perl21:03:100
165559943,0cyclictest7393-21awk21:13:120
165559943,0cyclictest3524-21snmpd00:28:280
165559943,0cyclictest28656-21awk19:58:100
165559943,0cyclictest18209-21awk21:58:110
165559942,0cyclictest26914-21kworker/0:000:36:140
165559942,0cyclictest26914-21kworker/0:000:08:440
165559940,0cyclictest31291-21munin-node20:23:210
165559940,0cyclictest18206-21irqcore20:13:140
169940,0watchdog/19628-21ssh00:52:081
169940,0watchdog/126800-21tr21:43:151
169940,0watchdog/123467-21kthreadcore23:28:151
169940,0watchdog/118159-21irqcore00:03:121
169940,0watchdog/116990-21python22:48:191
169940,0watchdog/114433-21munin-node23:08:111
169940,0watchdog/114023-21perl23:43:111
169940,0watchdog/10-21swapper/121:08:111
169940,0watchdog/10-21swapper/120:23:111
149940,0migration/06688-21kthreadcore20:03:140
149940,0migration/02238-21kthreadcore21:08:150
149940,0migration/012213-21kthreadcore20:08:130
149940,0migration/010000-21kthreadcore20:28:120
8305030,0irq/26-0000:00:0-21swapper/320:53:013
329930,0watchdog/30-21swapper/320:23:113
329930,0watchdog/30-21swapper/319:43:073
29805030,0irq/28-eth0-rx-0-21swapper/319:49:593
249930,0watchdog/20-21swapper/220:58:152
249930,0watchdog/20-21swapper/220:33:152
249930,0watchdog/20-21swapper/220:23:112
249930,0watchdog/20-21swapper/219:58:112
179930,0migration/13938-21sh23:38:011
165579932,0cyclictest3524-21snmpd19:49:552
165579932,0cyclictest25330-21awk21:03:112
165579932,0cyclictest23785-21cut19:53:122
165569932,0cyclictest4412-21kthreadcore20:48:121
165569932,0cyclictest14664-21awk21:18:121
165569932,0cyclictest10987-21awk20:53:121
165569930,0cyclictest0-21swapper/119:32:581
165559933,0cyclictest21372-21kworker/0:119:48:070
165559933,0cyclictest15885-21kworker/0:020:48:070
165559933,0cyclictest15885-21kworker/0:020:18:070
165559932,0cyclictest3524-21snmpd19:37:550
165559930,0cyclictest0-21swapper/019:28:110
169930,0watchdog/10-21swapper/123:53:031
169930,0watchdog/10-21swapper/123:18:111
169930,0watchdog/10-21swapper/122:58:151
169930,0watchdog/10-21swapper/122:23:031
169930,0watchdog/10-21swapper/120:33:151
169930,0watchdog/10-21swapper/120:08:071
169930,0watchdog/10-21swapper/119:53:111
169930,0watchdog/10-21swapper/119:28:071
169930,0watchdog/10-21swapper/100:28:121
169930,0watchdog/10-21swapper/100:13:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional