You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-16 - 05:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Wed Sep 16, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1386124333,0sleep30-21swapper/319:31:243
1396923930,0sleep20-21swapper/219:32:392
1371123322,0sleep00-21swapper/019:29:370
705023223,0sleep10-21swapper/119:27:541
339970,0migration/32934-21sh21:55:063
339960,0migration/329301-21idleruntime-cro01:02:523
339960,0migration/318951-21sh21:47:263
339960,0migration/313576-21kthreadcore20:38:083
339960,0migration/311141-21sh23:17:153
339960,0migration/310615-21aten_r1power_cu00:33:023
29815060,0irq/29-eth0-tx-21966-21munin-node21:08:050
29805060,0irq/28-eth0-rx-27608-21python22:08:143
29805060,0irq/28-eth0-rx-26928-21iostat_ios21:33:083
29805060,0irq/28-eth0-rx-22688-21cut23:03:103
27160,0ktimersoftd/20-21swapper/200:25:002
19160,0ktimersoftd/10-21swapper/100:25:001
149960,0migration/0361-21sh00:24:150
149960,0migration/031624-21sh00:06:130
149960,0migration/010325-21sh00:32:520
8305050,0irq/26-0000:00:20149-21ssh22:05:152
339950,0migration/38455-21switchtime21:38:173
339950,0migration/33577-21taskset19:47:583
339950,0migration/331247-21irqrtprio22:13:093
339950,0migration/329449-21munin-node22:28:143
339950,0migration/327664-21fschecks_time23:08:063
339950,0migration/326787-21taskset00:40:553
339950,0migration/326382-21munin-node20:03:083
339950,0migration/323911-21taskset00:02:583
339950,0migration/320226-21kthreadcore20:43:113
339950,0migration/318339-21if_err_eth100:18:093
339950,0migration/317848-21kthreadcore22:23:113
339950,0migration/315955-21kthreadcore22:03:103
339950,0migration/312086-21fschecks_time21:23:093
339950,0migration/312086-21fschecks_time21:23:093
339950,0migration/310597-21taskset20:35:413
329950,0watchdog/326071-21grep20:48:063
329950,0watchdog/325107-21kthreadcore19:38:103
329950,0watchdog/324000-21ntp_states19:58:103
329950,0watchdog/31688-21kthreadcore23:28:113
329950,0watchdog/3140142chrt20:14:263
329950,0watchdog/31205-21cut20:28:103
329950,0watchdog/30-21swapper/323:58:113
329950,0watchdog/30-21swapper/323:23:033
329950,0watchdog/30-21swapper/321:03:103
29815050,0irq/29-eth0-tx-5470-21diskstats23:33:052
29815050,0irq/29-eth0-tx-32427-21munin-node20:08:080
29815050,0irq/29-eth0-tx-29819-21munin-node22:13:062
29815050,0irq/29-eth0-tx-28926-21munin-node20:28:130
29815050,0irq/29-eth0-tx-2362-21ssh21:53:262
29815050,0irq/29-eth0-tx-20832-21kthreadcore00:38:102
29815050,0irq/29-eth0-tx-18144-40yum-updatesd-he00:35:442
29815050,0irq/29-eth0-tx-17744-21sshd20:39:270
29815050,0irq/29-eth0-tx-17272-21munin-node00:18:092
29815050,0irq/29-eth0-tx-1375-21ssh21:37:172
29815050,0irq/29-eth0-tx-0-21swapper/223:28:092
29815050,0irq/29-eth0-tx-0-21swapper/223:03:052
29815050,0irq/29-eth0-tx-0-21swapper/222:28:432
29815050,0irq/29-eth0-tx-0-21swapper/221:58:122
29815050,0irq/29-eth0-tx-0-21swapper/200:55:242
29815050,0irq/29-eth0-tx-0-21swapper/021:32:060
29815050,0irq/29-eth0-tx-0-21swapper/020:43:100
29815050,0irq/29-eth0-tx-0-21swapper/020:23:030
29815050,0irq/29-eth0-tx-0-21swapper/019:48:130
29805050,0irq/28-eth0-rx-9157-21cut23:33:103
29805050,0irq/28-eth0-rx-6955-21aten_r1power_fr23:53:043
29805050,0irq/28-eth0-rx-4919-21tail23:48:193
29805050,0irq/28-eth0-rx-27783-21memory21:08:113
29805050,0irq/28-eth0-rx-25697-21ssh21:48:153
29805050,0irq/28-eth0-rx-18072-21kthreadcore00:53:133
29805050,0irq/28-eth0-rx-16916-21fschecks_count22:43:043
29805050,0irq/28-eth0-rx-12505-21perl23:18:103
29805050,0irq/28-eth0-rx-11575-21ssh22:00:133
29805050,0irq/28-eth0-rx-1086-21munin-node00:08:083
29805050,0irq/28-eth0-rx-10306-21ssh00:13:093
29805050,0irq/28-eth0-rx-0-21swapper/323:43:173
29805050,0irq/28-eth0-rx-0-21swapper/322:59:163
29805050,0irq/28-eth0-rx-0-21swapper/322:55:133
29805050,0irq/28-eth0-rx-0-21swapper/322:48:083
29805050,0irq/28-eth0-rx-0-21swapper/322:38:053
29805050,0irq/28-eth0-rx-0-21swapper/322:33:103
29805050,0irq/28-eth0-rx-0-21swapper/320:53:183
29805050,0irq/28-eth0-rx-0-21swapper/300:48:093
29805050,0irq/28-eth0-rx-0-21swapper/300:45:523
27150,0ktimersoftd/20-21swapper/223:00:172
27150,0ktimersoftd/20-21swapper/221:45:242
259950,0migration/2810-21fschecks_time00:08:062
259950,0migration/26419-21sh23:52:232
259950,0migration/23112-21munin-node20:28:182
259950,0migration/229382-21kthreadcore20:03:102
259950,0migration/221479-21kthreadcore21:28:092
259950,0migration/217698-21kthreadcore20:18:112
259950,0migration/216588-21if_eth1.223:58:092
259950,0migration/216055-21kthreadcore23:38:112
259950,0migration/213370-21kthreadcore23:18:132
249950,0watchdog/226868-21unixbench_singl23:23:152
249950,0watchdog/213492-21grep20:58:102
19150,0ktimersoftd/10-21swapper/123:00:171
179950,0migration/130251-21kthreadcore00:43:101
179950,0migration/12928-21latency_hist23:12:521
179950,0migration/126776-21taskset00:40:531
179950,0migration/126535-21kthreadcore23:43:091
179950,0migration/123073-21kthreadcore00:58:101
179950,0migration/121813-21sh22:24:521
179950,0migration/12047-21kthreadcore21:13:091
179950,0migration/119875-21kthreadcore23:58:111
179950,0migration/117294-21sh20:38:141
179950,0migration/11691-21kthreadcore23:48:111
179950,0migration/116694-21munin-node00:33:111
179950,0migration/114575-21cpuspeed_turbos19:33:041
179950,0migration/114244-21kthreadcore19:53:091
179950,0migration/114202-21taskset20:16:341
179950,0migration/113680-21aten_r1power_po23:38:051
179950,0migration/113425-21munin-node20:58:101
179950,0migration/111459-21kthreadcore00:13:101
140559955,0cyclictest0-21swapper/220:53:132
140559950,0cyclictest0-21swapper/222:49:532
140559950,0cyclictest0-21swapper/222:34:542
140549955,0cyclictest0-21swapper/123:31:171
140549955,0cyclictest0-21swapper/100:53:451
140549950,0cyclictest0-21swapper/123:08:071
140549950,0cyclictest0-21swapper/122:19:051
140549950,0cyclictest0-21swapper/121:58:541
140549950,0cyclictest0-21swapper/100:19:411
149950,0migration/09545-21latency_hist22:57:510
149950,0migration/09172-21kthreadcore23:53:100
149950,0migration/07831-21kthreadcore23:13:100
149950,0migration/06275-21sh22:33:550
149950,0migration/03421-21kthreadcore20:53:100
149950,0migration/030727-21kthreadcore20:03:100
149950,0migration/027227-21taskset21:51:250
149950,0migration/026112-21sh00:38:550
149950,0migration/025908-21kthreadcore22:28:090
149950,0migration/021919-21kthreadcore23:23:070
149950,0migration/02082-21kthreadcore23:48:110
149950,0migration/020014-21latency_hist23:22:520
149950,0migration/01978-21aten_r1power_fr21:38:040
149950,0migration/019486-21kthreadcore22:43:080
149950,0migration/017365-21kthreadcore20:18:110
149950,0migration/017020-21kthreadcore19:33:090
149950,0migration/016521-21kthreadcore23:38:110
149950,0migration/015367-21taskset23:57:550
149950,0migration/015365-21kthreadcore21:23:140
149950,0migration/015365-21kthreadcore21:23:140
149950,0migration/012974-21kthreadcore21:43:100
149950,0migration/012395-21sh23:35:160
149950,0migration/011729-21taskset00:51:260
8305040,0irq/26-0000:00:6457-21kthreadcore00:28:102
8305040,0irq/26-0000:00:0-21swapper/221:48:092
339940,0migration/329645-21gltestperf19:43:053
339940,0migration/31883-21kthreadcore20:08:103
339940,0migration/315565-21idleruntime20:18:083
329940,0watchdog/33206-17auditd19:37:463
329940,0watchdog/325864-21cut20:23:103
329940,0watchdog/30-21swapper/322:18:033
329940,0watchdog/30-21swapper/320:58:103
329940,0watchdog/30-21swapper/300:23:113
29815040,0irq/29-eth0-tx-4035-21munin-node21:18:030
29815040,0irq/29-eth0-tx-0-21swapper/223:42:532
29815040,0irq/29-eth0-tx-0-21swapper/223:08:042
29815040,0irq/29-eth0-tx-0-21swapper/222:38:052
29815040,0irq/29-eth0-tx-0-21swapper/222:17:512
29815040,0irq/29-eth0-tx-0-21swapper/200:58:502
29815040,0irq/29-eth0-tx-0-21swapper/200:42:542
29815040,0irq/29-eth0-tx-0-21swapper/200:13:032
29815040,0irq/29-eth0-tx-0-21swapper/200:02:592
29815040,0irq/29-eth0-tx-0-21swapper/021:13:020
29805040,0irq/28-eth0-rx-0-21swapper/323:39:453
29805040,0irq/28-eth0-rx-0-21swapper/319:53:043
29805040,0irq/28-eth0-rx-0-21swapper/300:29:233
259940,0migration/26193-21kthreadcore23:13:102
259940,0migration/229584-21fschecks_time19:43:052
259940,0migration/220745-21munin-node21:03:122
259940,0migration/216532-21kthreadcore22:23:112
259940,0migration/210928-21sh19:53:032
249940,0watchdog/27922-21basename23:53:072
249940,0watchdog/25234-21cut20:33:102
249940,0watchdog/221340-21aten2.4-expect22:08:032
249940,0watchdog/219821-21irqstats20:43:102
249940,0watchdog/20-21swapper/219:38:062
179940,0migration/19712-21kthreadcore23:53:101
179940,0migration/18949-21kthreadcore23:33:101
179940,0migration/14667-21kthreadcore00:28:101
179940,0migration/14193-21sh21:18:041
179940,0migration/129282-21kthreadcore22:48:091
179940,0migration/128084-21kthreadcore00:03:091
179940,0migration/128055-21kthreadcore20:03:101
179940,0migration/125645-21cpu20:48:051
179940,0migration/125630-21latency_hist21:32:521
179940,0migration/123880-21kthreadcore22:08:091
179940,0migration/122718-21hwlatdetect20:23:071
179940,0migration/122616-21kthreadcore19:58:081
179940,0migration/121269-21kthreadcore22:43:081
179940,0migration/113156-21kthreadcore21:23:131
179940,0migration/113156-21kthreadcore21:23:131
179940,0migration/110059-21munin-node00:48:121
169940,0watchdog/17113-21ssh00:08:551
169940,0watchdog/14829-21kthreadcore22:33:111
169940,0watchdog/14812-21ssh22:15:031
169940,0watchdog/119912-21fschecks_count21:48:071
169940,0watchdog/10-21swapper/123:23:031
169940,0watchdog/10-21swapper/123:18:071
169940,0watchdog/10-21swapper/123:03:031
169940,0watchdog/10-21swapper/121:43:071
140559943,0cyclictest4989-21awk00:48:072
140559943,0cyclictest3571-21lldpd21:21:132
140559943,0cyclictest3250-21irqbalance22:54:082
140559943,0cyclictest3250-21irqbalance21:37:582
140559943,0cyclictest3250-21irqbalance21:07:582
140559943,0cyclictest3250-21irqbalance20:47:582
140559943,0cyclictest3250-21irqbalance20:24:382
140559943,0cyclictest3250-21irqbalance20:13:082
140559943,0cyclictest3250-21irqbalance19:58:182
140559943,0cyclictest3250-21irqbalance19:48:082
140559943,0cyclictest3250-21irqbalance19:33:382
140559943,0cyclictest2747-21awk21:13:112
140559943,0cyclictest17747-21sed22:43:072
140559943,0cyclictest12378-21awk21:23:112
140559943,0cyclictest12378-21awk21:23:112
140559943,0cyclictest12081-21awk20:38:062
140559943,0cyclictest1065-21awk20:08:072
140549944,0cyclictest0-21swapper/122:28:231
140549944,0cyclictest0-21swapper/121:55:171
140549943,0cyclictest9082-21awk22:38:071
140549943,0cyclictest4931-21awk20:33:091
140549943,0cyclictest4628-21awk19:48:081
140549943,0cyclictest3571-21lldpd22:04:431
140549943,0cyclictest3121-21awk21:38:081
140549943,0cyclictest22543-21awk19:38:081
140549943,0cyclictest15920-21awk21:03:081
140539944,0cyclictest25453-21diskmemload01:01:250
140539943,0cyclictest8459-21sadc00:12:520
140539943,0cyclictest29784-21kworker/0:100:53:150
140539943,0cyclictest2929-21kworker/0:122:23:130
140539943,0cyclictest28819-21awk00:43:080
140539943,0cyclictest18369-21awk00:18:090
149940,0migration/08467-21fschecks_time20:58:050
149940,0migration/06319-21kthreadcore20:33:110
149940,0migration/025863-21aten_r1power_vo21:33:040
149940,0migration/021523-21kthreadcore23:03:090
149940,0migration/015762-21kthreadcore22:03:100
149940,0migration/014848-21kthreadcore19:53:100
149940,0migration/01197-21sh23:08:240
149940,0migration/010108-21df22:58:030
329930,0watchdog/30-21swapper/321:28:073
329930,0watchdog/30-21swapper/321:18:063
329930,0watchdog/30-21swapper/321:13:103
179930,0migration/18516-21sh22:54:581
169930,0watchdog/10-21swapper/120:53:101
169930,0watchdog/10-21swapper/120:28:101
140549932,0cyclictest32211-21kthreadcore19:43:101
140549932,0cyclictest24594-21kthreadcore21:08:101
140549932,0cyclictest19619-21awk21:28:071
140549930,0cyclictest698-21perl20:08:051
140549930,0cyclictest17655-21kthreadcore20:18:111
140549930,0cyclictest0-21swapper/120:42:521
140539933,0cyclictest9819-21kworker/0:120:12:520
140539933,0cyclictest9819-21kworker/0:119:58:060
140539933,0cyclictest29784-21kworker/0:123:28:070
140539933,0cyclictest2929-21kworker/0:122:19:170
140539933,0cyclictest2929-21kworker/0:121:58:030
140539933,0cyclictest25964-21kworker/0:222:48:350
140539933,0cyclictest20842-21kworker/0:119:43:020
140539933,0cyclictest20842-21kworker/0:119:38:000
140539932,0cyclictest31017-21awk22:13:080
140539932,0cyclictest29043-21hwlatdetect21:53:070
140539932,0cyclictest26546-21awk20:48:080
140539932,0cyclictest15856-21awk21:03:080
140539932,0cyclictest12399-21grep22:38:100
140539930,0cyclictest9325-21cut00:13:060
140539930,0cyclictest22997-21perl23:43:050
140539930,0cyclictest22533-21iostat22:08:080
140539930,0cyclictest11593-21ssh00:33:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional