You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 07:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Thu Apr 23, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2101823924,0sleep00-21swapper/019:18:120
2101423725,0sleep10-21swapper/119:18:091
2106723627,0sleep20-21swapper/219:18:502
2091823626,0sleep30-21swapper/319:17:033
35160,0ktimersoftd/30-21swapper/321:37:243
339960,0migration/331122-21kernelversion23:11:103
339960,0migration/329540-21sh00:25:473
339960,0migration/32825-21pmu-power20:56:143
339960,0migration/32025-21sh00:06:363
339960,0migration/318496-21kthreadcore00:36:123
339960,0migration/314495-21sh22:21:383
339960,0migration/313295-21irqrtprio21:46:093
339960,0migration/313171-21munin-node23:01:083
29805060,0irq/28-eth0-rx-23022-21yum22:26:213
29805060,0irq/28-eth0-rx-16587-21port_sshpriv23:56:153
29805060,0irq/28-eth0-rx-0-21swapper/323:18:193
27160,0ktimersoftd/20-21swapper/222:42:312
213169965,0cyclictest28747-21tail19:46:111
213139965,0cyclictest13768-21ssh22:21:140
8305050,0irq/26-0000:00:18902-21latency_hist00:00:542
35150,0ktimersoftd/30-21swapper/322:42:313
339950,0migration/3646-21kthreadcore00:26:113
339950,0migration/35886-21munin-node00:46:143
339950,0migration/35886-21munin-node00:46:143
339950,0migration/33611-21kthreadcore20:36:103
339950,0migration/328393-21if_eth122:51:113
339950,0migration/32722-21missed_timers21:56:123
339950,0migration/325963-21idleruntime22:31:083
339950,0migration/324927-21taskset20:27:253
339950,0migration/324675-21kthreadcore20:51:113
339950,0migration/320166-21munin-node22:46:123
339950,0migration/318903-21kthreadcore23:21:113
339950,0migration/314789-21unixbench_multi23:36:193
339950,0migration/313022-21kthreadcore20:21:103
339950,0migration/312563-21sendmail_mailst00:31:163
339950,0migration/310908-21kthreadcore20:41:113
329950,0watchdog/36862-21python21:21:163
329950,0watchdog/36643-21cut22:36:133
329950,0watchdog/332495-21sh23:47:173
329950,0watchdog/313699-21tr21:26:123
329950,0watchdog/30-21swapper/322:16:053
29815050,0irq/29-eth0-tx-6683-21fschecks_count00:31:072
29815050,0irq/29-eth0-tx-6451-21fschecks_count23:16:072
29815050,0irq/29-eth0-tx-5441-21munin-node22:01:072
29815050,0irq/29-eth0-tx-4081-21cut00:11:072
29815050,0irq/29-eth0-tx-21747-21munin-node20:06:200
29815050,0irq/29-eth0-tx-2016-21ssh22:52:322
29815050,0irq/29-eth0-tx-18268-21munin-node20:26:120
29815050,0irq/29-eth0-tx-10341-21kthreadcore23:36:112
29815050,0irq/29-eth0-tx-0-21swapper/223:07:282
29815050,0irq/29-eth0-tx-0-21swapper/222:57:482
29815050,0irq/29-eth0-tx-0-21swapper/222:46:562
29815050,0irq/29-eth0-tx-0-21swapper/222:38:212
29815050,0irq/29-eth0-tx-0-21swapper/221:48:192
29805050,0irq/28-eth0-rx-8158-21kthreadcore00:11:143
29805050,0irq/28-eth0-rx-32408-21cat19:50:533
29805050,0irq/28-eth0-rx-25876-21ssh00:01:443
29805050,0irq/28-eth0-rx-25051-21kthreadcore23:26:113
29805050,0irq/28-eth0-rx-2429-21cut23:31:123
29805050,0irq/28-eth0-rx-21366-21munin-node23:06:073
29805050,0irq/28-eth0-rx-20951-21sensors20:46:163
29805050,0irq/28-eth0-rx-15647-21irqstats22:06:103
29805050,0irq/28-eth0-rx-15640-21cut00:16:123
29805050,0irq/28-eth0-rx-0-21swapper/323:41:123
29805050,0irq/28-eth0-rx-0-21swapper/322:04:493
29805050,0irq/28-eth0-rx-0-21swapper/321:41:123
29805050,0irq/28-eth0-rx-0-21swapper/321:33:113
29805050,0irq/28-eth0-rx-0-21swapper/321:16:103
29805050,0irq/28-eth0-rx-0-21swapper/320:31:073
27150,0ktimersoftd/20-21swapper/221:37:242
259950,0migration/29712-21fschecks_count21:26:082
259950,0migration/25189-21munin-node21:01:082
259950,0migration/23855-21sh21:57:192
259950,0migration/23348-21kthreadcore19:51:112
259950,0migration/229882-21sh22:12:332
259950,0migration/227537-21sendmail_mailqu00:21:172
259950,0migration/225789-21sh21:34:052
259950,0migration/223144-21latency_hist23:25:542
259950,0migration/213750-21netstat22:21:132
213179955,0cyclictest0-21swapper/223:48:592
213179955,0cyclictest0-21swapper/223:32:362
213179955,0cyclictest0-21swapper/223:03:262
213179955,0cyclictest0-21swapper/219:58:582
213179950,0cyclictest0-21swapper/223:44:252
213179950,0cyclictest0-21swapper/222:16:172
213179950,0cyclictest0-21swapper/221:23:472
213169950,0cyclictest0-21swapper/123:36:081
213139955,0cyclictest0-21swapper/021:06:210
213139955,0cyclictest0-21swapper/000:24:410
213139950,0cyclictest0-21swapper/023:22:430
213139950,0cyclictest0-21swapper/022:46:460
213139950,0cyclictest0-21swapper/022:04:220
213139950,0cyclictest0-21swapper/000:33:020
19150,0ktimersoftd/10-21swapper/122:42:311
19150,0ktimersoftd/10-21swapper/121:37:241
179950,0migration/18511-21sh22:21:071
179950,0migration/13996-21sh21:57:431
179950,0migration/121717-21if_eth1.221:51:091
179950,0migration/120802-21missed_timers00:36:131
179950,0migration/11585-21latency_hist23:50:541
179950,0migration/112691-21fschecks_time21:46:061
169950,0watchdog/122915-21kthreadcore21:11:121
149950,0migration/09775-21kthreadcore19:56:100
149950,0migration/05928-21sh22:16:500
149950,0migration/028815-21kthreadcore23:46:120
149950,0migration/028439-21kthreadcore19:46:100
149950,0migration/025761-21taskset00:01:240
149950,0migration/024748-21timerandwakeup21:11:190
149950,0migration/023205-21sh23:26:020
149950,0migration/022187-21kthreadcore21:51:100
149950,0migration/019954-21sh21:50:040
149950,0migration/018471-21kthreadcore00:36:120
149950,0migration/015919-21munin-node21:26:200
149950,0migration/015711-21kthreadcore23:01:120
149950,0migration/013320-21latency20:41:120
149950,0migration/011089-21if_eth1.222:41:100
149950,0migration/01035-21idleruntime19:51:080
339940,0migration/323645-21kthreadcore20:06:113
339940,0migration/321786-21kthreadcore21:11:123
329940,0watchdog/32689-21gltestperf23:51:093
329940,0watchdog/311840-21hwlatdetect19:36:083
329940,0watchdog/30-21swapper/319:41:163
329940,0watchdog/30-21swapper/319:26:043
329940,0watchdog/30-21swapper/319:21:083
29815040,0irq/29-eth0-tx-32251-21ssh00:46:062
29815040,0irq/29-eth0-tx-32251-21ssh00:46:062
29815040,0irq/29-eth0-tx-25189-21cpuspeed_turbos22:31:052
29815040,0irq/29-eth0-tx-14824-21ssh00:35:582
29815040,0irq/29-eth0-tx-0-21swapper/223:55:572
29815040,0irq/29-eth0-tx-0-21swapper/222:06:202
29815040,0irq/29-eth0-tx-0-21swapper/221:40:562
29815040,0irq/29-eth0-tx-0-21swapper/200:41:092
29815040,0irq/29-eth0-tx-0-21swapper/200:26:062
29815040,0irq/29-eth0-tx-0-21swapper/200:05:592
29815040,0irq/29-eth0-tx-0-21swapper/021:21:110
29815040,0irq/29-eth0-tx-0-21swapper/020:31:090
29815040,0irq/29-eth0-tx-0-21swapper/019:36:050
29805040,0irq/28-eth0-rx-0-21swapper/322:56:073
29805040,0irq/28-eth0-rx-0-21swapper/322:11:093
29805040,0irq/28-eth0-rx-0-21swapper/321:51:043
29805040,0irq/28-eth0-rx-0-21swapper/320:16:103
29805040,0irq/28-eth0-rx-0-21swapper/300:41:233
27140,0ktimersoftd/20-21swapper/220:12:312
259940,0migration/27192-21kthreadcore20:16:112
259940,0migration/226612-21kthreadcore20:51:122
259940,0migration/222690-21gltestperf20:06:082
259940,0migration/217783-21kthreadcore20:46:112
259940,0migration/214397-21runrttasks20:44:412
249940,0watchdog/26314-21runrttasks20:05:242
249940,0watchdog/216253-21ssh22:25:572
249940,0watchdog/214632-21ssh23:21:052
249940,0watchdog/20-21swapper/223:51:092
249940,0watchdog/20-21swapper/221:06:122
249940,0watchdog/20-21swapper/200:16:132
213179944,0cyclictest0-21swapper/221:16:132
213179943,0cyclictest3571-21lldpd19:36:412
213179943,0cyclictest3524-21snmpd21:51:102
213179943,0cyclictest3524-21snmpd20:23:092
213179943,0cyclictest32200-21sadc19:50:532
213179943,0cyclictest30609-21awk23:11:082
213169944,0cyclictest0-21swapper/122:27:521
213169944,0cyclictest0-21swapper/100:46:171
213169944,0cyclictest0-21swapper/100:46:171
213169943,0cyclictest970-21gltestperf19:51:071
213169943,0cyclictest6512-21awk22:01:091
213169943,0cyclictest3571-21lldpd21:22:121
213169943,0cyclictest3571-21lldpd19:32:111
213169943,0cyclictest3524-21snmpd23:46:111
213169943,0cyclictest3524-21snmpd21:02:241
213169943,0cyclictest3524-21snmpd20:46:241
213169943,0cyclictest3524-21snmpd20:36:091
213169943,0cyclictest3250-21irqbalance23:06:401
213169943,0cyclictest3250-21irqbalance22:16:001
213169943,0cyclictest3250-21irqbalance20:41:501
213169943,0cyclictest3250-21irqbalance20:32:201
213169943,0cyclictest3250-21irqbalance20:21:001
213169943,0cyclictest3250-21irqbalance20:01:201
213169943,0cyclictest3250-21irqbalance19:57:291
213169943,0cyclictest3250-21irqbalance19:40:591
213169943,0cyclictest30074-21awk20:11:101
213169943,0cyclictest28330-21awk22:51:111
213169943,0cyclictest26742-21awk21:16:091
213169943,0cyclictest24589-21awk00:41:101
213169943,0cyclictest18223-21sadc21:10:531
213169940,0cyclictest0-21swapper/122:55:561
213139943,0cyclictest7114-21awk23:16:100
213139943,0cyclictest4871-21awk20:16:080
213139943,0cyclictest3571-21lldpd20:36:420
213139943,0cyclictest3524-21snmpd21:31:540
213139943,0cyclictest3250-21irqbalance23:36:000
213139943,0cyclictest3250-21irqbalance23:31:100
213139943,0cyclictest3250-21irqbalance22:56:300
213139943,0cyclictest3250-21irqbalance22:52:200
213139943,0cyclictest3250-21irqbalance22:39:000
213139943,0cyclictest3250-21irqbalance22:06:100
213139943,0cyclictest3250-21irqbalance21:59:200
213139943,0cyclictest3250-21irqbalance19:30:590
213139943,0cyclictest3250-21irqbalance19:21:390
213139943,0cyclictest3250-21irqbalance00:16:000
213139943,0cyclictest3250-21irqbalance00:11:000
213139943,0cyclictest31001-21awk00:26:090
213139943,0cyclictest30201-21awk20:56:080
213139943,0cyclictest27840-21awk21:36:080
213139943,0cyclictest2782-21awk23:51:100
213139943,0cyclictest26790-21awk21:16:090
213139943,0cyclictest17983-21awk23:41:110
179940,0migration/17481-21kthreadcore20:16:111
179940,0migration/129839-21sh22:12:261
179940,0migration/128462-21sshd19:25:361
179940,0migration/128247-21unixbench_singl20:06:201
179940,0migration/125703-21kthreadcore23:26:111
179940,0migration/12520-21taskset00:07:581
179940,0migration/122494-21fschecks_count20:51:071
179940,0migration/121954-21kthreadcore22:46:131
179940,0migration/121034-21kthreadcore20:26:101
179940,0migration/115913-21kthreadcore23:01:121
179940,0migration/115205-21fschecks_time23:21:071
179940,0migration/11159-21kthreadcore23:11:111
169940,0watchdog/125167-21kthreadcore00:21:131
169940,0watchdog/121736-21kthreadcore23:41:131
169940,0watchdog/116165-21kthreadcore00:16:131
169940,0watchdog/113684-21ssh00:33:211
169940,0watchdog/112232-21ssh23:16:171
169940,0watchdog/110409-21ssh23:56:011
169940,0watchdog/10-21swapper/122:36:131
169940,0watchdog/10-21swapper/121:31:041
169940,0watchdog/10-21swapper/119:36:081
149940,0migration/05415-21irqcore21:01:090
149940,0migration/05006-21kthreadcore00:46:120
149940,0migration/05006-21kthreadcore00:46:120
149940,0migration/029670-21gltestperf19:26:070
149940,0migration/022861-21aten_r1power_vo22:11:060
149940,0migration/022454-21fschecks_count20:51:070
149940,0migration/018786-21fschecks_time19:41:070
149940,0migration/018692-21kthreadcore20:46:120
149940,0migration/018681-21kthreadcore22:26:110
149940,0migration/017645-21kthreadcore20:01:110
339930,0migration/332660-21kthreadcore20:11:123
329930,0watchdog/30-21swapper/321:06:123
329930,0watchdog/30-21swapper/321:01:123
329930,0watchdog/30-21swapper/319:46:043
29815030,0irq/29-eth0-tx-0-21swapper/020:11:060
29805030,0irq/28-eth0-rx-0-21swapper/320:01:053
29805030,0irq/28-eth0-rx-0-21swapper/319:56:063
29805030,0irq/28-eth0-rx-0-21swapper/319:33:443
259930,0migration/23133-21timerandwakeup20:56:182
249930,0watchdog/20-21swapper/219:31:122
249930,0watchdog/20-21swapper/219:26:042
213179933,0cyclictest305350irq/27-eth120:30:542
213179932,0cyclictest357-21aten2.4-expect20:36:052
213179932,0cyclictest3524-21snmpd20:26:092
213179932,0cyclictest19124-21awk19:41:092
213179930,0cyclictest23247-21grep19:21:082
213179930,0cyclictest19161-21tune2fs21:11:082
213169933,0cyclictest0-21swapper/100:25:571
213169932,0cyclictest4814-21kthreadcore23:31:131
213169932,0cyclictest3524-21snmpd19:27:231
213169932,0cyclictest26007-21awk22:31:081
213169932,0cyclictest19982-21head00:01:081
213169932,0cyclictest10138-21gltestperf21:26:081
213169930,0cyclictest9581-21swap21:41:191
213139933,0cyclictest0-21swapper/000:06:040
213139932,0cyclictest4409-21awk21:41:090
213139932,0cyclictest3524-21snmpd22:35:250
213139932,0cyclictest11632-21awk23:56:100
213139931,0cyclictest24939-21irqrtprio00:41:110
213139930,0cyclictest23254-21kthreadcore23:06:110
213139930,0cyclictest0-21swapper/020:21:050
179930,0migration/116283-21kthreadcore22:06:101
169930,0watchdog/10-21swapper/100:11:011
149930,0migration/029966-21sh23:11:060
169920,0watchdog/10-21swapper/120:56:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional