You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-05 - 11:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Mon Jan 05, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3240623727,0sleep30-21swapper/319:11:553
3235723727,0sleep20-21swapper/219:11:262
3217123627,0sleep10-21swapper/119:09:131
3209522824,0sleep00-21swapper/019:08:200
324769973,0cyclictest3571-21lldpd20:53:101
324769973,0cyclictest23563-21awk20:57:141
324769973,0cyclictest13623-21awk22:42:151
324769972,0cyclictest4667-21awk22:37:141
324769972,0cyclictest31006-21awk00:22:141
324769972,0cyclictest2773-21sensors21:57:201
324769970,0cyclictest30471-21diskstats21:22:111
339960,0migration/39013-21sh21:43:023
339960,0migration/35994-21idleruntime23:32:113
339960,0migration/35917-21sh23:47:203
339960,0migration/332694-21sh23:09:513
339960,0migration/332539-21aten_r1power_vo22:17:083
339960,0migration/328315-21sh23:27:023
339960,0migration/327883-21sh23:26:323
339960,0migration/327454-21munin-node00:17:253
339960,0migration/324742-21taskset23:58:413
339960,0migration/320097-21taskset22:44:353
339960,0migration/320094-21kthreadcore22:27:163
339960,0migration/31664-21irqcore19:57:153
324769965,0cyclictest3528-21cat21:02:251
324769963,0cyclictest3571-21lldpd00:17:131
324769962,0cyclictest9817-21kthreadcore19:17:161
324769962,0cyclictest6034-21cut19:12:141
324769962,0cyclictest5340-21awk20:22:141
324769962,0cyclictest13196-21awk00:12:131
324769962,0cyclictest11527-21diskmemload00:08:541
324769961,0cyclictest27999-21awk22:32:131
324769961,0cyclictest27631-21awk00:02:161
324769961,0cyclictest12682-21awk20:27:131
324769960,0cyclictest9271-21ssh21:43:391
324769960,0cyclictest9204-21grep23:32:141
324769960,0cyclictest5159-21ssh22:53:181
324769960,0cyclictest31449-21sed19:52:211
324769960,0cyclictest31090-21kthreadcore19:32:151
324769960,0cyclictest30667-21sed20:17:171
324769960,0cyclictest2924-21sh23:27:551
324769960,0cyclictest29211-21ssh21:20:561
324769960,0cyclictest26578-21perl20:37:101
324769960,0cyclictest26192-21ps23:07:151
324769960,0cyclictest25617-21grep22:12:161
324769960,0cyclictest25557-21if_err_eth1.300:37:151
324769960,0cyclictest19648-21cpu23:22:111
324769960,0cyclictest19344-21kthreadcore00:32:181
324769960,0cyclictest19032-21ssh21:14:051
324769960,0cyclictest18707-21kthreadcore20:07:151
324769960,0cyclictest16957-21gltestperf21:32:111
324769960,0cyclictest15778-21sh23:53:371
324769960,0cyclictest0-21swapper/123:12:201
324759965,0cyclictest15980-21ps19:22:150
324759960,0cyclictest11527-21diskmemload21:14:390
324759960,0cyclictest0-21swapper/022:38:030
324759960,0cyclictest0-21swapper/020:07:100
29805060,0irq/28-eth0-rx-690-21users00:02:283
29805060,0irq/28-eth0-rx-26155-21perl21:37:123
29805060,0irq/28-eth0-rx-16321-21perl00:32:133
29805060,0irq/28-eth0-rx-12234-21fschecks_count21:12:103
29805060,0irq/28-eth0-rx-0-21swapper/322:03:433
29805060,0irq/28-eth0-rx-0-21swapper/300:31:543
149960,0migration/029436-21sh21:21:240
149960,0migration/025627-21kthreadcore23:42:170
149960,0migration/022867-21sh23:22:170
149960,0migration/011194-21sh00:10:420
8305050,0irq/26-0000:00:8411-21date23:51:572
8305050,0irq/26-0000:00:32411-21crond19:11:562
4150,0ktimersoftd/00-21swapper/022:32:320
339950,0migration/37208-21kthreadcore00:07:163
339950,0migration/35736-21irqcore21:07:183
339950,0migration/332691-21latency_hist19:56:563
339950,0migration/332586-21kthreadcore00:22:163
339950,0migration/331688-21kthreadcore21:57:153
339950,0migration/329124-21taskset20:58:473
339950,0migration/32750-21kthreadcore22:52:143
339950,0migration/32438-21kthreadcore19:12:133
339950,0migration/322265-21cpuspeed_turbos19:27:123
339950,0migration/316697-21kthreadcore19:42:173
339950,0migration/316404-21irqrtprio20:07:143
339950,0migration/31397-21fschecks_time20:42:113
324779955,0cyclictest0-21swapper/222:18:462
324779950,0cyclictest26046-21tune2fs21:37:112
324779950,0cyclictest0-21swapper/223:38:042
324779950,0cyclictest0-21swapper/223:13:192
324779950,0cyclictest0-21swapper/222:05:412
324779950,0cyclictest0-21swapper/221:22:572
324769951,0cyclictest449-21basename19:57:091
324769951,0cyclictest4308-21cpuspeed_turbos19:37:101
324769951,0cyclictest18971-21ls20:32:101
324769951,0cyclictest1089-21sed20:42:101
324769950,0cyclictest9239-21cpu22:22:091
324769950,0cyclictest8120-21cut20:47:071
324769950,0cyclictest7710-21sed20:01:561
324769950,0cyclictest6940-21basename21:27:081
324769950,0cyclictest6929-21cut22:56:561
324769950,0cyclictest6619-21sh00:27:101
324769950,0cyclictest4909-21sed21:07:141
324769950,0cyclictest32691-21grep22:17:091
324769950,0cyclictest31897-21aten_r1power_en23:47:081
324769950,0cyclictest25071-21cat21:36:571
324769950,0cyclictest22941-21head23:42:091
324769950,0cyclictest22263-21aten_r1power_fr20:12:101
324769950,0cyclictest22002-21cut19:27:111
324769950,0cyclictest21250-21latency_hist22:46:561
324769950,0cyclictest19857-21sh21:52:041
324769950,0cyclictest18540-21stty19:47:061
324769950,0cyclictest18011-21awk22:27:091
324769950,0cyclictest17335-21cat23:56:571
324769950,0cyclictest16058-21aten_r1power_fr23:02:091
324769950,0cyclictest14768-21basename19:22:081
324769950,0cyclictest14313-21date22:06:561
324769950,0cyclictest13937-21ssh23:37:031
324769950,0cyclictest11375-21aten_r1power_po19:42:101
324769950,0cyclictest11051-21ssh21:47:081
324769950,0cyclictest10533-21aten2.4-expect23:17:081
324769950,0cyclictest0-21swapper/122:01:561
324759955,0cyclictest0-21swapper/022:02:440
324759955,0cyclictest0-21swapper/021:58:000
324759950,0cyclictest0-21swapper/021:33:430
324759950,0cyclictest0-21swapper/021:02:590
329950,0watchdog/37536-21cat19:37:153
329950,0watchdog/35569-21sed20:22:153
329950,0watchdog/322352-21gltestperf22:47:123
329950,0watchdog/321645-21unixbench-2d20:52:233
329950,0watchdog/320782-21cut20:32:153
29815050,0irq/29-eth0-tx-3491-21munin-node22:37:182
29815050,0irq/29-eth0-tx-31162-21uptime00:37:272
29815050,0irq/29-eth0-tx-29800-21ssh00:21:582
29815050,0irq/29-eth0-tx-27651-21users00:17:262
29815050,0irq/29-eth0-tx-17791-21cut00:12:152
29815050,0irq/29-eth0-tx-13523-21ssh00:28:032
29815050,0irq/29-eth0-tx-0-21swapper/223:57:142
29815050,0irq/29-eth0-tx-0-21swapper/223:47:152
29815050,0irq/29-eth0-tx-0-21swapper/223:43:502
29815050,0irq/29-eth0-tx-0-21swapper/223:30:522
29815050,0irq/29-eth0-tx-0-21swapper/222:16:082
29815050,0irq/29-eth0-tx-0-21swapper/221:43:412
29815050,0irq/29-eth0-tx-0-21swapper/221:17:422
29815050,0irq/29-eth0-tx-0-21swapper/200:32:162
29815050,0irq/29-eth0-tx-0-21swapper/019:27:210
29805050,0irq/28-eth0-rx-9992-21sh22:22:113
29805050,0irq/28-eth0-rx-31434-21ssh00:38:033
29805050,0irq/28-eth0-rx-29995-21ssh21:22:043
29805050,0irq/28-eth0-rx-27083-21sensors21:17:203
29805050,0irq/28-eth0-rx-23677-21grep23:42:123
29805050,0irq/28-eth0-rx-22393-21cut21:52:163
29805050,0irq/28-eth0-rx-16038-21ssh21:32:083
29805050,0irq/28-eth0-rx-14634-21fschecks_time23:37:113
29805050,0irq/28-eth0-rx-13089-21if_err_eth1.200:12:123
29805050,0irq/28-eth0-rx-10508-21munin-node23:17:123
29805050,0irq/28-eth0-rx-0-21swapper/323:54:133
29805050,0irq/28-eth0-rx-0-21swapper/323:14:533
29805050,0irq/28-eth0-rx-0-21swapper/322:57:393
29805050,0irq/28-eth0-rx-0-21swapper/322:38:333
29805050,0irq/28-eth0-rx-0-21swapper/322:35:333
29805050,0irq/28-eth0-rx-0-21swapper/322:13:303
29805050,0irq/28-eth0-rx-0-21swapper/322:07:463
29805050,0irq/28-eth0-rx-0-21swapper/321:47:353
29805050,0irq/28-eth0-rx-0-21swapper/320:27:153
27150,0ktimersoftd/20-21swapper/223:01:012
27150,0ktimersoftd/20-21swapper/200:10:232
259950,0migration/227084-21munin-node00:02:142
259950,0migration/223975-21missed_timers22:27:182
259950,0migration/218763-21sh22:42:212
259950,0migration/215797-21fschecks_time20:07:102
259950,0migration/214898-21kthreadcore19:42:162
259950,0migration/21244-21kthreadcore21:02:172
249950,0watchdog/221646-21unixbench-2d20:52:232
149950,0migration/09713-21kthreadcore22:57:130
149950,0migration/08244-21sh22:20:490
149950,0migration/06400-21sh22:56:140
149950,0migration/05355-21kthreadcore23:12:210
149950,0migration/03976-21latency_hist19:36:560
149950,0migration/03432-21irqrtprio21:42:140
149950,0migration/032148-21cpuspeed_turbos23:47:090
149950,0migration/031598-21kthreadcore00:22:160
149950,0migration/029914-21fschecks_time19:32:110
149950,0migration/029102-21kthreadcore22:12:170
149950,0migration/028476-21kthreadcore20:37:140
149950,0migration/027822-21kthreadcore19:52:190
149950,0migration/027453-21idleruntime00:02:150
149950,0migration/027281-21kthreadcore21:37:150
149950,0migration/027098-21kthreadcore23:07:160
149950,0migration/02461-21kthreadcore20:42:150
149950,0migration/02396-21kthreadcore19:12:130
149950,0migration/023755-21kthreadcore20:32:160
149950,0migration/023553-21irqcore20:12:150
149950,0migration/023418-21kthreadcore00:17:160
149950,0migration/023112-21fschecks_time20:57:110
149950,0migration/021366-21sh23:39:000
149950,0migration/021311-21latency_hist22:46:560
149950,0migration/021105-21missed_timers20:52:170
149950,0migration/019432-21irqrtprio22:27:150
149950,0migration/019067-21taskset23:21:420
149950,0migration/015819-21irqcore22:07:130
149950,0migration/013543-21sh00:28:050
149950,0migration/013403-21kthreadcore19:42:160
149950,0migration/01070-21fschecks_count19:57:120
149950,0migration/010030-21kthreadcore23:32:150
8305040,0irq/26-0000:00:25849-21cat20:36:562
8305040,0irq/26-0000:00:18538-21telnet19:47:062
8305040,0irq/26-0000:00:0-21swapper/221:46:572
339940,0migration/332742-21kthreadcore19:32:153
339940,0migration/317435-21irqrtprio23:02:153
339940,0migration/314296-21taskset19:19:213
324779943,0cyclictest5552-21awk21:07:172
324779943,0cyclictest3524-21snmpd22:07:252
324779943,0cyclictest3524-21snmpd19:26:242
324779943,0cyclictest26100-21awk23:07:152
324759944,0cyclictest28425-21kworker/0:021:26:520
324759944,0cyclictest0-21swapper/023:28:390
324759944,0cyclictest0-21swapper/021:28:410
324759944,0cyclictest0-21swapper/000:33:270
324759943,0cyclictest8893-21awk20:02:140
324759943,0cyclictest3524-21snmpd22:44:550
324759943,0cyclictest3524-21snmpd19:20:390
329940,0watchdog/30-21swapper/320:37:113
329940,0watchdog/30-21swapper/320:17:233
29815040,0irq/29-eth0-tx-11527-21diskmemload22:47:072
29815040,0irq/29-eth0-tx-0-21swapper/223:32:072
29815040,0irq/29-eth0-tx-0-21swapper/223:22:392
29815040,0irq/29-eth0-tx-0-21swapper/223:17:052
29815040,0irq/29-eth0-tx-0-21swapper/222:52:082
29815040,0irq/29-eth0-tx-0-21swapper/221:57:032
29815040,0irq/29-eth0-tx-0-21swapper/221:32:012
29815040,0irq/29-eth0-tx-0-21swapper/221:27:102
29805040,0irq/28-eth0-rx-0-21swapper/321:27:133
29805040,0irq/28-eth0-rx-0-21swapper/320:14:003
259940,0migration/29845-21fschecks_time22:22:112
259940,0migration/27509-21runrttasks20:43:542
259940,0migration/24541-21cpuspeed_turbos20:22:112
259940,0migration/232301-21runrttasks19:53:142
259940,0migration/231117-21kthreadcore19:32:152
259940,0migration/229567-21kthreadcore22:32:152
259940,0migration/224997-21kthreadcore19:27:182
259940,0migration/221135-21kthreadcore20:32:152
259940,0migration/216842-21fschecks_time23:02:112
259940,0migration/21467-21idleruntime19:57:132
259940,0migration/214581-21kthreadcore21:12:152
259940,0migration/213285-21kthreadcore20:47:132
259940,0migration/212288-21fschecks_time20:27:102
249940,0watchdog/220496-21fschecks_count21:52:122
249940,0watchdog/20-21swapper/219:37:152
149940,0migration/08713-21fschecks_time20:47:080
149940,0migration/022512-21timerwakeupswit23:02:240
149940,0migration/02085-21kthreadcore20:17:180
149940,0migration/018195-21ksmtuned20:28:340
149940,0migration/015046-21timerandwakeup23:52:240
324779932,0cyclictest23620-21irqcore20:57:142
324779932,0cyclictest23289-21awk20:12:142
324779932,0cyclictest14530-21sadc19:21:562
324779931,0cyclictest31851-21cat20:17:182
324779931,0cyclictest11129-21kthreadcore20:02:162
324759933,0cyclictest28425-21kworker/0:021:52:020
324759933,0cyclictest28425-21kworker/0:021:47:040
324759933,0cyclictest28425-21kworker/0:020:21:570
324759933,0cyclictest28182-21kworker/0:019:47:050
324759933,0cyclictest26073-21kworker/0:100:37:100
324759933,0cyclictest26073-21kworker/0:100:12:020
324759932,0cyclictest5646-21awk21:07:180
324759932,0cyclictest21696-21cut23:57:160
324759932,0cyclictest13929-21kthreadcore22:22:150
329930,0watchdog/30-21swapper/321:06:513
329930,0watchdog/30-21swapper/320:02:193
29805030,0irq/28-eth0-rx-0-21swapper/319:47:063
29805030,0irq/28-eth0-rx-0-21swapper/319:22:083
329920,0watchdog/30-21swapper/320:46:593
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional