You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-31 - 07:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Tue Mar 31, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
351680,0ktimersoftd/315006-21perf19:18:493
2195524940,0sleep20-21swapper/219:16:492
2202324637,0sleep10-21swapper/119:17:401
2207422925,0sleep00-21swapper/019:18:150
22210991717,0cyclictest3524-21snmpd23:49:400
22210991717,0cyclictest3524-21snmpd00:24:470
22210991414,0cyclictest3524-21snmpd22:34:250
22210991111,0cyclictest3524-21snmpd21:39:140
8305060,0irq/26-0000:00:31602-21if_eth1.323:09:152
35160,0ktimersoftd/30-21swapper/300:22:113
339960,0migration/37949-21gltestperf00:29:153
339960,0migration/33334-21fschecks_time23:49:143
339960,0migration/328690-21sh21:50:323
339960,0migration/32563-21sh21:35:463
339960,0migration/325477-21sh22:28:263
339960,0migration/325260-21sh21:29:233
339960,0migration/322228-21kthreadcore23:39:183
339960,0migration/318902-21munin-node21:44:193
339960,0migration/316216-21sh22:21:363
339960,0migration/310583-21munin-node22:54:193
29815060,0irq/29-eth0-tx-18893-21munin-node19:39:120
29815060,0irq/29-eth0-tx-1227-21munin-node21:19:160
29805060,0irq/28-eth0-rx-31435-21awk21:54:163
29805060,0irq/28-eth0-rx-30996-21ssh00:39:263
29805060,0irq/28-eth0-rx-3085-21perl22:34:143
29805060,0irq/28-eth0-rx-25110-21python19:39:223
259960,0migration/227241-21sh23:24:182
222129960,0cyclictest0-21swapper/223:04:002
222119965,0cyclictest23935-21sed20:49:171
222119960,0cyclictest32320-21port_sshpriv20:29:201
222119960,0cyclictest0-21swapper/123:35:311
222119960,0cyclictest0-21swapper/120:34:131
222109960,0cyclictest0-21swapper/023:44:170
19160,0ktimersoftd/10-21swapper/100:22:111
179960,0migration/14382-21munin-node23:09:211
149960,0migration/06404-21kthreadcore00:09:170
149960,0migration/032120-21sh22:13:540
149960,0migration/023097-21sh00:36:330
149960,0migration/017776-21sh21:26:550
8305050,0irq/26-0000:00:13344-21ssh21:59:472
4150,0ktimersoftd/00-21swapper/000:03:500
339950,0migration/38821-21taskset00:48:353
339950,0migration/37266-21kthreadcore00:09:183
339950,0migration/36588-21taskset00:28:443
339950,0migration/34963-21kthreadcore19:49:173
339950,0migration/329025-21kthreadcore20:29:163
339950,0migration/328950-21kthreadcore22:29:163
339950,0migration/328920-21sendmail_mailtr20:49:223
339950,0migration/325099-21idleruntime23:24:153
339950,0migration/323424-21kthreadcore23:04:183
339950,0migration/322788-21cpuspeed_turbos20:04:123
339950,0migration/322277-21taskset20:03:373
339950,0migration/321466-21munin-node22:04:243
339950,0migration/319335-21latency00:14:223
339950,0migration/31470-21kthreadcore20:09:173
339950,0migration/31413-21kthreadcore19:24:173
329950,0watchdog/3298050irq/28-eth0-rx-22:39:193
329950,0watchdog/327947-21kernelversion21:14:183
329950,0watchdog/325034-21memory21:09:183
329950,0watchdog/317549-21grep23:19:193
329950,0watchdog/316459-21kthreadcore23:54:193
329950,0watchdog/314885-21yum20:39:263
329950,0watchdog/311417-21sh21:40:343
29815050,0irq/29-eth0-tx-9941-21kthreadcore23:14:182
29815050,0irq/29-eth0-tx-5656-21ssh21:57:282
29815050,0irq/29-eth0-tx-13434-21munin-node00:14:172
29815050,0irq/29-eth0-tx-0-21swapper/223:34:082
29815050,0irq/29-eth0-tx-0-21swapper/222:58:022
29815050,0irq/29-eth0-tx-0-21swapper/222:26:312
29815050,0irq/29-eth0-tx-0-21swapper/222:15:072
29815050,0irq/29-eth0-tx-0-21swapper/221:42:162
29815050,0irq/29-eth0-tx-0-21swapper/221:35:062
29815050,0irq/29-eth0-tx-0-21swapper/020:23:590
29805050,0irq/28-eth0-rx-7596-21if_err_eth1.221:59:153
29805050,0irq/28-eth0-rx-13583-21diskstats22:59:133
29805050,0irq/28-eth0-rx-11581-21irqrtprio21:24:173
29805050,0irq/28-eth0-rx-0-21swapper/323:59:293
29805050,0irq/28-eth0-rx-0-21swapper/323:44:193
29805050,0irq/28-eth0-rx-0-21swapper/323:29:153
29805050,0irq/28-eth0-rx-0-21swapper/323:12:523
29805050,0irq/28-eth0-rx-0-21swapper/322:49:153
29805050,0irq/28-eth0-rx-0-21swapper/322:44:193
29805050,0irq/28-eth0-rx-0-21swapper/322:14:403
29805050,0irq/28-eth0-rx-0-21swapper/321:23:163
29805050,0irq/28-eth0-rx-0-21swapper/300:37:353
29805050,0irq/28-eth0-rx-0-21swapper/300:05:593
259950,0migration/223053-21fschecks_count20:04:132
259950,0migration/220175-21kthreadcore00:34:182
249950,0watchdog/214217-21sed20:39:182
222129955,0cyclictest0-21swapper/221:04:212
222129954,0cyclictest11142-21sed20:14:252
222129950,0cyclictest0-21swapper/222:19:232
222119955,0cyclictest0-21swapper/123:41:401
222119955,0cyclictest0-21swapper/122:18:261
222119955,0cyclictest0-21swapper/121:24:501
222119950,0cyclictest0-21swapper/122:40:301
222119950,0cyclictest0-21swapper/122:33:151
222119950,0cyclictest0-21swapper/119:59:131
222119950,0cyclictest0-21swapper/119:44:141
222109955,0cyclictest0-21swapper/022:32:140
222109955,0cyclictest0-21swapper/021:36:150
222109955,0cyclictest0-21swapper/020:14:260
222109955,0cyclictest0-21swapper/000:17:140
19150,0ktimersoftd/10-21swapper/100:11:191
149950,0migration/09526-21fschecks_time22:19:160
149950,0migration/08590-21latency_hist22:19:000
149950,0migration/05151-21kthreadcore23:29:150
149950,0migration/032573-21kthreadcore20:54:170
149950,0migration/031933-21kthreadcore20:29:170
149950,0migration/029604-21kthreadcore21:14:190
149950,0migration/028501-21sh23:04:280
149950,0migration/028059-21kthreadcore00:39:170
149950,0migration/026873-21sh22:46:030
149950,0migration/026343-21kthreadcore19:19:170
149950,0migration/025043-21kthreadcore00:19:180
149950,0migration/024761-21kthreadcore20:04:170
149950,0migration/024525-21kthreadcore21:49:180
149950,0migration/023771-21taskset23:23:590
149950,0migration/020194-21sh21:45:530
149950,0migration/017543-21kthreadcore22:04:190
149950,0migration/017530-21kthreadcore20:19:170
149950,0migration/01691-21fschecks_time19:49:130
149950,0migration/014247-21sh22:02:160
149950,0migration/014096-21kthreadcore22:39:180
149950,0migration/011423-21kthreadcore23:34:190
149950,0migration/010302-21latency19:29:170
8305040,0irq/26-0000:00:0-21swapper/222:59:002
4140,0ktimersoftd/00-21swapper/022:51:090
339940,0migration/39557-21kthreadcore19:29:163
339940,0migration/318644-21taskset20:22:113
339940,0migration/313039-21irqcore19:34:163
329940,0watchdog/320997-21kthreadcore20:44:183
329940,0watchdog/30-21swapper/323:34:193
329940,0watchdog/30-21swapper/320:58:543
329940,0watchdog/30-21swapper/320:34:183
329940,0watchdog/30-21swapper/319:54:183
29815040,0irq/29-eth0-tx-964-21diskmemload23:49:422
29815040,0irq/29-eth0-tx-964-21diskmemload23:19:232
29815040,0irq/29-eth0-tx-22063-21munin-node00:19:202
29815040,0irq/29-eth0-tx-21502sleep222:34:012
29815040,0irq/29-eth0-tx-11744-21telnet19:34:110
29815040,0irq/29-eth0-tx-0-21swapper/223:59:512
29815040,0irq/29-eth0-tx-0-21swapper/223:54:022
29815040,0irq/29-eth0-tx-0-21swapper/223:44:102
29815040,0irq/29-eth0-tx-0-21swapper/223:40:142
29815040,0irq/29-eth0-tx-0-21swapper/223:29:092
29815040,0irq/29-eth0-tx-0-21swapper/222:49:102
29815040,0irq/29-eth0-tx-0-21swapper/222:44:062
29815040,0irq/29-eth0-tx-0-21swapper/222:39:142
29815040,0irq/29-eth0-tx-0-21swapper/222:29:022
29815040,0irq/29-eth0-tx-0-21swapper/222:09:272
29815040,0irq/29-eth0-tx-0-21swapper/222:04:202
29815040,0irq/29-eth0-tx-0-21swapper/221:44:172
29815040,0irq/29-eth0-tx-0-21swapper/221:29:032
29815040,0irq/29-eth0-tx-0-21swapper/221:19:362
29815040,0irq/29-eth0-tx-0-21swapper/200:39:592
29815040,0irq/29-eth0-tx-0-21swapper/200:04:032
29815040,0irq/29-eth0-tx-0-21swapper/020:09:140
29805040,0irq/28-eth0-rx-0-21swapper/323:14:193
29805040,0irq/28-eth0-rx-0-21swapper/322:09:163
29805040,0irq/28-eth0-rx-0-21swapper/320:59:173
29805040,0irq/28-eth0-rx-0-21swapper/320:27:253
259940,0migration/27936-21kthreadcore00:09:182
259940,0migration/27800-21fschecks_time00:29:142
259940,0migration/24930-21kthreadcore19:49:172
259940,0migration/2439-21sh00:44:122
259940,0migration/232282-21kthreadcore00:24:172
259940,0migration/226365-21latency_hist21:13:592
259940,0migration/226264-21aten_r1power_cu20:29:102
259940,0migration/226197-21kthreadcore20:49:182
259940,0migration/214839-21kthreadcore19:34:172
259940,0migration/213914-21latency19:54:182
259940,0migration/21262-21kthreadcore20:54:172
259940,0migration/21143-21munin-node20:34:132
259940,0migration/210451-21needreboot19:29:182
249940,0watchdog/220999-21kthreadcore20:44:182
222129943,0cyclictest3571-21lldpd19:42:462
222129943,0cyclictest3571-21lldpd19:24:162
222129943,0cyclictest20292-21awk21:09:152
222129943,0cyclictest20107-21awk20:24:152
222129943,0cyclictest11144-21awk21:24:162
222129940,0cyclictest21606-21munin-node21:49:142
222119944,0cyclictest16725-21irqcore20:44:161
222119944,0cyclictest0-21swapper/123:03:411
222119944,0cyclictest0-21swapper/121:48:191
222119943,0cyclictest8098-21awk00:29:161
222119943,0cyclictest3571-21lldpd23:04:481
222119943,0cyclictest3571-21lldpd22:10:471
222119943,0cyclictest3571-21lldpd20:06:161
222119943,0cyclictest3571-21lldpd19:35:461
222119943,0cyclictest3571-21lldpd19:27:461
222119943,0cyclictest3571-21lldpd00:02:491
222119943,0cyclictest3524-21snmpd23:31:341
222119943,0cyclictest3524-21snmpd22:54:041
222119943,0cyclictest3524-21snmpd22:22:191
222119943,0cyclictest3524-21snmpd21:11:481
222119943,0cyclictest3524-21snmpd21:00:031
222119943,0cyclictest3524-21snmpd20:55:181
222119943,0cyclictest3524-21snmpd20:26:171
222119943,0cyclictest3524-21snmpd19:57:471
222119943,0cyclictest3524-21snmpd19:21:461
222119943,0cyclictest3524-21snmpd00:48:051
222119943,0cyclictest3524-21snmpd00:05:201
222119943,0cyclictest3335-21awk22:34:161
222119943,0cyclictest31797-21awk00:24:161
222119943,0cyclictest31303-21awk21:54:151
222119943,0cyclictest28852-21awk21:34:161
222119943,0cyclictest2281-21awk21:19:151
222119943,0cyclictest19929-21awk19:39:151
222119943,0cyclictest16587-21awk23:19:171
222119943,0cyclictest16285-21awk22:04:171
222109943,0cyclictest29590-21awk00:04:190
222109943,0cyclictest20005-21awk21:29:160
222109943,0cyclictest1645-21awk00:44:170
222109943,0cyclictest13138-21awk21:04:150
222109941,0cyclictest0-21swapper/019:24:100
222109940,0cyclictest26195-21basename21:13:590
222109940,0cyclictest0-21swapper/023:15:080
222109940,0cyclictest0-21swapper/021:03:280
19140,0ktimersoftd/10-21swapper/122:51:091
179940,0migration/1971-21aten_r1power_fr19:49:101
179940,0migration/132696-21switchtime23:44:261
179940,0migration/113136-21turbostat00:18:541
169940,0watchdog/1964-21diskmemload21:50:541
169940,0watchdog/127320-21ssh22:47:191
169940,0watchdog/126409-21munin-node21:14:181
169940,0watchdog/124247-21ssh00:39:071
169940,0watchdog/123483-21cut21:29:181
169940,0watchdog/113564-21ssh23:14:351
169940,0watchdog/10-21swapper/123:49:191
169940,0watchdog/10-21swapper/122:24:181
169940,0watchdog/10-21swapper/120:39:181
149940,0migration/07432-21switchtime20:34:250
149940,0migration/020420-21kthreadcore19:59:160
149940,0migration/017836-21kthreadcore20:44:170
149940,0migration/014112-21kthreadcore23:54:180
8305030,0irq/26-0000:00:0-21swapper/319:18:593
339930,0migration/328323-21kthreadcore19:44:163
29815030,0irq/29-eth0-tx-0-21swapper/019:44:100
29805030,0irq/28-eth0-rx-0-21swapper/321:04:113
29805030,0irq/28-eth0-rx-0-21swapper/320:14:113
249930,0watchdog/20-21swapper/219:19:182
222129932,0cyclictest3571-21lldpd19:45:152
222129932,0cyclictest30815-21awk20:09:142
222129932,0cyclictest10993-21sensors20:59:222
222129930,0cyclictest16019-21perl19:59:122
222119932,0cyclictest5820-21awk20:14:151
222119932,0cyclictest5672-21awk19:29:141
222119932,0cyclictest5180-21sed21:39:141
222119932,0cyclictest16843-21awk00:34:161
222119930,0cyclictest24838-21perl23:24:131
222119930,0cyclictest0-21swapper/121:59:171
222109933,0cyclictest14251-21awk22:59:160
222109932,0cyclictest9321-21awk19:54:160
222109932,0cyclictest3524-21snmpd00:29:480
222109932,0cyclictest31625-21awk23:09:150
222109932,0cyclictest23903-21awk20:49:160
222109932,0cyclictest21023-21kthreadcore22:24:180
222109932,0cyclictest17732-21aten2.4-expect23:39:120
222109932,0cyclictest14526-21sensors20:39:210
222109932,0cyclictest10844-21sensors22:54:220
169930,0watchdog/129751-21munin-node20:09:101
169930,0watchdog/10-21swapper/123:54:191
169930,0watchdog/10-21swapper/120:19:141
222129921,0cyclictest0-21swapper/220:18:592
222109921,0cyclictest29937-21latency_hist21:54:000
222109921,0cyclictest0-21swapper/023:24:040
169920,0watchdog/10-21swapper/121:04:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional