You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-04 - 19:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Tue Aug 04, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
277528483,0sleep20-21swapper/207:27:582
2966995353,0cyclictest32388-21md0_resync09:22:340
249524945,0sleep00-21swapper/007:25:030
2968994444,0cyclictest32387-21md1_resync09:22:342
252724342,0sleep10-21swapper/107:25:241
253723228,0sleep30-21swapper/307:25:303
29805070,0irq/28-eth0-rx-0-21swapper/312:13:543
8305060,0irq/26-0000:00:7768-21aten2.4-expect07:54:343
8305060,0irq/26-0000:00:20987-21needreboot07:59:443
8305060,0irq/26-0000:00:19901-21tune2fs08:24:353
8305060,0irq/26-0000:00:0-21swapper/211:21:552
4160,0ktimersoftd/00-21swapper/007:42:370
339960,0migration/324827-21sh12:36:353
339960,0migration/320480-21sh10:59:523
339960,0migration/315995-21latency11:34:413
29815060,0irq/29-eth0-tx-6325-21telnet08:59:340
29815060,0irq/29-eth0-tx-12047-21munin-node08:19:390
29815060,0irq/29-eth0-tx-0-21swapper/209:44:582
29805060,0irq/28-eth0-rx-9320-21users12:44:513
29805060,0irq/28-eth0-rx-32422-21ps10:29:453
29805060,0irq/28-eth0-rx-32342-21ntp_states12:39:453
29689966,0cyclictest0-21swapper/212:20:442
29689966,0cyclictest0-21swapper/211:54:242
29689960,0cyclictest0-21swapper/211:37:512
29689960,0cyclictest0-21swapper/211:33:352
29689960,0cyclictest0-21swapper/210:22:012
29669966,0cyclictest0-21swapper/010:44:440
29669960,0cyclictest2028-21md1_raid108:12:540
29669960,0cyclictest0-21swapper/012:24:030
29669960,0cyclictest0-21swapper/010:17:180
29669960,0cyclictest0-21swapper/010:04:510
27160,0ktimersoftd/20-21swapper/207:42:372
19160,0ktimersoftd/10-21swapper/107:42:371
149960,0migration/026090-21taskset11:41:420
149960,0migration/013750-21sh10:01:550
149960,0migration/010210-21kthreadcore10:54:430
8305050,0irq/26-0000:00:9002-21munin-node10:34:492
8305050,0irq/26-0000:00:4712-21ssh12:05:502
8305050,0irq/26-0000:00:4473-21cut09:39:392
8305050,0irq/26-0000:00:437-21ssh10:29:502
8305050,0irq/26-0000:00:4000-21perl07:29:363
8305050,0irq/26-0000:00:28070-21grep11:24:422
8305050,0irq/26-0000:00:26508-21diskstats12:39:372
8305050,0irq/26-0000:00:2411-21fschecks_time08:34:363
8305050,0irq/26-0000:00:23521-21iostat11:04:392
8305050,0irq/26-0000:00:21970-21cut09:29:433
8305050,0irq/26-0000:00:21449-21ps12:54:422
8305050,0irq/26-0000:00:18822-21cpu11:39:372
8305050,0irq/26-0000:00:18568-21interrupts12:34:382
8305050,0irq/26-0000:00:18464-21kthreadcore10:59:422
8305050,0irq/26-0000:00:18311-21ls10:24:362
8305050,0irq/26-0000:00:16959-21fschecks_count08:44:373
8305050,0irq/26-0000:00:167112sleep309:24:453
8305050,0irq/26-0000:00:15914-21hddtemp_smartct12:14:392
8305050,0irq/26-0000:00:15016-21kthreadcore08:19:413
8305050,0irq/26-0000:00:14327-21kthreadcore10:39:402
8305050,0irq/26-0000:00:1348-21ssh09:35:492
8305050,0irq/26-0000:00:1192-21ntp_states11:44:452
8305050,0irq/26-0000:00:11617-21sed10:54:502
8305050,0irq/26-0000:00:11192-21sh11:51:352
8305050,0irq/26-0000:00:0-21swapper/308:59:483
8305050,0irq/26-0000:00:0-21swapper/307:39:383
339950,0migration/39542-21munin-node08:39:353
339950,0migration/39230-21kthreadcore08:14:423
339950,0migration/38616-21missed_timers10:34:433
339950,0migration/3700-21gltestperf10:14:383
339950,0migration/33613-21kthreadcore07:49:403
339950,0migration/33290-21munin-node09:19:353
339950,0migration/33283-21sh10:50:303
339950,0migration/331958-21fschecks_time08:54:363
339950,0migration/329709-3199-raid-check09:54:283
339950,0migration/325234-21taskset10:27:503
339950,0migration/324762-21if_eth1.212:19:393
339950,0migration/317221-21kthreadcore12:14:433
339950,0migration/316933-21sensors_volt07:34:453
339950,0migration/315353-21kthreadcore09:04:383
339950,0migration/313901-21kthreadcore10:19:443
339950,0migration/311200-21sh11:51:363
329950,0watchdog/328115-21fschecks_time11:44:383
329950,0watchdog/326510-21kthreadcore09:09:413
329950,0watchdog/326051-21perl07:44:373
329950,0watchdog/323668-21cut08:04:413
329950,0watchdog/320716-21fschecks_time12:54:383
329950,0watchdog/30-21swapper/309:34:413
29815050,0irq/29-eth0-tx-8668-21ssh12:29:292
29815050,0irq/29-eth0-tx-27907-21ssh09:50:082
29815050,0irq/29-eth0-tx-22927-21kthreadcore10:44:422
29815050,0irq/29-eth0-tx-22297-21munin-node08:04:520
29815050,0irq/29-eth0-tx-21594-21df_inode11:59:382
29815050,0irq/29-eth0-tx-20891-21munin-node09:09:350
29815050,0irq/29-eth0-tx-0-21swapper/211:10:182
29815050,0irq/29-eth0-tx-0-21swapper/210:49:342
29815050,0irq/29-eth0-tx-0-21swapper/210:09:362
29815050,0irq/29-eth0-tx-0-21swapper/210:01:272
29815050,0irq/29-eth0-tx-0-21swapper/008:36:320
29815050,0irq/29-eth0-tx-0-21swapper/007:33:010
29805050,0irq/28-eth0-rx-8773-21irqcore11:14:413
29805050,0irq/28-eth0-rx-5266-21kthreadcore09:39:393
29805050,0irq/28-eth0-rx-2137-21cut12:24:413
29805050,0irq/28-eth0-rx-20593-21ssh09:49:053
29805050,0irq/28-eth0-rx-18953-21python11:54:493
29805050,0irq/28-eth0-rx-0-21swapper/312:50:163
29805050,0irq/28-eth0-rx-0-21swapper/312:29:373
29805050,0irq/28-eth0-rx-0-21swapper/312:04:353
29805050,0irq/28-eth0-rx-0-21swapper/312:02:563
29805050,0irq/28-eth0-rx-0-21swapper/311:40:243
29805050,0irq/28-eth0-rx-0-21swapper/311:19:353
29805050,0irq/28-eth0-rx-0-21swapper/311:12:373
29805050,0irq/28-eth0-rx-0-21swapper/310:44:353
29805050,0irq/28-eth0-rx-0-21swapper/310:09:423
29805050,0irq/28-eth0-rx-0-21swapper/310:09:173
29805050,0irq/28-eth0-rx-0-21swapper/310:03:213
29805050,0irq/28-eth0-rx-0-21swapper/309:52:063
29805050,0irq/28-eth0-rx-0-21swapper/308:29:223
29689955,0cyclictest0-21swapper/212:50:512
29689955,0cyclictest0-21swapper/209:15:382
29689955,0cyclictest0-21swapper/208:24:242
29689950,0cyclictest0-21swapper/212:26:242
29689950,0cyclictest0-21swapper/209:10:172
29689950,0cyclictest0-21swapper/208:51:122
29689950,0cyclictest0-21swapper/208:06:262
29689950,0cyclictest0-21swapper/207:29:232
29679955,0cyclictest0-21swapper/111:18:561
29679954,0cyclictest13945-21df09:04:341
29679953,0cyclictest24717-21awk12:19:391
29679950,0cyclictest0-21swapper/110:14:051
29679950,0cyclictest0-21swapper/108:27:401
29669955,0cyclictest27963-21kworker/0:107:50:550
29669955,0cyclictest0-21swapper/012:54:290
29669955,0cyclictest0-21swapper/012:49:170
29669954,0cyclictest30843-21awk09:54:390
29669953,0cyclictest5893-21kworker/0:112:43:040
29669950,0cyclictest0-21swapper/012:52:450
29669950,0cyclictest0-21swapper/012:00:150
29669950,0cyclictest0-21swapper/010:25:110
27150,0ktimersoftd/20-21swapper/209:30:182
259950,0migration/29891-21kthreadcore11:14:412
259950,0migration/25185-21munin-node08:54:452
259950,0migration/219024-21taskset08:22:372
249950,0watchdog/26073-21kthreadcore12:44:422
149950,0migration/09639-21fschecks_count08:39:360
149950,0migration/08560-21sh11:31:130
149950,0migration/07499-21aten_r1power_en11:14:350
149950,0migration/05429-21unixbench_multi08:54:480
149950,0migration/05252-21kthreadcore12:24:420
149950,0migration/05070-21proc_pri11:09:440
149950,0migration/03386-21sh10:50:480
149950,0migration/030852-21latency_hist11:09:230
149950,0migration/029763-21latency08:49:420
149950,0migration/02860-21taskset09:18:230
149950,0migration/027999-21fschecks_time11:44:380
149950,0migration/026769-21sh08:29:340
149950,0migration/025514-21cpuspeed_turbos07:44:360
149950,0migration/023025-21kthreadcore12:34:400
149950,0migration/021383-21kthreadcore09:29:420
149950,0migration/020436-21idleruntime08:24:370
149950,0migration/018538-21kthreadcore08:44:410
149950,0migration/017569-21kthreadcore12:14:430
149950,0migration/015524-21kthreadcore10:59:410
149950,0migration/015148-21munin-node07:59:360
149950,0migration/014680-21latency_hist12:14:220
149950,0migration/011642-21kthreadcore11:34:400
149950,0migration/011623-21sh09:43:590
149950,0migration/011146-21fschecks_count09:24:380
8305040,0irq/26-0000:00:0-21swapper/309:14:353
8305040,0irq/26-0000:00:0-21swapper/308:51:143
8305040,0irq/26-0000:00:0-21swapper/308:09:593
8305040,0irq/26-0000:00:0-21swapper/210:04:422
339940,0migration/38447-21kthreadcore10:54:423
339940,0migration/316597-21kthreadcore10:39:413
29815040,0irq/29-eth0-tx-0-21swapper/209:54:342
29815040,0irq/29-eth0-tx-0-21swapper/009:04:330
29815040,0irq/29-eth0-tx-0-21swapper/007:34:410
29805040,0irq/28-eth0-rx-0-21swapper/311:29:303
29805040,0irq/28-eth0-rx-0-21swapper/311:24:423
29805040,0irq/28-eth0-rx-0-21swapper/311:04:583
29689944,0cyclictest0-21swapper/208:35:172
29689943,0cyclictest889-21awk10:14:402
29689943,0cyclictest8822-21awk07:54:392
29689943,0cyclictest3571-21lldpd08:39:312
29689943,0cyclictest3571-21lldpd08:12:312
29689943,0cyclictest3524-21snmpd08:46:392
29689943,0cyclictest27774-21awk08:29:382
29689943,0cyclictest26410-21awk07:44:392
29679944,0cyclictest0-21swapper/110:29:421
29679944,0cyclictest0-21swapper/109:59:441
29679943,0cyclictest957-21awk12:24:391
29679943,0cyclictest7400-21awk12:09:401
29679943,0cyclictest3571-21lldpd12:51:031
29679943,0cyclictest3571-21lldpd11:12:031
29679943,0cyclictest3571-21lldpd10:20:321
29679943,0cyclictest3571-21lldpd09:39:011
29679943,0cyclictest3524-21snmpd12:48:271
29679943,0cyclictest3524-21snmpd07:48:241
29679943,0cyclictest3468-21awk10:34:391
29679943,0cyclictest3250-21irqbalance08:36:481
29679943,0cyclictest3250-21irqbalance07:36:181
29679943,0cyclictest30650-21tune2fs12:04:351
29679943,0cyclictest29575-21awk10:49:371
29679943,0cyclictest29296-21awk09:14:391
29679943,0cyclictest23331-21awk08:04:391
29679943,0cyclictest19167-21awk09:29:411
29679943,0cyclictest13531-21awk11:54:401
29679943,0cyclictest0-21swapper/109:49:291
29679942,0cyclictest19706-21awk11:39:401
29679942,0cyclictest17573-21awk08:44:401
29679941,0cyclictest8839-21sh07:54:391
29679941,0cyclictest3919-21grep10:14:431
29679941,0cyclictest28720-21irqrtprio11:44:411
29679941,0cyclictest20936-21kthreadcore12:34:391
29679941,0cyclictest16565-21diskstats11:19:361
29679941,0cyclictest12526-21diskstats09:44:381
29679941,0cyclictest10132-21rm09:40:001
29679940,0cyclictest0-21swapper/112:54:351
29679940,0cyclictest0-21swapper/112:30:561
29679940,0cyclictest0-21swapper/111:06:071
29669944,0cyclictest27963-21kworker/0:107:57:450
29669944,0cyclictest0-21swapper/010:09:250
29669943,0cyclictest3250-21irqbalance12:04:290
29669943,0cyclictest3250-21irqbalance11:56:190
29669943,0cyclictest3250-21irqbalance11:50:090
29669943,0cyclictest3250-21irqbalance11:21:090
29669943,0cyclictest3250-21irqbalance10:37:590
29669943,0cyclictest3250-21irqbalance10:19:590
29669943,0cyclictest3250-21irqbalance09:49:390
29669943,0cyclictest26043-21awk11:24:400
29669943,0cyclictest13163-21awk09:44:400
259940,0migration/24404-21kthreadcore07:49:412
259940,0migration/218259-21kthreadcore07:59:422
259940,0migration/211964-21irqcore07:34:402
259940,0migration/210786-21aten_r1power_vo09:24:372
249940,0watchdog/27682-21irqrtprio12:09:422
249940,0watchdog/25520-21perl08:14:372
249940,0watchdog/23552-21lldpd09:07:012
179940,0migration/131102-21irqrtprio08:09:381
179940,0migration/116410-21kthreadcore10:59:411
149940,0migration/027436-21irqcore10:29:400
149940,0migration/014221-21kthreadcore10:39:400
29689930,0cyclictest6783-21grep08:59:362
29679932,0cyclictest19772-21cat10:44:231
29679932,0cyclictest0-21swapper/109:24:361
29679931,0cyclictest9456-21cut08:39:351
29679931,0cyclictest6222-21aten2.4-expect08:59:341
29679931,0cyclictest4983-21df08:14:361
29679931,0cyclictest4932-21ssh10:54:331
29679931,0cyclictest3584-21latency_hist11:49:221
29679931,0cyclictest32556-21date07:49:221
29679931,0cyclictest3234-21hostname07:29:331
29679931,0cyclictest31963-21munin-node09:54:341
29679931,0cyclictest3165-21cat09:19:221
29679931,0cyclictest31210-21aten_r1power_en08:54:341
29679931,0cyclictest26752-21aten_r1power_cu08:29:341
29679931,0cyclictest25948-21cat12:39:231
29679931,0cyclictest24918-21aten_r1power_en11:24:351
29679931,0cyclictest23884-21munin-node08:49:341
29679931,0cyclictest21712-21perl09:09:371
29679931,0cyclictest21108-21ssh11:59:261
29679931,0cyclictest17346-21cut10:24:321
29679931,0cyclictest17300-21cut12:14:431
29679931,0cyclictest14961-21cat07:59:221
29679931,0cyclictest14908-21munin-node10:04:341
29679931,0cyclictest12266-21egrep08:19:351
29679931,0cyclictest11112-21cat10:39:231
29679931,0cyclictest1094-21ssh11:29:271
29679931,0cyclictest0-21swapper/111:34:231
29669933,0cyclictest5893-21kworker/0:112:29:300
29669933,0cyclictest27963-21kworker/0:108:14:250
29669933,0cyclictest2686-21kworker/0:009:34:240
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional