You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-04 - 00:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Thu Sep 03, 2026 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
296481721020,1sleep72964794-21ssh09:29:547
33361792590,0sleep40-21swapper/412:00:014
266866625318,30sleep70-21swapper/707:05:407
266887325242,7sleep50-21swapper/507:08:345
266888124837,8sleep40-21swapper/407:08:414
2669245994340,2cyclictest3166034-21kworker/u16:2+events_unbound12:09:315
2669245994339,4cyclictest2897000-21kworker/u16:2+flush-8:009:14:285
2669245994240,2cyclictest3153751-21kworker/u16:1+events_unbound11:00:305
2669245994038,2cyclictest3363665-21kworker/u16:4+flush-8:012:25:185
266890224016,8sleep60-21swapper/607:09:006
2669245993937,2cyclictest3226646-21kworker/u16:1+events_unbound11:35:195
2669245993735,2cyclictest3166034-21kworker/u16:2+events_unbound11:59:435
2669245993735,2cyclictest3091874-21kworker/u16:4+events_unbound10:35:025
2669245993735,2cyclictest3015755-21kworker/u16:3+events_unbound10:49:185
2669245993734,2cyclictest3389866-21kworker/u16:0+events_unbound12:34:305
2669245993734,2cyclictest3091874-21kworker/u16:4+events_unbound10:39:305
2669245993634,2cyclictest3166034-21kworker/u16:2+flush-8:011:59:285
2669245993633,2cyclictest3015755-21kworker/u16:3+events_unbound10:49:305
2669245993533,2cyclictest3226646-21kworker/u16:1+events_unbound11:32:395
2669245993533,2cyclictest3200368-21kworker/u16:3+events_unbound11:18:395
2669245993533,2cyclictest3003165-21kworker/u16:0+events_unbound10:01:355
2669245993433,1cyclictest3301819-21kworker/u16:3+events_unbound12:04:305
2669245993432,2cyclictest3140343-21kworker/u16:0+events_unbound11:11:035
2669245993431,2cyclictest3350801-21kworker/u16:1+events_unbound12:14:305
2669245993331,2cyclictest3301819-21kworker/u16:3+events_unbound12:19:435
2669245993331,2cyclictest3252358-21kworker/u16:0+events_unbound11:46:185
2669245993331,2cyclictest3166034-21kworker/u16:2+events_unbound11:05:235
2669245993331,2cyclictest3166034-21kworker/u16:2+events_unbound11:05:235
2669245993331,2cyclictest3015755-21kworker/u16:3+events_unbound10:34:195
2669245993331,2cyclictest3015755-21kworker/u16:3+events_unbound10:05:395
2669245993331,2cyclictest2703147-21kworker/u16:0+flush-8:007:34:285
2669245993331,2cyclictest2669434-21kworker/u16:1+flush-8:007:39:285
2669245993330,2cyclictest3227752-21kworker/u16:4+events_unbound11:24:305
2669250993226,5cyclictest3400583-21latency_hist12:29:287
2669245993230,2cyclictest3015755-21kworker/u16:3+events_unbound10:17:545
2669245993129,2cyclictest2928607-21kworker/u16:1+events_unbound09:47:215
2669245993129,2cyclictest2928607-21kworker/u16:1+events_unbound09:47:215
2669245993129,2cyclictest2928607-21kworker/u16:1+events_unbound09:35:395
2669245993028,2cyclictest3389866-21kworker/u16:0+flush-8:012:30:075
2669245993028,2cyclictest3252358-21kworker/u16:0+events_unbound11:51:465
2669245993028,2cyclictest3200368-21kworker/u16:3+events_unbound11:21:385
2669245993028,2cyclictest3015755-21kworker/u16:3+events_unbound10:20:585
2669245993028,2cyclictest3003165-21kworker/u16:0+events_unbound10:10:345
2669250992923,5cyclictest3252322-21latency_hist11:29:287
2669245992927,2cyclictest3226646-21kworker/u16:1+events_unbound11:40:385
2669245992927,2cyclictest2928607-21kworker/u16:1+events_unbound09:33:075
2669245992927,2cyclictest2897000-21kworker/u16:2+events_unbound09:50:385
2669245992927,2cyclictest2897000-21kworker/u16:2+events_unbound09:15:475
2669245992826,2cyclictest2928607-21kworker/u16:1+events_unbound09:27:445
2669245992826,2cyclictest2867820-21kworker/u16:0+events_unbound09:21:195
32138142270,1chrt3213812-21ssh11:11:557
30790142270,1chrt3079011-21ssh10:18:507
2669245992725,2cyclictest2669435-21kworker/u16:4+flush-8:007:14:245
32528252260,1chrt3252826-21sh11:29:437
2669247992622,3cyclictest2703147-21kworker/u16:0+events_unbound08:06:586
2669245992624,2cyclictest3153751-21kworker/u16:1+events_unbound10:54:585
2669245992624,2cyclictest2989611-21kworker/u16:3+events_unbound09:44:275
2669241992625,1cyclictest3226646-21kworker/u16:1+events_unbound11:37:284
2669250992524,0cyclictest0-21swapper/712:14:237
2669247992523,2cyclictest2928607-21kworker/u16:1+events_unbound09:29:596
2669245992523,2cyclictest3015755-21kworker/u16:3+flush-8:010:25:245
2669245992523,2cyclictest3015755-21kworker/u16:3+flush-8:010:25:245
2669245992523,2cyclictest2928607-21kworker/u16:1+events_unbound09:57:585
2669241992523,2cyclictest2867820-21kworker/u16:0+events_unbound08:54:434
2669250992419,4cyclictest3141205-21latency_hist10:44:287
2669250992418,5cyclictest2943462-21latency_hist09:24:297
2669245992422,2cyclictest2837268-21kworker/u16:3+flush-8:008:45:205
2669245992422,2cyclictest2789346-21kworker/u16:5+flush-8:008:24:395
2669245992422,2cyclictest1985015-21kworker/u16:2+events_unbound07:19:465
2669241992321,2cyclictest3003165-21kworker/u16:0+events_unbound10:18:044
2669250992217,4cyclictest1017-21in:imjournal11:44:237
2669250992216,5cyclictest2750563-21latency_hist07:49:297
2669245992220,2cyclictest2770395-21kworker/u16:3+flush-8:008:00:395
2669250992120,0cyclictest0-21swapper/708:04:437
2669247992119,2cyclictest3030094-21kworker/u16:5+flush-8:010:14:286
2669247992119,2cyclictest2928607-21kworker/u16:1+events_unbound09:49:596
2669247992117,3cyclictest3015755-21kworker/u16:3+events_unbound10:49:416
2669245992119,2cyclictest2896994-21kworker/u16:1+events_unbound09:04:355
2669250992018,1cyclictest3412938-21munin-run12:34:277
2669250992015,4cyclictest3190621-21latency_hist11:04:287
2669245992018,2cyclictest2669435-21kworker/u16:4+flush-8:007:39:475
2669250991913,5cyclictest2980600-21latency_hist09:39:287
2669245991917,2cyclictest2799260-21kworker/u16:1+flush-8:008:16:495
2669245991917,2cyclictest2703147-21kworker/u16:0+flush-8:008:40:035
2669245991917,2cyclictest2669435-21kworker/u16:4+events_unbound07:44:395
2669245991916,2cyclictest2703147-21kworker/u16:0+events_unbound08:29:405
2669245991914,3cyclictest2703147-21kworker/u16:0+events_unbound07:24:455
2669250991816,1cyclictest0-21swapper/707:24:537
2669250991813,4cyclictest648-21systemd-journal11:39:237
2669247991814,3cyclictest2818997-21kworker/u16:2+flush-8:008:39:466
2669250991714,2cyclictest1277-21snmpd08:49:167
266925099170,1cyclictest0-21swapper/709:04:537
266924799178,8cyclictest0-21swapper/608:19:446
266924799178,8cyclictest0-21swapper/608:19:446
2669247991715,2cyclictest2928607-21kworker/u16:1+flush-8:009:29:296
2669247991714,2cyclictest2837268-21kworker/u16:3+flush-8:008:34:286
2669247991713,3cyclictest2927932-21ps09:14:546
2669245991715,2cyclictest2703147-21kworker/u16:0+events_unbound07:57:395
2669245991714,2cyclictest2799260-21kworker/u16:1+events_unbound08:19:305
2669245991714,2cyclictest2799260-21kworker/u16:1+events_unbound08:19:305
2669250991613,2cyclictest0-21swapper/707:49:297
266925099160,14cyclictest1277-21snmpd12:01:567
266925099160,14cyclictest0-21swapper/708:14:527
2669247991614,2cyclictest2770395-21kworker/u16:3+flush-8:007:59:556
2669245991614,2cyclictest2818997-21kworker/u16:2+events_unbound08:36:385
2669241991614,2cyclictest2799260-21kworker/u16:1+events_unbound08:14:434
266925099159,5cyclictest3375891-21latency_hist12:19:287
266925099158,6cyclictest2848026-21latency_hist08:39:297
2669250991514,0cyclictest0-21swapper/707:19:537
2669247991514,1cyclictest0-21swapper/611:09:026
2669247991514,1cyclictest0-21swapper/611:09:026
266924799150,1cyclictest0-21swapper/611:09:496
2669245991513,2cyclictest2837268-21kworker/u16:3+events_unbound09:01:395
2669245991510,4cyclictest2780956-21cat08:04:435
2669241991513,2cyclictest3015755-21kworker/u16:3+flush-8:010:29:594
2669241991512,2cyclictest3015755-21kworker/u16:3+flush-8:010:49:544
266924199150,1cyclictest0-21swapper/411:09:484
266925099149,4cyclictest3228883-21cat11:19:427
2669250991412,1cyclictest0-21swapper/711:49:477
2669250991411,2cyclictest1277-21snmpd08:20:397
2669250991411,2cyclictest1277-21snmpd08:20:397
2669250991411,2cyclictest0-21swapper/710:29:287
2669250991411,2cyclictest0-21swapper/709:54:287
2669247991413,1cyclictest0-21swapper/612:24:526
2669247991413,1cyclictest0-21swapper/611:59:386
2669247991413,1cyclictest0-21swapper/611:55:516
2669247991413,1cyclictest0-21swapper/611:41:216
266924799140,1cyclictest0-21swapper/610:27:156
266924799140,1cyclictest0-21swapper/610:27:156
2669241991413,1cyclictest0-21swapper/412:11:174
2669241991413,1cyclictest0-21swapper/411:09:014
2669241991413,1cyclictest0-21swapper/411:09:014
2669241991413,1cyclictest0-21swapper/410:54:594
266924199140,1cyclictest0-21swapper/410:38:364
266924199140,14cyclictest0-21swapper/412:25:574
266924199140,14cyclictest0-21swapper/412:24:044
266924199140,14cyclictest0-21swapper/411:29:024
266924199140,13cyclictest0-21swapper/409:39:564
266925099139,3cyclictest1277-21snmpd10:03:267
266925099139,3cyclictest1277-21snmpd09:04:227
266925099139,3cyclictest1277-21snmpd08:41:557
266925099138,4cyclictest3178219-21latency_hist10:59:287
266925099137,5cyclictest3326447-21turbostat11:59:277
2669250991310,2cyclictest0-21swapper/709:44:517
2669250991310,2cyclictest0-21swapper/709:44:517
266925099130,3cyclictest3201933-21ssh11:07:417
266925099130,3cyclictest3201933-21ssh11:07:417
266925099130,2cyclictest3298457-21ntpq11:44:537
266925099130,11cyclictest1277-21snmpd10:05:117
266924799139,3cyclictest3142497-21cat10:44:436
2669247991312,1cyclictest0-21swapper/612:08:186
2669247991312,1cyclictest0-21swapper/611:53:586
2669247991312,1cyclictest0-21swapper/611:44:496
2669247991312,1cyclictest0-21swapper/611:23:426
2669247991312,1cyclictest0-21swapper/610:55:006
2669247991312,1cyclictest0-21swapper/610:29:376
2669247991312,1cyclictest0-21swapper/607:42:406
2669247991311,1cyclictest0-21swapper/608:59:466
266924799130,0cyclictest0-21swapper/610:39:246
2669245991311,2cyclictest2837268-21kworker/u16:3+events_unbound08:55:205
2669245991311,2cyclictest2669435-21kworker/u16:4+flush-8:007:54:245
2669241991312,1cyclictest0-21swapper/412:37:184
2669241991312,1cyclictest0-21swapper/411:41:204
2669241991312,1cyclictest0-21swapper/410:28:024
2669241991312,1cyclictest0-21swapper/410:28:024
2669241991312,1cyclictest0-21swapper/409:24:394
2669241991312,1cyclictest0-21swapper/409:23:054
2669241991312,1cyclictest0-21swapper/408:46:114
2669241991312,1cyclictest0-21swapper/407:24:414
2669241991310,2cyclictest2895341-21kthreadcore08:59:494
266924199130,1cyclictest0-21swapper/412:06:244
266924199130,13cyclictest0-21swapper/412:29:444
266924199130,13cyclictest0-21swapper/409:11:444
266924199130,13cyclictest0-21swapper/407:33:024
266924199130,0cyclictest0-21swapper/411:01:374
266925099128,3cyclictest5994-21gmain09:28:587
266925099128,3cyclictest5988-21gmain10:50:257
266925099128,3cyclictest1277-21snmpd07:36:567
266925099128,2cyclictest0-21swapper/710:19:427
266925099127,4cyclictest6175-21gvfs-afc-volume08:54:407
266925099127,4cyclictest2779804-21systemd-run08:04:297
266925099123,7cyclictest3376337-21ssh12:19:357
2669250991210,1cyclictest0-21swapper/707:54:507
266925099120,11cyclictest3227333-21ssh11:19:017
2669247991211,1cyclictest0-21swapper/612:10:126
2669247991211,1cyclictest0-21swapper/611:29:516
2669247991211,1cyclictest0-21swapper/611:02:256
266924799120,12cyclictest0-21swapper/607:15:056
266924799120,0cyclictest0-21swapper/612:19:116
2669245991210,2cyclictest2789346-21kworker/u16:5+events_unbound08:12:205
2669241991211,1cyclictest0-21swapper/411:29:504
2669241991211,1cyclictest0-21swapper/411:23:414
2669241991211,1cyclictest0-21swapper/410:40:574
2669241991211,1cyclictest0-21swapper/407:09:334
2669241991210,2cyclictest2789346-21kworker/u16:5+events_unbound08:24:434
266924199120,12cyclictest0-21swapper/408:22:234
266924199120,12cyclictest0-21swapper/408:22:234
266924199120,12cyclictest0-21swapper/407:58:164
266924199120,0cyclictest0-21swapper/408:11:404
266925099118,2cyclictest1277-21snmpd08:51:467
266925099118,2cyclictest1277-21snmpd08:30:067
266925099117,3cyclictest1277-21snmpd07:15:267
266925099117,3cyclictest1277-21snmpd07:12:207
266925099110,3cyclictest2720781-21switchtime07:29:567
266925099110,1cyclictest3065790-21ssh10:12:177
266925099110,1cyclictest2981023-21ssh09:39:337
266925099110,10cyclictest3350615-21ssh12:08:307
266925099110,10cyclictest3027964-21ssh09:55:587
266925099110,10cyclictest1277-21snmpd10:36:127
266924799119,2cyclictest2928607-21kworker/u16:1+flush-8:009:39:446
266924799119,2cyclictest2789346-21kworker/u16:5+flush-8:008:25:076
266924799117,3cyclictest2790534-21tune2fs08:09:416
266924799117,3cyclictest2712933-21cat07:29:436
2669247991110,1cyclictest0-21swapper/609:13:196
2669247991110,1cyclictest0-21swapper/608:45:346
2669247991110,1cyclictest0-21swapper/607:56:236
2669247991110,1cyclictest0-21swapper/607:28:386
2669247991110,1cyclictest0-21swapper/607:13:116
266924799110,10cyclictest2874860-21kthreadcore08:49:506
266924799110,10cyclictest2808443-21sed08:14:556
2669245991110,1cyclictest0-21swapper/508:50:035
266924199118,2cyclictest2927864-21ntpq09:14:534
266924199117,3cyclictest2897782-21cat09:04:454
2669241991110,1cyclictest0-21swapper/412:16:114
2669241991110,1cyclictest0-21swapper/411:55:504
2669241991110,1cyclictest0-21swapper/408:40:504
2669241991110,1cyclictest0-21swapper/407:52:544
266925099106,3cyclictest1277-21snmpd09:14:497
266925099106,3cyclictest1277-21snmpd09:09:557
266925099106,3cyclictest1277-21snmpd08:14:217
266925099100,9cyclictest3425024-21ssh12:39:017
266925099100,3cyclictest3092740-21ssh10:24:407
266925099100,3cyclictest3092740-21ssh10:24:407
266925099100,1cyclictest0-21swapper/710:44:537
266924799109,1cyclictest0-21swapper/607:35:066
266924799106,3cyclictest3026207-21grep09:54:496
266924799106,3cyclictest2751735-21cat07:49:446
266924799105,4cyclictest2897619-21tune2fs09:04:446
266924799100,9cyclictest3216217-21cat11:14:396
266924799100,9cyclictest2934971-21grep09:19:466
266924799100,4cyclictest2749487-21missed_timers07:44:506
266924799100,2cyclictest2971697-21kthreadcore09:34:456
266924799100,10cyclictest0-21swapper/608:55:306
266924599109,1cyclictest0-21swapper/507:18:465
266924199109,1cyclictest0-21swapper/411:53:574
266924199109,1cyclictest0-21swapper/410:47:354
266924199109,1cyclictest0-21swapper/408:03:384
266924199109,1cyclictest0-21swapper/407:15:144
266924199105,4cyclictest3006594-21cat09:49:474
26692509996,2cyclictest0-21swapper/708:28:387
26692509995,3cyclictest0-21swapper/707:39:487
26692479998,1cyclictest0-21swapper/612:36:136
26692479998,1cyclictest0-21swapper/612:22:586
26692479998,1cyclictest0-21swapper/611:24:296
26692479998,1cyclictest0-21swapper/610:41:466
26692479997,2cyclictest86-21ksoftirqd/611:34:436
26692479996,2cyclictest3030969-21df09:59:406
26692479995,3cyclictest2692954-21cpuspeed_turbos07:19:406
26692479994,4cyclictest3082060-21grep10:19:466
26692479991,7cyclictest3067694-21cpuspeed_turbos10:14:406
26692479990,8cyclictest3044963-21cut10:04:456
26692479990,8cyclictest2994138-21perl09:44:416
26692479990,8cyclictest2994138-21perl09:44:416
26692419998,1cyclictest0-21swapper/411:44:484
26692419998,1cyclictest0-21swapper/408:32:004
26692419998,1cyclictest0-21swapper/407:20:544
26692419997,2cyclictest2928607-21kworker/u16:1+events_unbound09:59:434
26692419996,3cyclictest2897000-21kworker/u16:2+flush-8:009:29:544
26692419990,8cyclictest2734772-21cut07:39:464
26692479986,2cyclictest86-21ksoftirqd/612:32:506
26692419985,2cyclictest0-21swapper/408:49:484
26692419984,3cyclictest2839358-21tune2fs08:34:424
26692419983,4cyclictest3222132-21cut11:14:474
26692419983,4cyclictest3043364-21expr10:04:404
26692419983,4cyclictest2993765-21expr09:44:394
26692419983,4cyclictest2993765-21expr09:44:394
26692419983,4cyclictest2782581-21cut08:04:464
26692419983,4cyclictest2724396-21grep07:34:464
26692479973,3cyclictest2839170-21expr08:34:406
26692419974,2cyclictest3081441-21kthreadcore10:19:454
26692419974,2cyclictest2742488-21kthreadcore07:44:464
26692419973,3cyclictest3018512-21expr09:54:414
26692419973,3cyclictest2969539-21ip_192.168.115.09:34:434
26692419970,6cyclictest3060333-21tr10:09:524
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional