You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-30 - 09:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Sun Aug 30, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
293685126049,8sleep40-21swapper/419:08:404
293678625520,30sleep70-21swapper/719:07:477
293664125443,8sleep50-21swapper/519:05:455
2937226994640,5cyclictest3018837-21latency_hist19:49:467
293687424522,8sleep60-21swapper/619:08:596
2937226994135,5cyclictest3096796-21latency_hist20:29:477
293722699410,39cyclictest648-21systemd-journal22:34:467
2937226993832,5cyclictest3155133-21latency_hist20:59:477
2937226993530,4cyclictest3357680-21latency_hist22:24:467
2937213993329,4cyclictest2969991-21kworker/u16:3+flush-8:019:29:475
2937226993226,5cyclictest3345483-21latency_hist22:19:467
2937213993129,2cyclictest3490101-21kworker/u16:1+flush-8:000:25:025
2937213993128,2cyclictest3116050-21kworker/u16:1+events_unbound20:45:015
2937213992724,2cyclictest3552436-21kworker/u16:2+events_unbound00:24:465
2937213992624,2cyclictest3477763-21kworker/u16:0+events_unbound23:24:465
2937213992523,2cyclictest3539042-21kworker/u16:0+events_unbound23:40:095
2937213992523,2cyclictest3126388-21kworker/u16:0+events_unbound21:30:015
2937213992423,1cyclictest3268227-21kworker/u16:0+flush-8:021:59:475
2937213992421,2cyclictest3154910-21kworker/u16:3+flush-8:021:10:045
2937213992220,2cyclictest2969991-21kworker/u16:3+events_unbound19:35:095
2937226992120,0cyclictest0-21swapper/719:40:027
2937226992118,2cyclictest3125228-21smart_sda20:40:127
2937226992115,5cyclictest3675124-21latency_hist00:34:467
2937226992017,2cyclictest3638599-21sed00:19:467
2937213992018,2cyclictest3382586-21kworker/u16:0+events_unbound22:45:025
2937213992015,5cyclictest3416561-21kworker/u16:2+flush-8:023:14:465
2937210992017,2cyclictest3490101-21kworker/u16:1+flush-8:000:10:484
293722699190,18cyclictest3391209-21ssh22:35:097
2937222991915,3cyclictest3285785-21cat21:55:026
2937213991917,2cyclictest3382586-21kworker/u16:0+flush-8:022:35:105
2937210991917,2cyclictest3552436-21kworker/u16:2+flush-8:023:54:514
2937226991812,5cyclictest3211291-21latency_hist21:24:467
2937213991816,2cyclictest3565393-21kworker/u16:3+events_unbound00:09:415
2937213991816,2cyclictest3552436-21kworker/u16:2+events_unbound00:15:145
2937226991714,2cyclictest1277-21snmpd21:53:487
2937226991713,3cyclictest1277-21snmpd23:20:387
2937226991711,5cyclictest3028562-21latency_hist19:54:467
2937213991715,2cyclictest3416561-21kworker/u16:2+events_unbound22:59:595
2937213991715,2cyclictest3382586-21kworker/u16:0+events_unbound22:50:155
2937226991611,4cyclictest3406516-21latency_hist22:44:467
2937226991610,5cyclictest3145406-21latency_hist20:54:477
2937222991611,4cyclictest3371177-21cat22:30:016
293721399160,15cyclictest3619003-21kthreadcore00:10:035
293722699159,5cyclictest3135725-21latency_hist20:49:467
293722299150,1cyclictest0-21swapper/622:35:096
293722299150,1cyclictest0-21swapper/600:30:056
293721399150,1cyclictest0-21swapper/520:40:095
293721399150,15cyclictest0-21swapper/523:49:055
2937210991514,1cyclictest0-21swapper/423:07:364
293721099150,15cyclictest0-21swapper/421:10:564
293722699140,1cyclictest0-21swapper/723:10:087
293722699140,1cyclictest0-21swapper/723:00:097
293722699140,13cyclictest1277-21snmpd23:15:297
293722699140,13cyclictest0-21swapper/722:50:117
293722699140,13cyclictest0-21swapper/720:35:077
293722699140,12cyclictest0-21swapper/723:59:587
2937222991413,1cyclictest0-21swapper/623:11:346
2937222991413,1cyclictest0-21swapper/622:20:206
2937222991413,1cyclictest0-21swapper/600:15:066
293722299140,1cyclictest0-21swapper/622:07:056
293722299140,1cyclictest0-21swapper/621:35:126
293722299140,1cyclictest0-21swapper/621:29:346
293722299140,1cyclictest0-21swapper/621:29:346
293722299140,1cyclictest0-21swapper/600:11:106
293722299140,1cyclictest0-21swapper/600:08:486
2937213991412,2cyclictest3225202-21kworker/u16:3+flush-8:021:50:035
2937213991412,2cyclictest3086946-21kworker/u16:1+events_unbound20:25:015
293721399140,1cyclictest0-21swapper/523:29:325
293721399140,1cyclictest0-21swapper/523:16:465
293721399140,14cyclictest0-21swapper/522:30:445
293721399140,14cyclictest0-21swapper/522:09:275
293721399140,14cyclictest0-21swapper/521:15:515
2937210991413,1cyclictest0-21swapper/423:24:004
2937210991413,1cyclictest0-21swapper/400:33:034
293721099140,1cyclictest0-21swapper/422:22:404
293721099140,1cyclictest0-21swapper/422:06:354
293721099140,1cyclictest0-21swapper/421:54:554
293721099140,14cyclictest0-21swapper/423:44:484
293722699139,3cyclictest1277-21snmpd21:44:507
293722699139,3cyclictest1277-21snmpd21:34:087
293722699139,3cyclictest1277-21snmpd20:22:257
293722699139,3cyclictest1277-21snmpd00:21:127
293722699137,5cyclictest648-21systemd-journal22:59:467
293722699136,6cyclictest6175-21gvfs-afc-volume19:30:157
2937226991312,0cyclictest0-21swapper/719:15:027
2937226991310,2cyclictest0-21swapper/723:35:077
2937222991312,1cyclictest0-21swapper/623:37:066
2937222991312,1cyclictest0-21swapper/623:18:216
2937222991312,1cyclictest0-21swapper/623:05:356
2937222991312,1cyclictest0-21swapper/621:15:326
2937222991310,2cyclictest3341528-21cut22:15:086
293722299130,13cyclictest0-21swapper/622:11:306
293722299130,0cyclictest0-21swapper/623:56:116
293721399139,3cyclictest3010258-21cat19:45:025
2937213991312,1cyclictest0-21swapper/523:59:485
2937213991312,1cyclictest0-21swapper/523:04:475
2937213991312,1cyclictest0-21swapper/522:21:545
2937213991312,1cyclictest0-21swapper/522:17:295
2937213991311,2cyclictest3416561-21kworker/u16:2+flush-8:023:35:175
2937213991311,2cyclictest3000554-21kworker/u16:2+flush-8:019:44:425
2937213991310,2cyclictest3248363-21kworker/u16:2+flush-8:021:44:535
293721399130,13cyclictest0-21swapper/521:21:035
2937210991312,1cyclictest0-21swapper/423:12:484
2937210991312,1cyclictest0-21swapper/422:57:124
2937210991312,1cyclictest0-21swapper/422:47:354
2937210991312,1cyclictest0-21swapper/422:39:324
2937210991312,1cyclictest0-21swapper/422:26:184
2937210991312,1cyclictest0-21swapper/421:20:334
293721099130,1cyclictest0-21swapper/421:30:104
293721099130,13cyclictest0-21swapper/423:18:474
293721099130,13cyclictest0-21swapper/422:10:134
293722699129,2cyclictest1277-21snmpd23:58:097
293722699129,2cyclictest1277-21snmpd23:53:157
293722699129,2cyclictest1277-21snmpd23:42:207
293722699129,2cyclictest1277-21snmpd22:11:157
293722699129,2cyclictest1277-21snmpd21:43:087
293722699129,2cyclictest1277-21snmpd20:16:497
293722699129,2cyclictest1277-21snmpd19:22:207
293722699129,2cyclictest0-21swapper/721:10:057
293722699128,3cyclictest1277-21snmpd21:08:567
293722699128,3cyclictest1277-21snmpd19:55:337
293722699128,3cyclictest1277-21snmpd19:14:147
2937226991211,0cyclictest0-21swapper/700:06:057
293722699120,2cyclictest3415630-21nfs_client22:45:117
293722699120,11cyclictest1277-21snmpd22:26:367
293722699120,11cyclictest1277-21snmpd00:11:247
293722299129,2cyclictest3167719-21kthreadcore21:05:056
293722299124,7cyclictest0-21swapper/620:15:086
293722299122,3cyclictest3102361-21cut20:30:066
2937222991211,1cyclictest0-21swapper/622:02:416
2937222991211,1cyclictest0-21swapper/620:41:296
293722299120,1cyclictest0-21swapper/620:46:136
293722299120,1cyclictest0-21swapper/620:12:486
293721399128,3cyclictest2979984-21kworker/u16:0+flush-8:019:55:175
2937213991211,1cyclictest0-21swapper/522:13:045
2937213991211,1cyclictest0-21swapper/521:43:175
2937213991211,1cyclictest0-21swapper/520:08:225
2937213991210,2cyclictest3552436-21kworker/u16:2+flush-8:023:59:465
2937210991211,1cyclictest0-21swapper/423:29:124
2937210991211,1cyclictest0-21swapper/421:27:484
2937210991211,1cyclictest0-21swapper/421:27:484
2937210991211,1cyclictest0-21swapper/421:15:214
2937210991211,1cyclictest0-21swapper/420:05:314
2937210991211,1cyclictest0-21swapper/420:03:564
2937210991211,1cyclictest0-21swapper/420:03:564
2937210991211,1cyclictest0-21swapper/419:56:324
293721099120,12cyclictest0-21swapper/420:12:084
293722699118,2cyclictest1277-21snmpd23:05:317
293722699118,2cyclictest1277-21snmpd21:55:157
293722699118,2cyclictest1277-21snmpd21:29:087
293722699118,2cyclictest1277-21snmpd21:29:087
293722699118,2cyclictest1277-21snmpd19:25:567
293722699117,3cyclictest6175-21gvfs-afc-volume21:35:107
293722699117,3cyclictest1277-21snmpd20:31:167
293722699117,2cyclictest0-21swapper/700:35:037
293722699115,5cyclictest6175-21gvfs-afc-volume19:35:097
293722699110,1cyclictest3319068-21ssh22:06:087
293722699110,1cyclictest3187246-21ssh21:14:557
293722699110,1cyclictest0-21swapper/723:33:237
293722699110,1cyclictest0-21swapper/723:33:237
293722699110,10cyclictest1277-21snmpd20:06:097
293722299117,3cyclictest3138158-21kthreadcore20:50:046
2937222991110,1cyclictest0-21swapper/621:44:336
2937222991110,1cyclictest0-21swapper/621:31:376
2937222991110,1cyclictest0-21swapper/621:22:196
2937222991110,1cyclictest0-21swapper/620:27:186
2937222991110,1cyclictest0-21swapper/600:25:216
2937222991110,1cyclictest0-21swapper/600:19:506
293722299110,4cyclictest3086075-21ntpq20:20:096
293722299110,4cyclictest3034120-21kthreadcore19:55:056
293722299110,11cyclictest0-21swapper/619:30:426
293722299110,10cyclictest2944906-21cut19:10:076
293721399119,1cyclictest0-21swapper/521:59:505
293721399118,2cyclictest0-21swapper/521:05:075
2937213991110,1cyclictest0-21swapper/522:26:195
2937213991110,1cyclictest0-21swapper/520:09:575
2937213991110,1cyclictest0-21swapper/519:51:595
293721399110,11cyclictest0-21swapper/520:19:435
293721399110,11cyclictest0-21swapper/520:00:585
293721399110,11cyclictest0-21swapper/520:00:585
293721399110,11cyclictest0-21swapper/519:34:005
293721399110,0cyclictest0-21swapper/520:21:185
2937210991110,1cyclictest0-21swapper/423:01:364
2937210991110,1cyclictest0-21swapper/422:43:104
2937210991110,1cyclictest0-21swapper/422:29:554
2937210991110,1cyclictest0-21swapper/422:02:104
2937210991110,1cyclictest0-21swapper/419:46:454
2937210991110,1cyclictest0-21swapper/419:27:414
293721099110,4cyclictest0-21swapper/400:38:194
293721099110,11cyclictest0-21swapper/420:31:224
293721099110,11cyclictest0-21swapper/420:28:134
293721099110,11cyclictest0-21swapper/419:22:384
293722699107,2cyclictest1277-21snmpd23:29:117
293722699107,2cyclictest1277-21snmpd21:01:077
293722699107,2cyclictest1277-21snmpd20:09:517
293722699107,2cyclictest0-21swapper/723:45:057
293722699106,3cyclictest1277-21snmpd00:26:157
293722699100,1cyclictest3307354-21ssh22:01:597
293722299109,1cyclictest0-21swapper/623:42:196
293722299109,1cyclictest0-21swapper/623:24:206
293722299109,1cyclictest0-21swapper/619:51:216
293722299108,2cyclictest86-21ksoftirqd/619:20:076
293722299107,2cyclictest3507173-21kthreadcore23:25:046
293722299107,2cyclictest3175140-21/usr/sbin/munin21:09:596
293722299101,3cyclictest3590715-21fschecks_count00:00:006
293722299100,9cyclictest3524028-21kthreadcore23:30:056
293722299100,9cyclictest3524028-21kthreadcore23:30:056
293722299100,9cyclictest0-21swapper/619:25:106
293722299100,8cyclictest3145839-21cpu20:54:576
293722299100,4cyclictest3557140-21cut23:45:056
293722299100,4cyclictest3444352-21fschecks_time22:59:596
293722299100,3cyclictest3280624-21kthreadcore21:50:076
293722299100,3cyclictest3157118-21kthreadcore21:00:046
293722299100,3cyclictest2997089-21tr19:35:076
293721399106,3cyclictest3664131-21cat00:30:015
293721099109,1cyclictest0-21swapper/423:34:244
293721099109,1cyclictest0-21swapper/423:34:244
293721099109,1cyclictest0-21swapper/421:44:504
293721099109,1cyclictest0-21swapper/420:15:174
293721099109,1cyclictest0-21swapper/419:32:434
29372269994,4cyclictest3046819-21grep20:00:077
29372269994,4cyclictest3046819-21grep20:00:077
29372229998,1cyclictest0-21swapper/620:35:116
29372229996,2cyclictest3678338-21kthreadcore00:35:046
29372229996,2cyclictest3364462-21kthreadcore22:25:076
29372229996,2cyclictest0-21swapper/619:45:136
29372229990,8cyclictest3572021-21kthreadcore23:50:056
29372229990,8cyclictest3432602-21irqcore22:55:036
29372229990,8cyclictest3052202-21kthreadcore20:05:056
29372229990,4cyclictest3419218-21/usr/sbin/munin22:50:036
29372229990,3cyclictest3407049-21cpu22:44:596
29372229990,3cyclictest3394978-21expr22:40:006
29372229990,3cyclictest3263300-21cut21:45:056
29372139998,1cyclictest0-21swapper/523:33:575
29372139998,1cyclictest0-21swapper/523:33:575
29372139998,1cyclictest0-21swapper/519:24:425
29372139992,5cyclictest3158516-21grep21:00:055
29372109998,1cyclictest0-21swapper/423:39:364
29372109998,1cyclictest0-21swapper/421:51:184
29372109998,1cyclictest0-21swapper/421:42:004
29372109998,1cyclictest0-21swapper/421:39:094
29372109998,1cyclictest0-21swapper/419:10:304
29372109994,4cyclictest3145795-21/usr/sbin/munin20:55:134
29372109994,4cyclictest2951344-21cstates19:15:004
29372229987,1cyclictest0-21swapper/619:42:226
29372229985,2cyclictest0-21swapper/620:00:026
29372229985,2cyclictest0-21swapper/620:00:026
29372229983,4cyclictest2951172-21cpuspeed_turbos19:15:006
29372139985,2cyclictest0-21swapper/519:10:065
29372139984,3cyclictest3154173-21awk20:55:095
29372139984,1cyclictest681rcuog/421:25:075
29372139984,1cyclictest681rcuog/421:25:075
29372139983,4cyclictest3137553-21grep20:50:045
29372139983,4cyclictest3110464-21cut20:35:035
29372139983,4cyclictest3102006-21cut20:30:065
29372139983,4cyclictest2958374-21kthreadcore19:15:095
29372139980,4cyclictest3240144-21cut21:35:055
29372109986,1cyclictest0-21swapper/421:00:014
29372109984,3cyclictest3565984-21cstates23:49:574
29372109983,4cyclictest3604600-21grep00:05:044
29372109983,4cyclictest3590354-21expr23:59:584
29372109983,4cyclictest3548771-21cut23:40:074
29372109983,4cyclictest3425772-21cut22:50:064
29372109983,4cyclictest3335993-21cut22:15:044
29372109983,4cyclictest3136792-21tune2fs20:50:014
29372109983,4cyclictest3129287-21cut20:45:054
29372109983,4cyclictest3106976-21grep20:34:564
29372109983,4cyclictest3020105-21sed19:50:034
29372109983,4cyclictest2992247-21cat19:35:034
29372109981,6cyclictest3008318-21smartctl19:40:154
29372109980,4cyclictest3656583-21cut00:25:064
29372139973,3cyclictest3675946-21cat00:34:595
29372139973,3cyclictest3566525-21cat23:50:005
29372139973,3cyclictest3395640-21cat22:40:035
29372139972,4cyclictest3434724-21cat22:55:055
29372109975,1cyclictest0-21swapper/421:05:004
29372109975,1cyclictest0-21swapper/400:14:594
29372109974,2cyclictest3116907-21grep20:39:574
29372109973,3cyclictest3079237-21cut20:20:034
29372109972,4cyclictest3639757-21hwlatdetect00:20:004
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional