You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-28 - 22:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Sun Dec 28, 2025 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
295130624635,8sleep50-21swapper/507:04:505
2951898994539,5cyclictest3013785-21latency_hist07:38:567
2951893994139,2cyclictest3324361-21kworker/u16:0+events_unbound11:03:555
29513572418,29sleep70-21swapper/707:05:327
2951893994038,2cyclictest3488648-21kworker/u16:1+events_unbound12:29:115
2951897993836,2cyclictest3343583-21kworker/u16:4+events_unbound10:29:106
2951897993836,2cyclictest3343583-21kworker/u16:4+events_unbound10:29:106
2951893993735,2cyclictest2965665-21kworker/u16:4+flush-8:007:23:565
295153323727,7sleep60-21swapper/607:08:046
2951893993533,2cyclictest3168949-21kworker/u16:0+events_unbound09:08:555
35512742340,1chrt0-21swapper/512:14:175
2951898993332,0cyclictest0-21swapper/707:19:247
2951893993331,2cyclictest3324361-21kworker/u16:0+events_unbound11:58:505
2951898993130,0cyclictest0-21swapper/708:49:107
2951898993125,5cyclictest3188529-21latency_hist09:08:567
2951897993129,2cyclictest3023644-21kworker/u16:4+flush-8:007:49:196
2951898992822,5cyclictest650-21systemd-journal08:58:507
2951898992822,5cyclictest650-21systemd-journal08:58:507
2951893992826,2cyclictest3352163-21kworker/u16:5+flush-8:011:18:555
2951891992825,2cyclictest3168998-21kworker/u16:4+flush-8:008:59:264
2951891992724,2cyclictest2685250-21kworker/u16:1+flush-8:008:19:134
295138122717,7sleep40-21swapper/407:05:544
2951898992623,2cyclictest0-21swapper/710:49:107
2951897992624,2cyclictest3324361-21kworker/u16:0+flush-8:010:54:106
2951897992623,2cyclictest3419998-21kworker/u16:2+events_unbound11:09:086
2951893992624,2cyclictest3208309-21kworker/u16:1+flush-8:009:33:505
2951893992623,2cyclictest3285472-21kworker/u16:2+flush-8:010:03:565
2951898992520,4cyclictest3178799-21latency_hist09:03:567
2951897992523,2cyclictest3419998-21kworker/u16:2+flush-8:011:19:226
2951897992523,2cyclictest3352163-21kworker/u16:5+events_unbound10:49:206
2951893992523,2cyclictest3285472-21kworker/u16:2+flush-8:010:18:555
2951893992523,2cyclictest3061271-21kworker/u16:0+flush-8:008:44:185
2951891992522,2cyclictest3488648-21kworker/u16:1+events_unbound11:54:094
2951898992418,5cyclictest3082734-21cut08:14:117
2951897992422,2cyclictest2932349-21kworker/u16:3+events_unbound08:53:506
2951897992421,2cyclictest2932349-21kworker/u16:3+events_unbound08:58:576
2951893992422,2cyclictest3498283-21kworker/u16:3+events_unbound12:19:105
2951891992422,2cyclictest3352163-21kworker/u16:5+flush-8:010:48:554
2951891992422,2cyclictest3265830-21kworker/u16:1+events_unbound09:49:084
2951898992322,0cyclictest0-21swapper/711:34:097
2951898992317,5cyclictest3372502-21latency_hist10:43:567
2951897992321,2cyclictest3061271-21kworker/u16:0+events_unbound08:14:216
2951897992321,2cyclictest2685249-21kworker/u16:0+flush-8:007:13:506
2951893992321,2cyclictest3324361-21kworker/u16:0+events_unbound10:54:175
2951893992321,2cyclictest3012815-21kworker/u16:2+events_unbound07:34:275
2951891992321,2cyclictest3061271-21kworker/u16:0+flush-8:008:14:264
2951898992221,0cyclictest0-21swapper/708:44:227
295189899220,21cyclictest650-21systemd-journal10:38:557
2951897992220,2cyclictest3324361-21kworker/u16:0+events_unbound10:59:126
2951893992220,2cyclictest3411626-21kworker/u16:1+events_unbound11:04:195
2951893992220,2cyclictest3265830-21kworker/u16:1+flush-8:010:24:225
2951893992220,2cyclictest2685250-21kworker/u16:1+events_unbound08:39:205
2951893992219,2cyclictest3265830-21kworker/u16:1+events_unbound09:48:585
2951893992219,2cyclictest2932349-21kworker/u16:3+flush-8:008:54:125
2951893992219,2cyclictest2932349-21kworker/u16:3+flush-8:008:54:125
2951891992220,2cyclictest3324361-21kworker/u16:0+events_unbound10:59:144
2951891992220,2cyclictest3168998-21kworker/u16:4+events_unbound09:04:194
2951891992219,2cyclictest3217975-21kworker/u16:3+flush-8:010:04:144
2951897992119,2cyclictest3208309-21kworker/u16:1+events_unbound09:24:196
2951893992119,2cyclictest3023644-21kworker/u16:4+events_unbound07:49:205
2951891992119,2cyclictest3265830-21kworker/u16:1+flush-8:010:09:144
2951898992014,5cyclictest3565950-21latency_hist12:23:557
2951897992018,2cyclictest3419998-21kworker/u16:2+events_unbound11:24:096
2951897992018,2cyclictest3411626-21kworker/u16:1+events_unbound11:04:216
2951897992018,2cyclictest3023644-21kworker/u16:4+events_unbound07:44:116
2951897992018,2cyclictest2685250-21kworker/u16:1+events_unbound08:09:246
2951893992018,2cyclictest3023644-21kworker/u16:4+events_unbound07:59:225
2951891992017,2cyclictest3324361-21kworker/u16:0+flush-8:011:39:244
2951891992017,2cyclictest2965665-21kworker/u16:4+events_unbound07:19:284
2951898991918,0cyclictest0-21swapper/709:44:227
2951898991917,1cyclictest0-21swapper/708:04:217
2951897991917,2cyclictest3168949-21kworker/u16:0+events_unbound09:14:136
2951897991916,2cyclictest3168949-21kworker/u16:0+flush-8:009:44:056
295189799190,19cyclictest3168933-21fwupd08:58:506
295189799190,19cyclictest3168933-21fwupd08:58:506
2951893991917,2cyclictest2685250-21kworker/u16:1+events_unbound08:24:275
2951891991917,2cyclictest3324361-21kworker/u16:0+flush-8:011:28:504
2951891991917,2cyclictest2685250-21kworker/u16:1+flush-8:007:39:144
32156402180,0sleep40-21swapper/409:19:174
2951898991817,0cyclictest0-21swapper/711:39:207
2951898991816,1cyclictest0-21swapper/709:59:227
2951898991815,2cyclictest3285335-21awk09:58:557
2951898991813,4cyclictest650-21systemd-journal11:33:507
2951897991816,2cyclictest3419998-21kworker/u16:2+events_unbound11:29:106
2951897991816,2cyclictest2932349-21kworker/u16:3+flush-8:008:33:566
2951897991816,2cyclictest2685250-21kworker/u16:1+flush-8:008:39:196
2951897991816,2cyclictest2685249-21kworker/u16:0+flush-8:007:34:126
2951897991816,2cyclictest2685249-21kworker/u16:0+events_unbound07:24:106
2951897991815,2cyclictest3168949-21kworker/u16:0+events_unbound09:54:036
2951893991816,2cyclictest3208309-21kworker/u16:1+flush-8:009:19:115
2951893991815,2cyclictest3419998-21kworker/u16:2+flush-8:011:19:155
2951891991816,2cyclictest3168949-21kworker/u16:0+flush-8:009:54:254
2951898991716,0cyclictest0-21swapper/711:44:187
2951898991716,0cyclictest0-21swapper/710:54:217
2951898991716,0cyclictest0-21swapper/709:43:507
2951898991711,5cyclictest3343385-21latency_hist10:28:557
2951898991711,5cyclictest3062256-21latency_hist08:03:567
2951897991715,2cyclictest3488648-21kworker/u16:1+flush-8:012:29:056
2951897991715,2cyclictest3023644-21kworker/u16:4+flush-8:008:00:066
2951897991715,2cyclictest2685250-21kworker/u16:1+events_unbound09:09:206
2951893991715,2cyclictest3488648-21kworker/u16:1+events_unbound12:07:145
2951893991715,2cyclictest3488648-21kworker/u16:1+events_unbound12:07:145
2951893991715,2cyclictest3488648-21kworker/u16:1+events_unbound11:59:195
2951893991715,2cyclictest3324361-21kworker/u16:0+events_unbound10:19:145
295189399170,1cyclictest0-21swapper/508:09:195
2951891991715,2cyclictest3419998-21kworker/u16:2+flush-8:011:29:264
2951891991715,2cyclictest3419998-21kworker/u16:2+events_unbound11:19:104
2951891991715,2cyclictest3285472-21kworker/u16:2+flush-8:010:19:124
2951898991615,0cyclictest0-21swapper/711:24:197
2951898991613,2cyclictest0-21swapper/709:33:557
2951898991610,5cyclictest3517621-21latency_hist11:58:557
2951897991614,2cyclictest3488648-21kworker/u16:1+events_unbound11:44:096
2951897991614,2cyclictest3324361-21kworker/u16:0+events_unbound10:24:036
2951897991614,2cyclictest2965665-21kworker/u16:4+events_unbound07:19:346
2951897991614,2cyclictest2685249-21kworker/u16:0+events_unbound07:14:216
2951893991614,2cyclictest3168949-21kworker/u16:0+flush-8:009:14:125
2951891991614,2cyclictest3168949-21kworker/u16:0+events_unbound09:14:154
2951891991614,2cyclictest2685250-21kworker/u16:1+flush-8:008:04:114
295189899159,5cyclictest3081670-21latency_hist08:13:567
295189899158,6cyclictest6045-21gmain09:29:137
2951898991514,0cyclictest0-21swapper/711:04:177
2951898991514,0cyclictest0-21swapper/708:29:187
295189899150,14cyclictest3536967-21turbostat12:08:557
295189899150,14cyclictest3536967-21turbostat12:08:557
295189899150,13cyclictest3324032-21turbostat10:18:557
295189899150,13cyclictest3314367-21turbostat10:13:557
2951897991513,2cyclictest3498283-21kworker/u16:3+events_unbound11:49:216
2951897991513,2cyclictest3488648-21kworker/u16:1+flush-8:012:34:256
2951897991513,2cyclictest3419998-21kworker/u16:2+flush-8:011:34:236
2951897991513,2cyclictest3324361-21kworker/u16:0+flush-8:011:39:116
2951897991513,2cyclictest3285472-21kworker/u16:2+flush-8:010:14:066
2951897991513,2cyclictest3285472-21kworker/u16:2+events_unbound10:11:156
2951897991513,2cyclictest2685250-21kworker/u16:1+flush-8:007:39:176
2951893991513,2cyclictest2685249-21kworker/u16:0+flush-8:007:24:125
2951893991512,2cyclictest2685250-21kworker/u16:1+events_unbound08:49:125
2951891991513,2cyclictest3324361-21kworker/u16:0+events_unbound12:14:144
2951891991513,2cyclictest2685250-21kworker/u16:1+flush-8:007:54:164
2951898991413,0cyclictest0-21swapper/707:29:247
2951898991412,1cyclictest0-21swapper/710:04:197
2951898991410,3cyclictest1267-21snmpd10:30:307
2951898991410,3cyclictest1267-21snmpd10:30:307
295189899140,13cyclictest3052551-21turbostat07:58:557
2951897991413,1cyclictest0-21swapper/611:13:566
2951897991412,2cyclictest3324361-21kworker/u16:0+events_unbound10:35:116
295189799140,1cyclictest0-21swapper/612:04:136
295189799140,1cyclictest0-21swapper/612:04:136
2951893991412,2cyclictest3352163-21kworker/u16:5+flush-8:010:39:155
2951893991412,2cyclictest3208309-21kworker/u16:1+events_unbound09:38:065
2951893991412,2cyclictest3168949-21kworker/u16:0+events_unbound09:39:105
2951891991412,2cyclictest2685249-21kworker/u16:0+flush-8:007:14:014
2951891991411,2cyclictest3168949-21kworker/u16:0+events_unbound09:39:084
295189899139,3cyclictest1267-21snmpd12:33:337
295189899139,3cyclictest1267-21snmpd12:01:117
295189899139,3cyclictest1267-21snmpd09:12:577
295189899139,3cyclictest1267-21snmpd08:37:417
295189899139,3cyclictest1267-21snmpd08:19:297
295189899136,6cyclictest0-21swapper/712:34:137
2951898991312,0cyclictest0-21swapper/710:44:117
2951898991311,1cyclictest3546737-21latency_hist12:13:557
2951898991310,2cyclictest3555372-21ntp_states12:14:247
2951897991312,1cyclictest0-21swapper/608:04:266
2951897991311,2cyclictest3498283-21kworker/u16:3+flush-8:012:09:246
2951897991311,2cyclictest3498283-21kworker/u16:3+flush-8:011:59:106
2951897991311,2cyclictest3343583-21kworker/u16:4+events_unbound10:39:246
2951897991311,2cyclictest3168949-21kworker/u16:0+events_unbound09:19:226
2951897991311,2cyclictest3061271-21kworker/u16:0+events_unbound08:44:176
2951897991311,2cyclictest2685250-21kworker/u16:1+events_unbound08:19:206
295189399138,4cyclictest3014951-21cat07:39:105
2951893991312,1cyclictest0-21swapper/508:29:325
2951893991312,1cyclictest0-21swapper/508:18:585
2951893991311,2cyclictest3343583-21kworker/u16:4+events_unbound10:29:125
2951893991311,2cyclictest3343583-21kworker/u16:4+events_unbound10:29:125
2951893991311,2cyclictest3150003-21kworker/u16:2+events_unbound08:59:045
2951891991312,1cyclictest0-21swapper/411:44:164
2951891991310,2cyclictest3198531-21kworker/u16:2+flush-8:009:24:064
295189899129,2cyclictest0-21swapper/710:59:247
295189899128,3cyclictest1267-21snmpd09:20:077
295189899128,3cyclictest1267-21snmpd09:14:257
295189899128,3cyclictest1267-21snmpd08:39:217
295189899128,3cyclictest1267-21snmpd07:40:107
295189899126,5cyclictest6184-21gvfs-afc-volume10:19:137
295189899126,5cyclictest6184-21gvfs-afc-volume07:49:137
295189899125,5cyclictest3437706-21grep11:14:167
295189899122,2cyclictest3430203-21sed11:09:257
295189899121,2cyclictest0-21swapper/707:14:127
2951898991211,0cyclictest0-21swapper/709:24:247
295189899120,11cyclictest96-21ksoftirqd/711:19:147
295189899120,10cyclictest1267-21snmpd09:49:267
295189799125,1cyclictest0-21swapper/608:24:106
2951897991211,1cyclictest0-21swapper/611:53:586
2951897991211,1cyclictest0-21swapper/610:44:176
2951897991211,1cyclictest0-21swapper/607:29:546
2951897991210,2cyclictest3546793-21kworker/u16:2+events_unbound12:23:536
2951897991210,2cyclictest3488648-21kworker/u16:1+events_unbound12:24:286
2951897991210,2cyclictest3324361-21kworker/u16:0+events_unbound12:14:466
2951897991210,2cyclictest3285472-21kworker/u16:2+events_unbound10:22:416
2951897991210,2cyclictest3168998-21kworker/u16:4+events_unbound09:06:056
2951897991210,2cyclictest3168949-21kworker/u16:0+events_unbound09:29:126
295189799120,1cyclictest0-21swapper/609:43:176
295189399129,2cyclictest2995639-21irqcore07:29:125
2951893991211,1cyclictest0-21swapper/512:37:595
2951893991211,1cyclictest0-21swapper/511:42:585
2951893991211,1cyclictest0-21swapper/510:37:135
2951893991211,1cyclictest0-21swapper/507:08:585
2951893991210,2cyclictest3285472-21kworker/u16:2+flush-8:010:09:255
2951893991210,2cyclictest3217975-21kworker/u16:3+flush-8:009:58:515
2951893991210,2cyclictest3217975-21kworker/u16:3+events_unbound10:04:175
2951893991210,2cyclictest3061271-21kworker/u16:0+flush-8:008:38:565
2951893991210,2cyclictest2685250-21kworker/u16:1+flush-8:007:54:125
295189399120,1cyclictest0-21swapper/511:46:175
295189199128,3cyclictest2952876-21cat07:09:114
295189199127,4cyclictest3238104-21cat09:34:124
2951891991211,1cyclictest0-21swapper/411:14:094
2951891991211,1cyclictest0-21swapper/408:49:164
2951891991211,1cyclictest0-21swapper/407:34:234
2951891991210,2cyclictest3419998-21kworker/u16:2+events_unbound11:09:104
626589110,1rtkit-daemon0-21swapper/410:31:474
626589110,1rtkit-daemon0-21swapper/410:31:474
295189899118,2cyclictest0-21swapper/712:24:117
295189899111,9cyclictest2952099-21/usr/sbin/munin07:09:267
2951898991110,0cyclictest0-21swapper/711:49:027
2951898991110,0cyclictest0-21swapper/708:24:127
295189799119,2cyclictest3217975-21kworker/u16:3+events_unbound10:07:156
295189799119,2cyclictest2685250-21kworker/u16:1+events_unbound07:55:086
2951897991110,1cyclictest0-21swapper/608:35:486
295189799110,0cyclictest0-21swapper/610:02:406
295189399119,2cyclictest3419998-21kworker/u16:2+events_unbound11:52:065
295189399119,2cyclictest2932349-21kworker/u16:3+events_unbound08:04:235
2951893991110,1cyclictest0-21swapper/512:27:255
2951893991110,1cyclictest0-21swapper/512:09:555
2951893991110,1cyclictest0-21swapper/511:36:115
2951893991110,1cyclictest0-21swapper/511:29:245
2951893991110,1cyclictest0-21swapper/510:50:005
2951893991110,1cyclictest0-21swapper/510:46:505
2951893991110,1cyclictest0-21swapper/507:18:445
295189199119,2cyclictest3285472-21kworker/u16:2+flush-8:010:24:144
295189199118,2cyclictest3352163-21kworker/u16:5+events_unbound10:34:134
2951891991110,1cyclictest0-21swapper/412:04:364
2951891991110,1cyclictest0-21swapper/412:04:364
2951891991110,1cyclictest0-21swapper/411:34:104
2951891991110,1cyclictest0-21swapper/410:54:174
2951891991110,1cyclictest0-21swapper/408:29:524
295189199110,1cyclictest0-21swapper/408:55:534
295189199110,1cyclictest0-21swapper/408:55:534
295189199110,11cyclictest0-21swapper/412:36:084
295189199110,11cyclictest0-21swapper/411:07:414
295189199110,11cyclictest0-21swapper/409:59:354
295189199110,11cyclictest0-21swapper/407:50:374
295189199110,11cyclictest0-21swapper/407:30:264
295189899109,0cyclictest0-21swapper/707:24:127
295189899100,8cyclictest0-21swapper/707:44:097
295189799109,1cyclictest0-21swapper/609:49:356
295189399109,1cyclictest0-21swapper/508:15:205
295189199109,1cyclictest0-21swapper/412:01:084
295189199109,1cyclictest0-21swapper/408:39:294
295189199100,0cyclictest0-21swapper/412:32:394
29518979997,1cyclictest3238544-21kthreadcore09:34:166
29518939998,1cyclictest0-21swapper/511:26:065
29518939998,1cyclictest0-21swapper/509:26:455
29518939996,2cyclictest3026023-21kthreadcore07:44:145
29518939995,3cyclictest3189708-21cat09:09:105
29518919998,1cyclictest0-21swapper/412:25:344
29518919998,1cyclictest0-21swapper/409:30:344
29518919998,1cyclictest0-21swapper/408:36:204
29518919997,2cyclictest3352163-21kworker/u16:5+events_unbound10:49:184
29518919997,1cyclictest3321346-21kthreadcore10:14:164
29518919994,4cyclictest3080699-21ntpq08:09:184
29518919994,4cyclictest3032362-21grep07:44:224
29518919990,8cyclictest2989334-21kthreadcore07:24:154
29518939986,2cyclictest3168949-21kworker/u16:0+events_unbound09:44:155
29518939983,4cyclictest3421678-21expr11:09:095
29518919984,3cyclictest3264983-21ntp_kernel_pll_09:44:184
29518919984,3cyclictest3058609-21kthreadcore07:59:184
29518919983,4cyclictest3363561-21ls10:39:084
29518919983,4cyclictest3192875-21cut09:09:144
29518919976,1cyclictest0-21swapper/412:22:064
29518919975,1cyclictest0-21swapper/408:44:134
29518919973,3cyclictest3101880-21cat08:24:084
29518919972,4cyclictest3499179-21cut11:49:084
29518919962,4cyclictest0-21swapper/412:09:434
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional