You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-28 - 23:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Sat Mar 28, 2026 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
249756821420,1sleep60-21swapper/607:13:166
249756821420,1sleep60-21swapper/607:13:166
268840521010,1sleep72688407-21kthreadcore08:53:167
30389422950,0sleep50-21swapper/511:22:545
30274962600,0sleep73027494-21tr11:18:077
246689525948,7sleep50-21swapper/507:02:345
2467216995755,2cyclictest3148694-21kworker/u16:1+events_unbound12:13:284
2467216995653,2cyclictest3051053-21kworker/u16:4+events_unbound11:33:264
246662425646,7sleep60-21swapper/606:58:426
2467222995553,2cyclictest2759281-21kworker/u16:5+events_unbound09:30:506
2467222995452,2cyclictest3084856-21kworker/u16:0+events_unbound12:28:276
246685625442,7sleep40-21swapper/407:02:014
2467216995350,2cyclictest2927871-21kworker/u16:2+events_unbound10:48:294
2467222995250,2cyclictest2890948-21kworker/u16:3+flush-8:011:03:296
2467216995249,2cyclictest2927871-21kworker/u16:2+events_unbound11:28:274
2467216995249,2cyclictest2821846-21kworker/u16:0+flush-8:009:58:204
2467225995043,5cyclictest2509065-21latency_hist07:22:557
2467222995048,2cyclictest3148694-21kworker/u16:1+events_unbound12:13:246
2467222995048,2cyclictest2857670-21kworker/u16:2+flush-8:010:13:256
2467216995047,2cyclictest2927871-21kworker/u16:2+events_unbound11:13:244
2467222994947,2cyclictest2927871-21kworker/u16:2+events_unbound10:38:166
2467222994947,2cyclictest2773134-21kworker/u16:1+flush-8:009:48:206
2467216994947,2cyclictest2821846-21kworker/u16:0+flush-8:010:18:104
2467222994847,1cyclictest2890948-21kworker/u16:3+events_unbound11:23:286
2467216994846,2cyclictest2759281-21kworker/u16:5+events_unbound09:43:214
2467222994644,2cyclictest2890948-21kworker/u16:3+events_unbound10:53:076
2467216994644,2cyclictest2773134-21kworker/u16:1+events_unbound09:33:174
2467216994644,2cyclictest2537748-21kworker/u16:2+events_unbound09:25:534
2467216994644,2cyclictest2537748-21kworker/u16:2+events_unbound09:25:534
2467216994643,2cyclictest1488360-21kworker/u16:1+events_unbound07:03:104
2467225994541,2cyclictest3088481-21iostat11:43:097
2467216994543,2cyclictest2906247-21kworker/u16:0+events_unbound10:33:174
2467216994543,2cyclictest2759281-21kworker/u16:5+events_unbound10:13:094
2467216994542,2cyclictest2773134-21kworker/u16:1+events_unbound09:53:214
2467222994442,2cyclictest3051053-21kworker/u16:4+events_unbound11:33:286
2467222994442,2cyclictest2927871-21kworker/u16:2+events_unbound11:12:326
2467220994441,2cyclictest3051053-21kworker/u16:4+flush-8:011:47:495
2467216994442,2cyclictest3148694-21kworker/u16:1+flush-8:012:18:294
2467216994442,2cyclictest3084856-21kworker/u16:0+events_unbound11:44:174
2467216994442,2cyclictest2927871-21kworker/u16:2+events_unbound11:11:374
2467216994442,2cyclictest2773134-21kworker/u16:1+events_unbound09:48:374
2467222994341,2cyclictest3084856-21kworker/u16:0+events_unbound11:54:296
2467222994341,2cyclictest2966454-21kworker/u16:0+events_unbound11:02:326
2467222994341,2cyclictest2857670-21kworker/u16:2+events_unbound10:21:086
2467222994341,2cyclictest2671899-21kworker/u16:1+events_unbound09:17:336
2467216994341,2cyclictest3084856-21kworker/u16:0+events_unbound11:40:014
2467216994341,2cyclictest2890948-21kworker/u16:3+events_unbound11:55:044
2467216994340,2cyclictest2773134-21kworker/u16:1+events_unbound10:05:284
2467216994340,2cyclictest2661861-21kworker/u16:0+events_unbound09:11:184
2467225994240,1cyclictest3016002-21/usr/sbin/munin11:13:097
2467222994240,2cyclictest3051053-21kworker/u16:4+events_unbound11:40:136
2467222994240,2cyclictest2890948-21kworker/u16:3+flush-8:012:03:236
2467222994240,2cyclictest2890948-21kworker/u16:3+events_unbound12:20:486
2467222994240,2cyclictest2773134-21kworker/u16:1+events_unbound10:29:536
2467222994240,2cyclictest2773134-21kworker/u16:1+events_unbound09:35:496
2467222994240,2cyclictest2759281-21kworker/u16:5+events_unbound10:12:186
2467222994239,2cyclictest3148694-21kworker/u16:1+events_unbound12:08:176
2467222994239,2cyclictest2890948-21kworker/u16:3+events_unbound10:47:566
2467222994139,2cyclictest2927871-21kworker/u16:2+events_unbound11:20:386
2467222994139,2cyclictest2890948-21kworker/u16:3+events_unbound12:24:336
2467222994139,2cyclictest2821846-21kworker/u16:0+events_unbound10:05:326
2467222994139,2cyclictest2537748-21kworker/u16:2+events_unbound09:06:586
2467216994139,2cyclictest2966454-21kworker/u16:0+events_unbound11:03:284
2467216994139,2cyclictest2890948-21kworker/u16:3+events_unbound12:30:404
2467216994138,2cyclictest2773134-21kworker/u16:1+events_unbound10:28:124
2467222994038,2cyclictest2927871-21kworker/u16:2+flush-8:010:43:106
2467222994038,2cyclictest2927871-21kworker/u16:2+events_unbound11:31:176
2467222994038,2cyclictest2927871-21kworker/u16:2+events_unbound11:16:146
2467222994038,2cyclictest2890948-21kworker/u16:3+events_unbound10:26:016
2467222994038,2cyclictest2821846-21kworker/u16:0+events_unbound10:02:496
2467222994038,2cyclictest2759281-21kworker/u16:5+events_unbound09:46:216
2467220994038,2cyclictest2773134-21kworker/u16:1+flush-8:009:47:495
2467216994038,2cyclictest3084856-21kworker/u16:0+events_unbound12:25:574
2467216994038,2cyclictest3084856-21kworker/u16:0+events_unbound11:49:534
2467216994038,2cyclictest2890948-21kworker/u16:3+events_unbound12:03:204
2467216994037,2cyclictest2773134-21kworker/u16:1+events_unbound10:39:014
2467216994037,2cyclictest2759281-21kworker/u16:5+events_unbound09:31:244
2467222993937,2cyclictest3084856-21kworker/u16:0+events_unbound12:01:456
2467222993937,2cyclictest3084856-21kworker/u16:0+events_unbound11:50:056
2467222993937,2cyclictest2906247-21kworker/u16:0+events_unbound10:37:016
2467222993937,2cyclictest2759281-21kworker/u16:5+events_unbound09:56:466
2467222993937,2cyclictest2759281-21kworker/u16:5+events_unbound09:41:336
2467222993937,2cyclictest2759281-21kworker/u16:5+events_unbound09:27:086
2467222993937,2cyclictest2759281-21kworker/u16:5+events_unbound09:27:086
2467222993937,2cyclictest2661861-21kworker/u16:0+events_unbound09:21:186
2467222993937,2cyclictest2661861-21kworker/u16:0+events_unbound09:09:266
2467220993937,2cyclictest2773134-21kworker/u16:1+flush-8:010:28:305
2467216993937,2cyclictest2890948-21kworker/u16:3+events_unbound11:02:414
2467216993937,2cyclictest2773134-21kworker/u16:1+events_unbound10:45:454
2467216993937,2cyclictest2759281-21kworker/u16:5+events_unbound10:10:174
2467216993937,2cyclictest2671899-21kworker/u16:1+events_unbound09:14:534
2467216993937,2cyclictest2509057-21kworker/u16:0+events_unbound07:27:574
2467216993936,2cyclictest3148694-21kworker/u16:1+events_unbound12:10:174
2467216993936,2cyclictest2759239-21kworker/u16:3+events_unbound09:41:494
2467216993936,2cyclictest2661861-21kworker/u16:0+events_unbound09:20:374
24666992396,29sleep70-21swapper/706:59:477
2467220993836,2cyclictest2759239-21kworker/u16:3+events_unbound09:25:105
2467220993836,2cyclictest2759239-21kworker/u16:3+events_unbound09:25:105
2467216993836,2cyclictest2966454-21kworker/u16:0+events_unbound10:54:414
2467216993836,2cyclictest2466970-21kworker/u16:3+flush-8:007:38:164
2467222993735,2cyclictest3084856-21kworker/u16:0+events_unbound11:46:016
2467216993735,2cyclictest3084856-21kworker/u16:0+events_unbound12:02:334
2467216993734,2cyclictest2537748-21kworker/u16:2+events_unbound09:06:294
2467225993630,5cyclictest650-21systemd-journal09:52:557
2467225993630,5cyclictest3002734-21latency_hist11:07:557
2467220993634,2cyclictest3148694-21kworker/u16:1+flush-8:012:08:265
2467220993634,2cyclictest2890948-21kworker/u16:3+flush-8:010:57:495
2467222993533,2cyclictest2671899-21kworker/u16:1+events_unbound09:01:536
2467220993533,2cyclictest2773134-21kworker/u16:1+flush-8:010:27:555
2467216993533,2cyclictest2927871-21kworker/u16:2+flush-8:011:18:364
2467216993533,2cyclictest2927871-21kworker/u16:2+events_unbound11:26:224
2467225993433,0cyclictest0-21swapper/709:45:537
2467222993432,2cyclictest2466970-21kworker/u16:3+events_unbound07:40:106
2467216993432,2cyclictest2857670-21kworker/u16:2+events_unbound10:26:484
2467222993331,2cyclictest2566309-21kworker/u16:1+events_unbound07:57:226
2467220993331,2cyclictest2759281-21kworker/u16:5+flush-8:009:54:325
246722599320,30cyclictest2748517-21ssh09:22:487
2467222993230,2cyclictest2622662-21kworker/u16:0+events_unbound08:27:576
2467222993230,2cyclictest1488360-21kworker/u16:1+events_unbound07:29:256
2467220993230,2cyclictest2773134-21kworker/u16:1+flush-8:010:33:315
29181292310,1chrt5436-21crond10:32:547
2467220993128,2cyclictest2890948-21kworker/u16:3+flush-8:011:13:005
246722599300,29cyclictest2951356-21ntpq10:43:247
2467222993028,2cyclictest2622662-21kworker/u16:0+events_unbound08:21:346
2467222993028,2cyclictest2566309-21kworker/u16:1+events_unbound08:11:226
2467222992927,2cyclictest2661861-21kworker/u16:0+flush-8:008:43:376
2467225992828,0cyclictest0-21swapper/709:06:547
2467225992827,0cyclictest0-21swapper/712:07:567
2467220992826,2cyclictest2537748-21kworker/u16:2+flush-8:009:08:115
2467216992826,2cyclictest2622662-21kworker/u16:0+events_unbound08:32:054
2467216992826,2cyclictest2566309-21kworker/u16:1+flush-8:008:13:214
2467222992725,2cyclictest2585527-21kworker/u16:3+events_unbound08:16:056
2467222992725,2cyclictest2537748-21kworker/u16:2+flush-8:008:33:296
2467222992725,2cyclictest1488360-21kworker/u16:1+flush-8:007:03:166
2467216992725,2cyclictest2537748-21kworker/u16:2+events_unbound08:07:374
2467225992625,0cyclictest0-21swapper/708:03:247
246722599260,25cyclictest3109324-21ssh11:49:147
2467222992624,2cyclictest2466970-21kworker/u16:3+events_unbound07:52:016
2467220992624,2cyclictest3051053-21kworker/u16:4+flush-8:012:03:165
2467220992624,2cyclictest1488360-21kworker/u16:1+events_unbound07:23:195
2467216992624,2cyclictest2661861-21kworker/u16:0+events_unbound08:44:414
2467222992523,2cyclictest2566309-21kworker/u16:1+events_unbound08:04:086
2467220992523,2cyclictest3084856-21kworker/u16:0+flush-8:012:28:305
2467220992523,2cyclictest3051053-21kworker/u16:4+flush-8:011:48:235
2467216992523,2cyclictest2633551-21kworker/u16:4+events_unbound08:41:064
2467225992424,0cyclictest0-21swapper/710:06:177
2467225992421,2cyclictest2736088-21ssh09:17:137
2467220992422,2cyclictest2773134-21kworker/u16:1+flush-8:009:48:095
2467225992323,0cyclictest0-21swapper/711:11:297
2467225992321,1cyclictest0-21swapper/712:23:047
246722599230,21cyclictest2633168-21sh08:27:557
2467222992321,2cyclictest2466970-21kworker/u16:3+events_unbound07:17:576
2467222992321,2cyclictest1488360-21kworker/u16:1+events_unbound07:09:076
2467222992320,2cyclictest2661861-21kworker/u16:0+events_unbound08:52:566
2467220992321,2cyclictest2927871-21kworker/u16:2+flush-8:010:48:305
2467216992321,2cyclictest2566309-21kworker/u16:1+events_unbound07:59:134
2467216992321,2cyclictest2537748-21kworker/u16:2+flush-8:008:53:554
2467216992321,2cyclictest2537748-21kworker/u16:2+flush-8:007:48:054
2467225992221,0cyclictest0-21swapper/709:29:017
2467222992220,2cyclictest2661861-21kworker/u16:0+events_unbound08:50:176
2467222992220,2cyclictest2661861-21kworker/u16:0+events_unbound08:50:176
2467220992220,2cyclictest2890948-21kworker/u16:3+flush-8:011:03:235
2467220992220,2cyclictest2537748-21kworker/u16:2+events_unbound09:03:075
2467216992220,2cyclictest2537748-21kworker/u16:2+events_unbound08:52:134
2467216992220,2cyclictest2537748-21kworker/u16:2+events_unbound08:52:134
29840262210,0chrt0-21swapper/510:58:175
246722599210,20cyclictest2893639-21sh10:22:187
246722599210,19cyclictest2575839-21latency_hist07:57:557
2467222992119,2cyclictest1488360-21kworker/u16:1+events_unbound07:27:066
2467220992118,2cyclictest2537748-21kworker/u16:2+events_unbound08:48:125
2467220992118,2cyclictest2537748-21kworker/u16:2+events_unbound08:48:125
2467216992119,2cyclictest2509057-21kworker/u16:0+events_unbound07:36:254
2467225992017,2cyclictest2759210-21ssh09:25:027
2467225992017,2cyclictest2759210-21ssh09:25:027
246722599200,19cyclictest3112269-21cat11:53:057
246722599200,19cyclictest2870473-21cpuspeed_turbos10:13:097
2467220992018,2cyclictest2661861-21kworker/u16:0+events_unbound08:58:185
2467216992018,2cyclictest2566309-21kworker/u16:1+events_unbound07:53:214
2467216992018,2cyclictest2466970-21kworker/u16:3+flush-8:007:14:554
2467216992018,2cyclictest2466970-21kworker/u16:3+flush-8:007:14:554
2467216992017,2cyclictest2537748-21kworker/u16:2+events_unbound08:33:054
2467225991919,0cyclictest0-21swapper/710:01:027
2467225991918,0cyclictest0-21swapper/708:13:547
2467225991914,4cyclictest2942288-21latency_hist10:42:547
2467222991917,2cyclictest2566309-21kworker/u16:1+events_unbound08:01:146
2467216991917,2cyclictest2466970-21kworker/u16:3+events_unbound07:20:184
2467225991818,0cyclictest0-21swapper/710:58:407
246722599180,17cyclictest2820039-21ssh09:50:217
2467222991816,2cyclictest2622662-21kworker/u16:0+events_unbound08:23:076
2467222991816,2cyclictest2585527-21kworker/u16:3+events_unbound08:38:456
2467220991816,2cyclictest2857670-21kworker/u16:2+flush-8:010:08:295
2467216991816,2cyclictest2466970-21kworker/u16:3+events_unbound07:44:304
246722599177,9cyclictest0-21swapper/707:08:127
2467225991717,0cyclictest0-21swapper/711:34:017
246722599170,1cyclictest0-21swapper/707:58:187
246722599170,16cyclictest2556738-21latency_hist07:47:547
246722599170,15cyclictest2476643-21latency_hist07:07:557
2467220991715,2cyclictest2509057-21kworker/u16:0+events_unbound07:28:095
2467216991715,2cyclictest2585527-21kworker/u16:3+events_unbound08:24:494
2467216991715,2cyclictest2537748-21kworker/u16:2+events_unbound08:07:574
246722599167,7cyclictest0-21swapper/709:08:147
2467225991616,0cyclictest0-21swapper/712:21:547
2467225991616,0cyclictest0-21swapper/710:56:447
2467225991615,0cyclictest0-21swapper/708:48:197
2467225991615,0cyclictest0-21swapper/708:48:197
2467225991615,0cyclictest0-21swapper/707:28:207
2467225991614,1cyclictest2868753-21ssh10:11:027
2467225991613,2cyclictest2904416-21ssh10:24:497
2467222991614,2cyclictest2466970-21kworker/u16:3+events_unbound07:37:226
2467220991614,2cyclictest3084856-21kworker/u16:0+flush-8:011:54:255
2467220991614,2cyclictest2927871-21kworker/u16:2+events_unbound11:23:095
2467220991614,2cyclictest2759281-21kworker/u16:5+flush-8:009:37:555
2467220991614,2cyclictest2633551-21kworker/u16:4+flush-8:008:32:505
2467220991613,2cyclictest2466970-21kworker/u16:3+flush-8:007:43:135
2467216991614,2cyclictest2509057-21kworker/u16:0+events_unbound07:23:274
2467216991614,2cyclictest2466970-21kworker/u16:3+events_unbound07:08:094
246721699160,16cyclictest0-21swapper/408:21:034
2467225991515,0cyclictest0-21swapper/710:48:107
2467220991513,2cyclictest2585527-21kworker/u16:3+events_unbound08:18:145
2467220991513,2cyclictest2466970-21kworker/u16:3+events_unbound07:33:065
2467216991513,2cyclictest2671899-21kworker/u16:1+flush-8:009:02:544
246722599149,4cyclictest3124704-21cat11:58:107
246722599146,7cyclictest0-21swapper/711:22:557
2467225991414,0cyclictest0-21swapper/712:06:287
2467225991414,0cyclictest0-21swapper/709:42:447
2467225991410,3cyclictest3084089-21ntpq11:38:257
2467225991410,3cyclictest2927093-21ntpq10:33:237
246722599140,13cyclictest3052377-21sed11:28:117
246722599140,12cyclictest0-21swapper/708:58:217
2467222991412,2cyclictest2466970-21kworker/u16:3+events_unbound07:45:306
2467220991413,1cyclictest0-21swapper/510:21:125
2467220991411,2cyclictest1488360-21kworker/u16:1+flush-8:007:13:125
2467220991411,2cyclictest1488360-21kworker/u16:1+flush-8:007:13:125
246722099140,1cyclictest0-21swapper/510:04:295
246722599137,5cyclictest2623641-21systemd-run08:22:557
246722599136,6cyclictest0-21swapper/712:28:127
246722599136,6cyclictest0-21swapper/712:13:077
246722599134,8cyclictest2777002-21kthreadcore09:33:157
2467225991312,0cyclictest0-21swapper/708:08:187
246722599130,5cyclictest1060-21runrttasks08:43:217
2467220991312,1cyclictest0-21swapper/512:20:045
2467220991312,1cyclictest0-21swapper/512:17:425
2467220991312,1cyclictest0-21swapper/511:31:405
2467220991312,1cyclictest0-21swapper/510:00:335
2467220991312,1cyclictest0-21swapper/507:03:115
2467220991311,2cyclictest2585527-21kworker/u16:3+flush-8:008:23:255
246722099130,13cyclictest0-21swapper/511:38:175
246722099130,0cyclictest0-21swapper/511:11:485
246722599128,3cyclictest1267-21snmpd08:42:317
246722599122,8cyclictest924-21NetworkManager07:48:137
246722599120,2cyclictest0-21swapper/708:28:197
246722099129,3cyclictest2773134-21kworker/u16:1+flush-8:010:38:115
246722099128,3cyclictest2537748-21kworker/u16:2+flush-8:009:31:385
2467220991211,1cyclictest0-21swapper/507:58:225
2467220991211,1cyclictest0-21swapper/507:55:225
2467220991211,1cyclictest0-21swapper/507:52:225
2467220991210,2cyclictest2585527-21kworker/u16:3+events_unbound08:13:095
2467220991210,2cyclictest2585527-21kworker/u16:3+events_unbound08:08:085
246722599118,2cyclictest1267-21snmpd07:36:357
246722599118,2cyclictest1267-21snmpd07:16:267
246722599118,2cyclictest1267-21snmpd07:16:267
246722599111,9cyclictest0-21swapper/708:33:197
246722599110,9cyclictest2518930-21cat07:27:557
246722599110,10cyclictest2546227-21ntpq07:38:157
246722099119,2cyclictest2633551-21kworker/u16:4+events_unbound08:33:195
246722099119,2cyclictest2537748-21kworker/u16:2+flush-8:009:18:265
2467220991110,1cyclictest0-21swapper/510:14:445
246722099110,11cyclictest0-21swapper/507:40:145
246722099109,1cyclictest0-21swapper/508:07:305
246722099107,2cyclictest2482016-21kthreadcore07:08:115
24672209998,1cyclictest0-21swapper/512:24:485
24672209998,1cyclictest0-21swapper/509:42:445
24672209997,2cyclictest2661861-21kworker/u16:0+events_unbound08:53:095
24672209995,3cyclictest3051053-21kworker/u16:4+flush-8:011:33:105
24672209987,1cyclictest0-21swapper/510:45:005
24672209986,2cyclictest2633551-21kworker/u16:4+flush-8:008:38:115
24672209984,3cyclictest2726718-21kthreadcore09:13:125
24672209983,4cyclictest2664159-21cut08:43:125
24672209976,1cyclictest0-21swapper/512:01:185
24672209973,3cyclictest2500370-21cat07:18:085
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional