You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-12 - 19:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Thu Mar 12, 2026 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32969352660,1sleep73296937-21ssh11:53:397
2655427995554,0cyclictest0-21swapper/712:04:247
2655410995146,2cyclictest3062258-21kworker/u16:3+events_unbound10:21:564
265509125141,7sleep50-21swapper/507:03:295
2655427995045,4cyclictest3345109-21latency_hist12:13:577
265508324939,7sleep60-21swapper/607:03:226
2655410994542,2cyclictest3117214-21kworker/u16:2+events_unbound11:31:274
2655427994443,0cyclictest0-21swapper/709:11:047
2655427994438,4cyclictest3152843-21latency_hist10:53:587
2655410994341,2cyclictest2984699-21kworker/u16:1+events_unbound10:06:164
2655427994241,0cyclictest0-21swapper/710:01:357
2655410994240,2cyclictest3142267-21kworker/u16:6+events_unbound11:40:284
2655410994240,2cyclictest2602101-21kworker/u16:0+events_unbound10:32:434
2655427994140,0cyclictest0-21swapper/710:37:527
2655410994139,2cyclictest3298844-21kworker/u16:0+events_unbound12:00:404
2655410994139,2cyclictest3262690-21kworker/u16:0+events_unbound11:46:084
2655410994139,2cyclictest3142267-21kworker/u16:6+events_unbound11:24:484
2655410994139,2cyclictest2879239-21kworker/u16:2+events_unbound10:11:484
264602324131,7sleep40-21swapper/406:59:034
2655427994039,0cyclictest0-21swapper/709:15:537
2655410994038,2cyclictest3298844-21kworker/u16:0+events_unbound12:30:084
2655410994038,2cyclictest3298844-21kworker/u16:0+events_unbound12:15:354
2655410994038,2cyclictest3298844-21kworker/u16:0+events_unbound11:56:284
2655410994038,2cyclictest3285089-21kworker/u16:2+events_unbound12:25:274
2655410994038,2cyclictest3142267-21kworker/u16:6+events_unbound11:15:314
2655410994038,2cyclictest3128873-21kworker/u16:5+events_unbound12:10:284
2655410994038,2cyclictest2984699-21kworker/u16:1+events_unbound10:36:574
2655410994038,2cyclictest2984699-21kworker/u16:1+events_unbound10:27:154
2655410994038,2cyclictest2984699-21kworker/u16:1+events_unbound10:02:514
2655410994038,2cyclictest2984699-21kworker/u16:1+events_unbound09:58:394
2655410994038,2cyclictest2679986-21kworker/u16:3+flush-8:007:23:584
2655410994038,2cyclictest2602101-21kworker/u16:0+events_unbound09:08:044
26548572406,30sleep70-21swapper/707:00:107
265542799390,38cyclictest3357139-21latency_hist12:18:587
2655414993936,2cyclictest2602101-21kworker/u16:0+events_unbound09:59:125
2655410993937,2cyclictest3285089-21kworker/u16:2+events_unbound12:21:484
2655410993937,2cyclictest2984699-21kworker/u16:1+events_unbound09:50:404
2655410993937,2cyclictest2879239-21kworker/u16:2+events_unbound09:13:444
2655410993937,2cyclictest2812122-21kworker/u16:3+events_unbound09:25:204
2655427993837,0cyclictest0-21swapper/709:42:377
2655410993836,2cyclictest3285089-21kworker/u16:2+events_unbound12:05:484
2655410993836,2cyclictest3128873-21kworker/u16:5+events_unbound11:22:354
2655410993836,2cyclictest3117214-21kworker/u16:2+flush-8:010:55:204
2655410993836,2cyclictest3117214-21kworker/u16:2+events_unbound11:11:564
2655410993836,2cyclictest3117214-21kworker/u16:2+events_unbound10:59:454
2655410993836,2cyclictest3117214-21kworker/u16:2+events_unbound10:41:354
2655410993836,2cyclictest3062258-21kworker/u16:3+events_unbound10:14:444
2655410993836,2cyclictest2879239-21kworker/u16:2+events_unbound09:18:374
2655410993836,2cyclictest2602101-21kworker/u16:0+events_unbound09:43:364
2655410993836,2cyclictest2602101-21kworker/u16:0+events_unbound09:30:194
2655419993733,3cyclictest3298844-21kworker/u16:0+flush-8:011:54:156
2655410993735,2cyclictest3128873-21kworker/u16:5+events_unbound11:50:534
2655410993735,2cyclictest3128873-21kworker/u16:5+events_unbound11:36:204
2655410993735,2cyclictest3117214-21kworker/u16:2+events_unbound10:47:234
2655427993635,0cyclictest0-21swapper/711:05:317
2655427993635,0cyclictest0-21swapper/710:41:277
2655427993635,0cyclictest0-21swapper/710:21:077
265542799360,34cyclictest2745066-21latency_hist07:48:597
2655414993532,2cyclictest3117214-21kworker/u16:2+flush-8:010:43:585
2655410993533,2cyclictest3117214-21kworker/u16:2+events_unbound10:52:594
2655410993533,2cyclictest2812122-21kworker/u16:3+events_unbound09:47:564
2655410993533,2cyclictest2602101-21kworker/u16:0+events_unbound09:36:244
2655410993533,2cyclictest2602101-21kworker/u16:0+events_unbound09:36:244
2655410993533,2cyclictest2602101-21kworker/u16:0+events_unbound09:23:404
2655410993532,2cyclictest2744740-21kworker/u16:2+events_unbound08:14:004
2655427993433,0cyclictest0-21swapper/712:33:477
2655427993427,1cyclictest0-21swapper/709:45:497
2655427993330,2cyclictest3259631-21ssh11:36:267
2655419993330,2cyclictest3354281-21kworker/u16:3+flush-8:012:19:126
2655414993330,2cyclictest2984699-21kworker/u16:1+events_unbound10:29:125
2655414993229,2cyclictest3142267-21kworker/u16:6+flush-8:010:54:035
2655410993230,2cyclictest3117214-21kworker/u16:2+events_unbound11:05:474
2655410993230,2cyclictest2602101-21kworker/u16:0+events_unbound08:29:284
265542799310,30cyclictest5417-21sshd09:21:197
2655419993128,2cyclictest2602101-21kworker/u16:0+events_unbound10:24:196
2655414993129,2cyclictest2879239-21kworker/u16:2+events_unbound09:49:125
2655410993129,2cyclictest2602101-21kworker/u16:0+events_unbound08:36:204
2655419993028,2cyclictest3142267-21kworker/u16:6+flush-8:011:39:346
2655410993027,2cyclictest2744740-21kworker/u16:2+events_unbound07:54:004
2655427992929,0cyclictest0-21swapper/712:27:387
2655427992928,0cyclictest0-21swapper/708:48:207
2655427992923,5cyclictest2706865-21latency_hist07:28:587
2655419992927,2cyclictest2869122-21kworker/u16:1+flush-8:008:58:586
2655414992926,2cyclictest3298844-21kworker/u16:0+events_unbound12:29:125
2655427992828,0cyclictest0-21swapper/711:01:447
2655427992828,0cyclictest0-21swapper/709:32:227
2655427992827,0cyclictest0-21swapper/709:25:267
2655427992821,5cyclictest650-21systemd-journal09:03:587
2655410992826,2cyclictest2812122-21kworker/u16:3+events_unbound08:53:094
2655410992826,2cyclictest2744740-21kworker/u16:2+events_unbound07:46:194
2655427992727,0cyclictest0-21swapper/711:30:147
2655414992725,2cyclictest2984699-21kworker/u16:1+flush-8:010:34:215
2655410992725,2cyclictest2602101-21kworker/u16:0+events_unbound08:28:204
2655410992725,2cyclictest2602101-21kworker/u16:0+events_unbound08:04:084
2655427992625,0cyclictest0-21swapper/707:13:297
2655414992624,2cyclictest3128873-21kworker/u16:5+flush-8:011:49:085
2655414992623,2cyclictest3117214-21kworker/u16:2+flush-8:011:24:215
2655414992623,2cyclictest3117214-21kworker/u16:2+events_unbound11:34:135
2655427992525,0cyclictest0-21swapper/710:07:547
2655414992522,2cyclictest3128873-21kworker/u16:5+events_unbound11:54:115
2655419992422,2cyclictest2679986-21kworker/u16:3+flush-8:007:33:546
2655419992422,2cyclictest2679986-21kworker/u16:3+flush-8:007:33:546
2655414992422,2cyclictest2879239-21kworker/u16:2+flush-8:009:39:195
2655414992422,2cyclictest2602101-21kworker/u16:0+events_unbound07:14:125
2655414992421,2cyclictest2744740-21kworker/u16:2+flush-8:008:49:155
2655427992323,0cyclictest0-21swapper/710:58:547
2655427992323,0cyclictest0-21swapper/707:43:017
2655427992322,0cyclictest0-21swapper/707:07:217
2655427992321,1cyclictest0-21swapper/707:14:157
2655419992321,2cyclictest3128873-21kworker/u16:5+flush-8:012:14:226
2655419992321,2cyclictest3128873-21kworker/u16:5+flush-8:010:44:196
2655419992321,2cyclictest2984699-21kworker/u16:1+flush-8:010:04:266
2655419992321,2cyclictest2879239-21kworker/u16:2+flush-8:009:49:226
2655414992321,2cyclictest3128873-21kworker/u16:5+events_unbound11:14:215
2655414992320,2cyclictest2984699-21kworker/u16:1+events_unbound10:09:205
2655427992222,0cyclictest0-21swapper/712:20:187
2655427992222,0cyclictest0-21swapper/709:37:177
2655427992222,0cyclictest0-21swapper/709:37:177
2655427992221,1cyclictest107-21kcompactd010:24:377
2655427992221,0cyclictest0-21swapper/708:58:497
2655419992220,2cyclictest2602101-21kworker/u16:0+events_unbound09:39:266
2655419992219,2cyclictest2602101-21kworker/u16:0+flush-8:008:19:166
2655410992220,2cyclictest2869122-21kworker/u16:1+events_unbound08:59:224
2655410992220,2cyclictest2812122-21kworker/u16:3+flush-8:008:55:404
2655410992219,2cyclictest2602101-21kworker/u16:0+flush-8:007:59:094
2655419992119,2cyclictest3117214-21kworker/u16:2+events_unbound11:24:256
2655410992119,2cyclictest2744740-21kworker/u16:2+events_unbound07:50:214
2655427992020,0cyclictest0-21swapper/708:16:197
2655427992019,0cyclictest0-21swapper/708:35:597
265542799200,18cyclictest0-21swapper/708:49:217
2655419992018,2cyclictest2602101-21kworker/u16:0+events_unbound10:14:256
2655419992017,3cyclictest2984699-21kworker/u16:1+flush-8:009:47:326
2655419992016,3cyclictest3128873-21kworker/u16:5+flush-8:011:34:146
2655427991919,0cyclictest0-21swapper/711:21:087
2655427991918,0cyclictest0-21swapper/708:42:247
2655427991918,0cyclictest0-21swapper/707:35:207
2655419991917,2cyclictest3117214-21kworker/u16:2+flush-8:010:49:196
2655419991917,2cyclictest2984699-21kworker/u16:1+events_unbound10:29:266
2655419991917,2cyclictest2602101-21kworker/u16:0+events_unbound09:34:196
2655419991917,2cyclictest2602101-21kworker/u16:0+events_unbound09:34:196
2655419991917,2cyclictest2602101-21kworker/u16:0+events_unbound08:04:276
2655419991917,2cyclictest2602101-21kworker/u16:0+events_unbound07:49:136
2655414991917,2cyclictest3285089-21kworker/u16:2+flush-8:011:59:555
2655414991916,2cyclictest2744740-21kworker/u16:2+events_unbound08:29:125
2655410991917,2cyclictest2679986-21kworker/u16:3+events_unbound07:35:104
2655410991917,2cyclictest2602101-21kworker/u16:0+events_unbound08:39:264
2655419991816,2cyclictest2602101-21kworker/u16:0+flush-8:010:23:346
2655419991816,2cyclictest2602101-21kworker/u16:0+flush-8:008:14:276
2655414991816,2cyclictest2602101-21kworker/u16:0+events_unbound07:34:125
2655427991717,0cyclictest0-21swapper/707:31:497
2655427991717,0cyclictest0-21swapper/707:31:497
2655427991714,2cyclictest3139291-21ssh10:46:047
2655427991713,3cyclictest1267-21snmpd09:55:427
2655419991715,2cyclictest2879239-21kworker/u16:2+events_unbound09:54:116
2655419991714,3cyclictest3128873-21kworker/u16:5+flush-8:011:20:526
2655419991714,2cyclictest2744740-21kworker/u16:2+events_unbound08:29:166
2655414991715,2cyclictest2602101-21kworker/u16:0+events_unbound09:44:235
2655414991714,2cyclictest2602101-21kworker/u16:0+flush-8:007:59:155
2655427991615,0cyclictest0-21swapper/708:02:287
2655419991614,2cyclictest3354281-21kworker/u16:3+flush-8:012:29:266
2655419991614,2cyclictest3285089-21kworker/u16:2+events_unbound12:24:246
2655419991614,2cyclictest2602101-21kworker/u16:0+events_unbound07:19:136
265542799157,7cyclictest0-21swapper/711:59:187
265542799157,7cyclictest0-21swapper/711:24:167
265542799157,7cyclictest0-21swapper/711:14:157
265542799157,7cyclictest0-21swapper/710:14:187
2655427991513,1cyclictest2888455-21diskmemload11:44:167
2655427991511,3cyclictest0-21swapper/708:33:587
2655419991513,2cyclictest2679986-21kworker/u16:3+flush-8:007:38:546
2655419991511,3cyclictest2602101-21kworker/u16:0+flush-8:008:39:196
2655410991513,2cyclictest2744740-21kworker/u16:2+flush-8:008:44:154
2655410991513,2cyclictest2744740-21kworker/u16:2+events_unbound08:09:054
2655410991513,2cyclictest2602101-21kworker/u16:0+events_unbound07:29:194
2655410991513,2cyclictest2602101-21kworker/u16:0+events_unbound07:29:194
265542799146,7cyclictest6053-21gmain07:48:597
265542799146,7cyclictest0-21swapper/710:29:377
265542799146,7cyclictest0-21swapper/709:05:467
265542799145,8cyclictest0-21swapper/711:54:217
2655427991413,0cyclictest0-21swapper/708:24:517
2655419991413,1cyclictest0-21swapper/612:03:396
2655419991413,1cyclictest0-21swapper/611:14:376
2655419991413,1cyclictest0-21swapper/610:41:306
2655419991412,2cyclictest2744740-21kworker/u16:2+flush-8:008:34:226
2655414991413,1cyclictest0-21swapper/512:04:585
2655414991411,2cyclictest2656022-21expr07:04:105
265541499140,14cyclictest0-21swapper/512:25:005
265541499140,14cyclictest0-21swapper/512:21:035
2655410991412,2cyclictest2636191-21kworker/u16:1+events_unbound07:18:084
265542799136,6cyclictest0-21swapper/709:49:127
265542799135,7cyclictest0-21swapper/711:39:097
265542799135,7cyclictest0-21swapper/711:10:577
265542799135,7cyclictest0-21swapper/710:11:177
2655427991311,1cyclictest0-21swapper/708:11:537
265541999138,2cyclictest1-21systemd11:03:586
2655419991312,1cyclictest0-21swapper/612:07:356
2655419991312,1cyclictest0-21swapper/611:06:536
2655419991312,1cyclictest0-21swapper/610:10:276
2655419991312,1cyclictest0-21swapper/609:14:106
2655419991311,2cyclictest2602101-21kworker/u16:0+events_unbound10:34:256
265541999130,13cyclictest0-21swapper/611:51:496
265541999130,13cyclictest0-21swapper/609:08:486
265541999130,12cyclictest0-21swapper/609:09:126
265541999130,0cyclictest0-21swapper/612:11:416
2655414991312,1cyclictest0-21swapper/511:23:505
2655414991312,1cyclictest0-21swapper/509:19:555
2655414991312,1cyclictest0-21swapper/508:39:245
265541499130,13cyclictest0-21swapper/509:09:025
265541499130,13cyclictest0-21swapper/508:35:375
2655410991311,2cyclictest2636191-21kworker/u16:1+events_unbound07:26:214
2655410991311,2cyclictest2602101-21kworker/u16:0+flush-8:007:09:204
2655410991311,2cyclictest2602101-21kworker/u16:0+events_unbound07:08:534
265542799128,3cyclictest2812121-21sed08:23:587
265542799128,3cyclictest1267-21snmpd07:56:397
2655427991212,0cyclictest0-21swapper/708:06:527
265542799120,10cyclictest0-21swapper/707:19:237
265541999129,2cyclictest2602101-21kworker/u16:0+flush-8:009:01:556
2655419991211,1cyclictest0-21swapper/611:30:046
2655419991211,1cyclictest0-21swapper/611:12:436
2655419991211,1cyclictest0-21swapper/610:02:536
2655419991211,1cyclictest0-21swapper/607:44:096
2655414991211,1cyclictest2812122-21kworker/u16:3+flush-8:009:04:245
2655414991211,1cyclictest0-21swapper/511:39:265
2655414991211,1cyclictest0-21swapper/510:04:415
2655414991211,1cyclictest0-21swapper/509:55:135
2655414991211,1cyclictest0-21swapper/509:30:575
2655414991210,2cyclictest2744740-21kworker/u16:2+flush-8:008:44:235
2655414991210,2cyclictest2602101-21kworker/u16:0+events_unbound10:19:125
2655410991210,2cyclictest2602101-21kworker/u16:0+events_unbound08:21:494
265541999119,2cyclictest2602101-21kworker/u16:0+events_unbound07:59:266
2655419991110,1cyclictest0-21swapper/611:47:536
2655419991110,1cyclictest0-21swapper/608:10:006
2655419991110,1cyclictest0-21swapper/607:27:176
265541999110,11cyclictest0-21swapper/608:50:506
265541499119,2cyclictest3298844-21kworker/u16:0+events_unbound12:09:235
265541499118,3cyclictest3142267-21kworker/u16:6+events_unbound10:49:205
265541499118,2cyclictest2921589-21grep09:14:245
265541499117,3cyclictest3262690-21kworker/u16:0+events_unbound11:44:115
2655414991110,1cyclictest0-21swapper/511:33:365
2655414991110,1cyclictest0-21swapper/511:10:165
2655414991110,1cyclictest0-21swapper/510:14:095
2655414991110,1cyclictest0-21swapper/508:56:355
2655414991110,1cyclictest0-21swapper/508:17:005
265541099119,2cyclictest2679986-21kworker/u16:3+events_unbound07:41:394
265541999109,1cyclictest0-21swapper/607:13:246
265541999107,3cyclictest2879239-21kworker/u16:2+flush-8:009:19:136
265541999106,3cyclictest2679986-21kworker/u16:3+flush-8:007:39:246
265541499109,1cyclictest0-21swapper/511:08:235
265541499109,1cyclictest0-21swapper/507:53:035
265541499109,1cyclictest0-21swapper/507:31:555
265541499109,1cyclictest0-21swapper/507:31:555
265541499108,2cyclictest2984699-21kworker/u16:1+events_unbound10:44:215
265541499108,2cyclictest2744740-21kworker/u16:2+flush-8:008:09:135
265541499106,3cyclictest2961862-21cat09:34:125
265541499106,3cyclictest2961862-21cat09:34:125
265541499100,0cyclictest0-21swapper/508:22:315
26554199998,1cyclictest0-21swapper/610:57:076
26554199998,1cyclictest0-21swapper/609:30:436
26554199998,1cyclictest0-21swapper/608:46:546
26554199998,1cyclictest0-21swapper/607:15:466
26554199997,2cyclictest2653913-21kworker/u16:2+events_unbound07:04:126
26554149998,1cyclictest0-21swapper/511:00:395
26554149998,1cyclictest0-21swapper/508:24:165
26554149998,1cyclictest0-21swapper/507:55:065
26554149998,1cyclictest0-21swapper/507:40:265
26554149997,2cyclictest2879239-21kworker/u16:2+flush-8:009:24:245
26554199984,3cyclictest2945526-21ntpq09:24:226
26554199984,3cyclictest2812923-21fschecks_count08:24:096
26554199983,4cyclictest2758674-21cut07:54:166
26554149987,1cyclictest0-21swapper/507:44:325
26554149986,1cyclictest0-21swapper/507:19:185
26554149986,1cyclictest0-21swapper/507:09:035
26554149985,2cyclictest0-21swapper/508:04:175
26554149983,4cyclictest3354486-21timerandwakeup12:14:265
26554149980,4cyclictest3081248-21/usr/sbin/munin10:24:135
26554149974,2cyclictest2698363-21fschecks_time07:24:125
26554149972,4cyclictest2879626-21expr08:59:095
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional