You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-02 - 09:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sun Aug 02, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
223652780,1sleep222362-21sshd23:40:292
194462740,2sleep61208699cyclictest21:24:586
194462740,2sleep61208699cyclictest21:24:586
81112720,0sleep50-21swapper/521:47:485
230402530,2sleep71209099cyclictest22:51:417
110132510,1sleep111010-21sshd21:31:421
1173125027,8sleep20-21swapper/219:03:222
1189624926,8sleep60-21swapper/619:05:426
1174324926,8sleep50-21swapper/519:03:335
64652470,2sleep11206099cyclictest22:07:301
315352470,1sleep431534-21sshd21:18:234
315352470,1sleep431534-21sshd21:18:234
235782460,0sleep0111rcuc/000:07:340
235782460,0sleep0111rcuc/000:07:340
168102460,0sleep70-21swapper/723:40:107
301832450,0sleep50-21swapper/521:41:475
265702450,1sleep1756-21sshd00:27:381
211672450,0sleep70-21swapper/723:26:017
80322430,0sleep00-21swapper/022:05:530
308472430,0sleep00-21swapper/000:27:530
263192430,0sleep70-21swapper/721:23:317
263192430,0sleep70-21swapper/721:23:317
260362430,0sleep00-21swapper/022:41:090
246552430,0sleep70-21swapper/700:11:187
67822420,0sleep20-21swapper/221:09:482
38022420,0sleep3391rcuc/322:54:173
314942420,0sleep6631rcuc/600:35:126
24982420,0sleep60-21swapper/623:55:396
181542420,1sleep618155-21grep23:51:076
1167024230,9sleep70-21swapper/719:02:397
81272410,0sleep10-21swapper/123:14:251
60412410,0sleep60-21swapper/621:47:416
40272410,0sleep50-21swapper/523:50:185
245702410,0sleep10-21swapper/122:17:311
245702410,0sleep10-21swapper/122:17:311
225372410,2sleep51208499cyclictest23:11:335
104912410,0sleep20-21swapper/222:15:002
224192400,0sleep50-21swapper/522:24:405
213182400,0sleep40-21swapper/400:12:514
1175124027,9sleep40-21swapper/419:03:404
1162324028,8sleep00-21swapper/019:02:000
96882390,0sleep20-21swapper/222:23:572
70182390,0sleep60-21swapper/622:16:326
70182390,0sleep60-21swapper/622:16:326
68772390,0sleep30-21swapper/322:59:543
229062390,0sleep60-21swapper/622:13:526
187232390,0sleep50-21swapper/523:29:275
187232390,0sleep50-21swapper/523:29:275
1162623927,9sleep30-21swapper/319:02:033
1159723926,10sleep10-21swapper/119:01:371
115932390,0sleep10-21swapper/100:35:551
296692380,0sleep70-21swapper/723:46:197
293172380,0sleep10-21swapper/121:16:281
293172380,0sleep10-21swapper/121:16:281
196982380,0sleep10-21swapper/121:10:351
151892380,0sleep70-21swapper/721:13:547
4112370,0sleep50-21swapper/521:11:205
231122370,0sleep40-21swapper/423:42:164
155222310,1sleep315527-21grepconf.sh00:08:583
155222310,1sleep315527-21grepconf.sh00:08:583
12084992312,2cyclictest57-21ksoftirqd/521:30:275
12084992312,2cyclictest57-21ksoftirqd/521:30:275
1208499227,1cyclictest57-21ksoftirqd/523:24:085
1208499226,3cyclictest464-21systemd-journal22:36:525
12060992218,1cyclictest121rcu_preempt23:52:291
12077992115,3cyclictest49-21ksoftirqd/422:56:184
1206099216,3cyclictest25-21ksoftirqd/122:05:071
1206099216,2cyclictest25-21ksoftirqd/123:03:301
1206099214,3cyclictest25-21ksoftirqd/122:22:521
1206099214,3cyclictest25-21ksoftirqd/100:13:271
1206099212,1cyclictest25-21ksoftirqd/123:56:371
12060992113,1cyclictest25-21ksoftirqd/123:25:401
12084992016,3cyclictest57-21ksoftirqd/523:16:295
1206099208,3cyclictest25-21ksoftirqd/121:44:151
1206099205,3cyclictest25-21ksoftirqd/100:21:251
1206099204,1cyclictest25-21ksoftirqd/123:07:151
1206099204,1cyclictest25-21ksoftirqd/122:48:551
1206099202,1cyclictest25-21ksoftirqd/121:48:431
12060992016,3cyclictest25-21ksoftirqd/123:16:431
1206099200,3cyclictest121rcu_preempt22:13:541
1208499199,1cyclictest57-21ksoftirqd/521:16:295
1208499199,1cyclictest57-21ksoftirqd/521:16:295
1208499196,1cyclictest57-21ksoftirqd/523:52:255
1208499192,2cyclictest57-21ksoftirqd/522:59:275
12084991917,1cyclictest57-21ksoftirqd/523:36:295
12084991915,3cyclictest57-21ksoftirqd/523:35:455
12084991915,1cyclictest57-21ksoftirqd/522:05:475
12084991914,3cyclictest57-21ksoftirqd/522:30:305
12084991913,3cyclictest57-21ksoftirqd/522:07:275
12084991912,3cyclictest57-21ksoftirqd/523:05:135
12077991915,1cyclictest49-21ksoftirqd/421:14:194
1206099195,1cyclictest121rcu_preempt21:24:081
1206099195,1cyclictest121rcu_preempt21:24:081
12060991917,1cyclictest25-21ksoftirqd/122:52:171
12060991914,4cyclictest25-21ksoftirqd/121:57:381
12060991910,1cyclictest25-21ksoftirqd/122:41:001
1206099191,1cyclictest25-21ksoftirqd/123:43:171
1206099191,1cyclictest121rcu_preempt00:09:251
1206099191,1cyclictest121rcu_preempt00:09:251
41862180,1sleep64176-21sshd00:19:106
1208499189,2cyclictest57-21ksoftirqd/523:44:415
1208499186,4cyclictest57-21ksoftirqd/522:41:475
1208499184,1cyclictest57-21ksoftirqd/500:02:015
12084991816,1cyclictest57-21ksoftirqd/521:58:095
12084991816,1cyclictest57-21ksoftirqd/500:11:525
12084991814,2cyclictest57-21ksoftirqd/522:52:545
12084991814,1cyclictest57-21ksoftirqd/500:18:355
12084991813,4cyclictest57-21ksoftirqd/521:22:525
12084991813,4cyclictest57-21ksoftirqd/521:22:525
12084991812,3cyclictest57-21ksoftirqd/522:14:385
12084991811,1cyclictest57-21ksoftirqd/521:32:175
1208499181,1cyclictest57-21ksoftirqd/521:40:285
1206099186,2cyclictest464-21systemd-journal21:28:271
1206099186,2cyclictest464-21systemd-journal21:28:271
1206099184,1cyclictest25-21ksoftirqd/122:56:561
12060991817,1cyclictest25-21ksoftirqd/123:33:551
12060991815,3cyclictest1844-21nfsd00:02:051
12060991814,3cyclictest25-21ksoftirqd/122:26:421
12060991810,1cyclictest25-21ksoftirqd/123:36:461
1206099181,1cyclictest25-21ksoftirqd/100:18:171
1206099180,2cyclictest121rcu_preempt21:11:251
1206099180,18cyclictest23049-21kworker/1:221:39:051
1206099180,1cyclictest131rcu_sched22:32:591
61042170,0sleep40-21swapper/422:40:014
12084991715,1cyclictest57-21ksoftirqd/523:56:265
12084991715,1cyclictest57-21ksoftirqd/521:52:145
12084991715,1cyclictest57-21ksoftirqd/500:08:235
12084991715,1cyclictest57-21ksoftirqd/500:08:235
12084991714,1cyclictest57-21ksoftirqd/522:31:425
12084991714,1cyclictest57-21ksoftirqd/500:26:525
12084991713,1cyclictest57-21ksoftirqd/500:23:245
12084991711,3cyclictest57-21ksoftirqd/523:06:315
1208499171,1cyclictest57-21ksoftirqd/522:16:335
1208499171,1cyclictest57-21ksoftirqd/522:16:335
1208499170,1cyclictest29898-21sshd22:46:395
12077991715,1cyclictest49-21ksoftirqd/423:12:044
12077991715,1cyclictest49-21ksoftirqd/422:31:354
12077991715,1cyclictest49-21ksoftirqd/421:59:384
12077991713,1cyclictest49-21ksoftirqd/421:41:014
12060991715,1cyclictest464-21systemd-journal23:46:231
12060991715,1cyclictest25-21ksoftirqd/123:27:151
12060991715,1cyclictest25-21ksoftirqd/123:27:151
12060991715,1cyclictest25-21ksoftirqd/122:41:481
12060991715,1cyclictest25-21ksoftirqd/121:52:111
12090991614,1cyclictest73-21ksoftirqd/721:56:297
12086991614,1cyclictest65-21ksoftirqd/622:04:366
1208499164,2cyclictest57-21ksoftirqd/521:07:485
12084991614,1cyclictest57-21ksoftirqd/500:32:285
12077991615,1cyclictest49-21ksoftirqd/423:09:054
12077991615,1cyclictest49-21ksoftirqd/421:54:104
12077991614,1cyclictest49-21ksoftirqd/423:51:254
12077991614,1cyclictest49-21ksoftirqd/423:38:004
12077991614,1cyclictest49-21ksoftirqd/423:33:474
12077991614,1cyclictest49-21ksoftirqd/423:27:584
12077991614,1cyclictest49-21ksoftirqd/423:27:584
12077991614,1cyclictest49-21ksoftirqd/422:50:444
12077991614,1cyclictest49-21ksoftirqd/422:28:334
12077991614,1cyclictest49-21ksoftirqd/400:19:094
12077991612,3cyclictest49-21ksoftirqd/421:23:504
12077991612,3cyclictest49-21ksoftirqd/421:23:504
1207799160,16cyclictest1263-21kworker/4:100:06:344
1207799160,16cyclictest1263-21kworker/4:100:06:344
279472150,1sleep2311rcuc/223:04:412
12090991514,1cyclictest73-21ksoftirqd/722:46:037
12086991514,1cyclictest65-21ksoftirqd/623:06:276
12086991513,1cyclictest65-21ksoftirqd/623:45:106
12086991513,1cyclictest65-21ksoftirqd/621:57:546
12086991513,1cyclictest65-21ksoftirqd/600:11:026
12086991513,1cyclictest65-21ksoftirqd/600:11:026
1207799152,12cyclictest1500-21kworker/4:122:55:214
12077991514,1cyclictest49-21ksoftirqd/423:04:074
12077991513,1cyclictest49-21ksoftirqd/423:56:294
12077991513,1cyclictest49-21ksoftirqd/423:46:194
12077991513,1cyclictest49-21ksoftirqd/422:25:004
12077991513,1cyclictest49-21ksoftirqd/422:11:294
12077991513,1cyclictest49-21ksoftirqd/422:03:224
12077991513,1cyclictest49-21ksoftirqd/400:36:034
12077991513,1cyclictest49-21ksoftirqd/400:26:444
12077991512,2cyclictest49-21ksoftirqd/422:43:534
12077991512,2cyclictest49-21ksoftirqd/421:31:444
12077991511,1cyclictest49-21ksoftirqd/422:16:224
12077991511,1cyclictest49-21ksoftirqd/422:16:224
12077991510,4cyclictest49-21ksoftirqd/423:22:124
12068991513,1cyclictest33-21ksoftirqd/221:59:432
82622140,0sleep20-21swapper/200:08:332
82622140,0sleep20-21swapper/200:08:332
33822140,0sleep0111rcuc/023:57:250
312062140,1sleep331184-21sshd23:49:593
17012140,0sleep2311rcuc/223:42:542
169042140,0sleep50-21swapper/519:11:335
131402140,1sleep3401ktimersoftd/321:40:573
12086991413,1cyclictest65-21ksoftirqd/622:27:346
12086991412,1cyclictest65-21ksoftirqd/622:58:056
12086991412,1cyclictest65-21ksoftirqd/621:43:436
12077991413,1cyclictest49-21ksoftirqd/423:16:404
12077991413,1cyclictest20039-21kworker/4:300:01:544
12077991412,1cyclictest49-21ksoftirqd/422:08:464
12077991412,1cyclictest49-21ksoftirqd/421:43:394
12077991412,1cyclictest49-21ksoftirqd/421:27:114
12077991412,1cyclictest49-21ksoftirqd/421:27:114
12077991412,1cyclictest49-21ksoftirqd/400:21:164
12068991411,2cyclictest22901-21sshd23:53:062
1206099140,1cyclictest121rcu_preempt20:51:121
1205899145,8cyclictest15359-21sshd22:51:220
12058991412,1cyclictest9-21ksoftirqd/000:02:540
1205899140,9cyclictest0-21swapper/021:25:420
1205899140,9cyclictest0-21swapper/021:25:420
84102130,0sleep30-21swapper/321:20:473
84102130,0sleep30-21swapper/321:20:473
122202130,1sleep712219-21id21:28:117
122202130,1sleep712219-21id21:28:117
12090991311,1cyclictest73-21ksoftirqd/722:28:257
12086991312,1cyclictest65-21ksoftirqd/623:01:316
12086991312,1cyclictest65-21ksoftirqd/621:39:046
12086991312,1cyclictest65-21ksoftirqd/600:30:336
12086991311,1cyclictest65-21ksoftirqd/622:45:256
12086991311,1cyclictest65-21ksoftirqd/600:22:116
1208699131,11cyclictest16363-21kworker/6:321:13:226
12084991312,1cyclictest57-21ksoftirqd/519:07:295
1207799139,1cyclictest49-21ksoftirqd/421:08:154
12077991311,1cyclictest49-21ksoftirqd/421:48:244
1207199134,4cyclictest23823-21sshd00:20:173
12071991311,1cyclictest28786-21systemd22:10:373
12071991310,2cyclictest10611-21systemctl00:26:423
1206899138,4cyclictest33-21ksoftirqd/221:54:272
12068991311,1cyclictest33-21ksoftirqd/221:38:172
12060991312,1cyclictest8880-21kworker/1:221:05:011
1205899139,3cyclictest9-21ksoftirqd/022:47:040
12058991310,2cyclictest9-21ksoftirqd/021:50:530
260452120,0sleep70-21swapper/721:54:147
1209099122,4cyclictest4022-21sshd22:39:537
1209099122,4cyclictest32537-21sshd23:13:587
1209099122,4cyclictest22326-21bash21:08:407
1209099122,4cyclictest12533-21sshd23:09:147
1209099122,4cyclictest0-21swapper/723:31:497
1209099122,4cyclictest0-21swapper/721:45:037
1209099122,4cyclictest0-21swapper/721:37:107
1209099122,4cyclictest0-21swapper/700:28:007
1208699128,3cyclictest65-21ksoftirqd/622:47:256
1208699124,4cyclictest30066-21sshd23:28:156
1208699124,4cyclictest30066-21sshd23:28:156
12086991211,1cyclictest65-21ksoftirqd/622:23:236
12086991211,1cyclictest65-21ksoftirqd/621:53:566
12086991211,1cyclictest65-21ksoftirqd/621:29:266
12086991211,1cyclictest65-21ksoftirqd/621:29:266
12086991211,1cyclictest65-21ksoftirqd/600:01:046
12086991210,1cyclictest65-21ksoftirqd/623:36:336
12086991210,1cyclictest65-21ksoftirqd/623:11:246
12086991210,1cyclictest65-21ksoftirqd/622:08:056
12086991210,1cyclictest65-21ksoftirqd/600:04:576
1208699120,11cyclictest25956-21sshd22:39:176
12084991212,0cyclictest0-21swapper/521:05:015
12084991211,1cyclictest0-21swapper/519:52:035
12084991210,1cyclictest57-21ksoftirqd/519:21:125
1207199122,5cyclictest8673-21bash00:33:533
1207199122,4cyclictest859-21gdbus00:15:023
1207199122,4cyclictest5979-21systemd-cgroups23:12:263
1207199122,4cyclictest3053-21sshd22:12:433
1207199122,4cyclictest1-21systemd23:16:253
1207199122,4cyclictest1-21systemd22:31:183
12071991210,1cyclictest41-21ksoftirqd/321:53:593
1207199120,12cyclictest25716-21kworker/3:321:26:473
1207199120,12cyclictest25716-21kworker/3:321:26:473
1207199120,11cyclictest5481-21kworker/3:521:12:313
1207199120,11cyclictest0-21swapper/300:23:143
1207199120,1cyclictest0-21swapper/321:44:443
12068991210,1cyclictest33-21ksoftirqd/223:36:112
12068991210,1cyclictest33-21ksoftirqd/200:29:312
1206899120,11cyclictest0-21swapper/222:50:592
12060991211,1cyclictest8880-21kworker/1:219:52:031
12060991211,1cyclictest8880-21kworker/1:219:07:291
1205899129,1cyclictest11948-21sshd22:09:400
1205899127,5cyclictest9-21ksoftirqd/023:35:350
12058991210,1cyclictest9-21ksoftirqd/023:01:490
12058991210,1cyclictest9-21ksoftirqd/022:22:360
12058991210,1cyclictest9-21ksoftirqd/000:31:410
1205899121,6cyclictest0-21swapper/021:40:280
1205899120,6cyclictest13019-21sshd22:13:180
208422110,0sleep00-21swapper/000:18:160
1209099119,1cyclictest859-21gdbus22:07:537
1209099119,1cyclictest73-21ksoftirqd/722:16:267
1209099119,1cyclictest73-21ksoftirqd/722:16:267
1209099119,1cyclictest73-21ksoftirqd/700:20:377
1209099114,1cyclictest16528-21sshd22:49:367
1209099113,4cyclictest857-21polkitd21:35:537
1209099112,4cyclictest11554-21sshd22:34:547
1209099112,4cyclictest0-21swapper/721:17:207
1209099112,4cyclictest0-21swapper/721:17:207
1209099112,3cyclictest7229-21sshd22:14:487
1209099112,3cyclictest26741-21sshd23:29:547
1209099112,3cyclictest26741-21sshd23:29:547
1209099112,3cyclictest22026-21sshd00:21:557
1209099111,4cyclictest5367-21sshd23:01:337
1209099111,4cyclictest4417-21sshd23:59:207
1209099111,4cyclictest0-21swapper/722:57:367
1209099111,4cyclictest0-21swapper/722:25:077
1209099110,1cyclictest22445-21sshd21:46:457
1209099110,1cyclictest0-21swapper/723:17:137
1209099110,1cyclictest0-21swapper/700:06:417
1209099110,1cyclictest0-21swapper/700:06:417
1208699119,1cyclictest65-21ksoftirqd/622:54:406
1208699119,1cyclictest65-21ksoftirqd/621:34:556
1208699119,1cyclictest65-21ksoftirqd/600:11:586
1208699115,3cyclictest17371-21cp23:31:126
12086991110,1cyclictest65-21ksoftirqd/622:33:246
1208699110,11cyclictest0-21swapper/623:16:396
1208499117,4cyclictest57-21ksoftirqd/519:22:555
1208499117,4cyclictest57-21ksoftirqd/519:22:555
1207199119,1cyclictest464-21systemd-journal23:05:033
1207199119,1cyclictest41-21ksoftirqd/323:41:353
1207199119,1cyclictest41-21ksoftirqd/323:34:033
1207199112,4cyclictest9207-21bash22:38:203
1207199112,4cyclictest8732-21sshd21:49:413
1207199112,4cyclictest19340-21sshd23:56:313
1207199111,4cyclictest1-21systemd22:00:113
1207199110,11cyclictest26939-21kworker/3:200:04:433
1207199110,11cyclictest15218-21kworker/3:623:28:273
1207199110,11cyclictest15218-21kworker/3:623:28:273
1207199110,10cyclictest464-21systemd-journal21:22:253
1207199110,10cyclictest464-21systemd-journal21:22:253
1207199110,10cyclictest19859-21date20:16:123
1206899119,2cyclictest33-21ksoftirqd/223:25:082
1206899119,1cyclictest33-21ksoftirqd/222:17:182
1206899119,1cyclictest33-21ksoftirqd/222:17:182
1206899119,1cyclictest33-21ksoftirqd/221:22:432
1206899119,1cyclictest33-21ksoftirqd/221:22:432
1206899119,1cyclictest33-21ksoftirqd/200:33:082
1206899118,2cyclictest33-21ksoftirqd/221:27:202
1206899118,2cyclictest33-21ksoftirqd/221:27:202
1206899118,2cyclictest20377-21grepconf.sh21:14:112
1206899118,1cyclictest33-21ksoftirqd/200:22:022
1206899117,1cyclictest33-21ksoftirqd/222:32:542
1206899111,3cyclictest27688-21sshd21:48:552
12060991111,0cyclictest8880-21kworker/1:220:16:391
12060991110,1cyclictest8880-21kworker/1:219:57:451
12060991110,1cyclictest8880-21kworker/1:219:40:051
12060991110,1cyclictest8880-21kworker/1:219:20:511
1205899119,1cyclictest9-21ksoftirqd/023:29:060
1205899119,1cyclictest9-21ksoftirqd/023:29:060
1205899119,1cyclictest9-21ksoftirqd/023:06:240
1205899118,2cyclictest3020-21sshd23:37:320
1205899114,7cyclictest0-21swapper/022:16:180
1205899114,7cyclictest0-21swapper/022:16:180
1205899112,5cyclictest721-21dbus-daemon22:35:470
12058991110,1cyclictest9-21ksoftirqd/023:50:580
12058991110,1cyclictest9-21ksoftirqd/023:12:190
1205899110,10cyclictest0-21swapper/022:42:400
311442100,0sleep00-21swapper/023:42:440
1209099103,6cyclictest20962-21grepconf.sh23:42:087
1209099103,4cyclictest19138-21bash22:02:497
1209099102,7cyclictest10971-21bash00:32:107
1209099102,5cyclictest857-21polkitd23:51:267
1208699108,1cyclictest65-21ksoftirqd/621:16:236
1208699108,1cyclictest65-21ksoftirqd/621:16:236
1208699106,3cyclictest65-21ksoftirqd/623:24:326
1208499109,1cyclictest57-21ksoftirqd/520:11:355
1208499109,1cyclictest57-21ksoftirqd/520:01:255
1208499108,1cyclictest57-21ksoftirqd/521:01:115
1208499106,4cyclictest57-21ksoftirqd/520:51:275
12084991010,0cyclictest0-21swapper/519:57:455
1207199109,1cyclictest3781-21sshd21:31:243
1207199106,3cyclictest41-21ksoftirqd/319:41:113
1207199104,4cyclictest6770-21kill22:02:063
1207199103,6cyclictest23050-21sshd22:22:523
1207199103,6cyclictest18681-21sshd23:24:023
1207199103,2cyclictest12647-21bash23:52:313
1207199102,3cyclictest29802-21sshd22:26:483
1207199101,4cyclictest21959-21sshd22:48:033
1207199101,4cyclictest0-21swapper/322:44:243
1207199100,10cyclictest28483-21kworker/3:023:38:323
1207199100,10cyclictest2537-21kworker/3:423:10:393
1207199100,10cyclictest22683-21kworker/3:421:06:413
1206899109,1cyclictest33-21ksoftirqd/222:36:172
1206899109,1cyclictest0-21swapper/221:31:222
1206899108,2cyclictest33-21ksoftirqd/221:46:062
1206899108,1cyclictest33-21ksoftirqd/223:12:382
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional