You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-13 - 04:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot0.osadl.org (updated Mon Apr 13, 2026 00:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2578421260,0sleep325785-21sshd00:03:353
3137421160,1sleep00-21swapper/021:32:490
3256821150,4sleep41368799cyclictest22:26:144
105892960,1sleep70-21swapper/700:06:127
47462860,2sleep50-21swapper/521:38:085
34202840,1sleep7726-21gdbus21:48:027
180352840,0sleep50-21swapper/523:54:325
226792810,2sleep30-21swapper/321:42:223
155792800,1sleep4681-21dbus-daemon22:17:004
308932790,0sleep10-21swapper/123:31:201
253572790,0sleep70-21swapper/700:12:127
227222790,0sleep20-21swapper/200:05:112
42272780,0sleep50-21swapper/523:08:155
210792780,0sleep0121rcuc/022:05:340
74592770,0sleep60-21swapper/622:09:576
74152770,0sleep40-21swapper/423:48:454
57852770,0sleep10-21swapper/122:50:001
215722770,0sleep30-21swapper/321:54:003
166812770,0sleep50-21swapper/523:56:075
272162760,1sleep60-21swapper/622:29:216
261722760,0sleep30-21swapper/322:19:163
209922760,4sleep21367799cyclictest23:30:482
142692760,3sleep71370399cyclictest21:51:557
316772750,0sleep50-21swapper/521:16:115
250132750,0sleep20-21swapper/223:26:002
242282740,1sleep4501ktimersoftd/400:31:094
191602740,0sleep70-21swapper/722:00:297
161142740,1sleep61-21systemd22:37:076
271162730,1sleep41051-21sshd22:12:364
106092730,0sleep50-21swapper/521:41:435
323342720,0sleep60-21swapper/622:59:436
21192720,1sleep60-21swapper/600:14:276
89782710,0sleep60-21swapper/623:16:506
325402710,0sleep40-21swapper/422:06:114
160762710,0sleep516077-21bash21:45:215
132572710,0sleep70-21swapper/723:32:057
115612710,1sleep1221rcuc/122:23:311
97872700,0sleep60-21swapper/621:53:226
4372700,0sleep50-21swapper/521:32:545
293142700,0sleep0121rcuc/023:58:350
213442700,0sleep30-21swapper/323:10:463
98062690,0sleep40-21swapper/400:20:034
255022690,0sleep30-21swapper/322:27:343
247792690,1sleep1231ktimersoftd/123:24:231
247792690,1sleep1231ktimersoftd/123:24:221
181322690,0sleep60-21swapper/600:15:176
184212680,1sleep70-21swapper/722:45:347
105752680,0sleep60-21swapper/622:23:286
74242670,3sleep01366499cyclictest23:36:470
205422670,0sleep6681ktimersoftd/623:22:276
205422670,0sleep6681ktimersoftd/623:22:266
25042640,0sleep50-21swapper/519:50:235
112862640,0sleep20-21swapper/221:38:282
159202600,0sleep40-21swapper/400:10:014
41892580,0sleep10-21swapper/122:04:471
38312570,1sleep41-21systemd23:34:584
27792570,4sleep61369899cyclictest23:29:566
231332560,1sleep323130-21sshd00:27:393
150622540,0sleep00-21swapper/000:32:250
1340825343,6sleep70-21swapper/719:09:327
1341425141,6sleep40-21swapper/419:09:364
1338425141,6sleep30-21swapper/319:09:113
1333724838,6sleep00-21swapper/019:08:360
1331324826,7sleep50-21swapper/519:08:175
1141424837,7sleep60-21swapper/619:05:066
263242460,0sleep70-21swapper/700:29:367
1339224332,7sleep20-21swapper/219:09:182
1103124331,7sleep10-21swapper/119:05:011
132272260,1sleep00-21swapper/022:45:180
101162250,0sleep70-21swapper/723:55:467
157672240,1sleep7771ktimersoftd/722:43:487
70932230,0sleep30-21swapper/323:30:093
66902220,1sleep10-21swapper/100:18:081
316632220,0sleep30-21swapper/323:29:453
285142220,0sleep1231ktimersoftd/122:12:411
231062220,1sleep123084-21sshd22:59:141
192612220,1sleep124-21ksoftirqd/123:42:261
13677992218,3cyclictest0-21swapper/223:47:232
106572220,1sleep00-21swapper/021:16:470
53692210,1sleep20-21swapper/221:19:522
269512210,1sleep20-21swapper/223:55:002
300422200,1sleep50-21swapper/500:05:295
16172200,1sleep01613-21sshd22:26:180
155082200,0sleep315473-21strings00:20:183
154802200,2sleep40-21swapper/423:52:384
13677992018,1cyclictest0-21swapper/223:43:262
90312190,1sleep2311rcuc/223:21:502
90312190,1sleep2311rcuc/223:21:502
57382190,1sleep6671rcuc/621:26:306
327492190,1sleep00-21swapper/021:44:350
278482190,1sleep51146-21nfsd22:44:275
255242190,0sleep30-21swapper/323:51:243
216072190,1sleep70-21swapper/700:22:227
213642190,1sleep221358-21sshd00:11:592
69142180,0sleep30-21swapper/323:00:043
309672180,0sleep530968-21sshd22:47:555
307532180,1sleep70-21swapper/721:26:067
289452180,0sleep00-21swapper/000:17:340
276092180,0sleep00-21swapper/000:26:080
195922180,0sleep30-21swapper/322:55:383
188342180,0sleep40-21swapper/423:00:374
18332180,0sleep40-21swapper/421:29:404
180282180,0sleep00-21swapper/023:08:590
176602180,1sleep40-21swapper/422:23:504
1370399183,13cyclictest781-21gdbus21:24:487
133302180,0sleep10-21swapper/121:53:331
114582180,0sleep50-21swapper/523:20:185
114582180,0sleep50-21swapper/523:20:175
107172180,0sleep4491rcuc/421:51:444
39992170,0sleep40-21swapper/422:51:324
287552170,0sleep70-21swapper/723:04:327
259422170,1sleep00-21swapper/023:02:410
207322170,0sleep60-21swapper/621:57:156
207322170,0sleep60-21swapper/621:57:156
163532170,1sleep10-21swapper/123:12:111
1366499174,3cyclictest7-21ksoftirqd/023:42:180
107472170,0sleep40-21swapper/421:10:084
53682160,0sleep00-21swapper/023:28:210
24782160,1sleep233-21ksoftirqd/200:30:032
208592160,0sleep70-21swapper/721:10:367
15392160,0sleep00-21swapper/022:54:470
1370399160,14cyclictest0-21swapper/722:30:357
1369899160,14cyclictest0-21swapper/600:23:446
1368799161,2cyclictest17575-21sshd23:08:564
1368799160,13cyclictest0-21swapper/421:30:074
13681991612,2cyclictest681-21dbus-daemon22:31:033
13681991612,2cyclictest0-21swapper/321:25:443
1366499167,5cyclictest7-21ksoftirqd/023:18:590
1366499167,5cyclictest7-21ksoftirqd/000:36:330
1366499167,5cyclictest7-21ksoftirqd/000:05:120
1366499165,2cyclictest7-21ksoftirqd/022:03:030
1366499165,1cyclictest7-21ksoftirqd/023:10:160
13664991614,1cyclictest0-21swapper/020:45:150
97692150,0sleep40-21swapper/400:11:224
94342150,1sleep451-21ksoftirqd/422:31:444
88422150,1sleep78806-21sshd23:13:307
74312150,0sleep60-21swapper/621:16:376
306582150,0sleep30-21swapper/321:59:293
306582150,0sleep30-21swapper/321:59:283
250162150,0sleep00-21swapper/022:10:480
220492150,0sleep30-21swapper/300:18:583
1370399150,2cyclictest0-21swapper/722:13:117
1370399150,13cyclictest18264-21sshd23:25:387
1370399150,13cyclictest0-21swapper/722:05:327
13698991512,1cyclictest0-21swapper/623:05:486
1369899150,13cyclictest0-21swapper/600:04:156
1369499150,2cyclictest0-21swapper/500:00:035
1369499150,13cyclictest761-21systemd-logind22:12:235
1368799152,5cyclictest21567-21systemd-cgroups23:58:104
1368799150,2cyclictest0-21swapper/423:17:554
1368799150,13cyclictest15065-21sshd21:41:574
13681991511,2cyclictest1-21systemd00:39:483
13681991511,2cyclictest0-21swapper/321:46:583
1368199150,13cyclictest19573-21sshd23:49:253
1367799152,1cyclictest80750irq/25-eno1-rx-23:02:422
13670991511,2cyclictest17807-21sshd22:07:061
1366499157,3cyclictest7-21ksoftirqd/022:32:220
1366499156,2cyclictest7-21ksoftirqd/021:22:420
1366499156,1cyclictest7-21ksoftirqd/021:11:390
1366499155,2cyclictest7-21ksoftirqd/000:00:020
1366499155,1cyclictest7-21ksoftirqd/021:49:070
1366499154,4cyclictest7-21ksoftirqd/021:26:490
1366499154,3cyclictest7-21ksoftirqd/023:20:470
1366499154,3cyclictest7-21ksoftirqd/023:20:460
1366499151,3cyclictest101rcu_sched21:55:290
1366499151,3cyclictest101rcu_sched21:55:280
1370399149,1cyclictest761-21systemd-logind23:18:457
13703991412,1cyclictest0-21swapper/723:22:167
13703991412,1cyclictest0-21swapper/723:22:167
1370399140,12cyclictest7553-21sshd21:16:367
1369899140,12cyclictest7606-21sshd23:57:236
13694991412,1cyclictest0-21swapper/500:26:235
13694991411,2cyclictest0-21swapper/522:32:335
13694991411,2cyclictest0-21swapper/500:16:015
1368799148,3cyclictest51-21ksoftirqd/400:35:264
1368799145,3cyclictest51-21ksoftirqd/421:16:484
1368799144,3cyclictest658-21polkitd21:47:404
1368799141,3cyclictest101rcu_sched23:11:534
13687991412,1cyclictest19081-21sshd23:29:054
13687991412,1cyclictest0-21swapper/400:19:124
13687991411,2cyclictest0-21swapper/422:38:324
1368799140,4cyclictest0-21swapper/422:03:394
1368799140,13cyclictest0-21swapper/421:55:154
1368799140,13cyclictest0-21swapper/421:55:154
13681991411,1cyclictest0-21swapper/322:01:053
1368199140,13cyclictest0-21swapper/322:43:013
1367799140,1cyclictest15675-21sshd22:38:472
1367099141,12cyclictest0-21swapper/123:52:051
1366499148,1cyclictest7-21ksoftirqd/022:20:390
1366499146,1cyclictest7-21ksoftirqd/022:35:310
1366499144,6cyclictest7-21ksoftirqd/022:56:170
1366499144,1cyclictest7-21ksoftirqd/023:51:100
1366499144,1cyclictest7-21ksoftirqd/000:20:300
1366499143,4cyclictest7-21ksoftirqd/022:42:360
1366499143,1cyclictest7-21ksoftirqd/021:35:100
1366499140,1cyclictest101rcu_sched23:46:190
125212140,0sleep50-21swapper/523:43:505
13703991311,1cyclictest658-21polkitd00:00:347
13703991311,1cyclictest17301-21sshd21:38:477
13703991311,1cyclictest0-21swapper/722:50:337
13698991311,1cyclictest9570-21grepconf.sh23:50:336
13698991311,1cyclictest1051-21sshd00:26:026
13698991311,1cyclictest0-21swapper/623:11:176
1369899130,1cyclictest15501-21sshd22:53:496
1369899130,1cyclictest1051-21sshd21:12:456
1369899130,1cyclictest0-21swapper/622:12:016
1369899130,1cyclictest0-21swapper/600:06:326
1369899130,12cyclictest11554-21bash23:40:206
1369899130,12cyclictest0-21swapper/600:34:056
1369499139,2cyclictest26445-21sshd23:12:445
13694991311,1cyclictest0-21swapper/500:36:445
1369499130,1cyclictest12716-21id22:26:535
1369499130,1cyclictest0-21swapper/522:20:115
1369499130,12cyclictest4521-21sshd23:28:195
1369499130,12cyclictest20817-21sshd22:57:245
1369499130,12cyclictest20581-21sshd00:24:065
1369499130,12cyclictest19739-21sshd00:34:265
1369499130,12cyclictest0-21swapper/522:16:485
1369499130,12cyclictest0-21swapper/521:14:275
1368799138,1cyclictest51-21ksoftirqd/422:45:284
1368799137,2cyclictest51-21ksoftirqd/423:35:334
1368799137,2cyclictest51-21ksoftirqd/400:28:404
1368799136,3cyclictest51-21ksoftirqd/423:20:134
1368799136,3cyclictest51-21ksoftirqd/423:20:124
1368799131,3cyclictest101rcu_sched22:57:024
1368799130,1cyclictest0-21swapper/421:37:344
1368799130,12cyclictest0-21swapper/400:02:014
13681991311,1cyclictest0-21swapper/323:59:383
13681991311,1cyclictest0-21swapper/323:17:573
13681991311,1cyclictest0-21swapper/323:08:013
13681991311,1cyclictest0-21swapper/322:46:143
13681991311,1cyclictest0-21swapper/322:37:383
13681991311,1cyclictest0-21swapper/300:08:473
1368199130,1cyclictest0-21swapper/322:22:033
1368199130,1cyclictest0-21swapper/322:14:153
1368199130,12cyclictest6804-21gdbus21:14:033
1368199130,12cyclictest0-21swapper/321:37:253
1368199130,12cyclictest0-21swapper/321:23:283
13677991311,1cyclictest681-21dbus-daemon21:53:112
13677991311,1cyclictest681-21dbus-daemon00:26:182
13677991311,1cyclictest681-21dbus-daemon00:03:192
13677991311,1cyclictest0-21swapper/222:07:452
13677991311,1cyclictest0-21swapper/221:25:472
1367799130,1cyclictest681-21dbus-daemon22:17:412
1367799130,12cyclictest25686-21rm22:40:552
13670991311,1cyclictest0-21swapper/122:51:031
13670991311,1cyclictest0-21swapper/100:34:251
13670991310,2cyclictest761-21systemd-logind23:59:291
13670991310,1cyclictest761-21systemd-logind23:05:111
1367099130,2cyclictest29475-21grepconf.sh22:32:461
1367099130,1cyclictest17316-21sshd22:27:081
1367099130,1cyclictest0-21swapper/123:04:051
1367099130,1cyclictest0-21swapper/121:10:071
1367099130,1cyclictest0-21swapper/100:12:381
1366499134,2cyclictest7-21ksoftirqd/000:10:350
1366499133,3cyclictest7-21ksoftirqd/023:31:230
13664991311,1cyclictest25781-21/usr/sbin/munin20:40:120
13664991311,1cyclictest0-21swapper/021:50:220
1366499130,1cyclictest91rcu_preempt22:15:180
13703991210,1cyclictest0-21swapper/722:25:267
13703991210,1cyclictest0-21swapper/700:38:217
1370399120,1cyclictest0-21swapper/721:30:357
1370399120,11cyclictest0-21swapper/722:22:037
1369899129,2cyclictest31377-21sshd23:38:026
13698991210,1cyclictest22979-21bash22:40:476
13698991210,1cyclictest0-21swapper/623:45:586
13698991210,1cyclictest0-21swapper/621:37:206
13698991210,1cyclictest0-21swapper/600:39:536
1369899120,11cyclictest30916-21sshd23:31:206
13694991210,1cyclictest0-21swapper/522:05:475
13694991210,1cyclictest0-21swapper/521:28:265
1369499120,11cyclictest0-21swapper/522:04:445
1369499120,11cyclictest0-21swapper/520:35:205
1368799126,3cyclictest51-21ksoftirqd/422:42:234
1368799126,2cyclictest51-21ksoftirqd/423:40:054
1368799126,2cyclictest51-21ksoftirqd/421:20:044
13687991210,1cyclictest0-21swapper/419:45:174
1368799120,11cyclictest0-21swapper/420:00:214
1368199120,11cyclictest0-21swapper/323:35:513
1368199120,11cyclictest0-21swapper/320:16:473
1368199120,11cyclictest0-21swapper/300:31:463
1367799129,2cyclictest778-21NetworkManager21:48:192
1367799128,2cyclictest32080-21sshd21:12:532
13677991210,1cyclictest18098-21bash22:25:292
13677991210,1cyclictest0-21swapper/222:31:072
13677991210,1cyclictest0-21swapper/221:32:472
13677991210,1cyclictest0-21swapper/200:36:402
13677991210,1cyclictest0-21swapper/200:18:152
1367799120,7cyclictest0-21swapper/200:21:222
1367799120,1cyclictest0-21swapper/223:36:032
1367799120,1cyclictest0-21swapper/219:50:142
1367799120,11cyclictest12927-21sshd21:56:512
1367799120,11cyclictest12927-21sshd21:56:502
1367799120,11cyclictest0-21swapper/223:58:462
1367799120,11cyclictest0-21swapper/223:10:212
13670991210,1cyclictest6566-21bash23:28:251
13670991210,1cyclictest0-21swapper/121:40:291
13670991210,1cyclictest0-21swapper/100:24:041
1367099120,1cyclictest0-21swapper/122:17:031
1367099120,11cyclictest0-21swapper/121:27:351
1367099120,11cyclictest0-21swapper/120:00:221
292002110,1sleep70-21swapper/723:51:367
1370399119,1cyclictest0-21swapper/723:48:057
1370399119,1cyclictest0-21swapper/723:36:477
1370399119,1cyclictest0-21swapper/723:06:507
1370399119,1cyclictest0-21swapper/720:45:187
1370399110,10cyclictest0-21swapper/723:42:267
1369899119,1cyclictest25421-21sshd22:17:326
1369899119,1cyclictest0-21swapper/620:55:176
1369899118,2cyclictest1-21systemd22:34:206
1369899110,1cyclictest0-21swapper/619:30:126
1369899110,10cyclictest0-21swapper/621:00:236
1369499119,1cyclictest0-21swapper/523:48:365
1369499119,1cyclictest0-21swapper/522:35:455
1369499119,1cyclictest0-21swapper/521:53:255
1368199119,1cyclictest0-21swapper/319:52:193
1368199114,5cyclictest0-21swapper/320:55:243
1368199110,10cyclictest539-40kipmi019:10:153
1367099119,1cyclictest0-21swapper/100:36:431
1367099117,2cyclictest681-21dbus-daemon00:28:391
1367099113,5cyclictest0-21swapper/119:38:191
1367099113,5cyclictest0-21swapper/119:38:191
1367099110,10cyclictest0-21swapper/123:48:361
1367099110,10cyclictest0-21swapper/119:30:151
1367099110,0cyclictest0-21swapper/123:16:121
1367099110,0cyclictest0-21swapper/121:31:051
1366499119,1cyclictest7-21ksoftirqd/021:10:010
1366499118,2cyclictest0-21swapper/020:23:000
1366499111,5cyclictest28100-21munin-run19:40:000
1366499111,5cyclictest28100-21munin-run19:40:000
1370399108,1cyclictest0-21swapper/722:18:437
1370399107,2cyclictest7808-21memory00:30:177
1370399104,5cyclictest0-21swapper/719:35:077
1370399104,5cyclictest0-21swapper/719:35:077
1370399100,9cyclictest1-21systemd22:37:187
1369899103,5cyclictest0-21swapper/620:37:306
1369899103,1cyclictest28557-21sshd22:46:066
1369899100,1cyclictest0-21swapper/619:55:196
1369499108,1cyclictest27515-21sshd21:22:395
1369499108,1cyclictest0-21swapper/520:05:225
1369499106,2cyclictest726-21gdbus22:50:145
1369499103,4cyclictest0-21swapper/519:37:435
1369499103,4cyclictest0-21swapper/519:37:435
1369499100,9cyclictest0-21swapper/523:02:255
1368199108,1cyclictest0-21swapper/320:08:193
1368199108,1cyclictest0-21swapper/300:11:033
1368199107,2cyclictest0-21swapper/321:17:323
1368199104,4cyclictest766-21gdbus21:30:073
1368199104,4cyclictest681-21dbus-daemon23:20:013
1368199104,4cyclictest681-21dbus-daemon23:20:003
1368199103,1cyclictest4529-21sshd22:51:323
1368199100,8cyclictest7573-21basename21:10:003
1368199100,4cyclictest28775-21sshd23:42:563
1367799108,1cyclictest16796-21bash22:57:122
1367799108,1cyclictest0-21swapper/223:15:532
1367799108,1cyclictest0-21swapper/222:45:142
1367799100,3cyclictest15102-21sshd22:11:582
1367099101,5cyclictest0-21swapper/120:20:231
1367099100,1cyclictest101rcu_sched22:44:351
1367099100,1cyclictest101rcu_sched00:07:361
9066290,1sleep50-21swapper/500:14:525
137039997,1cyclictest0-21swapper/722:55:567
137039994,2cyclictest671-21avahi-daemon21:41:297
137039993,5cyclictest0-21swapper/720:37:557
137039993,2cyclictest0-21swapper/719:10:147
137039992,2cyclictest0-21swapper/721:03:247
137039990,6cyclictest0-21swapper/719:25:147
137039990,5cyclictest0-21swapper/719:45:167
136989997,1cyclictest9005-21kworker/6:221:24:306
136989997,1cyclictest28106-21kworker/6:221:42:446
136989997,1cyclictest27655-21kworker/6:023:01:446
136989997,1cyclictest27102-21kworker/6:220:43:226
136989997,1cyclictest2237-21kworker/6:121:30:246
136989997,1cyclictest22092-21kworker/6:321:45:106
136989997,1cyclictest13231-21kworker/6:119:16:516
136989993,5cyclictest0-21swapper/619:51:196
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional