You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-24 - 06:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot0.osadl.org (updated Thu Sep 24, 2026 00:45:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2065221620,4sleep62038299cyclictest00:28:486
2450921280,0sleep60-21swapper/600:12:066
1331421230,0sleep70-21swapper/723:51:157
61821190,2sleep080850irq/26-eno1-tx-22:31:240
3272021180,0sleep30-21swapper/300:02:243
1961421180,0sleep30-21swapper/321:11:533
1298321170,0sleep40-21swapper/423:58:014
39421160,0sleep70-21swapper/721:19:197
1271321160,4sleep62038299cyclictest21:21:346
2647021150,0sleep00-21swapper/022:19:220
2337821140,0sleep40-21swapper/421:38:554
1039821090,0sleep70-21swapper/723:08:587
2800221080,0sleep5591ktimersoftd/523:55:215
2099521020,4sleep72038899cyclictest00:28:497
1726221020,1sleep417260-21sshd00:18:294
1231821010,0sleep20-21swapper/223:57:582
179802980,1sleep617982-21grepconf.sh23:44:496
179802980,1sleep617982-21grepconf.sh23:44:486
139772960,3sleep52037199cyclictest23:36:055
258312930,0sleep00-21swapper/000:25:380
134012930,1sleep30-21swapper/323:36:033
106622920,2sleep12034999cyclictest00:13:051
13732900,1sleep41369-21sshd22:55:014
117002900,0sleep30-21swapper/323:20:493
117002900,0sleep30-21swapper/323:20:483
225592880,0sleep60-21swapper/621:47:156
252222860,0sleep10-21swapper/122:24:201
210362860,0sleep081ktimersoftd/023:17:580
264782850,1sleep40-21swapper/400:08:514
30802840,0sleep70-21swapper/700:17:437
197082840,0sleep40-21swapper/421:21:574
191662840,0sleep40-21swapper/422:15:344
170312840,0sleep50-21swapper/521:18:285
315442830,0sleep10-21swapper/123:52:131
296022830,1sleep10-21swapper/122:34:381
22932830,1sleep52290-21sshd00:21:035
49602820,0sleep40-21swapper/400:27:594
225342820,1sleep3401rcuc/321:37:103
188632820,1sleep50-21swapper/522:08:535
140552820,0sleep40-21swapper/423:34:294
140552820,0sleep40-21swapper/423:34:284
126292820,2sleep30-21swapper/322:37:043
16042810,0sleep20-21swapper/222:44:582
72062800,1sleep30-21swapper/322:48:343
44082800,1sleep24412-21bash21:51:202
23972800,1sleep62395-21systemd-cgroups00:15:586
3162790,0sleep50-21swapper/521:22:375
220052780,0sleep70-21swapper/723:55:077
75312770,1sleep3681-21dbus-daemon21:49:523
63992770,1sleep70-21swapper/723:27:197
63992770,1sleep70-21swapper/723:27:187
14792770,1sleep7771ktimersoftd/721:26:017
7802760,1sleep71-21systemd22:18:017
38282760,0sleep00-21swapper/023:49:070
181892760,0sleep20-21swapper/222:27:182
234962750,1sleep323485-21sshd00:12:023
232562750,1sleep30-21swapper/322:09:083
170232750,1sleep717014-21smartctl21:35:137
63342740,1sleep50-21swapper/521:56:285
63342740,1sleep50-21swapper/521:56:275
254372740,1sleep30-21swapper/321:40:393
215242730,0sleep00-21swapper/022:05:360
109942730,0sleep20-21swapper/222:20:132
40602720,0sleep10-21swapper/121:51:181
196652720,0sleep70-21swapper/700:20:177
190492720,1sleep119047-21sshd22:02:081
36842710,0sleep60-21swapper/621:26:076
301342710,1sleep40-21swapper/423:15:054
277212710,1sleep3401rcuc/321:24:033
173702710,0sleep10-21swapper/122:25:321
126222710,0sleep10-21swapper/121:14:561
184552700,1sleep081ktimersoftd/023:21:100
184552700,1sleep081ktimersoftd/023:21:090
265872690,0sleep00-21swapper/021:37:230
110142680,1sleep40-21swapper/422:11:504
110142680,1sleep40-21swapper/422:11:494
196922670,0sleep5581rcuc/522:44:125
93812650,0sleep22035399cyclictest00:28:132
286062650,4sleep22035399cyclictest00:14:012
229772620,0sleep322981-21bash22:10:453
229772620,0sleep322981-21bash22:10:443
2010825949,6sleep70-21swapper/719:09:497
2004225938,6sleep60-21swapper/619:09:006
1808025848,6sleep30-21swapper/319:05:043
1807825848,6sleep10-21swapper/119:05:021
19892570,0sleep30-21swapper/323:47:183
47842560,0sleep40-21swapper/400:36:254
247152560,0sleep20-21swapper/221:37:172
168482560,5sleep62038299cyclictest00:05:016
234392540,3sleep32036099cyclictest21:57:223
234392540,3sleep32036099cyclictest21:57:213
2003625342,7sleep00-21swapper/019:08:540
243382520,0sleep40-21swapper/423:41:424
243382520,0sleep40-21swapper/423:41:414
58312510,1sleep75830-21sshd23:18:527
25922510,2sleep10-21swapper/100:04:161
294302500,2sleep22035399cyclictest00:39:272
320452490,4sleep62038299cyclictest21:57:496
320452490,4sleep62038299cyclictest21:57:486
85522480,0sleep1221rcuc/123:20:381
85522480,0sleep1221rcuc/123:20:381
200822480,0sleep00-21swapper/000:11:520
33162470,3sleep22035399cyclictest23:15:182
120532470,1sleep2726-21gdbus00:33:252
145802460,1sleep314581-21grep23:44:383
145802460,1sleep314581-21grep23:44:373
1995824433,7sleep50-21swapper/519:07:555
180122440,3sleep12034999cyclictest00:08:231
42112430,3sleep080850irq/26-eno1-tx-00:00:540
287182430,0sleep10-21swapper/123:18:221
2011424332,7sleep40-21swapper/419:09:544
1992624232,6sleep20-21swapper/219:07:352
140042420,0sleep00-21swapper/023:56:200
56122410,0sleep60-21swapper/600:38:106
299652410,1sleep3681-21dbus-daemon23:57:123
43652400,0sleep40-21swapper/423:08:404
135482400,2sleep52037199cyclictest00:03:075
5892390,0sleep00-21swapper/000:20:580
185422390,0sleep00-21swapper/000:37:080
41282370,0sleep30-21swapper/300:21:083
296462370,0sleep50-21swapper/500:14:055
297372320,0sleep4491rcuc/400:30:554
238952320,0sleep10-21swapper/100:23:551
279282280,0sleep60-21swapper/600:24:086
317922270,1sleep431793-21systemd-cgroups23:11:444
274942270,1sleep40-21swapper/422:32:494
47242260,0sleep20-21swapper/222:03:052
130322260,5sleep40-21swapper/422:06:524
2034299250,21cyclictest726-21gdbus00:16:250
196192250,1sleep10-21swapper/123:58:211
85492240,1sleep08545-21sshd22:00:000
85492240,1sleep08545-21sshd21:59:590
301682240,0sleep70-21swapper/723:11:407
246642230,3sleep22035399cyclictest22:05:462
199622230,1sleep319950-21sshd22:52:363
9582220,0sleep40-21swapper/421:41:034
214832220,1sleep20-21swapper/222:17:242
2035399220,19cyclictest8104-21grepconf.sh23:44:172
2035399220,19cyclictest8104-21grepconf.sh23:44:162
202332220,4sleep62038299cyclictest22:17:216
183972220,0sleep40-21swapper/422:57:334
173402220,1sleep117333-21sshd21:45:171
66942210,1sleep66692-21sshd23:05:216
35322210,1sleep50-21swapper/522:34:585
28042210,1sleep70-21swapper/721:21:037
171362210,1sleep30-21swapper/323:51:263
34212200,0sleep53398-21sshd22:53:255
2036099200,18cyclictest20992-21sshd21:53:563
20353992016,3cyclictest752-21bash23:50:352
2035399200,1cyclictest17011-21sshd00:15:072
2035399200,1cyclictest0-21swapper/200:21:222
2034299200,19cyclictest0-21swapper/022:29:160
191232200,0sleep70-21swapper/721:53:497
94802190,0sleep30-21swapper/300:36:403
74992190,0sleep2311rcuc/221:26:202
295612190,6sleep778-21ksoftirqd/700:10:397
226042190,1sleep50-21swapper/500:37:215
208272190,1sleep5581rcuc/522:37:315
205262190,1sleep2321ktimersoftd/222:12:192
205262190,1sleep2321ktimersoftd/222:12:192
2036099190,17cyclictest681-21dbus-daemon22:57:533
2036099190,17cyclictest0-21swapper/323:09:113
2036099190,13cyclictest681-21dbus-daemon23:26:223
2036099190,13cyclictest681-21dbus-daemon23:26:223
121072190,0sleep50-21swapper/522:10:145
121072190,0sleep50-21swapper/522:10:145
77452180,1sleep07742-21sshd23:37:280
33242180,0sleep40-21swapper/419:40:134
306432180,0sleep70-21swapper/723:43:467
306432180,0sleep70-21swapper/723:43:457
20382991815,2cyclictest0-21swapper/621:30:196
20382991814,2cyclictest32389-21sshd22:38:076
2036099180,8cyclictest681-21dbus-daemon21:31:073
2036099180,1cyclictest0-21swapper/323:32:263
2036099180,1cyclictest0-21swapper/323:32:263
2036099180,1cyclictest0-21swapper/323:12:073
2036099180,1cyclictest0-21swapper/321:27:183
2036099180,17cyclictest6802-21packagekitd00:17:533
98792170,0sleep40-21swapper/421:48:174
87192170,1sleep40-21swapper/421:56:344
87192170,1sleep40-21swapper/421:56:344
294932170,0sleep40-21swapper/421:10:434
294442170,1sleep4491rcuc/422:44:434
269942170,1sleep526992-21sshd23:11:295
243912170,1sleep10-21swapper/121:37:171
20382991714,2cyclictest8914-21sshd22:52:016
20366991713,2cyclictest11191-21sshd22:01:434
18712170,0sleep60-21swapper/622:58:246
159322170,0sleep20-21swapper/223:10:552
142602170,1sleep50-21swapper/521:43:295
20382991612,2cyclictest0-21swapper/623:54:576
2038299161,13cyclictest0-21swapper/621:43:056
2037199160,14cyclictest0-21swapper/523:20:025
2037199160,14cyclictest0-21swapper/523:20:015
2036099160,1cyclictest0-21swapper/322:27:533
198432160,0sleep60-21swapper/622:14:006
198432160,0sleep60-21swapper/622:13:596
125242160,0sleep70-21swapper/722:13:377
125242160,0sleep70-21swapper/722:13:367
106222160,0sleep00-21swapper/021:33:140
50242150,0sleep20-21swapper/220:50:132
277932150,1sleep226502-21kworker/2:123:25:052
277932150,1sleep226502-21kworker/2:123:25:042
258402150,1sleep50-21swapper/523:53:365
239362150,0sleep60-21swapper/622:25:536
20388991513,1cyclictest0-21swapper/722:44:107
20388991511,2cyclictest0-21swapper/721:32:147
2038899150,2cyclictest681-21dbus-daemon00:07:127
2038899150,13cyclictest2845-21grepconf.sh23:35:307
2038899150,13cyclictest0-21swapper/722:25:287
2038299150,1cyclictest0-21swapper/623:35:446
20371991512,2cyclictest19428-21sshd00:16:525
20366991511,2cyclictest24862-21sshd23:45:094
2036699150,13cyclictest0-21swapper/422:48:514
2036099156,6cyclictest0-21swapper/322:17:263
2036099150,13cyclictest1146-21nfsd22:23:143
20353991513,1cyclictest681-21dbus-daemon23:22:252
20353991513,1cyclictest681-21dbus-daemon23:22:242
2034999150,2cyclictest0-21swapper/123:05:011
20342991511,2cyclictest17620-21sshd22:47:260
199672150,1sleep619959-21bash22:00:306
184782150,0sleep10-21swapper/122:44:081
176372150,0sleep5581rcuc/523:44:475
176372150,0sleep5581rcuc/523:44:475
158752150,0sleep70-21swapper/723:48:017
10262150,1sleep01028-21grepconf.sh21:47:500
90102140,0sleep10-21swapper/119:50:201
5402140,1sleep4538-21sshd00:02:254
305992140,1sleep630600-21sshd21:12:286
2038899140,1cyclictest0-21swapper/722:58:077
2038899140,12cyclictest0-21swapper/700:02:237
20382991412,1cyclictest29734-21kworker/6:323:10:256
20382991411,2cyclictest784-21rm23:20:156
20382991411,2cyclictest784-21rm23:20:156
2038299140,2cyclictest17062-21sshd22:42:216
2036699140,2cyclictest761-21systemd-logind23:28:074
2036699140,2cyclictest761-21systemd-logind23:28:064
2036699140,13cyclictest0-21swapper/400:12:274
2036099144,8cyclictest2310-21nscd23:04:153
2036099142,10cyclictest658-21polkitd22:32:123
2036099142,10cyclictest0-21swapper/322:41:133
2036099141,8cyclictest6804-21gdbus00:33:023
2036099141,12cyclictest24237-21sshd00:27:173
2036099140,10cyclictest0-21swapper/322:00:273
20353991412,1cyclictest80750irq/25-eno1-rx-22:54:462
2035399140,1cyclictest13305-21sshd23:32:432
2035399140,1cyclictest13305-21sshd23:32:422
2034999140,2cyclictest681-21dbus-daemon23:11:451
2034999140,1cyclictest0-21swapper/123:39:431
2034999140,13cyclictest0-21swapper/122:59:231
20342991411,1cyclictest0-21swapper/022:51:460
20342991410,2cyclictest20600-21bash23:53:210
2034299140,13cyclictest0-21swapper/023:01:110
2034299140,12cyclictest681-21dbus-daemon22:56:290
189262140,0sleep20-21swapper/223:09:252
315272130,0sleep10-21swapper/100:19:131
2038899130,1cyclictest0-21swapper/721:47:507
2038899130,12cyclictest4367-21sshd22:45:057
2038899130,12cyclictest0-21swapper/720:50:187
20382991311,1cyclictest23402-21bash23:16:216
20382991310,2cyclictest19279-21grepconf.sh21:53:496
2038299130,1cyclictest4290-21kworker/6:321:38:326
2038299130,1cyclictest0-21swapper/622:31:126
20371991311,1cyclictest0-21swapper/523:45:015
20371991311,1cyclictest0-21swapper/523:17:055
20371991310,2cyclictest0-21swapper/520:10:245
2037199130,12cyclictest0-21swapper/522:15:395
20366991311,1cyclictest25900-21sshd00:24:014
20366991311,1cyclictest0-21swapper/422:35:494
2036699130,1cyclictest4835-21sshd22:28:174
2036699130,12cyclictest0-21swapper/421:50:234
2036099134,7cyclictest681-21dbus-daemon21:16:593
2036099131,6cyclictest1059-21snmpd20:56:293
2036099130,11cyclictest6804-21gdbus23:15:593
2036099130,11cyclictest658-21polkitd00:06:123
2035399130,1cyclictest681-21dbus-daemon22:37:362
2035399130,1cyclictest0-21swapper/223:39:272
2035399130,12cyclictest0-21swapper/221:33:462
20349991311,1cyclictest3737-21bash23:33:561
20349991311,1cyclictest3737-21bash23:33:551
2034999130,1cyclictest959-21sshd21:17:391
2034999130,1cyclictest21015-21sshd23:48:181
2034999130,12cyclictest1051-21sshd23:25:201
2034999130,12cyclictest1051-21sshd23:25:191
2034999130,12cyclictest0-21swapper/123:40:391
2034999130,12cyclictest0-21swapper/123:40:381
2034999130,12cyclictest0-21swapper/123:01:151
2034999130,12cyclictest0-21swapper/100:31:431
2034299137,4cyclictest7-21ksoftirqd/000:34:350
20342991311,1cyclictest0-21swapper/021:19:500
2034299130,1cyclictest9536-21sshd22:01:390
2034299130,11cyclictest4329-21bash21:42:570
86112120,0sleep00-21swapper/022:40:140
65012120,1sleep16503-21sshd22:48:321
26422120,0sleep70-21swapper/719:40:007
2038899129,2cyclictest6633-21sshd22:36:457
20388991210,1cyclictest24675-21sshd21:42:197
20388991210,1cyclictest0-21swapper/700:30:197
2038899120,1cyclictest681-21dbus-daemon21:12:297
20382991210,1cyclictest69-21ksoftirqd/600:32:436
20382991210,1cyclictest681ktimersoftd/623:30:066
20382991210,1cyclictest681ktimersoftd/623:30:066
2038299120,3cyclictest101rcu_sched23:28:526
2038299120,3cyclictest101rcu_sched23:28:526
2038299120,11cyclictest28163-21kworker/6:323:48:446
2038299120,11cyclictest0-21swapper/621:18:056
2037199129,2cyclictest681-21dbus-daemon21:47:265
20371991210,1cyclictest7884-21sshd21:36:245
20371991210,1cyclictest0-21swapper/523:09:175
20371991210,1cyclictest0-21swapper/519:45:155
20371991210,1cyclictest0-21swapper/519:45:155
2037199120,1cyclictest20560-21sshd21:11:565
2037199120,1cyclictest0-21swapper/519:50:215
2037199120,1cyclictest0-21swapper/500:34:225
20366991210,1cyclictest15006-21sshd21:15:024
2036699120,1cyclictest0-21swapper/423:52:094
2036099120,11cyclictest0-21swapper/319:20:173
2035399129,2cyclictest0-21swapper/222:58:022
2035399127,3cyclictest0-21swapper/221:20:512
20353991210,1cyclictest14417-21tty21:11:362
2035399120,1cyclictest0-21swapper/200:06:262
2035399120,11cyclictest0-21swapper/221:40:132
20349991210,1cyclictest20462-21sshd22:19:041
20349991210,1cyclictest0-21swapper/121:30:401
20349991210,1cyclictest0-21swapper/121:23:251
20349991210,1cyclictest0-21swapper/100:37:291
2034999120,1cyclictest0-21swapper/121:27:031
2034299122,5cyclictest14321-21basename21:10:000
2034299121,10cyclictest30191-21kworker/0:000:05:190
20342991210,1cyclictest26271-21sshd22:37:490
20342991210,1cyclictest24150-21sshd21:25:290
20342991210,1cyclictest0-21swapper/023:32:060
20342991210,1cyclictest0-21swapper/023:32:050
20342991210,1cyclictest0-21swapper/023:14:370
2034299120,3cyclictest461-21systemd-journal21:24:310
2034299120,11cyclictest0-21swapper/021:51:170
2038899119,1cyclictest21093-21sshd22:54:227
2038899119,1cyclictest0-21swapper/723:22:047
2038899119,1cyclictest0-21swapper/723:22:037
2038899119,1cyclictest0-21swapper/700:35:107
2038899118,2cyclictest7536-21sshd22:04:577
2038899118,2cyclictest26608-21sshd21:57:317
2038899118,2cyclictest26608-21sshd21:57:317
2038899110,6cyclictest0-21swapper/720:20:147
2038299118,1cyclictest69-21ksoftirqd/622:45:156
2038299118,1cyclictest69-21ksoftirqd/600:08:036
2038299117,2cyclictest69-21ksoftirqd/623:00:126
2038299117,2cyclictest0-21swapper/621:00:126
2038299110,10cyclictest0-21swapper/619:24:146
2037199119,1cyclictest60-21ksoftirqd/522:59:515
2037199119,1cyclictest60-21ksoftirqd/521:26:305
2037199118,2cyclictest0-21swapper/523:31:365
2037199118,2cyclictest0-21swapper/523:31:355
2037199112,6cyclictest0-21swapper/523:04:195
2037199112,3cyclictest101rcu_sched21:33:335
2037199110,1cyclictest0-21swapper/522:45:365
2037199110,10cyclictest1051-21sshd22:00:535
2036699119,1cyclictest0-21swapper/423:35:464
2036699119,1cyclictest0-21swapper/423:24:134
2036699119,1cyclictest0-21swapper/423:24:124
2036699117,2cyclictest28592-21sshd21:30:464
2036099119,1cyclictest0-21swapper/319:30:223
2036099118,2cyclictest0-21swapper/319:10:123
2036099113,7cyclictest851-21df19:35:133
2036099113,7cyclictest1059-21snmpd20:35:293
2036099113,7cyclictest1059-21snmpd19:55:473
2036099113,7cyclictest1059-21snmpd19:47:053
2036099113,7cyclictest1059-21snmpd19:47:043
2036099113,7cyclictest1059-21snmpd19:41:193
2036099110,9cyclictest9988-21latency_hist19:55:003
2036099110,9cyclictest658-21polkitd21:09:593
2036099110,9cyclictest18265-21latency20:10:143
2036099110,9cyclictest16621-21grep20:05:253
2036099110,9cyclictest1090-21in:imjournal19:30:003
2036099110,9cyclictest0-21swapper/320:20:003
2036099110,5cyclictest1059-21snmpd20:34:263
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional