You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 19:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Wed Dec 31, 2025 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15789912074,25cyclictest57-21ksoftirqd/510:50:545
234452750,0sleep50-21swapper/510:46:095
140892730,1sleep449-21ksoftirqd/412:08:494
229482720,0sleep7721ktimersoftd/711:06:067
170412720,1sleep773-21ksoftirqd/709:58:467
1585997237,0cyclictest0-21swapper/610:50:536
156399650,65cyclictest9559-21kworker/3:010:50:543
195532630,1sleep319550-21systemd12:36:033
3130925127,8sleep00-21swapper/007:04:310
114125123,9sleep50-21swapper/507:05:565
33092500,1sleep125-21ksoftirqd/112:20:561
168402490,0sleep40-21swapper/410:48:574
157199480,47cyclictest7221-21kworker/u16:310:50:534
129824825,8sleep10-21swapper/107:08:011
83202470,0sleep10-21swapper/111:38:111
131724531,10sleep70-21swapper/707:08:157
55142440,0sleep30-21swapper/310:47:443
171592440,0sleep10-21swapper/109:38:461
75522430,0sleep47546-21sshd11:44:394
245722430,0sleep30-21swapper/312:23:143
1535994217,25cyclictest0-21swapper/010:50:540
244712410,0sleep40-21swapper/410:29:354
219792410,0sleep50-21swapper/511:39:355
1543994141,0cyclictest19265-21kworker/1:010:50:531
263182400,0sleep10-21swapper/110:26:191
189142400,0sleep40-21swapper/410:22:144
165512400,1sleep416535-21systemd09:58:434
123824029,8sleep30-21swapper/307:07:153
110224027,9sleep40-21swapper/407:05:314
108824027,9sleep20-21swapper/207:05:212
139323927,8sleep60-21swapper/607:09:186
1551993737,0cyclictest13550irq/24-ahci[00010:50:542
154162370,2sleep1154399cyclictest10:58:471
26322360,0sleep70-21swapper/710:17:127
22712360,0sleep50-21swapper/511:27:265
159399342,18cyclictest0-21swapper/710:50:547
168162210,0sleep40-21swapper/409:25:044
300162200,0sleep20-21swapper/211:03:362
32512180,4sleep50-21swapper/511:20:455
1585991812,2cyclictest23890-21systemd09:22:356
43862170,0sleep619643-21kworker/u16:211:14:216
158599171,1cyclictest0-21swapper/610:55:046
1535991715,1cyclictest6761-21kworker/0:311:15:200
1535991712,4cyclictest9-21ksoftirqd/010:17:520
1585991610,2cyclictest28233-21systemd12:20:076
1535991613,2cyclictest29371-21kworker/0:411:38:220
76882150,1sleep449-21ksoftirqd/410:11:014
43962150,0sleep40-21swapper/411:00:504
191932150,1sleep6158599cyclictest10:22:166
156399150,9cyclictest0-21swapper/309:58:273
1543991513,1cyclictest25-21ksoftirqd/110:36:561
1543991513,1cyclictest25-21ksoftirqd/110:36:561
1543991513,1cyclictest25-21ksoftirqd/109:40:381
1535991514,1cyclictest9-21ksoftirqd/010:06:380
1535991514,1cyclictest4929-21kworker/0:309:12:220
1535991513,1cyclictest9-21ksoftirqd/012:28:430
1535991513,1cyclictest9-21ksoftirqd/012:23:350
1535991513,1cyclictest9-21ksoftirqd/011:49:340
1535991513,1cyclictest9-21ksoftirqd/011:07:130
1535991513,1cyclictest9-21ksoftirqd/010:39:390
1535991510,2cyclictest31064-21kworker/0:410:21:200
149052150,0sleep30-21swapper/311:58:553
78412140,0sleep50-21swapper/507:19:335
48092140,0sleep10-21swapper/107:14:331
1543991412,1cyclictest25-21ksoftirqd/112:33:061
1543991412,1cyclictest25-21ksoftirqd/111:21:011
153599148,1cyclictest456-21kworker/0:411:48:150
1535991413,1cyclictest9-21ksoftirqd/012:17:020
1535991413,1cyclictest9-21ksoftirqd/012:17:020
1535991413,1cyclictest9-21ksoftirqd/009:34:380
1535991413,0cyclictest7221-21kworker/u16:311:03:220
1535991412,2cyclictest22478-21kworker/u16:111:12:460
1535991412,1cyclictest9-21ksoftirqd/009:59:360
1535991412,1cyclictest9-21ksoftirqd/009:56:370
1535991412,1cyclictest111rcuc/011:26:550
1535991412,0cyclictest7905-21kworker/u16:409:15:380
1535991411,1cyclictest9-21ksoftirqd/010:49:050
1535991411,1cyclictest23213-21kworker/0:209:49:520
1535991411,1cyclictest17601-21kworker/0:211:59:110
1535991411,1cyclictest1490-21kworker/u16:410:30:340
102852140,0sleep30-21swapper/310:28:053
71742130,0sleep40-21swapper/409:44:264
57142130,0sleep5561ktimersoftd/511:04:275
327112130,0sleep10-21swapper/111:54:051
1593991310,2cyclictest1-21systemd10:22:567
1578991312,1cyclictest57-21ksoftirqd/510:25:235
1578991311,1cyclictest57-21ksoftirqd/512:38:505
1578991311,1cyclictest57-21ksoftirqd/512:15:325
1578991311,1cyclictest57-21ksoftirqd/512:15:325
1551991312,1cyclictest33-21ksoftirqd/211:27:382
1543991312,1cyclictest25-21ksoftirqd/111:57:401
1543991312,1cyclictest25-21ksoftirqd/111:18:221
1543991312,1cyclictest25-21ksoftirqd/109:58:081
1543991311,1cyclictest25-21ksoftirqd/110:09:541
154399130,13cyclictest21862-21kworker/1:211:29:141
153599139,1cyclictest9-21ksoftirqd/010:55:200
153599138,1cyclictest9-21ksoftirqd/012:07:210
1535991312,1cyclictest9-21ksoftirqd/011:20:530
1535991312,1cyclictest9-21ksoftirqd/009:26:140
1535991312,1cyclictest9-21ksoftirqd/009:19:290
1535991311,2cyclictest9-21ksoftirqd/011:30:010
1535991311,2cyclictest5393-21kworker/0:010:25:520
1535991311,1cyclictest9-21ksoftirqd/012:11:580
1535991311,1cyclictest9-21ksoftirqd/012:00:420
1535991311,1cyclictest9-21ksoftirqd/009:46:110
1535991311,1cyclictest9-21ksoftirqd/009:40:260
1535991311,1cyclictest9-21ksoftirqd/009:32:580
1535991310,1cyclictest29091-21kworker/0:107:52:140
143442130,0sleep60-21swapper/611:15:106
130382130,0sleep70-21swapper/710:11:367
281902120,0sleep7711rcuc/709:26:197
264522120,2sleep3401ktimersoftd/311:03:133
230902120,0sleep10-21swapper/112:03:021
159399122,4cyclictest16175-21sshd10:45:227
159399122,4cyclictest0-21swapper/709:36:547
1593991210,1cyclictest25580-21systemd12:09:497
158599125,6cyclictest14750-21systemd-cgroups10:05:016
158599122,4cyclictest4698-21sshd11:37:476
158599122,4cyclictest29556-21systemd-cgroups10:29:566
158599122,4cyclictest0-21swapper/610:45:186
158599121,5cyclictest31316-21bash11:53:566
158599120,11cyclictest29607-21kworker/6:111:28:226
1578991211,1cyclictest57-21ksoftirqd/512:29:205
1578991211,1cyclictest57-21ksoftirqd/510:56:075
1578991210,1cyclictest57-21ksoftirqd/512:32:155
1578991210,1cyclictest57-21ksoftirqd/512:06:445
1578991210,1cyclictest57-21ksoftirqd/511:53:545
1578991210,1cyclictest57-21ksoftirqd/511:18:165
157199123,4cyclictest1951-21sshd11:27:244
157199122,5cyclictest0-21swapper/411:11:304
157199122,4cyclictest686-21dbus-daemon11:38:514
157199122,4cyclictest18110-21sshd12:19:184
157199122,4cyclictest18110-21sshd12:19:184
157199122,4cyclictest0-21swapper/411:39:294
157199121,5cyclictest686-21dbus-daemon09:09:314
156399120,2cyclictest3134-21bash09:30:273
156399120,1cyclictest24967-21systemd-cgroups11:13:063
155199123,6cyclictest1-21systemd10:34:412
155199123,6cyclictest1-21systemd10:34:412
1551991210,1cyclictest33-21ksoftirqd/211:04:262
1543991211,1cyclictest25-21ksoftirqd/112:16:251
1543991211,1cyclictest25-21ksoftirqd/112:16:251
1543991211,1cyclictest25-21ksoftirqd/112:08:221
1543991210,1cyclictest25-21ksoftirqd/111:10:261
154399120,2cyclictest1510-21systemd10:03:511
153599129,2cyclictest492-21systemd-journal12:30:270
153599129,2cyclictest23780-21bash10:12:460
153599127,3cyclictest15-21kswork11:39:530
1535991210,1cyclictest9-21ksoftirqd/012:38:110
1535991210,1cyclictest9-21ksoftirqd/010:35:520
1535991210,1cyclictest9-21ksoftirqd/010:35:520
1535991210,0cyclictest29091-21kworker/0:108:06:400
128122120,0sleep70-21swapper/712:35:197
100732120,0sleep50-21swapper/512:21:405
83552110,0sleep40-21swapper/410:17:494
294972110,1sleep429500-21kworker/u16:210:36:474
294972110,1sleep429500-21kworker/u16:210:36:474
286132110,0sleep30-21swapper/309:49:453
159399119,1cyclictest5130-21systemd-cgroups11:24:257
159399119,1cyclictest1729-21sshd10:57:187
159399113,4cyclictest686-21dbus-daemon11:36:547
159399110,2cyclictest32429-21systemd11:10:237
158599119,1cyclictest0-21swapper/612:09:226
158599113,7cyclictest885-21polkitd09:16:556
158599113,7cyclictest686-21dbus-daemon11:41:116
1585991110,1cyclictest65-21ksoftirqd/611:05:376
158599111,4cyclictest885-21polkitd09:44:046
158599111,4cyclictest686-21dbus-daemon09:53:076
158599111,4cyclictest23597-21systemd-cgroups11:56:216
158599111,4cyclictest22395-21sshd12:36:226
158599111,4cyclictest19700-21systemd-cgroups11:02:296
158599111,4cyclictest0-21swapper/610:14:136
158599110,11cyclictest20057-21kworker/6:211:49:166
158599110,11cyclictest20057-21kworker/6:211:24:036
158599110,11cyclictest17522-21kworker/6:409:49:216
158599110,11cyclictest17522-21kworker/6:409:30:576
157899119,1cyclictest57-21ksoftirqd/511:45:305
157899119,1cyclictest57-21ksoftirqd/511:10:285
157899115,3cyclictest686-21dbus-daemon09:44:555
1578991110,1cyclictest57-21ksoftirqd/512:00:445
1578991110,1cyclictest57-21ksoftirqd/510:40:175
1578991110,1cyclictest57-21ksoftirqd/510:37:085
1578991110,1cyclictest57-21ksoftirqd/510:37:085
157899110,11cyclictest14798-21kworker/5:411:59:025
157199119,1cyclictest49-21ksoftirqd/409:38:284
157199113,2cyclictest691-21systemd-logind10:00:314
157199112,4cyclictest0-21swapper/412:28:514
1571991110,1cyclictest49-21ksoftirqd/411:56:564
1571991110,1cyclictest49-21ksoftirqd/410:40:374
157199111,4cyclictest686-21dbus-daemon09:43:494
157199111,4cyclictest686-21dbus-daemon09:33:054
157199111,4cyclictest13904-21systemd11:32:004
157199111,4cyclictest0-21swapper/411:59:264
157199111,4cyclictest0-21swapper/409:51:304
157199110,5cyclictest1-21systemd09:14:454
157199110,10cyclictest28200-21kworker/4:211:49:414
156399119,1cyclictest41-21ksoftirqd/308:39:223
156399115,2cyclictest1-21systemd10:11:433
156399114,4cyclictest27224-21sshd09:43:083
156399113,4cyclictest1-21systemd12:16:163
156399113,4cyclictest1-21systemd12:16:163
156399112,5cyclictest686-21dbus-daemon10:34:173
156399112,5cyclictest24523-21sshd09:59:323
1563991110,1cyclictest41-21ksoftirqd/312:11:093
156399110,1cyclictest686-21dbus-daemon11:05:403
156399110,1cyclictest0-21swapper/311:49:583
156399110,0cyclictest0-21swapper/308:54:383
155199119,2cyclictest33-21ksoftirqd/210:44:232
155199118,2cyclictest8516-21systemd10:54:392
155199118,2cyclictest33-21ksoftirqd/212:15:242
155199118,2cyclictest33-21ksoftirqd/212:15:242
155199113,3cyclictest1-21systemd10:18:352
155199112,7cyclictest31168-21systemd-cgroups11:30:192
155199112,6cyclictest0-21swapper/211:49:582
155199112,5cyclictest686-21dbus-daemon11:39:502
155199112,4cyclictest885-21polkitd12:20:512
155199112,3cyclictest686-21dbus-daemon11:48:562
155199112,2cyclictest32050-21systemd-cgroups12:34:092
1551991110,1cyclictest8383-21kworker/2:111:15:172
155199111,4cyclictest1-21systemd10:32:152
155199110,3cyclictest686-21dbus-daemon11:35:462
155199110,3cyclictest1-21systemd10:20:052
155199110,10cyclictest32166-21systemd-cgroups09:43:402
154399119,1cyclictest25-21ksoftirqd/111:03:021
154399119,1cyclictest25-21ksoftirqd/109:28:161
154399119,1cyclictest25-21ksoftirqd/109:13:531
154399117,4cyclictest25-21ksoftirqd/110:30:251
1543991110,1cyclictest25-21ksoftirqd/110:22:321
1543991110,1cyclictest25-21ksoftirqd/109:47:171
1543991110,1cyclictest0-21swapper/111:45:451
154399110,11cyclictest16340-21kworker/1:210:42:231
154399110,10cyclictest686-21dbus-daemon09:29:541
195002100,1sleep5561ktimersoftd/510:09:015
159399109,1cyclictest0-21swapper/712:04:477
159399109,1cyclictest0-21swapper/710:42:197
159399107,2cyclictest30338-21systemd10:30:027
159399104,3cyclictest691-21systemd-logind12:16:367
159399104,3cyclictest691-21systemd-logind12:16:367
159399103,6cyclictest885-21polkitd09:19:577
159399103,6cyclictest686-21dbus-daemon09:14:247
159399103,6cyclictest27611-21sshd11:19:527
159399103,5cyclictest691-21systemd-logind10:26:577
159399103,1cyclictest8022-21sshd11:31:207
159399100,10cyclictest535-21kworker/7:210:39:167
159399100,10cyclictest535-21kworker/7:210:39:167
159399100,10cyclictest24979-21kworker/7:312:31:117
158599108,1cyclictest65-21ksoftirqd/612:29:446
158599103,6cyclictest13696-21sshd12:05:166
158599102,2cyclictest2908-21systemd10:40:416
158599101,4cyclictest25873-21timerwakeupswit11:29:456
158599100,4cyclictest16211-21systemd-cgroups12:19:066
158599100,4cyclictest16211-21systemd-cgroups12:19:066
158599100,10cyclictest5831-21kworker/6:009:26:096
158599100,10cyclictest24261-21kworker/6:209:55:066
158599100,10cyclictest10469-21kworker/6:012:25:476
157899109,1cyclictest57-21ksoftirqd/510:29:375
157899109,1cyclictest57-21ksoftirqd/510:18:135
157899109,1cyclictest57-21ksoftirqd/510:10:515
157899109,1cyclictest0-21swapper/509:41:245
157899108,1cyclictest57-21ksoftirqd/509:21:005
157899108,1cyclictest57-21ksoftirqd/509:16:235
157899107,3cyclictest57-21ksoftirqd/511:36:265
157899107,3cyclictest57-21ksoftirqd/511:30:285
157899104,3cyclictest17684-21sshd09:38:495
157899102,8cyclictest0-21swapper/509:57:155
157899100,10cyclictest0-21swapper/509:29:545
157899100,1cyclictest0-21swapper/509:24:425
157199108,1cyclictest49-21ksoftirqd/410:56:354
157199100,4cyclictest29101-21sshd12:20:134
157199100,4cyclictest19765-21sshd09:22:054
157199100,10cyclictest8132-21kworker/4:312:31:304
157199100,10cyclictest5156-21kworker/4:311:20:414
157199100,10cyclictest371-21kworker/4:310:04:314
157199100,10cyclictest0-21swapper/412:11:314
156399109,1cyclictest0-21swapper/311:35:193
156399108,1cyclictest686-21dbus-daemon10:06:433
156399108,1cyclictest41-21ksoftirqd/310:57:123
156399104,4cyclictest686-21dbus-daemon10:44:213
156399103,4cyclictest844-21sshd09:37:013
156399103,4cyclictest763-21NetworkManager12:30:533
156399103,3cyclictest10584-21sshd09:14:263
156399102,4cyclictest15955-21bash11:18:523
156399100,9cyclictest24978-21kworker/3:311:45:193
156399100,1cyclictest31160-21systemd09:23:213
155199109,1cyclictest33-21ksoftirqd/212:36:062
155199108,2cyclictest33-21ksoftirqd/209:53:462
155199105,2cyclictest15558-21systemd09:48:362
155199104,3cyclictest691-21systemd-logind10:10:472
155199104,3cyclictest29204-21munin-run08:54:222
155199103,4cyclictest686-21dbus-daemon10:43:042
155199102,5cyclictest566-21sd-pam11:57:232
155199102,5cyclictest2203-21grepconf.sh11:24:082
155199102,5cyclictest10490-21systemd-cgroups11:11:322
155199102,5cyclictest1-21systemd09:37:162
1551991010,0cyclictest25894-1kworker/2:2H10:00:302
155199101,6cyclictest0-21swapper/212:24:272
155199101,3cyclictest31916-21systemd-cgroups09:16:332
155199100,3cyclictest0-21swapper/212:06:032
155199100,10cyclictest0-21swapper/209:54:232
155199100,10cyclictest0-21swapper/209:28:232
155199100,1cyclictest0-21swapper/210:06:512
154399109,1cyclictest25-21ksoftirqd/111:34:191
154399109,1cyclictest25-21ksoftirqd/110:15:341
154399109,1cyclictest25-21ksoftirqd/109:20:491
154399108,1cyclictest25-21ksoftirqd/109:52:241
1543991010,0cyclictest13136-21systemd-cgroups09:18:021
154399100,10cyclictest0-21swapper/112:12:331
154399100,10cyclictest0-21swapper/110:04:231
153599109,1cyclictest9-21ksoftirqd/008:19:400
153599108,1cyclictest29091-21kworker/0:108:34:220
15939999,0cyclictest0-21swapper/711:18:357
15939997,1cyclictest73-21ksoftirqd/711:00:377
15939996,3cyclictest73-21ksoftirqd/709:59:247
15939993,6cyclictest0-21swapper/709:45:137
15939993,1cyclictest0-21swapper/709:41:547
15939992,6cyclictest691-21systemd-logind11:49:007
15939992,3cyclictest691-21systemd-logind12:20:107
15939990,9cyclictest0-21swapper/712:29:137
15939990,4cyclictest5896-21systemd11:41:107
15939990,4cyclictest28831-21id11:56:567
15939990,0cyclictest0-21swapper/710:07:107
15939990,0cyclictest0-21swapper/709:29:487
15859996,2cyclictest16141-21sshd10:15:116
15859993,6cyclictest0-21swapper/612:02:336
15859993,6cyclictest0-21swapper/610:24:446
15859990,9cyclictest17522-21kworker/6:409:37:046
15859990,8cyclictest8312-21kworker/6:009:59:336
15859990,4cyclictest12447-21systemd-cgroups09:10:056
15859990,4cyclictest0-21swapper/610:36:016
15859990,4cyclictest0-21swapper/610:36:016
15789999,0cyclictest0-21swapper/509:10:115
15789998,1cyclictest57-21ksoftirqd/510:20:405
15789997,1cyclictest57-21ksoftirqd/512:11:005
15789992,2cyclictest0-21swapper/510:00:075
15789991,7cyclictest686-21dbus-daemon11:00:055
15789990,9cyclictest0-21swapper/508:39:435
15789990,0cyclictest0-21swapper/509:51:015
15719999,0cyclictest0-21swapper/411:17:364
15719997,1cyclictest49-21ksoftirqd/410:29:044
15719990,4cyclictest0-21swapper/411:04:364
15639999,0cyclictest0-21swapper/310:37:183
15639999,0cyclictest0-21swapper/310:37:183
15639998,1cyclictest41-21ksoftirqd/311:30:173
15639997,1cyclictest41-21ksoftirqd/312:24:353
15639994,1cyclictest13826-21systemd-cgroups09:48:253
15639993,3cyclictest26877-21sshd09:12:253
15639993,3cyclictest15337-21systemd11:25:183
15639993,3cyclictest1129-21bash09:26:563
15639992,4cyclictest12982-21sshd12:05:113
15639990,8cyclictest5003-21kworker/3:110:16:163
15639990,8cyclictest20494-21kworker/3:510:23:373
15519998,1cyclictest33-21ksoftirqd/209:29:222
15519998,1cyclictest33-21ksoftirqd/209:19:392
15519992,4cyclictest14155-21systemd10:24:592
15519992,3cyclictest691-21systemd-logind12:00:022
15519991,3cyclictest0-21swapper/209:09:292
15519990,3cyclictest0-21swapper/212:09:372
15439998,1cyclictest25-21ksoftirqd/110:46:481
15439997,1cyclictest25-21ksoftirqd/111:06:221
15439994,2cyclictest4020-21systemd-cgroups12:24:301
15439990,9cyclictest0-21swapper/111:40:451
15439990,9cyclictest0-21swapper/108:39:431
15439990,8cyclictest9063-21kworker/1:012:35:251
15439990,0cyclictest0-21swapper/108:19:331
15939986,1cyclictest73-21ksoftirqd/709:49:287
15939983,2cyclictest0-21swapper/708:18:217
15939983,0cyclictest0-21swapper/707:42:057
15939982,3cyclictest691-21systemd-logind11:59:347
15939982,3cyclictest28721-21sshd09:12:437
15939980,7cyclictest16110-21kworker/7:011:51:027
15789988,0cyclictest0-21swapper/508:53:195
15719980,8cyclictest12394-21kworker/4:212:34:384
15639985,2cyclictest666-21grep11:40:373
15639983,4cyclictest686-21dbus-daemon11:59:283
15639980,8cyclictest2572-21kworker/3:211:20:163
15439980,0cyclictest0-21swapper/108:49:391
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional