You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-09 - 19:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Mon Mar 09, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
220622980,0sleep40-21swapper/411:04:414
114592940,0sleep40-21swapper/411:13:064
100252800,1sleep21427099cyclictest12:13:192
41722680,1sleep44167-21sshd11:31:004
178252620,0sleep20-21swapper/210:31:392
225802510,0sleep422577-21sshd12:08:334
78342500,0sleep00-21swapper/011:20:150
186952500,0sleep418587-21cstates11:17:154
33542490,1sleep53348-21bash10:14:205
242442490,1sleep124246-21bash11:21:121
287772480,0sleep60-21swapper/609:09:506
298962470,0sleep10-21swapper/110:14:001
278762470,0sleep60-21swapper/611:30:306
323192460,0sleep70-21swapper/712:11:007
165812460,0sleep50-21swapper/512:02:415
193122450,0sleep319313-21sshd10:00:333
193122450,0sleep319313-21sshd10:00:333
29952440,0sleep50-21swapper/512:36:455
262392440,0sleep70-21swapper/711:57:467
145572440,0sleep70-21swapper/711:09:417
141952440,0sleep5686-21dbus-daemon10:35:035
102852440,0sleep50-21swapper/510:09:085
81092430,1sleep08081-21cp09:37:550
57502430,1sleep25741-21systemd09:57:512
57502430,1sleep25741-21systemd09:57:512
1410924330,9sleep30-21swapper/307:06:493
36602420,1sleep13655-21systemd-cgroups10:47:161
268772420,0sleep50-21swapper/512:30:445
251592420,0sleep725157-21bash12:17:497
141452420,0sleep714139-21sshd11:33:197
1388524229,9sleep60-21swapper/607:03:476
1379224229,9sleep70-21swapper/707:02:287
272822410,0sleep70-21swapper/712:25:187
264642410,0sleep20-21swapper/211:43:082
256272410,0sleep10-21swapper/112:19:431
232552410,0sleep40-21swapper/409:20:374
163212410,0sleep7721ktimersoftd/707:07:247
5692400,1sleep2571-21grepconf.sh12:18:162
289682400,0sleep20-21swapper/211:28:422
271392400,0sleep40-21swapper/410:48:314
268302400,0sleep60-21swapper/610:15:416
218982400,0sleep40-21swapper/412:17:384
1405524029,8sleep00-21swapper/007:06:050
1389824028,9sleep10-21swapper/107:03:581
1385724027,9sleep50-21swapper/507:03:225
128642400,1sleep012865-21grepconf.sh12:02:280
103962400,0sleep20-21swapper/208:52:162
1384123927,8sleep20-21swapper/207:03:112
1330923925,9sleep40-21swapper/407:02:254
188702380,0sleep50-21swapper/509:29:275
10042380,0sleep60-21swapper/609:17:276
280382370,0sleep30-21swapper/312:36:193
310272360,2sleep31427699cyclictest10:54:153
303782340,2sleep71428999cyclictest11:27:037
1426299267,1cyclictest121rcu_preempt10:34:340
1427099257,1cyclictest33-21ksoftirqd/209:35:382
1427099249,1cyclictest33-21ksoftirqd/212:00:422
14270992416,4cyclictest33-21ksoftirqd/209:46:222
14289992310,2cyclictest73-21ksoftirqd/710:06:587
1427099238,1cyclictest33-21ksoftirqd/211:00:332
1428999228,1cyclictest73-21ksoftirqd/710:54:077
1428999227,3cyclictest73-21ksoftirqd/710:31:527
1428999225,2cyclictest73-21ksoftirqd/711:47:227
1428999224,3cyclictest73-21ksoftirqd/712:28:227
14262992212,1cyclictest121rcu_preempt10:11:010
1428999216,1cyclictest73-21ksoftirqd/712:05:387
14289992112,1cyclictest73-21ksoftirqd/709:32:387
1428999211,3cyclictest73-21ksoftirqd/710:45:517
1428999211,3cyclictest73-21ksoftirqd/710:45:517
14270992117,1cyclictest33-21ksoftirqd/210:02:542
14262992115,2cyclictest9-21ksoftirqd/011:51:580
14262992113,5cyclictest9-21ksoftirqd/012:07:240
1428999209,3cyclictest73-21ksoftirqd/711:55:517
1428999209,3cyclictest73-21ksoftirqd/709:39:397
1428999209,1cyclictest73-21ksoftirqd/710:00:267
1428999209,1cyclictest73-21ksoftirqd/710:00:267
1428999207,3cyclictest73-21ksoftirqd/712:12:187
1428999207,3cyclictest73-21ksoftirqd/709:23:157
1428999207,3cyclictest73-21ksoftirqd/709:16:357
1428999207,3cyclictest73-21ksoftirqd/709:07:407
1428999206,3cyclictest73-21ksoftirqd/709:18:417
14289992012,3cyclictest73-21ksoftirqd/710:51:297
1428999201,3cyclictest73-21ksoftirqd/711:12:257
1428999201,3cyclictest73-21ksoftirqd/710:37:067
1427099208,3cyclictest33-21ksoftirqd/211:48:122
1427099208,1cyclictest33-21ksoftirqd/210:20:182
1427099207,2cyclictest33-21ksoftirqd/209:22:252
1427099204,2cyclictest33-21ksoftirqd/209:53:522
14270992013,4cyclictest33-21ksoftirqd/211:16:182
14262992017,3cyclictest9-21ksoftirqd/010:05:280
14262992016,3cyclictest9-21ksoftirqd/011:33:320
14262992016,3cyclictest9-21ksoftirqd/010:13:210
14262992012,4cyclictest492-21systemd-journal09:23:120
14262992010,1cyclictest9-21ksoftirqd/011:30:020
134912200,0sleep30-21swapper/311:11:293
1428999199,1cyclictest73-21ksoftirqd/709:43:037
1428999198,3cyclictest73-21ksoftirqd/711:44:107
1428999198,1cyclictest73-21ksoftirqd/710:18:487
1428999198,1cyclictest73-21ksoftirqd/709:53:497
14289991910,3cyclictest73-21ksoftirqd/711:40:497
1428999191,2cyclictest73-21ksoftirqd/711:29:167
1427099199,2cyclictest33-21ksoftirqd/210:25:322
1427099199,1cyclictest33-21ksoftirqd/211:08:362
14270991913,4cyclictest33-21ksoftirqd/210:55:532
14262991918,1cyclictest9-21ksoftirqd/010:49:180
14262991916,2cyclictest9-21ksoftirqd/011:53:520
14262991915,3cyclictest9-21ksoftirqd/012:13:580
14262991915,1cyclictest9-21ksoftirqd/009:57:190
14262991915,1cyclictest9-21ksoftirqd/009:57:190
14262991913,2cyclictest9-21ksoftirqd/011:37:390
14262991912,4cyclictest9-21ksoftirqd/012:29:290
295152180,0sleep50-21swapper/509:17:185
1428999188,4cyclictest73-21ksoftirqd/711:04:007
1428999187,3cyclictest73-21ksoftirqd/711:19:167
1428999187,3cyclictest73-21ksoftirqd/710:13:437
1428999187,2cyclictest73-21ksoftirqd/709:49:307
1428999186,3cyclictest73-21ksoftirqd/710:25:297
1428999186,1cyclictest73-21ksoftirqd/710:09:147
1428999180,4cyclictest0-21swapper/710:32:317
14285991812,5cyclictest13414-21systemd09:45:335
1427099189,1cyclictest33-21ksoftirqd/209:51:442
1427099188,2cyclictest33-21ksoftirqd/212:09:482
1427099184,2cyclictest33-21ksoftirqd/210:32:082
14270991815,2cyclictest33-21ksoftirqd/209:17:172
14270991815,1cyclictest33-21ksoftirqd/210:16:492
14270991814,1cyclictest33-21ksoftirqd/210:39:162
1427099180,17cyclictest16175-21kworker/2:512:25:022
1427099180,1cyclictest0-21swapper/211:52:312
14262991816,1cyclictest9-21ksoftirqd/010:41:040
14262991816,1cyclictest9-21ksoftirqd/009:31:430
14262991816,1cyclictest9-21ksoftirqd/009:17:170
14262991815,2cyclictest9-21ksoftirqd/009:46:070
14262991815,1cyclictest9-21ksoftirqd/011:24:570
14262991814,3cyclictest9-21ksoftirqd/010:54:110
14262991813,2cyclictest9-21ksoftirqd/010:18:250
14262991812,2cyclictest9-21ksoftirqd/011:13:320
14262991811,3cyclictest9-21ksoftirqd/011:57:050
78712170,1sleep67856-21bash10:10:536
44642170,0sleep50-21swapper/511:18:125
295462170,1sleep429540-21bash10:46:554
295462170,1sleep429540-21bash10:46:554
221442170,0sleep40-21swapper/410:17:164
1428999176,3cyclictest73-21ksoftirqd/712:34:107
1428999171,1cyclictest24484-21systemd-cgroups10:57:297
1428999170,3cyclictest0-21swapper/709:28:227
14285991712,1cyclictest32647-21systemd10:03:035
14278991712,4cyclictest691-21systemd-logind09:36:304
1427099176,3cyclictest33-21ksoftirqd/211:22:482
1427099172,1cyclictest33-21ksoftirqd/210:47:302
14270991716,1cyclictest33-21ksoftirqd/211:19:122
14270991716,1cyclictest33-21ksoftirqd/211:02:382
14270991715,1cyclictest33-21ksoftirqd/211:32:372
14270991715,1cyclictest33-21ksoftirqd/209:31:432
14270991714,3cyclictest33-21ksoftirqd/212:34:332
14270991714,1cyclictest33-21ksoftirqd/209:15:262
14270991713,4cyclictest33-21ksoftirqd/212:05:242
14270991710,3cyclictest33-21ksoftirqd/212:31:502
1427099171,1cyclictest121rcu_preempt09:37:172
14267991715,1cyclictest25-21ksoftirqd/109:48:141
14262991715,2cyclictest666-21kworker/0:108:48:160
14262991715,1cyclictest9-21ksoftirqd/011:09:530
14262991715,1cyclictest9-21ksoftirqd/010:42:360
14262991715,1cyclictest9-21ksoftirqd/010:42:360
14262991715,1cyclictest9-21ksoftirqd/009:48:520
14262991715,1cyclictest9-21ksoftirqd/009:13:580
14262991715,0cyclictest30817-21kworker/u16:312:25:560
14262991714,1cyclictest9-21ksoftirqd/010:22:190
14262991712,3cyclictest9-21ksoftirqd/010:58:020
1426299171,1cyclictest9-21ksoftirqd/012:32:150
1426299170,1cyclictest121rcu_preempt10:27:210
26362160,0sleep40-21swapper/409:52:174
255082160,1sleep625505-21bash11:15:486
14285991612,3cyclictest57-21ksoftirqd/510:28:235
14285991611,1cyclictest1-21systemd09:09:255
14270991614,1cyclictest33-21ksoftirqd/210:44:062
14270991614,1cyclictest33-21ksoftirqd/210:44:062
14270991614,1cyclictest33-21ksoftirqd/210:07:092
14270991614,1cyclictest33-21ksoftirqd/209:11:272
14270991613,1cyclictest33-21ksoftirqd/211:37:182
1426299165,1cyclictest121rcu_preempt09:11:560
14262991614,1cyclictest9-21ksoftirqd/011:43:490
14262991614,1cyclictest9-21ksoftirqd/011:02:590
14262991614,1cyclictest9-21ksoftirqd/009:32:130
14262991612,1cyclictest9-21ksoftirqd/012:17:360
47302150,0sleep60-21swapper/611:23:416
274282150,0sleep327430-21systemd-cgroups11:56:063
144922150,0sleep60-21swapper/609:25:366
14286991513,1cyclictest65-21ksoftirqd/612:15:066
1428599154,2cyclictest88050irq/26-em1-tx-011:53:555
14285991514,1cyclictest57-21ksoftirqd/511:14:215
14285991511,1cyclictest1016-21systemd09:26:415
14262991513,2cyclictest18183-21kworker/0:207:29:200
14262991513,2cyclictest18183-21kworker/0:207:26:580
14262991513,2cyclictest18183-21kworker/0:207:26:580
14262991513,1cyclictest9-21ksoftirqd/009:54:530
322472140,0sleep60-21swapper/611:41:436
309642140,0sleep4481ktimersoftd/411:50:464
220652140,0sleep60-21swapper/610:19:026
14286991413,1cyclictest65-21ksoftirqd/609:56:236
14286991413,1cyclictest65-21ksoftirqd/609:43:406
14286991412,1cyclictest65-21ksoftirqd/611:36:406
14285991412,1cyclictest57-21ksoftirqd/512:26:295
14285991412,1cyclictest57-21ksoftirqd/512:07:365
14285991411,2cyclictest57-21ksoftirqd/510:17:245
14278991413,1cyclictest49-21ksoftirqd/411:57:424
14278991412,1cyclictest49-21ksoftirqd/411:35:084
14278991412,1cyclictest49-21ksoftirqd/411:09:324
14267991413,1cyclictest0-21swapper/110:09:381
14267991412,1cyclictest25-21ksoftirqd/111:47:531
14262991413,0cyclictest666-21kworker/0:108:54:020
14262991411,3cyclictest18183-21kworker/0:208:07:460
14262991411,1cyclictest18183-21kworker/0:208:21:120
316042130,1sleep331601-21sshd11:16:093
14286991311,1cyclictest65-21ksoftirqd/611:17:146
14286991311,1cyclictest65-21ksoftirqd/610:42:216
14286991311,1cyclictest65-21ksoftirqd/610:42:216
1428599132,5cyclictest891-21grepconf.sh10:54:235
14285991312,1cyclictest57-21ksoftirqd/511:42:485
14285991312,1cyclictest57-21ksoftirqd/511:35:395
14285991311,1cyclictest57-21ksoftirqd/510:37:405
14278991312,1cyclictest49-21ksoftirqd/409:47:174
14278991311,1cyclictest691-21systemd-logind10:56:024
14278991311,1cyclictest49-21ksoftirqd/409:45:194
14278991311,1cyclictest49-21ksoftirqd/409:08:064
1427699132,5cyclictest686-21dbus-daemon09:23:123
14276991311,1cyclictest41-21ksoftirqd/310:32:513
14276991311,1cyclictest41-21ksoftirqd/309:34:283
14276991310,2cyclictest12841-21systemd09:41:563
1427699130,13cyclictest11268-21kworker/3:510:17:053
14267991310,1cyclictest25-21ksoftirqd/109:38:141
1426799130,2cyclictest15986-21bash12:35:371
14262991312,0cyclictest666-21kworker/0:109:06:180
14262991311,2cyclictest666-21kworker/0:108:44:080
14262991311,1cyclictest18183-21kworker/0:208:29:100
14262991311,1cyclictest18183-21kworker/0:208:29:100
14262991311,1cyclictest18183-21kworker/0:207:52:140
14262991310,3cyclictest18183-21kworker/0:207:19:200
14262991310,3cyclictest18183-21kworker/0:207:19:200
257392120,0sleep60-21swapper/612:06:586
1428999124,1cyclictest73-21ksoftirqd/708:51:587
1428999124,1cyclictest73-21ksoftirqd/707:27:157
1428699124,5cyclictest686-21dbus-daemon10:38:366
1428699122,3cyclictest691-21systemd-logind09:39:156
14286991210,1cyclictest65-21ksoftirqd/610:57:216
14286991210,1cyclictest65-21ksoftirqd/610:56:276
1428599123,4cyclictest28943-21kworker/5:109:56:335
14285991210,1cyclictest9740-21sshd11:07:315
14285991210,1cyclictest57-21ksoftirqd/511:47:105
14285991210,1cyclictest57-21ksoftirqd/511:03:385
1428599121,4cyclictest4409-21bash10:58:125
1427899129,2cyclictest49-21ksoftirqd/410:32:084
1427899124,4cyclictest686-21dbus-daemon09:31:074
14278991211,1cyclictest49-21ksoftirqd/412:28:144
14278991211,1cyclictest49-21ksoftirqd/409:57:594
14278991211,1cyclictest49-21ksoftirqd/409:57:594
14278991211,1cyclictest49-21ksoftirqd/409:23:024
14278991210,1cyclictest49-21ksoftirqd/412:13:374
14278991210,1cyclictest49-21ksoftirqd/410:25:234
14278991210,1cyclictest49-21ksoftirqd/409:40:544
14278991210,1cyclictest15-21kswork10:15:194
1427899120,11cyclictest30181-21kworker/4:310:05:554
1427899120,11cyclictest1930-21sshd10:10:334
1427699129,2cyclictest686-21dbus-daemon10:06:033
1427699122,4cyclictest9947-21sshd09:19:513
1427699122,4cyclictest9530-21sshd10:16:343
1427699122,4cyclictest885-21polkitd10:57:053
1427699122,4cyclictest1-21systemd11:57:503
1427699122,4cyclictest1-21systemd09:07:263
14276991210,1cyclictest41-21ksoftirqd/311:22:233
1427699121,5cyclictest8283-21systemd09:12:253
1427699121,5cyclictest6093-21systemd12:20:273
1427699121,5cyclictest1-21systemd10:42:423
1427699121,5cyclictest1-21systemd10:42:423
1427699120,11cyclictest0-21swapper/312:23:313
1427699120,1cyclictest0-21swapper/311:45:223
1427699120,1cyclictest0-21swapper/309:55:553
1426799122,4cyclictest4581-21sshd12:29:271
1426799122,4cyclictest15015-21sshd10:33:131
1426799122,4cyclictest12554-21sshd09:32:401
1426799122,4cyclictest1-21systemd09:13:251
1426799120,2cyclictest21925-21grepconf.sh12:04:521
1426799120,11cyclictest686-21dbus-daemon11:12:041
14262991210,2cyclictest666-21kworker/0:108:57:580
14262991210,2cyclictest666-21kworker/0:108:40:340
14262991210,2cyclictest18183-21kworker/0:208:15:200
14262991210,2cyclictest18183-21kworker/0:208:02:560
14262991210,1cyclictest9-21ksoftirqd/008:02:040
14262991210,0cyclictest18183-21kworker/0:207:13:020
23992110,0sleep10-21swapper/110:21:371
1428999114,1cyclictest73-21ksoftirqd/707:22:327
1428999114,1cyclictest73-21ksoftirqd/707:22:327
1428699119,1cyclictest65-21ksoftirqd/612:18:216
1428699119,1cyclictest65-21ksoftirqd/611:42:256
1428699119,1cyclictest65-21ksoftirqd/611:10:256
1428699119,1cyclictest65-21ksoftirqd/611:07:006
1428699119,1cyclictest22788-21sshd10:26:276
1428699117,3cyclictest65-21ksoftirqd/611:59:546
1428699113,5cyclictest27291-21bash10:28:276
1428699113,4cyclictest6492-21systemd09:36:046
14286991110,1cyclictest65-21ksoftirqd/611:50:226
1428699110,2cyclictest11978-21kill12:28:006
1428699110,10cyclictest12400-21sshd12:35:256
1428699110,1cyclictest686-21dbus-daemon09:13:376
1428599119,1cyclictest818-21systemd09:32:075
1428599119,1cyclictest57-21ksoftirqd/510:51:015
1428599119,1cyclictest57-21ksoftirqd/510:22:415
1428599119,1cyclictest57-21ksoftirqd/509:47:435
1428599119,1cyclictest17781-21sshd11:57:205
14285991110,1cyclictest57-21ksoftirqd/509:37:175
1428599111,4cyclictest14861-21systemd10:42:215
1428599111,4cyclictest14861-21systemd10:42:215
1428599110,2cyclictest20833-21bash09:13:085
1428599110,11cyclictest24833-21kworker/5:311:22:185
1428599110,10cyclictest24833-21kworker/5:311:27:225
1427899119,1cyclictest49-21ksoftirqd/411:52:124
1427899119,1cyclictest49-21ksoftirqd/410:58:024
1427899119,1cyclictest49-21ksoftirqd/409:14:224
1427899118,2cyclictest49-21ksoftirqd/412:02:044
1427899118,2cyclictest25779-21sshd11:41:224
14278991110,1cyclictest49-21ksoftirqd/412:33:264
14278991110,1cyclictest49-21ksoftirqd/411:25:334
1427899110,10cyclictest23797-21kworker/4:410:37:374
1427699119,1cyclictest41-21ksoftirqd/312:08:453
1427699119,1cyclictest41-21ksoftirqd/310:30:313
1427699113,7cyclictest13390-21bash12:06:163
1427699112,4cyclictest24607-21sshd09:44:203
1427699112,4cyclictest22826-21sshd11:19:153
1427699112,4cyclictest0-21swapper/312:12:453
1427699112,4cyclictest0-21swapper/310:25:083
1427699111,4cyclictest2628-21rm11:32:393
1427699110,11cyclictest0-21swapper/311:30:333
14270991110,1cyclictest33-21ksoftirqd/208:22:042
1426799119,1cyclictest25-21ksoftirqd/111:32:121
1426799119,1cyclictest25-21ksoftirqd/109:57:101
1426799119,1cyclictest25-21ksoftirqd/109:57:101
1426799119,1cyclictest25-21ksoftirqd/109:27:381
1426799119,1cyclictest25-21ksoftirqd/107:49:121
1426799115,6cyclictest25-21ksoftirqd/109:08:521
1426799112,4cyclictest3228-21sshd11:05:281
1426799112,4cyclictest1960-21sshd09:21:161
1426799112,4cyclictest19597-21sshd11:53:451
1426799112,4cyclictest18107-21sshd12:13:471
14267991110,1cyclictest25-21ksoftirqd/111:12:241
14267991110,1cyclictest25-21ksoftirqd/110:22:051
14267991110,1cyclictest0-21swapper/109:55:551
1426799111,4cyclictest9676-21sshd11:58:411
1426799111,4cyclictest710-21nscd09:44:551
1426799111,4cyclictest19992-21sshd12:08:231
1426799111,4cyclictest1-21systemd10:54:401
1426799111,4cyclictest0-21swapper/111:01:301
1426299119,2cyclictest18183-21kworker/0:207:09:200
1428999104,1cyclictest73-21ksoftirqd/708:03:287
1428999101,3cyclictest0-21swapper/707:47:187
1428999101,1cyclictest0-21swapper/707:52:177
1428999100,3cyclictest18595-21unixbench_multi08:07:267
1428999100,2cyclictest121rcu_preempt09:02:197
1428699109,1cyclictest65-21ksoftirqd/610:02:066
1428699108,1cyclictest65-21ksoftirqd/612:22:206
1428699107,0cyclictest0-21swapper/610:49:566
1428699104,4cyclictest0-21swapper/612:07:396
1428699103,3cyclictest5298-21sshd10:01:366
1428699103,3cyclictest5298-21sshd10:01:366
1428699102,5cyclictest27489-21bash09:29:576
1428699101,5cyclictest23277-21systemd10:35:356
1428699101,5cyclictest0-21swapper/609:50:336
1428599108,1cyclictest57-21ksoftirqd/512:18:075
1428599108,1cyclictest57-21ksoftirqd/511:39:095
1428599103,4cyclictest946-21systemd12:12:485
1428599100,10cyclictest0-21swapper/508:56:475
1428599100,10cyclictest0-21swapper/508:35:135
1428599100,1cyclictest5186-21sshd09:59:445
1428599100,1cyclictest5186-21sshd09:59:445
1427899109,1cyclictest19820-21kworker/4:010:27:154
1427899108,1cyclictest49-21ksoftirqd/412:22:184
1427899108,1cyclictest49-21ksoftirqd/411:45:444
1427699103,6cyclictest696-21nscd10:09:533
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional