You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-05 - 22:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Fri Dec 05, 2025 12:43:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
467925126,8sleep40-21swapper/406:52:284
276872460,1sleep127681-21sshd09:32:231
263682450,0sleep70-21swapper/710:32:197
35772430,0sleep5561ktimersoftd/512:21:015
169842410,2sleep5493399cyclictest09:45:405
94832400,0sleep40-21swapper/409:04:394
452924028,9sleep10-21swapper/106:50:241
449924027,9sleep30-21swapper/306:50:023
444324027,9sleep50-21swapper/506:49:165
404624027,8sleep00-21swapper/006:48:550
320422400,0sleep21-21systemd09:08:212
245082400,0sleep40-21swapper/410:42:334
473923927,8sleep60-21swapper/606:53:186
461123926,9sleep70-21swapper/706:51:347
442223927,8sleep20-21swapper/206:48:572
3412380,0sleep60-21swapper/609:43:176
253202380,0sleep10-21swapper/112:00:231
12482380,0sleep50-21swapper/512:11:085
106512380,0sleep10-21swapper/109:19:571
494399236,0cyclictest0-21swapper/711:25:417
4933992222,0cyclictest25968-21kworker/5:107:50:255
4943992112,4cyclictest325-21grep09:33:177
4933992119,2cyclictest57-21ksoftirqd/510:28:065
4933992112,9cyclictest57-21ksoftirqd/508:05:555
88022200,0sleep60-21swapper/611:01:256
494399200,17cyclictest7845-21sshd11:22:117
493399204,5cyclictest57-21ksoftirqd/509:34:475
4933992015,5cyclictest57-21ksoftirqd/511:54:435
4933992011,9cyclictest57-21ksoftirqd/510:48:535
494399198,5cyclictest0-21swapper/710:45:297
494399198,5cyclictest0-21swapper/710:19:397
494399198,5cyclictest0-21swapper/709:55:337
494399198,5cyclictest0-21swapper/709:44:297
494399198,5cyclictest0-21swapper/709:25:257
494399198,5cyclictest0-21swapper/708:24:097
494399198,5cyclictest0-21swapper/707:55:377
494399198,5cyclictest0-21swapper/706:56:417
494399198,0cyclictest0-21swapper/712:18:437
494399198,0cyclictest0-21swapper/710:41:137
494399197,6cyclictest0-21swapper/709:06:057
493399198,5cyclictest0-21swapper/508:22:115
493399196,6cyclictest57-21ksoftirqd/509:19:535
4933991914,1cyclictest17292-21kworker/5:212:06:575
4933991914,0cyclictest0-21swapper/507:26:295
492699196,12cyclictest29739-21bash10:27:484
315802190,0sleep431579-21sshd09:53:084
315802190,0sleep431579-21sshd09:53:084
494399187,5cyclictest0-21swapper/711:53:237
494399187,5cyclictest0-21swapper/711:41:297
494399187,5cyclictest0-21swapper/709:40:437
494399187,5cyclictest0-21swapper/708:57:497
494399187,5cyclictest0-21swapper/707:47:177
494399187,5cyclictest0-21swapper/707:31:297
494399187,5cyclictest0-21swapper/707:17:497
494399187,5cyclictest0-21swapper/707:00:097
494399187,0cyclictest0-21swapper/712:20:337
494399187,0cyclictest0-21swapper/712:04:517
494399187,0cyclictest0-21swapper/711:01:057
494399187,0cyclictest0-21swapper/710:09:457
494399187,0cyclictest0-21swapper/709:16:517
494399187,0cyclictest0-21swapper/709:16:517
493399188,5cyclictest57-21ksoftirqd/509:49:095
493399188,5cyclictest57-21ksoftirqd/509:49:095
4933991814,0cyclictest1400-21kworker/5:011:37:495
4933991812,1cyclictest57-21ksoftirqd/512:18:515
4913991815,3cyclictest33-21ksoftirqd/210:24:052
494399178,5cyclictest0-21swapper/708:38:217
494399177,5cyclictest0-21swapper/710:05:477
494399177,10cyclictest0-21swapper/710:50:497
494399177,10cyclictest0-21swapper/707:19:177
494399176,5cyclictest0-21swapper/711:56:497
494399176,5cyclictest0-21swapper/711:33:017
494399176,5cyclictest0-21swapper/711:14:417
494399176,5cyclictest0-21swapper/711:11:157
494399176,5cyclictest0-21swapper/710:18:517
494399176,5cyclictest0-21swapper/709:50:017
494399176,5cyclictest0-21swapper/709:50:017
494399176,5cyclictest0-21swapper/709:36:097
494399176,5cyclictest0-21swapper/709:20:297
494399176,5cyclictest0-21swapper/709:10:257
494399176,5cyclictest0-21swapper/708:59:557
494399176,5cyclictest0-21swapper/708:39:177
494399176,5cyclictest0-21swapper/707:35:097
494399176,10cyclictest0-21swapper/708:01:137
494399176,0cyclictest0-21swapper/712:10:357
494399176,0cyclictest0-21swapper/707:48:577
493399177,5cyclictest57-21ksoftirqd/508:54:095
493399176,6cyclictest57-21ksoftirqd/511:14:415
493399176,5cyclictest25968-21kworker/5:107:18:355
4933991716,1cyclictest0-21swapper/510:33:115
4933991713,4cyclictest57-21ksoftirqd/510:09:575
4933991713,4cyclictest57-21ksoftirqd/509:10:015
4933991713,4cyclictest57-21ksoftirqd/508:00:395
4933991712,5cyclictest57-21ksoftirqd/510:16:415
4933991712,5cyclictest57-21ksoftirqd/507:02:135
4933991712,5cyclictest25968-21kworker/5:107:43:495
4933991712,1cyclictest57-21ksoftirqd/509:26:135
4933991712,0cyclictest57-21ksoftirqd/507:05:215
4933991711,1cyclictest57-21ksoftirqd/510:02:055
494399167,9cyclictest0-21swapper/711:34:377
494399166,10cyclictest0-21swapper/708:06:197
494399166,0cyclictest0-21swapper/708:16:257
494399165,5cyclictest0-21swapper/711:59:477
494399165,5cyclictest0-21swapper/710:54:097
494399165,5cyclictest0-21swapper/710:00:457
494399165,5cyclictest0-21swapper/708:49:317
494399165,5cyclictest0-21swapper/708:47:297
494399165,5cyclictest0-21swapper/708:19:417
494399165,5cyclictest0-21swapper/708:09:157
494399165,5cyclictest0-21swapper/707:39:077
494399165,11cyclictest0-21swapper/707:13:097
494399165,0cyclictest0-21swapper/710:38:377
494399165,0cyclictest0-21swapper/710:24:257
494399165,0cyclictest0-21swapper/707:24:137
494399165,0cyclictest0-21swapper/707:05:317
493399166,5cyclictest57-21ksoftirqd/509:02:355
493399166,5cyclictest57-21ksoftirqd/508:51:455
4933991614,2cyclictest57-21ksoftirqd/508:42:455
4933991612,4cyclictest57-21ksoftirqd/511:49:135
4933991612,4cyclictest57-21ksoftirqd/507:10:355
4933991611,5cyclictest57-21ksoftirqd/511:43:235
4933991611,5cyclictest57-21ksoftirqd/511:32:355
4933991611,5cyclictest57-21ksoftirqd/511:11:215
4933991611,5cyclictest57-21ksoftirqd/510:56:495
4933991611,5cyclictest57-21ksoftirqd/510:42:335
4933991611,5cyclictest57-21ksoftirqd/510:21:155
4933991611,5cyclictest57-21ksoftirqd/508:17:335
4933991611,1cyclictest57-21ksoftirqd/511:00:095
4933991611,1cyclictest57-21ksoftirqd/510:50:295
4933991611,1cyclictest57-21ksoftirqd/507:48:055
4933991611,1cyclictest25968-21kworker/5:107:23:015
4933991611,0cyclictest551rcuc/509:39:075
4933991610,1cyclictest57-21ksoftirqd/510:38:415
4913991613,1cyclictest33-21ksoftirqd/210:49:232
4906991615,1cyclictest29580-21kworker/1:209:41:211
4906991615,1cyclictest17218-21kworker/1:210:11:091
41572160,0sleep00-21swapper/010:03:530
494399150,9cyclictest0-21swapper/711:43:557
494399150,9cyclictest0-21swapper/711:03:577
494399150,9cyclictest0-21swapper/708:30:457
493799150,2cyclictest131rcu_sched09:49:066
493799150,2cyclictest131rcu_sched09:49:066
493399159,3cyclictest57-21ksoftirqd/511:24:095
493399156,3cyclictest29752-21kworker/5:109:29:335
493399154,6cyclictest0-21swapper/508:24:055
4933991514,1cyclictest57-21ksoftirqd/506:58:255
4933991513,1cyclictest57-21ksoftirqd/512:02:095
4933991512,3cyclictest0-21swapper/508:47:475
4933991511,0cyclictest0-21swapper/508:13:075
4933991510,5cyclictest57-21ksoftirqd/507:30:135
4933991510,1cyclictest13881-21kworker/5:009:18:495
4933991510,1cyclictest13881-21kworker/5:009:18:495
4913991513,1cyclictest33-21ksoftirqd/210:57:472
4913991513,1cyclictest33-21ksoftirqd/209:43:582
4913991513,1cyclictest33-21ksoftirqd/209:43:102
4913991512,2cyclictest33-21ksoftirqd/212:18:382
4906991514,1cyclictest30149-21kworker/1:011:30:531
4906991514,1cyclictest27826-21kworker/1:311:25:311
4906991513,1cyclictest6894-21kworker/1:211:42:411
493399149,5cyclictest57-21ksoftirqd/510:04:535
493399149,1cyclictest10138-21kworker/5:109:06:415
493399143,11cyclictest57-21ksoftirqd/508:36:095
4933991410,3cyclictest57-21ksoftirqd/511:45:395
4926991411,2cyclictest12931-21bash09:29:584
4913991413,1cyclictest33-21ksoftirqd/212:04:062
4913991413,1cyclictest33-21ksoftirqd/211:27:342
4913991413,1cyclictest33-21ksoftirqd/209:11:082
4913991412,1cyclictest33-21ksoftirqd/211:58:212
4913991412,1cyclictest33-21ksoftirqd/210:29:162
4913991412,1cyclictest33-21ksoftirqd/208:55:042
4913991412,1cyclictest2378-21sshd11:46:412
4906991413,1cyclictest7352-21kworker/1:009:03:131
4906991413,1cyclictest27826-21kworker/1:311:53:051
4906991413,1cyclictest25456-21kworker/1:411:58:371
4906991413,1cyclictest23058-21kworker/1:010:31:471
93032130,0sleep40-21swapper/410:04:214
4937991312,1cyclictest65-21ksoftirqd/609:09:106
4937991311,1cyclictest65-21ksoftirqd/609:24:076
493399139,4cyclictest57-21ksoftirqd/511:05:075
493399138,5cyclictest25968-21kworker/5:107:54:335
493399137,1cyclictest57-21ksoftirqd/509:56:195
493399133,0cyclictest121rcu_preempt07:35:175
4933991312,1cyclictest57-21ksoftirqd/511:19:175
491399139,1cyclictest33-21ksoftirqd/211:22:532
491399137,4cyclictest33-21ksoftirqd/211:33:542
491399132,6cyclictest33-21ksoftirqd/209:37:552
4913991312,1cyclictest33-21ksoftirqd/211:40:412
4913991312,1cyclictest33-21ksoftirqd/210:46:452
4913991312,1cyclictest33-21ksoftirqd/210:41:182
4913991311,1cyclictest33-21ksoftirqd/212:13:542
4913991311,1cyclictest33-21ksoftirqd/210:19:102
4913991311,1cyclictest33-21ksoftirqd/208:59:122
4913991310,1cyclictest33-21ksoftirqd/209:19:532
491399130,1cyclictest121rcu_preempt09:32:232
4906991312,1cyclictest4771-21kworker/1:107:09:091
4906991312,1cyclictest25-21ksoftirqd/111:07:301
4906991312,1cyclictest21923-21kworker/1:009:37:531
4906991312,1cyclictest13934-21kworker/1:112:09:011
4906991312,1cyclictest12322-21kworker/1:210:57:371
296662130,0sleep40-21swapper/409:37:464
493799129,2cyclictest0-21swapper/610:30:066
4937991211,1cyclictest65-21ksoftirqd/611:41:346
4937991211,1cyclictest65-21ksoftirqd/611:16:426
4937991211,1cyclictest65-21ksoftirqd/610:01:196
4937991211,1cyclictest65-21ksoftirqd/609:34:246
4937991210,1cyclictest65-21ksoftirqd/610:44:086
4937991210,1cyclictest65-21ksoftirqd/610:43:546
4937991210,1cyclictest65-21ksoftirqd/609:54:526
493399126,6cyclictest57-21ksoftirqd/508:29:555
492699122,4cyclictest711-21dbus-daemon12:21:354
4926991210,1cyclictest49-21ksoftirqd/411:58:384
492199120,12cyclictest0-21swapper/312:02:103
491399128,1cyclictest33-21ksoftirqd/211:18:492
4913991211,1cyclictest33-21ksoftirqd/212:19:012
4913991211,1cyclictest33-21ksoftirqd/211:59:352
4913991211,1cyclictest33-21ksoftirqd/209:50:182
4913991211,1cyclictest33-21ksoftirqd/209:50:182
4913991211,1cyclictest33-21ksoftirqd/209:28:542
4913991211,1cyclictest33-21ksoftirqd/209:13:572
4913991211,1cyclictest33-21ksoftirqd/209:13:572
4913991210,1cyclictest33-21ksoftirqd/211:49:502
4913991210,1cyclictest33-21ksoftirqd/211:34:192
4906991211,1cyclictest26588-21kworker/1:111:11:391
4906991211,1cyclictest26147-21kworker/1:011:15:171
4906991211,1cyclictest12322-21kworker/1:211:01:151
4906991211,1cyclictest11365-21kworker/1:109:57:171
4906991210,1cyclictest25-21ksoftirqd/110:49:081
493799119,1cyclictest732-21NetworkManager10:26:446
493799119,1cyclictest65-21ksoftirqd/612:14:166
493799119,1cyclictest65-21ksoftirqd/611:57:016
493799119,1cyclictest65-21ksoftirqd/611:21:186
493799119,1cyclictest0-21swapper/612:23:146
4937991110,1cyclictest65-21ksoftirqd/611:25:106
4937991110,1cyclictest65-21ksoftirqd/611:04:466
4937991110,1cyclictest65-21ksoftirqd/610:36:556
4937991110,1cyclictest65-21ksoftirqd/610:23:386
4937991110,1cyclictest65-21ksoftirqd/609:32:296
4937991110,1cyclictest65-21ksoftirqd/609:16:506
4937991110,1cyclictest65-21ksoftirqd/609:16:506
4937991110,1cyclictest65-21ksoftirqd/609:00:066
493799110,11cyclictest0-21swapper/609:19:536
492699110,10cyclictest315-21sshd10:38:294
492199110,1cyclictest1-21systemd12:22:533
491399119,1cyclictest33-21ksoftirqd/211:10:302
491399119,1cyclictest33-21ksoftirqd/211:04:472
491399119,1cyclictest33-21ksoftirqd/210:34:102
491399119,1cyclictest33-21ksoftirqd/210:14:192
491399119,1cyclictest33-21ksoftirqd/210:07:502
491399119,1cyclictest33-21ksoftirqd/209:59:462
4913991111,0cyclictest13450irq/24-ahci[00010:10:332
4913991110,1cyclictest33-21ksoftirqd/211:00:542
4906991110,1cyclictest6894-21kworker/1:211:44:351
4906991110,1cyclictest30013-21kworker/1:108:35:491
4906991110,1cyclictest30013-21kworker/1:108:33:451
4906991110,1cyclictest29580-21kworker/1:209:44:391
4906991110,1cyclictest29580-21kworker/1:209:24:011
4906991110,1cyclictest25-21ksoftirqd/109:49:421
4906991110,1cyclictest25-21ksoftirqd/109:49:421
4906991110,1cyclictest25-21ksoftirqd/109:17:411
4906991110,1cyclictest25-21ksoftirqd/109:17:411
4906991110,1cyclictest13316-21kworker/1:207:53:531
4906991110,1cyclictest11365-21kworker/1:110:04:031
4906991110,1cyclictest11365-21kworker/1:110:02:091
490699110,1cyclictest0-21swapper/112:15:511
490099119,1cyclictest0-21swapper/010:18:230
490099113,4cyclictest0-21swapper/008:08:530
243112110,1sleep024310-21grepconf.sh09:56:560
14202110,0sleep10-21swapper/112:06:241
493799109,1cyclictest65-21ksoftirqd/611:35:016
493799109,1cyclictest65-21ksoftirqd/610:51:286
493799109,1cyclictest65-21ksoftirqd/610:15:286
493799109,1cyclictest65-21ksoftirqd/610:09:016
493799108,1cyclictest65-21ksoftirqd/608:55:376
493799106,1cyclictest65-21ksoftirqd/612:06:276
493799100,1cyclictest0-21swapper/610:58:256
492699109,1cyclictest0-21swapper/409:11:284
492699103,6cyclictest22491-21sshd11:39:214
492699103,6cyclictest13168-21sshd09:15:294
492699103,6cyclictest13168-21sshd09:15:294
492699103,4cyclictest669-21avahi-daemon11:45:564
492699100,10cyclictest0-21swapper/412:05:214
492699100,10cyclictest0-21swapper/411:27:414
492699100,10cyclictest0-21swapper/409:48:024
492199109,1cyclictest41-21ksoftirqd/310:57:593
492199108,1cyclictest41-21ksoftirqd/310:29:153
492199106,2cyclictest11980-21kworker/3:110:18:173
492199104,3cyclictest26588-21sshd09:52:183
492199104,3cyclictest26588-21sshd09:52:183
492199100,9cyclictest12596-21kworker/3:111:45:213
491399108,1cyclictest33-21ksoftirqd/209:54:072
491399108,1cyclictest33-21ksoftirqd/208:53:542
490699109,1cyclictest4771-21kworker/1:107:19:231
490699109,1cyclictest27826-21kworker/1:311:35:351
490699109,1cyclictest25-21ksoftirqd/110:17:031
490699109,1cyclictest15741-21kworker/1:312:21:091
490699109,1cyclictest15381-21kworker/1:210:43:551
490699109,1cyclictest0-21swapper/110:19:501
490699100,9cyclictest9537-21bash10:34:361
490699100,8cyclictest28105-21nfsd11:21:101
490099109,1cyclictest0-21swapper/009:40:050
324852100,0sleep60-21swapper/612:01:326
49379997,1cyclictest65-21ksoftirqd/612:09:156
49379997,1cyclictest65-21ksoftirqd/611:45:016
49379997,1cyclictest65-21ksoftirqd/611:08:546
49379997,1cyclictest65-21ksoftirqd/610:06:476
49379997,1cyclictest65-21ksoftirqd/609:07:256
49379994,3cyclictest29187-21sshd11:30:106
49379990,8cyclictest7243-21kworker/6:009:44:466
49269993,5cyclictest5561-21sshd11:21:484
49269993,5cyclictest340-21sshd10:13:164
49269993,3cyclictest0-21swapper/410:03:034
49269992,6cyclictest13464-21sshd09:55:114
49269990,9cyclictest0-21swapper/410:57:534
49269990,8cyclictest25128-21kworker/4:211:10:294
49269990,8cyclictest21089-21kworker/4:410:17:434
49269990,0cyclictest0-21swapper/411:16:294
49219999,0cyclictest0-21swapper/312:15:093
49219998,1cyclictest41-21ksoftirqd/310:10:263
49219997,1cyclictest41-21ksoftirqd/311:17:023
49219996,1cyclictest13683-21kworker/3:212:10:593
49219994,2cyclictest25389-21sshd12:05:043
49219993,5cyclictest2360-21bash10:49:153
49219993,3cyclictest26035-21sshd11:55:573
49219993,3cyclictest17820-21bash10:41:273
49219992,3cyclictest18772-21bash11:19:023
49219990,9cyclictest0-21swapper/310:47:113
49219990,8cyclictest22083-21kworker/3:210:24:323
49219990,8cyclictest12596-21kworker/3:111:50:143
49139998,1cyclictest33-21ksoftirqd/208:24:072
49069999,0cyclictest30013-21kworker/1:108:40:511
49069998,1cyclictest25-21ksoftirqd/109:09:051
49069997,1cyclictest25-21ksoftirqd/109:05:231
49069997,1cyclictest25-21ksoftirqd/108:54:121
49069997,1cyclictest17971-21kworker/1:410:26:251
49009999,0cyclictest0-21swapper/011:57:240
49009996,2cyclictest30688-21sshd09:47:550
49009990,9cyclictest0-21swapper/012:04:390
49009990,9cyclictest0-21swapper/009:12:480
49009990,4cyclictest8726-21bash11:32:050
49009990,0cyclictest0-21swapper/011:12:470
49379986,1cyclictest65-21ksoftirqd/611:49:066
49379986,1cyclictest65-21ksoftirqd/608:43:106
49379984,0cyclictest0-21swapper/607:08:186
49269988,0cyclictest0-21swapper/412:17:204
49269987,1cyclictest0-21swapper/407:23:024
49269986,1cyclictest49-21ksoftirqd/411:36:434
49269986,1cyclictest15075-21sshd10:46:034
49269985,2cyclictest25387-21rm09:27:104
49269983,3cyclictest22126-21iostat_ios11:29:104
49269983,3cyclictest13757-21sshd12:03:384
49269982,5cyclictest16957-21sshd11:08:294
49269982,3cyclictest0-21swapper/407:13:274
49269980,7cyclictest5801-21kworker/4:110:51:164
49269980,7cyclictest27748-21kworker/4:011:49:324
49269980,3cyclictest13947-21sshd09:20:304
49269980,3cyclictest0-21swapper/409:39:524
49269980,0cyclictest0-21swapper/407:39:234
49219988,0cyclictest0-21swapper/311:07:033
49219988,0cyclictest0-21swapper/309:39:243
49219987,1cyclictest0-21swapper/310:22:453
49219986,1cyclictest9170-21sshd09:34:213
49219986,1cyclictest7936-21kworker/3:308:59:573
49219986,1cyclictest41-21ksoftirqd/308:56:473
49219986,1cyclictest28735-21kworker/3:409:44:033
49219986,1cyclictest25850-21kworker/3:110:59:313
49219986,1cyclictest12596-21kworker/3:111:36:333
49219986,1cyclictest11017-21kworker/3:410:00:533
49219986,1cyclictest10807-21kworker/3:009:14:193
49219986,1cyclictest10807-21kworker/3:009:14:193
49219986,1cyclictest10807-21kworker/3:009:11:493
49219986,1cyclictest10807-21kworker/3:009:04:173
49219983,4cyclictest0-21swapper/311:24:093
49219983,1cyclictest711-21dbus-daemon11:32:183
49219983,1cyclictest5998-21awk09:24:113
49219982,3cyclictest28466-21sshd11:40:253
49219981,3cyclictest14852-21sshd09:30:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional