You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-15 - 17:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sun Mar 15, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
325932960,0sleep10-21swapper/109:48:101
32012920,2sleep42456699cyclictest11:17:194
250502860,0sleep00-21swapper/012:16:100
267482830,2sleep12456399cyclictest09:34:561
285792810,0sleep20-21swapper/211:44:482
228222580,0sleep20-21swapper/210:02:202
125602520,0sleep20-21swapper/210:16:382
125602520,0sleep20-21swapper/210:16:382
2435625128,8sleep30-21swapper/307:05:493
124332500,0sleep20-21swapper/211:02:592
124332500,0sleep20-21swapper/211:02:592
85522490,0sleep10-21swapper/111:41:511
56572480,0sleep30-21swapper/309:39:143
60192470,1sleep25999-21sshd09:24:322
15292460,0sleep30-21swapper/310:23:203
118082460,0sleep60-21swapper/611:51:176
280322450,0sleep0111rcuc/012:36:440
97362440,0sleep00-21swapper/009:54:170
66602440,0sleep10-21swapper/111:54:401
314302440,2sleep52456799cyclictest09:48:065
269562440,0sleep40-21swapper/407:07:174
61292430,0sleep40-21swapper/411:02:374
61292430,0sleep40-21swapper/411:02:374
58252430,1sleep09-21ksoftirqd/010:25:330
301242430,1sleep665-21ksoftirqd/612:12:396
263842430,0sleep70-21swapper/711:50:147
231072430,0sleep20-21swapper/211:48:082
95542420,0sleep50-21swapper/510:25:465
261082420,0sleep60-21swapper/609:33:016
15392420,0sleep40-21swapper/411:07:584
142652420,0sleep10-21swapper/109:15:501
315902410,0sleep00-21swapper/011:33:490
29482410,0sleep40-21swapper/410:19:444
274152410,0sleep40-21swapper/410:47:074
26962410,1sleep42699-21bash10:58:454
257522410,1sleep325751-21grep11:31:443
2365924123,4sleep50-21swapper/507:02:145
204632410,0sleep60-21swapper/612:06:396
2437824027,9sleep70-21swapper/707:06:097
184602400,0sleep50-21swapper/512:04:375
96732390,0sleep0111rcuc/010:05:230
59042390,0sleep60-21swapper/610:08:496
59042390,0sleep60-21swapper/610:08:496
58572390,1sleep01-21systemd11:41:420
2439523928,8sleep20-21swapper/207:06:202
2423223926,9sleep40-21swapper/407:04:134
2417523926,9sleep10-21swapper/107:03:221
2412223927,9sleep60-21swapper/607:02:396
2166823927,8sleep00-21swapper/007:01:530
190882390,0sleep70-21swapper/711:22:027
43602350,2sleep42456699cyclictest09:35:314
2456799250,9cyclictest25574-21systemd11:57:335
2456799250,8cyclictest1832-21systemd-cgroups12:27:435
2456799250,7cyclictest1028-21sshd11:28:225
2456799250,6cyclictest13885-21bash11:23:325
2456799240,8cyclictest26902-21sshd12:25:305
2456799230,5cyclictest6674-21sshd10:29:165
2456799223,7cyclictest9128-21systemd-cgroups11:38:055
2456799220,8cyclictest13591-21sshd11:16:105
2456799220,7cyclictest2753-21sshd11:02:255
2456799220,7cyclictest2753-21sshd11:02:255
2456799220,7cyclictest1-21systemd12:09:485
2456799220,6cyclictest20964-21/usr/sbin/munin12:12:095
2456799220,6cyclictest0-21swapper/509:20:535
2456799220,6cyclictest0-21swapper/509:20:535
2456799210,9cyclictest13672-21bash12:21:035
2456799210,9cyclictest1187-21sshd12:35:095
2456799210,9cyclictest0-21swapper/510:39:205
2456799210,6cyclictest30742-21grepconf.sh11:43:015
2456799210,6cyclictest0-21swapper/509:42:025
2456799210,6cyclictest0-21swapper/509:37:385
2456799200,9cyclictest23674-21sshd11:50:045
2456799200,8cyclictest31117-21grepconf.sh09:33:185
2456799200,7cyclictest686-21dbus-daemon10:42:025
2456799200,7cyclictest6208-21grep10:05:115
2456799200,6cyclictest32421-21nfsd410:12:095
2456799200,6cyclictest32421-21nfsd410:12:095
2456799200,11cyclictest584-21bash10:47:235
2456799200,11cyclictest4168-21sshd11:32:135
211632200,0sleep7721ktimersoftd/709:12:277
2456799190,9cyclictest686-21dbus-daemon09:11:595
2456799190,9cyclictest18373-21bash11:18:135
2456799190,8cyclictest9881-21grep09:26:395
2456799190,8cyclictest3272-21bash10:06:525
2456799190,8cyclictest3272-21bash10:06:525
2456799190,8cyclictest29371-21bash09:31:275
2456799190,8cyclictest28356-21systemd10:21:145
2456799190,7cyclictest1923-21sshd09:59:225
2456799190,6cyclictest1-21systemd11:53:135
2456799190,6cyclictest0-21swapper/511:08:125
2456799190,6cyclictest0-21swapper/510:57:185
2456799190,6cyclictest0-21swapper/510:52:055
33932180,1sleep341-21ksoftirqd/309:46:353
24576991816,1cyclictest73-21ksoftirqd/711:36:547
2456799180,8cyclictest22598-21systemd09:08:325
2456799180,8cyclictest0-21swapper/510:32:045
2456799180,7cyclictest16135-21sshd09:52:465
24565991814,1cyclictest41-21ksoftirqd/311:59:083
233602180,0sleep30-21swapper/310:41:223
80202170,2sleep22456499cyclictest11:58:262
24576991715,1cyclictest73-21ksoftirqd/712:14:487
24576991715,1cyclictest73-21ksoftirqd/712:09:257
24576991715,1cyclictest73-21ksoftirqd/709:42:097
108952170,0sleep20-21swapper/209:09:582
306082160,0sleep030078-21sshd09:25:580
24576991615,1cyclictest73-21ksoftirqd/711:33:277
24576991615,1cyclictest73-21ksoftirqd/710:09:267
24576991615,1cyclictest73-21ksoftirqd/710:09:267
24576991614,1cyclictest73-21ksoftirqd/709:31:297
24576991614,1cyclictest73-21ksoftirqd/709:26:237
2457699160,1cyclictest131rcu_sched11:59:087
24565991615,1cyclictest41-21ksoftirqd/312:36:183
24565991615,1cyclictest41-21ksoftirqd/311:53:573
24565991615,1cyclictest41-21ksoftirqd/311:20:133
24565991614,1cyclictest41-21ksoftirqd/311:09:123
24565991614,1cyclictest41-21ksoftirqd/309:52:053
2455799160,0cyclictest691-21systemd-logind11:27:520
21072160,0sleep0111rcuc/012:31:320
15162160,1sleep731244-21/usr/sbin/munin12:22:097
48212150,0sleep30-21swapper/309:59:333
44482150,0sleep10-21swapper/109:29:591
26822150,0sleep20-21swapper/212:31:342
24576991514,1cyclictest73-21ksoftirqd/711:13:037
24576991514,1cyclictest73-21ksoftirqd/710:54:517
24576991514,1cyclictest73-21ksoftirqd/710:35:577
24576991513,1cyclictest73-21ksoftirqd/712:27:077
24576991513,1cyclictest73-21ksoftirqd/712:21:007
24576991511,2cyclictest73-21ksoftirqd/710:42:357
24576991510,1cyclictest73-21ksoftirqd/710:38:037
24572991513,1cyclictest65-21ksoftirqd/609:40:546
24565991514,1cyclictest41-21ksoftirqd/311:34:393
24565991514,1cyclictest41-21ksoftirqd/310:48:093
24565991514,1cyclictest41-21ksoftirqd/309:18:293
24565991514,1cyclictest41-21ksoftirqd/309:18:293
24565991513,1cyclictest41-21ksoftirqd/312:20:353
24565991513,1cyclictest41-21ksoftirqd/312:02:593
24565991513,1cyclictest41-21ksoftirqd/311:13:373
24565991513,1cyclictest41-21ksoftirqd/310:46:043
24565991513,1cyclictest3610-21sshd10:08:413
24565991513,1cyclictest3610-21sshd10:08:413
153962150,0sleep10-21swapper/110:33:271
300292140,0sleep60-21swapper/608:12:056
24576991413,1cyclictest73-21ksoftirqd/711:02:097
24576991413,1cyclictest73-21ksoftirqd/711:02:097
24576991413,1cyclictest73-21ksoftirqd/710:06:037
24576991413,1cyclictest73-21ksoftirqd/709:57:137
24576991413,1cyclictest73-21ksoftirqd/709:52:077
24576991413,1cyclictest73-21ksoftirqd/709:37:107
24576991412,1cyclictest73-21ksoftirqd/711:42:587
24576991412,1cyclictest73-21ksoftirqd/711:01:057
24576991412,1cyclictest73-21ksoftirqd/710:50:437
24576991412,1cyclictest73-21ksoftirqd/710:24:257
24576991412,1cyclictest73-21ksoftirqd/709:46:557
24576991412,1cyclictest73-21ksoftirqd/709:34:457
24572991413,1cyclictest65-21ksoftirqd/612:24:276
24566991412,1cyclictest49-21ksoftirqd/411:55:254
24565991413,1cyclictest41-21ksoftirqd/311:42:093
24565991413,1cyclictest41-21ksoftirqd/311:24:483
24565991413,1cyclictest41-21ksoftirqd/311:01:463
24565991413,1cyclictest41-21ksoftirqd/310:12:453
24565991413,1cyclictest41-21ksoftirqd/310:12:453
24565991413,1cyclictest41-21ksoftirqd/309:32:203
24565991412,1cyclictest41-21ksoftirqd/312:12:093
24565991412,1cyclictest41-21ksoftirqd/310:18:013
24565991412,1cyclictest41-21ksoftirqd/309:47:063
24565991412,1cyclictest41-21ksoftirqd/309:28:573
24565991412,1cyclictest41-21ksoftirqd/309:26:303
24565991410,2cyclictest41-21ksoftirqd/312:08:363
24565991410,1cyclictest41-21ksoftirqd/310:27:203
24564991412,1cyclictest33-21ksoftirqd/211:12:562
24564991412,1cyclictest33-21ksoftirqd/210:36:512
24563991412,1cyclictest25-21ksoftirqd/112:32:531
24563991412,1cyclictest25-21ksoftirqd/112:07:031
24563991412,1cyclictest25-21ksoftirqd/110:22:151
24563991412,1cyclictest25-21ksoftirqd/109:52:061
24557991411,2cyclictest1-21systemd11:24:060
127142140,0sleep60-21swapper/611:32:436
44322130,1sleep2321ktimersoftd/211:24:542
2457699132,1cyclictest73-21ksoftirqd/711:54:117
24576991312,1cyclictest73-21ksoftirqd/710:27:557
24576991311,1cyclictest73-21ksoftirqd/712:32:377
24576991311,1cyclictest73-21ksoftirqd/712:02:127
24576991311,1cyclictest73-21ksoftirqd/711:31:467
24576991311,1cyclictest73-21ksoftirqd/711:07:297
24576991311,1cyclictest73-21ksoftirqd/710:17:037
2457299139,1cyclictest65-21ksoftirqd/610:44:506
2457299133,4cyclictest885-21polkitd09:50:546
2457299133,3cyclictest723-21in:imjournal12:09:496
24572991312,1cyclictest65-21ksoftirqd/609:58:246
24572991312,1cyclictest65-21ksoftirqd/609:13:026
24572991311,1cyclictest65-21ksoftirqd/610:31:486
2456699138,2cyclictest19912-21kill12:26:594
24566991311,1cyclictest49-21ksoftirqd/410:23:134
2456699130,1cyclictest8238-21bash10:10:514
2456699130,1cyclictest8238-21bash10:10:514
2456599139,1cyclictest41-21ksoftirqd/310:33:053
24565991312,1cyclictest41-21ksoftirqd/312:29:493
24565991312,1cyclictest41-21ksoftirqd/311:48:153
24565991312,1cyclictest41-21ksoftirqd/309:12:193
24565991311,1cyclictest41-21ksoftirqd/312:26:133
24565991311,1cyclictest41-21ksoftirqd/311:39:493
24565991311,1cyclictest41-21ksoftirqd/311:02:563
24565991311,1cyclictest41-21ksoftirqd/311:02:563
2456499133,4cyclictest492-21systemd-journal11:01:002
24564991311,1cyclictest33-21ksoftirqd/209:33:392
24563991311,1cyclictest1-21systemd11:01:131
24563991310,2cyclictest26608-21bash10:13:401
24563991310,2cyclictest26608-21bash10:13:401
2456399130,12cyclictest10742-21bash09:45:071
24557991311,1cyclictest9-21ksoftirqd/009:59:420
114932130,0sleep40-21swapper/410:55:324
324212120,0sleep00-21swapper/012:07:130
24576991211,1cyclictest73-21ksoftirqd/711:19:337
24576991211,1cyclictest73-21ksoftirqd/709:17:167
24576991211,1cyclictest73-21ksoftirqd/709:17:167
24576991211,1cyclictest28628-21kworker/7:210:12:507
24576991211,1cyclictest28628-21kworker/7:210:12:507
24576991210,1cyclictest73-21ksoftirqd/709:07:097
2457299129,3cyclictest65-21ksoftirqd/610:48:266
2457299128,4cyclictest65-21ksoftirqd/611:18:466
2457299128,3cyclictest65-21ksoftirqd/609:52:346
24572991211,1cyclictest65-21ksoftirqd/611:38:286
24572991210,1cyclictest65-21ksoftirqd/612:27:156
24572991210,1cyclictest65-21ksoftirqd/609:22:116
2456799120,9cyclictest0-21swapper/507:16:275
2456799120,9cyclictest0-21swapper/507:16:275
2456799120,12cyclictest0-21swapper/508:05:395
2456699129,2cyclictest49-21ksoftirqd/411:40:354
2456699127,2cyclictest49-21ksoftirqd/409:12:194
2456699124,4cyclictest686-21dbus-daemon11:16:464
2456699122,4cyclictest22709-21sshd10:06:084
24566991210,1cyclictest49-21ksoftirqd/412:20:404
24566991210,1cyclictest49-21ksoftirqd/411:44:504
2456699120,11cyclictest22569-21kworker/4:410:15:474
2456699120,11cyclictest22569-21kworker/4:410:15:474
2456699120,1cyclictest686-21dbus-daemon09:38:354
24565991211,1cyclictest41-21ksoftirqd/310:02:263
24565991211,1cyclictest41-21ksoftirqd/309:08:073
24565991210,1cyclictest41-21ksoftirqd/310:52:143
2456499124,4cyclictest686-21dbus-daemon09:58:012
2456499122,4cyclictest0-21swapper/211:55:562
24564991211,1cyclictest33-21ksoftirqd/211:30:352
24564991211,1cyclictest33-21ksoftirqd/210:52:042
2456499121,5cyclictest0-21swapper/211:37:002
24563991211,1cyclictest25-21ksoftirqd/111:13:391
24563991210,1cyclictest691-21systemd-logind11:07:251
24563991210,1cyclictest25-21ksoftirqd/112:31:521
24563991210,1cyclictest25-21ksoftirqd/110:29:551
24563991210,1cyclictest25-21ksoftirqd/109:25:541
24563991210,1cyclictest0-21swapper/111:47:471
24563991210,1cyclictest0-21swapper/110:16:581
2456399120,11cyclictest8243-21kworker/1:311:18:001
2456399120,11cyclictest14112-21kworker/1:011:57:481
2456399120,1cyclictest0-21swapper/109:09:401
2455799124,2cyclictest691-21systemd-logind12:20:430
2455799122,4cyclictest9874-21sshd11:06:410
2455799122,4cyclictest9874-21sshd11:06:410
2455799122,4cyclictest9592-21sshd10:38:400
2455799122,4cyclictest1008-21bash09:35:190
24557991210,1cyclictest9-21ksoftirqd/011:54:070
24557991210,1cyclictest9-21ksoftirqd/009:45:300
2455799120,2cyclictest22059-21grepconf.sh10:15:170
2455799120,2cyclictest22059-21grepconf.sh10:15:170
2455799120,12cyclictest19285-21kworker/0:311:19:160
2455799120,12cyclictest15576-21sshd11:07:000
2455799120,11cyclictest6083-21sshd11:00:510
2457299119,2cyclictest0-21swapper/611:45:226
2457299119,1cyclictest65-21ksoftirqd/612:32:056
2457299119,1cyclictest65-21ksoftirqd/610:04:526
2457299119,1cyclictest11031-21systemd-cgroups11:58:366
2457299118,1cyclictest65-21ksoftirqd/610:36:066
2457299114,4cyclictest686-21dbus-daemon10:16:586
2457299114,4cyclictest22341-21expr11:22:096
2457299113,4cyclictest28544-21sshd09:42:206
24572991110,1cyclictest65-21ksoftirqd/611:54:466
24572991110,1cyclictest65-21ksoftirqd/610:16:016
24572991110,1cyclictest65-21ksoftirqd/610:16:016
24572991110,1cyclictest0-21swapper/609:07:056
2457299110,10cyclictest492-21systemd-journal12:18:196
2457299110,10cyclictest14277-21sshd11:05:006
2457299110,10cyclictest14277-21sshd11:05:006
2456799110,9cyclictest0-21swapper/507:08:505
2456699119,1cyclictest49-21ksoftirqd/411:59:374
2456699119,1cyclictest49-21ksoftirqd/411:22:554
2456699119,1cyclictest49-21ksoftirqd/409:57:534
2456699119,1cyclictest1-21systemd12:07:304
2456699118,2cyclictest14482-21id11:34:434
24566991110,1cyclictest49-21ksoftirqd/410:40:394
24566991110,1cyclictest0-21swapper/409:08:344
2456499119,1cyclictest33-21ksoftirqd/212:36:462
2456499119,1cyclictest33-21ksoftirqd/212:03:312
2456499119,1cyclictest33-21ksoftirqd/209:42:442
2456499119,1cyclictest33-21ksoftirqd/209:14:222
2456499112,4cyclictest27164-21sshd11:07:332
24564991110,1cyclictest33-21ksoftirqd/212:09:442
2456499111,5cyclictest31315-21bash10:27:022
2456499110,6cyclictest0-21swapper/212:15:102
2456499110,5cyclictest27792-21bash10:37:512
2456499110,5cyclictest19429-21bash09:27:082
2456499110,11cyclictest8482-21kworker/2:110:24:362
2456499110,11cyclictest25164-21kworker/2:312:24:142
2456499110,1cyclictest686-21dbus-daemon09:38:562
2456399119,1cyclictest25-21ksoftirqd/112:04:081
2456399119,1cyclictest25-21ksoftirqd/111:29:051
2456399119,1cyclictest25-21ksoftirqd/110:01:521
2456399118,2cyclictest18123-21grepconf.sh10:37:161
2456399113,4cyclictest0-21swapper/112:24:101
24563991110,1cyclictest25-21ksoftirqd/112:19:401
24563991110,1cyclictest25-21ksoftirqd/110:43:151
24563991110,1cyclictest0-21swapper/112:11:541
2456399111,6cyclictest19057-21id11:44:151
2456399110,10cyclictest2357-21nfsd407:22:081
2455799119,1cyclictest9-21ksoftirqd/010:27:010
2455799119,1cyclictest3431-21sshd10:10:330
2455799119,1cyclictest3431-21sshd10:10:330
2455799118,2cyclictest11270-21idleruntime-cro08:36:520
2455799113,5cyclictest31448-21sshd12:03:290
2455799112,4cyclictest9300-21sshd11:47:200
2455799112,4cyclictest25582-21sshd10:56:220
2455799111,4cyclictest6951-21sshd09:17:110
2455799111,4cyclictest6951-21sshd09:17:110
2455799110,11cyclictest9804-21kworker/0:209:38:520
2455799110,11cyclictest0-21swapper/010:18:360
2455799110,10cyclictest1955-21kworker/0:110:42:110
3132100,1sleep41-21systemd09:50:054
2457299109,1cyclictest65-21ksoftirqd/610:23:346
2457299108,1cyclictest65-21ksoftirqd/611:27:056
2457299108,1cyclictest65-21ksoftirqd/609:17:246
2457299108,1cyclictest65-21ksoftirqd/609:17:246
2457299108,1cyclictest65-21ksoftirqd/609:06:526
2457299107,3cyclictest65-21ksoftirqd/610:58:216
2457299107,1cyclictest65-21ksoftirqd/609:28:196
2457299102,5cyclictest15264-21systemd11:12:256
2457299102,1cyclictest0-21swapper/610:53:206
2457299100,4cyclictest19049-21bash11:07:086
2457299100,10cyclictest29960-21kworker/6:210:39:426
2456799100,9cyclictest21660-21cut08:52:095
2456799100,9cyclictest0-21swapper/507:18:595
2456799100,7cyclictest30103-21cstates08:12:055
2456799100,5cyclictest0-21swapper/509:04:455
2456799100,5cyclictest0-21swapper/508:42:595
2456799100,5cyclictest0-21swapper/508:17:455
2456799100,5cyclictest0-21swapper/508:08:475
2456799100,5cyclictest0-21swapper/507:58:425
2456799100,5cyclictest0-21swapper/507:37:545
2456799100,5cyclictest0-21swapper/507:33:135
2456799100,5cyclictest0-21swapper/507:28:285
2456699109,1cyclictest49-21ksoftirqd/412:34:164
2456699109,1cyclictest49-21ksoftirqd/410:29:134
2456699109,1cyclictest0-21swapper/409:54:274
2456699109,1cyclictest0-21swapper/409:46:054
2456699108,1cyclictest49-21ksoftirqd/412:12:054
2456699108,1cyclictest49-21ksoftirqd/411:27:324
2456699104,4cyclictest29457-21bash11:50:254
2456699104,3cyclictest49-21ksoftirqd/412:24:094
2456699104,2cyclictest691-21systemd-logind09:17:454
2456699104,2cyclictest691-21systemd-logind09:17:454
2456499108,1cyclictest33-21ksoftirqd/209:49:482
2456499103,6cyclictest4420-21irqstats09:52:082
2456499103,3cyclictest22691-21sshd11:18:282
2456499102,3cyclictest0-21swapper/211:32:292
2456499101,4cyclictest0-21swapper/210:07:572
2456499101,4cyclictest0-21swapper/210:07:572
2456499101,3cyclictest16771-21sshd10:42:452
2456399104,3cyclictest9075-21systemd10:09:001
2456399104,3cyclictest9075-21systemd10:09:001
2456399103,4cyclictest1-21systemd11:22:041
2456399102,5cyclictest18823-21cp10:48:281
2456399102,5cyclictest17280-21bash09:17:451
2456399102,5cyclictest17280-21bash09:17:451
2456399102,4cyclictest1689-21bash09:37:091
2456399101,5cyclictest15098-21bash10:03:481
2456399100,7cyclictest5390-21sshd11:02:341
2456399100,7cyclictest5390-21sshd11:02:341
2456399100,1cyclictest0-21swapper/111:34:131
2455799109,1cyclictest9-21ksoftirqd/009:29:310
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional