You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-03 - 21:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Wed Jun 03, 2026 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
233742950,2sleep71461499cyclictest10:03:097
254232880,2sleep41459099cyclictest11:15:474
254232880,2sleep41459099cyclictest11:15:474
226472760,2sleep21457199cyclictest12:30:092
159752740,1sleep315971-21systemd-cgroups09:21:483
209702590,10sleep213550irq/24-ahci[00012:03:582
303852550,0sleep130374-21sshd11:12:231
315592530,0sleep40-21swapper/410:22:124
267432500,0sleep7711rcuc/709:53:567
7602490,0sleep30-21swapper/310:18:353
1412124924,8sleep40-21swapper/407:04:254
74102480,0sleep20-21swapper/210:43:092
206002480,2sleep71461499cyclictest11:19:107
156552480,1sleep215653-21grepconf.sh10:13:452
1413624825,8sleep10-21swapper/107:04:381
79772470,0sleep20-21swapper/210:58:062
173992470,1sleep117385-21sshd09:42:211
230602460,1sleep323046-21sshd11:26:513
1441424624,8sleep00-21swapper/007:08:220
1415924634,9sleep20-21swapper/207:04:552
139932460,0sleep50-21swapper/510:50:575
312122450,0sleep00-21swapper/010:31:290
60932440,0sleep20-21swapper/212:12:312
289342440,0sleep1241ktimersoftd/109:11:131
237592440,1sleep123744-21sshd12:32:081
244112430,0sleep00-21swapper/012:30:150
188812430,0sleep70-21swapper/712:13:167
148982430,0sleep00-21swapper/011:09:340
128662430,1sleep61-21systemd09:19:436
48232420,0sleep00-21swapper/010:28:090
267832420,0sleep50-21swapper/511:56:565
267832420,0sleep50-21swapper/511:56:565
1436124230,8sleep70-21swapper/707:07:417
90512410,0sleep60-21swapper/609:58:366
322082410,0sleep50-21swapper/509:50:345
303152410,0sleep40-21swapper/411:47:504
237082410,0sleep20-21swapper/211:32:342
203002410,0sleep00-21swapper/009:33:150
194602410,0sleep30-21swapper/311:45:173
191212410,0sleep10-21swapper/109:31:151
1419824129,8sleep50-21swapper/507:05:315
108612410,0sleep2311rcuc/210:50:462
70952400,0sleep50-21swapper/512:36:455
60872400,0sleep70-21swapper/711:40:487
117012400,0sleep50-21swapper/510:26:385
42742390,0sleep10-21swapper/109:47:091
1420523926,9sleep30-21swapper/307:05:373
1409623925,10sleep60-21swapper/607:04:036
190062380,0sleep20-21swapper/211:06:072
1459899232,6cyclictest31362-21sshd11:40:245
1459899231,6cyclictest4480-21sshd09:56:275
49162220,0sleep00-21swapper/011:23:510
200772220,0sleep231305-1kworker/2:0H12:18:482
1457199225,3cyclictest33-21ksoftirqd/211:16:352
1457199225,3cyclictest33-21ksoftirqd/211:16:352
1459899212,5cyclictest22662-21sshd12:04:045
1459899212,5cyclictest1-21systemd09:44:285
1459899212,3cyclictest25231-21sshd09:13:065
1459899212,3cyclictest12760-21systemd-cgroups10:19:115
14571992117,3cyclictest33-21ksoftirqd/210:11:552
1459899204,3cyclictest25427-21bash11:12:065
1459899203,6cyclictest29524-21sshd12:21:165
1459899203,3cyclictest1-21systemd10:14:275
1459899202,5cyclictest721-21dbus-daemon11:19:585
1459899202,5cyclictest1-21systemd11:38:015
1459899194,4cyclictest14469-21grepconf.sh12:27:535
1459899194,3cyclictest13951-21grepconf.sh11:15:065
1459899194,3cyclictest13951-21grepconf.sh11:15:065
1459899193,5cyclictest18701-21sshd11:26:365
1459899193,5cyclictest12754-21grep10:34:045
1459899192,6cyclictest29800-21sshd09:18:485
1459899192,4cyclictest721-21dbus-daemon09:28:575
1459899192,4cyclictest14162-21systemd-cgroups09:16:075
1459899192,4cyclictest10347-21sshd10:28:275
1459899192,3cyclictest28108-21systemd-cgroups11:32:505
1459899192,2cyclictest9802-21systemd-cgroups10:59:595
1459099191,1cyclictest121rcu_preempt09:23:414
14571991915,4cyclictest33-21ksoftirqd/211:45:552
14571991914,3cyclictest33-21ksoftirqd/210:47:232
44482180,0sleep70-21swapper/711:05:167
1459899183,5cyclictest6031-21grepconf.sh11:07:165
1459899183,4cyclictest14188-21bash09:42:095
1459899183,3cyclictest20526-21kill12:17:035
1459899182,7cyclictest0-21swapper/509:58:415
1459099184,1cyclictest49-21ksoftirqd/409:41:594
14590991816,1cyclictest49-21ksoftirqd/412:10:464
14590991816,1cyclictest49-21ksoftirqd/411:01:464
14590991814,1cyclictest49-21ksoftirqd/412:19:414
1459099180,1cyclictest49-21ksoftirqd/410:46:454
14571991815,2cyclictest33-21ksoftirqd/212:17:062
14571991814,1cyclictest33-21ksoftirqd/211:41:392
1457199180,17cyclictest4324-21kworker/2:010:04:382
254272170,0sleep00-21swapper/009:52:050
1459899173,6cyclictest8768-21rm10:54:205
1459899173,5cyclictest29301-21grep12:11:595
1459899173,5cyclictest23178-21sshd11:43:395
1459899173,4cyclictest19971-21grep12:02:085
1459899172,6cyclictest32646-21grepconf.sh09:24:345
1459899172,5cyclictest20687-21grep10:10:235
1459899172,5cyclictest18188-21grepconf.sh10:43:415
1459899172,4cyclictest31367-21systemd-cgroups12:28:455
1459899171,6cyclictest1-21systemd10:05:065
1459899171,5cyclictest0-21swapper/509:33:395
1459899171,5cyclictest0-21swapper/509:33:395
14590991715,1cyclictest49-21ksoftirqd/409:58:424
14590991715,1cyclictest49-21ksoftirqd/409:29:084
14590991714,3cyclictest49-21ksoftirqd/411:48:364
14590991712,3cyclictest49-21ksoftirqd/409:20:574
1459099171,2cyclictest131rcu_sched10:28:424
1459099170,16cyclictest10143-21kworker/4:411:43:234
1459099170,1cyclictest49-21ksoftirqd/410:06:494
14583991712,1cyclictest29976-21systemd11:58:543
1457199172,2cyclictest33-21ksoftirqd/211:12:542
14571991715,2cyclictest33-21ksoftirqd/209:40:522
14571991715,1cyclictest33-21ksoftirqd/209:25:572
14571991713,3cyclictest33-21ksoftirqd/210:20:042
1457199170,16cyclictest27775-21kworker/2:310:02:472
317142160,0sleep60-21swapper/611:12:286
1459899163,12cyclictest24279-21sshd11:49:165
1459899162,3cyclictest0-21swapper/510:42:125
1459099169,4cyclictest49-21ksoftirqd/409:08:444
1459099165,1cyclictest49-21ksoftirqd/411:33:424
14590991615,1cyclictest49-21ksoftirqd/412:13:444
14590991615,1cyclictest49-21ksoftirqd/412:04:134
14590991614,1cyclictest49-21ksoftirqd/412:33:404
14590991614,1cyclictest49-21ksoftirqd/411:18:474
14590991614,1cyclictest49-21ksoftirqd/409:56:474
14590991614,1cyclictest49-21ksoftirqd/409:35:084
14590991614,1cyclictest49-21ksoftirqd/409:35:084
14590991613,2cyclictest49-21ksoftirqd/411:13:204
14590991612,1cyclictest49-21ksoftirqd/410:14:114
1459099161,1cyclictest49-21ksoftirqd/410:38:504
14583991614,1cyclictest41-21ksoftirqd/311:14:513
14583991614,1cyclictest41-21ksoftirqd/311:14:513
1457199166,3cyclictest131rcu_sched09:48:442
14571991614,2cyclictest33-21ksoftirqd/209:28:482
14571991614,1cyclictest33-21ksoftirqd/211:58:442
14571991614,1cyclictest33-21ksoftirqd/211:19:032
14571991614,1cyclictest33-21ksoftirqd/209:46:122
14571991614,1cyclictest33-21ksoftirqd/209:38:242
14571991614,1cyclictest33-21ksoftirqd/209:38:242
14571991613,2cyclictest33-21ksoftirqd/211:34:522
14571991612,3cyclictest33-21ksoftirqd/209:18:432
14571991610,4cyclictest33-21ksoftirqd/209:55:322
1457199161,14cyclictest5806-21kworker/2:410:35:472
1457199160,3cyclictest33-21ksoftirqd/209:17:232
1457199160,15cyclictest32603-21kworker/2:311:24:512
14564991615,1cyclictest25-21ksoftirqd/112:01:461
74482150,0sleep60-21swapper/610:48:416
14590991514,1cyclictest32179-21kworker/4:111:54:304
14590991514,1cyclictest32179-21kworker/4:111:54:304
14590991513,1cyclictest49-21ksoftirqd/412:31:174
14590991513,1cyclictest49-21ksoftirqd/411:28:014
14590991513,1cyclictest49-21ksoftirqd/411:07:344
14590991513,1cyclictest49-21ksoftirqd/410:48:524
14590991513,1cyclictest49-21ksoftirqd/410:24:294
14590991513,1cyclictest471rcuc/409:13:434
14590991512,3cyclictest49-21ksoftirqd/412:25:294
14590991512,2cyclictest49-21ksoftirqd/411:58:454
1459099151,1cyclictest49-21ksoftirqd/411:28:374
1459099150,3cyclictest49-21ksoftirqd/410:53:254
1459099150,2cyclictest131rcu_sched09:46:504
1459099150,1cyclictest2449-21sshd09:48:484
1459099150,1cyclictest131rcu_sched10:34:294
14583991514,1cyclictest41-21ksoftirqd/310:27:373
1457199159,3cyclictest33-21ksoftirqd/209:12:192
14571991514,1cyclictest33-21ksoftirqd/211:53:442
14571991514,1cyclictest33-21ksoftirqd/211:53:442
14571991514,1cyclictest33-21ksoftirqd/211:49:482
14571991513,2cyclictest33-21ksoftirqd/212:36:552
14571991513,1cyclictest33-21ksoftirqd/212:24:402
14571991513,1cyclictest33-21ksoftirqd/211:03:122
14590991413,1cyclictest49-21ksoftirqd/410:09:544
14583991412,1cyclictest41-21ksoftirqd/312:21:283
14583991412,1cyclictest41-21ksoftirqd/311:03:173
14583991412,1cyclictest41-21ksoftirqd/310:42:213
14571991413,1cyclictest33-21ksoftirqd/210:24:502
1457199140,1cyclictest131rcu_sched10:29:352
14564991413,1cyclictest25-21ksoftirqd/110:48:431
14564991410,1cyclictest25-21ksoftirqd/112:21:081
1455799143,5cyclictest29958-21sshd10:12:500
14557991412,1cyclictest9-21ksoftirqd/012:19:120
1461499132,5cyclictest20941-21bash09:35:037
1461499132,5cyclictest20941-21bash09:35:037
14614991311,1cyclictest73-21ksoftirqd/710:36:407
1460699132,5cyclictest3193-21bash12:36:316
1460699132,5cyclictest20346-21bash09:29:266
1460699132,5cyclictest18221-21kill09:44:096
1460699132,5cyclictest11283-21id11:22:286
14606991311,1cyclictest65-21ksoftirqd/610:47:096
14583991312,1cyclictest41-21ksoftirqd/312:32:133
14583991312,1cyclictest41-21ksoftirqd/309:09:343
14583991311,1cyclictest41-21ksoftirqd/311:31:353
14583991311,1cyclictest41-21ksoftirqd/310:57:493
14564991311,1cyclictest25-21ksoftirqd/110:43:401
1455799132,5cyclictest9658-21bash11:48:300
14557991312,1cyclictest9-21ksoftirqd/009:59:310
38852120,0sleep10-21swapper/109:54:301
282122120,0sleep70-21swapper/707:28:467
217042120,0sleep70-21swapper/711:36:087
17772120,0sleep10-21swapper/111:34:581
1461499129,2cyclictest73-21ksoftirqd/711:23:427
1461499124,5cyclictest19962-21systemd11:52:507
1461499122,4cyclictest28976-21sshd11:12:187
1461499122,4cyclictest11310-21sshd09:49:197
14614991210,1cyclictest73-21ksoftirqd/711:53:387
14614991210,1cyclictest73-21ksoftirqd/711:53:387
14614991210,1cyclictest73-21ksoftirqd/710:56:517
1461499120,12cyclictest26146-21kworker/7:010:41:217
1461499120,12cyclictest22243-21kworker/7:212:21:407
1461499120,11cyclictest31768-21kworker/7:310:20:447
1461499120,11cyclictest22243-21kworker/7:212:34:057
1461499120,11cyclictest13712-21kworker/7:311:59:047
1460699125,1cyclictest0-21swapper/609:56:286
1460699122,4cyclictest721-21dbus-daemon09:35:326
1460699122,4cyclictest721-21dbus-daemon09:35:326
1460699122,4cyclictest6846-21sshd11:53:506
1460699122,4cyclictest6846-21sshd11:53:506
1460699122,4cyclictest6809-21sshd12:18:096
1460699122,4cyclictest5160-21sshd10:26:156
1460699122,4cyclictest29056-21bash12:10:036
1460699122,4cyclictest25622-21sshd12:28:316
1460699122,4cyclictest17713-21sshd09:49:426
1460699122,4cyclictest1542-21sshd11:59:086
1460699122,4cyclictest15349-21sshd11:50:396
1460699122,4cyclictest0-21swapper/612:20:206
1460699122,4cyclictest0-21swapper/611:41:036
1460699122,4cyclictest0-21swapper/611:25:386
14606991211,1cyclictest65-21ksoftirqd/610:55:096
14606991210,1cyclictest4873-21sshd10:11:216
1458399129,1cyclictest41-21ksoftirqd/311:07:353
14583991211,1cyclictest41-21ksoftirqd/309:14:463
14583991210,1cyclictest41-21ksoftirqd/312:23:283
14583991210,1cyclictest41-21ksoftirqd/310:49:043
14583991210,1cyclictest41-21ksoftirqd/310:44:173
14583991210,1cyclictest41-21ksoftirqd/310:17:493
14583991210,1cyclictest41-21ksoftirqd/309:49:113
14583991210,1cyclictest21655-21grepconf.sh12:15:123
1458399120,2cyclictest15077-21cp09:57:053
1456499129,3cyclictest25-21ksoftirqd/111:17:141
1456499129,3cyclictest25-21ksoftirqd/111:17:141
1456499122,5cyclictest18770-21bash10:41:551
1456499122,4cyclictest24613-21systemd-cgroups09:52:021
14564991211,1cyclictest25-21ksoftirqd/111:24:431
14564991211,1cyclictest25-21ksoftirqd/110:15:181
14564991210,1cyclictest25-21ksoftirqd/110:27:301
1456499120,12cyclictest0-21swapper/111:43:151
1455799123,4cyclictest24881-21sshd11:36:190
1455799122,4cyclictest8715-21sshd10:35:440
1455799122,4cyclictest31419-21systemd12:08:250
1455799122,4cyclictest30417-21sshd10:22:080
1455799122,4cyclictest26145-21sshd10:16:180
1455799122,4cyclictest25458-21sshd12:13:360
1455799122,4cyclictest22623-21sshd11:30:310
1455799122,4cyclictest0-21swapper/011:07:310
1455799121,5cyclictest29244-21sshd11:42:100
1455799120,2cyclictest604-21grepconf.sh10:42:450
1455799120,12cyclictest24970-21kworker/0:211:56:100
1455799120,12cyclictest24970-21kworker/0:211:56:100
1455799120,11cyclictest27322-21kworker/0:311:20:510
108002120,0sleep30-21swapper/309:36:223
108002120,0sleep30-21swapper/309:36:223
86772110,0sleep10-21swapper/112:05:091
309742110,0sleep10-21swapper/112:13:501
266472110,0sleep20-21swapper/208:23:422
254142110,0sleep7711rcuc/710:46:027
1461499119,1cyclictest73-21ksoftirqd/712:17:107
1461499119,1cyclictest73-21ksoftirqd/710:49:007
1461499119,1cyclictest73-21ksoftirqd/709:45:437
1461499114,3cyclictest2892-21sshd11:03:237
1461499113,7cyclictest464-21systemd-journal10:04:367
14614991110,1cyclictest73-21ksoftirqd/711:43:257
1461499111,4cyclictest11038-21sshd10:24:417
1461499111,4cyclictest0-21swapper/712:25:047
1461499110,5cyclictest3192-21bash10:29:507
1461499110,5cyclictest10314-21sshd09:41:567
1461499110,11cyclictest6953-21kworker/7:509:18:487
1461499110,11cyclictest25669-21kworker/7:010:14:117
1461499110,11cyclictest25669-21kworker/7:010:13:047
1461499110,10cyclictest17344-21sshd09:27:297
1460699119,1cyclictest65-21ksoftirqd/610:36:066
1460699119,1cyclictest0-21swapper/610:16:336
1460699113,7cyclictest709-21systemd-logind10:59:516
1460699113,7cyclictest1190-21bash11:14:216
1460699113,7cyclictest1190-21bash11:14:216
1460699113,2cyclictest709-21systemd-logind11:36:436
1460699113,2cyclictest25380-21bash12:04:136
1460699112,4cyclictest15612-21grep09:12:326
1460699110,5cyclictest3802-21bash11:29:246
1460699110,5cyclictest29864-21grep12:26:536
1460699110,4cyclictest859-21gdbus10:28:396
1460699110,11cyclictest15912-21kworker/6:610:39:546
1460699110,10cyclictest6926-21kworker/6:309:39:596
1460699110,10cyclictest18471-21kworker/6:209:24:116
1460699110,1cyclictest0-21swapper/611:04:006
1458399119,1cyclictest41-21ksoftirqd/311:39:563
1458399119,1cyclictest41-21ksoftirqd/311:21:413
1458399119,1cyclictest41-21ksoftirqd/309:28:383
1458399118,2cyclictest41-21ksoftirqd/311:56:383
1458399118,2cyclictest41-21ksoftirqd/311:56:383
1458399118,1cyclictest41-21ksoftirqd/309:39:363
1458399113,5cyclictest18095-21sshd10:08:263
14583991110,1cyclictest41-21ksoftirqd/310:05:173
14583991110,1cyclictest41-21ksoftirqd/310:02:583
1458399110,1cyclictest0-21swapper/312:11:523
14571991110,1cyclictest33-21ksoftirqd/209:08:252
1456499119,1cyclictest25-21ksoftirqd/112:08:421
1456499119,1cyclictest25-21ksoftirqd/110:29:021
1456499117,1cyclictest25-21ksoftirqd/111:30:371
1456499116,1cyclictest721-21dbus-daemon09:37:511
1456499116,1cyclictest721-21dbus-daemon09:37:511
1456499115,3cyclictest26455-21kworker/1:110:02:541
14564991110,1cyclictest25-21ksoftirqd/110:59:271
14564991110,1cyclictest25-21ksoftirqd/109:25:261
14564991110,1cyclictest25-21ksoftirqd/109:15:451
1456499110,1cyclictest0-21swapper/110:22:411
1455799119,1cyclictest9-21ksoftirqd/009:08:420
1455799119,1cyclictest2063-21sshd09:15:240
1455799118,1cyclictest9-21ksoftirqd/010:52:320
1455799113,7cyclictest13740-21grepconf.sh10:45:180
14557991110,1cyclictest9-21ksoftirqd/009:39:310
14557991110,1cyclictest9-21ksoftirqd/009:24:320
1455799111,4cyclictest22249-21id12:26:250
1455799111,4cyclictest14613-21systemd12:33:290
1455799111,4cyclictest0-21swapper/010:57:140
1455799110,5cyclictest393-21systemd09:46:560
1455799110,11cyclictest12633-21kworker/0:509:22:360
1455799110,10cyclictest24820-21sshd11:00:530
1455799110,10cyclictest17706-21cat09:03:440
1455799110,10cyclictest10689-21sshd11:14:540
1455799110,10cyclictest10689-21sshd11:14:540
1461499103,6cyclictest26564-21sshd09:08:487
1461499103,1cyclictest14081-21sshd11:30:017
1461499102,7cyclictest24034-21sshd12:04:097
1461499102,2cyclictest3975-21bash11:14:317
1461499102,2cyclictest3975-21bash11:14:317
1461499100,4cyclictest857-21polkitd09:14:457
1461499100,4cyclictest5702-21sshd09:30:287
1461499100,4cyclictest0-21swapper/712:33:067
1460699103,6cyclictest0-21swapper/609:13:366
1460699103,1cyclictest27145-21sshd11:43:496
1460699100,4cyclictest30666-21sshd10:03:346
1460699100,4cyclictest1-21systemd10:18:426
1459899109,1cyclictest0-21swapper/507:38:425
1459099109,1cyclictest14228-21kworker/4:107:23:374
1459099108,1cyclictest49-21ksoftirqd/409:08:254
1458399108,1cyclictest41-21ksoftirqd/312:34:203
1458399108,1cyclictest41-21ksoftirqd/312:03:293
1458399108,1cyclictest41-21ksoftirqd/311:51:383
1458399108,1cyclictest41-21ksoftirqd/311:38:183
1458399108,1cyclictest41-21ksoftirqd/310:34:143
1458399108,1cyclictest41-21ksoftirqd/310:28:463
1458399108,1cyclictest41-21ksoftirqd/309:24:393
1458399107,2cyclictest721-21dbus-daemon11:08:533
1458399107,1cyclictest41-21ksoftirqd/309:46:043
1456499109,1cyclictest25-21ksoftirqd/112:36:341
1456499109,1cyclictest0-21swapper/110:33:431
1456499108,1cyclictest25-21ksoftirqd/111:45:411
1456499108,1cyclictest25-21ksoftirqd/111:23:031
1456499108,1cyclictest25-21ksoftirqd/110:58:001
1456499106,4cyclictest25-21ksoftirqd/110:09:201
1456499100,9cyclictest19779-21kworker/1:211:53:311
1456499100,9cyclictest19779-21kworker/1:211:53:311
1455799103,1cyclictest16906-21sshd11:47:030
1455799103,1cyclictest0-21swapper/010:04:010
1455799100,9cyclictest0-21swapper/012:00:120
1455799100,4cyclictest5023-21sshd09:34:070
1455799100,4cyclictest5023-21sshd09:34:070
1455799100,10cyclictest18536-21kworker/0:209:53:340
145989992,4cyclictest16350-21ntp_states07:08:435
145909998,1cyclictest14228-21kworker/4:108:08:414
145839995,3cyclictest41-21ksoftirqd/307:58:253
145719998,1cyclictest33-21ksoftirqd/208:48:392
145719998,1cyclictest33-21ksoftirqd/208:48:392
145649996,2cyclictest2938950sshd10:03:291
145649993,3cyclictest721-21dbus-daemon11:48:351
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional