You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-04 - 06:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Mon May 04, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
51772700,0sleep05137-21sshd23:06:000
289952570,1sleep228989-21sshd00:30:042
124252560,1sleep5758-21runrttasks21:48:365
304332530,0sleep70-21swapper/722:08:577
118132530,0sleep40-21swapper/400:19:254
271662510,1sleep727168-21grepconf.sh23:58:377
199412510,0sleep10-21swapper/122:23:561
86122500,0sleep40-21swapper/421:38:424
43062500,0sleep50-21swapper/522:59:565
1104625025,9sleep70-21swapper/719:06:397
1099525026,9sleep00-21swapper/019:06:000
28582490,0sleep61-21systemd21:59:346
233082490,0sleep50-21swapper/500:18:065
84222480,0sleep20-21swapper/223:37:342
243042480,0sleep00-21swapper/000:22:090
152012480,0sleep715198-21sshd21:48:467
1124224827,8sleep20-21swapper/219:09:232
156892460,0sleep00-21swapper/021:41:020
113162460,0sleep00-21swapper/021:34:540
1094724624,8sleep10-21swapper/119:05:211
44022450,0sleep20-21swapper/223:59:122
256652450,0sleep70-21swapper/722:30:117
49842440,0sleep50-21swapper/522:15:195
300502440,0sleep60-21swapper/623:44:436
238922430,0sleep70-21swapper/721:29:487
196142430,0sleep30-21swapper/322:29:513
139192430,0sleep20-21swapper/222:41:192
303242420,0sleep40-21swapper/421:49:394
279432420,1sleep31-21systemd23:32:543
204942420,0sleep320492-21sshd00:23:563
199802420,0sleep10-21swapper/122:43:351
289372410,1sleep628934-21sshd21:43:496
97792400,0sleep00-21swapper/023:19:460
31022400,1sleep61142999cyclictest22:22:576
264212400,0sleep40-21swapper/421:45:314
161802400,1sleep449-21ksoftirqd/400:31:184
136662400,1sleep113664-21bash22:58:401
1102624027,9sleep50-21swapper/519:06:215
1099824022,14sleep30-21swapper/319:06:033
85202390,1sleep18507-21sshd21:21:171
1119923927,9sleep40-21swapper/419:08:454
1101023927,8sleep60-21swapper/619:06:146
78222370,0sleep20-21swapper/221:11:092
317942370,0sleep1231rcuc/123:09:301
257642370,1sleep51142599cyclictest22:02:465
306642360,0sleep00-21swapper/022:08:580
202772360,0sleep20-21swapper/200:02:012
235972350,0sleep40-21swapper/423:32:394
174772220,0sleep00-21swapper/022:02:170
756-21210,14sshd85150irq/25-em1-rx-021:16:386
148422210,0sleep30-21swapper/323:53:533
1142599210,1cyclictest0-21swapper/523:22:025
1139799213,1cyclictest25-21ksoftirqd/122:11:571
318762200,1sleep233-21ksoftirqd/200:10:262
11425992016,3cyclictest57-21ksoftirqd/523:52:345
11425992016,3cyclictest57-21ksoftirqd/521:21:195
11401992017,2cyclictest2470-21cp00:14:462
1140199200,3cyclictest121rcu_preempt23:02:572
1139799205,1cyclictest25-21ksoftirqd/122:29:321
11397992018,1cyclictest25-21ksoftirqd/121:42:121
1139799201,1cyclictest25-21ksoftirqd/123:40:451
233422190,1sleep023318-21sshd22:47:420
11429991911,4cyclictest65-21ksoftirqd/621:57:046
11425991917,1cyclictest57-21ksoftirqd/523:57:025
11425991913,3cyclictest57-21ksoftirqd/522:23:355
1142599190,3cyclictest131rcu_sched21:13:575
11397991917,1cyclictest25-21ksoftirqd/100:05:501
11397991917,1cyclictest25-21ksoftirqd/100:03:181
1139799191,1cyclictest25-21ksoftirqd/121:44:521
29832180,4sleep50-21swapper/522:24:485
1142599187,3cyclictest57-21ksoftirqd/523:40:155
1142599187,2cyclictest57-21ksoftirqd/522:59:055
1142599183,3cyclictest57-21ksoftirqd/500:09:045
11425991814,3cyclictest57-21ksoftirqd/523:29:445
11425991814,3cyclictest57-21ksoftirqd/522:09:225
1142599181,1cyclictest131rcu_sched22:48:415
1142599180,0cyclictest121rcu_preempt21:58:035
1140199185,1cyclictest33-21ksoftirqd/221:43:382
11401991816,1cyclictest33-21ksoftirqd/221:47:572
11401991813,3cyclictest33-21ksoftirqd/223:09:222
11397991816,1cyclictest25-21ksoftirqd/122:08:321
1139799180,3cyclictest25-21ksoftirqd/100:23:381
30652170,0sleep4471rcuc/421:26:414
118182170,0sleep70-21swapper/722:50:457
1143599171,4cyclictest0-21swapper/721:17:177
11425991715,1cyclictest57-21ksoftirqd/521:17:285
11425991714,3cyclictest57-21ksoftirqd/521:37:365
11425991713,3cyclictest57-21ksoftirqd/523:27:415
1142599171,3cyclictest121rcu_preempt23:37:535
1142599170,2cyclictest721-21dbus-daemon00:00:115
1142599170,1cyclictest0-21swapper/521:41:175
11408991715,1cyclictest41-21ksoftirqd/300:33:063
1140199176,2cyclictest33-21ksoftirqd/222:19:462
11401991716,1cyclictest33-21ksoftirqd/223:26:052
11401991715,1cyclictest464-21systemd-journal23:16:122
11401991713,4cyclictest33-21ksoftirqd/221:59:422
11401991713,1cyclictest33-21ksoftirqd/222:09:402
11401991712,4cyclictest464-21systemd-journal22:48:132
11401991711,3cyclictest33-21ksoftirqd/200:38:172
1140199171,2cyclictest33-21ksoftirqd/222:26:462
1140199170,16cyclictest28777-21kworker/2:223:46:502
1139799173,4cyclictest25-21ksoftirqd/123:25:071
1139799172,3cyclictest25-21ksoftirqd/123:00:431
11397991716,1cyclictest25-21ksoftirqd/123:38:211
11397991715,1cyclictest3299-21grepconf.sh22:38:451
11397991715,1cyclictest25-21ksoftirqd/123:50:571
11397991715,1cyclictest25-21ksoftirqd/121:14:531
11397991712,1cyclictest25-21ksoftirqd/100:18:291
1139799170,2cyclictest131rcu_sched21:34:501
44832160,1sleep34451-21sshd00:14:513
241412160,0sleep6641ktimersoftd/621:33:476
171002160,1sleep017096-21bash21:56:320
11429991615,1cyclictest65-21ksoftirqd/623:02:236
1142599168,3cyclictest57-21ksoftirqd/521:25:055
1142599168,1cyclictest57-21ksoftirqd/523:44:435
1142599163,1cyclictest57-21ksoftirqd/522:29:535
11425991614,1cyclictest57-21ksoftirqd/523:18:005
11425991614,1cyclictest57-21ksoftirqd/500:36:575
11425991614,1cyclictest57-21ksoftirqd/500:30:485
11425991612,3cyclictest57-21ksoftirqd/500:21:135
11425991611,1cyclictest57-21ksoftirqd/500:12:025
11425991610,2cyclictest57-21ksoftirqd/500:27:445
1142599160,1cyclictest0-21swapper/521:53:575
11413991612,3cyclictest49-21ksoftirqd/423:59:034
11408991615,1cyclictest41-21ksoftirqd/321:27:573
1140199163,3cyclictest33-21ksoftirqd/222:39:032
11401991615,1cyclictest33-21ksoftirqd/223:09:472
11401991614,1cyclictest33-21ksoftirqd/223:49:552
11401991614,1cyclictest33-21ksoftirqd/223:22:422
11401991614,1cyclictest33-21ksoftirqd/222:14:482
11401991614,1cyclictest33-21ksoftirqd/221:22:482
11401991614,1cyclictest33-21ksoftirqd/200:22:142
11401991613,3cyclictest33-21ksoftirqd/221:53:172
11401991613,1cyclictest33-21ksoftirqd/222:54:552
11401991612,3cyclictest33-21ksoftirqd/200:25:492
11401991611,4cyclictest464-21systemd-journal22:52:162
11401991610,4cyclictest33-21ksoftirqd/221:28:442
1140199161,1cyclictest33-21ksoftirqd/222:05:312
1139799167,1cyclictest25-21ksoftirqd/123:33:221
1139799162,1cyclictest25-21ksoftirqd/100:27:081
11397991614,1cyclictest25-21ksoftirqd/123:54:541
11397991614,1cyclictest25-21ksoftirqd/122:53:341
11397991614,1cyclictest25-21ksoftirqd/122:44:521
11397991614,1cyclictest25-21ksoftirqd/122:34:141
11397991614,1cyclictest25-21ksoftirqd/121:56:021
11397991614,1cyclictest25-21ksoftirqd/121:51:121
11397991614,1cyclictest25-21ksoftirqd/121:29:431
11397991614,1cyclictest25-21ksoftirqd/121:26:081
11397991614,1cyclictest25-21ksoftirqd/100:36:151
11397991613,2cyclictest25-21ksoftirqd/121:14:251
11397991613,1cyclictest25-21ksoftirqd/122:02:091
1139799161,3cyclictest0-21swapper/123:20:021
1139799161,2cyclictest121rcu_preempt23:46:331
1139799160,3cyclictest25-21ksoftirqd/123:19:021
11391991614,1cyclictest9-21ksoftirqd/000:34:120
1139199160,15cyclictest5114-21kworker/0:022:20:270
255102150,1sleep325500-21bash21:33:523
11429991513,1cyclictest65-21ksoftirqd/623:20:336
11429991513,1cyclictest65-21ksoftirqd/622:59:246
11429991513,1cyclictest65-21ksoftirqd/622:18:516
11429991513,1cyclictest65-21ksoftirqd/621:35:096
11429991511,3cyclictest65-21ksoftirqd/623:34:086
11429991511,1cyclictest65-21ksoftirqd/621:53:286
1142999150,15cyclictest1785-21kworker/6:022:08:346
11425991513,1cyclictest57-21ksoftirqd/523:13:335
11425991512,3cyclictest57-21ksoftirqd/522:42:435
11425991511,1cyclictest57-21ksoftirqd/522:54:315
11425991511,1cyclictest57-21ksoftirqd/521:32:275
11425991510,1cyclictest57-21ksoftirqd/523:06:285
11408991513,1cyclictest41-21ksoftirqd/322:03:583
11408991511,2cyclictest41-21ksoftirqd/321:48:583
11408991510,5cyclictest41-21ksoftirqd/323:57:243
11408991510,4cyclictest41-21ksoftirqd/321:20:193
1140199159,3cyclictest33-21ksoftirqd/223:43:162
11401991514,1cyclictest33-21ksoftirqd/223:29:542
11401991513,1cyclictest33-21ksoftirqd/200:06:342
11397991514,1cyclictest25-21ksoftirqd/100:10:161
11397991513,1cyclictest25-21ksoftirqd/123:10:471
11397991513,1cyclictest25-21ksoftirqd/122:15:061
11397991513,1cyclictest25-21ksoftirqd/100:32:081
57852140,0sleep4471rcuc/423:21:264
308892140,0sleep70-21swapper/721:38:057
263332140,0sleep70-21swapper/721:41:417
13682140,1sleep31373-21bash23:29:023
11429991413,1cyclictest65-21ksoftirqd/623:55:286
11429991413,1cyclictest65-21ksoftirqd/623:16:066
11429991412,1cyclictest65-21ksoftirqd/623:28:036
11429991412,1cyclictest65-21ksoftirqd/623:10:046
11429991412,1cyclictest65-21ksoftirqd/622:48:216
11429991412,1cyclictest65-21ksoftirqd/622:10:456
11429991412,1cyclictest65-21ksoftirqd/621:48:566
11429991412,1cyclictest65-21ksoftirqd/600:04:536
11429991410,3cyclictest65-21ksoftirqd/621:24:556
11429991410,1cyclictest65-21ksoftirqd/621:22:026
11425991412,1cyclictest57-21ksoftirqd/522:09:515
11425991411,1cyclictest57-21ksoftirqd/522:34:445
1141399142,2cyclictest0-21swapper/420:49:464
11413991411,1cyclictest49-21ksoftirqd/422:23:114
1141399140,13cyclictest21388-21kworker/4:200:20:234
11408991412,1cyclictest41-21ksoftirqd/322:20:273
1140899140,13cyclictest20752-21kworker/3:223:06:553
1140199143,3cyclictest33-21ksoftirqd/222:29:382
11401991412,1cyclictest33-21ksoftirqd/221:29:522
11401991412,1cyclictest33-21ksoftirqd/221:15:172
11401991411,1cyclictest33-21ksoftirqd/221:56:132
1140199140,13cyclictest23103-21kworker/2:421:35:012
1139199149,4cyclictest9-21ksoftirqd/023:19:020
11391991412,1cyclictest9-21ksoftirqd/023:59:120
11391991412,1cyclictest9-21ksoftirqd/022:54:470
11391991412,1cyclictest9-21ksoftirqd/022:25:460
11391991412,1cyclictest9-21ksoftirqd/000:00:240
11391991410,1cyclictest9-21ksoftirqd/023:37:240
102102140,0sleep30-21swapper/323:11:563
301702130,1sleep449-21ksoftirqd/422:38:254
11435991310,2cyclictest6681-21bash00:14:587
1142999139,3cyclictest65-21ksoftirqd/600:37:386
1142999139,1cyclictest65-21ksoftirqd/622:49:556
1142999137,2cyclictest65-21ksoftirqd/623:07:186
11429991311,2cyclictest65-21ksoftirqd/623:34:396
11429991311,1cyclictest65-21ksoftirqd/622:43:356
11429991311,1cyclictest65-21ksoftirqd/622:30:086
11429991311,1cyclictest65-21ksoftirqd/621:11:576
11429991311,1cyclictest65-21ksoftirqd/600:25:286
11429991311,1cyclictest65-21ksoftirqd/600:22:336
11413991311,1cyclictest49-21ksoftirqd/423:46:534
11408991312,1cyclictest41-21ksoftirqd/323:20:303
11408991312,1cyclictest41-21ksoftirqd/322:59:353
11408991312,1cyclictest41-21ksoftirqd/322:51:463
11408991312,1cyclictest41-21ksoftirqd/300:10:563
11408991311,1cyclictest41-21ksoftirqd/322:24:343
11408991311,1cyclictest41-21ksoftirqd/321:53:333
11408991311,1cyclictest41-21ksoftirqd/300:26:393
11408991310,1cyclictest41-21ksoftirqd/323:35:503
1140899130,12cyclictest13982-21kworker/3:221:39:423
1139199138,1cyclictest9-21ksoftirqd/023:02:120
1139199137,3cyclictest27281-21kworker/0:521:21:060
11391991312,1cyclictest9-21ksoftirqd/023:30:290
11391991312,1cyclictest9-21ksoftirqd/022:34:520
11391991312,1cyclictest9-21ksoftirqd/021:31:000
11391991311,1cyclictest9-21ksoftirqd/023:11:260
11391991311,1cyclictest9-21ksoftirqd/022:15:310
11391991311,1cyclictest9-21ksoftirqd/022:14:310
11391991311,1cyclictest9-21ksoftirqd/021:51:370
11391991311,1cyclictest9-21ksoftirqd/021:47:480
11391991311,1cyclictest9-21ksoftirqd/000:09:120
1139199130,13cyclictest966-21kworker/0:423:45:540
1139199130,12cyclictest4694-21kworker/0:022:52:450
11435991210,1cyclictest73-21ksoftirqd/722:46:097
1143599120,2cyclictest709-21systemd-logind23:30:597
1143599120,12cyclictest24861-21kworker/7:400:07:207
1143599120,11cyclictest24405-21sshd21:12:247
1143599120,11cyclictest1-21systemd22:15:287
1142999129,3cyclictest65-21ksoftirqd/600:00:506
11429991211,1cyclictest65-21ksoftirqd/622:35:156
11429991211,1cyclictest65-21ksoftirqd/600:15:426
11429991210,1cyclictest65-21ksoftirqd/623:54:216
11429991210,1cyclictest65-21ksoftirqd/623:39:546
11429991210,1cyclictest65-21ksoftirqd/600:12:046
11429991210,1cyclictest464-21systemd-journal22:27:416
1142999121,1cyclictest131rcu_sched00:34:016
1141399123,5cyclictest31203-21sshd00:12:234
11413991210,2cyclictest4681-21sshd22:52:164
11413991210,1cyclictest49-21ksoftirqd/421:21:364
1141399120,11cyclictest25424-21kworker/4:223:18:354
1141399120,11cyclictest0-21swapper/421:40:034
11408991211,1cyclictest41-21ksoftirqd/322:05:293
11408991211,1cyclictest41-21ksoftirqd/300:05:123
11408991210,1cyclictest41-21ksoftirqd/322:40:563
11408991210,1cyclictest41-21ksoftirqd/321:13:483
11408991210,1cyclictest41-21ksoftirqd/300:36:353
11408991210,1cyclictest41-21ksoftirqd/300:04:053
1140899120,11cyclictest709-21systemd-logind22:58:133
1139199127,4cyclictest9-21ksoftirqd/021:10:560
1139199122,4cyclictest0-21swapper/023:26:370
11391991211,1cyclictest9-21ksoftirqd/000:38:280
11391991210,1cyclictest9-21ksoftirqd/023:53:410
11391991210,1cyclictest9-21ksoftirqd/023:43:320
11391991210,1cyclictest9-21ksoftirqd/022:40:310
11391991210,1cyclictest9-21ksoftirqd/021:15:300
11391991210,1cyclictest9-21ksoftirqd/000:24:510
11391991210,1cyclictest9-21ksoftirqd/000:14:320
1139199120,11cyclictest20953-21bash21:27:460
1139199120,1cyclictest23214-21sshd22:30:030
10412120,0sleep30-21swapper/321:36:173
33552110,0sleep00-21swapper/019:49:480
306332110,0sleep40-21swapper/400:08:274
216532119,1sleep773-21ksoftirqd/722:43:427
1143599119,1cyclictest73-21ksoftirqd/700:25:487
1143599119,1cyclictest0-21swapper/721:25:587
1143599115,2cyclictest721-21dbus-daemon22:54:597
1143599113,2cyclictest12059-21systemd-cgroups23:59:397
1143599112,5cyclictest857-21polkitd23:22:307
1143599112,5cyclictest15971-21bash22:21:487
11435991110,1cyclictest73-21ksoftirqd/721:22:377
1141399119,1cyclictest49-21ksoftirqd/423:25:384
1141399119,1cyclictest49-21ksoftirqd/422:42:514
1141399119,1cyclictest49-21ksoftirqd/422:25:474
1141399119,1cyclictest26213-21tune2fs22:14:444
1141399118,2cyclictest49-21ksoftirqd/421:11:114
1141399113,5cyclictest25598-21kworker/4:423:03:584
1141399113,4cyclictest29405-21sshd22:30:254
1141399112,5cyclictest28458-21systemd00:35:484
1141399112,4cyclictest3037-21sshd23:11:304
11413991110,1cyclictest49-21ksoftirqd/421:58:404
11413991110,1cyclictest0-21swapper/423:08:104
1141399110,1cyclictest709-21systemd-logind22:58:244
1141399110,1cyclictest0-21swapper/422:06:414
1140899119,1cyclictest41-21ksoftirqd/323:44:403
1140899119,1cyclictest41-21ksoftirqd/323:43:183
1140899119,1cyclictest41-21ksoftirqd/323:15:383
1140899119,1cyclictest41-21ksoftirqd/322:39:233
1140899119,1cyclictest41-21ksoftirqd/322:16:403
1140899115,3cyclictest15455-21rm21:16:033
11408991110,1cyclictest41-21ksoftirqd/321:55:403
11397991110,1cyclictest6082-21kworker/1:020:27:451
1139799110,10cyclictest29498-21ntp_states20:34:501
1139199119,1cyclictest9-21ksoftirqd/000:09:480
1143599109,1cyclictest73-21ksoftirqd/723:51:367
1143599108,1cyclictest73-21ksoftirqd/723:42:377
1143599108,1cyclictest73-21ksoftirqd/723:34:367
1143599108,1cyclictest73-21ksoftirqd/722:00:367
1143599106,4cyclictest73-21ksoftirqd/722:35:557
1143599104,4cyclictest0-21swapper/700:30:417
1143599104,3cyclictest721-21dbus-daemon23:44:337
1143599103,4cyclictest721-21dbus-daemon22:29:077
1143599103,3cyclictest24582-21grepconf.sh23:24:357
1143599102,5cyclictest29671-21grep22:10:487
1143599100,1cyclictest0-21swapper/700:37:407
1142599108,1cyclictest57-21ksoftirqd/520:34:325
1141399108,1cyclictest49-21ksoftirqd/422:13:364
1141399107,3cyclictest49-21ksoftirqd/421:31:374
1141399104,3cyclictest12608-21sshd23:43:414
1141399103,4cyclictest17032-21sshd00:01:494
1141399102,5cyclictest464-21systemd-journal22:48:114
1141399100,9cyclictest32159-21kworker/4:322:02:514
1141399100,9cyclictest30113-21kworker/4:500:24:544
1140899108,1cyclictest41-21ksoftirqd/322:09:573
1140899103,4cyclictest3565-21grep22:46:203
1139799109,1cyclictest6082-21kworker/1:020:22:431
15763290,2sleep416020-21bash23:36:014
114359997,1cyclictest73-21ksoftirqd/723:10:177
114359997,1cyclictest73-21ksoftirqd/723:05:467
114359997,1cyclictest73-21ksoftirqd/721:51:297
114359994,2cyclictest1-21systemd23:15:437
114359993,2cyclictest22139-21kill00:20:007
114359992,4cyclictest10010-21cp23:00:177
114359990,9cyclictest0-21swapper/719:09:457
114359990,8cyclictest31854-21kworker/7:221:56:587
114359990,8cyclictest16215-21kworker/7:000:09:557
114259998,1cyclictest57-21ksoftirqd/519:24:325
114259992,4cyclictest0-21swapper/519:47:335
114139997,1cyclictest49-21ksoftirqd/423:51:444
114139997,1cyclictest464-21systemd-journal21:15:274
114139990,9cyclictest0-21swapper/420:29:444
114089990,9cyclictest0-21swapper/320:29:333
113979998,1cyclictest6082-21kworker/1:019:52:551
113979998,1cyclictest6082-21kworker/1:019:14:471
113919991,4cyclictest25572-21diskstats20:29:440
113919990,0cyclictest0-21swapper/019:19:450
114359983,1cyclictest0-21swapper/720:09:227
114259986,1cyclictest57-21ksoftirqd/520:39:325
114259982,3cyclictest0-21swapper/519:43:195
114019987,1cyclictest33-21ksoftirqd/219:09:442
114019986,1cyclictest33-21ksoftirqd/219:54:432
113979988,0cyclictest0-21swapper/119:09:421
113979987,1cyclictest6082-21kworker/1:020:52:111
113919983,2cyclictest0-21swapper/020:39:320
114299975,1cyclictest65-21ksoftirqd/619:59:316
114299975,1cyclictest65-21ksoftirqd/619:12:176
114259975,1cyclictest57-21ksoftirqd/520:51:335
114259975,1cyclictest57-21ksoftirqd/520:20:125
114259974,3cyclictest57-21ksoftirqd/519:49:435
114259973,4cyclictest57-21ksoftirqd/520:40:135
114259970,6cyclictest18018-21ntp_states20:14:505
114259970,4cyclictest0-21swapper/520:59:535
114259970,4cyclictest0-21swapper/520:54:475
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional