You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 06:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Thu Dec 11, 2025 00:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
172722980,2sleep2313799cyclictest22:21:522
22102690,2sleep6317299cyclictest22:52:326
111042580,1sleep09-21ksoftirqd/000:02:260
64192480,6sleep665-21ksoftirqd/623:00:496
40152480,0sleep20-21swapper/200:13:492
284082480,0sleep30-21swapper/321:53:583
119292480,0sleep20-21swapper/221:49:572
6982470,1sleep6699-21unixbench-2d20:39:056
215232470,0sleep00-21swapper/023:30:540
73572460,0sleep0111rcuc/021:57:320
72052460,0sleep60-21swapper/623:53:436
67702460,0sleep30-21swapper/323:16:403
31702460,0sleep60-21swapper/600:13:456
228922450,0sleep40-21swapper/422:59:274
129052450,10sleep685350irq/25-em1-rx-022:26:456
57292440,0sleep00-21swapper/021:36:250
230652440,0sleep00-21swapper/021:40:260
153822440,0sleep00-21swapper/022:03:240
152722430,2sleep4315699cyclictest22:50:544
115492430,0sleep2763-21runrttasks23:11:502
47662420,0sleep40-21swapper/420:59:454
277124229,9sleep70-21swapper/718:51:467
5022410,0sleep557-21ksoftirqd/522:17:555
288624129,9sleep50-21swapper/518:53:205
270024128,9sleep30-21swapper/318:50:453
121042410,0sleep665-21ksoftirqd/600:23:226
110782410,0sleep60-21swapper/622:55:526
287424029,8sleep20-21swapper/218:53:092
278824027,9sleep60-21swapper/618:52:016
274124027,9sleep40-21swapper/418:51:184
182882400,0sleep20-21swapper/223:14:542
172922400,0sleep70-21swapper/721:13:587
122992400,0sleep40-21swapper/423:51:254
109492400,0sleep2321ktimersoftd/223:30:002
36822390,0sleep5763-21runrttasks22:52:395
35623927,8sleep00-21swapper/018:48:500
268023928,8sleep10-21swapper/118:50:271
14722390,0sleep40-21swapper/400:04:224
66272380,0sleep60-21swapper/622:13:086
39482380,0sleep40-21swapper/423:13:524
301342380,0sleep00-21swapper/021:33:130
129392360,0sleep00-21swapper/022:50:420
123262360,4sleep30-21swapper/323:19:363
234992340,0sleep70-21swapper/721:22:157
318099225,5cyclictest0-21swapper/700:19:257
318099211,19cyclictest32106-21sshd23:47:437
318099198,10cyclictest0-21swapper/719:49:417
318099198,10cyclictest0-21swapper/719:19:387
318099198,0cyclictest0-21swapper/720:56:157
318099198,0cyclictest0-21swapper/720:06:417
318099197,0cyclictest0-21swapper/722:21:097
312899198,2cyclictest25-21ksoftirqd/122:18:541
3128991913,3cyclictest25-21ksoftirqd/121:28:571
318099188,10cyclictest0-21swapper/719:34:497
318099187,10cyclictest0-21swapper/720:40:297
318099187,10cyclictest0-21swapper/720:00:237
318099187,10cyclictest0-21swapper/719:12:467
318099185,5cyclictest0-21swapper/719:30:097
318099184,13cyclictest20066-21id23:52:057
318099181,5cyclictest0-21swapper/723:39:357
318099181,5cyclictest0-21swapper/720:21:377
318099180,6cyclictest0-21swapper/723:21:357
315699180,16cyclictest19262-21sshd23:12:294
3137991815,1cyclictest29717-21grepconf.sh21:33:112
3137991814,3cyclictest33-21ksoftirqd/223:21:102
3128991817,1cyclictest25-21ksoftirqd/122:24:041
3121991814,1cyclictest9-21ksoftirqd/023:13:060
318099177,6cyclictest0-21swapper/719:45:257
318099176,5cyclictest0-21swapper/723:02:077
318099176,5cyclictest0-21swapper/722:54:397
318099176,5cyclictest0-21swapper/722:18:337
318099176,5cyclictest0-21swapper/721:53:377
318099176,5cyclictest0-21swapper/721:33:297
318099176,5cyclictest0-21swapper/720:17:097
318099176,5cyclictest0-21swapper/719:18:427
318099176,5cyclictest0-21swapper/700:13:037
318099176,0cyclictest0-21swapper/722:03:177
318099176,0cyclictest0-21swapper/721:09:537
318099176,0cyclictest0-21swapper/720:43:577
318099176,0cyclictest0-21swapper/720:36:317
318099176,0cyclictest0-21swapper/719:42:377
318099176,0cyclictest0-21swapper/719:06:487
318099175,5cyclictest0-21swapper/720:30:377
318099175,11cyclictest711-21dbus-daemon00:04:057
318099175,11cyclictest24756-21sshd22:04:017
3137991714,3cyclictest33-21ksoftirqd/222:10:332
3137991714,1cyclictest33-21ksoftirqd/221:07:072
3137991713,3cyclictest33-21ksoftirqd/222:30:502
313799170,0cyclictest121rcu_preempt23:40:202
312899178,1cyclictest25-21ksoftirqd/100:14:541
312899175,3cyclictest25-21ksoftirqd/122:04:181
312899173,1cyclictest25-21ksoftirqd/122:44:211
3128991716,1cyclictest25-21ksoftirqd/121:00:031
3128991715,1cyclictest25-21ksoftirqd/121:22:081
3128991715,1cyclictest25-21ksoftirqd/121:04:301
3128991715,1cyclictest25-21ksoftirqd/100:19:011
3128991714,1cyclictest25-21ksoftirqd/123:28:531
3128991714,1cyclictest25-21ksoftirqd/122:51:311
3128991713,3cyclictest25-21ksoftirqd/121:49:551
312899170,16cyclictest5164-21kworker/1:023:55:211
318099165,5cyclictest0-21swapper/723:17:457
318099165,5cyclictest0-21swapper/721:53:437
318099165,5cyclictest0-21swapper/721:37:257
318099165,5cyclictest0-21swapper/719:24:327
318099165,0cyclictest0-21swapper/720:48:457
318099165,0cyclictest0-21swapper/720:24:417
318099165,0cyclictest0-21swapper/720:08:537
318099165,0cyclictest0-21swapper/719:00:487
318099165,0cyclictest0-21swapper/700:16:157
3180991610,5cyclictest31917-21bash22:44:157
318099160,4cyclictest0-21swapper/722:28:457
317742160,0sleep40-21swapper/423:21:134
3148991611,4cyclictest1-21systemd21:05:583
3137991615,1cyclictest33-21ksoftirqd/200:00:282
3137991614,1cyclictest33-21ksoftirqd/222:14:562
3137991614,1cyclictest33-21ksoftirqd/221:54:042
3137991614,1cyclictest33-21ksoftirqd/200:12:072
3137991613,1cyclictest33-21ksoftirqd/222:56:322
3137991613,1cyclictest33-21ksoftirqd/220:55:012
3137991612,1cyclictest33-21ksoftirqd/222:06:412
3137991611,3cyclictest33-21ksoftirqd/222:45:302
3137991611,2cyclictest859-21polkitd22:59:292
312899166,1cyclictest25-21ksoftirqd/122:18:061
3128991615,1cyclictest25-21ksoftirqd/122:58:581
3128991615,1cyclictest25-21ksoftirqd/122:13:231
3128991615,1cyclictest25-21ksoftirqd/121:42:561
3128991614,2cyclictest25-21ksoftirqd/100:06:521
3128991614,1cyclictest25-21ksoftirqd/123:35:111
3128991614,1cyclictest25-21ksoftirqd/123:24:331
3128991614,1cyclictest25-21ksoftirqd/123:11:131
3128991614,1cyclictest25-21ksoftirqd/123:06:051
3128991614,1cyclictest25-21ksoftirqd/122:57:471
3128991614,1cyclictest25-21ksoftirqd/122:37:191
3128991614,1cyclictest25-21ksoftirqd/122:30:361
3128991614,1cyclictest25-21ksoftirqd/121:36:361
3128991614,1cyclictest25-21ksoftirqd/100:11:531
3128991613,3cyclictest25-21ksoftirqd/123:49:191
3128991613,1cyclictest25-21ksoftirqd/121:44:441
3128991613,1cyclictest25-21ksoftirqd/121:12:121
3128991611,3cyclictest25-21ksoftirqd/121:54:251
17492160,2sleep0312199cyclictest23:21:250
318099158,5cyclictest0-21swapper/723:29:177
318099158,5cyclictest0-21swapper/722:09:537
318099158,0cyclictest0-21swapper/722:26:017
318099157,5cyclictest0-21swapper/723:59:517
318099157,5cyclictest0-21swapper/723:05:017
318099157,5cyclictest0-21swapper/722:34:257
318099157,5cyclictest0-21swapper/721:39:457
318099157,0cyclictest0-21swapper/722:48:537
318099156,5cyclictest0-21swapper/723:57:097
318099156,5cyclictest0-21swapper/721:44:057
318099156,5cyclictest0-21swapper/721:25:497
318099155,5cyclictest0-21swapper/718:58:387
318099154,5cyclictest0-21swapper/722:38:577
318099154,5cyclictest0-21swapper/722:38:577
318099154,0cyclictest0-21swapper/723:35:457
318099154,0cyclictest0-21swapper/723:24:237
318099154,0cyclictest0-21swapper/719:58:237
318099150,5cyclictest0-21swapper/723:09:377
318099150,0cyclictest0-21swapper/721:04:097
3172991513,1cyclictest65-21ksoftirqd/623:05:386
317299151,8cyclictest25793-21bash00:03:496
313799159,3cyclictest33-21ksoftirqd/222:38:462
313799159,3cyclictest33-21ksoftirqd/222:38:462
313799152,3cyclictest33-21ksoftirqd/221:28:372
3137991514,1cyclictest33-21ksoftirqd/221:18:432
3137991513,1cyclictest33-21ksoftirqd/223:33:482
3137991513,1cyclictest33-21ksoftirqd/222:36:462
3137991513,1cyclictest33-21ksoftirqd/222:00:262
3137991513,1cyclictest33-21ksoftirqd/221:38:582
3137991513,1cyclictest33-21ksoftirqd/221:09:102
3137991513,1cyclictest33-21ksoftirqd/221:00:592
3137991513,1cyclictest33-21ksoftirqd/200:20:162
3137991512,3cyclictest33-21ksoftirqd/221:46:272
3137991511,3cyclictest33-21ksoftirqd/223:04:022
313799150,2cyclictest131rcu_sched23:55:462
312899155,3cyclictest25-21ksoftirqd/123:19:181
3128991514,1cyclictest25-21ksoftirqd/123:15:201
3128991514,1cyclictest1810-21kworker/1:220:17:031
3128991513,1cyclictest25-21ksoftirqd/123:44:091
3128991513,1cyclictest25-21ksoftirqd/122:39:221
3128991513,1cyclictest25-21ksoftirqd/122:39:221
3128991513,1cyclictest25-21ksoftirqd/121:14:061
3128991511,4cyclictest25-21ksoftirqd/123:41:141
3128991511,1cyclictest25-21ksoftirqd/122:02:201
3128991510,3cyclictest25-21ksoftirqd/100:01:271
3121991513,1cyclictest9-21ksoftirqd/022:33:150
3121991513,1cyclictest9-21ksoftirqd/000:18:390
316499148,5cyclictest859-21polkitd23:28:565
316499145,2cyclictest861-21gdbus23:55:425
316499143,5cyclictest0-21swapper/523:35:055
316499143,2cyclictest5469-21sshd21:44:115
316499140,3cyclictest0-21swapper/500:20:575
316499140,14cyclictest0-21swapper/522:35:375
316499140,1cyclictest0-21swapper/519:09:585
3137991413,1cyclictest33-21ksoftirqd/222:24:252
3137991412,1cyclictest33-21ksoftirqd/223:47:232
3137991412,1cyclictest33-21ksoftirqd/222:52:292
3137991412,1cyclictest33-21ksoftirqd/221:34:332
3137991412,1cyclictest33-21ksoftirqd/221:19:412
3137991411,2cyclictest33-21ksoftirqd/223:49:252
3137991411,2cyclictest33-21ksoftirqd/223:24:202
313799140,2cyclictest131rcu_sched00:04:062
3128991412,1cyclictest25-21ksoftirqd/120:55:001
3128991410,1cyclictest25-21ksoftirqd/121:24:301
3121991413,1cyclictest9-21ksoftirqd/023:06:170
3121991413,1cyclictest9-21ksoftirqd/022:39:530
3121991413,1cyclictest9-21ksoftirqd/022:39:530
3121991413,1cyclictest9-21ksoftirqd/022:04:100
3121991413,1cyclictest9-21ksoftirqd/021:13:560
3121991412,1cyclictest9-21ksoftirqd/023:48:590
3121991412,1cyclictest9-21ksoftirqd/021:04:090
312199140,2cyclictest131rcu_sched23:57:220
312199140,13cyclictest17488-21kworker/0:123:17:280
26392140,0sleep40-21swapper/423:32:024
322382130,0sleep00-21swapper/022:36:160
318099137,5cyclictest0-21swapper/721:02:457
3172991310,1cyclictest85350irq/25-em1-rx-023:10:416
316499133,10cyclictest0-21swapper/519:39:295
316499132,5cyclictest9119-21bash22:08:055
316499132,5cyclictest6750-21bash23:48:195
316499132,5cyclictest0-21swapper/500:00:015
316499130,7cyclictest0-21swapper/520:53:095
316499130,13cyclictest0-21swapper/521:22:145
316499130,13cyclictest0-21swapper/520:40:415
316499130,11cyclictest711-21dbus-daemon21:33:565
316499130,1cyclictest0-21swapper/520:27:195
316499130,1cyclictest0-21swapper/519:48:395
315699132,4cyclictest0-21swapper/400:18:424
3148991311,1cyclictest0-21swapper/321:52:133
314899130,12cyclictest21912-21sshd22:40:513
314899130,12cyclictest21912-21sshd22:40:513
3128991310,1cyclictest25-21ksoftirqd/119:53:571
3121991312,1cyclictest9-21ksoftirqd/022:24:010
3121991312,1cyclictest9-21ksoftirqd/022:21:030
3121991312,1cyclictest9-21ksoftirqd/021:43:590
3121991311,1cyclictest9-21ksoftirqd/022:57:240
3121991311,1cyclictest9-21ksoftirqd/022:09:360
3121991311,1cyclictest9-21ksoftirqd/021:23:560
3121991311,1cyclictest9-21ksoftirqd/021:03:420
312199130,12cyclictest13835-21kworker/0:023:28:420
267832130,0sleep40-21swapper/423:05:034
317299129,2cyclictest18981-21bash22:43:216
317299129,2cyclictest18981-21bash22:43:216
317299122,4cyclictest18519-21sshd21:37:306
3172991211,1cyclictest85350irq/25-em1-rx-019:58:576
316499127,4cyclictest711-21dbus-daemon22:30:295
316499126,5cyclictest0-21swapper/521:14:015
316499124,3cyclictest26411-21grepconf.sh23:39:095
3164991210,1cyclictest57-21ksoftirqd/523:02:485
316499121,11cyclictest0-21swapper/521:03:515
316499120,6cyclictest0-21swapper/520:35:375
316499120,6cyclictest0-21swapper/520:00:295
316499120,6cyclictest0-21swapper/518:55:545
316499120,12cyclictest0-21swapper/522:12:085
316499120,12cyclictest0-21swapper/520:30:535
316499120,12cyclictest0-21swapper/520:06:015
316499120,12cyclictest0-21swapper/519:56:335
316499120,1cyclictest0-21swapper/523:49:375
316499120,1cyclictest0-21swapper/519:02:025
316499120,0cyclictest0-21swapper/500:03:455
315699122,4cyclictest732-21NetworkManager22:13:504
315699122,4cyclictest360-21sshd21:36:004
315699122,4cyclictest24375-21sshd21:24:484
315699122,4cyclictest24050-21sshd22:11:524
315699122,4cyclictest15909-21sshd22:00:464
315699120,11cyclictest0-21swapper/421:28:534
314899126,4cyclictest5473-21kworker/3:121:29:213
3148991210,1cyclictest41-21ksoftirqd/319:28:423
3128991211,1cyclictest8516-21kworker/1:019:04:061
3128991211,1cyclictest25-21ksoftirqd/119:38:431
312199129,2cyclictest9-21ksoftirqd/021:19:160
312199128,4cyclictest9-21ksoftirqd/000:19:430
312199128,1cyclictest9-21ksoftirqd/022:44:100
3121991211,1cyclictest9-21ksoftirqd/023:00:020
3121991211,1cyclictest9-21ksoftirqd/022:14:010
3121991211,1cyclictest9-21ksoftirqd/000:09:030
3121991210,1cyclictest9-21ksoftirqd/021:51:000
310652120,0sleep30-21swapper/321:28:033
269442120,0sleep40-21swapper/421:04:104
114372120,0sleep50-21swapper/522:58:405
317299119,1cyclictest65-21ksoftirqd/623:36:436
317299119,1cyclictest15454-21sshd21:45:016
317299111,4cyclictest32050-21grep23:29:026
317299111,4cyclictest2587-21sshd21:18:026
317299110,5cyclictest6576-21grepconf.sh23:45:336
317299110,5cyclictest0-21swapper/600:12:156
317299110,11cyclictest0-21swapper/600:02:576
317299110,10cyclictest29010-21sshd21:04:216
316499119,1cyclictest57-21ksoftirqd/521:51:015
316499116,5cyclictest0-21swapper/520:54:375
316499116,5cyclictest0-21swapper/519:49:055
316499116,4cyclictest13703-21sshd22:45:295
316499110,5cyclictest0-21swapper/522:27:135
316499110,5cyclictest0-21swapper/520:12:395
316499110,5cyclictest0-21swapper/519:08:265
316499110,11cyclictest0-21swapper/523:20:375
316499110,11cyclictest0-21swapper/523:08:495
316499110,11cyclictest0-21swapper/521:32:335
316499110,11cyclictest0-21swapper/520:47:575
316499110,10cyclictest13751-21sshd23:17:155
316499110,1cyclictest0-21swapper/522:39:055
316499110,1cyclictest0-21swapper/522:39:055
316499110,0cyclictest0-21swapper/521:39:415
316499110,0cyclictest0-21swapper/500:14:475
315699111,4cyclictest6645-21sshd22:42:174
315699111,4cyclictest6645-21sshd22:42:174
315699111,4cyclictest31819-21sshd00:13:264
315699111,4cyclictest30532-21sshd22:25:314
315699111,4cyclictest0-21swapper/423:54:224
315699110,5cyclictest8027-21bash21:39:104
315699110,11cyclictest0-21swapper/422:20:334
315699110,10cyclictest16358-21sshd20:58:084
315699110,10cyclictest1-21systemd00:00:334
314899119,1cyclictest28955-21sshd00:10:123
314899119,1cyclictest1-21systemd00:17:343
314899110,11cyclictest10512-21kworker/3:422:20:223
314899110,11cyclictest0-21swapper/322:35:553
312899119,1cyclictest25-21ksoftirqd/119:48:431
312899119,1cyclictest25-21ksoftirqd/119:28:421
3128991111,0cyclictest22071-21kworker/1:020:35:571
3128991110,1cyclictest898-21kworker/1:220:44:371
3128991110,1cyclictest8516-21kworker/1:019:18:181
3128991110,1cyclictest1810-21kworker/1:219:49:091
312199119,1cyclictest9-21ksoftirqd/023:48:020
312199119,1cyclictest9-21ksoftirqd/023:34:490
3121991110,1cyclictest9-21ksoftirqd/023:38:490
3121991110,1cyclictest9-21ksoftirqd/021:08:530
3121991110,1cyclictest9-21ksoftirqd/020:53:490
3121991110,1cyclictest9-21ksoftirqd/000:05:450
317299109,1cyclictest65-21ksoftirqd/622:45:206
317299101,5cyclictest14985-21bash23:17:206
317299101,4cyclictest0-21swapper/622:04:566
317299100,10cyclictest0-21swapper/621:41:096
317299100,1cyclictest85350irq/25-em1-rx-022:21:176
316499108,1cyclictest57-21ksoftirqd/521:28:425
316499100,5cyclictest0-21swapper/523:26:235
316499100,1cyclictest8097-21bash22:21:075
315699109,1cyclictest49-21ksoftirqd/422:54:334
315699109,1cyclictest49-21ksoftirqd/421:08:504
315699107,2cyclictest15175-21bash23:27:474
315699103,6cyclictest25188-21sshd23:44:234
315699103,6cyclictest2196-21grep21:54:234
315699101,3cyclictest3637-21sshd21:44:044
315699100,4cyclictest1841-21sshd22:31:024
315699100,4cyclictest0-21swapper/422:38:334
315699100,4cyclictest0-21swapper/422:05:234
314899109,1cyclictest0-21swapper/323:39:253
314899109,1cyclictest0-21swapper/323:34:323
314899108,1cyclictest41-21ksoftirqd/323:28:513
314899108,1cyclictest41-21ksoftirqd/323:13:343
314899108,1cyclictest41-21ksoftirqd/322:48:243
314899103,4cyclictest26922-21bash21:09:223
314899103,4cyclictest20498-21sshd23:25:303
314899102,5cyclictest8404-21grepconf.sh23:06:163
314899102,5cyclictest2008-21bash22:55:073
314899102,4cyclictest17137-21bash22:08:423
314899100,9cyclictest12432-21kworker/3:022:05:403
314899100,8cyclictest12108-21grepconf.sh21:34:143
314899100,10cyclictest0-21swapper/321:58:573
313799108,1cyclictest311rcuc/220:13:542
312899109,1cyclictest25-21ksoftirqd/120:29:011
312899109,1cyclictest22071-21kworker/1:020:39:151
312899109,1cyclictest1810-21kworker/1:220:13:251
3128991010,0cyclictest8516-21kworker/1:019:11:021
29279-21100,0sshd0-21swapper/400:21:584
168062100,0sleep30-21swapper/321:42:373
31729993,6cyclictest0-21swapper/621:27:226
31729993,5cyclictest32601-21grep21:56:576
31729992,3cyclictest28618-21sshd23:42:046
31729991,2cyclictest15727-21bash21:21:366
31729990,9cyclictest0-21swapper/623:19:556
31729990,9cyclictest0-21swapper/622:35:376
31649994,5cyclictest0-21swapper/521:09:175
31649994,4cyclictest861-21gdbus23:04:215
31649991,7cyclictest13917-21grepconf.sh21:03:165
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional