You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 12:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot0.osadl.org (updated Sat Nov 22, 2025 00:45:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
218821150,0sleep20-21swapper/200:36:332
230032910,1sleep61036-21runrttasks23:48:126
267882870,1sleep70-21swapper/700:18:597
91562850,1sleep20-21swapper/222:07:342
308062830,0sleep30-21swapper/321:43:223
16932800,1sleep10-21swapper/100:26:221
256872770,0sleep4501ktimersoftd/422:25:394
293052760,0sleep70-21swapper/723:19:047
24092760,0sleep70-21swapper/723:26:097
230882760,1sleep60-21swapper/623:08:296
174812760,0sleep10-21swapper/123:44:221
39232750,0sleep1231ktimersoftd/122:43:231
39232750,0sleep1231ktimersoftd/122:43:231
96862740,0sleep00-21swapper/022:40:340
96862740,0sleep00-21swapper/022:40:330
265512740,0sleep20-21swapper/221:33:042
265512740,0sleep20-21swapper/221:33:032
202692740,1sleep30-21swapper/323:37:593
177422740,1sleep2321ktimersoftd/222:01:492
47272730,1sleep40-21swapper/423:29:514
238952720,0sleep50-21swapper/521:00:215
219262720,0sleep30-21swapper/323:21:323
41472710,1sleep04146-21bash21:50:250
200772710,1sleep00-21swapper/022:21:490
103112710,0sleep00-21swapper/000:30:380
103112710,0sleep00-21swapper/000:30:380
117212700,0sleep00-21swapper/021:18:190
293652690,0sleep60-21swapper/600:29:246
282932690,0sleep60-21swapper/622:06:106
211812690,0sleep30-21swapper/323:01:373
175452690,0sleep70-21swapper/723:21:047
322102680,0sleep00-21swapper/022:59:320
221012680,0sleep10-21swapper/123:11:361
214572660,0sleep00-21swapper/023:05:020
230232640,1sleep123017-21sshd21:25:571
185962640,1sleep618595-21bash23:21:116
233122580,0sleep10-21swapper/122:35:221
52452540,0sleep20-21swapper/200:23:272
56625241,7sleep50-21swapper/519:09:025
44825242,6sleep70-21swapper/719:07:347
46325141,6sleep30-21swapper/319:07:463
61324837,7sleep60-21swapper/619:09:266
47024736,7sleep00-21swapper/019:07:520
3104724231,7sleep10-21swapper/119:05:041
36024130,7sleep40-21swapper/419:06:364
3272624029,6sleep20-21swapper/219:05:212
225942240,1sleep40-21swapper/423:54:514
96599230,4cyclictest0-21swapper/121:50:511
96599223,3cyclictest0-21swapper/121:48:321
296562220,1sleep129655-21bash22:52:371
296562220,1sleep129655-21bash22:52:371
84752210,0sleep60-21swapper/621:41:016
96599200,1cyclictest0-21swapper/121:43:451
327022200,0sleep30-21swapper/322:49:433
320422200,1sleep7761rcuc/723:59:117
70252190,2sleep4501ktimersoftd/400:13:274
70252190,2sleep4501ktimersoftd/400:13:274
4372190,0sleep1434-21sshd22:23:121
294772190,0sleep00-21swapper/023:12:240
278382190,1sleep60-21swapper/622:35:516
319342180,0sleep00-21swapper/022:52:520
319342180,0sleep00-21swapper/022:52:520
301692180,1sleep50-21swapper/523:05:475
241302180,0sleep50-21swapper/523:25:115
171822180,0sleep50-21swapper/521:41:565
157182180,0sleep70-21swapper/722:47:547
126542180,1sleep70-21swapper/722:04:427
96599173,3cyclictest0-21swapper/123:00:291
96599173,10cyclictest0-21swapper/100:23:461
965991715,1cyclictest2310-21sshd21:14:031
96599170,13cyclictest0-21swapper/121:58:551
286892170,1sleep40-21swapper/421:23:204
286892170,1sleep40-21swapper/421:23:194
273942170,0sleep00-21swapper/022:06:040
242212170,0sleep50-21swapper/522:48:485
241142170,0sleep20-21swapper/200:32:082
241142170,0sleep20-21swapper/200:32:082
17742170,0sleep20-21swapper/200:12:532
17742170,0sleep20-21swapper/200:12:532
147152170,0sleep30-21swapper/321:11:573
133182170,0sleep20-21swapper/221:18:292
103592170,0sleep30-21swapper/300:34:103
103592170,0sleep30-21swapper/300:34:103
99999161,6cyclictest22253-21gdbus00:33:167
99999161,6cyclictest22253-21gdbus00:33:167
98299160,15cyclictest0-21swapper/423:08:314
97199160,2cyclictest0-21swapper/200:02:112
96599163,9cyclictest0-21swapper/100:01:061
96599162,5cyclictest0-21swapper/123:08:541
965991613,2cyclictest662-21gdbus22:45:321
96599160,8cyclictest0-21swapper/121:01:151
94572160,0sleep00-21swapper/023:53:270
173732160,0sleep40-21swapper/422:24:594
162742160,0sleep40-21swapper/423:01:064
99599150,13cyclictest16383-21sshd00:00:466
99599150,13cyclictest0-21swapper/623:00:586
988991511,2cyclictest0-21swapper/523:14:065
98899150,13cyclictest22250-21packagekitd21:20:045
98899150,13cyclictest22250-21packagekitd21:20:045
982991510,3cyclictest0-21swapper/421:05:214
98299150,13cyclictest0-21swapper/421:16:554
978991511,2cyclictest0-21swapper/323:27:223
97899151,12cyclictest0-21swapper/321:29:293
96599153,9cyclictest0-21swapper/121:20:231
96599153,9cyclictest0-21swapper/121:20:231
96599152,10cyclictest0-21swapper/120:45:181
96599150,13cyclictest0-21swapper/122:00:061
96599150,11cyclictest0-21swapper/121:05:231
49682150,1sleep7771ktimersoftd/723:33:067
309152150,0sleep70-21swapper/722:16:207
205022150,0sleep40-21swapper/421:35:384
199162150,0sleep50-21swapper/522:35:105
99999142,7cyclictest0-21swapper/722:40:197
99999142,7cyclictest0-21swapper/722:40:197
99999142,6cyclictest0-21swapper/723:02:237
99999141,6cyclictest0-21swapper/700:25:387
99999140,7cyclictest0-21swapper/721:53:467
99999140,12cyclictest660-21dbus-daemon22:54:027
99999140,12cyclictest660-21dbus-daemon22:54:017
99999140,12cyclictest23311-21tty23:35:017
995991411,1cyclictest754-21NetworkManager00:21:366
995991411,1cyclictest0-21swapper/623:30:086
995991411,1cyclictest0-21swapper/621:29:586
99599140,12cyclictest654-21polkitd21:37:386
99599140,12cyclictest0-21swapper/623:25:506
988991411,2cyclictest0-21swapper/521:26:585
98899140,12cyclictest662-21gdbus23:18:575
982991411,1cyclictest0-21swapper/422:06:314
982991411,1cyclictest0-21swapper/400:36:474
98299140,2cyclictest0-21swapper/422:44:414
98299140,2cyclictest0-21swapper/422:44:404
98299140,12cyclictest3433-21tty23:32:564
978991410,2cyclictest1044-21sshd23:17:173
97899140,3cyclictest0-21swapper/321:35:473
97899140,2cyclictest21896-21sshd00:01:223
97899140,2cyclictest0-21swapper/321:49:143
97899140,12cyclictest31209-21sshd00:29:353
97899140,12cyclictest0-21swapper/321:56:223
97199146,5cyclictest33-21ksoftirqd/222:41:412
97199146,5cyclictest33-21ksoftirqd/222:41:412
97199140,12cyclictest0-21swapper/222:53:172
97199140,12cyclictest0-21swapper/222:53:162
96599143,10cyclictest0-21swapper/123:49:021
96599143,10cyclictest0-21swapper/123:25:101
96599143,10cyclictest0-21swapper/121:33:351
96599143,10cyclictest0-21swapper/121:33:341
96599143,10cyclictest0-21swapper/119:24:131
96599143,10cyclictest0-21swapper/100:38:381
96599143,10cyclictest0-21swapper/100:34:421
96599143,10cyclictest0-21swapper/100:34:421
96599142,10cyclictest0-21swapper/119:46:221
965991411,2cyclictest19121-21sshd23:21:141
96599141,10cyclictest0-21swapper/122:34:231
96599140,4cyclictest0-21swapper/122:56:351
96599140,12cyclictest553-21id22:10:031
96599140,10cyclictest0-21swapper/122:18:391
96599140,10cyclictest0-21swapper/119:54:591
957991410,2cyclictest0-21swapper/023:32:310
95799140,1cyclictest0-21swapper/021:11:000
95799140,12cyclictest660-21dbus-daemon00:10:570
95799140,12cyclictest660-21dbus-daemon00:10:570
4002140,1sleep4501ktimersoftd/423:59:164
270762140,0sleep40-21swapper/421:46:124
155562140,0sleep6681ktimersoftd/622:47:536
102172140,0sleep50-21swapper/523:50:115
99999132,7cyclictest0-21swapper/722:35:217
99999132,7cyclictest0-21swapper/721:36:547
99999132,5cyclictest0-21swapper/723:11:187
999991310,2cyclictest0-21swapper/722:08:287
99999130,5cyclictest0-21swapper/723:06:057
99999130,1cyclictest0-21swapper/722:13:097
99999130,12cyclictest0-21swapper/723:51:257
99999130,11cyclictest28339-21sshd21:13:237
995991311,1cyclictest0-21swapper/600:39:376
99599130,1cyclictest660-21dbus-daemon22:44:426
99599130,1cyclictest660-21dbus-daemon22:44:426
99599130,1cyclictest0-21swapper/622:15:006
99599130,12cyclictest12168-21sensors19:30:216
988991310,2cyclictest3811-21sshd21:30:375
988991310,2cyclictest3811-21sshd21:30:365
988991310,1cyclictest0-21swapper/521:36:565
98899130,1cyclictest0-21swapper/522:54:135
98899130,1cyclictest0-21swapper/522:54:135
98899130,1cyclictest0-21swapper/521:46:195
98899130,1cyclictest0-21swapper/500:38:075
98899130,12cyclictest459-21rm22:59:385
98899130,12cyclictest1343-21sshd21:13:565
98899130,12cyclictest0-21swapper/522:06:455
98299138,1cyclictest1117-21nfsd23:22:534
982991310,1cyclictest0-21swapper/423:40:364
98299130,12cyclictest0-21swapper/400:15:334
978991311,1cyclictest1-21systemd23:56:073
978991310,2cyclictest0-21swapper/321:20:293
978991310,2cyclictest0-21swapper/321:20:283
978991310,1cyclictest465-21systemd-journal00:05:083
978991310,1cyclictest465-21systemd-journal00:05:083
97899130,1cyclictest660-21dbus-daemon22:52:573
97899130,1cyclictest660-21dbus-daemon22:52:573
97899130,12cyclictest0-21swapper/323:48:283
97199136,3cyclictest33-21ksoftirqd/223:55:042
971991311,1cyclictest754-21NetworkManager22:25:362
971991311,1cyclictest14366-21grepconf.sh23:40:362
97199130,12cyclictest0-21swapper/223:24:202
97199130,12cyclictest0-21swapper/222:34:522
97199130,12cyclictest0-21swapper/222:20:062
97199130,11cyclictest0-21swapper/223:01:532
96599136,5cyclictest0-21swapper/120:24:361
96599133,9cyclictest0-21swapper/123:17:351
96599133,9cyclictest0-21swapper/121:15:021
96599133,9cyclictest0-21swapper/100:18:421
96599133,5cyclictest0-21swapper/123:55:301
96599132,10cyclictest0-21swapper/123:50:381
96599132,10cyclictest0-21swapper/122:27:221
96599132,10cyclictest0-21swapper/120:51:341
96599131,10cyclictest0-21swapper/119:36:191
96599131,10cyclictest0-21swapper/119:18:591
965991310,2cyclictest0-21swapper/122:07:131
96599130,9cyclictest0-21swapper/123:34:221
96599130,8cyclictest0-21swapper/120:56:071
96599130,1cyclictest29339-21systemd-cgroups00:12:221
96599130,1cyclictest29339-21systemd-cgroups00:12:221
96599130,1cyclictest0-21swapper/100:05:551
96599130,1cyclictest0-21swapper/100:05:551
96599130,10cyclictest0-21swapper/120:19:191
96599130,10cyclictest0-21swapper/120:19:191
96599130,10cyclictest0-21swapper/120:05:461
96599130,10cyclictest0-21swapper/119:44:391
95799130,1cyclictest0-21swapper/000:39:590
95799130,12cyclictest0-21swapper/023:43:320
99999122,3cyclictest0-21swapper/721:41:397
99999121,6cyclictest0-21swapper/721:55:177
99999121,6cyclictest0-21swapper/721:17:127
99999121,5cyclictest28272-21sshd23:42:057
99999121,3cyclictest8387-21sshd22:30:337
999991210,1cyclictest0-21swapper/722:56:357
999991210,1cyclictest0-21swapper/721:34:277
999991210,1cyclictest0-21swapper/721:34:267
99999120,7cyclictest0-21swapper/721:21:157
99999120,7cyclictest0-21swapper/721:21:147
99999120,1cyclictest662-21gdbus22:24:527
99999120,11cyclictest0-21swapper/722:25:487
995991210,1cyclictest3745-21sshd23:39:406
995991210,1cyclictest0-21swapper/623:59:506
995991210,1cyclictest0-21swapper/623:10:226
995991210,1cyclictest0-21swapper/622:25:456
995991210,1cyclictest0-21swapper/600:18:236
99599120,1cyclictest0-21swapper/622:50:296
99599120,1cyclictest0-21swapper/622:50:296
99599120,1cyclictest0-21swapper/622:15:566
99599120,1cyclictest0-21swapper/600:32:146
99599120,1cyclictest0-21swapper/600:32:146
99599120,11cyclictest0-21swapper/621:45:426
988991210,1cyclictest20254-21bash23:21:215
988991210,1cyclictest14330-21sshd22:04:535
988991210,1cyclictest0-21swapper/522:27:515
988991210,1cyclictest0-21swapper/500:20:065
98899120,1cyclictest0-21swapper/500:19:105
982991210,1cyclictest0-21swapper/419:30:204
98299120,1cyclictest18790-21sshd22:54:544
98299120,1cyclictest18790-21sshd22:54:544
98299120,11cyclictest5229-21sshd21:57:144
98299120,11cyclictest0-21swapper/422:37:264
98299120,11cyclictest0-21swapper/421:34:564
98299120,11cyclictest0-21swapper/421:34:564
98299120,10cyclictest0-21swapper/419:40:184
97899129,2cyclictest0-21swapper/321:33:073
97899129,2cyclictest0-21swapper/321:33:073
97899128,2cyclictest0-21swapper/323:09:293
978991210,1cyclictest0-21swapper/323:42:413
978991210,1cyclictest0-21swapper/322:34:083
978991210,1cyclictest0-21swapper/322:03:133
978991210,1cyclictest0-21swapper/300:22:123
97899120,1cyclictest0-21swapper/322:29:023
97899120,11cyclictest0-21swapper/321:15:063
97199129,1cyclictest0-21swapper/200:15:082
97199127,3cyclictest33-21ksoftirqd/223:37:522
97199123,6cyclictest33-21ksoftirqd/221:10:212
97199123,1cyclictest33-21ksoftirqd/222:13:252
971991210,1cyclictest0-21swapper/223:51:132
971991210,1cyclictest0-21swapper/223:33:532
971991210,1cyclictest0-21swapper/223:06:522
971991210,1cyclictest0-21swapper/221:21:372
971991210,1cyclictest0-21swapper/221:21:362
971991210,1cyclictest0-21swapper/200:29:552
97199120,1cyclictest20844-21grep22:48:272
97199120,1cyclictest0-21swapper/223:28:382
97199120,1cyclictest0-21swapper/222:55:502
97199120,1cyclictest0-21swapper/221:58:512
97199120,11cyclictest0-21swapper/223:13:422
97199120,11cyclictest0-21swapper/221:54:242
97199120,11cyclictest0-21swapper/221:40:342
96599127,1cyclictest16228-21ipmitool21:35:171
96599121,10cyclictest0-21swapper/120:10:571
965991210,1cyclictest12374-21systemd-cgroups23:37:091
96599120,9cyclictest0-21swapper/120:04:031
96599120,6cyclictest0-21swapper/120:27:461
96599120,10cyclictest0-21swapper/120:40:551
95799123,5cyclictest7452-21munin-run20:30:010
95799123,2cyclictest7957-21sshd00:06:370
95799123,2cyclictest7957-21sshd00:06:370
95799123,1cyclictest25217-21sshd22:25:370
957991210,1cyclictest0-21swapper/023:17:110
957991210,1cyclictest0-21swapper/000:17:240
95799120,1cyclictest0-21swapper/022:46:410
95799120,1cyclictest0-21swapper/022:03:150
95799120,11cyclictest704-21systemd-logind23:38:420
95799120,11cyclictest0-21swapper/023:58:510
95799120,11cyclictest0-21swapper/021:47:320
95799120,11cyclictest0-21swapper/021:32:450
95799120,11cyclictest0-21swapper/021:32:450
253272120,0sleep40-21swapper/422:45:274
99999119,1cyclictest0-21swapper/700:38:287
99999118,1cyclictest660-21dbus-daemon00:05:037
99999118,1cyclictest660-21dbus-daemon00:05:037
99999112,5cyclictest0-21swapper/721:45:187
99999111,6cyclictest0-21swapper/721:27:357
99999111,6cyclictest0-21swapper/700:11:267
99999111,6cyclictest0-21swapper/700:11:267
99999110,5cyclictest0-21swapper/723:47:127
99599119,1cyclictest0-21swapper/623:54:356
99599119,1cyclictest0-21swapper/622:30:506
99599119,1cyclictest0-21swapper/620:10:156
99599119,1cyclictest0-21swapper/600:05:296
99599119,1cyclictest0-21swapper/600:05:296
99599118,2cyclictest0-21swapper/621:16:556
99599118,1cyclictest738-21gdbus21:58:366
99599110,1cyclictest0-21swapper/620:55:176
99599110,1cyclictest0-21swapper/619:19:526
98899119,1cyclictest0-21swapper/523:37:055
98899119,1cyclictest0-21swapper/523:00:485
98899119,1cyclictest0-21swapper/500:27:305
98899119,1cyclictest0-21swapper/500:12:425
98899119,1cyclictest0-21swapper/500:12:425
98899118,2cyclictest0-21swapper/522:22:465
98899110,2cyclictest0-21swapper/500:07:035
98899110,2cyclictest0-21swapper/500:07:035
98899110,1cyclictest0-21swapper/521:54:485
98899110,10cyclictest0-21swapper/522:43:035
98899110,10cyclictest0-21swapper/522:43:035
98899110,0cyclictest537-40kipmi020:40:125
98899110,0cyclictest0-21swapper/500:30:435
98899110,0cyclictest0-21swapper/500:30:435
98299119,1cyclictest21319-21sshd22:18:454
98299119,1cyclictest0-21swapper/423:38:104
98299119,1cyclictest0-21swapper/423:16:414
98299119,1cyclictest0-21swapper/423:10:224
98299119,1cyclictest0-21swapper/421:11:324
98299118,2cyclictest0-21swapper/419:55:204
98299118,2cyclictest0-21swapper/400:02:394
98299115,2cyclictest22253-21gdbus00:30:004
97899119,1cyclictest0-21swapper/321:51:563
97899113,7cyclictest0-21swapper/322:57:163
97899110,10cyclictest660-21dbus-daemon23:14:253
97199119,1cyclictest33-21ksoftirqd/221:10:002
97199117,2cyclictest465-21systemd-journal23:17:372
97199115,3cyclictest33-21ksoftirqd/223:48:112
97199115,3cyclictest33-21ksoftirqd/221:25:032
97199113,1cyclictest33-21ksoftirqd/200:05:482
97199113,1cyclictest33-21ksoftirqd/200:05:482
97199110,2cyclictest0-21swapper/222:36:112
97199110,1cyclictest0-21swapper/221:45:572
96599115,4cyclictest0-21swapper/119:29:221
96599113,3cyclictest0-21swapper/120:37:371
96599110,9cyclictest0-21swapper/119:55:031
96599110,9cyclictest0-21swapper/119:10:571
96599110,8cyclictest0-21swapper/120:30:021
96599110,10cyclictest0-21swapper/119:30:471
95799119,1cyclictest0-21swapper/023:49:190
95799119,1cyclictest0-21swapper/000:20:380
95799110,1cyclictest0-21swapper/022:31:210
95799110,10cyclictest0-21swapper/019:18:210
99999102,5cyclictest0-21swapper/700:21:367
99999101,5cyclictest0-21swapper/700:03:337
99599108,1cyclictest3967-21sshd23:19:506
99599108,1cyclictest1-21systemd00:11:566
99599108,1cyclictest1-21systemd00:11:566
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional