You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 05:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot0.osadl.org (updated Mon Dec 01, 2025 00:45:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
87021440,1sleep7871-21bash21:43:107
2519321180,0sleep00-21swapper/023:04:130
1941221110,0sleep10-21swapper/123:16:411
3151921070,1sleep40-21swapper/419:05:144
205122840,1sleep520509-21sshd22:40:385
186192790,0sleep30-21swapper/321:41:363
118952790,0sleep511887-21sshd22:36:295
118952790,0sleep511887-21sshd22:36:295
22712770,0sleep00-21swapper/023:51:100
22712770,0sleep00-21swapper/023:51:100
211612770,1sleep3411ktimersoftd/321:35:203
57972760,1sleep60-21swapper/623:05:246
10742760,1sleep00-21swapper/000:00:560
36012750,0sleep30-21swapper/322:48:543
174252750,0sleep70-21swapper/723:59:277
174252750,0sleep70-21swapper/723:59:277
310222730,0sleep7761rcuc/722:22:057
97402710,0sleep70-21swapper/722:33:037
131292710,0sleep40-21swapper/423:02:574
81802700,0sleep30-21swapper/321:34:083
80862700,0sleep70-21swapper/723:22:087
188582700,0sleep70-21swapper/722:47:057
212802690,1sleep6671rcuc/621:48:306
81232670,0sleep20-21swapper/222:26:162
226632640,0sleep30-21swapper/322:18:003
50825848,6sleep30-21swapper/319:09:393
37225848,6sleep60-21swapper/619:08:056
14742570,4sleep585399cyclictest20:15:185
36425646,6sleep70-21swapper/719:07:597
216492500,1sleep51036-21runrttasks22:04:565
51124838,6sleep50-21swapper/519:09:405
47424737,6sleep10-21swapper/119:09:121
289102450,4sleep585399cyclictest22:28:285
85312430,0sleep20-21swapper/222:06:452
3263524332,7sleep00-21swapper/019:05:360
47524029,7sleep20-21swapper/219:09:142
82899280,27cyclictest0-21swapper/120:35:351
82899274,4cyclictest0-21swapper/122:34:091
82899256,2cyclictest0-21swapper/122:39:541
82899256,2cyclictest0-21swapper/122:39:541
207432250,0sleep40-21swapper/421:55:014
31812230,1sleep50-21swapper/523:01:545
267282230,0sleep40-21swapper/423:37:114
82899222,7cyclictest4212-21sshd00:18:141
82899221,20cyclictest0-21swapper/120:31:471
275592220,0sleep36455-1kworker/3:0H23:50:253
275592220,0sleep36455-1kworker/3:0H23:50:253
82899210,20cyclictest0-21swapper/120:45:431
82899210,20cyclictest0-21swapper/120:41:031
82899210,1cyclictest0-21swapper/123:43:141
125712210,1sleep712530-21sshd22:40:007
125712210,1sleep712530-21sshd22:39:597
83252200,0sleep70-21swapper/721:11:127
82899200,1cyclictest0-21swapper/122:40:141
82899200,1cyclictest0-21swapper/100:14:111
307762200,0sleep00-21swapper/000:10:500
292572200,1sleep40-21swapper/400:37:324
260862200,1sleep7771ktimersoftd/722:15:077
15132200,1sleep60-21swapper/622:02:486
83399190,12cyclictest4664-21sshd23:48:122
818991913,5cyclictest660-21dbus-daemon21:46:350
23642190,0sleep60-21swapper/621:40:046
158432190,0sleep40-21swapper/421:47:564
83399180,1cyclictest0-21swapper/221:57:512
82899186,5cyclictest0-21swapper/123:58:381
82899186,5cyclictest0-21swapper/123:58:381
82899186,4cyclictest15703-21sshd23:45:541
82899183,13cyclictest0-21swapper/122:18:261
82899182,13cyclictest0-21swapper/120:13:231
231332180,0sleep50-21swapper/523:30:155
22862180,0sleep70-21swapper/700:18:037
85799170,1cyclictest0-21swapper/623:30:196
833991711,5cyclictest0-21swapper/223:24:002
833991710,6cyclictest22253-21gdbus23:15:192
83399170,1cyclictest13172-21sshd21:41:032
82899172,12cyclictest0-21swapper/123:23:101
828991711,5cyclictest0-21swapper/119:38:351
54292170,4sleep5581rcuc/521:20:405
30722170,0sleep00-21swapper/022:52:030
276752170,0sleep60-21swapper/621:52:216
245482170,0sleep30-21swapper/321:16:053
135982170,0sleep70-21swapper/700:35:497
111562170,1sleep011150-21bash21:57:130
866991611,3cyclictest0-21swapper/700:12:417
85799160,14cyclictest0-21swapper/622:08:406
853991611,4cyclictest1-21systemd22:11:045
846991611,3cyclictest0-21swapper/422:53:514
84099160,14cyclictest0-21swapper/300:20:413
83399160,1cyclictest0-21swapper/223:10:502
83399160,1cyclictest0-21swapper/200:31:532
82899163,12cyclictest0-21swapper/123:51:061
82899163,12cyclictest0-21swapper/123:51:061
82899163,12cyclictest0-21swapper/123:31:191
82899163,12cyclictest0-21swapper/123:08:021
82899163,12cyclictest0-21swapper/123:00:301
82899163,12cyclictest0-21swapper/122:00:341
82899163,12cyclictest0-21swapper/121:53:351
82899163,12cyclictest0-21swapper/120:16:351
82899163,12cyclictest0-21swapper/120:06:231
82899163,12cyclictest0-21swapper/119:45:101
82899163,12cyclictest0-21swapper/119:25:581
82899163,12cyclictest0-21swapper/119:14:111
82899162,13cyclictest0-21swapper/123:28:581
82899160,1cyclictest0-21swapper/123:35:151
82899160,13cyclictest0-21swapper/122:07:381
82899160,13cyclictest0-21swapper/121:05:261
82899160,13cyclictest0-21swapper/120:57:591
82899160,12cyclictest0-21swapper/100:34:341
82899160,10cyclictest0-21swapper/121:01:191
69492160,0sleep50-21swapper/523:05:315
165862160,0sleep50-21swapper/521:31:385
130862160,0sleep60-21swapper/621:18:166
125172160,1sleep7771ktimersoftd/721:47:347
86699150,14cyclictest0-21swapper/700:20:447
857991511,1cyclictest0-21swapper/622:24:566
85799150,1cyclictest0-21swapper/622:59:216
85799150,13cyclictest0-21swapper/623:37:476
85799150,13cyclictest0-21swapper/621:11:006
853991512,1cyclictest0-21swapper/521:56:215
84699150,2cyclictest660-21dbus-daemon23:25:584
840991511,2cyclictest21845-21bash00:13:253
84099150,12cyclictest0-21swapper/300:09:323
84099150,12cyclictest0-21swapper/300:09:313
83399154,2cyclictest653-21avahi-daemon21:35:152
83399152,2cyclictest22253-21gdbus22:30:472
833991511,2cyclictest0-21swapper/222:15:032
833991510,4cyclictest0-21swapper/221:29:292
83399150,2cyclictest1-21systemd22:58:352
83399150,13cyclictest732-21sshd21:16:592
82899157,5cyclictest0-21swapper/119:59:511
82899157,5cyclictest0-21swapper/119:40:351
82899157,5cyclictest0-21swapper/119:30:471
82899152,12cyclictest0-21swapper/123:11:021
82899152,12cyclictest0-21swapper/122:48:141
82899152,12cyclictest0-21swapper/100:02:581
82899151,13cyclictest0-21swapper/121:49:111
82899151,13cyclictest0-21swapper/121:20:031
828991510,4cyclictest0-21swapper/119:22:351
82899150,6cyclictest0-21swapper/100:07:381
82899150,6cyclictest0-21swapper/100:07:381
284712150,0sleep70-21swapper/723:37:227
202232150,0sleep40-21swapper/423:23:254
179812150,0sleep6671rcuc/623:23:116
146592150,1sleep01036-21runrttasks21:21:390
128762150,0sleep6671rcuc/623:25:516
866991410,3cyclictest0-21swapper/723:46:297
85799145,3cyclictest69-21ksoftirqd/600:23:526
857991412,1cyclictest69-21ksoftirqd/623:52:436
857991412,1cyclictest69-21ksoftirqd/623:52:426
857991411,2cyclictest0-21swapper/623:10:076
857991411,1cyclictest29064-21sshd22:48:116
85799140,13cyclictest0-21swapper/600:06:406
85799140,13cyclictest0-21swapper/600:06:406
85799140,12cyclictest4269-21bash21:33:446
85799140,12cyclictest0-21swapper/622:12:586
853991411,2cyclictest1-21systemd21:48:425
85399140,13cyclictest0-21swapper/523:49:575
84099140,2cyclictest0-21swapper/323:10:473
84099140,1cyclictest0-21swapper/323:58:463
84099140,1cyclictest0-21swapper/323:58:463
84099140,12cyclictest0-21swapper/322:05:043
83399145,2cyclictest660-21dbus-daemon23:43:522
83399145,2cyclictest22250-21packagekitd23:28:512
83399145,2cyclictest12668-21bash22:00:352
83399144,2cyclictest738-21gdbus22:38:322
83399144,2cyclictest738-21gdbus22:38:312
83399144,2cyclictest738-21gdbus00:20:502
83399144,2cyclictest738-21gdbus00:06:472
83399144,2cyclictest738-21gdbus00:06:472
83399144,2cyclictest654-21polkitd22:20:582
83399144,2cyclictest654-21polkitd21:47:122
83399144,2cyclictest653-21avahi-daemon00:38:342
83399144,2cyclictest653-21avahi-daemon00:01:022
83399143,5cyclictest0-21swapper/220:58:112
83399143,2cyclictest654-21polkitd22:10:312
83399141,3cyclictest0-21swapper/200:27:052
83399140,7cyclictest0-21swapper/221:20:042
83399140,2cyclictest7628-21sshd23:35:162
83399140,1cyclictest29681-21grepconf.sh23:01:172
83399140,1cyclictest26840-21systemd-cgroups22:51:092
83399140,1cyclictest24082-21sshd23:50:132
83399140,1cyclictest24082-21sshd23:50:132
83399140,1cyclictest1362-21sshd21:30:122
82899147,4cyclictest0-21swapper/121:55:431
82899142,7cyclictest0-21swapper/121:40:111
82899141,12cyclictest0-21swapper/122:55:021
82899141,12cyclictest0-21swapper/121:30:501
82899141,12cyclictest0-21swapper/100:26:311
82899140,6cyclictest0-21swapper/100:35:141
82899140,13cyclictest0-21swapper/122:52:141
82899140,13cyclictest0-21swapper/122:26:061
82899140,13cyclictest0-21swapper/122:22:301
82899140,13cyclictest0-21swapper/121:35:031
82899140,13cyclictest0-21swapper/121:28:511
82899140,13cyclictest0-21swapper/121:11:391
82899140,13cyclictest0-21swapper/120:52:391
82899140,13cyclictest0-21swapper/120:28:591
82899140,13cyclictest0-21swapper/120:23:191
82899140,13cyclictest0-21swapper/120:00:061
82899140,13cyclictest0-21swapper/119:50:151
82899140,13cyclictest0-21swapper/119:50:151
82899140,13cyclictest0-21swapper/119:16:231
82899140,13cyclictest0-21swapper/100:24:181
82899140,12cyclictest0-21swapper/122:14:451
81899140,2cyclictest660-21dbus-daemon23:37:320
81899140,1cyclictest0-21swapper/023:29:550
81899140,13cyclictest0-21swapper/023:47:390
34652140,1sleep73452-21sshd23:28:177
86699130,12cyclictest0-21swapper/723:13:017
86699130,12cyclictest0-21swapper/700:08:477
86699130,12cyclictest0-21swapper/700:08:477
86699130,11cyclictest0-21swapper/700:30:347
85799134,6cyclictest69-21ksoftirqd/600:38:176
85799131,5cyclictest704-21systemd-logind22:17:036
857991311,1cyclictest778-21gdbus22:32:046
85799130,1cyclictest465-21systemd-journal00:26:116
85799130,1cyclictest0-21swapper/600:34:226
85799130,12cyclictest0-21swapper/621:39:306
853991310,2cyclictest0-21swapper/500:07:565
853991310,2cyclictest0-21swapper/500:07:565
853991310,1cyclictest6322-21sshd21:37:085
85399130,1cyclictest0-21swapper/522:55:055
846991311,1cyclictest17097-21sshd21:18:414
84699130,1cyclictest0-21swapper/422:58:414
84699130,12cyclictest0-21swapper/422:01:264
84099130,2cyclictest0-21swapper/322:43:063
84099130,1cyclictest0-21swapper/322:56:073
84099130,1cyclictest0-21swapper/321:59:493
84099130,12cyclictest0-21swapper/323:27:513
84099130,12cyclictest0-21swapper/323:20:043
84099130,12cyclictest0-21swapper/321:47:513
83399133,1cyclictest704-21systemd-logind00:15:332
83399133,1cyclictest0-21swapper/219:45:082
83399132,3cyclictest22139-21sshd23:30:122
833991311,1cyclictest0-21swapper/222:45:582
83399130,2cyclictest16323-21grepconf.sh22:40:172
83399130,1cyclictest8429-21grepconf.sh21:11:132
83399130,1cyclictest6336-21sshd23:05:272
83399130,1cyclictest14883-21sshd23:59:102
83399130,1cyclictest14883-21sshd23:59:102
83399130,1cyclictest11645-21sshd00:12:142
83399130,1cyclictest10650-21df20:35:152
83399130,1cyclictest1044-21sshd21:52:422
82899130,12cyclictest0-21swapper/121:15:271
818991311,1cyclictest0-21swapper/023:19:150
818991311,1cyclictest0-21swapper/022:31:240
81899130,12cyclictest660-21dbus-daemon21:44:320
81899130,12cyclictest0-21swapper/022:43:060
866991210,1cyclictest14186-21sshd22:59:517
866991210,1cyclictest0-21swapper/723:40:427
866991210,1cyclictest0-21swapper/723:18:237
866991210,1cyclictest0-21swapper/723:02:157
866991210,1cyclictest0-21swapper/721:26:587
866991210,1cyclictest0-21swapper/721:22:077
866991210,1cyclictest0-21swapper/721:15:317
86699120,1cyclictest0-21swapper/723:31:017
86699120,11cyclictest32686-21sshd21:52:547
86699120,11cyclictest26907-21grepconf.sh23:07:387
86699120,11cyclictest0-21swapper/721:56:157
86699120,11cyclictest0-21swapper/700:03:257
85799129,2cyclictest0-21swapper/623:15:286
85799129,2cyclictest0-21swapper/600:17:586
85799127,1cyclictest69-21ksoftirqd/622:43:236
85799125,4cyclictest69-21ksoftirqd/623:56:336
85799125,4cyclictest69-21ksoftirqd/623:56:336
857991210,1cyclictest0-21swapper/623:45:596
857991210,1cyclictest0-21swapper/623:40:126
857991210,1cyclictest0-21swapper/622:52:056
857991210,1cyclictest0-21swapper/621:27:006
857991210,1cyclictest0-21swapper/621:22:106
857991210,1cyclictest0-21swapper/600:01:276
85799120,1cyclictest662-21gdbus21:56:216
85799120,1cyclictest0-21swapper/622:25:536
85799120,11cyclictest0-21swapper/620:35:156
853991210,1cyclictest0-21swapper/523:42:165
853991210,1cyclictest0-21swapper/523:25:205
853991210,1cyclictest0-21swapper/521:53:005
85399120,1cyclictest12213-21bash00:19:065
85399120,1cyclictest0-21swapper/521:18:195
85399120,1cyclictest0-21swapper/500:23:565
85399120,1cyclictest0-21swapper/500:14:155
85399120,11cyclictest0-21swapper/519:10:225
85399120,11cyclictest0-21swapper/500:34:335
84699128,3cyclictest0-21swapper/422:16:134
846991210,1cyclictest0-21swapper/423:40:294
846991210,1cyclictest0-21swapper/422:40:244
846991210,1cyclictest0-21swapper/422:07:374
84699120,1cyclictest0-21swapper/423:50:344
84699120,1cyclictest0-21swapper/423:50:344
84699120,1cyclictest0-21swapper/423:15:454
84699120,1cyclictest0-21swapper/421:10:294
84699120,11cyclictest25263-21sshd21:25:574
84699120,11cyclictest0-21swapper/422:47:324
84699120,11cyclictest0-21swapper/421:23:304
84699120,11cyclictest0-21swapper/400:05:384
84699120,11cyclictest0-21swapper/400:05:374
84099129,1cyclictest0-21swapper/321:22:193
840991210,1cyclictest0-21swapper/323:44:483
840991210,1cyclictest0-21swapper/322:38:243
840991210,1cyclictest0-21swapper/322:38:233
840991210,1cyclictest0-21swapper/321:27:093
840991210,1cyclictest0-21swapper/300:36:083
84099120,1cyclictest0-21swapper/321:52:093
84099120,1cyclictest0-21swapper/300:25:313
84099120,11cyclictest0-21swapper/300:15:503
83399124,2cyclictest7218-21seq20:28:342
83399120,2cyclictest0-21swapper/220:07:172
83399120,1cyclictest26771-21taskset21:09:152
83399120,1cyclictest22340-21chrt21:00:012
81899128,2cyclictest0-21swapper/022:56:320
818991210,1cyclictest28661-21sshd22:18:380
81899120,1cyclictest22253-21gdbus23:34:100
81899120,1cyclictest0-21swapper/021:28:130
81899120,10cyclictest0-21swapper/000:21:130
16092120,10sleep01757-21sshd22:38:500
16092120,10sleep01757-21sshd22:38:500
86699118,2cyclictest0-21swapper/723:53:137
86699118,2cyclictest0-21swapper/723:53:127
86699115,5cyclictest0-21swapper/720:20:207
86699110,1cyclictest0-21swapper/720:15:197
86699110,10cyclictest0-21swapper/720:36:587
85799111,3cyclictest101rcu_sched23:00:136
85799111,2cyclictest69-21ksoftirqd/600:10:176
85799110,3cyclictest660-21dbus-daemon22:38:136
85799110,3cyclictest660-21dbus-daemon22:38:136
85799110,10cyclictest0-21swapper/620:31:386
85399119,1cyclictest2393-21sshd22:48:455
85399119,1cyclictest1557-21sshd23:21:265
85399119,1cyclictest0-21swapper/523:36:295
85399119,1cyclictest0-21swapper/523:17:325
85399119,1cyclictest0-21swapper/500:36:585
85399119,1cyclictest0-21swapper/500:28:465
85399112,8cyclictest0-21swapper/520:04:445
85399110,2cyclictest0-21swapper/522:21:275
85399110,10cyclictest0-21swapper/520:20:145
85399110,0cyclictest0-21swapper/522:17:525
85399110,0cyclictest0-21swapper/522:05:545
84699119,1cyclictest1-21systemd22:26:424
84699119,1cyclictest0-21swapper/422:38:314
84699119,1cyclictest0-21swapper/422:38:314
84699119,1cyclictest0-21swapper/422:12:514
84699119,1cyclictest0-21swapper/421:40:524
84699119,1cyclictest0-21swapper/421:35:054
84699119,1cyclictest0-21swapper/400:32:144
84699117,2cyclictest465-21systemd-journal00:11:414
84699110,1cyclictest0-21swapper/423:12:104
84699110,1cyclictest0-21swapper/421:31:434
84699110,10cyclictest0-21swapper/400:00:154
84099119,1cyclictest0-21swapper/323:36:363
84099119,1cyclictest0-21swapper/323:05:253
84099119,1cyclictest0-21swapper/322:21:193
84099119,1cyclictest0-21swapper/322:10:183
84099119,1cyclictest0-21swapper/322:04:073
84099117,2cyclictest1044-21sshd23:00:043
84099110,0cyclictest0-21swapper/300:33:433
83399110,2cyclictest0-21swapper/220:53:222
83399110,2cyclictest0-21swapper/219:31:552
83399110,1cyclictest7259-21switchtime19:20:232
81899119,1cyclictest5468-21sshd23:11:590
81899119,1cyclictest0-21swapper/000:17:510
81899110,1cyclictest0-21swapper/022:12:270
81899110,1cyclictest0-21swapper/021:36:500
81899110,1cyclictest0-21swapper/000:33:100
81899110,10cyclictest662-21gdbus00:28:520
81899110,10cyclictest0-21swapper/022:03:040
164852110,2sleep3660-21dbus-daemon21:12:053
86699108,1cyclictest0-21swapper/722:05:487
86699108,1cyclictest0-21swapper/722:00:347
86699103,1cyclictest20535-21sshd22:40:387
85799107,1cyclictest69-21ksoftirqd/621:10:006
85799100,1cyclictest0-21swapper/620:24:226
85399108,1cyclictest0-21swapper/523:57:115
85399108,1cyclictest0-21swapper/523:57:115
85399108,1cyclictest0-21swapper/523:51:245
85399108,1cyclictest0-21swapper/523:51:245
85399108,1cyclictest0-21swapper/522:34:325
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional