You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 08:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Sat Apr 27, 2024 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8990995013,19cyclictest13-21ksoftirqd/000:16:310
8990993316,0cyclictest141rcuc/022:02:090
8990993210,4cyclictest0-21swapper/021:50:570
8997993128,2cyclictest18502-21latency_hist21:30:013
899799310,30cyclictest21619-21latency_hist23:20:013
8991993128,2cyclictest24684-21sh23:22:161
8990993129,2cyclictest0-21swapper/023:15:320
8990993128,2cyclictest3099-21ssh21:11:300
899099310,29cyclictest27011-21rm00:35:320
8997993028,1cyclictest29607-21time-dir00:04:123
8997993028,1cyclictest28087-21ssh21:40:013
8997993028,1cyclictest11298-21sh22:31:483
899799300,29cyclictest356-21diskmemload23:46:373
899799300,29cyclictest356-21diskmemload23:42:353
899799300,29cyclictest356-21diskmemload22:01:453
899799300,29cyclictest2512-21apt-get00:10:113
899799300,29cyclictest24330-21sh22:45:453
899799300,29cyclictest23802-21apt-get20:50:123
899799300,29cyclictest21136-21ssh21:30:503
899799300,1cyclictest25139-21apt-get00:35:123
899799300,1cyclictest0-21swapper/322:12:403
899799300,1cyclictest0-21swapper/300:30:223
8993993028,1cyclictest29339-21ssh00:03:452
8993993028,1cyclictest24690-21sh22:46:262
8993993028,1cyclictest18485-21cron21:30:002
8993993028,1cyclictest155132chrt00:24:432
8993993028,1cyclictest0-21swapper/223:32:512
899399300,29cyclictest24001-21ntp_states22:10:192
899399300,29cyclictest22302-21diskmemload23:55:172
899399300,29cyclictest16347-21ssh22:01:462
899399300,29cyclictest0-21swapper/223:08:062
899399300,29cyclictest0-21swapper/222:55:352
899399300,29cyclictest0-21swapper/222:07:312
899399300,29cyclictest0-21swapper/221:39:122
899399300,29cyclictest0-21swapper/221:39:122
899399300,1cyclictest356-21diskmemload21:43:002
899399300,1cyclictest24844-21munin-run00:35:012
899399300,1cyclictest0-21swapper/200:18:382
8991993028,2cyclictest12036-21ssh21:21:141
8991993028,1cyclictest0-21swapper/122:55:441
8991993028,1cyclictest0-21swapper/122:03:121
899199300,29cyclictest356-21diskmemload22:45:401
899199300,29cyclictest356-21diskmemload22:10:051
899199300,29cyclictest356-21diskmemload21:35:231
899199300,29cyclictest356-21diskmemload21:35:231
899199300,29cyclictest356-21diskmemload00:20:271
899199300,29cyclictest25580-21apt-get19:45:091
899199300,29cyclictest0-21swapper/123:56:051
899199300,29cyclictest0-21swapper/123:42:551
899199300,29cyclictest0-21swapper/123:30:201
899199300,29cyclictest0-21swapper/123:25:151
899199300,29cyclictest0-21swapper/123:16:051
899199300,29cyclictest0-21swapper/121:45:141
899199300,29cyclictest0-21swapper/100:26:101
899199300,1cyclictest356-21diskmemload21:16:411
8990993028,1cyclictest0-21swapper/000:31:160
899099300,29cyclictest9808-21apt-get20:20:120
899099300,29cyclictest0-21swapper/023:32:280
899099300,29cyclictest0-21swapper/023:13:310
899099300,29cyclictest0-21swapper/020:55:120
899099300,1cyclictest356-21diskmemload23:23:410
899099300,1cyclictest356-21diskmemload21:41:030
899099300,1cyclictest29915-21ssh00:04:470
899099300,1cyclictest22562-21ssh21:33:340
899099300,1cyclictest12974-21cron22:35:010
899099300,0cyclictest0-21swapper/022:27:230
8997992929,0cyclictest356-21diskmemload23:25:133
8997992929,0cyclictest356-21diskmemload22:25:563
8997992929,0cyclictest0-21swapper/321:47:233
8997992929,0cyclictest0-21swapper/300:08:053
899799290,29cyclictest7299-21ssh21:51:533
899799290,29cyclictest356-21diskmemload23:06:213
899799290,29cyclictest0-21swapper/323:55:393
899799290,29cyclictest0-21swapper/323:51:153
899799290,29cyclictest0-21swapper/323:31:573
899799290,29cyclictest0-21swapper/323:24:293
899799290,29cyclictest0-21swapper/322:17:303
899799290,29cyclictest0-21swapper/321:57:223
899799290,29cyclictest0-21swapper/321:36:323
899799290,29cyclictest0-21swapper/321:36:323
899799290,29cyclictest0-21swapper/321:20:183
899799290,29cyclictest0-21swapper/321:12:053
899799290,28cyclictest13732-21ssh23:10:183
899799290,28cyclictest0-21swapper/322:05:273
899799290,28cyclictest0-21swapper/300:27:093
899799290,1cyclictest6913-21ssh23:02:543
899799290,0cyclictest356-21diskmemload21:15:043
899799290,0cyclictest0-21swapper/323:35:013
899799290,0cyclictest0-21swapper/322:57:243
899799290,0cyclictest0-21swapper/322:50:013
899799290,0cyclictest0-21swapper/322:41:343
899799290,0cyclictest0-21swapper/322:35:013
899799290,0cyclictest0-21swapper/322:22:513
899799290,0cyclictest0-21swapper/300:20:463
8993992928,1cyclictest356-21diskmemload23:15:592
899399290,29cyclictest356-21diskmemload23:45:302
899399290,29cyclictest356-21diskmemload23:25:562
899399290,29cyclictest356-21diskmemload22:51:542
899399290,29cyclictest356-21diskmemload22:30:072
899399290,29cyclictest29652-21seq22:16:242
899399290,29cyclictest0-21swapper/223:50:262
899399290,29cyclictest0-21swapper/223:40:462
899399290,29cyclictest0-21swapper/222:20:192
899399290,29cyclictest0-21swapper/221:32:522
899399290,29cyclictest0-21swapper/221:15:042
899399290,29cyclictest0-21swapper/200:25:522
899399290,29cyclictest0-21swapper/200:10:112
899399290,29cyclictest0-21swapper/200:06:252
899399290,28cyclictest0-21swapper/223:35:012
899399290,28cyclictest0-21swapper/223:10:132
899399290,28cyclictest0-21swapper/221:45:302
899399290,28cyclictest0-21swapper/221:10:332
899399290,1cyclictest6625-21ssh23:02:212
899399290,0cyclictest356-21diskmemload21:51:322
899399290,0cyclictest0-21swapper/223:21:082
899399290,0cyclictest0-21swapper/222:41:192
899399290,0cyclictest0-21swapper/222:35:122
899399290,0cyclictest0-21swapper/222:25:412
899399290,0cyclictest0-21swapper/221:55:222
899399290,0cyclictest0-21swapper/221:20:242
899399290,0cyclictest0-21swapper/220:50:122
899399290,0cyclictest0-21swapper/200:35:122
8991992929,0cyclictest0-21swapper/122:53:311
8991992929,0cyclictest0-21swapper/121:29:191
8991992929,0cyclictest0-21swapper/100:35:091
8991992928,1cyclictest8376-21apt-get23:05:111
8991992928,1cyclictest4551-21ssh23:35:231
899199290,29cyclictest0-21swapper/123:52:261
899199290,29cyclictest0-21swapper/123:12:151
899199290,29cyclictest0-21swapper/122:38:231
899199290,29cyclictest0-21swapper/122:21:081
899199290,29cyclictest0-21swapper/122:15:461
899199290,29cyclictest0-21swapper/122:05:581
899199290,29cyclictest0-21swapper/121:55:311
899199290,29cyclictest0-21swapper/121:30:031
899199290,29cyclictest0-21swapper/121:12:071
899199290,29cyclictest0-21swapper/100:30:471
899199290,29cyclictest0-21swapper/100:15:271
899199290,29cyclictest0-21swapper/100:07:481
899199290,29cyclictest0-21swapper/100:00:321
899199290,28cyclictest0-21swapper/119:50:101
899199290,28cyclictest0-21swapper/100:10:091
899199290,0cyclictest356-21diskmemload23:01:071
899199290,0cyclictest356-21diskmemload21:44:211
899199290,0cyclictest0-21swapper/123:47:011
899199290,0cyclictest0-21swapper/122:40:111
899199290,0cyclictest0-21swapper/122:30:121
899199290,0cyclictest0-21swapper/122:26:131
899199290,0cyclictest0-21swapper/121:50:371
8990992929,0cyclictest356-21diskmemload21:35:300
8990992929,0cyclictest356-21diskmemload21:35:300
8990992928,1cyclictest356-21diskmemload23:50:180
8990992928,1cyclictest10767-21sh23:06:320
8990992928,1cyclictest0-21swapper/021:16:360
8990992927,1cyclictest2158-21idleruntime-cro00:10:010
899099290,29cyclictest356-21diskmemload23:46:540
899099290,29cyclictest356-21diskmemload23:37:210
899099290,29cyclictest356-21diskmemload22:55:120
899099290,29cyclictest356-21diskmemload22:36:370
899099290,29cyclictest356-21diskmemload21:45:010
899099290,29cyclictest356-21diskmemload21:25:170
899099290,29cyclictest356-21diskmemload21:20:590
899099290,29cyclictest0-21swapper/023:25:340
899099290,29cyclictest0-21swapper/023:00:010
899099290,29cyclictest0-21swapper/022:50:280
899099290,29cyclictest0-21swapper/022:15:090
899099290,29cyclictest0-21swapper/022:10:290
899099290,29cyclictest0-21swapper/020:25:120
899099290,28cyclictest0-21swapper/000:10:460
899099290,1cyclictest0-21swapper/021:56:530
899099290,0cyclictest356-21diskmemload22:47:260
899099290,0cyclictest356-21diskmemload22:41:400
899099290,0cyclictest356-21diskmemload22:05:040
899099290,0cyclictest356-21diskmemload00:20:370
899099290,0cyclictest16276-21apt-get19:25:100
899099290,0cyclictest0-21swapper/023:55:100
899099290,0cyclictest0-21swapper/023:40:500
899099290,0cyclictest0-21swapper/022:20:040
899099290,0cyclictest0-21swapper/000:25:230
8997992828,0cyclictest0-21swapper/320:15:013
8997992828,0cyclictest0-21swapper/319:35:103
8997992828,0cyclictest0-21swapper/300:15:283
8993992828,0cyclictest0-21swapper/219:35:102
8991992828,0cyclictest0-21swapper/120:15:111
8991992828,0cyclictest0-21swapper/119:25:011
8990992828,0cyclictest0-21swapper/019:55:130
8990992828,0cyclictest0-21swapper/019:30:090
899099280,0cyclictest0-21swapper/020:45:120
899099280,0cyclictest0-21swapper/019:10:120
8997992726,0cyclictest30783-21apt-get21:05:133
8991992727,0cyclictest0-21swapper/119:30:091
8990992725,1cyclictest584-21gdbus20:05:010
8993992626,0cyclictest0-21swapper/221:05:132
8991992626,0cyclictest11614-21apt-get19:15:101
8991992525,0cyclictest0-21swapper/120:40:111
8997992424,0cyclictest13955-21apt-get19:20:103
8997992423,1cyclictest19155-21apt-get20:40:103
8997992323,0cyclictest12180-21apt-get20:25:123
8993992323,0cyclictest0-21swapper/220:40:102
8993992323,0cyclictest0-21swapper/219:20:102
8993992321,1cyclictest0-21swapper/219:50:012
8991992323,0cyclictest0-21swapper/119:40:131
8991992321,1cyclictest32581-21sh20:00:011
8991992321,1cyclictest16567-21perf20:35:011
8990992322,1cyclictest28460-21apt-get21:00:090
8997992222,0cyclictest0-21swapper/319:45:093
8997992220,1cyclictest1-21systemd19:30:003
8993992222,0cyclictest0-21swapper/220:25:122
8993992219,2cyclictest2411-21systemd-journal19:30:002
8990992121,0cyclictest0-21swapper/020:15:110
899099207,0cyclictest0-21swapper/021:06:100
8997991917,1cyclictest0-21swapper/320:25:003
8990991919,0cyclictest2766-21apt-get20:05:100
8993991816,1cyclictest0-21swapper/220:25:002
8991991818,0cyclictest11924-21perf20:25:001
899099180,18cyclictest0-21swapper/020:32:350
8990991717,0cyclictest0-21swapper/020:35:140
8990991717,0cyclictest0-21swapper/019:45:090
899099170,0cyclictest0-21swapper/020:10:110
8997991616,0cyclictest0-21swapper/319:50:093
8997991616,0cyclictest0-21swapper/319:15:103
8993991613,2cyclictest15641-21awk20:30:202
899799150,14cyclictest0-21swapper/320:35:193
8993991515,0cyclictest28201-21apt-get19:50:092
8993991515,0cyclictest0-21swapper/219:15:102
899399150,1cyclictest0-21swapper/221:00:142
899399150,14cyclictest0-21swapper/219:40:132
899199150,14cyclictest0-21swapper/119:25:181
8997991414,0cyclictest0-21swapper/320:15:213
8997991414,0cyclictest0-21swapper/319:33:483
899799140,14cyclictest0-21swapper/321:00:293
899799140,14cyclictest0-21swapper/320:08:083
899799140,14cyclictest0-21swapper/320:02:413
899799140,14cyclictest0-21swapper/319:59:533
899799140,14cyclictest0-21swapper/319:40:033
899799140,0cyclictest15890-21ssh20:30:233
899799140,0cyclictest0-21swapper/320:47:533
8993991414,0cyclictest0-21swapper/220:08:082
8993991413,0cyclictest18591-21apt-get19:30:092
899399140,14cyclictest0-21swapper/220:56:112
899399140,14cyclictest0-21swapper/220:39:442
899399140,14cyclictest0-21swapper/220:15:352
899399140,14cyclictest0-21swapper/219:56:052
8991991414,0cyclictest0-21swapper/121:05:491
8991991414,0cyclictest0-21swapper/120:48:051
8991991414,0cyclictest0-21swapper/120:05:021
899199140,14cyclictest0-21swapper/121:01:491
899199140,14cyclictest0-21swapper/120:56:151
899199140,14cyclictest0-21swapper/120:53:551
899199140,14cyclictest0-21swapper/120:36:521
899199140,14cyclictest0-21swapper/120:13:301
899199140,14cyclictest0-21swapper/120:00:011
899199140,14cyclictest0-21swapper/119:36:011
8990991414,0cyclictest0-21swapper/020:50:490
8990991414,0cyclictest0-21swapper/019:35:050
899099140,14cyclictest0-21swapper/020:44:450
899099140,14cyclictest0-21swapper/019:53:490
899099140,14cyclictest0-21swapper/019:40:420
899099140,0cyclictest0-21swapper/019:20:010
899099140,0cyclictest0-21swapper/019:19:150
8997991313,0cyclictest0-21swapper/320:55:043
8997991313,0cyclictest0-21swapper/319:13:553
8993991313,0cyclictest0-21swapper/220:00:182
8993991313,0cyclictest0-21swapper/219:14:572
899399130,13cyclictest0-21swapper/220:48:352
8991991313,0cyclictest0-21swapper/120:25:241
8991991313,0cyclictest0-21swapper/119:11:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional