You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-08 - 03:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Thu Dec 07, 2023 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2885199310,30cyclictest26956-21ssh09:48:373
2885199310,30cyclictest17891-21sh12:25:473
2884699310,30cyclictest5223-21ssh11:05:312
2884699310,30cyclictest30336-21ssh12:05:272
2884699310,30cyclictest20320-21awk12:30:012
28842993129,1cyclictest21499-21diskmemload12:30:251
2884099310,30cyclictest22546-21ssh10:16:270
2884099310,1cyclictest0-21swapper/011:23:340
28851993030,0cyclictest0-21swapper/312:20:153
28851993028,2cyclictest4981-21apt-get10:00:013
28851993028,1cyclictest0-21swapper/310:52:423
2885199300,29cyclictest0-21swapper/308:50:183
2885199300,29cyclictest0-21swapper/308:50:183
2885199300,0cyclictest0-21swapper/310:39:173
28846993028,1cyclictest220562sleep211:24:062
28846993028,1cyclictest0-21swapper/212:10:212
28846993028,1cyclictest0-21swapper/210:22:282
28846993028,1cyclictest0-21swapper/210:00:162
28846993027,1cyclictest0-21swapper/211:17:402
2884699300,29cyclictest3685-21ssh09:57:482
2884699300,29cyclictest28198-21apt-get09:50:192
2884699300,29cyclictest21499-21diskmemload09:44:382
2884699300,29cyclictest0-21swapper/212:35:472
2884699300,29cyclictest0-21swapper/212:00:152
2884699300,29cyclictest0-21swapper/211:03:072
2884699300,29cyclictest0-21swapper/210:15:322
2884699300,29cyclictest0-21swapper/210:07:212
2884699300,29cyclictest0-21swapper/209:17:502
2884699300,1cyclictest21435-21hddtemp_smartct12:30:222
28842993030,0cyclictest0-21swapper/110:16:591
28842993029,1cyclictest21499-21diskmemload10:10:161
28842993028,1cyclictest0-21swapper/110:05:401
2884299300,29cyclictest29976-21latency_hist12:40:011
2884299300,29cyclictest21499-21diskmemload12:20:211
2884299300,29cyclictest21499-21diskmemload11:31:221
2884299300,29cyclictest21499-21diskmemload11:17:251
2884299300,29cyclictest0-21swapper/112:10:011
2884299300,29cyclictest0-21swapper/111:55:351
2884299300,29cyclictest0-21swapper/110:26:421
2884299300,29cyclictest0-21swapper/109:47:351
2884299300,29cyclictest0-21swapper/109:21:501
2884299300,1cyclictest0-21swapper/110:04:231
28840993030,0cyclictest58550irq/126-eno112:19:220
28840993029,1cyclictest58550irq/126-eno111:02:590
28840993028,1cyclictest561-21dbus-daemon09:25:000
28840993028,1cyclictest30026-21ssh09:50:390
2884099300,30cyclictest1428-21cron07:45:000
2884099300,30cyclictest0-21swapper/010:26:150
2884099300,2cyclictest24107-21ssh12:00:160
2884099300,29cyclictest28282-21ssh11:30:200
2884099300,29cyclictest0-21swapper/012:38:350
2884099300,1cyclictest12408-21ssh10:05:370
2884099300,1cyclictest0-21swapper/010:25:010
28851992928,1cyclictest17246-21ssh11:51:573
2885199290,29cyclictest710-21ssh10:27:573
2885199290,29cyclictest21499-21diskmemload12:11:233
2885199290,29cyclictest21499-21diskmemload12:00:213
2885199290,29cyclictest21499-21diskmemload11:56:023
2885199290,29cyclictest21499-21diskmemload11:30:343
2885199290,29cyclictest21499-21diskmemload11:18:413
2885199290,29cyclictest21499-21diskmemload11:11:133
2885199290,29cyclictest21499-21diskmemload10:30:183
2885199290,29cyclictest21499-21diskmemload09:40:153
2885199290,29cyclictest21499-21diskmemload09:30:023
2885199290,29cyclictest21499-21diskmemload09:25:513
2885199290,29cyclictest21499-21diskmemload09:18:233
2885199290,29cyclictest21499-21diskmemload09:12:093
2885199290,29cyclictest0-21swapper/312:35:423
2885199290,29cyclictest0-21swapper/312:33:203
2885199290,29cyclictest0-21swapper/312:16:073
2885199290,29cyclictest0-21swapper/312:05:363
2885199290,29cyclictest0-21swapper/311:45:403
2885199290,29cyclictest0-21swapper/311:20:393
2885199290,29cyclictest0-21swapper/310:56:083
2885199290,29cyclictest0-21swapper/309:57:473
2885199290,1cyclictest6874-21ssh11:07:533
2885199290,1cyclictest2967-21ssh11:37:103
2885199290,1cyclictest19839-21ssh10:47:353
2885199290,0cyclictest21499-21diskmemload11:40:293
2885199290,0cyclictest21499-21diskmemload11:29:223
2885199290,0cyclictest21499-21diskmemload11:02:283
2885199290,0cyclictest21499-21diskmemload10:42:333
2885199290,0cyclictest21499-21diskmemload10:15:173
2885199290,0cyclictest21499-21diskmemload09:51:333
2885199290,0cyclictest21499-21diskmemload09:21:493
2885199290,0cyclictest0-21swapper/310:12:003
2885199290,0cyclictest0-21swapper/310:06:423
2885199290,0cyclictest0-21swapper/307:55:193
28846992929,0cyclictest9878-21apt-get08:45:222
28846992929,0cyclictest21499-21diskmemload12:20:092
28846992927,1cyclictest25076-21munin-run08:10:012
28846992927,0cyclictest0-21swapper/209:33:122
28846992925,0cyclictest0-21swapper/210:40:432
2884699290,29cyclictest21499-21diskmemload10:26:322
2884699290,29cyclictest21499-21diskmemload09:26:452
2884699290,29cyclictest21499-21diskmemload09:20:302
2884699290,29cyclictest0-21swapper/211:50:032
2884699290,29cyclictest0-21swapper/211:46:082
2884699290,29cyclictest0-21swapper/211:40:032
2884699290,29cyclictest0-21swapper/211:12:282
2884699290,29cyclictest0-21swapper/210:55:152
2884699290,29cyclictest0-21swapper/210:50:042
2884699290,29cyclictest0-21swapper/210:45:172
2884699290,29cyclictest0-21swapper/209:46:142
2884699290,29cyclictest0-21swapper/209:10:042
2884699290,1cyclictest32347-21apt-get08:25:012
2884699290,1cyclictest30480-21ssh11:31:582
2884699290,1cyclictest15710-21ssh09:35:532
2884699290,1cyclictest0-21swapper/211:56:292
2884699290,0cyclictest21499-21diskmemload11:35:162
2884699290,0cyclictest21499-21diskmemload11:27:212
2884699290,0cyclictest21499-21diskmemload10:30:092
2884699290,0cyclictest0-21swapper/210:35:082
2884699290,0cyclictest0-21swapper/210:11:282
2884699290,0cyclictest0-21swapper/208:30:222
28842992929,0cyclictest0-21swapper/111:35:421
28842992929,0cyclictest0-21swapper/110:46:111
28842992929,0cyclictest0-21swapper/109:30:091
28842992928,1cyclictest14815-21apt-get08:55:201
28842992928,1cyclictest11944-21ssh11:45:561
28842992928,1cyclictest0-21swapper/112:15:531
2884299290,29cyclictest21499-21diskmemload10:36:451
2884299290,29cyclictest0-21swapper/112:10:301
2884299290,29cyclictest0-21swapper/112:00:171
2884299290,29cyclictest0-21swapper/111:50:131
2884299290,29cyclictest0-21swapper/111:40:271
2884299290,29cyclictest0-21swapper/111:28:091
2884299290,29cyclictest0-21swapper/111:05:461
2884299290,29cyclictest0-21swapper/111:02:421
2884299290,29cyclictest0-21swapper/110:30:181
2884299290,29cyclictest0-21swapper/109:54:461
2884299290,29cyclictest0-21swapper/109:41:151
2884299290,29cyclictest0-21swapper/109:36:471
2884299290,29cyclictest0-21swapper/109:25:081
2884299290,29cyclictest0-21swapper/109:15:061
2884299290,1cyclictest0-21swapper/111:20:471
2884299290,0cyclictest21499-21diskmemload10:20:371
2884299290,0cyclictest0-21swapper/112:25:241
2884299290,0cyclictest0-21swapper/111:10:471
2884299290,0cyclictest0-21swapper/110:55:591
2884299290,0cyclictest0-21swapper/110:50:071
2884299290,0cyclictest0-21swapper/110:40:401
2884299290,0cyclictest0-21swapper/109:55:141
2884299290,0cyclictest0-21swapper/109:14:031
28840992929,0cyclictest0-21swapper/012:05:020
28840992928,1cyclictest22232-21fschecks_time10:50:220
28840992928,1cyclictest0-21swapper/010:00:010
28840992927,1cyclictest14046-21cstates09:35:200
2884099290,29cyclictest23008-21ssh12:31:220
2884099290,29cyclictest21499-21diskmemload11:48:140
2884099290,29cyclictest21499-21diskmemload11:36:070
2884099290,29cyclictest21499-21diskmemload11:25:550
2884099290,29cyclictest21499-21diskmemload10:40:300
2884099290,29cyclictest21499-21diskmemload10:38:350
2884099290,29cyclictest21499-21diskmemload10:31:440
2884099290,29cyclictest21499-21diskmemload09:30:420
2884099290,29cyclictest21499-21diskmemload09:10:580
2884099290,29cyclictest0-21swapper/012:21:000
2884099290,29cyclictest0-21swapper/011:41:060
2884099290,29cyclictest0-21swapper/011:06:310
2884099290,29cyclictest0-21swapper/010:56:030
2884099290,29cyclictest0-21swapper/010:47:540
2884099290,29cyclictest0-21swapper/009:47:050
2884099290,29cyclictest0-21swapper/009:25:140
2884099290,29cyclictest0-21swapper/009:18:030
2884099290,0cyclictest21499-21diskmemload12:10:350
2884099290,0cyclictest21499-21diskmemload11:55:460
2884099290,0cyclictest21499-21diskmemload10:10:040
2884099290,0cyclictest21499-21diskmemload09:55:240
2884099290,0cyclictest0-21swapper/012:26:080
2884099290,0cyclictest0-21swapper/011:51:110
2884099290,0cyclictest0-21swapper/011:15:400
2884099290,0cyclictest0-21swapper/011:10:170
2884099290,0cyclictest0-21swapper/009:40:210
28851992828,0cyclictest21499-21diskmemload09:35:463
28846992828,0cyclictest0-21swapper/212:15:052
28846992828,0cyclictest0-21swapper/209:00:162
28846992828,0cyclictest0-21swapper/207:25:182
28842992826,1cyclictest0-21swapper/108:30:011
28840992828,0cyclictest0-21swapper/007:50:200
28840992828,0cyclictest0-21swapper/007:30:190
2884099280,0cyclictest0-21swapper/008:20:190
2884099280,0cyclictest0-21swapper/008:00:200
28851992727,0cyclictest0-21swapper/309:05:183
28851992727,0cyclictest0-21swapper/307:45:223
28846992725,1cyclictest16826-21cron09:00:012
28840992727,0cyclictest0-21swapper/007:10:020
28851992626,0cyclictest5167-21apt-get08:35:223
28842992626,0cyclictest0-21swapper/109:05:191
28842992626,0cyclictest0-21swapper/108:50:191
28842992626,0cyclictest0-21swapper/108:50:191
28842992626,0cyclictest0-21swapper/107:25:191
28851992525,0cyclictest1633-21apt-get07:20:173
28851992525,0cyclictest0-21swapper/308:55:193
28851992525,0cyclictest0-21swapper/307:10:193
28842992525,0cyclictest1633-21apt-get07:20:181
28840992525,0cyclictest0-21swapper/008:35:220
28851992424,0cyclictest0-21swapper/308:05:003
28842992424,0cyclictest8597-21apt-get07:35:191
28842992422,1cyclictest561-21dbus-daemon08:00:011
28851992323,0cyclictest0-21swapper/307:15:203
28842992323,0cyclictest0-21swapper/108:10:171
28851992222,0cyclictest0-21swapper/308:05:193
28842992222,0cyclictest0-21swapper/108:00:191
28840992222,0cyclictest0-21swapper/008:15:030
28851992121,0cyclictest32347-21apt-get08:25:023
28846992121,0cyclictest25342-21apt-get08:10:172
28846992120,1cyclictest8296-21cron07:35:012
28846992120,1cyclictest10786-21apt-get07:40:012
28840992121,0cyclictest17149-21apt-get09:00:160
28846991919,0cyclictest0-21swapper/208:15:032
28851991818,0cyclictest0-21swapper/308:40:203
28846991818,0cyclictest0-21swapper/207:55:182
28846991818,0cyclictest0-21swapper/207:10:182
28840991818,0cyclictest0-21swapper/008:10:170
28851991717,0cyclictest0-21swapper/307:35:193
28842991717,0cyclictest0-21swapper/107:45:211
28840991717,0cyclictest13721-21apt-get07:45:210
28846991616,0cyclictest0-21swapper/207:40:192
28842991614,1cyclictest28604-21hddtemp_smartct08:15:221
28840991615,1cyclictest11903-21apt-get08:50:010
28846991515,0cyclictest0-21swapper/208:50:032
28846991515,0cyclictest0-21swapper/208:50:022
2884699150,14cyclictest0-21swapper/207:50:262
28842991515,0cyclictest16035-21apt-get07:50:191
2884099150,14cyclictest23029-21apt-get08:05:190
2884099150,14cyclictest0-21swapper/007:20:180
28851991414,0cyclictest0-21swapper/308:10:293
28851991413,1cyclictest27931-21/usr/sbin/munin08:15:243
2885199140,14cyclictest30314-21apt-get08:20:193
2885199140,14cyclictest0-21swapper/309:02:243
2885199140,14cyclictest0-21swapper/308:46:093
2885199140,14cyclictest0-21swapper/308:30:373
2885199140,14cyclictest0-21swapper/307:40:183
2885199140,14cyclictest0-21swapper/307:26:213
2885199140,0cyclictest0-21swapper/307:50:393
2885199140,0cyclictest0-21swapper/307:34:113
28846991412,1cyclictest0-21swapper/208:40:242
2884699140,14cyclictest0-21swapper/209:06:082
2884699140,14cyclictest0-21swapper/208:35:122
2884699140,14cyclictest0-21swapper/208:27:152
2884699140,14cyclictest0-21swapper/208:02:092
2884699140,14cyclictest0-21swapper/207:48:082
2884699140,14cyclictest0-21swapper/207:21:312
2884699140,14cyclictest0-21swapper/207:18:292
28842991414,0cyclictest0-21swapper/109:00:061
28842991414,0cyclictest0-21swapper/108:40:191
28842991414,0cyclictest0-21swapper/108:20:191
28842991414,0cyclictest0-21swapper/107:15:391
28842991414,0cyclictest0-21swapper/107:12:561
2884299140,14cyclictest0-21swapper/108:34:171
2884299140,14cyclictest0-21swapper/107:40:061
2884299140,14cyclictest0-21swapper/107:31:081
2884299140,0cyclictest0-21swapper/108:45:491
2884299140,0cyclictest0-21swapper/108:35:031
2884299140,0cyclictest0-21swapper/108:05:421
28840991414,0cyclictest0-21swapper/008:51:130
28840991414,0cyclictest0-21swapper/008:51:130
2884099140,14cyclictest0-21swapper/009:05:170
2884099140,14cyclictest0-21swapper/008:55:230
2884099140,14cyclictest0-21swapper/008:42:440
2884099140,14cyclictest0-21swapper/008:25:170
2884099140,14cyclictest0-21swapper/007:55:560
2884099140,14cyclictest0-21swapper/007:35:200
2884099140,14cyclictest0-21swapper/007:25:220
2884099140,0cyclictest0-21swapper/007:15:260
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional