You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-29 - 20:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5.osadl.org (updated Thu Feb 29, 2024 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1350993227,1cyclictest31909-21apt-get11:35:191
135099320,31cyclictest0-21swapper/109:41:581
135099320,29cyclictest25191-21diskmemload09:10:511
135099320,29cyclictest0-21swapper/111:55:091
1353993128,2cyclictest4920-21ssh11:05:392
135399310,30cyclictest558-21irqbalance10:11:082
1350993129,1cyclictest561-21dbus-daemon07:50:001
1350993128,0cyclictest0-21swapper/112:33:311
1350993128,0cyclictest0-21swapper/110:50:361
135099310,28cyclictest25191-21diskmemload09:35:091
135099310,0cyclictest0-21swapper/111:12:251
1345993129,1cyclictest7048-21expr10:00:210
1356993028,1cyclictest0-21swapper/311:15:013
1356993028,1cyclictest0-21swapper/310:35:243
1356993028,1cyclictest0-21swapper/310:10:173
135699300,29cyclictest4451-21sh09:21:023
135699300,29cyclictest28211-21chrt10:56:223
135699300,29cyclictest25191-21diskmemload12:11:533
135699300,29cyclictest25191-21diskmemload11:26:573
135699300,29cyclictest25191-21diskmemload09:56:043
135699300,29cyclictest15857-21awk12:25:283
135699300,29cyclictest114442sleep309:30:183
135699300,29cyclictest10593-21ssh10:04:343
135699300,29cyclictest0-21swapper/311:49:263
135699300,29cyclictest0-21swapper/310:50:323
135699300,29cyclictest0-21swapper/310:31:213
135699300,29cyclictest0-21swapper/310:31:213
135699300,29cyclictest0-21swapper/309:28:193
1353993028,2cyclictest0-21swapper/209:31:112
1353993028,1cyclictest29012-21ssh10:24:132
1353993028,1cyclictest28182-21cron12:40:012
1353993028,1cyclictest16526-21sh11:18:592
1353993028,1cyclictest16526-21sh11:18:592
135399301,1cyclictest25191-21diskmemload12:17:442
135399300,29cyclictest25191-21diskmemload11:56:352
135399300,29cyclictest25191-21diskmemload11:47:252
135399300,29cyclictest25191-21diskmemload10:47:052
135399300,29cyclictest2411-21systemd-journal07:25:012
135399300,29cyclictest1843-21ssh11:36:282
135399300,29cyclictest13810-21sh10:41:262
135399300,29cyclictest0-21swapper/210:51:352
135399300,29cyclictest0-21swapper/209:50:022
135399300,29cyclictest0-21swapper/208:30:222
135399300,1cyclictest25191-21diskmemload12:13:562
1350993028,1cyclictest0-21swapper/110:20:011
1350993027,2cyclictest14979-21sh11:16:141
1350993027,2cyclictest14979-21sh11:16:141
135099300,29cyclictest30183-21apt-get10:25:191
135099300,29cyclictest26381-21ntp_states09:45:291
135099300,29cyclictest25191-21diskmemload10:06:121
135099300,29cyclictest0-21swapper/112:11:491
135099300,29cyclictest0-21swapper/110:35:231
135099300,29cyclictest0-21swapper/110:12:551
135099300,29cyclictest0-21swapper/109:30:191
135099300,1cyclictest25191-21diskmemload10:56:481
135099300,1cyclictest17054-21ssh12:26:321
1345993028,1cyclictest4862sleep012:10:030
134599300,30cyclictest25191-21diskmemload09:12:060
134599300,29cyclictest31541-21/usr/sbin/munin09:15:350
134599300,29cyclictest25191-21diskmemload11:40:030
134599300,29cyclictest25191-21diskmemload11:08:020
134599300,29cyclictest12416-21perf11:15:010
134599300,29cyclictest0-21swapper/009:37:210
134599300,1cyclictest0-21swapper/011:25:330
134599300,1cyclictest0-21swapper/010:55:010
1356992929,0cyclictest0-21swapper/309:45:053
1356992929,0cyclictest0-21swapper/308:40:213
135699290,29cyclictest25191-21diskmemload11:15:403
135699290,29cyclictest25191-21diskmemload11:15:403
135699290,29cyclictest25191-21diskmemload10:28:083
135699290,29cyclictest0-21swapper/312:35:083
135699290,29cyclictest0-21swapper/312:06:413
135699290,29cyclictest0-21swapper/311:55:393
135699290,29cyclictest0-21swapper/311:36:043
135699290,29cyclictest0-21swapper/311:20:213
135699290,29cyclictest0-21swapper/311:07:013
135699290,29cyclictest0-21swapper/311:00:383
135699290,29cyclictest0-21swapper/310:15:303
135699290,29cyclictest0-21swapper/309:51:093
135699290,29cyclictest0-21swapper/309:40:403
135699290,29cyclictest0-21swapper/309:35:163
135699290,29cyclictest0-21swapper/309:10:033
135699290,0cyclictest25191-21diskmemload12:30:193
135699290,0cyclictest25191-21diskmemload12:22:033
135699290,0cyclictest25191-21diskmemload12:17:293
135699290,0cyclictest25191-21diskmemload11:41:513
135699290,0cyclictest25191-21diskmemload11:30:073
135699290,0cyclictest25191-21diskmemload10:49:123
135699290,0cyclictest25191-21diskmemload10:20:213
135699290,0cyclictest25191-21diskmemload10:08:223
135699290,0cyclictest25191-21diskmemload09:15:113
135699290,0cyclictest0-21swapper/312:01:043
135699290,0cyclictest0-21swapper/310:40:213
1353992929,0cyclictest0-21swapper/210:33:002
1353992929,0cyclictest0-21swapper/210:33:002
1353992928,1cyclictest25191-21diskmemload12:25:272
1353992928,1cyclictest25191-21diskmemload11:40:522
1353992928,1cyclictest25191-21diskmemload11:26:422
1353992928,1cyclictest20476-21ssh12:30:292
1353992927,1cyclictest25191-21diskmemload09:55:272
1353992927,1cyclictest0-21swapper/211:10:492
135399290,29cyclictest30753-21apt-get11:00:202
135399290,29cyclictest25191-21diskmemload11:20:552
135399290,29cyclictest25191-21diskmemload10:35:482
135399290,29cyclictest25191-21diskmemload10:00:102
135399290,29cyclictest0-21swapper/212:20:052
135399290,29cyclictest0-21swapper/212:06:252
135399290,29cyclictest0-21swapper/210:26:332
135399290,29cyclictest0-21swapper/209:20:332
135399290,29cyclictest0-21swapper/209:10:112
135399290,28cyclictest0-21swapper/209:45:212
135399290,1cyclictest19153-21ssh09:38:102
135399290,1cyclictest13314-21ssh10:06:032
135399290,1cyclictest0-21swapper/210:15:322
135399290,0cyclictest25191-21diskmemload12:00:112
135399290,0cyclictest25191-21diskmemload09:27:282
135399290,0cyclictest25191-21diskmemload09:15:412
135399290,0cyclictest0-21swapper/211:50:172
135399290,0cyclictest0-21swapper/211:31:042
135399290,0cyclictest0-21swapper/210:56:012
135399290,0cyclictest0-21swapper/209:41:422
135399290,0cyclictest0-21swapper/208:05:242
1350992929,0cyclictest25191-21diskmemload12:35:431
1350992929,0cyclictest0-21swapper/111:20:101
1350992929,0cyclictest0-21swapper/109:56:191
1350992929,0cyclictest0-21swapper/109:20:001
1350992927,2cyclictest13093-21ssh12:23:171
135099290,29cyclictest25191-21diskmemload11:25:071
135099290,29cyclictest25191-21diskmemload11:00:311
135099290,29cyclictest0-21swapper/112:02:041
135099290,29cyclictest0-21swapper/111:46:581
135099290,29cyclictest0-21swapper/110:45:541
135099290,29cyclictest0-21swapper/110:34:531
135099290,29cyclictest0-21swapper/110:34:531
135099290,29cyclictest0-21swapper/110:16:571
135099290,29cyclictest0-21swapper/109:17:571
135099290,0cyclictest6692-21apt-get10:00:201
135099290,0cyclictest25191-21diskmemload11:05:051
135099290,0cyclictest25191-21diskmemload10:41:211
135099290,0cyclictest25191-21diskmemload09:27:581
135099290,0cyclictest0-21swapper/112:15:051
135099290,0cyclictest0-21swapper/112:06:131
135099290,0cyclictest0-21swapper/111:51:081
135099290,0cyclictest0-21swapper/111:41:221
135099290,0cyclictest0-21swapper/111:30:161
135099290,0cyclictest0-21swapper/109:51:141
1345992929,0cyclictest0-21swapper/012:25:140
1345992929,0cyclictest0-21swapper/012:20:580
1345992929,0cyclictest0-21swapper/011:00:210
1345992929,0cyclictest0-21swapper/009:50:470
1345992929,0cyclictest0-21swapper/009:40:280
1345992928,1cyclictest21571-21pluginstate10:15:300
1345992928,1cyclictest0-21swapper/011:45:310
1345992928,1cyclictest0-21swapper/010:35:210
1345992927,2cyclictest18076-21rm10:11:300
134599290,29cyclictest30261-21kworker/u8:112:07:000
134599290,29cyclictest25191-21diskmemload10:50:040
134599290,29cyclictest25191-21diskmemload10:06:180
134599290,29cyclictest25191-21diskmemload09:55:220
134599290,29cyclictest25191-21diskmemload09:32:110
134599290,29cyclictest25191-21diskmemload09:29:000
134599290,29cyclictest0-21swapper/012:17:120
134599290,29cyclictest0-21swapper/011:35:360
134599290,29cyclictest0-21swapper/011:20:200
134599290,29cyclictest0-21swapper/010:26:340
134599290,29cyclictest0-21swapper/009:20:110
134599290,28cyclictest0-21swapper/012:35:160
134599290,0cyclictest25191-21diskmemload12:30:410
134599290,0cyclictest25191-21diskmemload10:46:330
134599290,0cyclictest25191-21diskmemload09:45:130
134599290,0cyclictest14185-21apt-get11:50:210
134599290,0cyclictest0-21swapper/012:00:360
134599290,0cyclictest0-21swapper/011:57:050
134599290,0cyclictest0-21swapper/010:30:140
134599290,0cyclictest0-21swapper/010:30:140
134599290,0cyclictest0-21swapper/010:20:020
1356992828,0cyclictest0-21swapper/311:50:073
135699280,0cyclictest0-21swapper/308:50:183
1353992828,0cyclictest0-21swapper/209:00:222
1350992828,0cyclictest11544-21apt-get08:40:211
135099280,0cyclictest0-21swapper/107:40:231
1345992828,0cyclictest18503-21apt-get08:55:210
1345992828,0cyclictest18503-21apt-get08:55:210
1345992826,1cyclictest0-21swapper/008:50:010
1356992726,0cyclictest0-21swapper/308:20:243
1356992725,1cyclictest561-21dbus-daemon07:20:013
1350992727,0cyclictest0-21swapper/108:35:211
1350992725,1cyclictest20544-21sendmail-msp09:00:001
1350992725,1cyclictest20544-21sendmail-msp09:00:001
1345992727,0cyclictest0-21swapper/009:05:240
1345992727,0cyclictest0-21swapper/009:00:220
1353992626,0cyclictest0-21swapper/207:55:242
1350992626,0cyclictest0-21swapper/108:00:201
1345992626,0cyclictest0-21swapper/008:30:220
1345992623,2cyclictest13249-21idleruntime-cro07:35:010
1353992525,0cyclictest0-21swapper/208:20:232
1353992523,1cyclictest581-21polkitd08:20:012
1345992525,0cyclictest0-21swapper/008:10:200
1350992423,1cyclictest0-21swapper/108:05:241
1350992423,0cyclictest6881-21apt-get08:30:221
1350992422,1cyclictest8596-21cron07:25:011
1356992323,0cyclictest0-21swapper/307:40:233
1356992323,0cyclictest0-21swapper/307:25:223
1353992323,0cyclictest0-21swapper/207:15:022
1345992323,0cyclictest0-21swapper/007:35:220
1345992321,1cyclictest0-21swapper/007:30:010
1353992222,0cyclictest0-21swapper/207:10:212
1353992221,1cyclictest6577-21cron08:30:002
1350992222,0cyclictest22959-21apt-get07:55:251
1356992121,0cyclictest0-21swapper/308:10:213
1356992121,0cyclictest0-21swapper/307:30:213
1350992121,0cyclictest31983-21perf08:15:011
1345992121,0cyclictest0-21swapper/008:20:240
1345992121,0cyclictest0-21swapper/007:10:210
1356992020,0cyclictest0-21swapper/308:15:223
1350992020,0cyclictest20848-21apt-get09:00:221
1345991917,1cyclictest6608-21munin-run08:30:000
1356991818,0cyclictest0-21swapper/308:25:223
1350991717,0cyclictest0-21swapper/108:20:231
1350991715,1cyclictest0-21swapper/108:20:011
1345991717,0cyclictest0-21swapper/007:55:250
1345991715,1cyclictest27312-21cron08:05:010
1356991616,0cyclictest0-21swapper/307:35:213
135099163,0cyclictest0-21swapper/107:28:231
1350991614,1cyclictest561-21dbus-daemon08:30:001
1353991515,0cyclictest0-21swapper/209:05:242
135399150,14cyclictest0-21swapper/207:28:382
1350991515,0cyclictest0-21swapper/107:15:021
1350991514,1cyclictest16180-21apt-get08:50:181
135099150,14cyclictest0-21swapper/107:50:211
134599150,1cyclictest10105-21memory08:35:260
134599150,14cyclictest0-21swapper/007:50:240
1356991414,0cyclictest0-21swapper/307:45:243
135699140,14cyclictest0-21swapper/309:05:193
135699140,14cyclictest0-21swapper/308:55:113
135699140,14cyclictest0-21swapper/308:55:113
135699140,14cyclictest0-21swapper/308:35:193
135699140,14cyclictest0-21swapper/308:05:343
135699140,14cyclictest0-21swapper/307:55:453
135699140,14cyclictest0-21swapper/307:50:453
135699140,14cyclictest0-21swapper/307:11:283
135699140,0cyclictest0-21swapper/309:00:133
135699140,0cyclictest0-21swapper/308:45:043
135699140,0cyclictest0-21swapper/308:31:173
135699140,0cyclictest0-21swapper/308:01:583
135399140,14cyclictest0-21swapper/208:55:292
135399140,14cyclictest0-21swapper/208:55:292
135399140,14cyclictest0-21swapper/208:40:522
135399140,14cyclictest0-21swapper/207:45:172
135399140,14cyclictest0-21swapper/207:40:052
135399140,14cyclictest0-21swapper/207:35:232
135399140,0cyclictest0-21swapper/208:49:212
135399140,0cyclictest0-21swapper/208:04:492
1350991414,0cyclictest1609-21apt-get07:10:211
1350991414,0cyclictest0-21swapper/107:35:271
135099140,14cyclictest0-21swapper/109:07:121
135099140,14cyclictest0-21swapper/108:45:101
135099140,14cyclictest0-21swapper/107:32:461
1345991414,0cyclictest0-21swapper/008:40:370
1345991414,0cyclictest0-21swapper/007:45:100
134599140,14cyclictest0-21swapper/008:19:240
134599140,14cyclictest0-21swapper/008:05:220
134599140,14cyclictest0-21swapper/007:20:020
134599140,0cyclictest0-21swapper/008:54:490
134599140,0cyclictest0-21swapper/007:40:420
135699130,0cyclictest0-21swapper/307:20:193
1353991313,0cyclictest0-21swapper/208:36:402
1353991313,0cyclictest0-21swapper/207:30:452
135399130,13cyclictest0-21swapper/208:50:492
135399130,13cyclictest0-21swapper/208:10:262
135399130,0cyclictest0-21swapper/207:50:162
1345991111,0cyclictest0-21swapper/007:15:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional