You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 03:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Fri Jul 26, 2024 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28684994444,0cyclictest0-21swapper/010:57:550
28690993127,1cyclictest0-21swapper/210:05:572
28692993013,13cyclictest34-21ksoftirqd/310:47:393
2869099301,28cyclictest271rcuc/211:38:312
2868499300,29cyclictest20403-21apt-get11:25:130
28692992928,1cyclictest21007-21diskmemload10:32:043
2869299290,28cyclictest21007-21diskmemload11:45:463
2869299290,28cyclictest21007-21diskmemload09:26:143
2869299290,28cyclictest21007-21diskmemload09:17:203
2869299290,28cyclictest19753-21ssh10:50:153
2869299290,28cyclictest0-21swapper/311:10:123
2869299290,28cyclictest0-21swapper/310:17:353
2869299290,28cyclictest0-21swapper/308:00:123
2869299290,1cyclictest21007-21diskmemload11:56:263
2869299290,1cyclictest21007-21diskmemload11:30:513
2869299290,1cyclictest17767-21taskset10:14:593
2869099290,28cyclictest28-21ksoftirqd/210:42:522
2869099290,28cyclictest21007-21diskmemload09:57:532
2869099290,28cyclictest19266-21apt-get10:50:132
2869099290,28cyclictest0-21swapper/211:45:112
2869099290,28cyclictest0-21swapper/211:21:052
2869099290,28cyclictest0-21swapper/210:37:002
2869099290,28cyclictest0-21swapper/210:25:282
2869099290,28cyclictest0-21swapper/210:16:552
2869099290,28cyclictest0-21swapper/209:47:282
28686992929,0cyclictest0-21swapper/111:35:491
28686992927,1cyclictest0-21swapper/111:12:131
2868699290,28cyclictest4415-21cron12:35:011
2868699290,28cyclictest21007-21diskmemload11:16:051
2868699290,28cyclictest21007-21diskmemload10:42:441
2868699290,28cyclictest14413-21ssh10:45:041
2868699290,28cyclictest0-21swapper/111:43:291
2868699290,28cyclictest0-21swapper/110:51:251
2868699290,28cyclictest0-21swapper/110:13:361
2868699290,28cyclictest0-21swapper/109:30:131
2868699290,28cyclictest0-21swapper/109:14:391
2868699290,1cyclictest28395-21runrttasks09:16:051
2868699290,1cyclictest21007-21diskmemload09:59:101
2868699290,1cyclictest0-21swapper/109:45:131
28684992928,1cyclictest21007-21diskmemload11:11:130
28684992928,1cyclictest21007-21diskmemload11:07:310
2868499290,29cyclictest21007-21diskmemload11:43:000
2868499290,29cyclictest21007-21diskmemload11:16:370
2868499290,29cyclictest0-21swapper/010:18:560
2868499290,28cyclictest21007-21diskmemload10:46:190
2868499290,28cyclictest0-21swapper/009:45:570
2868499290,0cyclictest0-21swapper/009:19:470
28692992828,0cyclictest27789-21apt-get12:15:103
28692992828,0cyclictest21007-21diskmemload09:35:503
28692992828,0cyclictest21007-21diskmemload09:21:383
28692992828,0cyclictest0-21swapper/311:43:133
28692992828,0cyclictest0-21swapper/311:20:063
28692992827,1cyclictest21007-21diskmemload11:50:003
2869299280,28cyclictest21007-21diskmemload10:05:263
2869299280,28cyclictest0-21swapper/311:26:093
2869299280,28cyclictest0-21swapper/310:23:173
2869299280,28cyclictest0-21swapper/309:51:463
2869299280,28cyclictest0-21swapper/307:45:113
2869299280,27cyclictest0-21swapper/312:35:103
2869299280,27cyclictest0-21swapper/309:45:113
2869299280,0cyclictest21007-21diskmemload10:42:093
2869299280,0cyclictest0-21swapper/311:35:103
2869299280,0cyclictest0-21swapper/311:06:143
2869299280,0cyclictest0-21swapper/310:55:083
2869299280,0cyclictest0-21swapper/310:35:293
2869299280,0cyclictest0-21swapper/310:28:093
2869299280,0cyclictest0-21swapper/309:56:563
2869299280,0cyclictest0-21swapper/309:40:113
2869299280,0cyclictest0-21swapper/309:30:143
2869299280,0cyclictest0-21swapper/309:10:113
2869299280,0cyclictest0-21swapper/308:55:123
28690992828,0cyclictest271rcuc/211:50:582
28690992828,0cyclictest0-21swapper/211:40:542
28690992828,0cyclictest0-21swapper/211:05:592
28690992828,0cyclictest0-21swapper/207:40:122
28690992827,1cyclictest271rcuc/210:56:122
28690992827,1cyclictest21007-21diskmemload09:11:182
2869099280,28cyclictest21007-21diskmemload11:00:412
2869099280,28cyclictest0-21swapper/210:45:222
2869099280,28cyclictest0-21swapper/210:21:472
2869099280,28cyclictest0-21swapper/210:00:062
2869099280,28cyclictest0-21swapper/209:30:102
2869099280,28cyclictest0-21swapper/209:25:532
2869099280,28cyclictest0-21swapper/209:15:332
2869099280,0cyclictest31550-21apt-get07:15:122
2869099280,0cyclictest23151-21apt-get12:05:112
2869099280,0cyclictest21007-21diskmemload11:27:382
2869099280,0cyclictest21007-21diskmemload10:10:462
2869099280,0cyclictest21007-21diskmemload09:20:202
2869099280,0cyclictest0-21swapper/211:32:082
2869099280,0cyclictest0-21swapper/211:17:312
2869099280,0cyclictest0-21swapper/209:52:082
2869099280,0cyclictest0-21swapper/209:35:472
28686992828,0cyclictest24028-21apt-get10:55:091
28686992828,0cyclictest21007-21diskmemload11:05:151
28686992828,0cyclictest21007-21diskmemload11:03:531
28686992828,0cyclictest0-21swapper/111:25:181
28686992828,0cyclictest0-21swapper/111:20:461
28686992828,0cyclictest0-21swapper/110:25:311
28686992828,0cyclictest0-21swapper/110:20:161
28686992828,0cyclictest0-21swapper/109:40:251
28686992828,0cyclictest0-21swapper/108:50:111
2868699280,28cyclictest21007-21diskmemload09:50:371
2868699280,28cyclictest0-21swapper/111:55:331
2868699280,28cyclictest0-21swapper/111:30:221
2868699280,28cyclictest0-21swapper/110:31:271
2868699280,28cyclictest0-21swapper/110:15:521
2868699280,28cyclictest0-21swapper/110:05:111
2868699280,28cyclictest0-21swapper/110:01:511
2868699280,28cyclictest0-21swapper/109:20:081
2868699280,0cyclictest0-21swapper/111:51:571
2868699280,0cyclictest0-21swapper/111:47:301
2868699280,0cyclictest0-21swapper/110:35:121
2868699280,0cyclictest0-21swapper/109:36:431
2868699280,0cyclictest0-21swapper/109:25:061
28684992828,0cyclictest21007-21diskmemload10:40:420
28684992828,0cyclictest21007-21diskmemload09:30:450
28684992828,0cyclictest21007-21diskmemload09:22:220
28684992828,0cyclictest0-21swapper/010:10:560
28684992828,0cyclictest0-21swapper/009:55:050
28684992828,0cyclictest0-21swapper/009:52:230
28684992827,1cyclictest0-21swapper/011:36:350
28684992826,1cyclictest4203-21cut10:00:120
2868499280,28cyclictest0-21swapper/011:34:330
2868499280,28cyclictest0-21swapper/011:21:070
2868499280,28cyclictest0-21swapper/010:51:400
2868499280,28cyclictest0-21swapper/010:27:430
2868499280,28cyclictest0-21swapper/010:20:360
2868499280,28cyclictest0-21swapper/010:09:110
2868499280,0cyclictest23169-21apt-get08:05:090
2868499280,0cyclictest21370-21apt-get09:10:090
2868499280,0cyclictest21007-21diskmemload10:37:550
2868499280,0cyclictest21007-21diskmemload09:25:310
2868499280,0cyclictest1647-21sshd10:30:210
2868499280,0cyclictest0-21swapper/011:55:240
2868499280,0cyclictest0-21swapper/011:45:050
2868499280,0cyclictest0-21swapper/011:01:370
2868499280,0cyclictest0-21swapper/009:43:240
2868499280,0cyclictest0-21swapper/009:36:260
2868499280,0cyclictest0-21swapper/007:50:130
28692992727,0cyclictest0-21swapper/311:00:113
28692992727,0cyclictest0-21swapper/310:00:023
28692992725,1cyclictest22873-21cron12:05:013
28690992727,0cyclictest29225-21apt-get07:10:102
28690992727,0cyclictest0-21swapper/211:55:102
28690992727,0cyclictest0-21swapper/210:31:012
28690992727,0cyclictest0-21swapper/208:00:122
28690992727,0cyclictest0-21swapper/207:25:012
28690992727,0cyclictest0-21swapper/207:25:012
28690992726,1cyclictest8184-21perf07:35:022
28690992726,1cyclictest6765-21perf12:40:012
2869099270,27cyclictest0-21swapper/209:40:042
28686992727,0cyclictest0-21swapper/112:20:141
28686992727,0cyclictest0-21swapper/112:05:101
28686992727,0cyclictest0-21swapper/108:45:121
28690992626,0cyclictest14319-21apt-get08:55:122
28690992525,0cyclictest0-21swapper/212:25:092
28690992525,0cyclictest0-21swapper/208:25:112
28686992524,1cyclictest1484-21apt-get07:20:131
28686992524,1cyclictest1484-21apt-get07:20:131
28684992525,0cyclictest0-21swapper/007:10:020
28692992424,0cyclictest0-21swapper/309:05:113
28692992421,2cyclictest575-21dbus-daemon07:35:023
28690992424,0cyclictest0-21swapper/208:50:112
28686992424,0cyclictest30164-21apt-get08:20:131
28686992424,0cyclictest0-21swapper/108:10:141
28684992424,0cyclictest0-21swapper/008:55:120
28692992323,0cyclictest0-21swapper/307:10:103
28690992321,1cyclictest7076-21sh08:39:592
28684992322,1cyclictest11714-21cron08:50:000
28684992321,1cyclictest13224-21cron07:45:010
2869299229,0cyclictest0-21swapper/312:28:253
28690992222,0cyclictest28-21ksoftirqd/207:54:072
28686992222,0cyclictest7357-21apt-get08:40:091
28686992222,0cyclictest0-21swapper/112:25:111
28686992222,0cyclictest0-21swapper/107:35:121
28684992222,0cyclictest32465-21apt-get12:25:110
28684992222,0cyclictest0-21swapper/009:00:120
28684992222,0cyclictest0-21swapper/008:30:090
28684992222,0cyclictest0-21swapper/007:55:110
28692992121,0cyclictest2375-21apt-get12:30:113
28692992119,1cyclictest10879-21cron07:40:023
28690992121,0cyclictest0-21swapper/209:05:112
28686992121,0cyclictest16661-21apt-get09:00:131
28686992121,0cyclictest0-21swapper/112:10:091
28686992121,0cyclictest0-21swapper/107:25:111
28690992020,0cyclictest0-21swapper/208:40:082
28690992019,1cyclictest20776-21apt-get12:00:122
28692991919,0cyclictest0-21swapper/307:20:133
28692991919,0cyclictest0-21swapper/307:20:133
28692991919,0cyclictest0-21swapper/307:15:113
28692991917,1cyclictest5866-21munin-run07:30:013
28690991919,0cyclictest0-21swapper/212:30:122
28684991919,0cyclictest0-21swapper/012:10:110
28684991918,0cyclictest0-21swapper/012:15:100
28690991816,1cyclictest32185-21idleruntime-cro12:25:002
28686991818,0cyclictest0-21swapper/107:40:121
28692991717,0cyclictest0-21swapper/308:10:143
28686991717,0cyclictest0-21swapper/112:15:091
28686991717,0cyclictest0-21swapper/108:30:081
28684991717,0cyclictest6126-21apt-get07:30:110
28684991717,0cyclictest0-21swapper/007:15:120
28692991616,0cyclictest0-21swapper/308:35:113
28692991616,0cyclictest0-21swapper/308:15:113
28692991614,1cyclictest0-21swapper/307:55:003
2869299160,15cyclictest24773-21head12:05:213
28690991614,1cyclictest308-21systemd-journal07:30:012
28690991614,1cyclictest27547-21perf08:15:022
2869099160,15cyclictest30967-21irqstats08:20:182
28686991616,0cyclictest0-21swapper/108:05:101
28690991515,0cyclictest0-21swapper/207:35:132
28690991513,1cyclictest4741-21latency_hist08:34:592
28690991513,1cyclictest0-21swapper/207:55:132
28684991515,0cyclictest0-21swapper/008:15:100
28684991513,1cyclictest1120-21ntp_states08:25:190
2868499150,1cyclictest0-21swapper/007:40:010
2868499150,14cyclictest20796-21apt-get08:00:130
2868499150,14cyclictest0-21swapper/012:05:100
2869299146,7cyclictest31016-21wc12:20:193
28692991414,0cyclictest0-21swapper/309:00:553
28692991414,0cyclictest0-21swapper/308:47:153
28692991414,0cyclictest0-21swapper/308:40:193
2869299140,14cyclictest0-21swapper/312:11:233
2869299140,14cyclictest0-21swapper/308:51:503
2869299140,14cyclictest0-21swapper/308:25:063
2869299140,14cyclictest0-21swapper/308:24:083
2869299140,14cyclictest0-21swapper/307:40:073
2869299140,0cyclictest0-21swapper/308:33:533
2869099140,14cyclictest26468-21strings12:10:172
2869099140,14cyclictest0-21swapper/209:00:362
2869099140,14cyclictest0-21swapper/208:46:542
2869099140,14cyclictest0-21swapper/208:15:042
2869099140,14cyclictest0-21swapper/208:06:472
2869099140,14cyclictest0-21swapper/207:46:072
2869099140,0cyclictest0-21swapper/212:16:092
28686991414,0cyclictest0-21swapper/109:07:101
28686991414,0cyclictest0-21swapper/108:25:061
28686991414,0cyclictest0-21swapper/107:30:421
2868699140,14cyclictest0-21swapper/112:37:061
2868699140,14cyclictest0-21swapper/112:00:041
2868699140,14cyclictest0-21swapper/108:55:341
2868699140,14cyclictest0-21swapper/108:16:121
2868699140,14cyclictest0-21swapper/108:01:381
2868699140,14cyclictest0-21swapper/107:50:511
2868699140,14cyclictest0-21swapper/107:45:031
2868699140,14cyclictest0-21swapper/107:15:301
2868699140,14cyclictest0-21swapper/107:11:051
2868699140,0cyclictest0-21swapper/108:35:331
2868699140,0cyclictest0-21swapper/107:57:291
28684991414,0cyclictest0-21swapper/012:30:060
28684991414,0cyclictest0-21swapper/009:05:020
28684991414,0cyclictest0-21swapper/007:45:090
2868499140,14cyclictest0-21swapper/012:35:250
2868499140,14cyclictest0-21swapper/012:20:490
2868499140,14cyclictest0-21swapper/012:04:110
2868499140,14cyclictest0-21swapper/008:40:230
2868499140,14cyclictest0-21swapper/008:35:250
2868499140,14cyclictest0-21swapper/008:10:030
2868499140,0cyclictest0-21swapper/008:51:330
2868499140,0cyclictest0-21swapper/008:21:120
2868499140,0cyclictest0-21swapper/007:26:090
2868499140,0cyclictest0-21swapper/007:20:050
2868499140,0cyclictest0-21swapper/007:20:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional