You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-10-04 - 04:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack1slot1.osadl.org (updated Wed Oct 04, 2023 00:45:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7282235158,26sleep20-21swapper/219:05:142
28352199161,25sleep10-21swapper/119:09:511
26212199161,25sleep30-21swapper/319:07:033
7212198159,25sleep00-21swapper/019:05:080
184352190,0sleep10-21swapper/122:14:241
293099172,10cyclictest18753-21perf22:15:000
293099158,4cyclictest10732-21latency_hist19:24:590
295099140,13cyclictest0-21swapper/223:20:252
294199140,13cyclictest0-21swapper/123:20:251
2950991210,1cyclictest3354-21ssh22:35:212
295099120,11cyclictest0-21swapper/223:30:152
2930991210,1cyclictest9-21ksoftirqd/023:55:000
2930991210,1cyclictest9-21ksoftirqd/019:19:590
295099110,11cyclictest0-21swapper/200:09:332
2930991110,1cyclictest9-21ksoftirqd/023:30:010
2930991110,1cyclictest9-21ksoftirqd/023:30:010
2930991110,1cyclictest9-21ksoftirqd/021:20:000
295699109,1cyclictest35-21ksoftirqd/319:40:013
293099109,1cyclictest9-21ksoftirqd/000:00:000
293099108,1cyclictest9-21ksoftirqd/020:45:000
293099108,1cyclictest9-21ksoftirqd/020:04:590
29569999,0cyclictest0-21swapper/322:11:103
29569999,0cyclictest0-21swapper/319:52:073
29569998,1cyclictest35-21ksoftirqd/323:40:013
29569998,1cyclictest35-21ksoftirqd/322:49:593
29569998,1cyclictest35-21ksoftirqd/320:25:003
29569998,1cyclictest35-21ksoftirqd/300:35:013
29569998,1cyclictest35-21ksoftirqd/300:25:003
29569998,0cyclictest35-21ksoftirqd/322:20:203
29569997,1cyclictest35-21ksoftirqd/321:40:013
29569994,2cyclictest259-21systemd-journal20:55:003
29509999,0cyclictest0-21swapper/221:31:032
29509996,2cyclictest770-21snmpd19:35:222
29419990,3cyclictest0-21swapper/122:25:191
29309998,1cyclictest9-21ksoftirqd/023:35:010
29309997,1cyclictest9-21ksoftirqd/020:05:200
29309993,5cyclictest0-21swapper/019:25:210
29309992,6cyclictest21871-21ssh22:17:490
29309990,8cyclictest17936-21munin-run21:35:010
29569987,1cyclictest35-21ksoftirqd/323:00:003
29569987,1cyclictest35-21ksoftirqd/320:40:013
29569986,1cyclictest770-21snmpd23:59:173
29569986,1cyclictest770-21snmpd20:15:383
29569986,1cyclictest770-21snmpd20:09:493
29569980,1cyclictest0-21swapper/321:25:173
29509988,0cyclictest0-21swapper/223:13:532
29509986,1cyclictest770-21snmpd19:52:402
29509986,1cyclictest770-21snmpd00:17:372
29509986,1cyclictest770-21snmpd00:02:232
29509986,1cyclictest61250irq/122-eno123:35:172
29509986,1cyclictest61250irq/122-eno122:50:202
29509986,1cyclictest61250irq/122-eno122:10:202
29509986,1cyclictest61250irq/122-eno121:55:222
29509986,1cyclictest61250irq/122-eno121:40:402
29509986,1cyclictest28-21ksoftirqd/221:10:002
29509980,7cyclictest0-21swapper/221:35:062
29509980,3cyclictest0-21swapper/223:53:022
29419983,1cyclictest0-21swapper/120:30:201
29309987,1cyclictest9-21ksoftirqd/020:30:010
29309987,1cyclictest9-21ksoftirqd/019:40:010
29309987,1cyclictest9-21ksoftirqd/000:35:220
29309987,1cyclictest9-21ksoftirqd/000:10:240
29309986,1cyclictest770-21snmpd20:31:140
29309986,1cyclictest770-21snmpd19:52:550
29309986,1cyclictest31927-21ssh22:30:210
29309986,1cyclictest16879-21ntpq22:50:260
29309985,3cyclictest534-21nscd21:46:020
29309983,2cyclictest7414-21/usr/sbin/munin22:40:170
29309982,1cyclictest25391-21ssh23:00:300
29309981,6cyclictest7953-21/usr/sbin/munin23:20:270
29309980,7cyclictest31872-21ssh00:26:280
29309980,7cyclictest30736-21ssh21:50:090
29309980,7cyclictest28964-21ssh00:24:200
29309980,7cyclictest24448-21ssh21:40:450
29309980,7cyclictest22123-21ssh22:56:440
29309980,7cyclictest12639-21ssh21:28:310
29309980,4cyclictest28429-21perf21:10:000
29309980,4cyclictest27375-21munin-run20:00:000
29309980,3cyclictest16558-21ssh00:09:480
29309980,1cyclictest0-21swapper/020:10:210
10926280,0sleep30-21swapper/322:44:243
384270,0sleep30-21swapper/321:51:013
30964270,1sleep10-21swapper/121:11:291
29569976,1cyclictest35-21ksoftirqd/323:50:203
29569976,1cyclictest35-21ksoftirqd/322:20:013
29569976,1cyclictest35-21ksoftirqd/322:00:003
29569976,1cyclictest35-21ksoftirqd/321:35:013
29569975,1cyclictest8826-21ssh22:01:143
29569975,1cyclictest7956-21ssh00:36:343
29569975,1cyclictest770-21snmpd23:42:503
29569975,1cyclictest770-21snmpd21:21:073
29569975,1cyclictest770-21snmpd21:10:423
29569975,1cyclictest770-21snmpd21:07:453
29569975,1cyclictest770-21snmpd20:59:333
29569975,1cyclictest770-21snmpd20:41:153
29569975,1cyclictest770-21snmpd20:13:433
29569975,1cyclictest770-21snmpd20:02:533
29569975,1cyclictest770-21snmpd19:27:143
29569975,1cyclictest770-21snmpd00:15:083
29569975,1cyclictest35-21ksoftirqd/323:10:003
29569974,2cyclictest1971-21proc_pri21:15:303
29569971,2cyclictest0-21swapper/322:35:223
29569970,5cyclictest9963-21sensors_temp19:20:253
29569970,5cyclictest28386-21diskmemload00:27:273
29569970,5cyclictest0-21swapper/322:05:233
29569970,4cyclictest0-21swapper/323:00:493
29569970,1cyclictest12151-21/usr/sbin/munin23:25:183
29569970,1cyclictest12151-21/usr/sbin/munin23:25:183
29509977,0cyclictest61250irq/122-eno122:23:392
29509976,1cyclictest770-21snmpd21:46:112
29509976,1cyclictest61250irq/122-eno123:05:232
29509976,1cyclictest61250irq/122-eno122:46:392
29509976,1cyclictest61250irq/122-eno122:04:542
29509976,1cyclictest61250irq/122-eno121:52:362
29509976,1cyclictest61250irq/122-eno100:13:422
29509976,1cyclictest28-21ksoftirqd/220:45:402
29509976,1cyclictest28-21ksoftirqd/219:59:402
29509976,0cyclictest61250irq/122-eno123:00:032
29509976,0cyclictest61250irq/122-eno122:17:322
29509976,0cyclictest61250irq/122-eno100:32:132
29509975,1cyclictest8345-21cat22:40:202
29509975,1cyclictest770-21snmpd22:33:542
29509975,1cyclictest61250irq/122-eno119:45:252
29509975,1cyclictest61250irq/122-eno119:10:292
29509973,2cyclictest259-21systemd-journal22:30:012
29509972,4cyclictest16409-21munin-plugin-st20:45:002
29509971,3cyclictest13395-21latency_hist21:30:012
29509970,4cyclictest6187-21apt-get19:15:162
29509970,4cyclictest28386-21diskmemload22:10:002
29509970,3cyclictest0-21swapper/220:35:232
29509970,1cyclictest259-21systemd-journal23:59:592
29419972,4cyclictest0-21swapper/121:50:151
29419971,1cyclictest0-21swapper/122:21:541
29419970,6cyclictest0-21swapper/121:31:451
29419970,3cyclictest0-21swapper/123:55:181
29309976,1cyclictest28022-21/usr/sbin/munin23:05:220
29309975,1cyclictest770-21snmpd20:58:300
29309975,1cyclictest770-21snmpd20:38:210
29309975,1cyclictest770-21snmpd20:16:290
29309975,1cyclictest12079-21ssh22:45:230
29309974,1cyclictest259-21systemd-journal19:35:000
29309972,1cyclictest23165-21ssh00:15:510
29309970,6cyclictest3258-21ssh22:35:090
29309970,6cyclictest24366-21ssh23:40:060
29309970,6cyclictest23831-21ssh23:39:270
29309970,6cyclictest11363-21ssh00:02:250
29309970,6cyclictest0-21swapper/023:15:240
29309970,6cyclictest0-21swapper/023:10:300
29309970,6cyclictest0-21swapper/021:20:180
29309970,5cyclictest0-21swapper/023:46:220
29309970,1cyclictest3905-21processes21:55:290
29309970,1cyclictest25680-21ssh22:22:070
29309970,1cyclictest1959-21diskstats00:30:210
29309970,1cyclictest18191-21ssh21:35:060
29309970,1cyclictest13523-21ssh22:07:330
29309970,1cyclictest0-21swapper/022:25:280
29309970,1cyclictest0-21swapper/022:00:230
29309970,1cyclictest0-21swapper/021:10:290
29309970,1cyclictest0-21swapper/020:50:290
29569966,0cyclictest35-21ksoftirqd/319:20:003
29569965,1cyclictest8663-21ssh00:00:123
29569965,1cyclictest770-21snmpd23:22:403
29569965,1cyclictest6180-21ssh23:16:463
29569965,1cyclictest35-21ksoftirqd/320:29:593
29569965,1cyclictest35-21ksoftirqd/319:45:013
29569965,1cyclictest35-21ksoftirqd/319:30:203
29569965,1cyclictest31834-21ssh23:48:493
29569965,1cyclictest3051-21ssh23:14:033
29569965,1cyclictest27566-21ssh21:45:233
29569965,1cyclictest27258-21ssh22:25:153
29569965,1cyclictest25159-21ssh21:42:243
29569965,1cyclictest1949-21ssh22:33:083
29569965,1cyclictest18664-21ssh23:32:013
29569964,1cyclictest770-21snmpd22:51:293
29569964,1cyclictest770-21snmpd21:01:243
29569964,1cyclictest770-21snmpd20:47:503
29569964,1cyclictest770-21snmpd20:31:163
29569962,2cyclictest20347-21apt-get19:45:183
29569961,1cyclictest149922sleep300:06:143
29569960,6cyclictest19409-21ssh00:11:483
29509966,0cyclictest61250irq/122-eno123:25:152
29509966,0cyclictest61250irq/122-eno123:25:152
29509966,0cyclictest61250irq/122-eno122:55:472
29509966,0cyclictest61250irq/122-eno121:20:112
29509966,0cyclictest61250irq/122-eno120:50:192
29509966,0cyclictest61250irq/122-eno120:30:302
29509966,0cyclictest61250irq/122-eno120:27:032
29509966,0cyclictest61250irq/122-eno120:17:142
29509966,0cyclictest61250irq/122-eno120:11:472
29509966,0cyclictest61250irq/122-eno119:31:132
29509966,0cyclictest61250irq/122-eno100:35:232
29509966,0cyclictest0-21swapper/200:20:352
29509965,1cyclictest4760-21cat23:15:252
29509965,1cyclictest29495-21ssh00:25:012
29509965,1cyclictest28801-21ntpq20:00:282
29509964,1cyclictest61250irq/122-eno119:20:162
29509964,1cyclictest28386-21diskmemload23:45:182
29509961,3cyclictest0-21swapper/221:00:192
29509960,6cyclictest0-21swapper/220:58:022
29509960,6cyclictest0-21swapper/219:41:452
29509960,5cyclictest0-21swapper/221:15:012
29509960,1cyclictest0-21swapper/223:40:072
29509960,1cyclictest0-21swapper/220:09:022
29419965,1cyclictest0-21swapper/123:41:531
29419962,2cyclictest0-21swapper/121:55:311
29419961,2cyclictest0-21swapper/122:40:151
29419960,6cyclictest0-21swapper/123:31:161
29419960,6cyclictest0-21swapper/123:26:041
29419960,6cyclictest0-21swapper/123:26:031
29419960,6cyclictest0-21swapper/122:45:181
29419960,6cyclictest0-21swapper/121:35:191
29419960,6cyclictest0-21swapper/121:01:151
29419960,6cyclictest0-21swapper/120:28:531
29419960,6cyclictest0-21swapper/120:14:341
29419960,6cyclictest0-21swapper/119:48:371
29419960,6cyclictest0-21swapper/119:36:131
29419960,6cyclictest0-21swapper/100:36:241
29419960,6cyclictest0-21swapper/100:03:441
29419960,3cyclictest0-21swapper/122:39:241
29419960,3cyclictest0-21swapper/100:18:331
29419960,2cyclictest0-21swapper/121:40:591
29419960,2cyclictest0-21swapper/121:22:181
29419960,1cyclictest0-21swapper/119:50:201
29309966,0cyclictest9-21ksoftirqd/021:00:220
29309964,1cyclictest770-21snmpd19:11:090
29309963,1cyclictest259-21systemd-journal20:50:010
29309960,0cyclictest0-21swapper/019:40:290
29569955,0cyclictest0-21swapper/319:10:463
29569951,2cyclictest25254-21apt-get19:55:183
29509952,1cyclictest4714-21aten2.4-expect20:20:162
29509951,1cyclictest0-21swapper/219:25:192
29509950,1cyclictest0-21swapper/221:05:172
29419955,0cyclictest0-21swapper/123:05:411
29419955,0cyclictest0-21swapper/122:03:261
29419953,1cyclictest0-21swapper/123:10:291
29419953,1cyclictest0-21swapper/121:05:231
29419952,3cyclictest0-21swapper/120:49:261
29419951,2cyclictest0-21swapper/120:35:331
29419951,2cyclictest0-21swapper/120:20:001
29419951,1cyclictest0-21swapper/123:50:241
29419950,5cyclictest0-21swapper/121:47:141
29419950,5cyclictest0-21swapper/120:55:391
29419950,5cyclictest0-21swapper/119:25:361
29419950,4cyclictest0-21swapper/120:50:221
29419950,4cyclictest0-21swapper/119:15:221
29419950,3cyclictest0-21swapper/123:36:361
29419950,3cyclictest0-21swapper/122:55:191
29419950,3cyclictest0-21swapper/121:25:071
29419950,3cyclictest0-21swapper/100:30:181
29419950,2cyclictest0-21swapper/123:46:481
29419950,2cyclictest0-21swapper/122:32:471
29419950,1cyclictest0-21swapper/121:15:011
29419950,1cyclictest0-21swapper/119:20:161
29419950,1cyclictest0-21swapper/100:10:321
29419950,0cyclictest0-21swapper/123:04:481
29419950,0cyclictest0-21swapper/122:08:121
29309954,1cyclictest9-21ksoftirqd/020:20:180
29309953,1cyclictest9-21ksoftirqd/019:45:200
29419943,1cyclictest15637-21chrt22:50:131
29419942,1cyclictest31825-21chrt20:06:461
29419942,1cyclictest19925-21chrt19:42:511
29419941,2cyclictest0-21swapper/120:00:321
29419941,2cyclictest0-21swapper/119:55:181
29419940,3cyclictest0-21swapper/122:15:251
29419940,3cyclictest0-21swapper/119:10:261
29419940,3cyclictest0-21swapper/100:07:351
29419940,2cyclictest0-21swapper/120:45:011
29419940,2cyclictest0-21swapper/119:30:181
29419940,2cyclictest0-21swapper/100:25:271
29419940,1cyclictest0-21swapper/123:15:021
29419940,0cyclictest0-21swapper/100:20:291
29419933,0cyclictest0-21swapper/120:20:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional