You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-10-01 - 21:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Sun Oct 01, 2023 12:45:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
206922229157,26sleep00-21swapper/007:06:430
206362221157,24sleep10-21swapper/107:06:001
207552214153,49sleep30-21swapper/307:07:353
209112206162,30sleep20-21swapper/207:09:342
52472630,0sleep10-21swapper/112:30:251
16642580,0sleep30-21swapper/311:09:083
21035991918,1cyclictest28-21ksoftirqd/211:25:152
21035991918,1cyclictest28-21ksoftirqd/211:19:592
21035991918,1cyclictest28-21ksoftirqd/210:30:172
21035991918,1cyclictest28-21ksoftirqd/210:25:142
21035991817,1cyclictest28-21ksoftirqd/212:05:222
21035991817,1cyclictest28-21ksoftirqd/209:55:192
21035991816,1cyclictest28-21ksoftirqd/211:20:172
21035991716,1cyclictest28-21ksoftirqd/211:55:242
21035991716,1cyclictest28-21ksoftirqd/210:40:332
21035991716,1cyclictest28-21ksoftirqd/210:07:102
21035991716,1cyclictest28-21ksoftirqd/208:00:202
21035991716,1cyclictest28-21ksoftirqd/207:45:002
21035991715,1cyclictest28-21ksoftirqd/210:10:222
21035991615,1cyclictest28-21ksoftirqd/211:44:132
21035991614,2cyclictest28-21ksoftirqd/209:15:372
2101999160,10cyclictest19446-21perf12:10:000
21035991515,0cyclictest28-21ksoftirqd/210:24:162
21035991514,1cyclictest28-21ksoftirqd/211:05:272
21035991514,1cyclictest28-21ksoftirqd/209:53:112
21035991513,2cyclictest28-21ksoftirqd/209:42:522
21035991414,0cyclictest28-21ksoftirqd/210:15:332
21035991414,0cyclictest28-21ksoftirqd/208:50:172
21035991414,0cyclictest28-21ksoftirqd/208:45:212
21035991414,0cyclictest28-21ksoftirqd/208:10:122
21035991413,1cyclictest28-21ksoftirqd/212:00:032
21035991413,1cyclictest28-21ksoftirqd/210:04:172
21035991413,1cyclictest28-21ksoftirqd/207:14:212
21035991411,1cyclictest28-21ksoftirqd/211:35:002
2103599137,4cyclictest28-21ksoftirqd/210:35:232
21035991312,1cyclictest28-21ksoftirqd/212:30:262
21035991312,1cyclictest28-21ksoftirqd/211:45:222
21035991312,1cyclictest28-21ksoftirqd/210:45:402
21035991312,1cyclictest28-21ksoftirqd/209:30:082
21035991312,1cyclictest28-21ksoftirqd/209:10:022
21035991312,1cyclictest28-21ksoftirqd/208:55:012
21035991311,1cyclictest28-21ksoftirqd/209:40:002
21035991311,1cyclictest28-21ksoftirqd/209:25:002
2103599130,0cyclictest0-21swapper/209:00:032
21019991312,1cyclictest9-21ksoftirqd/008:30:000
21035991212,0cyclictest28-21ksoftirqd/212:26:022
21035991212,0cyclictest28-21ksoftirqd/210:58:592
21035991212,0cyclictest28-21ksoftirqd/207:50:122
21035991211,1cyclictest28-21ksoftirqd/212:35:162
21035991211,1cyclictest28-21ksoftirqd/212:20:172
21035991211,1cyclictest28-21ksoftirqd/211:50:222
21035991211,1cyclictest28-21ksoftirqd/211:35:132
21035991211,1cyclictest28-21ksoftirqd/211:10:212
21035991211,1cyclictest28-21ksoftirqd/211:00:152
21035991211,1cyclictest28-21ksoftirqd/209:45:172
21035991211,1cyclictest28-21ksoftirqd/209:29:592
21035991211,1cyclictest28-21ksoftirqd/208:20:232
21035991211,1cyclictest28-21ksoftirqd/208:00:012
21035991210,1cyclictest28-21ksoftirqd/212:10:252
21035991210,1cyclictest28-21ksoftirqd/207:40:012
2103599120,0cyclictest0-21swapper/210:52:022
2103599119,1cyclictest28-21ksoftirqd/212:15:152
2103599119,1cyclictest28-21ksoftirqd/207:35:002
21035991110,1cyclictest28-21ksoftirqd/209:10:012
21035991110,1cyclictest28-21ksoftirqd/208:40:002
21035991110,1cyclictest28-21ksoftirqd/208:10:002
21035991110,1cyclictest28-21ksoftirqd/207:20:202
2103599110,11cyclictest0-21swapper/207:19:192
2103599110,0cyclictest0-21swapper/208:26:272
2101999118,1cyclictest9-21ksoftirqd/008:05:010
2101999113,4cyclictest23487-21missed_timers07:15:000
2103599109,1cyclictest28-21ksoftirqd/208:40:172
2103599109,1cyclictest28-21ksoftirqd/208:20:012
2103599109,1cyclictest28-21ksoftirqd/207:50:002
2103599104,5cyclictest28-21ksoftirqd/208:30:202
2103099100,4cyclictest0-21swapper/112:10:201
210409998,1cyclictest35-21ksoftirqd/308:20:003
210359998,1cyclictest28-21ksoftirqd/207:29:592
210199997,1cyclictest9-21ksoftirqd/007:45:000
210199990,4cyclictest26288-21latency_hist11:00:000
210409987,1cyclictest35-21ksoftirqd/308:45:193
210409986,1cyclictest770-21snmpd11:50:563
210409986,1cyclictest770-21snmpd09:16:393
210409986,1cyclictest770-21snmpd08:38:223
210409985,2cyclictest21740-21apt-get10:15:173
210409985,1cyclictest31105-21diskmemload10:52:393
210409981,5cyclictest0-21swapper/309:55:313
210309980,3cyclictest0-21swapper/111:25:131
210199987,1cyclictest9-21ksoftirqd/011:55:000
210199987,1cyclictest9-21ksoftirqd/008:23:250
210199986,1cyclictest770-21snmpd12:01:350
210199986,1cyclictest770-21snmpd11:21:040
210199986,1cyclictest770-21snmpd09:31:390
210199986,1cyclictest770-21snmpd07:23:290
210199986,1cyclictest2529-21cat07:50:160
210199984,2cyclictest259-21systemd-journal11:39:590
210199983,4cyclictest31588-1kworker/u9:209:48:550
210199982,3cyclictest7927-21/usr/sbin/munin12:35:210
210199982,1cyclictest19329-21/usr/sbin/munin08:45:220
210199980,7cyclictest573-21ssh09:10:260
210199980,7cyclictest14586-21cat10:05:260
210199980,7cyclictest12434-21ssh10:41:460
210199980,7cyclictest0-21swapper/010:00:210
210199980,1cyclictest9977-21ssh09:21:410
210409976,1cyclictest20654-21cat12:10:243
210409975,1cyclictest9230-21ssh10:00:013
210409975,1cyclictest770-21snmpd10:57:593
210409975,1cyclictest770-21snmpd10:30:083
210409975,1cyclictest770-21snmpd09:26:523
210409975,1cyclictest770-21snmpd07:50:223
210409975,1cyclictest770-21snmpd07:12:373
210409975,1cyclictest29468-21ssh10:24:413
210409975,1cyclictest0-21swapper/311:29:083
210409972,4cyclictest0-21swapper/312:00:023
210409972,1cyclictest31105-21diskmemload12:24:423
210409971,5cyclictest341rcuc/312:20:003
210409971,2cyclictest7566-21apt-get09:20:183
210409970,6cyclictest32695-21unixbench-2d07:40:233
210409970,6cyclictest20647-21ssh09:35:153
210409970,5cyclictest18113-21/usr/sbin/munin09:30:323
210409970,4cyclictest6427-21ssh10:35:193
210409970,4cyclictest0-21swapper/312:30:083
210409970,3cyclictest0-21swapper/309:46:333
210409970,2cyclictest0-21swapper/311:35:133
210409970,2cyclictest0-21swapper/310:45:203
210409970,1cyclictest0-21swapper/311:55:193
210309971,6cyclictest0-21swapper/111:30:071
210309970,7cyclictest0-21swapper/108:52:191
210309970,5cyclictest0-21swapper/112:21:531
210309970,3cyclictest0-21swapper/111:12:591
210309970,2cyclictest0-21swapper/111:35:141
210309970,2cyclictest0-21swapper/110:34:041
210199975,1cyclictest770-21snmpd09:00:030
210199975,1cyclictest770-21snmpd08:43:050
210199975,1cyclictest770-21snmpd08:33:460
210199975,1cyclictest770-21snmpd08:11:360
210199975,1cyclictest770-21snmpd07:55:490
210199975,1cyclictest770-21snmpd07:45:200
210199975,1cyclictest24749-1kworker/u9:212:10:170
210199975,1cyclictest1859-21/usr/sbin/munin10:30:200
210199975,1cyclictest14668-1kworker/u9:011:40:220
210199973,1cyclictest25827-21/usr/sbin/munin10:20:150
210199972,1cyclictest677-21ssh11:45:440
210199970,7cyclictest3390-1kworker/u9:009:56:170
210199970,7cyclictest30802-21ssh10:25:190
210199970,6cyclictest9158-21ssh11:56:200
210199970,6cyclictest3957-21ssh09:15:200
210199970,6cyclictest32448-21/usr/sbin/munin12:25:190
210199970,6cyclictest30813-21aten2.4-expect11:05:180
210199970,6cyclictest198432sleep010:11:250
210199970,6cyclictest17265-21ssh11:27:100
210199970,6cyclictest14251-21ssh10:45:210
210199970,6cyclictest0-21swapper/012:20:220
210199970,6cyclictest0-21swapper/010:50:140
210199970,1cyclictest6418-21ssh11:15:050
210199970,1cyclictest5735-21ssh12:30:420
210199970,1cyclictest3534-21ssh09:51:580
210199970,1cyclictest31105-21diskmemload09:35:540
210199970,1cyclictest28094-21cpu07:30:140
210199970,1cyclictest27726-21ssh09:42:050
210199970,1cyclictest20296-1kworker/u9:110:15:330
210199970,1cyclictest11978-21apt-get09:25:180
210199970,1cyclictest0-21swapper/011:30:260
210199970,1cyclictest0-21swapper/011:14:090
210199970,1cyclictest0-21swapper/010:35:190
210409965,1cyclictest35-21ksoftirqd/309:10:003
210409965,1cyclictest35-21ksoftirqd/308:44:593
210409965,1cyclictest29970-21sshd07:34:393
210409965,1cyclictest2941-21ssh09:50:353
210409965,1cyclictest26965-21ssh11:40:013
210409965,1cyclictest21338-21ssh11:32:043
210409965,1cyclictest19736-21ssh10:11:113
210409965,1cyclictest15148-21ntpq08:30:223
210409964,1cyclictest770-21snmpd10:06:313
210409964,1cyclictest770-21snmpd08:00:483
210409964,1cyclictest35-21ksoftirqd/309:03:173
210409964,1cyclictest27326-21/usr/sbin/munin11:00:183
210409964,1cyclictest22279-21tune2fs08:50:213
210409963,2cyclictest547-21dbus-daemon12:35:233
210409963,1cyclictest27781-21ssh09:42:133
210409962,2cyclictest15082-21cron12:05:003
210409961,3cyclictest0-21swapper/311:20:143
210409960,5cyclictest0-21swapper/311:46:223
210409960,4cyclictest31105-21diskmemload12:25:293
210409960,3cyclictest0-21swapper/310:40:273
210409960,3cyclictest0-21swapper/310:26:103
210409960,2cyclictest9937-21dump-pmu-power08:15:003
210409960,1cyclictest757-21runrttasks11:16:443
210409960,1cyclictest0-21swapper/311:10:213
210309964,1cyclictest0-21swapper/110:00:161
210309960,6cyclictest0-21swapper/111:57:051
210309960,6cyclictest0-21swapper/111:48:491
210309960,6cyclictest0-21swapper/111:04:291
210309960,6cyclictest0-21swapper/110:37:001
210309960,6cyclictest0-21swapper/109:20:561
210309960,6cyclictest0-21swapper/108:49:021
210309960,6cyclictest0-21swapper/108:35:371
210309960,6cyclictest0-21swapper/108:32:231
210309960,6cyclictest0-21swapper/108:29:591
210309960,6cyclictest0-21swapper/108:05:341
210309960,6cyclictest0-21swapper/107:20:201
210309960,5cyclictest0-21swapper/110:19:411
210309960,5cyclictest0-21swapper/109:45:321
210309960,5cyclictest0-21swapper/109:25:091
210309960,5cyclictest0-21swapper/109:07:171
210309960,4cyclictest0-21swapper/109:51:431
210309960,3cyclictest0-21swapper/110:06:201
210309960,2cyclictest0-21swapper/112:06:031
210309960,2cyclictest0-21swapper/111:19:111
210309960,2cyclictest0-21swapper/110:45:201
210309960,2cyclictest0-21swapper/109:35:291
210309960,1cyclictest0-21swapper/112:16:191
210309960,1cyclictest0-21swapper/111:50:111
210309960,1cyclictest0-21swapper/111:44:321
210309960,0cyclictest0-21swapper/112:36:471
210309960,0cyclictest0-21swapper/110:55:281
210199965,1cyclictest783-21sshd07:36:400
210199965,1cyclictest770-21snmpd07:25:080
210199965,1cyclictest25800-1kworker/u9:211:00:120
210199964,1cyclictest770-21snmpd12:15:140
210199964,1cyclictest770-21snmpd08:17:440
210199960,6cyclictest0-21swapper/009:06:350
210199960,6cyclictest0-21swapper/008:35:280
210199960,0cyclictest0-21swapper/008:56:380
210199960,0cyclictest0-21swapper/008:54:030
12105260,1sleep10-21swapper/110:40:591
210409955,0cyclictest31105-21diskmemload09:11:313
210409954,1cyclictest35-21ksoftirqd/307:17:513
210409953,1cyclictest770-21snmpd08:07:133
210409953,1cyclictest770-21snmpd07:46:463
210409953,1cyclictest10807-21apt-get08:20:123
210409951,2cyclictest0-21swapper/308:25:013
210409950,1cyclictest0-21swapper/308:55:253
210309953,1cyclictest0-21swapper/109:58:221
210309953,1cyclictest0-21swapper/109:41:361
210309950,5cyclictest0-21swapper/108:20:391
210309950,5cyclictest0-21swapper/107:45:571
210309950,4cyclictest0-21swapper/107:38:091
210309950,3cyclictest0-21swapper/110:51:141
210309950,3cyclictest0-21swapper/110:10:101
210309950,2cyclictest0-21swapper/111:24:001
210309950,2cyclictest0-21swapper/110:29:591
210309950,2cyclictest0-21swapper/109:15:121
210309950,2cyclictest0-21swapper/109:10:251
210309950,1cyclictest978-21chrt11:07:341
210309950,1cyclictest0-21swapper/112:25:181
210309950,1cyclictest0-21swapper/112:01:371
210309950,1cyclictest0-21swapper/110:20:561
210309950,1cyclictest0-21swapper/109:34:501
210199954,1cyclictest9-21ksoftirqd/007:17:330
210199950,5cyclictest0-21swapper/008:05:140
210409942,1cyclictest770-21snmpd07:58:123
210409942,1cyclictest770-21snmpd07:39:203
210409941,2cyclictest24925-21apt-get07:20:143
210409940,0cyclictest0-21swapper/307:28:473
210309944,0cyclictest0-21swapper/108:19:141
210309944,0cyclictest0-21swapper/107:57:591
210309944,0cyclictest0-21swapper/107:44:331
210309942,1cyclictest9706-21chrt08:12:211
210309941,3cyclictest0-21swapper/109:00:161
210309941,2cyclictest0-21swapper/107:30:001
210309940,2cyclictest0-21swapper/107:50:131
210309940,0cyclictest0-21swapper/108:55:281
210309940,0cyclictest0-21swapper/108:00:211
210309932,1cyclictest18760-21chrt08:40:551
210309932,1cyclictest0-21swapper/107:15:001
210309931,1cyclictest0-21swapper/107:10:171
210309930,2cyclictest0-21swapper/107:30:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional