You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-18 - 21:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Tue Nov 18, 2025 12:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
279892203187,11sleep10-21swapper/107:08:001
280302184166,13sleep00-21swapper/007:08:310
280962181164,12sleep20-21swapper/207:09:212
278002177160,12sleep30-21swapper/307:05:333
291722470,0sleep10-21swapper/112:26:071
230442460,0sleep10-21swapper/112:23:301
141792440,0sleep10-21swapper/112:35:191
46012390,0sleep10-21swapper/111:25:171
2830999102,4cyclictest25520-21munin-run11:20:000
31660290,0sleep10-21swapper/109:45:211
283159971,6cyclictest0-21swapper/210:35:142
283159971,5cyclictest0-21swapper/207:15:162
283159964,2cyclictest31-21ksoftirqd/208:25:002
283199955,0cyclictest16134-21kworker/3:211:52:513
283199955,0cyclictest16134-21kworker/3:210:12:053
283199955,0cyclictest16134-21kworker/3:209:49:443
283199955,0cyclictest16134-21kworker/3:209:27:183
283199955,0cyclictest16134-21kworker/3:209:16:083
283199955,0cyclictest16134-21kworker/3:208:42:303
283199955,0cyclictest16134-21kworker/3:208:31:193
283199955,0cyclictest16134-21kworker/3:208:20:073
283199955,0cyclictest16134-21kworker/3:208:08:553
283199955,0cyclictest16134-21kworker/3:207:57:433
283199955,0cyclictest16134-21kworker/3:207:46:323
283199955,0cyclictest16134-21kworker/3:207:12:563
283199955,0cyclictest0-21swapper/308:25:163
283199952,3cyclictest714-21snmpd08:00:183
283199950,5cyclictest0-21swapper/312:23:193
283199950,5cyclictest0-21swapper/312:14:183
283199950,5cyclictest0-21swapper/310:34:203
283199950,5cyclictest0-21swapper/310:08:533
283159955,0cyclictest0-21swapper/210:04:102
283159950,5cyclictest0-21swapper/210:58:092
283159950,0cyclictest0-21swapper/212:07:242
283159950,0cyclictest0-21swapper/211:34:492
283109950,5cyclictest0-21swapper/111:22:291
283109950,5cyclictest0-21swapper/110:50:111
283109950,5cyclictest0-21swapper/110:29:141
283109950,5cyclictest0-21swapper/110:17:351
283109950,5cyclictest0-21swapper/110:07:331
283109950,5cyclictest0-21swapper/109:10:311
283099955,0cyclictest0-21swapper/010:29:250
283099954,1cyclictest0-21swapper/011:08:420
283099952,3cyclictest714-21snmpd09:44:010
283099951,4cyclictest10438-21kworker/0:110:05:220
283099951,4cyclictest0-21swapper/010:40:160
283099950,5cyclictest0-21swapper/010:54:090
283099950,5cyclictest0-21swapper/008:20:110
283099950,4cyclictest1553-21ssh11:40:140
9430240,0sleep30-21swapper/311:11:113
29659240,0sleep20-21swapper/211:54:192
283199944,0cyclictest0-21swapper/312:27:503
283199944,0cyclictest0-21swapper/310:52:053
283199944,0cyclictest0-21swapper/310:01:103
283199943,1cyclictest5037-21tr12:30:233
283199943,1cyclictest25202-21perl09:10:153
283199943,1cyclictest12141-21/usr/sbin/munin09:20:143
283199942,2cyclictest21507-21ntpq09:40:193
283199941,2cyclictest714-21snmpd11:42:223
283199940,4cyclictest8374-21apt-get10:55:123
283199940,4cyclictest16899-21ssh11:47:293
283199940,4cyclictest16030-21apt-get11:15:133
283199940,4cyclictest0-21swapper/311:55:013
283199940,4cyclictest0-21swapper/311:35:213
283199940,4cyclictest0-21swapper/311:07:553
283199940,4cyclictest0-21swapper/309:30:153
283199940,4cyclictest0-21swapper/309:05:143
283199940,4cyclictest0-21swapper/308:10:133
283199940,4cyclictest0-21swapper/307:21:293
283199940,3cyclictest9119-21latency_hist07:35:003
283199940,3cyclictest8775-21/usr/sbin/munin09:50:153
283199940,3cyclictest7443-21irqstats12:15:183
283199940,3cyclictest4232-21df11:25:163
283199940,3cyclictest3668-21diskstats10:20:143
283199940,3cyclictest26800-21perl11:20:153
283199940,3cyclictest24739-21apt-get10:15:003
283199940,3cyclictest18774-21sh12:05:023
283199940,3cyclictest17737-21/usr/sbin/munin08:55:193
283199940,3cyclictest16919-21ssh10:43:003
283199940,3cyclictest15852-21sh12:35:493
283199940,3cyclictest11203-21if_eth009:35:203
283199940,1cyclictest21764-21sed10:45:173
283199940,1cyclictest19323-21hddtemp_smartct11:00:163
283199940,1cyclictest15190-21users10:25:233
283199940,1cyclictest14615-21gltestperf11:30:133
283199940,1cyclictest11925-21tr07:40:113
283159944,0cyclictest0-21swapper/212:26:542
283159944,0cyclictest0-21swapper/212:22:242
283159944,0cyclictest0-21swapper/211:01:122
283159944,0cyclictest0-21swapper/209:40:182
283159944,0cyclictest0-21swapper/209:37:152
283159943,1cyclictest5214-21ssh10:05:112
283159941,2cyclictest0-21swapper/209:00:132
283159941,2cyclictest0-21swapper/208:55:142
283159941,2cyclictest0-21swapper/207:35:132
283159941,1cyclictest0-21swapper/212:30:162
283159941,1cyclictest0-21swapper/211:05:152
283159941,1cyclictest0-21swapper/210:50:132
283159940,4cyclictest5045-21ssh09:15:572
283159940,4cyclictest23664-21df10:30:152
283159940,4cyclictest0-21swapper/211:55:372
283159940,4cyclictest0-21swapper/211:48:102
283159940,4cyclictest0-21swapper/211:44:192
283159940,4cyclictest0-21swapper/211:25:142
283159940,4cyclictest0-21swapper/211:22:112
283159940,4cyclictest0-21swapper/211:10:062
283159940,4cyclictest0-21swapper/210:45:142
283159940,4cyclictest0-21swapper/210:25:132
283159940,4cyclictest0-21swapper/210:20:062
283159940,4cyclictest0-21swapper/210:17:042
283159940,4cyclictest0-21swapper/209:56:332
283159940,4cyclictest0-21swapper/209:45:142
283159940,4cyclictest0-21swapper/209:22:022
283159940,4cyclictest0-21swapper/207:45:122
283159940,4cyclictest0-21swapper/207:25:122
283159940,4cyclictest0-21swapper/207:20:112
283159940,4cyclictest0-21swapper/207:10:152
283159940,3cyclictest32164-21ssh09:30:022
283159940,3cyclictest28928-21ssh12:10:122
283159940,3cyclictest23566-21apt-config11:35:012
283159940,3cyclictest21807-21apt-config08:00:002
283159940,3cyclictest18612-21latency_hist12:05:002
283159940,3cyclictest17453-21sort09:55:012
283159940,3cyclictest15273-21ssh10:10:132
283159940,3cyclictest10027-21perl08:40:152
283109944,0cyclictest0-21swapper/111:17:061
283109944,0cyclictest0-21swapper/110:47:511
283109944,0cyclictest0-21swapper/109:32:031
283109944,0cyclictest0-21swapper/109:26:401
283109944,0cyclictest0-21swapper/109:15:541
283109941,2cyclictest0-21swapper/112:30:161
283109941,2cyclictest0-21swapper/112:15:141
283109941,2cyclictest0-21swapper/112:00:141
283109941,2cyclictest0-21swapper/111:50:141
283109941,2cyclictest0-21swapper/111:10:121
283109941,2cyclictest0-21swapper/110:20:121
283109941,2cyclictest0-21swapper/109:50:121
283109941,2cyclictest0-21swapper/109:20:131
283109941,2cyclictest0-21swapper/108:55:141
283109941,2cyclictest0-21swapper/108:40:131
283109940,4cyclictest0-21swapper/111:03:161
283109940,4cyclictest0-21swapper/110:31:331
283109940,4cyclictest0-21swapper/109:06:351
283109940,4cyclictest0-21swapper/108:32:571
283109940,0cyclictest0-21swapper/111:30:561
283099944,0cyclictest0-21swapper/011:46:490
283099944,0cyclictest0-21swapper/009:56:140
283099943,1cyclictest23327-21kworker/0:011:36:120
283099943,1cyclictest18996-21perf09:00:000
283099942,1cyclictest15603-21awk12:20:000
283099942,1cyclictest0-21swapper/007:55:120
283099941,2cyclictest0-21swapper/011:30:100
283099941,2cyclictest0-21swapper/010:15:140
283099941,2cyclictest0-21swapper/008:30:120
283099941,1cyclictest0-21swapper/012:35:170
283099940,4cyclictest6070-21ssh10:37:280
283099940,4cyclictest19627-21cstates09:00:140
283099940,4cyclictest0-21swapper/012:30:160
283099940,4cyclictest0-21swapper/012:25:120
283099940,4cyclictest0-21swapper/012:00:180
283099940,4cyclictest0-21swapper/010:55:120
283099940,4cyclictest0-21swapper/010:30:130
283099940,4cyclictest0-21swapper/010:20:120
283099940,4cyclictest0-21swapper/010:04:330
283099940,4cyclictest0-21swapper/009:50:130
283099940,4cyclictest0-21swapper/009:30:530
283099940,4cyclictest0-21swapper/009:25:330
283099940,3cyclictest8706-21ssh11:10:430
283099940,3cyclictest29888-21diskstats08:15:160
283099940,3cyclictest28810-21cstates07:10:170
283099940,3cyclictest28563-21ssh10:48:550
283099940,3cyclictest27403-21df08:10:150
283099940,3cyclictest22223-21df_inode09:05:150
283099940,3cyclictest21923-21dpkg08:00:010
283099940,3cyclictest21838-21ssh12:05:490
283099940,3cyclictest2074-21ssh09:15:140
283099940,3cyclictest19160-21cat07:55:000
283099940,3cyclictest15277-21ssh10:10:130
283099940,3cyclictest10729-21df09:35:180
283099940,1cyclictest31033-21sed11:55:000
283099940,1cyclictest25042-21df_inode09:10:150
283099940,0cyclictest0-21swapper/012:22:190
18225240,0sleep20-21swapper/212:37:222
283199931,2cyclictest714-21snmpd09:00:033
283199930,3cyclictest9351-21apt07:35:133
283199930,3cyclictest713-21ssh10:35:143
283199930,3cyclictest6842-21apt-get08:35:133
283199930,3cyclictest32065-21seq07:15:173
283199930,3cyclictest14792-21/usr/sbin/munin08:50:143
283199930,3cyclictest12212-21cat08:45:143
283199930,3cyclictest0-21swapper/312:00:013
283199930,3cyclictest0-21swapper/307:50:113
283199930,3cyclictest0-21swapper/307:25:013
283199930,2cyclictest29946-21grep08:15:163
283199930,1cyclictest0-21swapper/309:55:073
283159932,1cyclictest714-21snmpd09:10:102
283159931,1cyclictest10773-21apt-get10:40:162
283159931,1cyclictest0-21swapper/207:40:102
283159930,3cyclictest16781-21apt-get07:50:112
283159930,3cyclictest15837-21ssh11:15:052
283159930,3cyclictest0-21swapper/212:15:022
283159930,3cyclictest0-21swapper/209:25:122
283159930,3cyclictest0-21swapper/209:05:132
283159930,3cyclictest0-21swapper/208:50:132
283159930,3cyclictest0-21swapper/208:45:082
283159930,3cyclictest0-21swapper/208:35:012
283159930,3cyclictest0-21swapper/208:30:122
283159930,3cyclictest0-21swapper/208:25:022
283159930,3cyclictest0-21swapper/208:15:142
283159930,3cyclictest0-21swapper/208:10:132
283159930,3cyclictest0-21swapper/208:05:162
283159930,3cyclictest0-21swapper/207:55:032
283159930,3cyclictest0-21swapper/207:30:112
283109933,0cyclictest0-21swapper/110:36:131
283109933,0cyclictest0-21swapper/109:40:291
283109932,1cyclictest0-21swapper/107:28:141
283109931,1cyclictest286132chrt12:10:011
283109931,1cyclictest0-21swapper/112:05:141
283109931,1cyclictest0-21swapper/111:55:011
283109931,1cyclictest0-21swapper/111:45:141
283109931,1cyclictest0-21swapper/111:40:131
283109931,1cyclictest0-21swapper/110:55:121
283109931,1cyclictest0-21swapper/110:40:161
283109931,1cyclictest0-21swapper/110:10:131
283109931,1cyclictest0-21swapper/109:35:161
283109931,1cyclictest0-21swapper/108:50:131
283109931,1cyclictest0-21swapper/108:35:131
283109931,1cyclictest0-21swapper/108:20:111
283109931,1cyclictest0-21swapper/108:15:141
283109931,1cyclictest0-21swapper/108:10:141
283109931,1cyclictest0-21swapper/108:05:141
283109931,1cyclictest0-21swapper/108:00:011
283109931,1cyclictest0-21swapper/107:55:111
283109931,1cyclictest0-21swapper/107:50:111
283109931,1cyclictest0-21swapper/107:45:111
283109931,1cyclictest0-21swapper/107:40:101
283109931,1cyclictest0-21swapper/107:30:111
283109931,1cyclictest0-21swapper/107:20:111
283109931,1cyclictest0-21swapper/107:15:161
283109930,2cyclictest21352-21chrt09:03:451
283099932,1cyclictest714-21snmpd07:45:120
283099931,2cyclictest12797-21cat07:40:140
283099931,1cyclictest4395-21gpgv07:25:000
283099930,3cyclictest32199-21df_inode07:15:170
283099930,3cyclictest23939-21diskmemload12:10:080
283099930,3cyclictest12004-21taskset09:20:080
283099930,3cyclictest0-21swapper/011:20:050
283099930,3cyclictest0-21swapper/011:00:130
283099930,3cyclictest0-21swapper/009:45:140
283099930,3cyclictest0-21swapper/008:50:130
283099930,3cyclictest0-21swapper/008:45:130
283099930,3cyclictest0-21swapper/008:40:130
283099930,3cyclictest0-21swapper/008:35:130
283099930,3cyclictest0-21swapper/008:25:150
283099930,3cyclictest0-21swapper/008:05:140
283099930,3cyclictest0-21swapper/007:35:130
283099930,3cyclictest0-21swapper/007:30:110
283099930,3cyclictest0-21swapper/007:20:110
283099930,2cyclictest31792-21cpuspeed11:55:130
283099930,2cyclictest0-21swapper/011:25:130
283109921,1cyclictest0-21swapper/110:00:141
283109921,1cyclictest0-21swapper/108:45:141
283109921,1cyclictest0-21swapper/107:35:131
283109921,1cyclictest0-21swapper/107:10:151
283109920,1cyclictest0-21swapper/111:35:011
283109920,1cyclictest0-21swapper/111:05:161
283109920,1cyclictest0-21swapper/109:55:121
283109920,1cyclictest0-21swapper/108:25:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional