You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-04 - 11:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Tue Nov 04, 2025 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
224122205190,10sleep10-21swapper/119:09:121
222302190176,10sleep00-21swapper/019:06:500
223672189171,13sleep30-21swapper/319:08:383
22373210789,13sleep20-21swapper/219:08:412
62982460,0sleep10-21swapper/120:45:151
128252450,0sleep10-21swapper/100:23:181
82872440,0sleep10-21swapper/123:31:061
116272430,0sleep10-21swapper/119:50:141
207522420,0sleep1211ktimersoftd/120:10:001
166462410,0sleep10-21swapper/100:08:571
173112120,0sleep00-21swapper/021:05:200
29120290,0sleep30-21swapper/323:41:533
20953290,0sleep20-21swapper/223:21:022
226459973,4cyclictest801-21awk19:30:010
226459970,3cyclictest8280-21idleruntime-cro22:10:010
226459960,3cyclictest876-21munin-run21:50:010
25214250,0sleep30-21swapper/323:23:473
226559955,0cyclictest20998-21kworker/3:023:52:473
226559955,0cyclictest0-21swapper/322:46:343
226559950,5cyclictest0-21swapper/323:35:123
226559950,5cyclictest0-21swapper/322:09:543
226559950,5cyclictest0-21swapper/321:38:293
226559950,5cyclictest0-21swapper/300:29:003
226559950,3cyclictest0-21swapper/322:12:213
226519955,0cyclictest0-21swapper/222:00:592
226519950,5cyclictest18068-21diskmemload21:45:592
226519950,5cyclictest0-21swapper/223:45:532
226519950,5cyclictest0-21swapper/222:45:562
226519950,5cyclictest0-21swapper/219:55:132
226519950,0cyclictest0-21swapper/200:29:582
226469952,2cyclictest0-21swapper/123:50:131
226469951,2cyclictest0-21swapper/120:10:121
226469950,5cyclictest0-21swapper/122:55:411
226469950,5cyclictest0-21swapper/122:12:541
226469950,0cyclictest0-21swapper/123:56:301
226459955,0cyclictest0-21swapper/023:50:310
226459951,2cyclictest0-21swapper/020:05:110
226459950,5cyclictest0-21swapper/023:34:040
226459950,5cyclictest0-21swapper/023:18:220
226459950,5cyclictest0-21swapper/000:24:080
226559944,0cyclictest25208-21kworker/3:121:04:523
226559944,0cyclictest25208-21kworker/3:120:42:283
226559944,0cyclictest25208-21kworker/3:120:20:043
226559944,0cyclictest25208-21kworker/3:119:46:313
226559944,0cyclictest0-21swapper/321:17:403
226559944,0cyclictest0-21swapper/300:00:383
226559943,1cyclictest28394-21cut23:25:133
226559942,2cyclictest20007-21ssh22:15:193
226559942,1cyclictest27436-21ssh22:51:403
226559941,1cyclictest29421-21cut00:15:153
226559940,4cyclictest3486-21/usr/sbin/munin19:35:203
226559940,4cyclictest25937-21apt-get22:35:133
226559940,4cyclictest25502-21ssh23:07:133
226559940,4cyclictest21080-21ssh00:10:293
226559940,4cyclictest13380-21/usr/sbin/munin19:55:143
226559940,4cyclictest0-21swapper/323:46:003
226559940,4cyclictest0-21swapper/323:15:133
226559940,4cyclictest0-21swapper/322:29:483
226559940,4cyclictest0-21swapper/321:26:393
226559940,4cyclictest0-21swapper/320:25:133
226559940,4cyclictest0-21swapper/320:10:133
226559940,4cyclictest0-21swapper/300:23:283
226559940,3cyclictest8977-21seq23:31:333
226559940,3cyclictest6054-21apt-config21:20:013
226559940,3cyclictest30721-21/usr/sbin/munin20:30:203
226559940,3cyclictest30682-21unixbench_multi22:20:233
226559940,3cyclictest30181-21cat23:10:003
226559940,3cyclictest26370-21df_inode00:30:133
226559940,3cyclictest25659-21cut19:15:013
226559940,3cyclictest25412-21awk22:35:013
226559940,3cyclictest2194-21ssh22:55:203
226559940,2cyclictest22073-21cpuspeed_turbos23:55:153
226559940,2cyclictest0-21swapper/321:30:223
226559940,1cyclictest8986-21/usr/sbin/munin00:05:213
226559940,1cyclictest8201-21/usr/sbin/munin20:50:153
226559940,1cyclictest23848-21/usr/sbin/munin21:45:183
226559940,1cyclictest22767-21/usr/sbin/munin19:10:153
226559940,1cyclictest21296-21/usr/sbin/munin22:00:173
226559940,1cyclictest18337-21/usr/sbin/munin20:05:163
226559940,1cyclictest14696-21expr21:40:153
226559940,1cyclictest11346-21/usr/sbin/munin21:55:203
226559940,1cyclictest10668-21/usr/sbin/munin20:55:133
226559940,0cyclictest0-21swapper/321:54:113
226519944,0cyclictest0-21swapper/223:40:392
226519944,0cyclictest0-21swapper/223:35:242
226519944,0cyclictest0-21swapper/223:19:412
226519943,1cyclictest8672-21tr19:45:142
226519943,1cyclictest28959-21cut22:20:152
226519943,1cyclictest17601-21sed20:00:222
226519942,1cyclictest11854-21ssh22:27:412
226519941,2cyclictest0-21swapper/220:25:142
226519941,2cyclictest0-21swapper/200:15:122
226519941,1cyclictest0-21swapper/220:20:142
226519940,4cyclictest6479-21ssh22:08:552
226519940,4cyclictest18814-21ssh22:30:502
226519940,4cyclictest0-21swapper/223:57:322
226519940,4cyclictest0-21swapper/222:56:072
226519940,4cyclictest0-21swapper/222:50:282
226519940,4cyclictest0-21swapper/222:10:132
226519940,4cyclictest0-21swapper/221:57:082
226519940,4cyclictest0-21swapper/221:31:572
226519940,4cyclictest0-21swapper/221:25:142
226519940,4cyclictest0-21swapper/221:10:142
226519940,4cyclictest0-21swapper/219:35:132
226519940,4cyclictest0-21swapper/219:20:122
226519940,4cyclictest0-21swapper/200:02:192
226519940,3cyclictest8846-21ssh23:31:282
226519940,3cyclictest7878-21ssh21:20:202
226519940,3cyclictest784-21latency_hist19:30:012
226519940,3cyclictest6579-21cat00:20:132
226519940,3cyclictest5591-21ssh00:35:232
226519940,3cyclictest4560-21ls22:40:162
226519940,3cyclictest3262-21/usr/sbin/munin20:40:172
226519940,3cyclictest30721-21/usr/sbin/munin20:30:152
226519940,3cyclictest30419-21rm23:25:482
226519940,3cyclictest27268-21ssh00:14:252
226519940,3cyclictest25630-21sed19:15:012
226519940,3cyclictest21430-21hddtemp_smartct23:05:152
226519940,3cyclictest1976-21ssh00:34:322
226519940,3cyclictest19074-21ssh21:42:212
226519940,3cyclictest12681-21perl23:50:152
226519940,0cyclictest0-21swapper/223:04:422
226519940,0cyclictest0-21swapper/221:36:142
226469944,0cyclictest0-21swapper/123:42:141
226469944,0cyclictest0-21swapper/123:09:131
226469944,0cyclictest0-21swapper/122:42:091
226469944,0cyclictest0-21swapper/122:32:241
226469944,0cyclictest0-21swapper/121:58:391
226469944,0cyclictest0-21swapper/121:48:551
226469941,2cyclictest0-21swapper/122:20:141
226469941,2cyclictest0-21swapper/119:10:151
226469940,4cyclictest0-21swapper/122:27:101
226469940,4cyclictest0-21swapper/121:27:131
226469940,0cyclictest0-21swapper/123:46:451
226469940,0cyclictest0-21swapper/123:18:141
226469940,0cyclictest0-21swapper/122:36:551
226469940,0cyclictest0-21swapper/121:20:311
226459944,0cyclictest0-21swapper/022:43:530
226459944,0cyclictest0-21swapper/000:30:050
226459943,1cyclictest28818-21cpuspeed_turbos19:20:130
226459942,2cyclictest4637-21kworker/0:020:26:090
226459942,1cyclictest3489-21apt-get19:35:130
226459942,1cyclictest30833-21ssh21:15:270
226459942,1cyclictest25795-21ssh23:07:250
226459940,4cyclictest0-21swapper/023:55:140
226459940,4cyclictest0-21swapper/023:40:270
226459940,4cyclictest0-21swapper/023:23:360
226459940,4cyclictest0-21swapper/023:00:150
226459940,4cyclictest0-21swapper/022:35:130
226459940,4cyclictest0-21swapper/022:33:360
226459940,4cyclictest0-21swapper/021:55:130
226459940,4cyclictest0-21swapper/021:52:270
226459940,4cyclictest0-21swapper/021:42:290
226459940,4cyclictest0-21swapper/021:30:160
226459940,4cyclictest0-21swapper/021:25:140
226459940,4cyclictest0-21swapper/021:11:040
226459940,4cyclictest0-21swapper/020:51:410
226459940,4cyclictest0-21swapper/020:30:120
226459940,4cyclictest0-21swapper/020:00:130
226459940,4cyclictest0-21swapper/000:36:030
226459940,4cyclictest0-21swapper/000:10:140
226459940,4cyclictest0-21swapper/000:01:430
226459940,3cyclictest8636-21ssh21:20:270
226459940,3cyclictest4627-21fschecks_time21:35:160
226459940,3cyclictest20785-21users22:15:230
226459940,3cyclictest1296-21grep19:30:140
226459940,3cyclictest10232-21tail19:45:220
226459940,3cyclictest0-21swapper/022:26:210
226459940,3cyclictest0-21swapper/022:22:020
226459940,3cyclictest0-21swapper/020:40:130
226459940,3cyclictest0-21swapper/019:40:150
226459940,0cyclictest0-21swapper/023:13:070
226559930,3cyclictest3217-21find22:40:013
226559930,3cyclictest3158-21apt-get00:35:013
226559930,3cyclictest28494-21apt19:20:123
226559930,3cyclictest1294-21df_inode20:35:153
226559930,3cyclictest0-21swapper/321:05:013
226559930,3cyclictest0-21swapper/320:45:133
226559930,3cyclictest0-21swapper/320:15:133
226559930,3cyclictest0-21swapper/320:00:133
226559930,3cyclictest0-21swapper/319:50:073
226559930,3cyclictest0-21swapper/319:40:153
226559930,3cyclictest0-21swapper/319:30:083
226559930,3cyclictest0-21swapper/319:25:103
226559930,2cyclictest18362-21apt-config21:10:013
226559930,1cyclictest10556-21ssh23:00:083
226519933,0cyclictest28826-21kworker/2:020:55:092
226519932,1cyclictest0-21swapper/219:10:152
226519931,1cyclictest0-21swapper/222:35:132
226519931,1cyclictest0-21swapper/220:45:132
226519930,3cyclictest8785-21ssh00:05:042
226519930,3cyclictest28394-21ssh21:15:042
226519930,3cyclictest1373-21apt-get21:50:122
226519930,3cyclictest13156-21apt-get21:00:112
226519930,3cyclictest0-21swapper/223:10:122
226519930,3cyclictest0-21swapper/222:15:122
226519930,3cyclictest0-21swapper/221:05:132
226519930,3cyclictest0-21swapper/220:50:142
226519930,3cyclictest0-21swapper/220:35:032
226519930,3cyclictest0-21swapper/220:15:132
226519930,3cyclictest0-21swapper/220:10:122
226519930,3cyclictest0-21swapper/220:05:052
226519930,3cyclictest0-21swapper/219:50:122
226519930,3cyclictest0-21swapper/219:40:152
226519930,3cyclictest0-21swapper/219:30:132
226469931,2cyclictest0-21swapper/122:05:141
226469931,1cyclictest0-21swapper/123:25:111
226469931,1cyclictest0-21swapper/123:20:121
226469931,1cyclictest0-21swapper/123:10:011
226469931,1cyclictest0-21swapper/122:45:131
226469931,1cyclictest0-21swapper/121:50:121
226469931,1cyclictest0-21swapper/121:30:161
226469931,1cyclictest0-21swapper/121:15:161
226469931,1cyclictest0-21swapper/121:10:141
226469931,1cyclictest0-21swapper/121:05:131
226469931,1cyclictest0-21swapper/120:55:121
226469931,1cyclictest0-21swapper/120:50:141
226469931,1cyclictest0-21swapper/120:40:131
226469931,1cyclictest0-21swapper/120:35:121
226469931,1cyclictest0-21swapper/120:15:131
226469931,1cyclictest0-21swapper/119:45:131
226469931,1cyclictest0-21swapper/119:40:151
226469931,1cyclictest0-21swapper/119:25:101
226469931,1cyclictest0-21swapper/119:20:121
226469931,1cyclictest0-21swapper/100:30:111
226469931,1cyclictest0-21swapper/100:10:141
226469930,3cyclictest0-21swapper/120:20:511
226469930,2cyclictest105202sleep123:00:071
226469930,2cyclictest0-21swapper/100:35:111
226469930,0cyclictest0-21swapper/121:01:441
226459933,0cyclictest0-21swapper/020:11:570
226459932,1cyclictest25482-21grep19:15:010
226459932,1cyclictest14675-21ssh23:35:060
226459931,2cyclictest13378-21ssh22:45:100
226459931,1cyclictest0-21swapper/019:50:120
226459930,3cyclictest25784-21apt-get20:20:140
226459930,3cyclictest0-21swapper/023:45:130
226459930,3cyclictest0-21swapper/023:25:110
226459930,3cyclictest0-21swapper/022:55:140
226459930,3cyclictest0-21swapper/022:50:110
226459930,3cyclictest0-21swapper/022:10:070
226459930,3cyclictest0-21swapper/022:00:120
226459930,3cyclictest0-21swapper/021:00:120
226459930,3cyclictest0-21swapper/020:55:120
226459930,3cyclictest0-21swapper/020:45:130
226459930,3cyclictest0-21swapper/020:35:120
226459930,3cyclictest0-21swapper/020:15:050
226459930,3cyclictest0-21swapper/019:55:130
226459930,3cyclictest0-21swapper/019:10:210
226459930,3cyclictest0-21swapper/000:25:060
226459930,3cyclictest0-21swapper/000:15:120
226459930,3cyclictest0-21swapper/000:05:180
226469921,1cyclictest0-21swapper/119:55:131
226469921,1cyclictest0-21swapper/119:30:131
226469921,1cyclictest0-21swapper/100:00:141
226469920,2cyclictest302102sleep120:26:381
226469920,1cyclictest16117-21chrt21:40:281
226469920,1cyclictest0-21swapper/123:35:121
226469920,1cyclictest0-21swapper/122:50:121
226469920,1cyclictest0-21swapper/122:15:171
226469920,1cyclictest0-21swapper/122:00:121
226469920,1cyclictest0-21swapper/121:35:111
226469920,1cyclictest0-21swapper/120:30:121
226469920,1cyclictest0-21swapper/120:00:011
226469920,1cyclictest0-21swapper/119:35:131
226469920,1cyclictest0-21swapper/119:15:131
226469920,1cyclictest0-21swapper/100:25:141
226469920,1cyclictest0-21swapper/100:15:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional