You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-16 - 00:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot2.osadl.org (updated Tue Jul 15, 2025 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
191952199182,12sleep10-21swapper/107:07:111
191252191175,11sleep30-21swapper/307:06:173
190822187170,12sleep00-21swapper/007:05:410
172012175159,12sleep20-21swapper/207:05:112
211782500,1sleep021158-21cron10:50:010
139122460,0sleep10-21swapper/112:07:201
37342440,0sleep00-21swapper/009:35:460
190362420,0sleep30-21swapper/310:15:373
69262390,0sleep00-21swapper/010:25:430
306812380,0sleep10-21swapper/111:59:561
221832130,0sleep30-21swapper/312:28:083
154562130,0sleep10-21swapper/111:35:171
264122110,0sleep10-21swapper/109:47:241
195859992,3cyclictest12351-21munin-run09:05:010
19835280,0sleep00-21swapper/012:26:370
3922270,0sleep10-21swapper/109:20:141
196009976,0cyclictest40-21ksoftirqd/311:20:153
196009966,0cyclictest40-21ksoftirqd/310:50:013
196009964,2cyclictest40-21ksoftirqd/309:30:133
195919961,3cyclictest0-21swapper/111:10:131
8755250,0sleep10-21swapper/109:38:561
3371250,0sleep00-21swapper/007:40:120
196009955,0cyclictest40-21ksoftirqd/311:55:143
196009955,0cyclictest40-21ksoftirqd/311:35:013
196009955,0cyclictest40-21ksoftirqd/311:35:013
196009955,0cyclictest40-21ksoftirqd/311:30:013
196009955,0cyclictest40-21ksoftirqd/310:25:013
196009955,0cyclictest40-21ksoftirqd/310:00:143
196009955,0cyclictest40-21ksoftirqd/309:15:143
196009955,0cyclictest391ktimersoftd/311:10:143
196009954,1cyclictest40-21ksoftirqd/312:35:133
196009954,1cyclictest40-21ksoftirqd/311:05:023
196009954,1cyclictest40-21ksoftirqd/310:15:013
196009953,1cyclictest40-21ksoftirqd/308:40:133
196009950,5cyclictest28974-21apt-get10:05:133
196009950,5cyclictest0-21swapper/311:45:163
196009950,5cyclictest0-21swapper/311:44:323
196009950,5cyclictest0-21swapper/309:10:183
196009950,4cyclictest12765-21apt-get09:05:013
196009950,4cyclictest0-21swapper/310:30:123
196009950,4cyclictest0-21swapper/308:45:123
195959950,5cyclictest0-21swapper/210:20:132
195959950,5cyclictest0-21swapper/208:55:132
195959950,4cyclictest0-21swapper/212:00:122
195959950,4cyclictest0-21swapper/210:05:132
195959950,4cyclictest0-21swapper/207:45:142
195959950,2cyclictest0-21swapper/208:45:172
195919951,3cyclictest0-21swapper/107:25:141
195919951,2cyclictest0-21swapper/112:00:121
195919951,2cyclictest0-21swapper/107:45:141
195919951,2cyclictest0-21swapper/107:40:111
195859955,0cyclictest0-21swapper/011:35:020
195859950,5cyclictest0-21swapper/011:34:180
195859950,5cyclictest0-21swapper/011:34:180
195859950,5cyclictest0-21swapper/011:26:090
195859950,5cyclictest0-21swapper/011:09:430
195859950,0cyclictest0-21swapper/009:22:460
18194250,0sleep10-21swapper/110:31:321
196009944,0cyclictest40-21ksoftirqd/312:10:163
196009944,0cyclictest40-21ksoftirqd/311:50:223
196009944,0cyclictest40-21ksoftirqd/310:50:153
196009944,0cyclictest40-21ksoftirqd/310:40:143
196009944,0cyclictest40-21ksoftirqd/310:35:203
196009944,0cyclictest40-21ksoftirqd/310:25:023
196009944,0cyclictest40-21ksoftirqd/309:55:153
196009944,0cyclictest40-21ksoftirqd/309:50:123
196009944,0cyclictest40-21ksoftirqd/309:00:143
196009944,0cyclictest40-21ksoftirqd/308:35:113
196009944,0cyclictest40-21ksoftirqd/308:20:133
196009944,0cyclictest40-21ksoftirqd/308:00:013
196009944,0cyclictest40-21ksoftirqd/307:25:013
196009944,0cyclictest1304-21kworker/3:208:59:213
196009944,0cyclictest1304-21kworker/3:208:25:453
196009944,0cyclictest1304-21kworker/3:208:03:213
196009944,0cyclictest1304-21kworker/3:207:40:583
196009944,0cyclictest1304-21kworker/3:207:29:463
196009943,1cyclictest40-21ksoftirqd/312:00:153
196009943,1cyclictest40-21ksoftirqd/311:00:123
196009943,1cyclictest40-21ksoftirqd/309:20:123
196009943,1cyclictest40-21ksoftirqd/308:10:013
196009943,1cyclictest391ktimersoftd/311:15:123
196009942,2cyclictest40-21ksoftirqd/309:35:103
196009942,2cyclictest40-21ksoftirqd/309:25:383
196009940,4cyclictest5147-21apt-get08:50:123
196009940,4cyclictest19031-21ntpq08:10:183
196009940,4cyclictest0-21swapper/312:30:123
196009940,4cyclictest0-21swapper/311:35:023
196009940,4cyclictest0-21swapper/310:55:133
196009940,4cyclictest0-21swapper/307:45:143
196009940,4cyclictest0-21swapper/307:30:123
196009940,3cyclictest8372-21df07:50:143
196009940,3cyclictest5695-21ssh12:20:013
196009940,3cyclictest28442-21ssh12:15:133
196009940,3cyclictest28189-21df08:30:143
196009940,3cyclictest22677-21sed07:15:013
196009940,3cyclictest20763-21diskstats08:15:133
196009940,3cyclictest20763-21diskstats08:15:133
196009940,3cyclictest11136-21cut09:40:133
196009940,0cyclictest0-21swapper/309:45:143
195959944,0cyclictest31-21ksoftirqd/212:20:002
195959944,0cyclictest0-21swapper/212:25:082
195959944,0cyclictest0-21swapper/212:11:282
195959944,0cyclictest0-21swapper/211:07:262
195959944,0cyclictest0-21swapper/208:40:192
195959943,1cyclictest22937-21memory10:50:182
195959943,1cyclictest10489-21munin-plugin-st09:40:012
195959942,1cyclictest30997-21snmpd07:14:332
195959941,3cyclictest30997-21snmpd11:00:502
195959941,2cyclictest0-21swapper/209:50:012
195959940,4cyclictest9000-21grep11:15:212
195959940,4cyclictest27678-21users12:30:212
195959940,4cyclictest24794-21ntpq09:30:172
195959940,4cyclictest0-21swapper/212:38:282
195959940,4cyclictest0-21swapper/212:20:122
195959940,4cyclictest0-21swapper/212:05:112
195959940,4cyclictest0-21swapper/211:50:082
195959940,4cyclictest0-21swapper/211:39:122
195959940,4cyclictest0-21swapper/211:27:032
195959940,4cyclictest0-21swapper/211:21:282
195959940,4cyclictest0-21swapper/211:13:372
195959940,4cyclictest0-21swapper/210:45:142
195959940,4cyclictest0-21swapper/210:35:142
195959940,4cyclictest0-21swapper/210:30:062
195959940,4cyclictest0-21swapper/210:10:142
195959940,4cyclictest0-21swapper/209:41:092
195959940,3cyclictest2551-21if_eth411:45:132
195959940,3cyclictest25335-21ssh09:15:012
195959940,3cyclictest22387-21hddtemp_smartct11:55:152
195959940,3cyclictest22334-21users07:15:012
195959940,3cyclictest20556-21cron09:45:012
195959940,3cyclictest19416-21expr10:00:152
195959940,3cyclictest12817-21apt-get08:00:132
195959940,3cyclictest12617-21sed09:05:012
195959940,3cyclictest11353-21sed10:45:012
195959940,3cyclictest0-21swapper/209:20:122
195959940,1cyclictest5723-21ntp_states10:25:182
195959940,1cyclictest30374-21/usr/sbin/munin07:30:152
195959940,1cyclictest25199-21/usr/sbin/munin08:25:232
195959940,0cyclictest0-21swapper/207:50:162
195919944,0cyclictest0-21swapper/111:20:261
195919944,0cyclictest0-21swapper/111:06:541
195919944,0cyclictest0-21swapper/110:44:031
195919944,0cyclictest0-21swapper/109:40:281
195919942,1cyclictest0-21swapper/108:30:121
195919941,2cyclictest0-21swapper/112:35:011
195919941,2cyclictest0-21swapper/112:20:121
195919941,2cyclictest0-21swapper/112:10:161
195919941,2cyclictest0-21swapper/111:50:021
195919941,2cyclictest0-21swapper/111:45:091
195919941,2cyclictest0-21swapper/111:30:121
195919941,2cyclictest0-21swapper/111:30:121
195919941,2cyclictest0-21swapper/111:25:121
195919941,2cyclictest0-21swapper/110:55:141
195919941,2cyclictest0-21swapper/110:50:141
195919941,2cyclictest0-21swapper/110:35:141
195919941,2cyclictest0-21swapper/110:25:021
195919941,2cyclictest0-21swapper/110:00:141
195919941,2cyclictest0-21swapper/109:50:011
195919941,2cyclictest0-21swapper/109:15:131
195919941,2cyclictest0-21swapper/109:10:121
195919941,2cyclictest0-21swapper/108:45:121
195919941,2cyclictest0-21swapper/107:55:141
195919941,2cyclictest0-21swapper/107:50:121
195919941,2cyclictest0-21swapper/107:30:121
195919941,2cyclictest0-21swapper/107:15:151
195919940,2cyclictest0-21swapper/112:30:121
195919940,2cyclictest0-21swapper/112:25:121
195919940,2cyclictest0-21swapper/108:25:151
195919940,0cyclictest0-21swapper/111:03:071
195859944,0cyclictest0-21swapper/012:33:230
195859944,0cyclictest0-21swapper/012:16:300
195859944,0cyclictest0-21swapper/011:20:110
195859944,0cyclictest0-21swapper/010:24:360
195859943,1cyclictest321-21grep10:55:160
195859942,1cyclictest30997-21snmpd10:30:140
195859940,4cyclictest31910-21df12:00:130
195859940,4cyclictest0-21swapper/012:35:010
195859940,4cyclictest0-21swapper/012:10:160
195859940,4cyclictest0-21swapper/011:55:230
195859940,4cyclictest0-21swapper/011:51:090
195859940,4cyclictest0-21swapper/011:48:540
195859940,4cyclictest0-21swapper/011:10:370
195859940,4cyclictest0-21swapper/010:40:140
195859940,4cyclictest0-21swapper/010:37:230
195859940,4cyclictest0-21swapper/009:50:110
195859940,4cyclictest0-21swapper/009:40:100
195859940,4cyclictest0-21swapper/009:30:120
195859940,4cyclictest0-21swapper/009:25:130
195859940,4cyclictest0-21swapper/008:20:130
195859940,3cyclictest5477-21ssh10:09:430
195859940,3cyclictest4917-21latency_hist08:50:010
195859940,3cyclictest32546-21cat08:40:010
195859940,3cyclictest32255-21sshd07:30:360
195859940,3cyclictest27345-21ssh09:47:590
195859940,3cyclictest22343-21memory07:15:010
195859940,3cyclictest21059-21ssh10:16:540
195859940,3cyclictest18123-21ssh09:10:400
195859940,0cyclictest0-21swapper/010:11:220
196009933,0cyclictest40-21ksoftirqd/312:05:013
196009931,1cyclictest0-21swapper/307:35:123
196009931,1cyclictest0-21swapper/307:10:133
195959932,1cyclictest57250irq/125-eth009:55:012
195959930,3cyclictest5844-21perl08:50:152
195959930,3cyclictest31587-21apt-get10:55:022
195959930,3cyclictest22731-21apt-get08:20:132
195959930,3cyclictest17755-21apt08:10:112
195959930,3cyclictest16565-21ssh10:15:132
195959930,3cyclictest12344-21apt-get09:05:012
195959930,3cyclictest0-21swapper/211:40:132
195959930,3cyclictest0-21swapper/209:25:062
195959930,3cyclictest0-21swapper/209:10:032
195959930,3cyclictest0-21swapper/208:35:102
195959930,3cyclictest0-21swapper/208:30:012
195959930,3cyclictest0-21swapper/208:15:122
195959930,3cyclictest0-21swapper/208:15:122
195959930,3cyclictest0-21swapper/208:05:012
195959930,3cyclictest0-21swapper/207:40:112
195959930,3cyclictest0-21swapper/207:35:122
195959930,3cyclictest0-21swapper/207:25:142
195959930,3cyclictest0-21swapper/207:20:122
195959930,1cyclictest4279-21ssh11:30:102
195959930,1cyclictest4279-21ssh11:30:102
195959930,0cyclictest10325-21apt-get07:55:142
195919933,0cyclictest0-21swapper/109:04:061
195919933,0cyclictest0-21swapper/108:05:441
195919932,1cyclictest0-21swapper/108:35:101
195919931,2cyclictest0-21swapper/108:55:131
195919931,2cyclictest0-21swapper/108:00:131
195919931,2cyclictest0-21swapper/107:35:121
195919931,1cyclictest0-21swapper/111:15:121
195919931,1cyclictest0-21swapper/110:20:131
195919931,1cyclictest0-21swapper/110:10:131
195919931,1cyclictest0-21swapper/110:05:131
195919931,1cyclictest0-21swapper/109:30:121
195919931,1cyclictest0-21swapper/109:25:131
195919931,1cyclictest0-21swapper/108:15:111
195919931,1cyclictest0-21swapper/108:15:111
195919930,2cyclictest0-21swapper/112:15:131
195919930,2cyclictest0-21swapper/111:40:121
195919930,2cyclictest0-21swapper/109:55:131
195919930,2cyclictest0-21swapper/109:05:011
195919930,2cyclictest0-21swapper/108:50:121
195859933,0cyclictest20665-21cat07:10:170
195859930,3cyclictest5840-21expr07:45:150
195859930,3cyclictest23883-21ssh11:40:020
195859930,3cyclictest21494-21ssh10:50:050
195859930,3cyclictest18771-21ssh10:00:060
195859930,3cyclictest15293-21apt-get08:05:160
195859930,3cyclictest1512-21memory07:35:170
195859930,3cyclictest0-21swapper/012:20:120
195859930,3cyclictest0-21swapper/012:05:020
195859930,3cyclictest0-21swapper/011:15:020
195859930,3cyclictest0-21swapper/011:00:120
195859930,3cyclictest0-21swapper/009:55:130
195859930,3cyclictest0-21swapper/009:15:020
195859930,3cyclictest0-21swapper/009:05:010
195859930,3cyclictest0-21swapper/008:55:020
195859930,3cyclictest0-21swapper/008:50:120
195859930,3cyclictest0-21swapper/008:40:130
195859930,3cyclictest0-21swapper/008:30:120
195859930,3cyclictest0-21swapper/008:25:150
195859930,3cyclictest0-21swapper/008:15:110
195859930,3cyclictest0-21swapper/008:15:110
195859930,3cyclictest0-21swapper/008:10:120
195859930,3cyclictest0-21swapper/008:00:130
195859930,3cyclictest0-21swapper/007:55:140
195859930,3cyclictest0-21swapper/007:50:120
195859930,3cyclictest0-21swapper/007:25:140
195859930,3cyclictest0-21swapper/007:20:120
195919921,1cyclictest0-21swapper/108:20:131
195919920,1cyclictest0-21swapper/110:45:141
195919920,1cyclictest0-21swapper/110:15:161
195919920,1cyclictest0-21swapper/108:40:131
195919920,1cyclictest0-21swapper/108:10:121
195919920,1cyclictest0-21swapper/107:20:121
195919920,1cyclictest0-21swapper/107:10:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional