You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 23:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Wed Dec 03, 2025 12:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
160722193176,12sleep10-21swapper/107:10:001
159192192175,12sleep30-21swapper/307:08:053
138492188172,11sleep00-21swapper/007:05:060
138562176156,15sleep20-21swapper/207:05:112
252492500,3sleep340-21ksoftirqd/311:09:373
196682430,0sleep10-21swapper/110:17:481
34892420,0sleep10-21swapper/108:50:201
237052420,0sleep20-21swapper/212:13:352
34612410,0sleep10-21swapper/109:21:061
168122140,0sleep00-21swapper/007:10:150
49822120,1sleep30-21swapper/308:55:133
183062120,0sleep00-21swapper/009:29:070
144602120,0sleep00-21swapper/009:43:030
1624099102,4cyclictest31744-21munin-run07:40:020
162409982,3cyclictest7520-21perf09:40:010
162409972,5cyclictest23223-21kworker/0:011:22:450
162409972,5cyclictest17678-21kworker/0:109:22:110
162409963,3cyclictest3357-21kworker/0:112:00:120
162409962,4cyclictest3357-21kworker/0:111:42:070
162409961,5cyclictest3357-21kworker/0:112:05:270
162409961,5cyclictest3357-21kworker/0:111:52:550
162409961,5cyclictest3357-21kworker/0:111:49:190
162409961,5cyclictest3357-21kworker/0:111:34:430
162409961,5cyclictest23223-21kworker/0:011:25:190
162409961,5cyclictest23223-21kworker/0:011:15:230
162409961,5cyclictest23223-21kworker/0:011:14:400
162409961,5cyclictest23223-21kworker/0:010:45:180
162409961,5cyclictest23223-21kworker/0:010:40:560
162409961,5cyclictest23223-21kworker/0:010:30:150
162409961,5cyclictest23223-21kworker/0:010:28:270
162409961,5cyclictest23223-21kworker/0:010:10:510
162409961,5cyclictest17678-21kworker/0:110:00:510
162409961,5cyclictest17678-21kworker/0:109:54:360
162409961,5cyclictest17678-21kworker/0:109:11:310
162409961,5cyclictest17678-21kworker/0:109:05:110
162409960,3cyclictest3523-21awk12:20:000
162509955,0cyclictest30578-21kworker/3:212:34:123
162509955,0cyclictest30578-21kworker/3:212:11:483
162509955,0cyclictest30578-21kworker/3:211:27:033
162509955,0cyclictest0-21swapper/310:33:123
162509950,5cyclictest0-21swapper/311:10:023
162509950,5cyclictest0-21swapper/309:05:123
162509950,5cyclictest0-21swapper/307:15:143
162509950,4cyclictest21497-21ssh11:40:093
162509950,4cyclictest0-21swapper/311:45:123
162469955,0cyclictest0-21swapper/210:15:152
162469951,4cyclictest714-21snmpd11:50:392
162469950,5cyclictest0-21swapper/207:20:132
162469950,5cyclictest0-21swapper/207:20:122
162419952,2cyclictest0-21swapper/108:10:121
162419951,3cyclictest0-21swapper/112:15:121
162419951,2cyclictest0-21swapper/109:35:141
162419951,2cyclictest0-21swapper/107:40:111
162419950,5cyclictest0-21swapper/111:09:021
162419950,5cyclictest0-21swapper/111:00:461
162419950,5cyclictest0-21swapper/109:18:111
162419950,3cyclictest0-21swapper/112:35:121
162409952,3cyclictest23223-21kworker/0:011:00:150
162409952,3cyclictest23223-21kworker/0:010:20:120
162409951,4cyclictest3357-21kworker/0:112:37:180
162409951,4cyclictest3357-21kworker/0:112:11:060
162409951,4cyclictest23223-21kworker/0:010:57:550
162409951,4cyclictest23223-21kworker/0:010:37:110
162409951,4cyclictest23223-21kworker/0:010:37:110
162409951,4cyclictest17678-21kworker/0:108:50:180
162409950,5cyclictest3357-21kworker/0:112:32:150
162409950,5cyclictest3357-21kworker/0:112:22:340
162409950,5cyclictest3357-21kworker/0:111:35:560
162409950,5cyclictest23223-21kworker/0:010:52:030
162409950,5cyclictest23223-21kworker/0:010:16:070
162409950,5cyclictest17678-21kworker/0:109:33:550
162409950,5cyclictest0-21swapper/011:55:470
162509944,0cyclictest30578-21kworker/3:208:16:433
162509944,0cyclictest30578-21kworker/3:208:05:303
162509944,0cyclictest30578-21kworker/3:207:54:193
162509944,0cyclictest30578-21kworker/3:207:43:083
162509944,0cyclictest30578-21kworker/3:207:31:553
162509944,0cyclictest30578-21kworker/3:207:20:433
162509944,0cyclictest30578-21kworker/3:207:20:423
162509944,0cyclictest0-21swapper/310:51:593
162509944,0cyclictest0-21swapper/309:15:053
162509943,1cyclictest8488-21sed11:00:213
162509943,1cyclictest24516-21uniq10:20:143
162509943,1cyclictest18356-21munin-plugin-st10:50:023
162509942,2cyclictest2907-21cat08:50:153
162509942,1cyclictest32098-21ssh09:20:013
162509941,3cyclictest0-21swapper/310:06:343
162509940,4cyclictest6884-21apt-get12:05:193
162509940,4cyclictest29022-21cpuspeed10:55:123
162509940,4cyclictest26782-21apt-get08:35:123
162509940,4cyclictest20338-21ssh09:30:133
162509940,4cyclictest11663-21diskmemload12:02:123
162509940,4cyclictest0-21swapper/312:35:033
162509940,4cyclictest0-21swapper/312:21:573
162509940,4cyclictest0-21swapper/312:15:113
162509940,4cyclictest0-21swapper/311:55:193
162509940,4cyclictest0-21swapper/311:50:153
162509940,4cyclictest0-21swapper/310:01:133
162509940,4cyclictest0-21swapper/308:30:113
162509940,4cyclictest0-21swapper/308:00:143
162509940,4cyclictest0-21swapper/307:55:113
162509940,3cyclictest4600-21ssh10:42:373
162509940,3cyclictest22403-21cut08:25:143
162509940,3cyclictest1923-21diskstats10:25:143
162509940,3cyclictest18098-21ssh09:45:033
162509940,3cyclictest16273-21ssh09:11:373
162509940,3cyclictest15756-21ssh11:36:393
162509940,3cyclictest13417-21ssh10:15:013
162509940,3cyclictest0-21swapper/312:25:133
162509940,3cyclictest0-21swapper/309:00:153
162509940,0cyclictest0-21swapper/311:18:203
162509940,0cyclictest0-21swapper/309:50:433
162469944,0cyclictest0-21swapper/212:17:292
162469944,0cyclictest0-21swapper/209:55:022
162469944,0cyclictest0-21swapper/209:43:072
162469944,0cyclictest0-21swapper/209:33:212
162469942,1cyclictest15452-21cron10:00:022
162469940,4cyclictest31944-21/usr/sbin/munin08:45:202
162469940,4cyclictest1998-21apt-get08:50:112
162469940,4cyclictest14482-21expr11:20:162
162469940,4cyclictest0-21swapper/212:38:282
162469940,4cyclictest0-21swapper/212:28:262
162469940,4cyclictest0-21swapper/211:57:122
162469940,4cyclictest0-21swapper/211:47:122
162469940,4cyclictest0-21swapper/211:07:322
162469940,4cyclictest0-21swapper/210:40:132
162469940,4cyclictest0-21swapper/210:35:132
162469940,4cyclictest0-21swapper/210:35:132
162469940,4cyclictest0-21swapper/210:05:132
162469940,4cyclictest0-21swapper/209:50:122
162469940,4cyclictest0-21swapper/209:25:122
162469940,3cyclictest9942-21df09:05:132
162469940,3cyclictest8685-21taskset10:28:402
162469940,3cyclictest32121-21gpgv09:20:012
162469940,3cyclictest31830-21ntp_states09:35:212
162469940,3cyclictest26552-21latency_hist08:35:002
162469940,3cyclictest24696-21perl11:25:142
162469940,3cyclictest18490-21latency_hist10:50:012
162469940,3cyclictest14172-21latency_hist08:10:002
162469940,3cyclictest14160-21sh11:03:562
162469940,3cyclictest13750-21awk09:10:222
162469940,3cyclictest12045-21sh12:07:262
162469940,2cyclictest0-21swapper/212:32:322
162469940,1cyclictest9469-21/usr/sbin/munin08:00:172
162469940,1cyclictest30774-21ntp_states07:35:202
162469940,1cyclictest16359-21/usr/sbin/munin07:10:142
162419944,0cyclictest211ktimersoftd/110:11:281
162419944,0cyclictest0-21swapper/112:04:281
162419944,0cyclictest0-21swapper/111:27:571
162419944,0cyclictest0-21swapper/110:35:531
162419944,0cyclictest0-21swapper/110:35:531
162419944,0cyclictest0-21swapper/109:11:281
162419943,1cyclictest0-21swapper/111:38:341
162419941,3cyclictest0-21swapper/109:05:111
162419941,2cyclictest0-21swapper/110:55:111
162419941,2cyclictest0-21swapper/110:50:111
162419941,2cyclictest0-21swapper/109:25:121
162419941,2cyclictest0-21swapper/108:35:111
162419941,2cyclictest0-21swapper/108:30:111
162419941,2cyclictest0-21swapper/108:25:121
162419941,2cyclictest0-21swapper/108:15:111
162419941,2cyclictest0-21swapper/108:00:141
162419941,2cyclictest0-21swapper/107:45:121
162419941,2cyclictest0-21swapper/107:35:141
162419941,2cyclictest0-21swapper/107:15:131
162419940,4cyclictest0-21swapper/112:31:581
162419940,4cyclictest0-21swapper/109:47:171
162419940,4cyclictest0-21swapper/109:42:021
162419940,3cyclictest0-21swapper/110:40:131
162419940,2cyclictest0-21swapper/112:10:131
162409944,0cyclictest0-21swapper/008:30:210
162409944,0cyclictest0-21swapper/007:46:230
162409942,2cyclictest23223-21kworker/0:011:07:160
162409942,2cyclictest17678-21kworker/0:107:20:150
162409942,2cyclictest17678-21kworker/0:107:20:150
162409941,3cyclictest3357-21kworker/0:112:25:220
162409941,3cyclictest17678-21kworker/0:109:15:010
162409941,3cyclictest17678-21kworker/0:109:00:190
162409941,3cyclictest17678-21kworker/0:108:20:190
162409940,4cyclictest29457-21apt-get08:40:000
162409940,4cyclictest23223-21kworker/0:010:06:150
162409940,4cyclictest17678-21kworker/0:109:47:390
162409940,4cyclictest0-21swapper/009:55:150
162409940,3cyclictest9248-21sendmail-msp08:00:050
162409940,3cyclictest25299-21perl07:25:150
162409940,3cyclictest19287-21ls08:20:000
162409940,3cyclictest12632-21fschecks_time08:05:140
15513240,0sleep10-21swapper/111:20:201
162509932,1cyclictest7785-21ssh09:40:033
162509932,1cyclictest6212-21grep09:55:163
162509932,1cyclictest3618-21ssh10:10:103
162509930,3cyclictest30137-21ssh09:35:043
162509930,3cyclictest29474-21apt-get08:40:113
162509930,3cyclictest2762-21perl07:45:143
162509930,3cyclictest10241-21apt-get09:25:133
162509930,3cyclictest0-21swapper/311:30:123
162509930,3cyclictest0-21swapper/311:20:063
162509930,3cyclictest0-21swapper/310:35:063
162509930,3cyclictest0-21swapper/310:35:063
162509930,3cyclictest0-21swapper/308:45:113
162509930,3cyclictest0-21swapper/308:20:133
162509930,3cyclictest0-21swapper/308:10:033
162509930,3cyclictest0-21swapper/307:37:223
162509930,3cyclictest0-21swapper/307:25:123
162509930,3cyclictest0-21swapper/307:10:123
162469933,0cyclictest18813-21kworker/2:111:15:012
162469932,1cyclictest28970-21ssh12:00:032
162469932,1cyclictest18813-21kworker/2:108:55:002
162469931,2cyclictest0-21swapper/209:45:122
162469931,1cyclictest868-21open_inodes07:40:222
162469930,3cyclictest3479-21sh10:10:052
162469930,3cyclictest26810-21cut08:35:112
162469930,3cyclictest22152-21sh09:15:082
162469930,3cyclictest19898-21df_inode08:20:152
162469930,3cyclictest19346-21df_inode07:15:062
162469930,3cyclictest0-21swapper/212:20:132
162469930,3cyclictest0-21swapper/211:40:112
162469930,3cyclictest0-21swapper/211:35:022
162469930,3cyclictest0-21swapper/211:10:042
162469930,3cyclictest0-21swapper/210:55:032
162469930,3cyclictest0-21swapper/210:50:122
162469930,3cyclictest0-21swapper/210:30:132
162469930,3cyclictest0-21swapper/210:20:142
162469930,3cyclictest0-21swapper/209:00:012
162469930,3cyclictest0-21swapper/208:40:042
162469930,3cyclictest0-21swapper/208:25:112
162469930,3cyclictest0-21swapper/208:15:122
162469930,3cyclictest0-21swapper/208:10:122
162469930,3cyclictest0-21swapper/207:55:112
162469930,3cyclictest0-21swapper/207:50:122
162469930,3cyclictest0-21swapper/207:45:022
162469930,3cyclictest0-21swapper/207:30:122
162469930,3cyclictest0-21swapper/207:25:122
162469930,1cyclictest0-21swapper/211:30:052
162419933,0cyclictest211ktimersoftd/112:25:011
162419933,0cyclictest211ktimersoftd/112:20:071
162419933,0cyclictest211ktimersoftd/112:05:011
162419933,0cyclictest211ktimersoftd/111:55:041
162419933,0cyclictest211ktimersoftd/111:50:021
162419933,0cyclictest211ktimersoftd/111:45:011
162419933,0cyclictest211ktimersoftd/111:40:031
162419933,0cyclictest211ktimersoftd/111:30:021
162419933,0cyclictest211ktimersoftd/111:15:071
162419933,0cyclictest211ktimersoftd/111:10:011
162419933,0cyclictest211ktimersoftd/110:45:031
162419933,0cyclictest211ktimersoftd/110:30:031
162419933,0cyclictest211ktimersoftd/110:25:031
162419933,0cyclictest211ktimersoftd/110:20:011
162419933,0cyclictest211ktimersoftd/110:05:091
162419933,0cyclictest211ktimersoftd/110:00:011
162419933,0cyclictest211ktimersoftd/109:55:031
162419933,0cyclictest211ktimersoftd/109:50:011
162419933,0cyclictest211ktimersoftd/109:30:011
162419933,0cyclictest211ktimersoftd/109:00:001
162419933,0cyclictest211ktimersoftd/108:55:121
162419933,0cyclictest211ktimersoftd/108:45:001
162419933,0cyclictest211ktimersoftd/108:05:131
162419933,0cyclictest211ktimersoftd/107:55:021
162419933,0cyclictest211ktimersoftd/107:50:151
162419933,0cyclictest211ktimersoftd/107:30:021
162419933,0cyclictest211ktimersoftd/107:25:011
162419933,0cyclictest211ktimersoftd/107:10:131
162419933,0cyclictest0-21swapper/108:20:151
162419931,1cyclictest0-21swapper/107:20:121
162419931,1cyclictest0-21swapper/107:20:121
162419930,2cyclictest0-21swapper/108:40:101
162409933,0cyclictest0-21swapper/008:45:010
162409933,0cyclictest0-21swapper/008:10:060
162409933,0cyclictest0-21swapper/007:55:070
162409931,2cyclictest17678-21kworker/0:107:40:060
162409931,1cyclictest714-21snmpd07:50:050
162409930,3cyclictest27029-21apt-get07:30:120
162409930,3cyclictest19205-21perl07:15:020
162409930,3cyclictest0-21swapper/008:55:130
162409930,3cyclictest0-21swapper/008:35:010
162409930,3cyclictest0-21swapper/008:25:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional