You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-23 - 20:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Thu Oct 23, 2025 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
178752195179,12sleep00-21swapper/007:05:070
198402193179,10sleep10-21swapper/107:06:391
200642190173,12sleep20-21swapper/207:09:332
200482185170,11sleep30-21swapper/307:09:223
161192520,0sleep30-21swapper/309:25:223
204892440,0sleep20-21swapper/208:10:212
194892440,0sleep20-21swapper/209:11:002
234422420,0sleep10-21swapper/110:00:581
26622110,0sleep20-21swapper/212:33:482
2030099102,4cyclictest23389-21awk08:20:000
2825290,0sleep30-21swapper/311:11:473
203009982,3cyclictest10128-21munin-run12:05:010
203009981,3cyclictest1770-21munin-run09:35:010
203009980,4cyclictest5798-21munin-run08:50:000
203009972,4cyclictest26047-21munin-run09:15:010
203069961,3cyclictest0-21swapper/111:45:121
203009962,4cyclictest2884-21munin-run11:45:000
203009960,3cyclictest32674-21awk12:00:010
203129955,0cyclictest40-21ksoftirqd/310:55:143
203129955,0cyclictest23033-21kworker/3:012:31:563
203129955,0cyclictest23033-21kworker/3:012:20:433
203129955,0cyclictest23033-21kworker/3:012:09:323
203129955,0cyclictest23033-21kworker/3:011:58:193
203129955,0cyclictest23033-21kworker/3:011:24:443
203129955,0cyclictest23033-21kworker/3:010:17:363
203129955,0cyclictest23033-21kworker/3:009:43:583
203129955,0cyclictest23033-21kworker/3:009:32:483
203129955,0cyclictest23033-21kworker/3:009:21:363
203129955,0cyclictest23033-21kworker/3:007:29:373
203129955,0cyclictest0-21swapper/311:17:053
203129954,1cyclictest0-21swapper/311:35:093
203129954,0cyclictest40-21ksoftirqd/311:40:123
203129950,5cyclictest10017-21apt-get09:55:033
203129950,5cyclictest0-21swapper/310:27:113
203129950,1cyclictest14760-21ntp_states11:50:183
203079950,5cyclictest1037-21ssh11:27:132
203079950,5cyclictest0-21swapper/210:30:552
203079950,5cyclictest0-21swapper/210:29:282
203079950,4cyclictest15891-21diskmemload11:20:152
203069952,2cyclictest0-21swapper/110:45:151
203069952,2cyclictest0-21swapper/109:55:111
203069951,3cyclictest0-21swapper/112:20:151
203069951,3cyclictest0-21swapper/110:05:131
203069951,3cyclictest0-21swapper/108:25:131
203069951,2cyclictest0-21swapper/110:11:161
203069951,2cyclictest0-21swapper/109:35:111
203069951,2cyclictest0-21swapper/108:05:121
203069950,5cyclictest0-21swapper/111:40:211
203069950,4cyclictest0-21swapper/112:05:121
203009950,5cyclictest0-21swapper/012:20:140
203009950,5cyclictest0-21swapper/010:09:350
203009950,1cyclictest18408-21munin-run08:10:010
203009950,0cyclictest0-21swapper/011:14:120
203009950,0cyclictest0-21swapper/010:46:410
27878240,0sleep10-21swapper/109:47:301
21652240,0sleep10-21swapper/111:05:151
20810240,3sleep215891-21diskmemload11:37:082
203129944,0cyclictest40-21ksoftirqd/309:10:023
203129944,0cyclictest40-21ksoftirqd/308:45:113
203129944,0cyclictest23033-21kworker/3:008:25:363
203129944,0cyclictest23033-21kworker/3:008:14:253
203129944,0cyclictest23033-21kworker/3:007:52:033
203129944,0cyclictest23033-21kworker/3:007:40:523
203129944,0cyclictest23033-21kworker/3:007:18:283
203129944,0cyclictest0-21swapper/309:35:493
203129943,1cyclictest40-21ksoftirqd/310:20:133
203129943,1cyclictest32677-21wc08:35:203
203129943,1cyclictest30620-21grep10:05:133
203129942,1cyclictest4884-21ssh12:01:413
203129941,3cyclictest714-21snmpd09:50:373
203129941,3cyclictest0-21swapper/311:25:583
203129941,1cyclictest0-21swapper/310:40:153
203129941,1cyclictest0-21swapper/308:50:113
203129941,1cyclictest0-21swapper/308:20:113
203129940,4cyclictest0-21swapper/312:10:113
203129940,4cyclictest0-21swapper/311:45:353
203129940,4cyclictest0-21swapper/310:50:123
203129940,4cyclictest0-21swapper/310:35:023
203129940,4cyclictest0-21swapper/310:31:263
203129940,4cyclictest0-21swapper/309:47:123
203129940,4cyclictest0-21swapper/308:15:123
203129940,3cyclictest9095-21sh10:10:163
203129940,3cyclictest6575-21df_inode11:30:153
203129940,3cyclictest4988-21apt-get12:35:013
203129940,3cyclictest2146-21hddtemp_smartct07:35:133
203129940,3cyclictest15698-21sh11:02:013
203129940,3cyclictest13684-21taskset08:00:023
203129940,3cyclictest0-21swapper/311:10:013
203129940,1cyclictest6270-21/usr/sbin/munin07:45:183
203129940,1cyclictest28541-21/usr/sbin/munin08:30:163
203129940,1cyclictest16966-21df09:10:133
203129940,1cyclictest10976-21/usr/sbin/munin09:00:113
203079944,0cyclictest0-21swapper/212:29:382
203079944,0cyclictest0-21swapper/210:50:252
203079944,0cyclictest0-21swapper/209:18:102
203079944,0cyclictest0-21swapper/208:06:162
203079941,3cyclictest14706-21ssh10:13:142
203079940,4cyclictest0-21swapper/212:35:122
203079940,4cyclictest0-21swapper/212:20:522
203079940,4cyclictest0-21swapper/212:11:552
203079940,4cyclictest0-21swapper/212:05:122
203079940,4cyclictest0-21swapper/211:57:422
203079940,4cyclictest0-21swapper/211:50:122
203079940,4cyclictest0-21swapper/211:30:122
203079940,4cyclictest0-21swapper/211:11:032
203079940,4cyclictest0-21swapper/210:39:092
203079940,4cyclictest0-21swapper/210:20:272
203079940,4cyclictest0-21swapper/210:19:082
203079940,4cyclictest0-21swapper/210:03:262
203079940,4cyclictest0-21swapper/209:59:382
203079940,4cyclictest0-21swapper/209:35:122
203079940,4cyclictest0-21swapper/209:26:052
203079940,4cyclictest0-21swapper/209:20:122
203079940,4cyclictest0-21swapper/209:03:462
203079940,4cyclictest0-21swapper/208:55:192
203079940,4cyclictest0-21swapper/208:48:462
203079940,4cyclictest0-21swapper/208:38:042
203079940,4cyclictest0-21swapper/208:32:012
203079940,4cyclictest0-21swapper/207:50:142
203079940,4cyclictest0-21swapper/207:45:122
203079940,3cyclictest28377-21ssh11:08:432
203079940,3cyclictest13476-21/usr/sbin/munin10:45:202
203079940,3cyclictest13022-21users11:00:212
203079940,3cyclictest12729-21python07:55:212
203079940,3cyclictest10577-21latency_hist11:00:002
203079940,3cyclictest0-21swapper/211:40:122
203079940,1cyclictest23941-21grep08:20:132
203079940,1cyclictest2229-21sed08:40:162
203079940,0cyclictest0-21swapper/212:02:262
203079940,0cyclictest0-21swapper/209:33:452
203079940,0cyclictest0-21swapper/208:25:112
203069944,0cyclictest0-21swapper/111:39:371
203069944,0cyclictest0-21swapper/110:27:531
203069944,0cyclictest0-21swapper/109:20:491
203069941,2cyclictest0-21swapper/112:35:111
203069941,2cyclictest0-21swapper/112:30:111
203069941,2cyclictest0-21swapper/111:50:131
203069941,2cyclictest0-21swapper/111:20:151
203069941,2cyclictest0-21swapper/111:10:161
203069941,2cyclictest0-21swapper/110:20:121
203069941,2cyclictest0-21swapper/110:15:151
203069941,2cyclictest0-21swapper/109:15:161
203069941,2cyclictest0-21swapper/109:10:121
203069941,2cyclictest0-21swapper/108:15:121
203069941,2cyclictest0-21swapper/108:00:151
203069941,2cyclictest0-21swapper/107:40:121
203069941,2cyclictest0-21swapper/107:25:131
203069941,1cyclictest0-21swapper/109:00:091
203069941,1cyclictest0-21swapper/108:20:111
203069940,4cyclictest0-21swapper/110:33:431
203069940,2cyclictest0-21swapper/110:55:151
203069940,2cyclictest0-21swapper/109:05:011
203009944,0cyclictest0-21swapper/010:11:020
203009943,1cyclictest11590-21cut09:55:160
203009942,1cyclictest20626-21ssh11:20:230
203009940,4cyclictest16192-21ssh11:50:500
203009940,4cyclictest0-21swapper/012:30:120
203009940,4cyclictest0-21swapper/012:15:120
203009940,4cyclictest0-21swapper/012:08:000
203009940,4cyclictest0-21swapper/011:46:380
203009940,4cyclictest0-21swapper/011:30:130
203009940,4cyclictest0-21swapper/011:00:120
203009940,4cyclictest0-21swapper/010:50:120
203009940,4cyclictest0-21swapper/010:40:150
203009940,4cyclictest0-21swapper/010:35:110
203009940,4cyclictest0-21swapper/010:25:110
203009940,4cyclictest0-21swapper/009:40:110
203009940,4cyclictest0-21swapper/009:28:560
203009940,4cyclictest0-21swapper/009:05:120
203009940,4cyclictest0-21swapper/009:00:010
203009940,4cyclictest0-21swapper/008:25:120
203009940,3cyclictest8662-21cat07:50:010
203009940,3cyclictest7323-21/usr/sbin/munin12:35:200
203009940,3cyclictest5386-21irqstats09:20:170
203009940,3cyclictest26314-21/usr/sbin/munin07:20:120
203009940,3cyclictest17969-21munin-run11:20:000
203009940,3cyclictest17117-21memory11:35:170
17721240,0sleep10-21swapper/109:26:071
203129933,0cyclictest40-21ksoftirqd/312:25:153
203129932,1cyclictest714-21snmpd07:55:113
203129931,2cyclictest0-21swapper/310:00:023
203129931,1cyclictest30133-21ssh12:15:023
203129930,3cyclictest31256-21apt-get07:30:113
203129930,3cyclictest13482-21apt10:45:163
203129930,3cyclictest0-21swapper/309:15:143
203129930,3cyclictest0-21swapper/308:05:113
203129930,3cyclictest0-21swapper/307:20:123
203129930,3cyclictest0-21swapper/307:10:163
203129930,2cyclictest0-21swapper/308:55:143
203129930,1cyclictest1077-21/usr/sbin/munin08:40:113
203079932,1cyclictest714-21snmpd11:45:142
203079932,1cyclictest714-21snmpd08:19:092
203079932,1cyclictest714-21snmpd07:10:142
203079930,3cyclictest32329-21ssh09:50:082
203079930,3cyclictest26299-21date07:20:022
203079930,3cyclictest23109-21df_inode07:15:012
203079930,3cyclictest14400-21perl08:00:172
203079930,3cyclictest0-21swapper/212:15:092
203079930,3cyclictest0-21swapper/211:15:032
203079930,3cyclictest0-21swapper/210:40:082
203079930,3cyclictest0-21swapper/210:05:112
203079930,3cyclictest0-21swapper/209:45:122
203079930,3cyclictest0-21swapper/209:40:042
203079930,3cyclictest0-21swapper/209:05:132
203079930,3cyclictest0-21swapper/208:50:112
203079930,3cyclictest0-21swapper/207:40:122
203079930,3cyclictest0-21swapper/207:35:102
203079930,3cyclictest0-21swapper/207:30:112
203079930,3cyclictest0-21swapper/207:25:052
203069932,1cyclictest0-21swapper/110:35:111
203069931,2cyclictest0-21swapper/107:45:131
203069931,1cyclictest0-21swapper/112:25:121
203069931,1cyclictest0-21swapper/112:15:131
203069931,1cyclictest0-21swapper/111:25:131
203069931,1cyclictest0-21swapper/111:05:011
203069931,1cyclictest0-21swapper/110:40:141
203069931,1cyclictest0-21swapper/109:40:121
203069931,1cyclictest0-21swapper/109:30:011
203069931,1cyclictest0-21swapper/108:50:121
203069931,1cyclictest0-21swapper/108:35:111
203069931,1cyclictest0-21swapper/107:55:131
203069931,1cyclictest0-21swapper/107:50:131
203069931,1cyclictest0-21swapper/107:35:111
203069931,1cyclictest0-21swapper/107:30:121
203069931,1cyclictest0-21swapper/107:20:111
203069931,1cyclictest0-21swapper/107:10:011
203069931,0cyclictest0-21swapper/111:15:131
203069930,2cyclictest28451-21chrt11:57:211
203069930,2cyclictest0-21swapper/111:30:181
203069930,2cyclictest0-21swapper/108:55:111
203069930,2cyclictest0-21swapper/108:40:111
203069930,2cyclictest0-21swapper/108:10:121
203069930,2cyclictest0-21swapper/107:15:121
203009932,1cyclictest32281-21ssh09:50:080
203009931,1cyclictest0-21swapper/007:40:130
203009930,3cyclictest28940-21expr08:30:130
203009930,3cyclictest2398-21memory07:35:150
203009930,3cyclictest23107-21munin-node07:15:020
203009930,3cyclictest2218-21kworker/0:009:35:070
203009930,3cyclictest20756-21rm11:05:050
203009930,3cyclictest18108-21rm10:15:140
203009930,3cyclictest15891-21diskmemload10:30:070
203009930,3cyclictest0-21swapper/012:25:090
203009930,3cyclictest0-21swapper/012:10:100
203009930,3cyclictest0-21swapper/011:25:120
203009930,3cyclictest0-21swapper/010:55:040
203009930,3cyclictest0-21swapper/010:00:120
203009930,3cyclictest0-21swapper/009:45:130
203009930,3cyclictest0-21swapper/009:15:150
203009930,3cyclictest0-21swapper/008:55:120
203009930,3cyclictest0-21swapper/008:50:110
203009930,3cyclictest0-21swapper/008:40:110
203009930,3cyclictest0-21swapper/008:35:120
203009930,3cyclictest0-21swapper/008:20:110
203009930,3cyclictest0-21swapper/008:10:140
203009930,3cyclictest0-21swapper/008:00:140
203009930,3cyclictest0-21swapper/007:55:030
203009930,3cyclictest0-21swapper/007:50:130
203009930,3cyclictest0-21swapper/007:30:110
203009930,3cyclictest0-21swapper/007:25:090
203009930,3cyclictest0-21swapper/007:10:020
203009930,2cyclictest28028-21ssh10:20:100
203069921,1cyclictest0-21swapper/112:10:111
203069920,2cyclictest0-21swapper/109:50:131
203069920,1cyclictest23239-21chrt10:50:071
203069920,1cyclictest0-21swapper/112:00:121
203069920,1cyclictest0-21swapper/108:45:111
203069920,1cyclictest0-21swapper/108:30:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional