You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 18:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Wed Nov 19, 2025 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
219122193176,12sleep30-21swapper/307:06:223
220632191174,12sleep10-21swapper/107:08:151
220472190174,11sleep00-21swapper/007:08:030
221882172155,12sleep20-21swapper/207:09:532
264442420,0sleep10-21swapper/110:34:171
85722410,1sleep28574-21sh09:20:192
104002390,0sleep10-21swapper/111:15:011
66102100,0sleep30-21swapper/312:01:063
3897290,0sleep00-21swapper/009:34:430
223709992,3cyclictest3146-21munin-run08:40:010
13131290,0sleep20-21swapper/212:05:052
223709982,3cyclictest5681-21awk07:40:010
223779970,5cyclictest0-21swapper/308:00:153
7809260,0sleep00-21swapper/011:45:220
223709960,1cyclictest20935-21apt-get08:10:120
24072250,0sleep20-21swapper/211:21:032
223779955,0cyclictest0-21swapper/312:18:323
223779950,5cyclictest0-21swapper/312:05:353
223779950,5cyclictest0-21swapper/308:10:183
223779950,4cyclictest0-21swapper/311:00:143
223779950,3cyclictest0-21swapper/312:39:423
223739952,3cyclictest19862-21ssh09:25:422
223739950,5cyclictest0-21swapper/212:26:532
223739950,5cyclictest0-21swapper/212:26:522
223739950,5cyclictest0-21swapper/212:20:032
223739950,5cyclictest0-21swapper/210:14:462
223739950,0cyclictest0-21swapper/211:19:482
223719951,3cyclictest0-21swapper/112:10:121
223719951,2cyclictest0-21swapper/112:15:131
223719951,2cyclictest0-21swapper/109:35:141
223719951,2cyclictest0-21swapper/109:10:141
223719951,2cyclictest0-21swapper/107:10:111
223719950,5cyclictest0-21swapper/110:16:191
223709952,2cyclictest25231-21rm11:38:210
223709950,5cyclictest0-21swapper/011:56:140
223709950,5cyclictest0-21swapper/010:56:360
223709950,5cyclictest0-21swapper/009:50:410
223709950,5cyclictest0-21swapper/009:10:310
223709950,4cyclictest28403-21apt-get07:20:000
223709950,0cyclictest0-21swapper/012:19:050
9528240,0sleep10-21swapper/108:50:171
223779944,0cyclictest0-21swapper/311:46:323
223779943,1cyclictest1376-21head10:05:153
223779942,1cyclictest8287-21cron08:50:003
223779941,1cyclictest0-21swapper/307:50:113
223779941,1cyclictest0-21swapper/307:35:143
223779940,4cyclictest24967-21ssh09:45:123
223779940,4cyclictest17323-21sh10:45:203
223779940,4cyclictest0-21swapper/312:23:523
223779940,4cyclictest0-21swapper/312:10:133
223779940,4cyclictest0-21swapper/311:55:133
223779940,4cyclictest0-21swapper/311:37:383
223779940,4cyclictest0-21swapper/311:10:143
223779940,4cyclictest0-21swapper/310:40:123
223779940,4cyclictest0-21swapper/310:30:133
223779940,4cyclictest0-21swapper/310:27:403
223779940,4cyclictest0-21swapper/310:02:193
223779940,4cyclictest0-21swapper/309:40:143
223779940,4cyclictest0-21swapper/309:30:143
223779940,4cyclictest0-21swapper/309:29:183
223779940,4cyclictest0-21swapper/309:20:153
223779940,4cyclictest0-21swapper/307:10:123
223779940,3cyclictest9531-21uname11:30:163
223779940,3cyclictest7095-21sh09:35:253
223779940,3cyclictest6101-21sh10:24:063
223779940,3cyclictest30614-21latency_hist08:30:013
223779940,3cyclictest29345-21/usr/sbin/munin11:40:153
223779940,3cyclictest28800-21apt-config09:15:013
223779940,3cyclictest28050-21sh10:35:083
223779940,3cyclictest27975-21apt-get07:20:013
223779940,3cyclictest22493-21sh09:11:183
223779940,3cyclictest22027-21taskset11:52:553
223779940,3cyclictest21512-21df11:20:163
223779940,3cyclictest20907-21cut08:10:013
223779940,3cyclictest20536-21/usr/sbin/munin10:15:133
223779940,3cyclictest16700-21fw_packets09:05:163
223779940,3cyclictest14478-21irqstats09:00:193
223779940,3cyclictest0-21swapper/312:25:143
223779940,3cyclictest0-21swapper/312:25:133
223779940,1cyclictest5896-21/usr/sbin/munin07:40:143
223779940,1cyclictest31090-21fschecks_count12:30:163
223779940,1cyclictest25808-21tr10:50:143
223779940,1cyclictest11900-21ntpq10:10:183
223779940,1cyclictest10743-21/usr/sbin/munin11:15:163
223779940,0cyclictest0-21swapper/310:56:023
223739944,0cyclictest0-21swapper/212:10:092
223739944,0cyclictest0-21swapper/210:40:482
223739944,0cyclictest0-21swapper/208:41:382
223739943,1cyclictest25817-21grep08:20:012
223739941,3cyclictest31071-21rm09:47:522
223739941,1cyclictest0-21swapper/212:00:112
223739940,4cyclictest5762-21ssh11:45:032
223739940,4cyclictest30516-21apt-get10:20:132
223739940,4cyclictest16554-21df11:50:162
223739940,4cyclictest13259-21apt-get11:00:152
223739940,4cyclictest11741-21perl08:55:152
223739940,4cyclictest0-21swapper/212:30:302
223739940,4cyclictest0-21swapper/212:15:572
223739940,4cyclictest0-21swapper/211:41:332
223739940,4cyclictest0-21swapper/211:25:132
223739940,4cyclictest0-21swapper/211:13:212
223739940,4cyclictest0-21swapper/211:05:162
223739940,4cyclictest0-21swapper/210:54:512
223739940,4cyclictest0-21swapper/210:25:012
223739940,4cyclictest0-21swapper/210:05:142
223739940,4cyclictest0-21swapper/209:50:132
223739940,4cyclictest0-21swapper/209:43:572
223739940,4cyclictest0-21swapper/209:35:122
223739940,4cyclictest0-21swapper/209:30:142
223739940,4cyclictest0-21swapper/209:10:142
223739940,4cyclictest0-21swapper/208:45:122
223739940,4cyclictest0-21swapper/208:26:122
223739940,4cyclictest0-21swapper/208:13:232
223739940,3cyclictest916-21date07:30:012
223739940,3cyclictest8826-21grep12:35:172
223739940,3cyclictest3303-21cat08:40:012
223739940,3cyclictest28231-21/usr/sbin/munin10:35:242
223739940,3cyclictest24346-21ssh10:16:292
223739940,3cyclictest16269-21diskstats10:45:132
223739940,3cyclictest159402sleep209:05:032
223739940,3cyclictest14108-21rm11:32:392
223739940,3cyclictest0-21swapper/210:55:142
223739940,3cyclictest0-21swapper/207:50:032
223739940,3cyclictest0-21swapper/207:20:012
223739940,1cyclictest14916-21users09:55:232
223739940,0cyclictest0-21swapper/209:16:172
223719944,0cyclictest0-21swapper/111:31:331
223719942,1cyclictest0-21swapper/111:00:151
223719942,1cyclictest0-21swapper/109:25:121
223719941,2cyclictest0-21swapper/112:30:121
223719941,2cyclictest0-21swapper/111:20:141
223719941,2cyclictest0-21swapper/110:35:171
223719941,2cyclictest0-21swapper/110:10:131
223719941,2cyclictest0-21swapper/110:00:121
223719941,2cyclictest0-21swapper/109:45:151
223719941,2cyclictest0-21swapper/109:40:151
223719941,2cyclictest0-21swapper/108:55:141
223719941,2cyclictest0-21swapper/108:30:131
223719941,2cyclictest0-21swapper/108:20:131
223719941,2cyclictest0-21swapper/108:05:111
223719941,2cyclictest0-21swapper/107:55:131
223719941,2cyclictest0-21swapper/107:45:121
223719941,2cyclictest0-21swapper/107:20:131
223719940,4cyclictest0-21swapper/109:30:021
223719940,2cyclictest0-21swapper/111:50:141
223719940,2cyclictest0-21swapper/107:50:121
223709944,0cyclictest3-21ksoftirqd/010:50:200
223709944,0cyclictest0-21swapper/012:35:500
223709944,0cyclictest0-21swapper/011:50:080
223709944,0cyclictest0-21swapper/011:31:480
223709944,0cyclictest0-21swapper/010:19:470
223709944,0cyclictest0-21swapper/010:05:570
223709944,0cyclictest0-21swapper/009:56:480
223709942,2cyclictest714-21snmpd12:01:170
223709942,2cyclictest3-21ksoftirqd/008:25:140
223709942,1cyclictest15905-21grep09:05:020
223709941,2cyclictest0-21swapper/010:30:130
223709941,1cyclictest0-21swapper/011:00:140
223709940,4cyclictest29693-21ssh09:47:020
223709940,4cyclictest20572-21apt-get12:25:140
223709940,4cyclictest20572-21apt-get12:25:130
223709940,4cyclictest0-21swapper/012:34:360
223709940,4cyclictest0-21swapper/011:40:130
223709940,4cyclictest0-21swapper/011:20:020
223709940,4cyclictest0-21swapper/011:10:150
223709940,4cyclictest0-21swapper/010:37:310
223709940,4cyclictest0-21swapper/010:25:160
223709940,4cyclictest0-21swapper/010:21:010
223709940,4cyclictest0-21swapper/009:35:130
223709940,4cyclictest0-21swapper/009:15:130
223709940,4cyclictest0-21swapper/009:05:080
223709940,4cyclictest0-21swapper/008:55:140
223709940,4cyclictest0-21swapper/007:49:270
223709940,3cyclictest32278-21ssh12:14:490
223709940,3cyclictest26964-21cut09:30:020
223709940,3cyclictest24004-21python07:10:210
223709940,3cyclictest15739-21rm12:22:160
223709940,3cyclictest0-21swapper/008:45:000
223709940,1cyclictest25107-21sed11:05:250
17319240,0sleep10-21swapper/112:23:191
223779933,0cyclictest0-21swapper/308:55:163
223779931,1cyclictest12702-21sh09:55:093
223779930,3cyclictest2364-21apt-config09:50:013
223779930,3cyclictest23412-21apt08:15:133
223779930,3cyclictest22894-21sh11:05:013
223779930,3cyclictest0-21swapper/311:25:133
223779930,3cyclictest0-21swapper/308:50:113
223779930,3cyclictest0-21swapper/308:40:073
223779930,3cyclictest0-21swapper/308:35:123
223779930,3cyclictest0-21swapper/308:30:143
223779930,3cyclictest0-21swapper/308:20:123
223779930,3cyclictest0-21swapper/307:55:123
223779930,3cyclictest0-21swapper/307:45:023
223779930,3cyclictest0-21swapper/307:30:133
223779930,3cyclictest0-21swapper/307:25:063
223779930,3cyclictest0-21swapper/307:15:013
223739932,1cyclictest714-21snmpd11:35:012
223739932,1cyclictest714-21snmpd09:00:042
223739932,1cyclictest4683-21ntp_states07:35:192
223739932,1cyclictest16316-21grep08:00:152
223739931,1cyclictest0-21swapper/207:30:142
223739930,3cyclictest25675-21perl07:15:032
223739930,3cyclictest0-21swapper/211:55:142
223739930,3cyclictest0-21swapper/210:30:132
223739930,3cyclictest0-21swapper/210:00:132
223739930,3cyclictest0-21swapper/208:50:112
223739930,3cyclictest0-21swapper/208:30:072
223739930,3cyclictest0-21swapper/208:20:132
223739930,3cyclictest0-21swapper/208:05:112
223739930,3cyclictest0-21swapper/207:55:132
223739930,3cyclictest0-21swapper/207:45:122
223739930,3cyclictest0-21swapper/207:40:132
223739930,3cyclictest0-21swapper/207:10:122
223719933,0cyclictest0-21swapper/111:46:131
223719933,0cyclictest0-21swapper/111:26:531
223719931,2cyclictest0-21swapper/109:50:141
223719931,2cyclictest0-21swapper/108:15:141
223719931,1cyclictest0-21swapper/112:35:131
223719931,1cyclictest0-21swapper/111:55:141
223719931,1cyclictest0-21swapper/111:40:131
223719931,1cyclictest0-21swapper/111:15:131
223719931,1cyclictest0-21swapper/110:50:131
223719931,1cyclictest0-21swapper/110:45:121
223719931,1cyclictest0-21swapper/110:20:131
223719931,1cyclictest0-21swapper/110:05:141
223719931,1cyclictest0-21swapper/109:20:041
223719931,1cyclictest0-21swapper/109:15:031
223719931,1cyclictest0-21swapper/108:45:011
223719931,1cyclictest0-21swapper/108:40:151
223719931,1cyclictest0-21swapper/108:35:111
223719931,1cyclictest0-21swapper/108:10:111
223719931,1cyclictest0-21swapper/107:40:111
223719931,1cyclictest0-21swapper/107:15:131
223719930,3cyclictest0-21swapper/110:55:531
223719930,2cyclictest0-21swapper/112:00:121
223719930,2cyclictest0-21swapper/110:25:151
223719930,2cyclictest0-21swapper/109:05:131
223719930,2cyclictest0-21swapper/109:00:141
223719930,0cyclictest0-21swapper/111:36:121
223709932,1cyclictest714-21snmpd08:05:100
223709932,1cyclictest3-21ksoftirqd/010:45:120
223709931,1cyclictest25910-21apt-get08:20:120
223709931,1cyclictest0-21swapper/007:55:130
223709931,1cyclictest0-21swapper/007:40:130
223709930,3cyclictest9047-21df08:50:130
223709930,3cyclictest6568-21grep10:40:160
223709930,3cyclictest31500-21tune2fs08:30:170
223709930,3cyclictest25397-21diskstats07:15:030
223709930,3cyclictest18202-21diskmemload12:05:100
223709930,3cyclictest15998-21apt08:00:150
223709930,3cyclictest1250-21cut07:30:160
223709930,3cyclictest0-21swapper/011:25:070
223709930,3cyclictest0-21swapper/011:15:140
223709930,3cyclictest0-21swapper/010:10:130
223709930,3cyclictest0-21swapper/009:40:140
223709930,3cyclictest0-21swapper/009:20:040
223709930,3cyclictest0-21swapper/008:15:130
223709930,3cyclictest0-21swapper/007:50:020
223709930,3cyclictest0-21swapper/007:25:130
223709930,2cyclictest18202-21diskmemload10:00:020
223709930,2cyclictest0-21swapper/008:40:140
223719921,1cyclictest0-21swapper/109:55:131
223719921,1cyclictest0-21swapper/107:35:141
223719921,1cyclictest0-21swapper/107:25:141
223719920,1cyclictest12995-21chrt12:05:011
223719920,1cyclictest11814-21chrt10:42:541
223719920,1cyclictest0-21swapper/112:25:011
223719920,1cyclictest0-21swapper/112:25:011
223719920,1cyclictest0-21swapper/111:05:161
223719920,1cyclictest0-21swapper/108:25:121
223719920,1cyclictest0-21swapper/107:30:151
223719910,1cyclictest0-21swapper/108:00:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional