You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 20:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot2.osadl.org (updated Sun Nov 30, 2025 12:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
208312205190,10sleep10-21swapper/107:08:271
209242190174,11sleep30-21swapper/307:09:393
208152189171,13sleep00-21swapper/007:08:150
209182179162,12sleep20-21swapper/207:09:332
207512450,0sleep00-21swapper/009:43:560
195912430,0sleep10-21swapper/109:59:421
119592420,0sleep30-21swapper/311:15:593
188442130,0sleep30-21swapper/311:52:183
2113799101,7cyclictest0-21swapper/210:35:142
14052100,0sleep10-21swapper/111:43:471
211349982,3cyclictest20130-21awk10:00:020
211349980,4cyclictest31903-21awk08:35:010
211349973,4cyclictest13200-21cron11:50:010
211349971,3cyclictest7763-21basename10:10:000
211349970,3cyclictest15868-21munin-run11:35:010
211419960,6cyclictest0-21swapper/311:00:113
211419960,5cyclictest0-21swapper/312:25:013
211359961,3cyclictest0-21swapper/110:45:131
211359961,3cyclictest0-21swapper/109:35:121
211349960,3cyclictest799-21awk10:55:010
211349960,3cyclictest598-21sendmail-msp12:00:000
211419955,0cyclictest40-21ksoftirqd/309:05:023
211419955,0cyclictest40-21ksoftirqd/308:45:013
211419955,0cyclictest21381-21kworker/3:209:44:433
211419955,0cyclictest21381-21kworker/3:209:33:323
211419955,0cyclictest16942-21kworker/3:009:11:073
211419955,0cyclictest16942-21kworker/3:007:52:453
211419955,0cyclictest0-21swapper/310:49:563
211419954,1cyclictest40-21ksoftirqd/312:25:003
211419950,5cyclictest0-21swapper/312:39:213
211419950,4cyclictest26424-21apt-get11:40:153
211419950,3cyclictest0-21swapper/309:46:503
211379952,3cyclictest1165-21ssh10:55:062
211379952,2cyclictest28594-21ssh10:20:152
211379950,5cyclictest0-21swapper/212:35:132
211379950,5cyclictest0-21swapper/210:30:502
211379950,5cyclictest0-21swapper/210:09:182
211379950,5cyclictest0-21swapper/209:23:192
211379950,5cyclictest0-21swapper/209:17:212
211379950,4cyclictest0-21swapper/208:35:122
211359951,3cyclictest0-21swapper/112:00:141
211359951,2cyclictest0-21swapper/111:35:131
211359951,2cyclictest0-21swapper/107:50:131
211359951,2cyclictest0-21swapper/107:40:151
211359951,2cyclictest0-21swapper/107:15:131
211359950,5cyclictest0-21swapper/112:32:181
211359950,5cyclictest0-21swapper/110:25:331
211349950,5cyclictest0-21swapper/012:00:280
211349950,5cyclictest0-21swapper/010:59:030
211349950,5cyclictest0-21swapper/008:55:140
211349950,0cyclictest0-21swapper/011:05:020
211349950,0cyclictest0-21swapper/009:17:130
10844250,0sleep00-21swapper/007:50:170
26920240,0sleep10-21swapper/111:56:081
211419944,0cyclictest5380-21kworker/3:112:32:393
211419944,0cyclictest40-21ksoftirqd/310:05:023
211419944,0cyclictest21381-21kworker/3:210:40:443
211419944,0cyclictest21381-21kworker/3:209:55:563
211419944,0cyclictest0-21swapper/312:08:303
211419944,0cyclictest0-21swapper/310:18:483
211419944,0cyclictest0-21swapper/310:11:213
211419943,1cyclictest40-21ksoftirqd/307:20:163
211419943,1cyclictest27871-21grep09:15:163
211419943,1cyclictest19738-21/usr/sbin/munin08:10:203
211419941,3cyclictest714-21snmpd09:08:463
211419940,4cyclictest28865-21/usr/sbin/munin11:25:203
211419940,4cyclictest1965-21/usr/sbin/munin07:35:203
211419940,4cyclictest15212-21ssh11:34:363
211419940,4cyclictest0-21swapper/312:12:153
211419940,4cyclictest0-21swapper/311:55:133
211419940,4cyclictest0-21swapper/311:20:143
211419940,4cyclictest0-21swapper/310:36:483
211419940,4cyclictest0-21swapper/310:27:343
211419940,4cyclictest0-21swapper/308:26:443
211419940,4cyclictest0-21swapper/308:08:423
211419940,4cyclictest0-21swapper/307:30:113
211419940,3cyclictest6987-21apt-config07:45:013
211419940,3cyclictest4539-21ssh09:51:323
211419940,3cyclictest3581-21sh11:45:023
211419940,3cyclictest3327-21sh12:00:263
211419940,3cyclictest28516-21sh10:20:123
211419940,3cyclictest24682-21cut08:20:013
211419940,3cyclictest2408-21irqstats10:55:173
211419940,3cyclictest16009-21perl09:25:153
211419940,3cyclictest15083-21diskstats08:00:143
211419940,3cyclictest0-21swapper/311:35:133
211419940,3cyclictest0-21swapper/308:35:013
211419940,1cyclictest31359-21/usr/sbin/munin11:10:183
211379944,0cyclictest0-21swapper/212:12:592
211379944,0cyclictest0-21swapper/211:32:322
211379944,0cyclictest0-21swapper/210:50:032
211379943,1cyclictest19813-21cut11:20:162
211379940,4cyclictest5503-21ssh12:01:492
211379940,4cyclictest27971-21ssh11:56:482
211379940,4cyclictest0-21swapper/212:30:102
211379940,4cyclictest0-21swapper/212:25:122
211379940,4cyclictest0-21swapper/212:06:362
211379940,4cyclictest0-21swapper/211:43:212
211379940,4cyclictest0-21swapper/211:16:262
211379940,4cyclictest0-21swapper/211:10:122
211379940,4cyclictest0-21swapper/211:05:012
211379940,4cyclictest0-21swapper/210:45:132
211379940,4cyclictest0-21swapper/210:41:092
211379940,4cyclictest0-21swapper/210:25:132
211379940,4cyclictest0-21swapper/210:15:112
211379940,4cyclictest0-21swapper/209:48:582
211379940,4cyclictest0-21swapper/209:35:032
211379940,4cyclictest0-21swapper/208:10:012
211379940,3cyclictest31271-21ssh09:32:472
211379940,3cyclictest29400-21sed07:25:012
211379940,3cyclictest20958-21sed11:05:012
211379940,3cyclictest19975-21ssh09:10:372
211379940,3cyclictest17756-21latency_hist10:15:002
211379940,3cyclictest17747-21date12:25:012
211379940,0cyclictest0-21swapper/209:41:572
211359944,0cyclictest0-21swapper/111:34:151
211359944,0cyclictest0-21swapper/109:51:221
211359941,2cyclictest0-21swapper/112:25:131
211359941,2cyclictest0-21swapper/112:20:121
211359941,2cyclictest0-21swapper/112:05:131
211359941,2cyclictest0-21swapper/111:45:121
211359941,2cyclictest0-21swapper/111:25:131
211359941,2cyclictest0-21swapper/111:15:121
211359941,2cyclictest0-21swapper/111:05:131
211359941,2cyclictest0-21swapper/110:50:131
211359941,2cyclictest0-21swapper/110:00:141
211359941,2cyclictest0-21swapper/108:30:121
211359941,2cyclictest0-21swapper/108:05:121
211359941,2cyclictest0-21swapper/108:00:131
211359941,2cyclictest0-21swapper/107:35:141
211359941,2cyclictest0-21swapper/107:25:131
211359941,1cyclictest0-21swapper/109:30:111
211359940,4cyclictest0-21swapper/110:41:081
211359940,4cyclictest0-21swapper/110:19:361
211359940,4cyclictest0-21swapper/110:06:131
211359940,4cyclictest0-21swapper/107:49:251
211359940,3cyclictest0-21swapper/109:45:131
211359940,0cyclictest0-21swapper/109:43:141
211349944,0cyclictest0-21swapper/012:29:520
211349944,0cyclictest0-21swapper/010:30:060
211349944,0cyclictest0-21swapper/009:23:110
211349943,1cyclictest27343-21ssh11:40:170
211349942,1cyclictest7969-21ssh10:10:010
211349942,1cyclictest0-21swapper/007:45:010
211349941,1cyclictest0-21swapper/007:55:120
211349940,4cyclictest15179-21ntpq10:45:200
211349940,4cyclictest12878-21cut11:00:210
211349940,4cyclictest0-21swapper/012:35:130
211349940,4cyclictest0-21swapper/012:30:240
211349940,4cyclictest0-21swapper/012:10:130
211349940,4cyclictest0-21swapper/012:08:190
211349940,4cyclictest0-21swapper/011:25:120
211349940,4cyclictest0-21swapper/011:15:130
211349940,4cyclictest0-21swapper/010:25:130
211349940,4cyclictest0-21swapper/010:00:130
211349940,4cyclictest0-21swapper/009:39:060
211349940,4cyclictest0-21swapper/009:25:130
211349940,4cyclictest0-21swapper/009:10:120
211349940,4cyclictest0-21swapper/008:50:130
211349940,4cyclictest0-21swapper/008:20:130
211349940,4cyclictest0-21swapper/008:06:410
211349940,3cyclictest25998-21ssh09:30:130
211349940,3cyclictest1369-21perl09:50:150
211349940,1cyclictest7094-21turbostat08:50:000
211349940,1cyclictest23477-21latency_hist07:15:010
211419932,1cyclictest23855-21uniq07:15:013
211419931,1cyclictest0-21swapper/308:50:123
211419930,3cyclictest5209-21dpkg09:20:113
211419930,3cyclictest24230-21expr10:50:153
211419930,3cyclictest17233-21awk10:30:173
211419930,3cyclictest0-21swapper/312:15:023
211419930,3cyclictest0-21swapper/310:05:023
211419930,3cyclictest0-21swapper/309:35:113
211419930,3cyclictest0-21swapper/308:55:153
211419930,3cyclictest0-21swapper/308:45:003
211419930,3cyclictest0-21swapper/308:35:123
211419930,3cyclictest0-21swapper/307:55:123
211419930,3cyclictest0-21swapper/307:40:123
211419930,3cyclictest0-21swapper/307:25:123
211419930,3cyclictest0-21swapper/307:10:123
211419930,1cyclictest26524-21unixbench_singl08:20:203
211419930,1cyclictest21079-21ssh11:05:013
211379933,0cyclictest0-21swapper/208:15:132
211379932,1cyclictest3448-21ntp_kernel_pll_08:40:192
211379931,2cyclictest30504-21ssh12:15:022
211379930,3cyclictest29651-21apt-get08:30:112
211379930,3cyclictest15082-21diskstats08:00:132
211379930,3cyclictest14105-21grep09:00:202
211379930,3cyclictest13330-21ntp_states07:55:182
211379930,3cyclictest0-21swapper/211:45:122
211379930,3cyclictest0-21swapper/211:35:012
211379930,3cyclictest0-21swapper/211:25:402
211379930,3cyclictest0-21swapper/210:00:022
211379930,3cyclictest0-21swapper/209:55:032
211379930,3cyclictest0-21swapper/209:50:112
211379930,3cyclictest0-21swapper/209:25:122
211379930,3cyclictest0-21swapper/209:05:172
211379930,3cyclictest0-21swapper/208:55:122
211379930,3cyclictest0-21swapper/208:50:022
211379930,3cyclictest0-21swapper/208:45:122
211379930,3cyclictest0-21swapper/208:25:072
211379930,3cyclictest0-21swapper/208:20:122
211379930,3cyclictest0-21swapper/208:05:122
211379930,3cyclictest0-21swapper/207:50:132
211379930,3cyclictest0-21swapper/207:45:122
211379930,3cyclictest0-21swapper/207:40:132
211379930,3cyclictest0-21swapper/207:35:132
211379930,3cyclictest0-21swapper/207:30:122
211379930,3cyclictest0-21swapper/207:25:132
211379930,3cyclictest0-21swapper/207:15:142
211379930,3cyclictest0-21swapper/207:10:122
211379930,2cyclictest13431-21ssh11:50:012
211359933,0cyclictest0-21swapper/111:24:291
211359931,2cyclictest0-21swapper/110:35:141
211359931,1cyclictest0-21swapper/111:50:111
211359931,1cyclictest0-21swapper/110:55:131
211359931,1cyclictest0-21swapper/110:10:131
211359931,1cyclictest0-21swapper/109:15:151
211359931,1cyclictest0-21swapper/108:50:121
211359931,1cyclictest0-21swapper/108:45:011
211359931,1cyclictest0-21swapper/108:25:131
211359931,1cyclictest0-21swapper/108:15:131
211359931,1cyclictest0-21swapper/108:10:001
211359931,1cyclictest0-21swapper/107:55:131
211359931,1cyclictest0-21swapper/107:30:121
211359931,1cyclictest0-21swapper/107:20:171
211359931,1cyclictest0-21swapper/107:10:111
211359930,2cyclictest0-21swapper/112:35:121
211359930,2cyclictest0-21swapper/112:15:131
211359930,2cyclictest0-21swapper/112:10:121
211359930,2cyclictest0-21swapper/111:10:131
211359930,2cyclictest0-21swapper/111:00:121
211359930,2cyclictest0-21swapper/110:20:001
211359930,2cyclictest0-21swapper/109:05:131
211359930,2cyclictest0-21swapper/108:55:121
211359930,2cyclictest0-21swapper/108:35:111
211359930,1cyclictest0-21swapper/110:30:141
211359930,1cyclictest0-21swapper/109:20:111
211359930,1cyclictest0-21swapper/108:20:121
211349931,1cyclictest714-21snmpd08:40:090
211349931,1cyclictest19604-21apt-config08:10:010
211349931,1cyclictest0-21swapper/011:10:130
211349931,1cyclictest0-21swapper/009:45:130
211349931,1cyclictest0-21swapper/007:30:110
211349930,3cyclictest8806-21diskstats12:20:120
211349930,3cyclictest4494-21basename07:40:150
211349930,3cyclictest29443-21apt07:25:120
211349930,3cyclictest27184-21apt-get08:25:130
211349930,3cyclictest24083-21ntpq07:15:010
211349930,3cyclictest18819-21sh11:20:090
211349930,3cyclictest0-21swapper/012:15:120
211349930,3cyclictest0-21swapper/011:50:050
211349930,3cyclictest0-21swapper/011:35:130
211349930,3cyclictest0-21swapper/010:40:120
211349930,3cyclictest0-21swapper/010:35:120
211349930,3cyclictest0-21swapper/010:20:010
211349930,3cyclictest0-21swapper/010:15:140
211349930,3cyclictest0-21swapper/009:05:120
211349930,3cyclictest0-21swapper/009:00:120
211349930,3cyclictest0-21swapper/008:35:020
211349930,3cyclictest0-21swapper/008:15:130
211349930,3cyclictest0-21swapper/008:00:120
211349930,3cyclictest0-21swapper/007:35:140
211349930,3cyclictest0-21swapper/007:20:160
211359921,1cyclictest0-21swapper/109:10:131
211359920,1cyclictest0-21swapper/109:25:111
211359920,1cyclictest0-21swapper/109:00:111
211359920,1cyclictest0-21swapper/108:40:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional