You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-07 - 10:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Fri Aug 07, 2026 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
294602198182,11sleep10-21swapper/119:09:031
292502192175,12sleep30-21swapper/319:06:253
292572191175,12sleep00-21swapper/019:06:310
291822159142,12sleep20-21swapper/219:05:312
42692460,1sleep20-21swapper/221:31:122
278842440,0sleep10-21swapper/123:04:591
170482440,0sleep00-21swapper/023:48:060
229542400,0sleep20-21swapper/222:30:012
263592130,0sleep20-21swapper/222:47:222
2969499110,1cyclictest7064-21ssh21:16:262
2969499110,0cyclictest0-21swapper/223:47:302
276832110,0sleep20-21swapper/221:59:542
66492100,0sleep10-21swapper/123:26:091
2969499102,8cyclictest15699-21apt-get19:45:112
2969499100,1cyclictest14519-21ssh22:57:482
2969499100,1cyclictest1325-21ssh21:45:472
2969499100,1cyclictest0-21swapper/222:42:592
2969499100,1cyclictest0-21swapper/221:51:532
2969499100,0cyclictest28047-21ssh21:10:262
296949990,1cyclictest5650-21ssh22:20:272
296949990,1cyclictest30913-21memory19:10:162
296949990,1cyclictest30500-21basename21:45:022
296949990,1cyclictest27376-21ssh21:26:392
296949990,1cyclictest21631-21ssh21:24:202
296949990,1cyclictest18181-21ssh23:32:122
296949990,1cyclictest1708-21ssh00:29:462
296949990,1cyclictest11329-21ssh00:34:372
296999981,6cyclictest0-21swapper/322:30:123
296949981,7cyclictest31122-21ssh22:50:132
296949981,4cyclictest16685-21ssh00:04:272
296949980,6cyclictest31376-21ssh22:17:312
296949980,1cyclictest5970-21ssh23:25:432
296949980,1cyclictest27937-21ssh23:53:352
296949980,1cyclictest26513-21ssh22:30:582
296949980,1cyclictest22964-21ssh00:07:082
296949980,1cyclictest19018-21ssh00:21:262
296949980,1cyclictest15476-21ls19:45:012
296949980,1cyclictest14033-21ssh21:35:562
296949980,1cyclictest12588-21ssh22:08:162
296949980,1cyclictest10463-21munin-run22:40:012
296949980,0cyclictest28021-21ssh23:20:242
296949980,0cyclictest26738-21ssh23:36:202
296949980,0cyclictest25598-21apt-get20:05:122
296949980,0cyclictest25016-21ssh22:14:502
296949971,6cyclictest1711-21sh23:40:152
296949970,1cyclictest9468-21ntpq20:35:182
296949970,1cyclictest7842-21idleruntime-cro19:30:022
296949970,1cyclictest5381-21perf19:25:012
296949970,1cyclictest32646-21wc19:15:012
296949970,1cyclictest31803-21kernelversion23:55:172
296949970,1cyclictest29451-21ssh22:00:142
296949970,1cyclictest28904-21smartctl20:10:132
296949970,1cyclictest2858-21munin-run20:25:012
296949970,1cyclictest28463-21rm23:05:122
296949970,1cyclictest28087-21sort00:10:112
296949970,1cyclictest22864-21perf21:05:012
296949970,1cyclictest20165-21sshd19:52:072
296949970,1cyclictest19588-21systemctl20:55:172
296949970,1cyclictest18527-21ssh23:00:122
296949970,1cyclictest17961-21sed23:15:232
296949970,1cyclictest16178-21df_inode20:50:112
296949970,1cyclictest14286-21wc20:45:172
296949970,1cyclictest13312-21grep00:35:152
296949970,1cyclictest12783-21apt-get19:40:012
296949970,1cyclictest11965-21ntpq20:40:152
296949970,0cyclictest5980-21apt-get23:10:112
296949970,0cyclictest5399-21apt-get00:15:132
296949970,0cyclictest0-21swapper/221:05:182
296949970,0cyclictest0-21swapper/220:25:102
296859972,5cyclictest32242-21kworker/0:022:36:250
296859972,5cyclictest32242-21kworker/0:000:35:160
296859972,5cyclictest32242-21kworker/0:000:23:250
296949960,1cyclictest8107-21cut19:30:122
296949960,1cyclictest5968-21cut20:30:122
296949960,1cyclictest30842-21grep20:15:112
296949960,1cyclictest23117-21taskset20:00:052
296949960,1cyclictest20667-21cut19:55:132
296859962,4cyclictest32242-21kworker/0:023:22:210
296859962,4cyclictest32242-21kworker/0:022:52:130
296859962,4cyclictest32242-21kworker/0:022:29:170
296859962,4cyclictest32242-21kworker/0:022:21:090
296859962,4cyclictest32242-21kworker/0:021:15:090
296859962,4cyclictest32242-21kworker/0:019:25:130
296859962,4cyclictest32242-21kworker/0:000:29:290
296859962,4cyclictest32242-21kworker/0:000:07:570
296859962,4cyclictest2880-21ssh22:20:010
296859961,5cyclictest32242-21kworker/0:023:27:570
296859961,5cyclictest32242-21kworker/0:023:00:130
296859961,5cyclictest32242-21kworker/0:022:56:330
296859961,5cyclictest32242-21kworker/0:022:48:130
296859961,5cyclictest32242-21kworker/0:022:06:530
296859961,5cyclictest32242-21kworker/0:021:56:060
296859961,5cyclictest32242-21kworker/0:021:50:450
296859961,5cyclictest32242-21kworker/0:021:43:450
296859961,5cyclictest32242-21kworker/0:021:35:290
296859961,5cyclictest32242-21kworker/0:021:34:020
296859961,5cyclictest32242-21kworker/0:021:20:170
296859961,5cyclictest32242-21kworker/0:021:05:140
296859961,5cyclictest32242-21kworker/0:020:15:170
296859961,5cyclictest32242-21kworker/0:000:12:580
296859960,6cyclictest32242-21kworker/0:000:00:410
296859960,3cyclictest32750-21ssh21:30:010
296859960,3cyclictest25321-21basename23:20:010
296859960,3cyclictest11944-21munin-run00:35:000
296999955,0cyclictest0-21swapper/300:25:173
296999950,5cyclictest0-21swapper/321:45:233
296999950,5cyclictest0-21swapper/321:35:383
296999950,5cyclictest0-21swapper/319:20:203
296999950,1cyclictest786-21/usr/sbin/munin23:40:193
296899951,3cyclictest0-21swapper/120:45:121
296899950,5cyclictest0-21swapper/122:17:311
296899950,5cyclictest0-21swapper/122:14:531
296859952,3cyclictest32242-21kworker/0:022:34:010
296859952,3cyclictest32242-21kworker/0:021:45:010
296859952,3cyclictest32242-21kworker/0:019:45:100
296859951,4cyclictest32242-21kworker/0:023:57:010
296859951,4cyclictest32242-21kworker/0:023:50:450
296859951,4cyclictest32242-21kworker/0:023:41:290
296859951,4cyclictest32242-21kworker/0:023:37:490
296859951,4cyclictest32242-21kworker/0:023:30:330
296859951,4cyclictest32242-21kworker/0:023:10:570
296859951,4cyclictest32242-21kworker/0:023:05:490
296859951,4cyclictest32242-21kworker/0:022:40:450
296859951,4cyclictest32242-21kworker/0:022:11:130
296859951,4cyclictest32242-21kworker/0:022:02:050
296859951,4cyclictest32242-21kworker/0:020:25:170
296859950,5cyclictest32242-21kworker/0:020:50:170
296859950,5cyclictest32242-21kworker/0:020:40:130
296859950,5cyclictest32242-21kworker/0:019:55:210
296859950,5cyclictest32242-21kworker/0:000:16:250
296859950,4cyclictest13190-21apt-get20:45:120
8069240,0sleep30-21swapper/322:38:323
296999944,0cyclictest0-21swapper/320:00:013
296999944,0cyclictest0-21swapper/300:07:063
296999943,1cyclictest4624-21memory22:20:173
296999943,1cyclictest27910-21/usr/sbin/munin00:10:193
296999942,2cyclictest0-21swapper/300:32:283
296999942,1cyclictest819-21/usr/sbin/munin21:30:163
296999942,1cyclictest802-21snmpd20:10:103
296999942,1cyclictest7981-21cron20:35:003
296999941,1cyclictest0-21swapper/320:50:093
296999940,4cyclictest6436-21diskstats22:05:133
296999940,4cyclictest28348-21ssh21:43:413
296999940,4cyclictest26911-21irqstats22:15:163
296999940,4cyclictest13204-21sh23:13:373
296999940,4cyclictest0-21swapper/323:55:413
296999940,4cyclictest0-21swapper/323:35:103
296999940,4cyclictest0-21swapper/323:25:113
296999940,4cyclictest0-21swapper/323:18:123
296999940,4cyclictest0-21swapper/323:05:123
296999940,4cyclictest0-21swapper/323:01:033
296999940,4cyclictest0-21swapper/322:56:243
296999940,4cyclictest0-21swapper/322:45:123
296999940,4cyclictest0-21swapper/322:40:133
296999940,4cyclictest0-21swapper/321:55:073
296999940,4cyclictest0-21swapper/321:50:123
296999940,4cyclictest0-21swapper/321:14:013
296999940,4cyclictest0-21swapper/319:30:113
296999940,4cyclictest0-21swapper/319:15:133
296999940,4cyclictest0-21swapper/319:13:173
296999940,4cyclictest0-21swapper/300:35:123
296999940,4cyclictest0-21swapper/300:00:113
296999940,3cyclictest32747-21sh22:01:493
296999940,3cyclictest30166-21latency_hist23:55:003
296999940,3cyclictest28644-21sh21:27:273
296999940,3cyclictest25872-21apt-get23:20:143
296999940,3cyclictest25595-21/usr/sbin/munin20:05:143
296999940,3cyclictest17258-21ntp_states22:10:173
296999940,3cyclictest16219-21df19:45:143
296999940,3cyclictest14026-21hddtemp_smartct20:45:153
296999940,3cyclictest13563-21sort22:25:153
296999940,3cyclictest13107-21rm19:40:013
296999940,1cyclictest6611-21ssh00:15:193
296999940,1cyclictest4409-21sort21:15:153
296999940,1cyclictest18122-21/usr/sbin/munin20:55:193
296999940,0cyclictest0-21swapper/323:48:553
296899944,0cyclictest0-21swapper/123:42:281
296899944,0cyclictest0-21swapper/122:57:131
296899941,2cyclictest0-21swapper/123:50:011
296899941,2cyclictest0-21swapper/123:10:111
296899941,2cyclictest0-21swapper/122:50:131
296899941,2cyclictest0-21swapper/121:35:121
296899941,2cyclictest0-21swapper/121:20:171
296899941,2cyclictest0-21swapper/121:05:121
296899941,2cyclictest0-21swapper/119:30:111
296899941,1cyclictest0-21swapper/121:45:131
296899940,4cyclictest0-21swapper/122:45:171
296899940,4cyclictest0-21swapper/122:39:191
296859942,2cyclictest32242-21kworker/0:019:20:130
296859941,3cyclictest32242-21kworker/0:020:55:130
296859941,3cyclictest32242-21kworker/0:020:37:220
296859941,3cyclictest32242-21kworker/0:020:10:180
296859941,3cyclictest32242-21kworker/0:020:05:170
296859941,3cyclictest32242-21kworker/0:020:00:250
296859941,3cyclictest32242-21kworker/0:019:30:130
296859941,3cyclictest32242-21kworker/0:019:15:130
296859941,3cyclictest29315-21kworker/0:119:10:020
296859940,4cyclictest32242-21kworker/0:021:10:290
296859940,4cyclictest32242-21kworker/0:020:20:010
296859940,4cyclictest0-21swapper/019:35:110
296859940,2cyclictest0-21swapper/021:00:120
296859940,1cyclictest7994-21idleruntime-cro20:35:000
296859940,1cyclictest15475-21munin-run19:45:010
11722240,0sleep10-21swapper/122:24:201
296999932,1cyclictest802-21snmpd19:55:063
296999932,1cyclictest18595-21ls19:50:133
296999930,3cyclictest5758-21apt-get20:30:113
296999930,3cyclictest2258-21cat20:20:193
296999930,3cyclictest0-21swapper/323:30:103
296999930,3cyclictest0-21swapper/322:50:063
296999930,3cyclictest0-21swapper/321:20:093
296999930,3cyclictest0-21swapper/321:05:173
296999930,3cyclictest0-21swapper/321:00:043
296999930,3cyclictest0-21swapper/320:40:043
296999930,3cyclictest0-21swapper/320:15:113
296999930,3cyclictest0-21swapper/319:35:113
296999930,3cyclictest0-21swapper/319:25:053
296999930,3cyclictest0-21swapper/300:20:123
296999930,2cyclictest0-21swapper/320:25:003
296899933,0cyclictest0-21swapper/123:59:211
296899933,0cyclictest0-21swapper/123:45:491
296899933,0cyclictest0-21swapper/100:32:321
296899933,0cyclictest0-21swapper/100:22:551
296899932,1cyclictest0-21swapper/121:40:131
296899931,1cyclictest0-21swapper/123:30:101
296899931,1cyclictest0-21swapper/123:20:131
296899931,1cyclictest0-21swapper/123:05:121
296899931,1cyclictest0-21swapper/122:40:141
296899931,1cyclictest0-21swapper/122:25:131
296899931,1cyclictest0-21swapper/121:50:131
296899931,1cyclictest0-21swapper/121:30:121
296899931,1cyclictest0-21swapper/121:25:131
296899931,1cyclictest0-21swapper/121:10:121
296899931,1cyclictest0-21swapper/120:50:091
296899931,1cyclictest0-21swapper/120:05:121
296899931,1cyclictest0-21swapper/119:20:121
296899931,1cyclictest0-21swapper/119:10:111
296899931,1cyclictest0-21swapper/100:35:121
296899931,1cyclictest0-21swapper/100:00:121
296899931,0cyclictest0-21swapper/120:10:111
296899930,3cyclictest0-21swapper/120:55:521
296899930,3cyclictest0-21swapper/120:36:131
296899930,3cyclictest0-21swapper/119:39:121
296899930,2cyclictest318-21chrt00:28:541
296899930,2cyclictest0-21swapper/123:40:011
296899930,2cyclictest0-21swapper/122:30:121
296899930,2cyclictest0-21swapper/121:15:101
296899930,2cyclictest0-21swapper/120:20:101
296859930,2cyclictest0-21swapper/019:50:110
296899922,0cyclictest0-21swapper/120:40:091
296899921,1cyclictest75552chrt19:26:361
296899921,1cyclictest0-21swapper/122:05:111
296899921,1cyclictest0-21swapper/121:00:111
296899921,1cyclictest0-21swapper/120:25:011
296899921,1cyclictest0-21swapper/119:45:111
296899921,1cyclictest0-21swapper/100:15:131
296899921,1cyclictest0-21swapper/100:05:111
296899921,0cyclictest0-21swapper/120:00:131
296899921,0cyclictest0-21swapper/119:50:111
296899920,1cyclictest57532sleep120:30:091
296899920,1cyclictest13217-21chrt19:40:011
296899920,1cyclictest0-21swapper/123:15:141
296899920,1cyclictest0-21swapper/122:00:101
296899920,1cyclictest0-21swapper/121:55:051
296899920,1cyclictest0-21swapper/120:15:101
296899920,1cyclictest0-21swapper/119:55:121
296899920,1cyclictest0-21swapper/119:15:011
296899920,1cyclictest0-21swapper/100:10:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional