You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-26 - 20:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Tue May 26, 2026 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
312162196179,12sleep00-21swapper/007:07:060
314282193164,23sleep10-21swapper/107:09:481
311842192176,12sleep30-21swapper/307:06:403
311112174158,12sleep20-21swapper/207:05:442
155622470,0sleep10-21swapper/110:22:401
59382440,0sleep25940-21gltestperf08:25:142
31282430,0sleep00-21swapper/011:35:370
276772410,0sleep30-21swapper/311:00:163
42982320,1sleep23162999cyclictest09:14:232
3162099104,2cyclictest3-21ksoftirqd/008:09:590
316209994,0cyclictest3-21ksoftirqd/009:10:120
316209992,1cyclictest3-21ksoftirqd/011:20:130
22362290,0sleep30-21swapper/310:41:393
316209986,1cyclictest3-21ksoftirqd/012:20:150
316209984,1cyclictest3-21ksoftirqd/010:15:160
316209982,1cyclictest3-21ksoftirqd/012:35:130
316209981,1cyclictest3-21ksoftirqd/010:55:140
21440280,0sleep20-21swapper/210:10:042
316209975,0cyclictest3-21ksoftirqd/011:25:160
316209975,0cyclictest3-21ksoftirqd/009:25:010
316209974,1cyclictest3-21ksoftirqd/012:10:170
316209973,2cyclictest3-21ksoftirqd/010:30:140
316209973,2cyclictest3-21ksoftirqd/010:30:130
316209972,1cyclictest3-21ksoftirqd/012:30:140
316209972,0cyclictest81rcu_preempt11:05:180
316209971,1cyclictest3-21ksoftirqd/011:50:210
316209971,1cyclictest3-21ksoftirqd/009:40:000
17416270,0sleep10-21swapper/111:43:111
316359960,5cyclictest20215-21apt-get08:55:013
316359960,5cyclictest0-21swapper/310:05:113
316259961,3cyclictest0-21swapper/111:30:111
316209964,0cyclictest3-21ksoftirqd/012:00:140
316209964,0cyclictest3-21ksoftirqd/011:30:150
316209964,0cyclictest3-21ksoftirqd/011:15:200
316209964,0cyclictest3-21ksoftirqd/010:50:180
316209964,0cyclictest3-21ksoftirqd/010:40:120
316209964,0cyclictest3-21ksoftirqd/009:40:170
316209964,0cyclictest3-21ksoftirqd/009:30:120
316209964,0cyclictest3-21ksoftirqd/009:25:190
316209964,0cyclictest3-21ksoftirqd/008:30:000
316209964,0cyclictest3-21ksoftirqd/007:35:140
316209964,0cyclictest3-21ksoftirqd/007:25:140
316209963,1cyclictest3-21ksoftirqd/012:15:200
316209962,2cyclictest3-21ksoftirqd/007:30:140
316209962,1cyclictest3-21ksoftirqd/011:55:100
316209962,1cyclictest3-21ksoftirqd/007:15:170
316209962,0cyclictest81rcu_preempt12:05:190
316209961,2cyclictest3-21ksoftirqd/009:15:210
316209961,1cyclictest81rcu_preempt08:45:110
316209961,1cyclictest3-21ksoftirqd/010:00:160
316209961,1cyclictest3-21ksoftirqd/008:35:170
316209961,1cyclictest3-21ksoftirqd/008:30:190
316209961,1cyclictest3-21ksoftirqd/007:55:140
316209960,4cyclictest0-21swapper/010:20:110
316209960,1cyclictest81rcu_preempt09:50:110
316209960,1cyclictest3-21ksoftirqd/008:20:000
316209960,1cyclictest25188-21apt-get09:05:100
316209960,1cyclictest17562-21apt-get08:50:110
316209960,0cyclictest81rcu_preempt07:45:220
316359955,0cyclictest13565-21kworker/3:011:22:503
316359955,0cyclictest13565-21kworker/3:009:08:293
316359955,0cyclictest13565-21kworker/3:008:46:053
316359955,0cyclictest13565-21kworker/3:007:16:323
316359955,0cyclictest0-21swapper/311:51:503
316359950,5cyclictest25303-21diskstats12:35:133
316359950,5cyclictest0-21swapper/312:09:003
316359950,5cyclictest0-21swapper/311:57:213
316359950,5cyclictest0-21swapper/311:38:273
316359950,5cyclictest0-21swapper/311:15:123
316359950,5cyclictest0-21swapper/311:05:163
316359950,0cyclictest0-21swapper/311:25:213
316359950,0cyclictest0-21swapper/311:14:173
316299955,0cyclictest8219-21munin-run11:55:002
316299950,5cyclictest0-21swapper/210:24:362
316299950,5cyclictest0-21swapper/209:31:042
316299950,5cyclictest0-21swapper/209:28:532
316299950,0cyclictest0-21swapper/210:06:082
316259952,2cyclictest0-21swapper/107:30:111
316259951,2cyclictest0-21swapper/111:50:111
316259951,2cyclictest0-21swapper/111:45:101
316259951,2cyclictest0-21swapper/111:05:121
316259951,2cyclictest0-21swapper/111:00:131
316259951,2cyclictest0-21swapper/109:35:121
316259951,2cyclictest0-21swapper/109:25:111
316259951,2cyclictest0-21swapper/109:20:121
316259951,2cyclictest0-21swapper/107:25:111
316259950,5cyclictest0-21swapper/112:17:131
316259950,5cyclictest0-21swapper/108:30:141
316209954,0cyclictest3-21ksoftirqd/011:10:140
316209954,0cyclictest3-21ksoftirqd/010:10:130
316209954,0cyclictest3-21ksoftirqd/009:00:120
316209954,0cyclictest3-21ksoftirqd/008:10:130
316209953,1cyclictest3-21ksoftirqd/011:00:110
316209953,0cyclictest3-21ksoftirqd/010:05:170
316209953,0cyclictest3-21ksoftirqd/009:55:150
316209953,0cyclictest3-21ksoftirqd/008:00:210
316209953,0cyclictest3-21ksoftirqd/007:40:100
316209952,2cyclictest3-21ksoftirqd/012:25:140
316209952,1cyclictest3-21ksoftirqd/008:55:090
316209951,2cyclictest3-21ksoftirqd/010:45:180
316209951,2cyclictest3-21ksoftirqd/010:26:110
316209951,1cyclictest3-21ksoftirqd/011:41:170
316209951,1cyclictest2651-21apt-get09:45:110
316209950,1cyclictest3-21ksoftirqd/011:45:010
316209950,1cyclictest3-21ksoftirqd/008:41:190
316209950,1cyclictest3-21ksoftirqd/007:25:010
316209950,1cyclictest3-21ksoftirqd/007:10:160
316209950,1cyclictest3-21ksoftirqd/007:10:160
316209950,0cyclictest3849-21sort08:20:140
316209950,0cyclictest0-21swapper/010:35:180
316209950,0cyclictest0-21swapper/007:50:110
316359944,0cyclictest0-21swapper/309:56:093
316359941,3cyclictest802-21snmpd12:01:213
316359940,4cyclictest4475-21apt-get12:25:093
316359940,4cyclictest31500-21ssh09:43:073
316359940,4cyclictest28344-21apt-get10:45:123
316359940,4cyclictest27423-21diskmemload12:20:123
316359940,4cyclictest0-21swapper/312:15:113
316359940,4cyclictest0-21swapper/310:56:513
316359940,4cyclictest0-21swapper/310:36:333
316359940,4cyclictest0-21swapper/310:32:203
316359940,4cyclictest0-21swapper/310:32:193
316359940,4cyclictest0-21swapper/310:25:493
316359940,4cyclictest0-21swapper/310:17:023
316359940,4cyclictest0-21swapper/310:00:123
316359940,4cyclictest0-21swapper/309:54:473
316359940,4cyclictest0-21swapper/309:47:153
316359940,4cyclictest0-21swapper/309:36:583
316359940,4cyclictest0-21swapper/309:25:503
316359940,4cyclictest0-21swapper/309:20:123
316359940,4cyclictest0-21swapper/309:19:593
316359940,4cyclictest0-21swapper/309:12:403
316359940,4cyclictest0-21swapper/309:00:153
316359940,4cyclictest0-21swapper/308:30:113
316359940,4cyclictest0-21swapper/308:15:123
316359940,3cyclictest32475-21fw_packets07:10:133
316359940,3cyclictest32475-21fw_packets07:10:133
316359940,3cyclictest21984-21irqstats11:45:153
316359940,3cyclictest17405-21apt07:45:113
316359940,3cyclictest16374-21grep12:15:003
316359940,3cyclictest12332-21ps11:40:193
316359940,3cyclictest10052-21ssh10:51:293
316359940,1cyclictest8783-21/usr/sbin/munin07:25:183
316359940,1cyclictest23962-21irqstats11:30:143
316359940,0cyclictest0-21swapper/310:24:413
316299944,0cyclictest22087-21sh11:13:462
316299944,0cyclictest0-21swapper/212:36:082
316299944,0cyclictest0-21swapper/212:27:422
316299944,0cyclictest0-21swapper/212:01:222
316299944,0cyclictest0-21swapper/210:44:232
316299941,3cyclictest57150irq/125-eth011:55:112
316299941,3cyclictest219732chrt11:29:462
316299941,3cyclictest0-21swapper/210:32:382
316299941,3cyclictest0-21swapper/210:32:382
316299940,4cyclictest29861-21ssh11:33:222
316299940,4cyclictest23632-21sh12:18:202
316299940,4cyclictest18833-21ntp_states08:50:162
316299940,4cyclictest0-21swapper/212:31:552
316299940,4cyclictest0-21swapper/212:13:262
316299940,4cyclictest0-21swapper/211:24:182
316299940,4cyclictest0-21swapper/211:00:152
316299940,4cyclictest0-21swapper/210:55:102
316299940,4cyclictest0-21swapper/210:51:202
316299940,4cyclictest0-21swapper/209:50:112
316299940,4cyclictest0-21swapper/209:00:122
316299940,4cyclictest0-21swapper/207:35:212
316299940,3cyclictest9881-21/usr/sbin/munin10:35:222
316299940,3cyclictest3904-21sh11:36:062
316299940,3cyclictest27242-21sh11:47:592
316299940,3cyclictest10785-21ssh11:08:052
316299940,3cyclictest0-21swapper/209:35:122
316299940,1cyclictest7503-21/usr/sbin/munin07:25:132
316299940,1cyclictest30746-21switchtime12:05:212
316299940,1cyclictest2718-21/usr/sbin/munin08:20:152
316299940,1cyclictest2539-21/usr/sbin/munin07:15:172
316299940,1cyclictest2464-21ntp_states10:00:182
316299940,1cyclictest23614-21ntp_states07:55:172
316299940,1cyclictest15090-21/usr/sbin/munin08:45:162
316299940,1cyclictest11379-21diskstats11:40:132
316259944,0cyclictest0-21swapper/112:06:361
316259944,0cyclictest0-21swapper/110:33:201
316259944,0cyclictest0-21swapper/110:33:201
316259944,0cyclictest0-21swapper/110:12:491
316259941,2cyclictest0-21swapper/112:25:091
316259941,2cyclictest0-21swapper/112:20:111
316259941,2cyclictest0-21swapper/111:25:111
316259941,2cyclictest0-21swapper/111:20:001
316259941,2cyclictest0-21swapper/110:40:121
316259941,2cyclictest0-21swapper/110:15:101
316259941,2cyclictest0-21swapper/109:45:111
316259941,2cyclictest0-21swapper/109:15:131
316259941,2cyclictest0-21swapper/108:50:111
316259941,2cyclictest0-21swapper/108:25:111
316259941,2cyclictest0-21swapper/108:20:091
316259941,2cyclictest0-21swapper/108:15:111
316259941,2cyclictest0-21swapper/108:10:131
316259941,2cyclictest0-21swapper/108:05:011
316259941,2cyclictest0-21swapper/107:45:131
316259941,1cyclictest0-21swapper/110:25:091
316259941,1cyclictest0-21swapper/107:35:121
316259941,1cyclictest0-21swapper/107:10:111
316259941,1cyclictest0-21swapper/107:10:111
316259940,4cyclictest0-21swapper/111:59:461
316259940,3cyclictest0-21swapper/110:50:111
316259940,2cyclictest0-21swapper/110:55:101
316259940,0cyclictest0-21swapper/109:53:191
316359932,1cyclictest21306-21ssh10:10:003
316359931,1cyclictest0-21swapper/308:40:103
316359931,1cyclictest0-21swapper/308:25:123
316359930,3cyclictest27423-21diskmemload12:30:003
316359930,3cyclictest19857-21taskset07:50:003
316359930,3cyclictest10663-21diskstats08:35:143
316359930,3cyclictest0-21swapper/309:30:063
316359930,3cyclictest0-21swapper/308:50:113
316359930,3cyclictest0-21swapper/308:20:093
316359930,3cyclictest0-21swapper/308:10:123
316359930,3cyclictest0-21swapper/308:05:013
316359930,3cyclictest0-21swapper/308:00:113
316359930,3cyclictest0-21swapper/307:55:093
316359930,3cyclictest0-21swapper/307:40:093
316359930,3cyclictest0-21swapper/307:35:123
316359930,3cyclictest0-21swapper/307:30:123
316359930,3cyclictest0-21swapper/307:20:123
316299932,1cyclictest25799-21memory11:15:172
316299932,1cyclictest24869-21ssh09:40:122
316299932,1cyclictest19862-21taskset07:50:032
316299931,2cyclictest57150irq/125-eth009:55:022
316299931,1cyclictest0-21swapper/209:20:122
316299930,3cyclictest7659-21munin-node08:30:102
316299930,3cyclictest30819-21hostname08:10:162
316299930,3cyclictest28344-21apt-get10:45:112
316299930,3cyclictest27067-21apt-get08:05:012
316299930,3cyclictest25355-21df_inode08:00:132
316299930,3cyclictest2458-21sh09:45:022
316299930,3cyclictest19801-21apt-get08:55:012
316299930,3cyclictest17926-21df07:45:142
316299930,3cyclictest0-21swapper/212:20:072
316299930,3cyclictest0-21swapper/210:25:102
316299930,3cyclictest0-21swapper/209:15:132
316299930,3cyclictest0-21swapper/209:05:112
316299930,3cyclictest0-21swapper/208:40:112
316299930,3cyclictest0-21swapper/208:35:122
316299930,3cyclictest0-21swapper/208:15:112
316299930,3cyclictest0-21swapper/207:20:112
316299930,3cyclictest0-21swapper/207:10:112
316299930,3cyclictest0-21swapper/207:10:112
316299930,2cyclictest10496-21/usr/sbin/munin07:30:132
316299930,1cyclictest31973-21wget10:15:102
316299930,1cyclictest0-21swapper/207:40:112
316259933,0cyclictest0-21swapper/111:36:291
316259931,2cyclictest0-21swapper/112:30:111
316259931,2cyclictest0-21swapper/111:15:121
316259931,1cyclictest0-21swapper/112:00:121
316259931,1cyclictest0-21swapper/111:10:111
316259931,1cyclictest0-21swapper/110:35:131
316259931,1cyclictest0-21swapper/108:45:111
316259931,1cyclictest0-21swapper/108:00:101
316259930,3cyclictest0-21swapper/109:08:391
316259930,3cyclictest0-21swapper/108:35:371
316259930,2cyclictest0-21swapper/112:35:111
316259930,2cyclictest0-21swapper/112:10:121
316259930,2cyclictest0-21swapper/110:05:121
316259930,2cyclictest0-21swapper/110:00:121
316259930,2cyclictest0-21swapper/109:40:111
316259930,2cyclictest0-21swapper/109:00:121
316259930,2cyclictest0-21swapper/108:55:001
316259930,2cyclictest0-21swapper/107:55:111
316259930,2cyclictest0-21swapper/107:50:111
316259930,2cyclictest0-21swapper/107:40:101
316259930,2cyclictest0-21swapper/107:15:111
316259930,1cyclictest0-21swapper/109:30:121
316259921,1cyclictest0-21swapper/110:45:111
316259921,1cyclictest0-21swapper/109:55:111
316259920,1cyclictest14625-21chrt08:42:141
316259920,1cyclictest0-21swapper/109:10:121
316259920,1cyclictest0-21swapper/107:20:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional