You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-10 - 14:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Wed Jun 10, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1676424737,0sleep30-21swapper/306:49:523
1686824233,0sleep10-21swapper/106:51:061
1679423424,0sleep20-21swapper/206:50:152
1679723321,0sleep00-21swapper/006:50:170
171119976,0cyclictest0-21swapper/011:37:280
171119970,0cyclictest14732-21awk12:13:150
35160,0ktimersoftd/30-21swapper/309:17:073
339960,0migration/36165-21sh11:05:123
339960,0migration/36128-21sh10:04:013
339960,0migration/332559-21fschecks_time10:43:183
339960,0migration/331791-21sh09:42:223
29715060,0irq/26-eth0-rx-31638-21ls10:43:053
29715060,0irq/26-eth0-rx-17096-21iostat_ios09:53:193
29715060,0irq/26-eth0-rx-0-21swapper/311:08:273
171119964,0cyclictest31817-21taskset10:02:520
171119960,0cyclictest0-21swapper/010:56:100
35150,0ktimersoftd/30-21swapper/310:34:513
339950,0migration/39857-21if_eth1.208:48:193
339950,0migration/38999-21kthreadcore10:48:213
339950,0migration/38822-21fschecks_time09:28:183
339950,0migration/38309-21kthreadcore11:48:233
339950,0migration/3703-21gltestperf09:23:183
339950,0migration/36463-21latency_hist12:08:053
339950,0migration/34701-21kthreadcore09:03:223
339950,0migration/332244-21munin-node11:43:203
339950,0migration/329650-21sh09:18:223
339950,0migration/329448-21taskset11:59:403
339950,0migration/329383-21taskset08:58:273
339950,0migration/328571-21kthreadcore11:18:223
339950,0migration/325906-21kthreadcore11:38:233
339950,0migration/322563-21runrttasks12:18:093
339950,0migration/320865-21kthreadcore07:43:223
339950,0migration/320423-21kthreadcore07:18:213
339950,0migration/319565-21kthreadcore08:28:233
339950,0migration/317460-21aten_r1power_vo06:53:163
339950,0migration/315816-21munin-node11:53:203
339950,0migration/31508-21kthreadcore12:03:203
29725050,0irq/27-eth0-tx-5527-21open_inodes09:43:252
29725050,0irq/27-eth0-tx-4927-21load10:43:232
29725050,0irq/27-eth0-tx-31520-21munin-node11:23:242
29725050,0irq/27-eth0-tx-23968-21munin-node06:58:210
29715050,0irq/26-eth0-rx-7738-21ssh09:08:113
29715050,0irq/26-eth0-rx-30698-21ssh11:00:523
29715050,0irq/26-eth0-rx-17365-21kthreadcore10:13:213
29715050,0irq/26-eth0-rx-0-21swapper/312:14:453
29715050,0irq/26-eth0-rx-0-21swapper/311:33:213
29715050,0irq/26-eth0-rx-0-21swapper/311:29:233
29715050,0irq/26-eth0-rx-0-21swapper/311:24:283
29715050,0irq/26-eth0-rx-0-21swapper/310:23:153
29715050,0irq/26-eth0-rx-0-21swapper/310:11:023
29715050,0irq/26-eth0-rx-0-21swapper/310:00:083
29715050,0irq/26-eth0-rx-0-21swapper/309:48:233
29715050,0irq/26-eth0-rx-0-21swapper/309:33:053
29715050,0irq/26-eth0-rx-0-21swapper/308:08:203
29715050,0irq/26-eth0-rx-0-21swapper/307:48:223
27150,0ktimersoftd/20-21swapper/210:34:512
249950,0watchdog/22697-21kthreadcore07:28:242
171139954,0cyclictest3514-21snmpd09:00:562
171119955,0cyclictest15370-21diskmemload11:29:450
171119955,0cyclictest0-21swapper/009:39:230
171119950,0cyclictest0-21swapper/012:08:030
171119950,0cyclictest0-21swapper/010:13:450
171119950,0cyclictest0-21swapper/009:44:260
171119950,0cyclictest0-21swapper/009:13:030
171119950,0cyclictest0-21swapper/008:28:170
179950,0migration/14794-21latency_hist07:08:061
179950,0migration/132341-21idleruntime11:23:201
179950,0migration/132175-21munin-node09:03:171
179950,0migration/13108-21kthreadcore10:23:221
179950,0migration/126227-21kthreadcore09:58:191
179950,0migration/124635-21munin-node10:38:181
179950,0migration/114902-21sh09:50:311
179950,0migration/114578-21latency_hist08:28:061
179950,0migration/113434-21munin-node07:38:191
179950,0migration/110824-21kthreadcore11:28:231
149950,0migration/09905-21kthreadcore11:48:240
149950,0migration/05702-21kthreadcore08:18:240
149950,0migration/04489-21kthreadcore10:03:220
149950,0migration/032016-21taskset07:49:220
149950,0migration/01848-21kthreadcore07:53:210
149950,0migration/018463-21kthreadcore09:33:210
149950,0migration/015074-21sh10:11:370
149950,0migration/013776-21sh11:08:530
8215040,0irq/24-0000:00:30370-21idleruntime-cro07:03:062
339940,0migration/38549-21taskset08:46:413
339940,0migration/37373-21kthreadcore07:33:223
339940,0migration/36289-21kthreadcore08:18:243
339940,0migration/331217-21kthreadcore08:13:213
339940,0migration/329534-21kthreadcore08:38:213
339940,0migration/329270-21kthreadcore07:23:223
339940,0migration/319036-21kthreadcore08:53:213
339940,0migration/317629-21kthreadcore11:13:223
29725040,0irq/27-eth0-tx-8020-21ssh10:48:172
29725040,0irq/27-eth0-tx-5857-21ssh11:04:222
29725040,0irq/27-eth0-tx-5440-21ssh11:44:352
29725040,0irq/27-eth0-tx-28853-21ssh12:18:442
29725040,0irq/27-eth0-tx-23813-21ssh10:38:092
29725040,0irq/27-eth0-tx-21956-21ssh08:54:312
29725040,0irq/27-eth0-tx-20760-21ntp_kernel_pll_11:33:232
29725040,0irq/27-eth0-tx-0-21swapper/212:06:582
29725040,0irq/27-eth0-tx-0-21swapper/211:38:092
29725040,0irq/27-eth0-tx-0-21swapper/211:28:122
29725040,0irq/27-eth0-tx-0-21swapper/211:22:322
29725040,0irq/27-eth0-tx-0-21swapper/211:13:162
29725040,0irq/27-eth0-tx-0-21swapper/210:58:302
29725040,0irq/27-eth0-tx-0-21swapper/210:28:062
29725040,0irq/27-eth0-tx-0-21swapper/210:18:132
29725040,0irq/27-eth0-tx-0-21swapper/210:08:322
29725040,0irq/27-eth0-tx-0-21swapper/209:59:582
29725040,0irq/27-eth0-tx-0-21swapper/209:48:192
29725040,0irq/27-eth0-tx-0-21swapper/209:38:112
29725040,0irq/27-eth0-tx-0-21swapper/209:33:592
29725040,0irq/27-eth0-tx-0-21swapper/209:23:162
29725040,0irq/27-eth0-tx-0-21swapper/007:13:160
29725040,0irq/27-eth0-tx-0-21swapper/007:03:200
29715040,0irq/26-eth0-rx-0-21swapper/310:55:283
29715040,0irq/26-eth0-rx-0-21swapper/310:29:373
29715040,0irq/26-eth0-rx-0-21swapper/310:18:073
29715040,0irq/26-eth0-rx-0-21swapper/309:43:213
29715040,0irq/26-eth0-rx-0-21swapper/308:01:443
259940,0migration/26830-21latency_hist11:48:052
259940,0migration/231673-21latency_hist09:03:052
259940,0migration/215180-21cpuspeed_turbos11:53:172
259940,0migration/213755-21unixbench-2d09:08:262
249940,0watchdog/23931-21cut08:18:242
249940,0watchdog/222898-21ssh11:58:112
249940,0watchdog/20-21swapper/209:18:152
171139943,0cyclictest9175-21awk09:28:202
171139943,0cyclictest8412-21awk11:08:202
171139943,0cyclictest6808-21awk07:33:202
171139943,0cyclictest572-21awk10:03:192
171139943,0cyclictest3556-21lldpd08:48:212
171139943,0cyclictest3556-21lldpd07:56:522
171139943,0cyclictest3556-21lldpd07:40:222
171139943,0cyclictest3556-21lldpd07:08:222
171139943,0cyclictest3556-21lldpd06:56:222
171139943,0cyclictest3514-21snmpd10:23:262
171139943,0cyclictest3514-21snmpd08:30:412
171139943,0cyclictest3514-21snmpd07:48:562
171139943,0cyclictest3241-21irqbalance12:08:432
171139943,0cyclictest3241-21irqbalance10:13:132
171139943,0cyclictest3241-21irqbalance09:54:332
171139943,0cyclictest3241-21irqbalance08:43:142
171139943,0cyclictest3241-21irqbalance08:41:442
171139943,0cyclictest3241-21irqbalance08:35:542
171139943,0cyclictest3241-21irqbalance08:23:142
171139943,0cyclictest3241-21irqbalance08:23:142
171139943,0cyclictest3241-21irqbalance08:14:042
171139943,0cyclictest3241-21irqbalance08:09:342
171139943,0cyclictest3241-21irqbalance08:03:342
171139943,0cyclictest20127-21awk07:43:212
171139943,0cyclictest16904-21awk09:13:192
171139943,0cyclictest16595-21awk10:53:192
171139940,0cyclictest14563-21munin-node12:13:172
171129943,0cyclictest715-21awk09:43:191
171129943,0cyclictest6872-21awk07:33:201
171129943,0cyclictest3514-21snmpd12:19:411
171129943,0cyclictest3514-21snmpd11:22:411
171129943,0cyclictest3514-21snmpd10:31:111
171129943,0cyclictest3514-21snmpd10:08:411
171129943,0cyclictest3514-21snmpd09:36:561
171129943,0cyclictest3514-21snmpd09:20:561
171129943,0cyclictest3514-21snmpd09:15:411
171129943,0cyclictest3514-21snmpd09:09:261
171129943,0cyclictest3514-21snmpd08:54:111
171129943,0cyclictest3514-21snmpd07:59:411
171129943,0cyclictest3514-21snmpd07:13:261
171129943,0cyclictest32535-21awk07:28:221
171129943,0cyclictest32226-21awk11:43:191
171129943,0cyclictest31741-21awk12:03:171
171129943,0cyclictest24821-21awk06:58:191
171129943,0cyclictest22118-21awk08:33:181
171129940,0cyclictest0-21swapper/110:20:491
171119944,0cyclictest0-21swapper/011:23:070
171119944,0cyclictest0-21swapper/011:05:370
171119944,0cyclictest0-21swapper/009:53:060
171119944,0cyclictest0-21swapper/009:07:130
171119943,0cyclictest832-21awk09:23:190
171119943,0cyclictest3556-21lldpd10:22:550
171119943,0cyclictest3556-21lldpd09:31:230
171119943,0cyclictest3556-21lldpd08:38:210
171119943,0cyclictest3514-21snmpd10:46:110
171119943,0cyclictest3514-21snmpd09:15:560
171119943,0cyclictest3514-21snmpd08:58:410
171119943,0cyclictest3514-21snmpd07:19:260
171119943,0cyclictest32472-21awk07:28:210
171119943,0cyclictest3241-21irqbalance11:53:230
171119943,0cyclictest3241-21irqbalance11:18:130
171119943,0cyclictest3241-21irqbalance11:13:430
171119943,0cyclictest3241-21irqbalance10:37:130
171119943,0cyclictest3241-21irqbalance10:28:130
171119943,0cyclictest3241-21irqbalance09:48:140
171119943,0cyclictest25757-21awk07:23:190
171119943,0cyclictest25094-21awk09:18:180
171119943,0cyclictest24795-21awk10:38:200
171119943,0cyclictest23799-21awk11:58:180
171119943,0cyclictest21167-21awk08:08:200
171119943,0cyclictest18172-21awk06:53:190
171119943,0cyclictest14504-21awk08:03:200
171119940,0cyclictest12598-21munin-node07:38:210
179940,0migration/17488-21fschecks_count11:48:201
179940,0migration/132410-21cpuspeed_turbos10:03:161
179940,0migration/13205-21kthreadcore09:23:211
179940,0migration/130039-21kthreadcore08:13:211
179940,0migration/129749-21ksmtuned08:58:321
179940,0migration/126738-21kthreadcore09:38:211
179940,0migration/120893-21kthreadcore10:13:221
179940,0migration/119524-21kthreadcore12:13:211
179940,0migration/118976-21kthreadcore09:53:201
179940,0migration/117920-21kthreadcore11:33:211
179940,0migration/117884-21kthreadcore11:13:221
179940,0migration/117737-21kthreadcore10:33:211
179940,0migration/115175-21kthreadcore08:03:221
179940,0migration/114139-21taskset08:25:181
179940,0migration/114139-21taskset08:25:181
179940,0migration/113873-21taskset10:48:441
179940,0migration/110960-21kthreadcore12:08:201
169940,0watchdog/15309-21timerandwakeup11:03:271
169940,0watchdog/131916-21munin-node10:43:151
169940,0watchdog/125115-21tr11:38:231
169940,0watchdog/10-21swapper/111:53:231
169940,0watchdog/10-21swapper/111:08:231
149940,0migration/07578-21kthreadcore07:08:220
149940,0migration/032503-21fschecks_count10:23:180
149940,0migration/027378-21kthreadcore10:58:210
149940,0migration/017546-21kthreadcore08:53:210
149940,0migration/013052-21taskset07:59:190
149940,0migration/010334-21kthreadcore10:48:220
8215030,0irq/24-0000:00:0-21swapper/207:23:102
339930,0migration/323958-21runrttasks06:58:073
29725030,0irq/27-eth0-tx-0-21swapper/008:48:150
29725030,0irq/27-eth0-tx-0-21swapper/008:23:190
29725030,0irq/27-eth0-tx-0-21swapper/008:23:190
29725030,0irq/27-eth0-tx-0-21swapper/007:33:160
29715030,0irq/26-eth0-rx-0-21swapper/308:35:353
29715030,0irq/26-eth0-rx-0-21swapper/308:27:373
29715030,0irq/26-eth0-rx-0-21swapper/308:27:373
29715030,0irq/26-eth0-rx-0-21swapper/308:05:213
29715030,0irq/26-eth0-rx-0-21swapper/307:56:083
29715030,0irq/26-eth0-rx-0-21swapper/307:28:303
29715030,0irq/26-eth0-rx-0-21swapper/307:13:233
29715030,0irq/26-eth0-rx-0-21swapper/307:08:163
171139932,0cyclictest7873-21awk07:58:232
171139932,0cyclictest3556-21lldpd07:15:212
171139932,0cyclictest31508-21awk07:03:202
171139930,0cyclictest23070-21grep07:18:222
171129933,0cyclictest24706-21awk10:58:191
171129932,0cyclictest26857-21awk07:48:211
171129932,0cyclictest23838-21awk11:58:181
171129932,0cyclictest22977-21sensors06:53:261
171129930,0cyclictest8846-21perl09:28:181
171129930,0cyclictest19245-21date07:43:061
171129930,0cyclictest0-21swapper/108:48:211
171119932,0cyclictest3514-21snmpd11:45:320
171119932,0cyclictest3514-21snmpd08:45:000
171119932,0cyclictest3514-21snmpd08:35:410
171119932,0cyclictest27020-21basename08:13:150
171119932,0cyclictest22668-21aten_r1power_fr12:18:160
171119932,0cyclictest19301-21aten_r1power_en07:43:160
171119930,0cyclictest0-21swapper/011:41:000
179930,0migration/118226-21latency_hist07:18:061
169930,0watchdog/10-21swapper/110:56:231
169930,0watchdog/10-21swapper/108:38:161
169930,0watchdog/10-21swapper/108:18:241
169930,0watchdog/10-21swapper/107:08:161
29715020,0irq/26-eth0-rx-17623-21cut07:38:223
29715020,0irq/26-eth0-rx-0-21swapper/307:03:163
171129920,0cyclictest20226-21cat08:08:061
171119920,0cyclictest0-21swapper/012:08:050
169920,0watchdog/10-21swapper/108:43:081
169920,0watchdog/10-21swapper/107:53:081
169920,0watchdog/10-21swapper/107:23:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional