You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-07 - 17:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Tue Apr 07, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450530,0irq/25-eth10-21swapper/306:54:303
247023624,0sleep20-21swapper/206:57:192
247423521,0sleep00-21swapper/006:57:210
237323223,0sleep10-21swapper/106:56:101
27139976,0cyclictest22578-21kthreadcore08:24:261
4160,0ktimersoftd/00-21swapper/010:53:160
339960,0migration/35171-21cpuspeed_turbos07:49:223
339960,0migration/332398-21sh10:18:443
339960,0migration/314331-21munin-node10:24:323
19160,0ktimersoftd/10-21swapper/109:14:251
149960,0migration/031538-21sh08:29:300
149960,0migration/031516-21sh10:36:560
149960,0migration/029111-21latency11:14:260
149960,0migration/029111-21latency11:14:260
149960,0migration/028784-21sh12:15:120
149960,0migration/025337-21kthreadcore07:14:260
149960,0migration/013513-21sh12:07:190
149960,0migration/012509-21sh12:25:300
4150,0ktimersoftd/00-21swapper/009:54:410
4150,0ktimersoftd/00-21swapper/009:19:220
339950,0migration/39635-21munin-node07:24:303
339950,0migration/37959-21kthreadcore12:04:263
339950,0migration/36040-21munin-node10:39:303
339950,0migration/35899-21kthreadcore06:59:263
339950,0migration/3565-21latency_hist09:59:093
339950,0migration/35198-21taskset12:22:333
339950,0migration/34318-21kthreadcore08:34:283
339950,0migration/33402-21kthreadcore09:19:253
339950,0migration/331862-21diskmemload09:56:203
339950,0migration/330382-21kthreadcore08:54:243
339950,0migration/326350-21fschecks_count08:29:213
339950,0migration/323321-21taskset11:34:183
339950,0migration/319941-21taskset08:49:093
339950,0migration/31742-21gltestperf09:39:223
339950,0migration/313408-21latency_hist08:44:093
339950,0migration/312600-21kthreadcore07:04:263
339950,0migration/310750-21kthreadcore12:24:253
29725050,0irq/27-eth0-tx-5031-21cut09:59:262
29725050,0irq/27-eth0-tx-3514-21snmpd11:56:582
29725050,0irq/27-eth0-tx-32551-21munin-node10:39:242
29725050,0irq/27-eth0-tx-27072-21cut12:14:262
29725050,0irq/27-eth0-tx-22487-21ssh11:53:532
29725050,0irq/27-eth0-tx-15234-21idleruntime12:09:232
29725050,0irq/27-eth0-tx-1180-21ssh08:59:200
29725050,0irq/27-eth0-tx-0-21swapper/211:09:282
29725050,0irq/27-eth0-tx-0-21swapper/211:05:032
29725050,0irq/27-eth0-tx-0-21swapper/211:00:182
29725050,0irq/27-eth0-tx-0-21swapper/210:12:452
29725050,0irq/27-eth0-tx-0-21swapper/209:24:272
29725050,0irq/27-eth0-tx-0-21swapper/007:44:300
29715050,0irq/26-eth0-rx-4938-21taskset12:00:323
29715050,0irq/26-eth0-rx-31581-21ssh09:14:413
29715050,0irq/26-eth0-rx-293812chrt07:19:083
29715050,0irq/26-eth0-rx-19020-21cut09:29:253
29715050,0irq/26-eth0-rx-16985-21sh09:09:093
29715050,0irq/26-eth0-rx-15727-21ssh09:45:543
29715050,0irq/26-eth0-rx-0-21swapper/312:14:293
29715050,0irq/26-eth0-rx-0-21swapper/311:49:253
29715050,0irq/26-eth0-rx-0-21swapper/311:41:133
29715050,0irq/26-eth0-rx-0-21swapper/311:26:223
29715050,0irq/26-eth0-rx-0-21swapper/311:21:203
29715050,0irq/26-eth0-rx-0-21swapper/311:14:163
29715050,0irq/26-eth0-rx-0-21swapper/311:14:163
29715050,0irq/26-eth0-rx-0-21swapper/310:59:273
29715050,0irq/26-eth0-rx-0-21swapper/310:54:253
29715050,0irq/26-eth0-rx-0-21swapper/310:34:273
29715050,0irq/26-eth0-rx-0-21swapper/310:19:373
29715050,0irq/26-eth0-rx-0-21swapper/310:10:033
29715050,0irq/26-eth0-rx-0-21swapper/310:04:253
29715050,0irq/26-eth0-rx-0-21swapper/309:49:283
29715050,0irq/26-eth0-rx-0-21swapper/309:25:103
29715050,0irq/26-eth0-rx-0-21swapper/308:49:283
29715050,0irq/26-eth0-rx-0-21swapper/307:47:113
27149955,0cyclictest813-21diskmemload09:01:012
27149954,0cyclictest3241-21irqbalance07:22:082
27129955,0cyclictest0-21swapper/012:21:190
27129955,0cyclictest0-21swapper/011:51:500
27129955,0cyclictest0-21swapper/010:26:130
27129955,0cyclictest0-21swapper/009:27:440
27129954,0cyclictest25161-21munin-run09:34:090
27129950,0cyclictest0-21swapper/011:19:210
259950,0migration/27353-21sh09:39:522
259950,0migration/228711-21kthreadcore07:39:262
259950,0migration/225266-21latency_hist09:34:092
259950,0migration/225083-21fschecks_count10:34:232
259950,0migration/217212-21latency_hist07:34:092
249950,0watchdog/230097-21grep10:54:312
249950,0watchdog/219351-21kthreadcore10:49:272
179950,0migration/19247-21aten2.4-expect09:04:201
179950,0migration/14896-21sh12:00:251
179950,0migration/118537-21kthreadcore07:09:261
179950,0migration/118273-21kthreadcore10:09:251
179950,0migration/118257-21idleruntime09:29:231
179950,0migration/115828-21taskset07:06:161
179950,0migration/115539-21sh09:45:221
179950,0migration/113752-21timerwakeupswit11:04:321
169950,0watchdog/18701-21ssh09:03:311
149950,0migration/09556-21kthreadcore07:49:270
149950,0migration/0693-21aten_r1power_en09:59:190
149950,0migration/05604-21taskset12:02:310
149950,0migration/03953-21kthreadcore10:59:250
149950,0migration/032631-21aten_r1power_fr10:39:190
149950,0migration/026915-21kthreadcore09:34:260
149950,0migration/025983-21kthreadcore07:39:250
149950,0migration/025707-21kthreadcore11:34:260
149950,0migration/024309-21taskset10:13:310
149950,0migration/021087-21kthreadcore07:59:260
149950,0migration/019937-21kthreadcore09:09:260
149950,0migration/017791-21kthreadcore11:29:250
149950,0migration/01712-21kthreadcore08:34:270
149950,0migration/016600-21kthreadcore08:44:250
149950,0migration/015628-21irqrtprio12:09:250
149950,0migration/015130-21sh10:46:480
149950,0migration/013616-21munin-node11:04:320
149950,0migration/011735-21kthreadcore09:44:250
149950,0migration/010775-21kthreadcore11:24:250
8215040,0irq/24-0000:00:0-21swapper/208:24:232
339940,0migration/38026-21irqcore11:44:253
339940,0migration/328481-21kthreadcore08:04:273
339940,0migration/318623-21df_abs07:59:213
339940,0migration/317864-21kthreadcore07:09:253
29725040,0irq/27-eth0-tx-9723-21telnet07:04:210
29725040,0irq/27-eth0-tx-8736-21cut11:24:242
29725040,0irq/27-eth0-tx-813-21diskmemload09:49:542
29725040,0irq/27-eth0-tx-6816-21ssh10:20:002
29725040,0irq/27-eth0-tx-3930-21munin-node07:24:240
29725040,0irq/27-eth0-tx-28640-21tr09:14:262
29725040,0irq/27-eth0-tx-25537-21gltestperf10:14:202
29725040,0irq/27-eth0-tx-23278-21ssh11:34:092
29725040,0irq/27-eth0-tx-13234-21grep10:04:272
29725040,0irq/27-eth0-tx-12464-40yum-updatesd-he11:44:302
29725040,0irq/27-eth0-tx-1085-21latency_hist09:19:092
29725040,0irq/27-eth0-tx-0-21swapper/212:19:272
29725040,0irq/27-eth0-tx-0-21swapper/212:05:122
29725040,0irq/27-eth0-tx-0-21swapper/211:59:162
29725040,0irq/27-eth0-tx-0-21swapper/211:29:172
29725040,0irq/27-eth0-tx-0-21swapper/210:29:182
29725040,0irq/27-eth0-tx-0-21swapper/210:24:152
29725040,0irq/27-eth0-tx-0-21swapper/209:54:142
29725040,0irq/27-eth0-tx-0-21swapper/209:09:282
29725040,0irq/27-eth0-tx-0-21swapper/209:04:232
29725040,0irq/27-eth0-tx-0-21swapper/008:49:200
29725040,0irq/27-eth0-tx-0-21swapper/008:19:240
29725040,0irq/27-eth0-tx-0-21swapper/008:14:200
29725040,0irq/27-eth0-tx-0-21swapper/008:09:210
29715040,0irq/26-eth0-rx-22005-21smartctl10:49:313
29715040,0irq/26-eth0-rx-0-21swapper/312:09:393
29715040,0irq/26-eth0-rx-0-21swapper/311:55:043
29715040,0irq/26-eth0-rx-0-21swapper/311:29:293
29715040,0irq/26-eth0-rx-0-21swapper/311:10:203
29715040,0irq/26-eth0-rx-0-21swapper/311:05:153
29715040,0irq/26-eth0-rx-0-21swapper/310:46:043
29715040,0irq/26-eth0-rx-0-21swapper/310:30:033
29715040,0irq/26-eth0-rx-0-21swapper/309:35:213
29715040,0irq/26-eth0-rx-0-21swapper/309:11:243
29715040,0irq/26-eth0-rx-0-21swapper/309:01:123
27149944,0cyclictest0-21swapper/208:14:212
27149943,0cyclictest3556-21lldpd07:26:572
27149943,0cyclictest3556-21lldpd07:12:582
27149943,0cyclictest32579-21awk11:19:222
27149943,0cyclictest3241-21irqbalance07:00:082
27149943,0cyclictest24609-21awk11:14:232
27149943,0cyclictest24609-21awk11:14:232
27149943,0cyclictest12529-21awk07:54:252
27149940,0cyclictest0-21swapper/212:24:142
27139944,0cyclictest0-21swapper/112:11:191
27139944,0cyclictest0-21swapper/111:25:261
27139943,0cyclictest7359-21awk12:04:241
27139943,0cyclictest6793-21awk08:14:231
27139943,0cyclictest513-21awk10:59:221
27139943,0cyclictest3556-21lldpd11:30:281
27139943,0cyclictest3556-21lldpd07:54:271
27139943,0cyclictest3514-21snmpd09:54:581
27139943,0cyclictest3514-21snmpd08:43:131
27139943,0cyclictest3241-21irqbalance12:27:471
27139943,0cyclictest3241-21irqbalance10:21:371
27139943,0cyclictest23737-21awk11:54:221
27139943,0cyclictest17513-21awk10:29:231
27139943,0cyclictest14566-21sadc11:49:091
27139943,0cyclictest13478-21awk08:19:231
27129944,0cyclictest0-21swapper/009:07:240
27129943,0cyclictest3888-21awk06:59:240
27129943,0cyclictest3556-21lldpd10:55:280
27129943,0cyclictest3241-21irqbalance10:07:470
27129943,0cyclictest25719-21awk10:14:220
27129943,0cyclictest17188-21awk07:09:240
27129943,0cyclictest16208-21kworker/0:109:41:360
27129940,0cyclictest13280-21munin-run08:44:090
259940,0migration/29054-21kthreadcore07:49:272
259940,0migration/229208-21kthreadcore08:54:242
259940,0migration/223529-21fschecks_count07:14:232
259940,0migration/221273-21irqcore08:49:252
259940,0migration/21449-21kthreadcore11:39:252
259940,0migration/212508-21kthreadcore07:04:262
249940,0watchdog/229845-21kthreadcore08:04:272
249940,0watchdog/210799-21kthreadcore10:44:272
249940,0watchdog/20-21swapper/209:44:232
249940,0watchdog/20-21swapper/209:34:232
249940,0watchdog/20-21swapper/208:34:272
179940,0migration/17542-21kthreadcore07:49:271
179940,0migration/13851-21kthreadcore11:39:261
179940,0migration/131095-21taskset11:18:061
179940,0migration/131095-21taskset11:18:061
179940,0migration/128295-21kthreadcore08:54:241
179940,0migration/127968-21kthreadcore10:54:251
179940,0migration/123873-21latency_hist07:39:091
179940,0migration/122248-21unixbench_multi10:49:321
179940,0migration/120751-21kthreadcore07:59:261
179940,0migration/117229-21taskset09:09:151
179940,0migration/116945-21irqcore11:09:241
179940,0migration/11619-21kthreadcore10:39:241
169940,0watchdog/17393-21unixbench_singl09:19:311
169940,0watchdog/14434-21ssh12:20:181
169940,0watchdog/13887-21kthreadcore08:09:271
169940,0watchdog/13234-21ps08:34:271
169940,0watchdog/130441-21munin-node10:14:271
169940,0watchdog/129843-21kthreadcore08:04:271
169940,0watchdog/129647-21ssh12:17:461
169940,0watchdog/128194-21tr11:34:271
169940,0watchdog/127718-21kthreadcore10:34:271
169940,0watchdog/117129-21ssh09:49:191
169940,0watchdog/114258-21kthreadcore09:24:271
169940,0watchdog/113840-21grep10:04:271
169940,0watchdog/10-21swapper/109:34:271
169940,0watchdog/10-21swapper/108:44:191
169940,0watchdog/10-21swapper/108:29:591
169940,0watchdog/10-21swapper/107:34:241
149940,0migration/027906-21irqcore08:54:230
149940,0migration/022739-21kthreadcore08:24:260
149940,0migration/02005-21kthreadcore11:39:250
149940,0migration/014121-21runrttasks11:47:510
149940,0migration/012824-21kthreadcore07:29:260
339930,0migration/318412-21irqcore07:34:263
29725030,0irq/27-eth0-tx-0-21swapper/007:54:230
29725030,0irq/27-eth0-tx-0-21swapper/007:34:220
29715030,0irq/26-eth0-rx-0-21swapper/308:24:233
29715030,0irq/26-eth0-rx-0-21swapper/308:19:193
29715030,0irq/26-eth0-rx-0-21swapper/308:14:113
29715030,0irq/26-eth0-rx-0-21swapper/308:09:233
29715030,0irq/26-eth0-rx-0-21swapper/307:54:213
29715030,0irq/26-eth0-rx-0-21swapper/307:39:193
29715030,0irq/26-eth0-rx-0-21swapper/307:29:303
29715030,0irq/26-eth0-rx-0-21swapper/307:19:223
27149932,0cyclictest26848-21awk08:29:232
27149932,0cyclictest19434-21sed08:44:312
27149932,0cyclictest11536-21awk07:29:252
27139933,0cyclictest3556-21lldpd07:25:281
27139933,0cyclictest30494-21awk07:19:241
27139932,0cyclictest9217-21awk10:44:251
27139932,0cyclictest3514-21snmpd09:39:281
27139932,0cyclictest3241-21irqbalance11:50:271
27139932,0cyclictest31405-21awk07:44:221
27139932,0cyclictest23851-21awk07:14:241
27139932,0cyclictest21111-21awk08:49:241
27139932,0cyclictest11512-21awk07:29:251
27139931,0cyclictest3502-21fschecks_time06:59:221
27129933,0cyclictest25918-21kworker/0:211:54:220
27129933,0cyclictest25918-21kworker/0:211:09:100
27129933,0cyclictest25918-21kworker/0:210:29:180
27129933,0cyclictest25918-21kworker/0:210:19:120
27129933,0cyclictest16208-21kworker/0:109:49:180
27129933,0cyclictest16208-21kworker/0:109:14:120
27129933,0cyclictest16208-21kworker/0:107:19:230
27129932,0cyclictest25830-21awk08:04:250
259930,0migration/216872-21kthreadcore08:19:252
249930,0watchdog/24613-21seq07:48:482
249930,0watchdog/20-21swapper/208:39:232
249930,0watchdog/20-21swapper/208:09:272
179930,0migration/11408-21kthreadcore11:19:251
169930,0watchdog/1813-21diskmemload09:59:191
169930,0watchdog/10-21swapper/110:24:271
249920,0watchdog/20-21swapper/207:59:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional