You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-10 - 00:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sat May 09, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
799523626,0sleep20-21swapper/206:53:552
803423531,0sleep00-21swapper/006:54:210
304450350,0irq/25-eth10-21swapper/306:53:313
780022622,0sleep10-21swapper/106:51:381
82629965,0cyclictest17474-21ps10:41:242
82629960,0cyclictest0-21swapper/212:19:062
339960,0migration/330007-21sh10:09:163
339960,0migration/322456-21sh09:45:053
339960,0migration/320600-21sh11:02:263
339960,0migration/312810-21sh10:16:473
339960,0migration/312343-21munin-node08:11:253
259960,0migration/21039-21kthreadcore10:11:262
82629955,0cyclictest0-21swapper/211:10:212
82629955,0cyclictest0-21swapper/210:56:102
82629950,0cyclictest0-21swapper/211:37:282
82629950,0cyclictest0-21swapper/211:30:232
82609955,0cyclictest0-21swapper/110:07:321
8215050,0irq/24-0000:00:12361-21python10:16:292
339950,0migration/39952-21taskset07:43:533
339950,0migration/35055-21taskset11:55:543
339950,0migration/34210-21munin-node09:11:263
339950,0migration/331577-21fschecks_count09:51:203
339950,0migration/3309-21kthreadcore10:31:233
339950,0migration/330058-21munin-node08:21:293
339950,0migration/326358-21kthreadcore11:26:243
339950,0migration/32569-21kthreadcore10:51:243
339950,0migration/324547-21kthreadcore11:46:243
339950,0migration/323182-21latency_hist09:26:083
339950,0migration/322248-21aten_r1power_fr11:06:183
339950,0migration/320237-21munin-node10:01:253
339950,0migration/320225-21kernelversion08:41:223
339950,0migration/319400-21kthreadcore08:16:243
339950,0migration/319022-21kthreadcore07:51:263
339950,0migration/317468-21kthreadcore09:21:253
339950,0migration/317108-21irqcore07:26:243
339950,0migration/315593-21kthreadcore11:41:243
339950,0migration/310914-21kthreadcore09:56:273
339950,0migration/310310-21kthreadcore12:16:253
29725050,0irq/27-eth0-tx-4647-21munin-node08:06:220
29725050,0irq/27-eth0-tx-28691-21ssh10:47:022
29725050,0irq/27-eth0-tx-28477-21munin-node07:11:270
29725050,0irq/27-eth0-tx-20145-21unixbench-2d11:01:302
29725050,0irq/27-eth0-tx-12852-21ssh08:56:542
29725050,0irq/27-eth0-tx-11363-21munin-node08:11:320
29725050,0irq/27-eth0-tx-0-21swapper/212:13:172
29725050,0irq/27-eth0-tx-0-21swapper/209:49:062
29725050,0irq/27-eth0-tx-0-21swapper/007:20:190
29715050,0irq/26-eth0-rx-8228-21kthreadcore11:16:243
29715050,0irq/26-eth0-rx-8047-21kthreadcore11:56:233
29715050,0irq/26-eth0-rx-7441-21kthreadcore10:56:223
29715050,0irq/26-eth0-rx-6683-21irqcore11:36:243
29715050,0irq/26-eth0-rx-492-21perl08:51:223
29715050,0irq/26-eth0-rx-27883-21ssh12:07:083
29715050,0irq/26-eth0-rx-26390-21hwlatdetect08:46:223
29715050,0irq/26-eth0-rx-21904-21ssh09:04:013
29715050,0irq/26-eth0-rx-15686-21sed10:21:233
29715050,0irq/26-eth0-rx-14010-21ssh10:40:583
29715050,0irq/26-eth0-rx-11573-21kthreadcore06:56:253
29715050,0irq/26-eth0-rx-10756-21kthreadcore07:21:253
29715050,0irq/26-eth0-rx-0-21swapper/312:21:193
29715050,0irq/26-eth0-rx-0-21swapper/312:01:243
29715050,0irq/26-eth0-rx-0-21swapper/311:24:163
29715050,0irq/26-eth0-rx-0-21swapper/310:47:053
29715050,0irq/26-eth0-rx-0-21swapper/310:12:133
29715050,0irq/26-eth0-rx-0-21swapper/309:48:143
29715050,0irq/26-eth0-rx-0-21swapper/309:36:243
29715050,0irq/26-eth0-rx-0-21swapper/309:19:543
29715050,0irq/26-eth0-rx-0-21swapper/309:06:273
29715050,0irq/26-eth0-rx-0-21swapper/308:26:233
29715050,0irq/26-eth0-rx-0-21swapper/308:06:243
29715050,0irq/26-eth0-rx-0-21swapper/307:36:213
29715050,0irq/26-eth0-rx-0-21swapper/307:31:253
259950,0migration/26263-21sh09:14:532
259950,0migration/226275-21kthreadcore08:21:262
259950,0migration/224211-21kthreadcore10:26:232
259950,0migration/222368-21latency_hist10:26:072
259950,0migration/221494-21sh12:06:122
259950,0migration/220056-21kthreadcore07:51:272
259950,0migration/216231-21irqcore09:41:252
259950,0migration/213294-21kthreadcore06:56:252
249950,0watchdog/20-21swapper/209:17:222
249950,0watchdog/20-21swapper/207:06:302
19150,0ktimersoftd/10-21swapper/112:22:151
179950,0migration/131153-21kthreadcore07:36:251
179950,0migration/130328-21df_abs11:31:181
179950,0migration/124023-21kthreadcore10:26:231
179950,0migration/120673-21unixbench_singl10:21:311
179950,0migration/118980-21kthreadcore11:41:251
169950,0watchdog/112435-21users10:36:301
149950,0migration/07070-21cpuspeed_turbos09:56:210
149950,0migration/05841-21munin-node11:56:200
149950,0migration/04922-21taskset11:55:310
149950,0migration/04519-21idleruntime07:41:230
149950,0migration/031127-21sh09:51:160
149950,0migration/030775-21latency_hist10:11:070
149950,0migration/030127-21sh10:30:340
149950,0migration/029214-21turbostat07:36:080
149950,0migration/02580-21kthreadcore08:26:250
149950,0migration/024883-21kthreadcore07:06:240
149950,0migration/024680-21kthreadcore09:06:250
149950,0migration/023833-21timerwakeupswit08:16:320
149950,0migration/023069-21sh09:46:110
149950,0migration/019310-21kthreadcore10:21:250
149950,0migration/013788-21munin-node11:41:180
82629944,0cyclictest0-21swapper/211:22:582
82629943,0cyclictest3556-21lldpd09:56:192
82629943,0cyclictest3556-21lldpd08:51:192
82629943,0cyclictest3556-21lldpd08:36:202
82629943,0cyclictest3556-21lldpd08:01:492
82629943,0cyclictest3556-21lldpd07:47:492
82629943,0cyclictest3556-21lldpd07:25:192
82629943,0cyclictest31210-21awk11:11:232
82629943,0cyclictest30582-21awk11:51:222
82629943,0cyclictest26474-21awk08:46:222
82629943,0cyclictest24623-21awk07:56:232
82629943,0cyclictest23691-21awk07:31:232
82629943,0cyclictest16144-21awk09:21:232
82629943,0cyclictest12318-21awk08:11:242
82629940,0cyclictest0-21swapper/208:11:082
82609944,0cyclictest0-21swapper/111:12:491
82609944,0cyclictest0-21swapper/111:04:561
82609944,0cyclictest0-21swapper/109:56:111
82609944,0cyclictest0-21swapper/108:46:211
82609943,0cyclictest7957-21awk09:16:221
82609943,0cyclictest3556-21lldpd12:18:201
82609943,0cyclictest3556-21lldpd11:28:191
82609943,0cyclictest3514-21snmpd10:11:111
82609943,0cyclictest3514-21snmpd09:53:411
82609943,0cyclictest3514-21snmpd09:45:401
82609943,0cyclictest3514-21snmpd07:47:391
82609943,0cyclictest3514-21snmpd07:35:381
82609943,0cyclictest3241-21irqbalance12:06:251
82609943,0cyclictest3241-21irqbalance11:16:161
82609943,0cyclictest31304-21awk10:51:211
82609943,0cyclictest30524-21awk12:11:221
82609943,0cyclictest23313-21awk10:46:221
82609943,0cyclictest15721-21awk10:01:221
82609943,0cyclictest13250-21awk08:36:221
82599943,0cyclictest7972-21awk09:16:220
82599943,0cyclictest7530-21awk08:56:230
82599943,0cyclictest3514-21snmpd12:14:570
82599943,0cyclictest3514-21snmpd10:56:110
82599943,0cyclictest3241-21irqbalance12:23:450
82599943,0cyclictest3241-21irqbalance12:20:150
82599943,0cyclictest3241-21irqbalance12:01:250
82599943,0cyclictest3241-21irqbalance11:11:160
82599943,0cyclictest3241-21irqbalance11:01:560
82599943,0cyclictest3241-21irqbalance10:31:260
82599943,0cyclictest3241-21irqbalance09:42:160
82599943,0cyclictest3241-21irqbalance09:02:160
82599943,0cyclictest3241-21irqbalance08:21:260
82599943,0cyclictest3241-21irqbalance08:01:160
82599943,0cyclictest3241-21irqbalance07:57:160
82599943,0cyclictest30416-21awk07:36:230
82599943,0cyclictest22567-21awk11:46:220
82599940,0cyclictest18950-21munin-node08:41:190
339940,0migration/36904-21cpuspeed_turbos08:56:203
339940,0migration/32917-21kthreadcore08:01:253
339940,0migration/325670-21kthreadcore10:26:233
29725040,0irq/27-eth0-tx-31139-21ssh09:51:182
29725040,0irq/27-eth0-tx-3089-21ssh11:31:252
29725040,0irq/27-eth0-tx-0-21swapper/212:22:102
29725040,0irq/27-eth0-tx-0-21swapper/211:57:172
29725040,0irq/27-eth0-tx-0-21swapper/211:41:192
29725040,0irq/27-eth0-tx-0-21swapper/211:16:592
29725040,0irq/27-eth0-tx-0-21swapper/210:51:322
29725040,0irq/27-eth0-tx-0-21swapper/210:36:072
29725040,0irq/27-eth0-tx-0-21swapper/210:32:162
29725040,0irq/27-eth0-tx-0-21swapper/210:06:152
29725040,0irq/27-eth0-tx-0-21swapper/210:02:012
29725040,0irq/27-eth0-tx-0-21swapper/209:31:102
29725040,0irq/27-eth0-tx-0-21swapper/209:26:242
29725040,0irq/27-eth0-tx-0-21swapper/209:06:142
29725040,0irq/27-eth0-tx-0-21swapper/008:51:200
29725040,0irq/27-eth0-tx-0-21swapper/008:46:310
29725040,0irq/27-eth0-tx-0-21swapper/008:31:260
29725040,0irq/27-eth0-tx-0-21swapper/007:46:290
29725040,0irq/27-eth0-tx-0-21swapper/007:26:200
29725040,0irq/27-eth0-tx-0-21swapper/006:56:190
29715040,0irq/26-eth0-rx-19344-21tr07:01:253
29715040,0irq/26-eth0-rx-0-21swapper/312:15:203
29715040,0irq/26-eth0-rx-0-21swapper/311:35:033
29715040,0irq/26-eth0-rx-0-21swapper/311:11:243
29715040,0irq/26-eth0-rx-0-21swapper/310:44:173
29715040,0irq/26-eth0-rx-0-21swapper/309:31:183
29715040,0irq/26-eth0-rx-0-21swapper/307:11:203
259940,0migration/231926-21kthreadcore07:36:252
259940,0migration/231135-21kthreadcore07:11:252
259940,0migration/221666-21kthreadcore08:16:252
259940,0migration/216243-21sh07:26:202
259940,0migration/213705-21cpu12:01:182
249940,0watchdog/231304-21aten_r1power_en08:26:182
249940,0watchdog/222503-21munin-node11:46:212
249940,0watchdog/211615-21head08:31:302
249940,0watchdog/20-21swapper/209:37:222
249940,0watchdog/20-21swapper/209:01:262
249940,0watchdog/20-21swapper/207:16:222
19140,0ktimersoftd/10-21swapper/108:58:011
179940,0migration/18772-21kthreadcore11:56:231
179940,0migration/16570-21taskset10:16:161
179940,0migration/16506-21kthreadcore07:16:261
179940,0migration/15843-21irqrtprio08:06:241
179940,0migration/131177-21kthreadcore11:51:241
179940,0migration/12900-21kthreadcore10:31:241
179940,0migration/125632-21kthreadcore11:46:241
179940,0migration/11912-21unixbench-2d07:11:311
179940,0migration/118970-21kthreadcore07:01:251
179940,0migration/112597-21sh09:36:271
179940,0migration/111369-21aten_r1power_cu08:11:201
179940,0migration/11134-21kthreadcore09:31:241
169940,0watchdog/16559-21runrttasks08:04:221
169940,0watchdog/16327-21fschecks_time11:36:211
169940,0watchdog/16320-21cpuspeed_turbos10:56:171
169940,0watchdog/14011-21kthreadcore09:11:261
169940,0watchdog/129883-21ssh09:48:181
169940,0watchdog/126070-21kthreadcore09:26:261
169940,0watchdog/119965-21irqcore08:41:221
169940,0watchdog/118257-21kthreadcore09:01:261
169940,0watchdog/111613-21grep08:31:301
169940,0watchdog/10-21swapper/111:08:091
169940,0watchdog/10-21swapper/109:21:301
169940,0watchdog/10-21swapper/107:51:261
169940,0watchdog/10-21swapper/107:41:261
169940,0watchdog/10-21swapper/107:06:261
149940,0migration/09561-21aten_r1power_po07:21:190
149940,0migration/03450-21kthreadcore09:31:250
149940,0migration/030334-21latency_hist10:51:070
149940,0migration/026979-21kthreadcore09:26:260
149940,0migration/024626-21kthreadcore11:06:240
149940,0migration/020606-21sensors_fan10:01:290
149940,0migration/016996-21latency_hist07:51:080
149940,0migration/015930-21hwlatdetect07:01:220
149940,0migration/014247-21kthreadcore08:36:240
149940,0migration/010116-21kthreadcore09:36:240
82629932,0cyclictest3556-21lldpd07:01:192
82609933,0cyclictest3556-21lldpd08:16:501
82609933,0cyclictest0-21swapper/106:56:271
82609932,0cyclictest3556-21lldpd08:27:501
82609932,0cyclictest3514-21snmpd07:58:391
82609932,0cyclictest3514-21snmpd07:21:231
82609932,0cyclictest25528-21awk08:21:241
82609932,0cyclictest16936-21kthreadcore11:21:231
82599932,0cyclictest966-21grep10:11:260
82599932,0cyclictest3514-21snmpd11:37:120
82599932,0cyclictest3241-21irqbalance11:31:260
82599932,0cyclictest32111-21awk09:11:230
82599932,0cyclictest28131-21sensors10:46:280
82599932,0cyclictest25415-21kthreadcore12:06:210
82599932,0cyclictest20842-21pluginstate09:21:280
82599932,0cyclictest14674-21gltestperf11:21:200
82599932,0cyclictest14090-21perf10:41:070
82599930,0cyclictest22354-21diskstats11:26:200
82599930,0cyclictest0-21swapper/011:16:440
29715030,0irq/26-eth0-rx-0-21swapper/308:36:193
29715030,0irq/26-eth0-rx-0-21swapper/308:31:183
29715030,0irq/26-eth0-rx-0-21swapper/307:57:493
29715030,0irq/26-eth0-rx-0-21swapper/307:46:193
29715030,0irq/26-eth0-rx-0-21swapper/307:20:263
29715030,0irq/26-eth0-rx-0-21swapper/307:06:273
249930,0watchdog/20-21swapper/208:41:182
249930,0watchdog/20-21swapper/207:41:142
169930,0watchdog/128024-21kthreadcore09:06:261
169930,0watchdog/10-21swapper/112:02:091
169930,0watchdog/10-21swapper/110:41:181
169930,0watchdog/10-21swapper/108:51:261
82599920,0cyclictest14077-21latency_hist10:41:070
82599920,0cyclictest0-21swapper/010:16:070
169920,0watchdog/10-21swapper/107:26:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional