You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-30 - 17:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Tue Jun 30, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1775923723,0sleep00-21swapper/006:50:240
304450350,0irq/25-eth10-21swapper/306:46:273
1771323526,0sleep20-21swapper/206:49:542
1769722824,0sleep10-21swapper/106:49:411
339960,0migration/35282-21sh12:03:213
339960,0migration/331030-21latency_hist11:41:103
339960,0migration/330548-21sh11:19:033
339960,0migration/330037-21pmu-power10:16:303
339960,0migration/328871-21unixbench-2d11:56:303
339960,0migration/325424-21kernelversion10:36:273
29715060,0irq/26-eth0-rx-32091-21tune2fs07:01:243
29715060,0irq/26-eth0-rx-21842-21rt-features10:31:313
29715060,0irq/26-eth0-rx-16591-21iostat_ios11:11:273
29715060,0irq/26-eth0-rx-10476-21kthreadcore09:26:263
27160,0ktimersoftd/20-21swapper/210:11:272
19160,0ktimersoftd/10-21swapper/110:11:271
178989966,0cyclictest16111-21diskmemload10:01:111
178989960,0cyclictest0-21swapper/111:20:201
178969966,0cyclictest0-21swapper/009:11:350
149960,0migration/024393-21hwlatdetect11:16:240
8215050,0irq/24-0000:00:8337-21cat10:06:102
4150,0ktimersoftd/00-21swapper/010:33:430
35150,0ktimersoftd/30-21swapper/311:47:213
339950,0migration/36294-21taskset07:29:303
339950,0migration/35827-21taskset11:02:073
339950,0migration/329113-21kthreadcore10:56:273
339950,0migration/32897-21if_eth1.308:16:263
339950,0migration/328679-21kthreadcore06:56:283
339950,0migration/327441-21kthreadcore12:16:283
339950,0migration/326153-21fschecks_count07:21:243
339950,0migration/322642-21smart_sdb09:31:333
339950,0migration/321374-21taskset08:27:063
339950,0migration/317625-21irqrtprio08:51:273
339950,0migration/31655-21kthreadcore11:41:273
339950,0migration/315052-21runrttasks10:28:553
339950,0migration/314692-21taskset11:30:193
339950,0migration/313848-21fschecks_count07:36:233
29725050,0irq/27-eth0-tx-30508-21ssh08:56:442
29725050,0irq/27-eth0-tx-22910-21users09:11:332
29725050,0irq/27-eth0-tx-21014-21munin-node08:06:310
29725050,0irq/27-eth0-tx-14795-21unixbench-2d09:26:332
29725050,0irq/27-eth0-tx-13334-21munin-node07:36:340
29725050,0irq/27-eth0-tx-0-21swapper/212:19:082
29725050,0irq/27-eth0-tx-0-21swapper/211:18:402
29725050,0irq/27-eth0-tx-0-21swapper/210:16:262
29725050,0irq/27-eth0-tx-0-21swapper/209:17:102
29725050,0irq/27-eth0-tx-0-21swapper/008:51:250
29725050,0irq/27-eth0-tx-0-21swapper/008:41:240
29725050,0irq/27-eth0-tx-0-21swapper/008:32:490
29725050,0irq/27-eth0-tx-0-21swapper/007:41:220
29725050,0irq/27-eth0-tx-0-21swapper/007:25:180
29725050,0irq/27-eth0-tx-0-21swapper/006:59:480
29715050,0irq/26-eth0-rx-8621-21cpu10:06:233
29715050,0irq/26-eth0-rx-5417-21ls10:21:283
29715050,0irq/26-eth0-rx-498-21cpuspeed_turbos10:01:223
29715050,0irq/26-eth0-rx-28819-21grep09:16:283
29715050,0irq/26-eth0-rx-28363-21kthreadcore08:56:283
29715050,0irq/26-eth0-rx-24168-21munin-run10:16:103
29715050,0irq/26-eth0-rx-16048-21sed11:31:233
29715050,0irq/26-eth0-rx-0-21swapper/311:51:233
29715050,0irq/26-eth0-rx-0-21swapper/311:21:273
29715050,0irq/26-eth0-rx-0-21swapper/311:07:403
29715050,0irq/26-eth0-rx-0-21swapper/310:52:063
29715050,0irq/26-eth0-rx-0-21swapper/310:44:233
29715050,0irq/26-eth0-rx-0-21swapper/309:56:273
29715050,0irq/26-eth0-rx-0-21swapper/309:52:183
29715050,0irq/26-eth0-rx-0-21swapper/309:50:483
29715050,0irq/26-eth0-rx-0-21swapper/309:41:243
29715050,0irq/26-eth0-rx-0-21swapper/309:37:163
29715050,0irq/26-eth0-rx-0-21swapper/309:23:373
29715050,0irq/26-eth0-rx-0-21swapper/307:56:293
27150,0ktimersoftd/20-21swapper/211:47:212
27150,0ktimersoftd/20-21swapper/209:05:282
259950,0migration/28754-21cpuspeed_turbos09:06:222
259950,0migration/232337-21sendmail_mailqu07:46:332
259950,0migration/231817-21sh11:01:192
259950,0migration/229692-21munin-node10:36:302
259950,0migration/215914-21sh11:51:242
19150,0ktimersoftd/10-21swapper/111:47:211
19150,0ktimersoftd/10-21swapper/109:05:281
179029950,0cyclictest16111-21diskmemload11:44:472
179029950,0cyclictest0-21swapper/211:39:062
179029950,0cyclictest0-21swapper/211:30:072
179029950,0cyclictest0-21swapper/209:48:542
178989955,0cyclictest16111-21diskmemload09:45:441
178989955,0cyclictest0-21swapper/112:13:271
178989955,0cyclictest0-21swapper/111:36:531
178989955,0cyclictest0-21swapper/111:07:141
178989955,0cyclictest0-21swapper/110:18:411
178989955,0cyclictest0-21swapper/109:30:361
178989955,0cyclictest0-21swapper/109:20:591
178989955,0cyclictest0-21swapper/107:36:371
178989950,0cyclictest0-21swapper/111:52:101
178989950,0cyclictest0-21swapper/110:27:121
178989950,0cyclictest0-21swapper/109:55:211
178989950,0cyclictest0-21swapper/109:49:311
178969955,0cyclictest0-21swapper/012:02:570
178969955,0cyclictest0-21swapper/010:36:340
178969955,0cyclictest0-21swapper/009:32:330
178969954,0cyclictest8596-21kthreadcore07:31:280
178969950,0cyclictest0-21swapper/011:35:310
178969950,0cyclictest0-21swapper/010:04:520
179950,0migration/17171-21taskset07:52:541
179950,0migration/132538-21munin-node11:21:251
179950,0migration/130137-21switchtime08:56:331
179950,0migration/12335-21kthreadcore07:01:291
179950,0migration/116886-21hddtemp_smartct10:31:231
169950,0watchdog/121068-21ls08:26:331
169950,0watchdog/111081-21kthreadcore07:31:291
149950,0migration/09137-21gltestperf10:06:240
149950,0migration/08961-21idleruntime10:26:250
149950,0migration/07695-21kthreadcore07:06:280
149950,0migration/07244-21cpuspeed_turbos11:46:210
149950,0migration/0500-21latency_hist09:21:100
149950,0migration/031706-21munin-node11:21:220
149950,0migration/031320-21aten_r1power_fr11:41:210
149950,0migration/030386-21kthreadcore07:46:280
149950,0migration/028579-21kthreadcore10:16:270
149950,0migration/028172-21fschecks_count08:11:240
149950,0migration/027899-21kthreadcore11:56:250
149950,0migration/02552-21kthreadcore09:01:270
149950,0migration/022203-21munin-node09:51:310
149950,0migration/021538-21timerwakeupswit11:11:340
149950,0migration/020831-21kthreadcore06:51:280
149950,0migration/018775-21kthreadcore11:51:270
149950,0migration/018356-21kthreadcore10:51:290
149950,0migration/018256-21kthreadcore08:26:270
149950,0migration/013174-21munin-node11:06:310
149950,0migration/012522-21kthreadcore09:26:270
149950,0migration/012379-21kthreadcore07:56:290
149950,0migration/010250-21kthreadcore12:06:270
339940,0migration/39766-21irqrtprio09:06:263
339940,0migration/3898-21sensors_fan08:11:323
339940,0migration/37415-21gltestperf07:31:253
339940,0migration/34052-21kthreadcore07:51:253
339940,0migration/33674-21gltestperf08:41:243
339940,0migration/322615-21kthreadcore07:41:273
339940,0migration/318273-21kthreadcore08:01:283
339940,0migration/312850-21diskmemload12:06:533
29725040,0irq/27-eth0-tx-8277-21entropy10:46:232
29725040,0irq/27-eth0-tx-798-21hwlatdetect10:21:242
29725040,0irq/27-eth0-tx-24843-21ssh09:36:132
29725040,0irq/27-eth0-tx-20805-21ssh11:31:292
29725040,0irq/27-eth0-tx-0-21swapper/211:57:082
29725040,0irq/27-eth0-tx-0-21swapper/211:06:122
29725040,0irq/27-eth0-tx-0-21swapper/210:56:112
29725040,0irq/27-eth0-tx-0-21swapper/210:51:342
29725040,0irq/27-eth0-tx-0-21swapper/210:26:282
29725040,0irq/27-eth0-tx-0-21swapper/210:01:182
29725040,0irq/27-eth0-tx-0-21swapper/209:56:162
29725040,0irq/27-eth0-tx-0-21swapper/008:36:340
29715040,0irq/26-eth0-rx-9678-21aten2.4-expect08:46:233
29715040,0irq/26-eth0-rx-0-21swapper/312:13:453
29715040,0irq/26-eth0-rx-0-21swapper/310:48:413
29715040,0irq/26-eth0-rx-0-21swapper/309:14:243
29715040,0irq/26-eth0-rx-0-21swapper/309:01:273
29715040,0irq/26-eth0-rx-0-21swapper/306:51:283
259940,0migration/29818-21cpu08:46:242
259940,0migration/29580-21kthreadcore07:56:282
259940,0migration/25670-21sensors_temp07:26:322
259940,0migration/24364-21munin-node07:01:292
259940,0migration/22231-21kernelversion07:51:252
259940,0migration/221909-21kthreadcore09:51:302
259940,0migration/218504-21kthreadcore11:11:282
259940,0migration/218458-21kthreadcore10:31:262
259940,0migration/217492-21fschecks_time09:31:242
259940,0migration/215558-21irqrtprio08:01:272
259940,0migration/211632-21timerwakeupswit07:06:342
259940,0migration/210886-21kthreadcore12:06:282
249940,0watchdog/29439-21hwlatdetect08:21:252
249940,0watchdog/23430-21kthreadcore12:01:282
249940,0watchdog/211083-21kthreadcore07:31:292
249940,0watchdog/20-21swapper/207:19:412
179029943,0cyclictest3881-21awk08:41:252
179029943,0cyclictest3556-21lldpd11:21:222
179029943,0cyclictest3556-21lldpd08:27:492
179029943,0cyclictest3556-21lldpd07:45:182
179029943,0cyclictest3556-21lldpd07:21:172
179029943,0cyclictest3556-21lldpd06:53:182
179029943,0cyclictest3514-21snmpd10:41:152
179029943,0cyclictest3514-21snmpd08:11:152
179029943,0cyclictest3514-21snmpd08:06:152
179029943,0cyclictest3514-21snmpd07:11:152
179029943,0cyclictest29553-21awk08:36:272
179029943,0cyclictest25668-21awk06:56:262
179029943,0cyclictest17343-21awk08:51:262
179029943,0cyclictest1637-21awk09:21:262
179029943,0cyclictest15476-21awk12:11:252
179029943,0cyclictest14187-21awk07:36:242
179029941,0cyclictest0-21swapper/209:41:212
178989944,0cyclictest0-21swapper/109:38:101
178989943,0cyclictest6670-21awk07:06:271
178989943,0cyclictest524-21awk10:41:261
178989943,0cyclictest3556-21lldpd12:19:521
178989943,0cyclictest3556-21lldpd10:56:221
178989943,0cyclictest3556-21lldpd10:51:221
178989943,0cyclictest3556-21lldpd10:40:521
178989943,0cyclictest3556-21lldpd07:16:481
178989943,0cyclictest26553-21awk07:21:261
178989943,0cyclictest23764-21awk11:56:221
178989943,0cyclictest1548-21awk09:21:261
178969944,0cyclictest0-21swapper/012:19:400
178969943,0cyclictest3556-21lldpd10:15:510
178969943,0cyclictest3556-21lldpd08:46:500
178969943,0cyclictest3514-21snmpd10:43:150
178969943,0cyclictest3514-21snmpd07:51:150
178969943,0cyclictest15461-21awk12:11:250
178969940,0cyclictest32472-21munin-run10:01:100
179940,0migration/19108-21kthreadcore07:56:281
179940,0migration/18225-21df_abs10:46:221
179940,0migration/17263-21kthreadcore08:41:271
179940,0migration/17237-21fschecks_time12:06:231
179940,0migration/15776-21kthreadcore08:16:281
179940,0migration/15680-21taskset11:43:261
179940,0migration/12813-21kthreadcore07:26:281
179940,0migration/124474-21runrttasks06:55:431
179940,0migration/12266-21kthreadcore12:01:281
179940,0migration/121538-21kthreadcore09:11:271
179940,0migration/120061-21kthreadcore11:11:281
179940,0migration/117907-21kthreadcore08:51:281
179940,0migration/115343-21aten_r1power_en11:31:201
179940,0migration/112117-21kthreadcore10:06:291
179940,0migration/111035-21kthreadcore11:26:281
169940,0watchdog/126301-21kthreadcore08:31:291
169940,0watchdog/10-21swapper/108:46:251
169940,0watchdog/10-21swapper/108:36:251
169940,0watchdog/10-21swapper/108:21:251
149940,0migration/09094-21fschecks_count09:46:230
149940,0migration/06183-21taskset11:03:080
149940,0migration/04215-21kthreadcore09:41:270
149940,0migration/03370-21kthreadcore10:21:270
149940,0migration/027918-21kthreadcore10:56:270
149940,0migration/026898-21kthreadcore09:16:280
149940,0migration/026604-21kthreadcore09:36:290
149940,0migration/025233-21sh08:56:260
149940,0migration/01925-21kthreadcore07:01:280
149940,0migration/015992-21kthreadcore07:11:280
149940,0migration/012857-21kthreadcore08:21:280
29715030,0irq/26-eth0-rx-0-21swapper/308:36:233
29715030,0irq/26-eth0-rx-0-21swapper/308:21:223
29715030,0irq/26-eth0-rx-0-21swapper/307:16:253
29715030,0irq/26-eth0-rx-0-21swapper/307:11:223
29715030,0irq/26-eth0-rx-0-21swapper/307:10:413
249930,0watchdog/20-21swapper/208:31:252
179029932,0cyclictest2770-21awk08:16:252
178989933,0cyclictest3556-21lldpd07:11:171
178989932,0cyclictest9370-21awk09:06:251
178989932,0cyclictest3556-21lldpd08:01:191
178989932,0cyclictest32363-21sensors07:46:331
178989932,0cyclictest28623-21awk08:11:261
178989930,0cyclictest20395-21diskstats07:41:231
178969933,0cyclictest9421-21kworker/0:011:36:130
178969933,0cyclictest9421-21kworker/0:011:26:530
178969933,0cyclictest9421-21kworker/0:010:46:170
178969933,0cyclictest31290-21kworker/0:109:07:220
178969933,0cyclictest31290-21kworker/0:108:16:180
178969933,0cyclictest31290-21kworker/0:108:01:160
178969933,0cyclictest31290-21kworker/0:107:26:240
178969933,0cyclictest31290-21kworker/0:107:16:160
179930,0migration/130843-21runrttasks06:57:071
169930,0watchdog/122190-21ssh09:31:291
169930,0watchdog/10-21swapper/111:01:241
169930,0watchdog/10-21swapper/110:21:241
169930,0watchdog/10-21swapper/109:57:041
339920,0migration/321409-21diskstats08:06:233
29715020,0irq/26-eth0-rx-0-21swapper/308:31:153
29715020,0irq/26-eth0-rx-0-21swapper/307:46:193
178989921,0cyclictest0-21swapper/108:06:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional