You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 23:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Wed Jul 22, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450560,0irq/25-eth10-21swapper/306:48:073
155723725,0sleep20-21swapper/206:46:122
164323526,0sleep10-21swapper/106:47:121
154422622,0sleep00-21swapper/006:46:020
35160,0ktimersoftd/30-21swapper/310:15:263
339960,0migration/331836-21needreboot12:09:223
339960,0migration/327609-21sh10:44:433
339960,0migration/322344-21sh09:41:463
29715060,0irq/26-eth0-rx-9063-21sh12:17:293
29715060,0irq/26-eth0-rx-32556-21aten2.4-expect09:09:163
29715060,0irq/26-eth0-rx-2910-21unixbench-2d10:49:273
259960,0migration/215088-21kthreadcore10:39:222
19160,0ktimersoftd/10-21swapper/109:06:051
18789960,0cyclictest0-21swapper/110:44:211
18769960,0cyclictest32562-21diskmemload10:29:230
8215050,0irq/24-0000:00:0-21swapper/207:29:052
4150,0ktimersoftd/00-21swapper/009:01:160
35150,0ktimersoftd/30-21swapper/311:30:293
339950,0migration/34156-21sh11:14:093
339950,0migration/33628-21fschecks_count07:14:183
339950,0migration/3331-21kthreadcore07:59:223
339950,0migration/33274-21fschecks_time11:54:183
339950,0migration/331148-21irqrtprio10:29:203
339950,0migration/330307-21runrttasks09:47:003
339950,0migration/326311-21irqrtprio08:19:203
339950,0migration/321754-21munin-node11:04:203
339950,0migration/318254-21sh11:19:303
339950,0migration/317975-21taskset08:11:043
339950,0migration/317515-21kthreadcore08:34:243
339950,0migration/315380-21fschecks_count09:59:183
339950,0migration/314953-21taskset06:55:383
339950,0migration/312285-21kthreadcore11:59:203
29725050,0irq/27-eth0-tx-9071-21ssh11:55:112
29725050,0irq/27-eth0-tx-6559-21runrttasks11:24:492
29725050,0irq/27-eth0-tx-5133-21munin-node08:04:240
29725050,0irq/27-eth0-tx-4411-21kthreadcore12:14:202
29725050,0irq/27-eth0-tx-31779-21munin-node08:24:190
29725050,0irq/27-eth0-tx-28375-21ssh10:25:052
29725050,0irq/27-eth0-tx-2721-21ssh08:49:200
29725050,0irq/27-eth0-tx-24688-21irqstats09:44:222
29725050,0irq/27-eth0-tx-22166-21munin-node07:04:270
29725050,0irq/27-eth0-tx-22072-21ssh10:02:482
29725050,0irq/27-eth0-tx-19312-21ssh11:44:162
29725050,0irq/27-eth0-tx-14149-21munin-node10:19:192
29725050,0irq/27-eth0-tx-11798-21munin-node08:09:260
29725050,0irq/27-eth0-tx-11150-21ntp_offset10:34:242
29725050,0irq/27-eth0-tx-0-21swapper/210:59:552
29725050,0irq/27-eth0-tx-0-21swapper/210:04:072
29725050,0irq/27-eth0-tx-0-21swapper/209:57:232
29725050,0irq/27-eth0-tx-0-21swapper/008:29:220
29725050,0irq/27-eth0-tx-0-21swapper/008:16:530
29715050,0irq/26-eth0-rx-8200-21sh09:14:163
29715050,0irq/26-eth0-rx-7198-21cpuspeed_turbos09:54:163
29715050,0irq/26-eth0-rx-6871-21grep10:54:213
29715050,0irq/26-eth0-rx-4722-21python09:49:253
29715050,0irq/26-eth0-rx-32223-21fschecks_count08:24:183
29715050,0irq/26-eth0-rx-24618-21perl09:24:183
29715050,0irq/26-eth0-rx-21642-21taskset10:23:373
29715050,0irq/26-eth0-rx-16488-21grep10:59:203
29715050,0irq/26-eth0-rx-14952-21cat10:39:223
29715050,0irq/26-eth0-rx-1152-21tail08:49:163
29715050,0irq/26-eth0-rx-0-21swapper/311:50:223
29715050,0irq/26-eth0-rx-0-21swapper/311:44:413
29715050,0irq/26-eth0-rx-0-21swapper/311:39:273
29715050,0irq/26-eth0-rx-0-21swapper/311:34:233
29715050,0irq/26-eth0-rx-0-21swapper/311:25:383
29715050,0irq/26-eth0-rx-0-21swapper/311:09:363
29715050,0irq/26-eth0-rx-0-21swapper/310:34:223
29715050,0irq/26-eth0-rx-0-21swapper/310:04:223
29715050,0irq/26-eth0-rx-0-21swapper/309:38:243
29715050,0irq/26-eth0-rx-0-21swapper/309:38:243
29715050,0irq/26-eth0-rx-0-21swapper/309:29:213
29715050,0irq/26-eth0-rx-0-21swapper/308:55:383
259950,0migration/23134-21kthreadcore09:09:222
259950,0migration/227257-21aten_r1power_vo11:49:152
259950,0migration/223886-21missed_timers12:04:212
259950,0migration/221796-21munin-node07:24:242
259950,0migration/220089-21kthreadcore08:14:222
259950,0migration/217080-21latency08:09:232
259950,0migration/216285-21latency_hist07:24:052
259950,0migration/215371-21latency_hist09:39:052
259950,0migration/213371-21kthreadcore11:59:202
259950,0migration/212489-21kthreadcore08:54:232
259950,0migration/211900-21kthreadcore09:14:222
259950,0migration/211041-21cpuspeed_turbos07:44:172
259950,0migration/21027-21kthreadcore09:29:202
249950,0watchdog/23389-21grep07:34:312
249950,0watchdog/222161-21users09:19:272
249950,0watchdog/212023-21python10:14:262
19150,0ktimersoftd/10-21swapper/111:02:381
18799955,0cyclictest32562-21diskmemload09:49:082
18799955,0cyclictest0-21swapper/211:23:062
18799955,0cyclictest0-21swapper/208:24:192
18799950,0cyclictest0-21swapper/211:38:232
18799950,0cyclictest0-21swapper/210:33:072
18799950,0cyclictest0-21swapper/209:04:592
18799950,0cyclictest0-21swapper/208:44:302
18789955,0cyclictest0-21swapper/109:40:201
18789950,0cyclictest0-21swapper/110:55:421
18789950,0cyclictest0-21swapper/110:27:191
18789950,0cyclictest0-21swapper/110:16:361
18789950,0cyclictest0-21swapper/109:57:031
18769955,0cyclictest0-21swapper/009:44:370
18769950,0cyclictest0-21swapper/011:38:460
18769950,0cyclictest0-21swapper/011:23:280
18769950,0cyclictest0-21swapper/010:11:160
18769950,0cyclictest0-21swapper/007:59:270
179950,0migration/19063-21unixbench_multi07:14:281
179950,0migration/128577-21idleruntime-cro07:09:051
179950,0migration/125276-21timerwakeupswit08:39:281
179950,0migration/124400-21latency_hist09:04:051
179950,0migration/119497-21irqcore08:14:211
179950,0migration/117158-21kthreadcore09:59:211
179950,0migration/115362-21irqrtprio10:19:211
169950,0watchdog/15876-21gltestperf08:04:191
169950,0watchdog/13392-21unixbench_singl07:34:311
169950,0watchdog/123034-21tr11:44:221
169950,0watchdog/122160-21ssh09:19:271
169950,0watchdog/113762-21kthreadcore11:39:221
149950,0migration/09387-21kthreadcore11:14:200
149950,0migration/06949-21kthreadcore11:54:220
149950,0migration/06071-21kthreadcore06:49:210
149950,0migration/03390-21taskset10:50:280
149950,0migration/030253-21fschecks_count07:34:210
149950,0migration/028822-21kthreadcore11:49:200
149950,0migration/028707-21aten_r1power_en11:09:140
149950,0migration/028356-21kthreadcore08:44:220
149950,0migration/027234-21kthreadcore09:04:240
149950,0migration/023905-21kthreadcore08:39:230
149950,0migration/021999-21fschecks_time10:44:170
149950,0migration/020598-21fschecks_time11:24:170
149950,0migration/020568-21diskmemload10:42:190
149950,0migration/020485-21sh10:20:020
149950,0migration/01720-21kthreadcore09:49:210
149950,0migration/017119-21kthreadcore06:59:210
149950,0migration/015489-21munin-node09:39:160
339940,0migration/37349-21kthreadcore06:49:223
339940,0migration/36862-21gltestperf08:29:163
339940,0migration/325942-21kthreadcore07:54:223
339940,0migration/324716-21kthreadcore10:24:213
339940,0migration/320771-21kthreadcore08:39:223
339940,0migration/31567-21kthreadcore07:34:253
339940,0migration/311261-21fschecks_count07:44:193
29725040,0irq/27-eth0-tx-5122-21if_eth111:14:172
29725040,0irq/27-eth0-tx-32160-21kthreadcore10:49:212
29725040,0irq/27-eth0-tx-30588-21ssh10:09:052
29725040,0irq/27-eth0-tx-29502-21cat11:29:222
29725040,0irq/27-eth0-tx-23124-21munin-node07:29:200
29725040,0irq/27-eth0-tx-0-21swapper/212:09:282
29725040,0irq/27-eth0-tx-0-21swapper/210:55:142
29725040,0irq/27-eth0-tx-0-21swapper/210:44:202
29725040,0irq/27-eth0-tx-0-21swapper/209:34:102
29725040,0irq/27-eth0-tx-0-21swapper/209:34:102
29725040,0irq/27-eth0-tx-0-21swapper/208:59:452
29725040,0irq/27-eth0-tx-0-21swapper/006:54:240
29715040,0irq/26-eth0-rx-0-21swapper/312:07:543
29715040,0irq/26-eth0-rx-0-21swapper/310:09:153
29715040,0irq/26-eth0-rx-0-21swapper/309:19:383
29715040,0irq/26-eth0-rx-0-21swapper/309:05:583
29715040,0irq/26-eth0-rx-0-21swapper/308:59:373
259940,0migration/26495-21df_inode08:29:152
259940,0migration/24683-21kthreadcore07:14:222
259940,0migration/220879-21kthreadcore07:49:222
259940,0migration/21837-21munin-node07:09:232
259940,0migration/218183-21kthreadcore06:59:212
259940,0migration/21012-21fschecks_time08:49:162
249940,0watchdog/29448-21cut06:54:192
249940,0watchdog/25875-21cut08:04:192
249940,0watchdog/222166-21munin-node07:04:192
249940,0watchdog/21750-21awk11:09:222
249940,0watchdog/20-21swapper/211:39:222
249940,0watchdog/20-21swapper/211:04:182
249940,0watchdog/20-21swapper/207:59:232
249940,0watchdog/20-21swapper/207:54:232
18799943,0cyclictest3241-21irqbalance08:39:232
18799943,0cyclictest24855-21awk09:24:192
18789944,0cyclictest0-21swapper/111:19:111
18789943,0cyclictest4974-21awk07:39:211
18789943,0cyclictest3556-21lldpd12:09:121
18789943,0cyclictest3556-21lldpd11:54:131
18789943,0cyclictest3556-21lldpd10:09:131
18789943,0cyclictest29649-21awk07:09:181
18789943,0cyclictest23640-21awk10:04:201
18789943,0cyclictest11501-21awk11:59:181
18769944,0cyclictest0-21swapper/012:06:300
18769944,0cyclictest0-21swapper/009:26:200
18769944,0cyclictest0-21swapper/009:21:070
18769943,0cyclictest4061-21awk07:14:200
18769943,0cyclictest3556-21lldpd12:09:420
18769943,0cyclictest3556-21lldpd10:04:130
18769943,0cyclictest3556-21lldpd09:58:130
18769943,0cyclictest3556-21lldpd08:38:410
18769943,0cyclictest3514-21snmpd11:47:560
18769943,0cyclictest26059-21awk08:19:190
18769943,0cyclictest21585-21awk11:04:190
18769943,0cyclictest18453-21awk07:49:200
18769941,0cyclictest0-21swapper/007:39:170
18769940,0cyclictest0-21swapper/011:44:030
18769940,0cyclictest0-21swapper/009:10:150
179940,0migration/1953-21kthreadcore08:24:221
179940,0migration/18145-21latency_hist09:14:051
179940,0migration/16286-21diskmemload09:31:091
179940,0migration/16168-21fschecks_time10:34:181
179940,0migration/15019-21kthreadcore12:14:201
179940,0migration/132343-21kthreadcore11:09:211
179940,0migration/130921-21munin-node10:29:191
179940,0migration/127265-21irqcore08:44:221
179940,0migration/126389-21kthreadcore09:24:211
179940,0migration/126329-21munin-node11:04:241
179940,0migration/124723-21fschecks_time07:54:191
179940,0migration/120792-21hwlatdetect11:24:181
179940,0migration/114338-21kthreadcore08:09:221
179940,0migration/112542-21kthreadcore09:34:241
179940,0migration/112542-21kthreadcore09:34:241
179940,0migration/110491-21kthreadcore08:29:201
169940,0watchdog/18813-21fschecks_count08:54:191
169940,0watchdog/14953-21kthreadcore09:09:231
169940,0watchdog/13965-21ssh10:52:101
169940,0watchdog/121077-21kthreadcore07:24:231
169940,0watchdog/113130-21df08:34:191
169940,0watchdog/11052-21ssh11:50:101
169940,0watchdog/10-21swapper/109:53:101
169940,0watchdog/10-21swapper/109:44:141
169940,0watchdog/10-21swapper/107:29:231
169940,0watchdog/10-21swapper/107:19:191
169940,0watchdog/10-21swapper/106:54:191
149940,0migration/09012-21hwlatdetect09:14:190
149940,0migration/08457-21aten_r1power_fr08:54:170
149940,0migration/07516-21irqrtprio10:14:210
149940,0migration/07010-21kthreadcore10:54:210
149940,0migration/06398-21diskmemload10:34:190
149940,0migration/027946-21aten_r1power_en11:29:160
149940,0migration/025385-21kthreadcore10:24:210
149940,0migration/02157-21kthreadcore09:29:200
149940,0migration/015681-21kthreadcore07:44:230
149940,0migration/014704-21kthreadcore11:59:210
339930,0migration/328807-21munin-node07:29:273
339930,0migration/328553-21taskset07:09:003
29715030,0irq/26-eth0-rx-0-21swapper/308:44:173
29715030,0irq/26-eth0-rx-0-21swapper/308:15:293
29715030,0irq/26-eth0-rx-0-21swapper/308:04:213
29715030,0irq/26-eth0-rx-0-21swapper/307:50:223
29715030,0irq/26-eth0-rx-0-21swapper/307:20:323
29715030,0irq/26-eth0-rx-0-21swapper/307:09:213
29715030,0irq/26-eth0-rx-0-21swapper/306:59:063
249930,0watchdog/20-21swapper/208:19:152
18799932,0cyclictest5060-21kthreadcore06:49:212
18799930,0cyclictest4486-21df_inode07:39:182
18799930,0cyclictest13196-21df_inode08:34:192
18789933,0cyclictest3556-21lldpd06:59:111
18789933,0cyclictest32562-21diskmemload10:43:141
18789932,0cyclictest3556-21lldpd11:34:131
18789932,0cyclictest28880-21awk11:29:211
18789932,0cyclictest20583-21kthreadcore07:49:221
18789932,0cyclictest19386-21awk12:04:181
18789932,0cyclictest1414-21irqcore08:49:191
18789930,0cyclictest9851-21ssh11:14:231
18769932,0cyclictest8429-21awk09:34:200
18769932,0cyclictest8429-21awk09:34:200
18769932,0cyclictest29727-21awk07:09:190
18769932,0cyclictest2866-21awk12:14:190
18769932,0cyclictest15478-21sensors07:19:270
18769931,0cyclictest0-21swapper/007:24:220
18769930,0cyclictest25174-21iostat_ios07:54:210
18769930,0cyclictest15248-21diskstats09:59:170
169930,0watchdog/115470-21kthreadcore07:44:231
169930,0watchdog/10-21swapper/108:19:151
169930,0watchdog/10-21swapper/107:59:231
169930,0watchdog/10-21swapper/106:49:151
29715020,0irq/26-eth0-rx-0-21swapper/307:39:053
29715020,0irq/26-eth0-rx-0-21swapper/307:24:273
18769921,0cyclictest12871-21aten_r1power_fr10:59:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional