You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-23 - 00:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sat Aug 22, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2243723625,0sleep20-21swapper/206:43:302
304450350,0irq/25-eth10-21swapper/306:41:103
2247423329,0sleep10-21swapper/106:43:571
2237423221,0sleep00-21swapper/006:42:480
339960,0migration/332436-21sh10:52:433
339960,0migration/331710-21sh11:12:193
339960,0migration/325617-21sh10:07:163
339960,0migration/319091-21sh09:44:423
339960,0migration/311815-21sh09:20:043
29715060,0irq/26-eth0-rx-22881-21sendmail_mailqu07:06:293
29715060,0irq/26-eth0-rx-21469-21munin-node12:06:283
29715060,0irq/26-eth0-rx-18314-21needreboot09:01:283
29715060,0irq/26-eth0-rx-10455-21basename10:21:063
29715060,0irq/26-eth0-rx-0-21swapper/311:49:203
227409966,0cyclictest20809-21diskmemload10:54:422
227409960,0cyclictest29400-21ssh11:11:252
227409960,0cyclictest0-21swapper/211:23:332
149960,0migration/04681-21sh08:56:160
149960,0migration/024861-21aten_r1power_po11:31:180
149960,0migration/023674-21sh11:28:420
149960,0migration/017176-21sh10:44:260
8215050,0irq/24-0000:00:31297-21sh12:16:062
8215050,0irq/24-0000:00:28276-21cat09:31:072
8215050,0irq/24-0000:00:12180-21latency_hist09:21:072
339950,0migration/37971-21cpuspeed_turbos08:36:193
339950,0migration/36207-21kthreadcore09:56:233
339950,0migration/34090-21kthreadcore11:56:243
339950,0migration/330440-21munin-node07:36:283
339950,0migration/330029-21smart_sda11:51:293
339950,0migration/328357-21fschecks_time09:51:213
339950,0migration/32764-21kthreadcore10:56:243
339950,0migration/323817-21munin-node07:31:303
339950,0migration/323174-21kthreadcore09:26:233
339950,0migration/321878-21kthreadcore09:46:233
339950,0migration/321286-21kthreadcore11:26:243
339950,0migration/320357-21cpuspeed_turbos08:21:183
339950,0migration/320051-21smart_sdb08:41:303
339950,0migration/320028-21munin-node07:56:223
339950,0migration/318315-21timerwakeupswit07:51:293
339950,0migration/317990-21fschecks_time11:06:213
339950,0migration/312554-21latency_hist09:01:073
339950,0migration/312329-21kthreadcore11:01:263
29725050,0irq/27-eth0-tx-3333-21fschecks_time10:16:212
29725050,0irq/27-eth0-tx-0-21swapper/211:49:312
29725050,0irq/27-eth0-tx-0-21swapper/211:31:242
29725050,0irq/27-eth0-tx-0-21swapper/210:02:412
29725050,0irq/27-eth0-tx-0-21swapper/209:56:232
29725050,0irq/27-eth0-tx-0-21swapper/209:36:202
29725050,0irq/27-eth0-tx-0-21swapper/208:49:102
29725050,0irq/27-eth0-tx-0-21swapper/008:21:170
29725050,0irq/27-eth0-tx-0-21swapper/008:13:330
29725050,0irq/27-eth0-tx-0-21swapper/007:46:180
29725050,0irq/27-eth0-tx-0-21swapper/007:41:290
29715050,0irq/26-eth0-rx-9638-21proc_pri09:36:283
29715050,0irq/26-eth0-rx-30325-21kthreadcore09:11:223
29715050,0irq/26-eth0-rx-24853-21irqrtprio12:11:233
29715050,0irq/26-eth0-rx-21830-21if_eth1.309:06:233
29715050,0irq/26-eth0-rx-16879-21open_files10:01:283
29715050,0irq/26-eth0-rx-14255-21load11:21:253
29715050,0irq/26-eth0-rx-11677-21cat10:21:233
29715050,0irq/26-eth0-rx-0-21swapper/312:01:343
29715050,0irq/26-eth0-rx-0-21swapper/311:36:423
29715050,0irq/26-eth0-rx-0-21swapper/310:43:543
29715050,0irq/26-eth0-rx-0-21swapper/310:36:363
29715050,0irq/26-eth0-rx-0-21swapper/310:11:483
29715050,0irq/26-eth0-rx-0-21swapper/309:25:033
29715050,0irq/26-eth0-rx-0-21swapper/309:25:033
29715050,0irq/26-eth0-rx-0-21swapper/308:51:253
29715050,0irq/26-eth0-rx-0-21swapper/308:48:023
29715050,0irq/26-eth0-rx-0-21swapper/308:26:193
27150,0ktimersoftd/20-21swapper/210:40:402
27150,0ktimersoftd/20-21swapper/208:56:562
259950,0migration/229883-21munin-node07:11:332
259950,0migration/221271-21munin-node12:06:262
259950,0migration/210742-21munin-node10:21:192
249950,0watchdog/216237-21ssh10:41:332
227409955,0cyclictest0-21swapper/211:37:072
227409955,0cyclictest0-21swapper/209:52:542
227409955,0cyclictest0-21swapper/209:02:552
227399950,0cyclictest8313-21ssh11:41:081
227399950,0cyclictest0-21swapper/110:46:071
227399950,0cyclictest0-21swapper/109:40:031
227389950,0cyclictest0-21swapper/011:50:130
19150,0ktimersoftd/10-21swapper/111:36:241
19150,0ktimersoftd/10-21swapper/110:12:171
179950,0migration/18190-21munin-node10:16:251
179950,0migration/14838-21munin-node08:56:191
179950,0migration/131078-21latency08:01:261
179950,0migration/126637-21munin-node08:46:271
179950,0migration/124030-21taskset11:29:481
179950,0migration/118554-21latency_hist10:26:061
179950,0migration/114791-21kthreadcore07:51:241
179950,0migration/111593-21munin-node07:01:221
169950,0watchdog/120090-21ssh09:26:011
169950,0watchdog/120090-21ssh09:26:011
169950,0watchdog/116998-21perl11:46:211
169950,0watchdog/113880-21grep09:01:251
169950,0watchdog/113451-21munin-node08:16:221
149950,0migration/09668-21hddtemp_smartct11:21:200
149950,0migration/06152-21kthreadcore06:56:250
149950,0migration/05999-21munin-node08:06:300
149950,0migration/05740-21kthreadcore10:36:240
149950,0migration/032637-21unixbench-2d08:26:300
149950,0migration/031836-21kthreadcore09:11:230
149950,0migration/031755-21sh11:55:400
149950,0migration/029770-21cpu06:51:200
149950,0migration/028198-21munin-node09:51:210
149950,0migration/026875-21sh08:46:300
149950,0migration/025014-21smart_sdb10:06:300
149950,0migration/023920-21runrttasks07:31:300
149950,0migration/023543-21munin-node10:46:250
149950,0migration/022552-21kthreadcore11:06:250
149950,0migration/022463-21kthreadcore09:06:240
149950,0migration/019963-21latency_hist08:21:080
149950,0migration/014911-21missed_timers11:01:270
149950,0migration/013812-21kthreadcore10:01:250
149950,0migration/010449-21taskset09:37:270
149950,0migration/010309-21munin-node07:21:270
8215040,0irq/24-0000:00:4805-21cat07:21:082
8215040,0irq/24-0000:00:3729-21cat06:56:082
4140,0ktimersoftd/00-21swapper/010:19:240
339940,0migration/34784-21sendmail_mailst07:41:313
339940,0migration/324684-21sh07:11:223
339940,0migration/317995-21taskset10:46:133
339940,0migration/316393-21kthreadcore08:16:253
339940,0migration/314593-21kthreadcore07:26:243
29725040,0irq/27-eth0-tx-22480-21cut09:06:242
29725040,0irq/27-eth0-tx-20407-21munin-node09:26:182
29725040,0irq/27-eth0-tx-0-21swapper/211:41:162
29725040,0irq/27-eth0-tx-0-21swapper/211:16:182
29725040,0irq/27-eth0-tx-0-21swapper/210:56:152
29725040,0irq/27-eth0-tx-0-21swapper/210:47:192
29725040,0irq/27-eth0-tx-0-21swapper/210:26:252
29725040,0irq/27-eth0-tx-0-21swapper/210:11:132
29725040,0irq/27-eth0-tx-0-21swapper/008:43:560
29725040,0irq/27-eth0-tx-0-21swapper/008:31:230
29725040,0irq/27-eth0-tx-0-21swapper/007:01:280
29715040,0irq/26-eth0-rx-0-21swapper/311:42:433
29715040,0irq/26-eth0-rx-0-21swapper/311:32:033
29715040,0irq/26-eth0-rx-0-21swapper/311:16:123
29715040,0irq/26-eth0-rx-0-21swapper/310:31:243
29715040,0irq/26-eth0-rx-0-21swapper/310:26:093
29715040,0irq/26-eth0-rx-0-21swapper/309:31:303
29715040,0irq/26-eth0-rx-0-21swapper/308:01:203
29715040,0irq/26-eth0-rx-0-21swapper/306:46:183
259940,0migration/27884-21irqcore08:11:252
259940,0migration/24986-21timerwakeupswit07:41:322
259940,0migration/232576-21aten_r1power_fr08:06:192
259940,0migration/229060-21aten_r1power_en08:51:192
259940,0migration/228014-21kthreadcore11:51:242
259940,0migration/219860-21gltestperf07:56:212
259940,0migration/219858-21aten_r1power_cu09:46:172
259940,0migration/218465-21kthreadcore08:16:262
259940,0migration/217206-21latency_hist07:06:082
259940,0migration/215033-21kthreadcore09:21:252
259940,0migration/215033-21kthreadcore09:21:252
259940,0migration/21465-21kthreadcore07:16:262
259940,0migration/214518-21kthreadcore09:41:242
259940,0migration/211919-21runrttasks07:47:152
249940,0watchdog/228389-21munin-node06:46:262
249940,0watchdog/220999-21kthreadcore11:06:252
249940,0watchdog/217481-21kthreadcore08:41:252
249940,0watchdog/20-21swapper/211:56:252
249940,0watchdog/20-21swapper/210:31:212
249940,0watchdog/20-21swapper/207:26:302
249940,0watchdog/20-21swapper/206:56:262
227409943,0cyclictest8801-21awk12:01:242
227409943,0cyclictest3556-21lldpd11:26:112
227409943,0cyclictest3556-21lldpd08:29:392
227409943,0cyclictest3556-21lldpd08:24:392
227409943,0cyclictest3556-21lldpd08:03:092
227409943,0cyclictest29759-21awk09:11:212
227409943,0cyclictest20093-21awk10:06:232
227409943,0cyclictest10442-21awk11:01:242
227409940,0cyclictest0-21swapper/207:31:382
227399943,0cyclictest3514-21snmpd09:59:531
227399943,0cyclictest3514-21snmpd08:22:221
227399943,0cyclictest32420-21sadc11:36:061
227399943,0cyclictest3241-21irqbalance09:43:251
227399943,0cyclictest28761-21awk09:51:231
227399943,0cyclictest23786-21awk06:46:211
227399943,0cyclictest2347-21awk10:56:221
227399943,0cyclictest18145-21awk07:06:231
227399943,0cyclictest12381-21awk07:26:221
227399943,0cyclictest12178-21awk10:01:221
227399940,0cyclictest0-21swapper/111:04:431
227389944,0cyclictest13481-21kworker/0:210:54:200
227389944,0cyclictest0-21swapper/011:38:420
227389944,0cyclictest0-21swapper/009:56:140
227389943,0cyclictest3514-21snmpd11:12:230
227389943,0cyclictest3514-21snmpd08:04:520
227389943,0cyclictest3241-21irqbalance09:21:050
227389943,0cyclictest29880-21awk08:51:230
227389943,0cyclictest27508-21munin-run09:51:070
227389943,0cyclictest24748-21awk07:11:230
227389943,0cyclictest2371-21awk10:56:230
227389943,0cyclictest18160-21awk07:06:230
227389943,0cyclictest13481-21kworker/0:212:01:280
227389943,0cyclictest13421-21awk07:51:220
227389943,0cyclictest13345-21awk09:21:230
227389943,0cyclictest13345-21awk09:21:230
227389943,0cyclictest11728-21awk10:21:240
227389940,0cyclictest0-21swapper/009:03:340
179940,0migration/16232-21runrttasks08:07:251
179940,0migration/14198-21kthreadcore10:36:231
179940,0migration/132446-21taskset11:14:341
179940,0migration/130965-21sh11:53:151
179940,0migration/129109-21munin-node09:11:181
179940,0migration/129094-21kthreadcore07:11:271
179940,0migration/127180-21kthreadcore07:36:251
179940,0migration/123905-21cpuspeed_turbos12:11:191
179940,0migration/122425-21kthreadcore09:06:241
179940,0migration/12203-21kthreadcore11:16:231
179940,0migration/121058-21fschecks_time09:26:201
179940,0migration/120905-21kthreadcore11:06:251
179940,0migration/120766-21if_eth009:46:211
179940,0migration/119969-21gltestperf10:06:211
179940,0migration/117252-21kthreadcore12:06:231
179940,0migration/11287-21kthreadcore07:41:261
179940,0migration/111874-21irqcore10:21:241
179940,0migration/110992-21kthreadcore11:21:231
179940,0migration/110979-21kthreadcore07:46:251
169940,0watchdog/17266-21kthreadcore06:56:261
169940,0watchdog/17217-21diskstats08:11:221
169940,0watchdog/14980-21kthreadcore11:56:251
169940,0watchdog/128465-21kthreadcore10:51:251
169940,0watchdog/127263-21head10:31:211
169940,0watchdog/112607-21grep10:41:251
169940,0watchdog/111403-21ssh09:18:491
169940,0watchdog/10-21swapper/112:01:251
169940,0watchdog/10-21swapper/109:31:251
149940,0migration/025333-21kthreadcore06:46:230
149940,0migration/02353-21kthreadcore11:56:240
149940,0migration/022769-21kthreadcore07:56:240
339930,0migration/36240-21runrttasks08:07:313
29725030,0irq/27-eth0-tx-0-21swapper/007:26:190
29715030,0irq/26-eth0-rx-0-21swapper/307:21:223
29715030,0irq/26-eth0-rx-0-21swapper/307:16:203
29715030,0irq/26-eth0-rx-0-21swapper/307:03:553
29715030,0irq/26-eth0-rx-0-21swapper/306:57:103
29715030,0irq/26-eth0-rx-0-21swapper/306:51:143
249930,0watchdog/20-21swapper/207:36:262
227409932,0cyclictest3556-21lldpd08:31:092
227409932,0cyclictest12649-21stty07:51:192
227409930,0cyclictest8413-21perl08:36:202
227399932,0cyclictest6225-21kthreadcore07:21:241
227399932,0cyclictest18203-21basename07:31:191
227399932,0cyclictest1119-21basename08:31:201
227399931,0cyclictest32114-21kthreadcore07:16:261
227399930,0cyclictest2653-21ntp_states06:51:271
227389933,0cyclictest6395-21kworker/0:007:16:210
227389933,0cyclictest13481-21kworker/0:212:11:140
227389933,0cyclictest13481-21kworker/0:212:06:120
227389933,0cyclictest13481-21kworker/0:211:41:100
227389933,0cyclictest13481-21kworker/0:211:16:080
227389933,0cyclictest13481-21kworker/0:210:31:100
227389933,0cyclictest13481-21kworker/0:210:26:080
227389933,0cyclictest13481-21kworker/0:210:11:080
227389933,0cyclictest13481-21kworker/0:209:41:100
227389933,0cyclictest13481-21kworker/0:209:31:120
227389933,0cyclictest13481-21kworker/0:208:36:170
227389932,0cyclictest25674-21awk07:36:230
227389930,0cyclictest20466-21telnet09:26:170
179930,0migration/131528-21kthreadcore08:26:251
169930,0watchdog/119976-21if_err_eth1.207:56:221
169930,0watchdog/10-21swapper/108:51:251
169930,0watchdog/10-21swapper/108:41:211
339920,0migration/32006-21iostat_ios08:31:243
29715020,0irq/26-eth0-rx-0-21swapper/308:11:103
29715020,0irq/26-eth0-rx-0-21swapper/307:46:253
227409921,0cyclictest10563-21date07:01:082
227399921,0cyclictest7635-21date08:36:081
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional