You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 14:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sun May 31, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1702823727,0sleep30-21swapper/306:49:463
1724023627,0sleep20-21swapper/206:52:132
1106123524,0sleep00-21swapper/006:49:150
1735223026,0sleep10-21swapper/106:53:321
339970,0migration/315045-21sh10:53:123
339960,0migration/35032-21needreboot07:29:223
339960,0migration/331317-21sh09:21:083
339960,0migration/330640-21sh09:00:263
339960,0migration/329230-21ntp_offset10:59:213
339960,0migration/323574-21sh08:58:303
339960,0migration/313812-21sh11:10:183
29715060,0irq/26-eth0-rx-18189-21kthreadcore12:14:173
29715060,0irq/26-eth0-rx-17168-21hwlatdetect09:14:153
19160,0ktimersoftd/10-21swapper/112:01:001
174729960,0cyclictest0-21swapper/111:57:321
174729960,0cyclictest0-21swapper/111:15:081
174729960,0cyclictest0-21swapper/109:59:181
174719966,0cyclictest0-21swapper/007:09:150
174719960,0cyclictest0-21swapper/007:34:290
149960,0migration/05652-21sh11:46:020
149960,0migration/031815-21taskset09:42:570
149960,0migration/022663-21sh09:14:510
149960,0migration/014901-21sh11:33:560
149960,0migration/014602-21sh09:10:110
149960,0migration/010277-21kthreadcore11:09:190
8215050,0irq/24-0000:00:32057-21idleruntime-cro09:04:032
339950,0migration/39930-21kthreadcore09:09:183
339950,0migration/37468-21fschecks_time12:09:153
339950,0migration/36286-21munin-node07:09:183
339950,0migration/34138-21kthreadcore08:19:193
339950,0migration/331558-21taskset07:26:383
339950,0migration/331384-21taskset10:02:153
339950,0migration/329882-21missed_timers09:39:203
339950,0migration/320889-21kthreadcore10:54:193
339950,0migration/320194-21kthreadcore11:54:193
339950,0migration/318712-21kthreadcore09:54:173
339950,0migration/317667-21latency_hist06:54:033
339950,0migration/315894-21irqcore08:29:193
339950,0migration/314143-21munin-node09:29:243
339950,0migration/311978-21kthreadcore08:24:203
339950,0migration/311586-21latency07:34:203
339950,0migration/310915-21kthreadcore10:09:193
29725050,0irq/27-eth0-tx-23969-21munin-node10:19:182
29725050,0irq/27-eth0-tx-21211-21ssh10:54:212
29725050,0irq/27-eth0-tx-19643-21munin-node07:44:260
29725050,0irq/27-eth0-tx-15830-21munin-node10:34:162
29725050,0irq/27-eth0-tx-15661-21ssh09:12:592
29725050,0irq/27-eth0-tx-13850-21ssh10:49:482
29725050,0irq/27-eth0-tx-12782-21python11:49:262
29725050,0irq/27-eth0-tx-0-21swapper/211:02:452
29725050,0irq/27-eth0-tx-0-21swapper/209:26:182
29725050,0irq/27-eth0-tx-0-21swapper/007:39:190
29715050,0irq/26-eth0-rx-7517-21ssh10:08:283
29715050,0irq/26-eth0-rx-6559-21runrttasks11:44:023
29715050,0irq/26-eth0-rx-6348-21unixbench_multi09:24:283
29715050,0irq/26-eth0-rx-32099-21ssh10:24:143
29715050,0irq/26-eth0-rx-29386-21sh11:39:303
29715050,0irq/26-eth0-rx-25238-21if_eth006:59:183
29715050,0irq/26-eth0-rx-19602-21sed07:44:033
29715050,0irq/26-eth0-rx-16951-21tr11:34:173
29715050,0irq/26-eth0-rx-14549-21taskset10:31:143
29715050,0irq/26-eth0-rx-0-21swapper/312:20:303
29715050,0irq/26-eth0-rx-0-21swapper/312:00:193
29715050,0irq/26-eth0-rx-0-21swapper/311:49:233
29715050,0irq/26-eth0-rx-0-21swapper/311:29:133
29715050,0irq/26-eth0-rx-0-21swapper/311:14:133
29715050,0irq/26-eth0-rx-0-21swapper/310:45:023
29715050,0irq/26-eth0-rx-0-21swapper/310:34:143
29715050,0irq/26-eth0-rx-0-21swapper/309:50:063
29715050,0irq/26-eth0-rx-0-21swapper/309:06:203
29715050,0irq/26-eth0-rx-0-21swapper/308:08:293
259950,0migration/29208-21kthreadcore07:59:202
259950,0migration/28472-21kthreadcore12:09:192
259950,0migration/27526-21irqrtprio07:34:182
259950,0migration/2718-21cpuspeed_turbos07:54:132
259950,0migration/26534-21sh11:07:272
259950,0migration/25663-21sh10:44:272
259950,0migration/25327-21munin-node07:29:262
259950,0migration/230842-21sh10:00:422
259950,0migration/225042-21kthreadcore11:59:172
259950,0migration/210072-21kthreadcore11:29:192
249950,0watchdog/2620-21hwlatdetect10:04:162
249950,0watchdog/229695-21sed10:39:242
19150,0ktimersoftd/10-21swapper/110:08:361
174739955,0cyclictest0-21swapper/211:34:222
174739955,0cyclictest0-21swapper/209:29:492
174739950,0cyclictest0-21swapper/209:56:472
174729955,0cyclictest0-21swapper/111:03:371
174729955,0cyclictest0-21swapper/108:59:421
174729954,0cyclictest23795-21grep11:39:151
174729950,0cyclictest0-21swapper/112:21:401
174729950,0cyclictest0-21swapper/111:52:391
174729950,0cyclictest0-21swapper/110:44:421
174729950,0cyclictest0-21swapper/110:33:591
174729950,0cyclictest0-21swapper/109:42:441
174729950,0cyclictest0-21swapper/109:34:041
174729950,0cyclictest0-21swapper/109:15:471
174719955,0cyclictest0-21swapper/011:58:240
174719955,0cyclictest0-21swapper/010:38:470
174719955,0cyclictest0-21swapper/009:57:380
174719950,0cyclictest0-21swapper/010:58:100
174719950,0cyclictest0-21swapper/010:17:390
179950,0migration/131796-21kthreadcore08:39:201
179950,0migration/128614-21kthreadcore06:59:201
179950,0migration/118934-21kthreadcore08:54:201
179950,0migration/110246-21munin-node08:49:191
169950,0watchdog/132413-21entropy07:29:171
149950,0migration/09156-21munin-node08:24:180
149950,0migration/0887-21munin-node10:04:180
149950,0migration/08780-21munin-node10:49:180
149950,0migration/07524-21sh09:07:560
149950,0migration/07432-21fschecks_time12:09:150
149950,0migration/06801-21taskset07:56:090
149950,0migration/0630-21kthreadcore12:04:170
149950,0migration/03958-21kthreadcore08:44:190
149950,0migration/03530-21kthreadcore11:24:180
149950,0migration/031972-21aten_r1power_fr10:44:130
149950,0migration/02747-21kthreadcore07:04:190
149950,0migration/027340-21kthreadcore09:19:200
149950,0migration/02687-21irqrtprio08:19:190
149950,0migration/023668-21fschecks_time11:59:140
149950,0migration/022334-21taskset12:18:200
149950,0migration/021555-21runrttasks11:14:270
149950,0migration/020774-21kthreadcore09:34:180
149950,0migration/020526-21kthreadcore07:19:200
149950,0migration/017370-21kthreadcore08:29:190
149950,0migration/01705-21kthreadcore07:29:210
149950,0migration/016767-21kthreadcore11:34:170
149950,0migration/014375-21fschecks_count08:04:160
149950,0migration/013021-21switchtime07:59:250
149950,0migration/010370-21kthreadcore10:29:190
149950,0migration/010265-21kthreadcore11:49:210
149950,0migration/010122-21kthreadcore09:29:190
339940,0migration/38758-21runrttasks08:46:243
339940,0migration/332601-21ksmtuned07:52:483
339940,0migration/332468-21kthreadcore08:14:233
339940,0migration/321758-21irqcore08:09:193
339940,0migration/319479-21kthreadcore09:34:183
339940,0migration/317303-21kthreadcore07:39:203
29725040,0irq/27-eth0-tx-7990-21ssh10:09:102
29725040,0irq/27-eth0-tx-515-21if_eth1.210:24:172
29725040,0irq/27-eth0-tx-0-21swapper/212:19:172
29725040,0irq/27-eth0-tx-0-21swapper/212:15:252
29725040,0irq/27-eth0-tx-0-21swapper/211:54:312
29725040,0irq/27-eth0-tx-0-21swapper/211:44:272
29725040,0irq/27-eth0-tx-0-21swapper/211:39:132
29725040,0irq/27-eth0-tx-0-21swapper/211:14:062
29725040,0irq/27-eth0-tx-0-21swapper/210:29:062
29725040,0irq/27-eth0-tx-0-21swapper/210:14:162
29725040,0irq/27-eth0-tx-0-21swapper/209:44:442
29725040,0irq/27-eth0-tx-0-21swapper/209:39:132
29725040,0irq/27-eth0-tx-0-21swapper/209:34:182
29725040,0irq/27-eth0-tx-0-21swapper/209:19:232
29725040,0irq/27-eth0-tx-0-21swapper/008:51:080
29725040,0irq/27-eth0-tx-0-21swapper/007:24:140
29715040,0irq/26-eth0-rx-0-21swapper/312:04:353
29715040,0irq/26-eth0-rx-0-21swapper/311:24:053
29715040,0irq/26-eth0-rx-0-21swapper/311:19:213
29715040,0irq/26-eth0-rx-0-21swapper/311:05:463
29715040,0irq/26-eth0-rx-0-21swapper/310:39:083
29715040,0irq/26-eth0-rx-0-21swapper/310:20:343
29715040,0irq/26-eth0-rx-0-21swapper/310:16:513
29715040,0irq/26-eth0-rx-0-21swapper/309:45:133
29715040,0irq/26-eth0-rx-0-21swapper/307:59:143
29715040,0irq/26-eth0-rx-0-21swapper/307:19:263
259940,0migration/23916-21latency07:04:192
259940,0migration/227189-21latency_hist08:14:032
259940,0migration/218966-21kthreadcore08:29:202
259940,0migration/217171-21irqrtprio08:54:192
259940,0migration/215886-21kthreadcore07:39:202
259940,0migration/214276-21df_abs08:04:152
259940,0migration/213655-21kthreadcore07:14:192
249940,0watchdog/28910-21perl09:49:162
249940,0watchdog/226346-21cut11:19:202
249940,0watchdog/226274-21kthreadcore08:34:212
249940,0watchdog/20-21swapper/208:09:212
174739943,0cyclictest933-21awk09:04:192
174739943,0cyclictest9205-21awk08:24:182
174739943,0cyclictest8421-21sed08:44:252
174739943,0cyclictest3556-21lldpd07:44:192
174739943,0cyclictest3556-21lldpd07:19:492
174739943,0cyclictest3514-21snmpd11:09:052
174739943,0cyclictest3514-21snmpd07:13:202
174739943,0cyclictest3514-21snmpd06:59:502
174739943,0cyclictest32426-21awk11:24:162
174739943,0cyclictest27204-21awk07:49:192
174739943,0cyclictest26242-21awk07:24:182
174739943,0cyclictest17383-21awk09:14:162
174739943,0cyclictest10111-21awk08:49:182
174739940,0cyclictest31071-21munin-node12:04:172
174729944,0cyclictest0-21swapper/106:54:221
174729943,0cyclictest9202-21awk09:49:181
174729943,0cyclictest906-21awk09:44:171
174729943,0cyclictest3556-21lldpd11:24:181
174729943,0cyclictest3556-21lldpd07:34:191
174729943,0cyclictest3556-21lldpd07:04:481
174729943,0cyclictest3514-21snmpd09:28:201
174729943,0cyclictest3514-21snmpd07:58:201
174729943,0cyclictest3514-21snmpd07:44:351
174729943,0cyclictest3241-21irqbalance09:57:111
174729943,0cyclictest25442-21awk09:19:181
174729943,0cyclictest15108-21sadc11:14:011
174729943,0cyclictest14782-21awk08:04:171
174719944,0cyclictest0-21swapper/008:59:270
174719943,0cyclictest30561-21sadc12:24:010
174719943,0cyclictest28123-21awk08:14:200
174719943,0cyclictest25255-21awk09:59:190
174719943,0cyclictest24884-21kworker/0:011:20:110
174719943,0cyclictest18535-21awk06:54:180
174719943,0cyclictest16774-21awk08:54:170
174719943,0cyclictest0-21swapper/008:09:200
179940,0migration/17611-21aten_r1power_cu10:49:131
179940,0migration/17360-21fschecks_time12:09:151
179940,0migration/1543-21kthreadcore12:04:171
179940,0migration/132468-21fschecks_count10:24:151
179940,0migration/128135-21kthreadcore10:39:191
179940,0migration/127900-21fschecks_time08:14:191
179940,0migration/127629-21kthreadcore07:49:201
179940,0migration/123300-21latency_hist11:19:011
179940,0migration/122608-21taskset10:56:471
179940,0migration/120553-21latency_hist08:09:031
179940,0migration/117969-21kthreadcore11:34:181
179940,0migration/117096-21kthreadcore07:14:201
179940,0migration/113400-21latency10:09:201
179940,0migration/110782-21kthreadcore09:29:191
169940,0watchdog/1736-21kthreadcore11:04:161
169940,0watchdog/15568-21ssh11:45:481
169940,0watchdog/130336-21kthreadcore07:24:211
169940,0watchdog/129733-21ssh10:19:241
169940,0watchdog/123650-21ssh10:18:561
169940,0watchdog/120405-21cut10:34:201
169940,0watchdog/115204-21ssh09:11:491
169940,0watchdog/113354-21ssh11:29:281
169940,0watchdog/10-21swapper/109:04:211
169940,0watchdog/10-21swapper/108:34:211
149940,0migration/029829-21switchtime10:19:250
149940,0migration/027924-21kthreadcore11:39:190
149940,0migration/025738-21kthreadcore08:34:210
149940,0migration/010668-21kthreadcore10:09:190
29725030,0irq/27-eth0-tx-0-21swapper/007:49:160
29715030,0irq/26-eth0-rx-0-21swapper/307:54:123
29715030,0irq/26-eth0-rx-0-21swapper/307:14:143
29715030,0irq/26-eth0-rx-0-21swapper/307:04:133
174739932,0cyclictest29055-21awk08:39:182
174739932,0cyclictest18550-21awk06:54:182
174729933,0cyclictest3299-21awk08:44:171
174729932,0cyclictest9093-21awk08:24:171
174729930,0cyclictest6647-21kthreadcore08:19:201
174729930,0cyclictest19569-21munin-node07:19:181
174729930,0cyclictest14937-21sh08:29:141
174729930,0cyclictest13766-21munin-node07:39:171
174719933,0cyclictest31467-21kworker/0:108:39:140
174719933,0cyclictest31467-21kworker/0:107:14:160
174719933,0cyclictest31467-21kworker/0:106:59:160
174719933,0cyclictest24884-21kworker/0:011:04:070
174719933,0cyclictest24884-21kworker/0:010:59:030
174719933,0cyclictest24884-21kworker/0:010:39:230
174719933,0cyclictest24884-21kworker/0:010:24:050
174719933,0cyclictest24884-21kworker/0:009:49:040
174719933,0cyclictest24884-21kworker/0:009:44:040
174719933,0cyclictest24884-21kworker/0:009:24:160
179930,0migration/17676-21kthreadcore07:09:201
169930,0watchdog/10-21swapper/112:14:481
169930,0watchdog/10-21swapper/107:59:211
29715020,0irq/26-eth0-rx-0-21swapper/308:49:133
29715020,0irq/26-eth0-rx-0-21swapper/308:39:143
29715020,0irq/26-eth0-rx-0-21swapper/308:34:313
174739921,0cyclictest1453-21latency_hist08:19:032
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional