You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-22 - 19:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Mon Jun 22, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3022126763,0sleep10-21swapper/106:47:471
3046523627,0sleep30-21swapper/306:50:373
3032622915,0sleep00-21swapper/006:49:020
3032222917,0sleep20-21swapper/206:49:002
30648991111,0cyclictest11004-21sensors09:37:150
339970,0migration/31644-21sh12:12:373
306499976,0cyclictest19817-21kthreadcore08:17:141
35160,0ktimersoftd/30-21swapper/311:12:143
339960,0migration/329249-21sh10:12:033
339960,0migration/329189-21latency_hist09:51:563
339960,0migration/327416-21sh10:07:263
339960,0migration/327352-21sh10:48:303
339960,0migration/325796-21rt-features11:47:173
339960,0migration/320084-21taskset07:56:273
339960,0migration/312563-21sh09:40:393
339960,0migration/310708-21sh10:57:213
306489960,0cyclictest0-21swapper/010:30:100
29725060,0irq/27-eth0-tx-20369-21munin-node07:57:080
29725060,0irq/27-eth0-tx-11831-21munin-node07:02:130
29715060,0irq/26-eth0-rx-0-21swapper/309:31:193
149960,0migration/04348-21sh10:36:310
149960,0migration/027587-21sh11:09:520
149960,0migration/013365-21latency_hist09:21:560
149960,0migration/012029-21sh11:42:050
149960,0migration/010957-21sh08:57:390
8215050,0irq/24-0000:00:4508-21latency_hist10:36:562
8215050,0irq/24-0000:00:12700-21latency_hist09:01:562
339950,0migration/38020-21kthreadcore11:57:133
339950,0migration/37805-21kthreadcore09:57:123
339950,0migration/36705-21kthreadcore08:57:133
339950,0migration/36698-21fschecks_time07:22:083
339950,0migration/35378-21munin-node09:17:073
339950,0migration/34697-21taskset06:54:223
339950,0migration/34607-21diskmemload09:15:543
339950,0migration/33601-21taskset11:36:263
339950,0migration/330935-21kthreadcore09:32:133
339950,0migration/327916-21munin-node08:02:113
339950,0migration/326063-21munin-node11:07:133
339950,0migration/322530-21kthreadcore12:07:123
339950,0migration/316398-21kthreadcore11:22:123
339950,0migration/314101-21munin-node10:02:113
339950,0migration/313870-21fschecks_time09:42:093
339950,0migration/313734-21cpuspeed_turbos09:22:083
339950,0migration/313276-21munin-node11:02:073
339950,0migration/313246-21kthreadcore07:02:143
339950,0migration/312802-21taskset07:27:003
339950,0migration/311189-21kthreadcore08:37:133
306509955,0cyclictest0-21swapper/209:42:132
306509954,0cyclictest3514-21snmpd07:35:282
306499954,0cyclictest6595-21ps09:37:101
306489955,0cyclictest0-21swapper/012:19:350
29725050,0irq/27-eth0-tx-7150-21grep09:37:102
29725050,0irq/27-eth0-tx-5162-21munin-node06:57:100
29725050,0irq/27-eth0-tx-4073-21munin-node11:37:182
29725050,0irq/27-eth0-tx-29085-21ssh09:51:492
29725050,0irq/27-eth0-tx-28066-21munin-node11:52:092
29725050,0irq/27-eth0-tx-26750-21ssh11:48:552
29725050,0irq/27-eth0-tx-19826-21munin-node12:07:162
29725050,0irq/27-eth0-tx-18341-21ntp_kernel_pll_10:42:152
29725050,0irq/27-eth0-tx-12985-21munin-node10:22:162
29725050,0irq/27-eth0-tx-10300-21sendmail_mailqu10:57:172
29725050,0irq/27-eth0-tx-0-21swapper/211:34:392
29725050,0irq/27-eth0-tx-0-21swapper/211:26:582
29725050,0irq/27-eth0-tx-0-21swapper/209:03:262
29725050,0irq/27-eth0-tx-0-21swapper/008:52:100
29715050,0irq/26-eth0-rx-2367-21python08:52:203
29715050,0irq/26-eth0-rx-21546-21df_abs09:07:093
29715050,0irq/26-eth0-rx-17597-21ntp_kernel_pll_11:42:153
29715050,0irq/26-eth0-rx-17313-21grep10:22:133
29715050,0irq/26-eth0-rx-13048-21telnet09:02:073
29715050,0irq/26-eth0-rx-10740-21python10:17:193
29715050,0irq/26-eth0-rx-0-21swapper/312:21:503
29715050,0irq/26-eth0-rx-0-21swapper/312:06:313
29715050,0irq/26-eth0-rx-0-21swapper/311:41:403
29715050,0irq/26-eth0-rx-0-21swapper/311:17:103
29715050,0irq/26-eth0-rx-0-21swapper/310:39:253
29715050,0irq/26-eth0-rx-0-21swapper/310:35:473
29715050,0irq/26-eth0-rx-0-21swapper/310:30:253
259950,0migration/28939-21kthreadcore09:57:132
259950,0migration/230299-21munin-node10:12:122
259950,0migration/229183-21fschecks_time11:12:112
259950,0migration/221479-21cpuspeed_turbos09:07:092
259950,0migration/214061-21cpuspeed_turbos07:52:102
259950,0migration/213426-21kthreadcore12:02:122
259950,0migration/212503-21fschecks_count11:42:092
249950,0watchdog/223701-21latency07:07:152
179950,0migration/17139-21munin-node08:07:191
179950,0migration/127140-21aten2.4-expect08:02:071
179950,0migration/122410-21kthreadcore11:47:131
179950,0migration/121521-21fschecks_time10:47:091
179950,0migration/119667-21sh10:44:211
179950,0migration/118933-21fschecks_count07:07:111
179950,0migration/111605-21taskset10:18:481
169950,0watchdog/130522-21kthreadcore11:12:141
169950,0watchdog/112898-21if_err_eth111:42:101
169950,0watchdog/111276-21users09:57:191
149950,0migration/09445-21munin-node11:37:150
149950,0migration/0741-21taskset08:03:520
149950,0migration/04860-21aten_r1power_fr10:37:070
149950,0migration/03294-21sh11:56:280
149950,0migration/03264-21kthreadcore07:42:150
149950,0migration/032622-21kthreadcore10:12:140
149950,0migration/031694-21kthreadcore12:12:130
149950,0migration/031298-21kthreadcore11:12:150
149950,0migration/031094-21cpuspeed_turbos06:52:100
149950,0migration/030884-21timerandwakeup07:12:190
149950,0migration/029503-21fschecks_time10:52:090
149950,0migration/027981-21taskset09:28:200
149950,0migration/027652-21taskset09:08:010
149950,0migration/026967-21taskset11:28:420
149950,0migration/025655-21ksmtuned07:34:360
149950,0migration/02371-21aten_r1power_po08:32:080
149950,0migration/023355-21kthreadcore07:07:150
149950,0migration/020456-21taskset10:05:290
149950,0migration/018728-21kthreadcore07:52:160
149950,0migration/018583-21sh10:42:180
149950,0migration/017796-21timerwakeupswit12:02:180
149950,0migration/01734-21munin-node11:32:170
149950,0migration/01697-21taskset08:28:180
149950,0migration/015866-21kthreadcore11:22:120
149950,0migration/015432-21gltestperf08:17:100
149950,0migration/015128-21kthreadcore11:02:100
149950,0migration/013360-21fschecks_time07:27:110
149950,0migration/012893-21latency_hist10:21:560
339940,0migration/327860-21pmu-power08:47:173
339940,0migration/317639-21kthreadcore08:42:143
339940,0migration/314136-21taskset08:12:523
339940,0migration/31217-21rt-features08:27:183
306509943,0cyclictest3514-21snmpd08:35:132
306509943,0cyclictest3514-21snmpd08:15:282
306509943,0cyclictest3514-21snmpd08:08:282
306509943,0cyclictest30003-21awk08:52:132
306509943,0cyclictest27930-21awk08:02:112
306509943,0cyclictest14199-21awk10:02:112
306499944,0cyclictest0-21swapper/110:12:481
306499944,0cyclictest0-21swapper/110:09:301
306499943,0cyclictest5072-21awk11:37:121
306499943,0cyclictest3556-21lldpd07:18:471
306499943,0cyclictest3514-21snmpd12:08:441
306499943,0cyclictest3514-21snmpd11:52:291
306499943,0cyclictest3514-21snmpd10:53:281
306499943,0cyclictest3514-21snmpd10:25:281
306499943,0cyclictest3514-21snmpd10:02:281
306499943,0cyclictest3514-21snmpd08:32:131
306499943,0cyclictest29295-21awk11:32:101
306499943,0cyclictest21318-21awk11:27:101
306499943,0cyclictest21210-21awk07:57:101
306489944,0cyclictest0-21swapper/010:59:200
306489944,0cyclictest0-21swapper/009:57:320
306489944,0cyclictest0-21swapper/009:50:170
306489944,0cyclictest0-21swapper/009:02:400
306489943,0cyclictest5856-21munin-run07:21:570
306489943,0cyclictest3241-21irqbalance11:57:040
306489943,0cyclictest30740-21kworker/0:010:47:460
306489943,0cyclictest30459-21awk09:32:110
306489943,0cyclictest23362-21ps08:47:130
306489943,0cyclictest21012-21awk11:47:110
306489943,0cyclictest14199-21awk09:42:110
306489941,0cyclictest0-21swapper/008:37:080
29725040,0irq/27-eth0-tx-30950-21kthreadcore12:12:132
29725040,0irq/27-eth0-tx-13064-21ssh11:22:092
29725040,0irq/27-eth0-tx-0-21swapper/212:17:112
29725040,0irq/27-eth0-tx-0-21swapper/211:57:122
29725040,0irq/27-eth0-tx-0-21swapper/211:01:592
29725040,0irq/27-eth0-tx-0-21swapper/210:47:052
29725040,0irq/27-eth0-tx-0-21swapper/210:27:092
29725040,0irq/27-eth0-tx-0-21swapper/210:07:112
29725040,0irq/27-eth0-tx-0-21swapper/209:33:162
29725040,0irq/27-eth0-tx-0-21swapper/209:27:012
29725040,0irq/27-eth0-tx-0-21swapper/008:12:180
29715040,0irq/26-eth0-rx-0-21swapper/311:52:123
29715040,0irq/26-eth0-rx-0-21swapper/311:26:583
29715040,0irq/26-eth0-rx-0-21swapper/310:52:073
29715040,0irq/26-eth0-rx-0-21swapper/310:43:283
29715040,0irq/26-eth0-rx-0-21swapper/309:52:223
259940,0migration/25351-21aten_r1power_en09:17:072
259940,0migration/2428-21irqcore07:17:122
259940,0migration/232640-21kthreadcore08:27:142
259940,0migration/232401-21kthreadcore06:52:142
259940,0migration/23092-21kthreadcore07:42:152
259940,0migration/227511-21kthreadcore07:12:132
259940,0migration/224310-21kthreadcore11:07:122
259940,0migration/222297-21latency_hist08:46:562
259940,0migration/221691-21df_abs08:22:092
259940,0migration/217256-21kthreadcore08:17:142
259940,0migration/21511-21kthreadcore09:52:142
259940,0migration/213644-21aten_r1power_vo09:22:082
259940,0migration/213023-21kthreadcore08:37:142
259940,0migration/210768-21kthreadcore07:47:152
249940,0watchdog/29407-21cut10:17:152
249940,0watchdog/24793-21aten_r1power_cu10:37:062
249940,0watchdog/230610-21irqrtprio09:12:112
249940,0watchdog/22451-21munin-node10:52:182
249940,0watchdog/221349-21python08:42:192
249940,0watchdog/210053-21ps11:17:182
249940,0watchdog/20-21swapper/207:37:152
249940,0watchdog/20-21swapper/207:22:072
179940,0migration/19412-21kthreadcore08:12:131
179940,0migration/17414-21munin-node07:47:101
179940,0migration/132699-21kthreadcore09:32:131
179940,0migration/131578-21kthreadcore09:12:111
179940,0migration/131555-21fschecks_time06:52:111
179940,0migration/130816-21kthreadcore09:52:131
179940,0migration/13068-21kthreadcore07:42:151
179940,0migration/127428-21taskset11:09:251
179940,0migration/125787-21taskset07:36:111
179940,0migration/123310-21kthreadcore09:47:131
179940,0migration/122893-21kthreadcore09:07:131
179940,0migration/118126-21munin-node11:02:121
179940,0migration/116649-21kthreadcore09:02:131
179940,0migration/116262-21fschecks_time08:42:111
179940,0migration/116193-21kthreadcore09:22:141
179940,0migration/113236-21latency_hist09:41:561
179940,0migration/111234-21runrttasks06:57:501
169940,0watchdog/19872-21ssh12:17:581
169940,0watchdog/127647-21ssh10:28:381
169940,0watchdog/117982-21ssh12:02:221
169940,0watchdog/116635-21cut07:52:151
169940,0watchdog/112415-21ssh09:01:191
169940,0watchdog/11197-21munin-node12:12:181
169940,0watchdog/111276-21timerwakeupswit09:17:191
169940,0watchdog/111097-21ssh12:00:421
169940,0watchdog/110567-21python10:37:181
169940,0watchdog/10-21swapper/107:22:071
149940,0migration/021622-21kthreadcore12:07:120
149940,0migration/017577-21kthreadcore08:42:140
149940,0migration/011985-21runrttasks10:19:550
306509932,0cyclictest3556-21lldpd07:04:172
306509932,0cyclictest3514-21snmpd07:01:122
306509932,0cyclictest20657-21expr07:57:082
306499932,0cyclictest9845-21awk08:37:111
306499932,0cyclictest3556-21lldpd07:14:471
306499932,0cyclictest28778-21sadc08:51:561
306499932,0cyclictest27250-21sensors09:27:171
306499932,0cyclictest22221-21awk08:22:111
306499932,0cyclictest13696-21awk07:27:131
306499932,0cyclictest13271-21awk11:22:101
306499932,0cyclictest12565-21grep07:02:111
306489933,0cyclictest30740-21kworker/0:011:17:050
306489933,0cyclictest30740-21kworker/0:009:52:240
306489933,0cyclictest30740-21kworker/0:009:16:580
306489933,0cyclictest30740-21kworker/0:009:11:580
306489933,0cyclictest30740-21kworker/0:008:21:580
306489933,0cyclictest30740-21kworker/0:008:06:580
306489933,0cyclictest30740-21kworker/0:007:47:000
306489933,0cyclictest30740-21kworker/0:007:36:580
306489933,0cyclictest30740-21kworker/0:007:21:580
306489932,0cyclictest23539-21kthreadcore10:07:140
29715030,0irq/26-eth0-rx-0-21swapper/308:32:083
29715030,0irq/26-eth0-rx-0-21swapper/308:22:073
29715030,0irq/26-eth0-rx-0-21swapper/308:17:093
29715030,0irq/26-eth0-rx-0-21swapper/308:08:423
29715030,0irq/26-eth0-rx-0-21swapper/307:48:263
29715030,0irq/26-eth0-rx-0-21swapper/307:43:593
29715030,0irq/26-eth0-rx-0-21swapper/307:40:203
29715030,0irq/26-eth0-rx-0-21swapper/307:32:173
29715030,0irq/26-eth0-rx-0-21swapper/307:12:083
29715030,0irq/26-eth0-rx-0-21swapper/306:57:033
249930,0watchdog/20-21swapper/207:27:112
169930,0watchdog/126793-21perl07:37:111
169930,0watchdog/10-21swapper/111:17:141
169930,0watchdog/10-21swapper/110:57:061
169930,0watchdog/10-21swapper/110:34:341
169930,0watchdog/10-21swapper/108:52:151
306499920,0cyclictest27916-21latency_hist08:26:571
29715020,0irq/26-eth0-rx-0-21swapper/307:57:063
29715020,0irq/26-eth0-rx-0-21swapper/307:17:073
29715020,0irq/26-eth0-rx-0-21swapper/307:08:073
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional