You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-18 - 17:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Wed Mar 18, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
442829389,0sleep00-21swapper/007:00:240
441023724,0sleep20-21swapper/207:00:102
436023626,0sleep30-21swapper/306:59:353
436323526,0sleep10-21swapper/106:59:371
45709960,0cyclictest0-21swapper/112:06:181
45639960,0cyclictest2749-21diskmemload09:32:530
45639960,0cyclictest1163-21rm09:16:380
45639960,0cyclictest0-21swapper/010:27:540
45639960,0cyclictest0-21swapper/010:14:490
339960,0migration/332238-21sh11:38:413
339960,0migration/324753-21sh10:32:183
339960,0migration/317898-21sh09:08:273
339960,0migration/317816-21irqcore12:11:173
339960,0migration/310152-21sh09:04:273
30445060,0irq/25-eth10-21swapper/010:01:440
29725060,0irq/27-eth0-tx-5777-21munin-node07:26:190
29725060,0irq/27-eth0-tx-24819-21munin-node07:16:220
29715060,0irq/26-eth0-rx-26656-21seq09:14:533
29715060,0irq/26-eth0-rx-15609-21ssh12:29:173
179960,0migration/125215-21taskset10:12:441
149960,0migration/09756-21kthreadcore07:01:200
149960,0migration/09487-21taskset10:45:160
149960,0migration/09259-21sh09:42:060
149960,0migration/08383-21sh11:24:010
149960,0migration/07774-21sh11:43:220
149960,0migration/026033-21cpuspeed_turbos07:41:140
149960,0migration/01601-21sh10:40:590
149960,0migration/01402-21latency_hist11:01:010
8215050,0irq/24-0000:00:32519-21latency_hist12:21:012
45769955,0cyclictest2749-21diskmemload11:00:022
45769955,0cyclictest0-21swapper/211:44:392
45769955,0cyclictest0-21swapper/210:17:092
45769950,0cyclictest0-21swapper/211:56:472
45769950,0cyclictest0-21swapper/209:34:532
45709954,0cyclictest3514-21snmpd08:19:571
45709950,0cyclictest28524-21perf08:56:021
45709950,0cyclictest28524-21perf08:56:021
45709950,0cyclictest0-21swapper/112:01:351
45709950,0cyclictest0-21swapper/110:39:361
45709950,0cyclictest0-21swapper/109:49:561
45709950,0cyclictest0-21swapper/109:07:121
45639955,0cyclictest0-21swapper/010:08:400
45639955,0cyclictest0-21swapper/009:52:450
45639954,0cyclictest0-21swapper/009:26:150
45639950,0cyclictest0-21swapper/009:06:140
339950,0migration/39301-21fschecks_count12:06:153
339950,0migration/38962-21munin-node08:41:143
339950,0migration/35961-21kthreadcore10:21:173
339950,0migration/33759-21kthreadcore10:41:193
339950,0migration/332483-21aten_r1power_en07:46:113
339950,0migration/331570-21ntp_offset10:56:193
339950,0migration/330633-21kthreadcore09:16:193
339950,0migration/326631-21kthreadcore11:56:173
339950,0migration/326515-21munin-node08:26:193
339950,0migration/326293-21kthreadcore12:16:163
339950,0migration/326252-21taskset08:02:513
339950,0migration/325870-21munin-node07:41:133
339950,0migration/324218-21kthreadcore08:51:183
339950,0migration/324218-21kthreadcore08:51:183
339950,0migration/319571-21kthreadcore10:51:173
339950,0migration/318134-21kthreadcore08:46:183
339950,0migration/312201-21kernelversion09:46:173
339950,0migration/311971-21taskset07:28:023
339950,0migration/310188-21munin-node11:26:153
29725050,0irq/27-eth0-tx-4805-21grep12:01:182
29725050,0irq/27-eth0-tx-27914-21tune2fs09:36:162
29725050,0irq/27-eth0-tx-24096-21python10:31:232
29725050,0irq/27-eth0-tx-1899-21munin-node10:41:182
29725050,0irq/27-eth0-tx-16590-21ssh10:47:392
29725050,0irq/27-eth0-tx-15384-21ssh12:28:362
29725050,0irq/27-eth0-tx-14423-21munin-node08:21:140
29725050,0irq/27-eth0-tx-0-21swapper/211:25:452
29725050,0irq/27-eth0-tx-0-21swapper/209:54:542
29725050,0irq/27-eth0-tx-0-21swapper/008:06:130
29715050,0irq/26-eth0-rx-8240-21cat09:41:203
29715050,0irq/26-eth0-rx-7066-21latency11:01:193
29715050,0irq/26-eth0-rx-5144-21kthreadcore11:21:183
29715050,0irq/26-eth0-rx-30616-21grep11:16:173
29715050,0irq/26-eth0-rx-28685-21cut09:36:193
29715050,0irq/26-eth0-rx-1192-21ssh09:57:583
29715050,0irq/26-eth0-rx-10510-21fschecks_count10:46:133
29715050,0irq/26-eth0-rx-0-21swapper/312:24:153
29715050,0irq/26-eth0-rx-0-21swapper/312:01:043
29715050,0irq/26-eth0-rx-0-21swapper/311:48:083
29715050,0irq/26-eth0-rx-0-21swapper/311:31:283
29715050,0irq/26-eth0-rx-0-21swapper/311:11:173
29715050,0irq/26-eth0-rx-0-21swapper/311:06:173
29715050,0irq/26-eth0-rx-0-21swapper/310:36:173
29715050,0irq/26-eth0-rx-0-21swapper/310:17:273
29715050,0irq/26-eth0-rx-0-21swapper/310:08:053
29715050,0irq/26-eth0-rx-0-21swapper/310:05:323
29715050,0irq/26-eth0-rx-0-21swapper/309:51:053
29715050,0irq/26-eth0-rx-0-21swapper/309:32:373
29715050,0irq/26-eth0-rx-0-21swapper/309:24:183
259950,0migration/221890-21kthreadcore10:11:182
259950,0migration/21077-21sh09:16:252
249950,0watchdog/28604-21ntp_states09:01:202
179950,0migration/17826-21vmstat11:01:251
179950,0migration/128083-21df_abs08:31:121
179950,0migration/126613-21latency_hist08:06:021
169950,0watchdog/130347-21open_inodes12:16:191
169950,0watchdog/110120-21chrt10:05:121
149950,0migration/09525-21kthreadcore07:51:190
149950,0migration/06976-21kthreadcore10:21:180
149950,0migration/029563-21idleruntime08:56:150
149950,0migration/028743-21kthreadcore12:16:160
149950,0migration/023711-21mdstat10:31:190
149950,0migration/02203-21irqrtprio08:11:160
149950,0migration/021108-21kthreadcore11:31:180
149950,0migration/021010-21kthreadcore07:11:180
149950,0migration/020051-21kthreadcore10:51:170
149950,0migration/019083-21rt-features07:56:210
149950,0migration/017794-21iostat12:11:170
149950,0migration/016421-21irqcore08:46:170
149950,0migration/016308-21taskset12:10:300
149950,0migration/016064-21taskset12:30:370
149950,0migration/015713-21unixbench_multi11:06:240
149950,0migration/015334-21kthreadcore07:31:180
149950,0migration/015002-21unixbench-2d11:46:230
149950,0migration/012825-21kthreadcore07:06:200
149950,0migration/010302-21sh09:23:570
45769943,0cyclictest4156-21awk09:21:162
45769943,0cyclictest3556-21lldpd08:21:102
45769943,0cyclictest3556-21lldpd08:11:402
45769943,0cyclictest3556-21lldpd07:54:092
45769943,0cyclictest3556-21lldpd07:26:092
45769943,0cyclictest3556-21lldpd07:13:092
45769943,0cyclictest3556-21lldpd07:06:092
45769943,0cyclictest29594-21awk08:56:152
45769943,0cyclictest27635-21awk08:06:172
45769943,0cyclictest26539-21awk11:16:152
45769943,0cyclictest26230-21awk11:36:162
45769943,0cyclictest22960-21awk08:51:162
45769943,0cyclictest22960-21awk08:51:162
45769940,0cyclictest0-21swapper/207:58:532
45709943,0cyclictest7727-21awk07:51:171
45709943,0cyclictest5748-21awk07:01:171
45709943,0cyclictest3556-21lldpd07:47:091
45709943,0cyclictest3514-21snmpd09:37:271
45709943,0cyclictest3514-21snmpd08:38:121
45709943,0cyclictest3514-21snmpd07:33:571
45709943,0cyclictest3241-21irqbalance10:58:101
45709943,0cyclictest3241-21irqbalance10:46:501
45709943,0cyclictest3241-21irqbalance10:45:101
45709943,0cyclictest26167-21sort11:16:131
45709943,0cyclictest2246-21sadc10:01:011
45709943,0cyclictest20212-21awk09:31:171
45709943,0cyclictest18346-21sadc10:11:011
45709943,0cyclictest17961-21awk11:51:161
45709943,0cyclictest1754-21awk11:41:141
45709943,0cyclictest16380-21awk08:46:161
45709943,0cyclictest15354-21awk08:21:151
45709943,0cyclictest10598-21awk11:06:151
45709940,0cyclictest0-21swapper/109:02:001
45639944,0cyclictest0-21swapper/012:23:090
45639944,0cyclictest0-21swapper/011:12:030
45639944,0cyclictest0-21swapper/008:01:260
45639943,0cyclictest3514-21snmpd10:47:270
45639943,0cyclictest32306-21awk07:21:160
45639943,0cyclictest28822-21kworker/0:011:59:180
45639943,0cyclictest28822-21kworker/0:011:51:260
45639943,0cyclictest28822-21kworker/0:011:16:210
45639943,0cyclictest18599-21sadc09:51:010
45639943,0cyclictest10250-21awk11:26:160
45639940,0cyclictest28306-21chrt08:53:470
45639940,0cyclictest28306-21chrt08:53:470
45639940,0cyclictest1988-21munin-node08:36:250
45639940,0cyclictest0-21swapper/008:46:020
339940,0migration/35531-21ksmtuned07:25:553
339940,0migration/35038-21cpuspeed_turbos07:01:143
339940,0migration/332422-21kthreadcore08:56:183
339940,0migration/331160-21taskset07:20:173
339940,0migration/324184-21taskset07:11:293
339940,0migration/310625-21kthreadcore07:51:193
29725040,0irq/27-eth0-tx-8763-21ssh10:22:102
29725040,0irq/27-eth0-tx-606-21ssh09:56:272
29725040,0irq/27-eth0-tx-23894-21ssh11:11:482
29725040,0irq/27-eth0-tx-22225-21cut11:31:182
29725040,0irq/27-eth0-tx-2042-21ssh11:01:152
29725040,0irq/27-eth0-tx-10356-21munin-node10:26:152
29725040,0irq/27-eth0-tx-0-21swapper/212:11:052
29725040,0irq/27-eth0-tx-0-21swapper/211:51:232
29725040,0irq/27-eth0-tx-0-21swapper/211:27:012
29725040,0irq/27-eth0-tx-0-21swapper/210:36:132
29725040,0irq/27-eth0-tx-0-21swapper/209:46:062
29725040,0irq/27-eth0-tx-0-21swapper/209:28:552
29725040,0irq/27-eth0-tx-0-21swapper/209:11:492
29725040,0irq/27-eth0-tx-0-21swapper/008:31:220
29725040,0irq/27-eth0-tx-0-21swapper/008:18:530
29715040,0irq/26-eth0-rx-0-21swapper/311:51:173
29715040,0irq/26-eth0-rx-0-21swapper/311:41:383
29715040,0irq/26-eth0-rx-0-21swapper/310:26:293
29715040,0irq/26-eth0-rx-0-21swapper/310:12:253
29715040,0irq/26-eth0-rx-0-21swapper/309:27:453
29715040,0irq/26-eth0-rx-0-21swapper/308:36:143
29715040,0irq/26-eth0-rx-0-21swapper/308:16:123
29715040,0irq/26-eth0-rx-0-21swapper/308:01:023
29715040,0irq/26-eth0-rx-0-21swapper/307:31:173
259940,0migration/29566-21fschecks_time11:46:132
259940,0migration/28369-21kthreadcore07:01:192
259940,0migration/26733-21runrttasks12:21:432
259940,0migration/230875-21kthreadcore08:31:172
259940,0migration/2303-21kernelversion07:21:182
259940,0migration/228160-21kthreadcore07:16:192
259940,0migration/22546-21fschecks_time08:36:152
259940,0migration/222369-21kthreadcore08:01:192
259940,0migration/220125-21kthreadcore10:51:172
259940,0migration/219658-21fschecks_count07:36:152
259940,0migration/211309-21kthreadcore08:41:182
259940,0migration/211139-21fschecks_count10:06:172
249940,0watchdog/29728-21aten_r1power_en11:06:112
249940,0watchdog/20-21swapper/212:06:152
249940,0watchdog/20-21swapper/210:01:482
249940,0watchdog/20-21swapper/209:41:202
249940,0watchdog/20-21swapper/209:06:162
249940,0watchdog/20-21swapper/207:41:242
179940,0migration/17584-21kthreadcore10:21:181
179940,0migration/16435-21kthreadcore09:21:181
179940,0migration/1571-21sh10:17:191
179940,0migration/15135-21kthreadcore11:21:181
179940,0migration/129897-21kthreadcore07:41:191
179940,0migration/125143-21taskset11:56:121
179940,0migration/123320-21kthreadcore08:26:171
179940,0migration/123156-21kthreadcore09:51:191
179940,0migration/12263-21unixbench_singl08:56:241
179940,0migration/119502-21irqcore10:31:161
179940,0migration/119272-21irqcore07:11:171
179940,0migration/117895-21cpuspeed_turbos11:11:121
179940,0migration/117463-21fschecks_time12:11:141
179940,0migration/115185-21timerandwakeup11:26:241
179940,0migration/113616-21kthreadcore10:26:171
179940,0migration/111528-21kthreadcore08:41:181
179940,0migration/110995-21kthreadcore11:46:171
169940,0watchdog/17784-21ssh12:24:431
169940,0watchdog/129621-21kthreadcore11:36:191
169940,0watchdog/127590-21cat08:06:161
169940,0watchdog/125023-21ssh10:53:591
169940,0watchdog/118994-21port_sshpriv07:56:201
169940,0watchdog/10-21swapper/109:41:201
169940,0watchdog/10-21swapper/109:11:201
149940,0migration/05822-21kthreadcore09:01:170
149940,0migration/031982-21runrttasks11:37:560
149940,0migration/028847-21kthreadcore09:36:190
45769933,0cyclictest3556-21lldpd07:31:092
45769932,0cyclictest8932-21irqrtprio08:16:182
45769932,0cyclictest22024-21awk08:26:162
45769932,0cyclictest16268-21awk08:46:162
45709933,0cyclictest0-21swapper/109:16:021
45709932,0cyclictest3857-21kthreadcore07:21:201
45709932,0cyclictest30474-21sensors07:16:231
45709932,0cyclictest17728-21fschecks_count11:31:131
45709932,0cyclictest14261-21sensors12:26:221
45709932,0cyclictest12182-21awk09:26:171
45709932,0cyclictest1128-21aten_r1power_vo08:11:121
45639933,0cyclictest28822-21kworker/0:012:01:020
45639933,0cyclictest28822-21kworker/0:011:01:030
45639933,0cyclictest28822-21kworker/0:010:16:150
45639933,0cyclictest28822-21kworker/0:009:11:030
45639933,0cyclictest28822-21kworker/0:007:46:030
45639932,0cyclictest3772-21munin-node08:26:110
45639932,0cyclictest27844-21if_eth1.209:56:160
45639932,0cyclictest19120-21munin-node07:36:150
29715030,0irq/26-eth0-rx-0-21swapper/308:31:253
29715030,0irq/26-eth0-rx-0-21swapper/308:21:123
29715030,0irq/26-eth0-rx-0-21swapper/308:08:143
29715030,0irq/26-eth0-rx-0-21swapper/307:36:193
29715030,0irq/26-eth0-rx-0-21swapper/307:08:163
249930,0watchdog/20-21swapper/207:46:162
169930,0watchdog/113525-21kthreadcore07:06:201
169930,0watchdog/10-21swapper/107:36:241
169930,0watchdog/10-21swapper/107:26:161
29715020,0irq/26-eth0-rx-0-21swapper/308:11:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional