You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-30 - 07:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Thu Apr 30, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450460,0irq/25-eth10-21swapper/318:55:323
418423526,0sleep20-21swapper/218:52:082
1046023324,0sleep10-21swapper/118:55:431
1047922725,0sleep00-21swapper/018:55:590
106459970,0cyclictest24683-21ssh21:24:062
339960,0migration/33414-21sh22:34:033
339960,0migration/326302-21sh22:25:243
339960,0migration/316320-21runrttasks22:15:153
29725060,0irq/27-eth0-tx-2470-21munin-node20:52:180
29715060,0irq/26-eth0-rx-26486-21if_err_eth021:07:153
29715060,0irq/26-eth0-rx-25364-21latency_hist21:07:013
29715060,0irq/26-eth0-rx-22207-21cat23:27:013
29715060,0irq/26-eth0-rx-18257-21df21:22:143
29715060,0irq/26-eth0-rx-12073-21cut00:17:173
149960,0migration/017632-21sh23:51:510
149960,0migration/015762-21sh22:13:390
149960,0migration/011002-21sh22:37:330
106439966,0cyclictest0-21swapper/100:00:041
106439960,0cyclictest0-21swapper/122:31:371
106429965,0cyclictest0-21swapper/019:17:250
106429960,0cyclictest8968-21diskmemload21:15:020
106429960,0cyclictest0-21swapper/022:58:180
106429960,0cyclictest0-21swapper/000:17:170
8215050,0irq/24-0000:00:31633-21cat19:37:022
8215050,0irq/24-0000:00:29278-21latency_hist21:57:012
339950,0migration/38309-21aten_r1power_po20:32:133
339950,0migration/37827-21taskset21:32:393
339950,0migration/35775-21munin-node22:37:163
339950,0migration/35114-21kthreadcore20:52:203
339950,0migration/34697-21kthreadcore20:27:193
339950,0migration/332564-21taskset20:01:303
339950,0migration/330766-21unixbench-2d22:57:233
339950,0migration/330573-21munin-node21:57:173
339950,0migration/326818-21taskset21:50:323
339950,0migration/326042-21latency_hist19:57:023
339950,0migration/325795-21kthreadcore19:07:173
339950,0migration/321500-21kthreadcore23:57:173
339950,0migration/320929-21fschecks_count20:17:143
339950,0migration/319295-21ntp_offset20:12:213
339950,0migration/318300-21sh23:53:103
339950,0migration/317166-21sh23:17:193
339950,0migration/316921-21taskset00:26:183
339950,0migration/316638-21kthreadcore22:47:183
339950,0migration/315657-21taskset20:58:183
339950,0migration/315016-21munin-node21:37:203
339950,0migration/313582-21kthreadcore23:47:183
339950,0migration/312363-21kthreadcore20:07:203
339950,0migration/311416-21taskset23:15:073
339950,0migration/31110-21taskset20:26:163
29725050,0irq/27-eth0-tx-8194-21munin-node20:32:180
29725050,0irq/27-eth0-tx-2120-21gltestperf21:12:162
29725050,0irq/27-eth0-tx-17530-21munin-node19:02:170
29725050,0irq/27-eth0-tx-16529-21ssh23:48:422
29725050,0irq/27-eth0-tx-14419-21ssh00:19:382
29725050,0irq/27-eth0-tx-13692-21kthreadcore23:17:182
29725050,0irq/27-eth0-tx-13500-21ssh22:44:122
29725050,0irq/27-eth0-tx-12406-21ssh22:41:382
29725050,0irq/27-eth0-tx-0-21swapper/223:57:392
29725050,0irq/27-eth0-tx-0-21swapper/223:43:112
29725050,0irq/27-eth0-tx-0-21swapper/222:17:112
29725050,0irq/27-eth0-tx-0-21swapper/221:28:372
29725050,0irq/27-eth0-tx-0-21swapper/019:52:220
29725050,0irq/27-eth0-tx-0-21swapper/019:32:130
29715050,0irq/26-eth0-rx-31158-21kthreadcore00:07:173
29715050,0irq/26-eth0-rx-20593-21cut22:17:193
29715050,0irq/26-eth0-rx-1672-21ssh23:06:063
29715050,0irq/26-eth0-rx-0-21swapper/323:44:023
29715050,0irq/26-eth0-rx-0-21swapper/323:36:073
29715050,0irq/26-eth0-rx-0-21swapper/323:07:183
29715050,0irq/26-eth0-rx-0-21swapper/322:56:123
29715050,0irq/26-eth0-rx-0-21swapper/321:55:073
29715050,0irq/26-eth0-rx-0-21swapper/321:17:063
29715050,0irq/26-eth0-rx-0-21swapper/300:03:213
29715050,0irq/26-eth0-rx-0-21swapper/300:03:213
259950,0migration/23664-21runrttasks21:58:142
259950,0migration/230876-21munin-node22:57:242
259950,0migration/227008-21munin-node19:57:182
259950,0migration/225696-21aten_r1power_fr21:07:122
259950,0migration/220505-21sh23:22:402
259950,0migration/218389-21sh23:53:252
259950,0migration/217854-21cpuspeed_turbos19:02:142
259950,0migration/217609-21sh21:21:562
259950,0migration/215682-21munin-node20:37:162
259950,0migration/215047-21cpuspeed_turbos22:47:132
259950,0migration/21377-21sh23:05:142
259950,0migration/212198-21df_abs19:22:142
19150,0ktimersoftd/10-21swapper/122:46:171
19150,0ktimersoftd/10-21swapper/122:07:011
179950,0migration/15387-21kthreadcore23:07:181
179950,0migration/14795-21aten_r1power_en22:37:111
179950,0migration/128961-21munin-node20:47:161
179950,0migration/127072-21latency_hist20:22:021
149950,0migration/08921-21kthreadcore20:07:190
149950,0migration/07798-21fschecks_time22:07:160
149950,0migration/0743-21taskset20:22:290
149950,0migration/05472-21kthreadcore21:32:190
149950,0migration/04659-21taskset19:14:010
149950,0migration/04300-21taskset22:36:300
149950,0migration/031719-21kthreadcore22:27:180
149950,0migration/024269-21timerandwakeup19:27:250
149950,0migration/02290-21latency_hist20:52:020
149950,0migration/022635-21latency_hist22:52:010
149950,0migration/022032-21fschecks_count20:42:150
149950,0migration/020695-21sh23:23:140
149950,0migration/016196-21sh21:18:170
149950,0migration/015872-21sh20:58:510
149950,0migration/015836-21kthreadcore19:22:190
149950,0migration/011386-21taskset23:15:030
106459955,0cyclictest0-21swapper/222:30:382
106459955,0cyclictest0-21swapper/221:03:172
106459950,0cyclictest0-21swapper/223:31:572
106439955,0cyclictest0-21swapper/121:26:401
106439955,0cyclictest0-21swapper/121:01:451
106439950,0cyclictest0-21swapper/123:31:511
106439950,0cyclictest0-21swapper/122:33:121
106439950,0cyclictest0-21swapper/118:57:031
106439950,0cyclictest0-21swapper/100:11:441
106429955,0cyclictest0-21swapper/023:32:210
106429955,0cyclictest0-21swapper/021:55:240
106429950,0cyclictest0-21swapper/023:55:320
106429950,0cyclictest0-21swapper/023:04:080
106429950,0cyclictest0-21swapper/000:11:270
8215040,0irq/24-0000:00:20263-21idleruntime-cro20:17:022
339940,0migration/37106-21if_eth119:42:163
339940,0migration/332232-21kthreadcore19:12:193
339940,0migration/315377-21kthreadcore19:47:183
29725040,0irq/27-eth0-tx-24206-21munin-node19:07:230
29725040,0irq/27-eth0-tx-15687-21ssh00:22:432
29725040,0irq/27-eth0-tx-15200-21ssh22:12:032
29725040,0irq/27-eth0-tx-0-21swapper/223:37:032
29725040,0irq/27-eth0-tx-0-21swapper/223:32:352
29725040,0irq/27-eth0-tx-0-21swapper/223:07:532
29725040,0irq/27-eth0-tx-0-21swapper/222:52:112
29725040,0irq/27-eth0-tx-0-21swapper/222:32:382
29725040,0irq/27-eth0-tx-0-21swapper/222:22:362
29725040,0irq/27-eth0-tx-0-21swapper/222:02:132
29725040,0irq/27-eth0-tx-0-21swapper/221:48:572
29725040,0irq/27-eth0-tx-0-21swapper/221:32:062
29725040,0irq/27-eth0-tx-0-21swapper/200:13:142
29725040,0irq/27-eth0-tx-0-21swapper/200:07:132
29725040,0irq/27-eth0-tx-0-21swapper/200:02:172
29725040,0irq/27-eth0-tx-0-21swapper/200:02:172
29725040,0irq/27-eth0-tx-0-21swapper/020:37:240
29725040,0irq/27-eth0-tx-0-21swapper/018:57:180
29715040,0irq/26-eth0-rx-12898-21ssh22:42:263
29715040,0irq/26-eth0-rx-0-21swapper/323:38:013
29715040,0irq/26-eth0-rx-0-21swapper/323:22:253
29715040,0irq/26-eth0-rx-0-21swapper/322:27:183
29715040,0irq/26-eth0-rx-0-21swapper/322:07:223
29715040,0irq/26-eth0-rx-0-21swapper/322:02:413
29715040,0irq/26-eth0-rx-0-21swapper/321:42:453
29715040,0irq/26-eth0-rx-0-21swapper/321:27:173
29715040,0irq/26-eth0-rx-0-21swapper/321:12:323
29715040,0irq/26-eth0-rx-0-21swapper/319:27:203
29715040,0irq/26-eth0-rx-0-21swapper/300:12:493
259940,0migration/29628-21aten_r1power_cu21:37:122
259940,0migration/25122-21latency_hist19:17:022
259940,0migration/23564-21kthreadcore19:12:202
259940,0migration/229505-21taskset19:07:182
259940,0migration/22183-21kthreadcore19:37:172
259940,0migration/217988-40yum-updatesd21:43:162
259940,0migration/217784-21kthreadcore19:47:192
259940,0migration/21668-21irqrtprio20:02:162
259940,0migration/212554-21kthreadcore18:57:182
259940,0migration/210294-21latency_hist23:12:012
249940,0watchdog/224803-21load19:52:202
249940,0watchdog/2154272sleep220:57:442
249940,0watchdog/20-21swapper/222:07:162
249940,0watchdog/20-21swapper/220:22:202
179940,0migration/16653-21kthreadcore20:27:201
179940,0migration/13689-21taskset21:58:191
179940,0migration/12714-21cpuspeed_turbos20:52:151
179940,0migration/126665-21fschecks_time21:27:141
179940,0migration/126568-21df_inode19:57:161
179940,0migration/119462-21taskset20:12:231
179940,0migration/118395-21taskset21:44:261
179940,0migration/118209-21idleruntime21:02:141
179940,0migration/117085-21taskset21:41:181
179940,0migration/113979-21kthreadcore23:17:181
179940,0migration/113362-21kthreadcore20:32:191
179940,0migration/11281-21latency_hist21:12:021
169940,0watchdog/14200-21switchtime19:12:241
169940,0watchdog/128615-21ssh21:55:081
169940,0watchdog/126559-21if_eth021:07:161
169940,0watchdog/118306-21ssh23:53:111
169940,0watchdog/116138-21ssh21:18:081
169940,0watchdog/111012-21cut22:07:201
169940,0watchdog/10-21swapper/123:37:151
169940,0watchdog/10-21swapper/122:57:231
169940,0watchdog/10-21swapper/122:49:391
169940,0watchdog/10-21swapper/100:22:031
169940,0watchdog/10-21swapper/100:18:511
149940,0migration/05479-21kthreadcore20:02:180
149940,0migration/025108-21sh21:25:210
11851240,0sleep312517-21kthreadcore18:57:183
106459943,0cyclictest7051-21awk19:42:162
106459943,0cyclictest3556-21lldpd20:28:582
106459943,0cyclictest3556-21lldpd20:19:282
106459943,0cyclictest27965-21basename20:47:012
106439944,0cyclictest0-21swapper/123:42:151
106439944,0cyclictest0-21swapper/122:56:131
106439944,0cyclictest0-21swapper/121:36:451
106439943,0cyclictest7222-21sadc00:17:011
106439943,0cyclictest3556-21lldpd23:23:281
106439943,0cyclictest3556-21lldpd22:23:281
106439943,0cyclictest3556-21lldpd22:12:581
106439943,0cyclictest3556-21lldpd20:42:291
106439943,0cyclictest3556-21lldpd19:28:581
106439943,0cyclictest3556-21lldpd19:08:281
106439943,0cyclictest331-21awk19:37:161
106439943,0cyclictest20571-21awk21:47:171
106439943,0cyclictest20353-21awk19:52:171
106439943,0cyclictest1414-21awk20:02:151
106439943,0cyclictest13756-21awk19:47:161
106439943,0cyclictest10806-21awk23:47:151
106429944,0cyclictest0-21swapper/023:39:180
106429944,0cyclictest0-21swapper/021:50:590
106429944,0cyclictest0-21swapper/000:05:370
106429944,0cyclictest0-21swapper/000:05:370
106429943,0cyclictest6955-21sadc22:07:010
106429943,0cyclictest3514-21snmpd23:57:190
106429943,0cyclictest3514-21snmpd20:28:320
106429943,0cyclictest26560-21awk21:07:160
106429943,0cyclictest18265-21awk21:02:150
106429943,0cyclictest13216-21awk23:17:160
106429943,0cyclictest0-21swapper/020:17:210
8215030,0irq/24-0000:00:0-21swapper/220:32:222
29715030,0irq/26-eth0-rx-0-21swapper/320:47:143
29715030,0irq/26-eth0-rx-0-21swapper/320:42:133
29715030,0irq/26-eth0-rx-0-21swapper/319:41:043
29715030,0irq/26-eth0-rx-0-21swapper/319:32:283
29715030,0irq/26-eth0-rx-0-21swapper/319:22:223
29715030,0irq/26-eth0-rx-0-21swapper/319:17:133
249930,0watchdog/25193-21kthreadcore20:52:202
249930,0watchdog/20-21swapper/219:27:242
179930,0migration/118724-21kthreadcore22:17:181
169930,0watchdog/10-21swapper/123:32:031
169930,0watchdog/10-21swapper/123:02:151
169930,0watchdog/10-21swapper/120:22:201
106459932,0cyclictest12878-21sensors20:07:232
106439933,0cyclictest3556-21lldpd19:45:581
106439932,0cyclictest8052-21awk20:07:161
106439932,0cyclictest3556-21lldpd23:13:281
106439932,0cyclictest3514-21snmpd00:03:261
106439932,0cyclictest3514-21snmpd00:03:261
106439932,0cyclictest26098-21awk19:32:171
106439932,0cyclictest20532-21sensors20:37:231
106439932,0cyclictest18462-21awk19:02:171
106439932,0cyclictest16329-21kthreadcore19:22:191
106439931,0cyclictest7033-21kthreadcore19:17:191
106429933,0cyclictest5499-21kworker/0:023:42:180
106429933,0cyclictest5499-21kworker/0:023:27:020
106429933,0cyclictest5499-21kworker/0:023:07:150
106429933,0cyclictest5499-21kworker/0:022:52:150
106429933,0cyclictest5499-21kworker/0:022:42:030
106429933,0cyclictest5499-21kworker/0:022:22:030
106429933,0cyclictest5499-21kworker/0:022:17:030
106429933,0cyclictest5499-21kworker/0:021:57:050
106429933,0cyclictest5499-21kworker/0:021:42:130
106429933,0cyclictest5499-21kworker/0:021:37:050
106429933,0cyclictest5499-21kworker/0:021:27:050
106429933,0cyclictest5499-21kworker/0:020:12:090
106429933,0cyclictest5499-21kworker/0:019:47:050
106429933,0cyclictest5499-21kworker/0:019:42:110
106429933,0cyclictest5499-21kworker/0:019:37:030
106429933,0cyclictest5499-21kworker/0:000:22:200
106429933,0cyclictest5499-21kworker/0:000:12:040
106429932,0cyclictest3514-21snmpd19:57:020
29715020,0irq/26-eth0-rx-15528-21perl20:37:153
29715020,0irq/26-eth0-rx-0-21swapper/320:02:193
29715020,0irq/26-eth0-rx-0-21swapper/319:02:143
106459920,0cyclictest0-21swapper/220:47:042
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional