You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 03:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sun May 31, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2247527877,0sleep10-21swapper/118:53:531
2136826463,0sleep20-21swapper/218:49:252
304450460,0irq/25-eth10-21swapper/318:50:103
2216123723,0sleep00-21swapper/018:50:150
22560991212,0cyclictest27176-21kworker/0:022:04:220
225609988,0cyclictest27176-21kworker/0:023:24:200
225609988,0cyclictest11194-21kworker/0:019:24:190
225629976,0cyclictest604-21cut20:59:252
225619970,0cyclictest0-21swapper/123:21:451
225609977,0cyclictest27176-21kworker/0:023:54:220
225609977,0cyclictest27176-21kworker/0:023:19:220
339960,0migration/36696-21aten2.4-expect20:19:173
339960,0migration/34147-21sh21:43:033
339960,0migration/33924-21sh22:03:063
339960,0migration/32740-21sh00:02:553
339960,0migration/319364-21sh21:09:343
339960,0migration/318371-21sh23:50:513
339960,0migration/310937-21sh22:05:033
29715060,0irq/26-eth0-rx-9475-21munin-node00:04:273
29715060,0irq/26-eth0-rx-29281-21hwlatdetect22:39:193
29715060,0irq/26-eth0-rx-17608-21ntp_states23:09:253
259960,0migration/25437-21latency_hist19:54:052
225619960,0cyclictest0-21swapper/123:05:501
225619960,0cyclictest0-21swapper/121:20:221
225609966,0cyclictest27176-21kworker/0:022:59:220
225609966,0cyclictest27176-21kworker/0:022:24:220
225609960,0cyclictest7567-21kthreadcore00:04:210
225609960,0cyclictest0-21swapper/023:18:280
149960,0migration/03742-21aten_r1power_vo23:44:150
149960,0migration/020461-21sh21:12:290
149960,0migration/019825-21sh21:51:530
149960,0migration/016644-21taskset19:11:540
8215050,0irq/24-0000:00:24476-21latency_hist19:44:052
339950,0migration/3907-21irqcore20:14:193
339950,0migration/37940-21kthreadcore23:04:223
339950,0migration/37414-21idleruntime-cro20:44:053
339950,0migration/35778-21if_eth1.221:44:223
339950,0migration/33279-21taskset19:02:233
339950,0migration/330475-21munin-node19:24:173
339950,0migration/329480-21kthreadcore20:09:233
339950,0migration/328898-21kthreadcore00:19:213
339950,0migration/327567-21taskset23:38:503
339950,0migration/327567-21taskset23:38:503
339950,0migration/326866-21cpuspeed_turbos20:34:163
339950,0migration/326608-21pmu-power20:54:263
339950,0migration/326334-21taskset20:33:303
339950,0migration/321891-21kthreadcore22:34:203
339950,0migration/312112-21cpuspeed_turbos23:29:173
339950,0migration/312107-21latency_hist22:49:053
29725050,0irq/27-eth0-tx-31371-21munin-node19:49:250
29725050,0irq/27-eth0-tx-29366-21munin-node21:19:262
29725050,0irq/27-eth0-tx-28254-21ssh20:57:362
29725050,0irq/27-eth0-tx-18995-21munin-node20:04:260
29725050,0irq/27-eth0-tx-18981-21ssh21:29:292
29725050,0irq/27-eth0-tx-12857-21fschecks_count22:29:182
29725050,0irq/27-eth0-tx-12848-21cat23:29:202
29725050,0irq/27-eth0-tx-12423-21ssh21:48:292
29725050,0irq/27-eth0-tx-11435-21ssh23:08:092
29725050,0irq/27-eth0-tx-0-21swapper/223:44:482
29725050,0irq/27-eth0-tx-0-21swapper/223:43:362
29725050,0irq/27-eth0-tx-0-21swapper/222:42:132
29725050,0irq/27-eth0-tx-0-21swapper/222:11:222
29725050,0irq/27-eth0-tx-0-21swapper/221:24:252
29725050,0irq/27-eth0-tx-0-21swapper/020:44:000
29715050,0irq/26-eth0-rx-8695-21kthreadcore22:44:233
29715050,0irq/26-eth0-rx-6157-21kthreadcore22:24:213
29715050,0irq/26-eth0-rx-28968-21irqcore23:39:223
29715050,0irq/26-eth0-rx-27044-21ssh22:15:073
29715050,0irq/26-eth0-rx-25476-21memory23:14:223
29715050,0irq/26-eth0-rx-23592-21kthreadcore23:54:223
29715050,0irq/26-eth0-rx-22701-21grep00:14:213
29715050,0irq/26-eth0-rx-21686-21ssh21:14:163
29715050,0irq/26-eth0-rx-20424-21cpu22:54:163
29715050,0irq/26-eth0-rx-18953-21uptime21:49:263
29715050,0irq/26-eth0-rx-13094-21ssh21:29:093
29715050,0irq/26-eth0-rx-12537-21aten_r1power_po22:29:173
29715050,0irq/26-eth0-rx-0-21swapper/322:59:093
29715050,0irq/26-eth0-rx-0-21swapper/322:20:003
29715050,0irq/26-eth0-rx-0-21swapper/321:57:323
29715050,0irq/26-eth0-rx-0-21swapper/321:34:153
29715050,0irq/26-eth0-rx-0-21swapper/321:26:063
29715050,0irq/26-eth0-rx-0-21swapper/321:19:213
29715050,0irq/26-eth0-rx-0-21swapper/321:04:233
29715050,0irq/26-eth0-rx-0-21swapper/320:59:253
29715050,0irq/26-eth0-rx-0-21swapper/319:49:223
29715050,0irq/26-eth0-rx-0-21swapper/300:11:403
259950,0migration/24097-21crond22:24:052
259950,0migration/23484-21idleruntime-cro19:04:052
259950,0migration/23266-21latency19:24:232
259950,0migration/23173-21idleruntime-cro00:04:052
259950,0migration/227601-21taskset21:14:412
259950,0migration/225142-21kthreadcore23:34:232
259950,0migration/225142-21kthreadcore23:34:232
259950,0migration/225071-21kthreadcore22:54:222
259950,0migration/222883-21timerwakeupswit19:14:292
259950,0migration/221903-21munin-node21:34:192
259950,0migration/217993-21timerwakeupswit23:09:282
259950,0migration/216926-21latency_hist19:14:052
259950,0migration/214891-21kthreadcore22:49:222
259950,0migration/211800-21aten_r1power_fr23:49:162
225629950,0cyclictest0-21swapper/222:59:242
225619955,0cyclictest0-21swapper/122:08:171
225619950,0cyclictest0-21swapper/121:56:181
225619950,0cyclictest0-21swapper/119:35:501
225619950,0cyclictest0-21swapper/119:19:171
225609955,0cyclictest27176-21kworker/0:023:49:180
225609955,0cyclictest27176-21kworker/0:022:39:180
225609955,0cyclictest27176-21kworker/0:022:19:220
225609955,0cyclictest26094-21kworker/0:119:04:170
225609955,0cyclictest11194-21kworker/0:020:29:230
225609955,0cyclictest11194-21kworker/0:019:39:170
225609955,0cyclictest0-21swapper/021:25:070
225609950,0cyclictest0-21swapper/021:47:020
225609950,0cyclictest0-21swapper/020:58:280
179950,0migration/16901-21kthreadcore23:24:211
179950,0migration/13612-21kthreadcore20:39:231
179950,0migration/119613-21fschecks_time20:04:181
169950,0watchdog/127311-21rm22:57:031
149950,0migration/08433-21idleruntime20:44:190
149950,0migration/07543-21kthreadcore19:29:220
149950,0migration/031881-21kthreadcore20:59:250
149950,0migration/030342-21irqrtprio21:39:200
149950,0migration/030317-21processes19:44:250
149950,0migration/030063-21kthreadcore00:19:210
149950,0migration/027701-21taskset21:14:590
149950,0migration/026656-21kthreadcore19:19:220
149950,0migration/025122-21munin-node00:14:240
149950,0migration/023855-21kthreadcore22:34:210
149950,0migration/02172-21taskset23:40:560
149950,0migration/019954-21aten_r1power_en23:34:170
149950,0migration/019954-21aten_r1power_en23:34:170
149950,0migration/017453-21kthreadcore22:49:230
149950,0migration/017289-21kthreadcore20:49:220
149950,0migration/016313-21kthreadcore21:29:230
149950,0migration/014664-21kthreadcore19:59:220
149950,0migration/012767-21taskset20:20:270
149950,0migration/012718-21irqrtprio00:09:220
149950,0migration/012448-21taskset21:07:510
149950,0migration/011757-21latency_hist23:29:050
8215040,0irq/24-0000:00:0-21swapper/223:24:072
339940,0migration/39935-21taskset19:06:163
339940,0migration/328729-21kthreadcore19:19:223
339940,0migration/325182-21fschecks_count19:44:183
339940,0migration/316011-21kthreadcore20:24:223
339940,0migration/313321-21taskset19:59:203
29725040,0irq/27-eth0-tx-0-21swapper/222:44:062
29725040,0irq/27-eth0-tx-0-21swapper/222:34:242
29725040,0irq/27-eth0-tx-0-21swapper/222:14:072
29725040,0irq/27-eth0-tx-0-21swapper/222:04:122
29725040,0irq/27-eth0-tx-0-21swapper/221:59:112
29725040,0irq/27-eth0-tx-0-21swapper/221:55:592
29725040,0irq/27-eth0-tx-0-21swapper/221:09:192
29725040,0irq/27-eth0-tx-0-21swapper/221:04:112
29725040,0irq/27-eth0-tx-0-21swapper/200:14:082
29725040,0irq/27-eth0-tx-0-21swapper/019:57:130
29725040,0irq/27-eth0-tx-0-21swapper/019:14:180
29715040,0irq/26-eth0-rx-0-21swapper/323:44:213
29715040,0irq/26-eth0-rx-0-21swapper/323:24:183
29715040,0irq/26-eth0-rx-0-21swapper/323:19:233
29715040,0irq/26-eth0-rx-0-21swapper/322:10:173
29715040,0irq/26-eth0-rx-0-21swapper/319:54:193
29715040,0irq/26-eth0-rx-0-21swapper/319:29:263
259940,0migration/27439-21kthreadcore00:04:212
259940,0migration/2513-21fschecks_time20:14:172
259940,0migration/24649-21latency_hist19:29:052
259940,0migration/24203-21fschecks_count19:04:182
259940,0migration/232561-21kthreadcore23:19:232
259940,0migration/232173-21kthreadcore21:39:212
259940,0migration/225134-21runrttasks20:05:482
259940,0migration/219976-21munin-node20:49:272
259940,0migration/217218-21timerwakeupswit19:34:282
259940,0migration/211025-21missed_timers19:54:232
225629944,0cyclictest0-21swapper/220:30:442
225629943,0cyclictest3556-21lldpd23:54:442
225629943,0cyclictest3556-21lldpd23:14:442
225629943,0cyclictest3556-21lldpd20:19:432
225629943,0cyclictest3556-21lldpd20:00:132
225629943,0cyclictest3556-21lldpd19:45:442
225629943,0cyclictest3556-21lldpd19:19:142
225629943,0cyclictest3514-21snmpd22:24:502
225629943,0cyclictest3514-21snmpd21:49:202
225629943,0cyclictest3514-21snmpd00:19:202
225629943,0cyclictest1708-21awk20:39:202
225629943,0cyclictest0-21swapper/200:09:052
225619944,0cyclictest0-21swapper/122:48:581
225619943,0cyclictest789-21awk20:14:181
225619943,0cyclictest3601-21ps19:24:261
225619943,0cyclictest3556-21lldpd23:57:141
225619943,0cyclictest3556-21lldpd23:14:131
225619943,0cyclictest3556-21lldpd22:34:131
225619943,0cyclictest3556-21lldpd20:19:131
225619943,0cyclictest3556-21lldpd19:54:141
225619943,0cyclictest3556-21lldpd19:53:441
225619943,0cyclictest3556-21lldpd19:39:431
225619943,0cyclictest3514-21snmpd22:29:201
225619943,0cyclictest3514-21snmpd20:13:351
225619943,0cyclictest3514-21snmpd19:02:051
225619943,0cyclictest3514-21snmpd18:55:501
225619943,0cyclictest3241-21irqbalance22:14:131
225619943,0cyclictest3241-21irqbalance21:44:231
225619943,0cyclictest30140-21awk21:39:191
225619943,0cyclictest29424-21awk22:39:201
225619943,0cyclictest23065-21ps20:29:231
225619943,0cyclictest20788-21awk23:34:201
225619943,0cyclictest20788-21awk23:34:201
225619943,0cyclictest20459-21awk00:14:191
225619943,0cyclictest13630-21awk22:09:201
225619943,0cyclictest13235-21awk19:59:201
225619943,0cyclictest13094-21awk22:49:201
225619940,0cyclictest0-21swapper/120:54:021
225619940,0cyclictest0-21swapper/119:47:111
225609944,0cyclictest0-21swapper/023:09:480
225609944,0cyclictest0-21swapper/021:56:390
225609943,0cyclictest26562-21awk20:09:210
225609943,0cyclictest14161-21awk20:24:200
225609943,0cyclictest13580-21awk22:09:200
225609943,0cyclictest12254-21awk19:34:200
225609940,0cyclictest0-21swapper/022:59:050
179940,0migration/19690-21sh00:04:391
179940,0migration/18998-21kthreadcore22:24:221
179940,0migration/18068-21fschecks_count20:44:181
179940,0migration/15912-21irqrtprio19:29:211
179940,0migration/14983-21kernelversion19:04:211
179940,0migration/14605-21if_eth1.323:44:191
179940,0migration/13263-21latency_hist00:04:051
179940,0migration/130507-21kthreadcore22:19:221
179940,0migration/128678-21gltestperf23:39:201
179940,0migration/127965-21sh00:19:171
179940,0migration/121681-21fschecks_time21:34:181
179940,0migration/119622-21sh21:10:201
179940,0migration/116389-21kthreadcore23:49:231
179940,0migration/115574-21kthreadcore23:29:221
179940,0migration/114068-21kthreadcore23:09:221
179940,0migration/112891-21sh21:49:121
179940,0migration/111874-21sh21:06:241
179940,0migration/111866-21kthreadcore19:09:211
179940,0migration/110042-21kthreadcore21:24:231
169940,0watchdog/12693-21ssh21:59:431
169940,0watchdog/113866-21grep21:29:191
169940,0watchdog/112230-21perl00:09:191
169940,0watchdog/10-21swapper/122:59:231
149940,0migration/07169-21kthreadcore23:04:220
149940,0migration/021180-21aten_r1power_fr21:34:150
339930,0migration/316501-21taskset19:10:163
29715030,0irq/26-eth0-rx-0-21swapper/320:49:163
29715030,0irq/26-eth0-rx-0-21swapper/320:44:163
29715030,0irq/26-eth0-rx-0-21swapper/319:39:113
29715030,0irq/26-eth0-rx-0-21swapper/319:38:523
29715030,0irq/26-eth0-rx-0-21swapper/318:54:163
249930,0watchdog/20-21swapper/220:44:442
225629932,0cyclictest3556-21lldpd18:58:132
225629932,0cyclictest26538-21awk20:09:212
225629930,0cyclictest14227-21awk20:24:202
225619932,0cyclictest3556-21lldpd19:14:131
225619932,0cyclictest3514-21snmpd20:54:201
225619932,0cyclictest27482-21awk20:34:191
225619932,0cyclictest22235-21awk21:14:191
225609933,0cyclictest27176-21kworker/0:022:29:200
225609933,0cyclictest27176-21kworker/0:022:14:120
225609933,0cyclictest27176-21kworker/0:021:59:100
225609933,0cyclictest27176-21kworker/0:021:19:070
225609933,0cyclictest26094-21kworker/0:118:59:090
225609933,0cyclictest26094-21kworker/0:118:54:110
225609933,0cyclictest11194-21kworker/0:020:34:070
225609933,0cyclictest11194-21kworker/0:020:14:150
225609932,0cyclictest5022-21awk22:44:200
225609932,0cyclictest27793-21sh23:59:140
179930,0migration/115346-21kthreadcore20:24:221
169930,0watchdog/10-21swapper/121:00:351
29715020,0irq/26-eth0-rx-0-21swapper/320:05:023
29715020,0irq/26-eth0-rx-0-21swapper/319:14:083
249920,0watchdog/20-21swapper/220:34:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional