You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-13 - 04:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Thu Aug 13, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2517628684,0sleep10-21swapper/118:42:221
304450650,0irq/25-eth10-21swapper/318:46:283
2579323425,0sleep20-21swapper/218:43:192
2578123228,0sleep00-21swapper/018:43:090
261879975,0cyclictest0-21swapper/121:54:301
261879973,0cyclictest7669-21awk21:57:161
261879973,0cyclictest3556-21lldpd20:22:391
261879972,0cyclictest913-21awk21:12:171
261879972,0cyclictest7033-21awk22:17:161
4160,0ktimersoftd/00-21swapper/023:42:230
35160,0ktimersoftd/30-21swapper/323:42:233
339960,0migration/329449-21sh21:47:533
339960,0migration/321995-21sh22:06:143
339960,0migration/321814-21sh22:27:023
339960,0migration/320108-21sh22:44:253
339960,0migration/319598-21sh23:05:033
339960,0migration/313834-21sh22:00:283
29725060,0irq/27-eth0-tx-1598-21munin-node19:17:140
29715060,0irq/26-eth0-rx-5666-21ssh21:32:573
29715060,0irq/26-eth0-rx-13408-21users18:57:243
29715060,0irq/26-eth0-rx-0-21swapper/321:47:013
27160,0ktimersoftd/20-21swapper/223:42:232
261889966,0cyclictest0-21swapper/220:27:172
261879962,0cyclictest3514-21snmpd19:27:341
261879962,0cyclictest28627-21awk23:32:161
261879962,0cyclictest25542-21awk20:47:171
261879960,0cyclictest16244-21entropy21:22:131
261879960,0cyclictest0-21swapper/121:28:491
261869965,0cyclictest30528-21ssh21:07:340
8215050,0irq/24-0000:00:7176-21idleruntime-cro18:57:022
4150,0ktimersoftd/00-21swapper/022:47:100
339950,0migration/39306-21munin-node20:07:263
339950,0migration/3884-21cpuspeed_turbos18:52:143
339950,0migration/37538-21kthreadcore19:42:193
339950,0migration/36484-21kthreadcore23:37:183
339950,0migration/35934-21fschecks_time22:37:133
339950,0migration/34577-21ksmtuned22:35:303
339950,0migration/332400-21kthreadcore20:27:183
339950,0migration/332170-21munin-node00:12:223
339950,0migration/331032-21kthreadcore19:12:183
339950,0migration/328641-21munin-node23:32:163
339950,0migration/326791-21munin-node22:47:203
339950,0migration/32539-21kthreadcore21:12:193
339950,0migration/324158-21latency_hist21:07:023
339950,0migration/32375-21latency_hist19:42:023
339950,0migration/321393-21kthreadcore00:07:193
339950,0migration/320833-21timerwakeupswit19:27:243
339950,0migration/31929-21kthreadcore20:52:193
339950,0migration/31841-21cpuspeed_turbos19:17:143
339950,0migration/316985-21munin-node19:52:173
339950,0migration/316861-21irqcore21:22:163
339950,0migration/31503-21runrttasks23:54:393
339950,0migration/312832-21munin-node23:22:143
339950,0migration/311734-21kthreadcore19:47:173
339950,0migration/311581-21df_abs20:37:133
339950,0migration/310237-21munin-node22:57:203
29725050,0irq/27-eth0-tx-8910-21cut21:57:182
29725050,0irq/27-eth0-tx-6110-21ssh21:56:182
29725050,0irq/27-eth0-tx-28319-21munin-node19:37:140
29725050,0irq/27-eth0-tx-23593-21munin-node20:22:230
29725050,0irq/27-eth0-tx-18582-21aten2.4-expect00:07:132
29725050,0irq/27-eth0-tx-0-21swapper/223:22:222
29725050,0irq/27-eth0-tx-0-21swapper/222:27:272
29725050,0irq/27-eth0-tx-0-21swapper/222:17:182
29725050,0irq/27-eth0-tx-0-21swapper/200:12:172
29725050,0irq/27-eth0-tx-0-21swapper/200:00:132
29725050,0irq/27-eth0-tx-0-21swapper/020:47:020
29715050,0irq/26-eth0-rx-3447-21if_err_eth1.223:57:163
29715050,0irq/26-eth0-rx-3342-21latency_hist20:07:023
29715050,0irq/26-eth0-rx-26694-21runrttasks21:27:173
29715050,0irq/26-eth0-rx-21961-21python21:02:253
29715050,0irq/26-eth0-rx-16330-21munin-node20:12:273
29715050,0irq/26-eth0-rx-14305-21ssh21:40:003
29715050,0irq/26-eth0-rx-14215-21cpuspeed_turbos22:22:133
29715050,0irq/26-eth0-rx-11778-21grep22:17:223
29715050,0irq/26-eth0-rx-0-21swapper/323:49:023
29715050,0irq/26-eth0-rx-0-21swapper/323:07:123
29715050,0irq/26-eth0-rx-0-21swapper/322:07:043
29715050,0irq/26-eth0-rx-0-21swapper/321:56:333
29715050,0irq/26-eth0-rx-0-21swapper/321:17:523
29715050,0irq/26-eth0-rx-0-21swapper/320:50:043
29715050,0irq/26-eth0-rx-0-21swapper/320:22:213
261889955,0cyclictest0-21swapper/223:51:552
261889955,0cyclictest0-21swapper/223:32:232
261889955,0cyclictest0-21swapper/223:21:112
261889955,0cyclictest0-21swapper/222:59:542
261889955,0cyclictest0-21swapper/221:24:502
261889950,0cyclictest0-21swapper/221:17:542
261879953,0cyclictest0-21swapper/100:06:561
261879952,0cyclictest923-21awk20:52:171
261879952,0cyclictest21946-21sensors21:02:241
261879950,0cyclictest17256-21runrttasks20:37:301
261869955,0cyclictest0-21swapper/021:42:440
261869955,0cyclictest0-21swapper/000:08:430
261869954,0cyclictest25072-21kworker/0:022:22:170
261869954,0cyclictest25072-21kworker/0:021:39:150
261869950,0cyclictest0-21swapper/023:26:190
261869950,0cyclictest0-21swapper/020:17:260
261869950,0cyclictest0-21swapper/019:02:140
261869950,0cyclictest0-21swapper/000:05:060
259950,0migration/23485-21latency_hist20:07:022
259950,0migration/22832-21sh22:52:252
259950,0migration/227343-21sh23:31:322
259950,0migration/227343-21sh23:31:322
259950,0migration/223178-21sh21:04:532
259950,0migration/21056-21kthreadcore23:12:172
249950,0watchdog/28657-21ssh21:37:202
249950,0watchdog/229588-21uptime20:22:242
149950,0migration/0772-21munin-node21:12:170
149950,0migration/07362-21kthreadcore22:37:170
149950,0migration/0553-21latency_hist18:52:020
149950,0migration/03880-21munin-node22:12:210
149950,0migration/03140-21munin-node22:32:210
149950,0migration/028267-21kthreadcore00:12:170
149950,0migration/027619-21fschecks_time23:52:150
149950,0migration/027550-21kthreadcore22:07:180
149950,0migration/022250-21kthreadcore20:42:180
149950,0migration/02206-21kthreadcore21:52:160
149950,0migration/02167-21needreboot22:52:190
149950,0migration/021657-21needreboot21:02:210
149950,0migration/021076-21kthreadcore21:22:180
149950,0migration/019795-21sh23:27:050
149950,0migration/019795-21sh23:27:050
149950,0migration/018004-21kthreadcore19:52:180
149950,0migration/016583-21kthreadcore22:42:180
149950,0migration/014878-21cpuspeed_turbos22:02:130
149950,0migration/012383-21taskset22:18:000
149950,0migration/010852-21kthreadcore21:17:180
8215040,0irq/24-0000:00:0-21swapper/221:47:022
339940,0migration/34571-21aten_r1power_cu20:32:133
339940,0migration/321974-21kernelversion19:07:183
339940,0migration/317598-21fschecks_time20:17:133
29725040,0irq/27-eth0-tx-32317-21ssh21:12:112
29725040,0irq/27-eth0-tx-30280-21telnet20:27:120
29725040,0irq/27-eth0-tx-0-21swapper/223:39:402
29725040,0irq/27-eth0-tx-0-21swapper/223:07:182
29725040,0irq/27-eth0-tx-0-21swapper/222:47:092
29725040,0irq/27-eth0-tx-0-21swapper/222:37:032
29725040,0irq/27-eth0-tx-0-21swapper/222:02:062
29725040,0irq/27-eth0-tx-0-21swapper/221:42:232
29725040,0irq/27-eth0-tx-0-21swapper/221:33:212
29725040,0irq/27-eth0-tx-0-21swapper/221:08:252
29725040,0irq/27-eth0-tx-0-21swapper/220:57:182
29725040,0irq/27-eth0-tx-0-21swapper/220:49:502
29725040,0irq/27-eth0-tx-0-21swapper/020:07:270
29725040,0irq/27-eth0-tx-0-21swapper/019:12:150
29715040,0irq/26-eth0-rx-0-21swapper/323:27:173
29715040,0irq/26-eth0-rx-0-21swapper/323:27:173
29715040,0irq/26-eth0-rx-0-21swapper/323:18:573
29715040,0irq/26-eth0-rx-0-21swapper/323:12:113
29715040,0irq/26-eth0-rx-0-21swapper/322:52:173
29715040,0irq/26-eth0-rx-0-21swapper/322:12:123
29715040,0irq/26-eth0-rx-0-21swapper/320:57:133
29715040,0irq/26-eth0-rx-0-21swapper/319:57:183
29715040,0irq/26-eth0-rx-0-21swapper/318:47:213
29715040,0irq/26-eth0-rx-0-21swapper/300:02:133
261889943,0cyclictest5444-21awk20:32:172
261889943,0cyclictest3514-21snmpd21:27:362
261889943,0cyclictest3514-21snmpd20:37:052
261889943,0cyclictest3514-21snmpd19:45:352
261889943,0cyclictest28238-21awk19:12:162
261889943,0cyclictest2437-21awk19:17:162
261889943,0cyclictest14975-21awk19:02:172
261889943,0cyclictest14804-21awk22:22:152
261889940,0cyclictest0-21swapper/219:37:312
261879944,0cyclictest0-21swapper/123:03:051
261879943,0cyclictest5761-21sadc22:17:011
261879943,0cyclictest3556-21lldpd23:39:111
261879943,0cyclictest3556-21lldpd23:27:091
261879943,0cyclictest3556-21lldpd23:27:091
261879943,0cyclictest3556-21lldpd23:16:391
261879943,0cyclictest3556-21lldpd21:49:091
261879943,0cyclictest3556-21lldpd21:17:391
261879943,0cyclictest3556-21lldpd21:07:391
261879943,0cyclictest3556-21lldpd20:57:391
261879943,0cyclictest3556-21lldpd20:21:091
261879943,0cyclictest3556-21lldpd19:22:101
261879943,0cyclictest3556-21lldpd00:12:101
261879943,0cyclictest3514-21snmpd19:57:501
261879943,0cyclictest3241-21irqbalance22:37:301
261879943,0cyclictest3241-21irqbalance22:34:001
261879943,0cyclictest3241-21irqbalance22:28:201
261879943,0cyclictest3241-21irqbalance21:32:501
261879943,0cyclictest3241-21irqbalance19:17:101
261879943,0cyclictest3241-21irqbalance19:12:201
261879943,0cyclictest3241-21irqbalance19:07:101
261879943,0cyclictest3241-21irqbalance18:57:201
261879943,0cyclictest3241-21irqbalance18:52:101
261879943,0cyclictest3241-21irqbalance18:47:201
261879943,0cyclictest3241-21irqbalance00:08:091
261879943,0cyclictest27967-21awk23:52:161
261879943,0cyclictest22108-21awk22:47:141
261879943,0cyclictest15047-21awk19:02:171
261879943,0cyclictest0-21swapper/123:17:551
261879940,0cyclictest0-21swapper/122:23:591
261879940,0cyclictest0-21swapper/122:07:361
261869944,0cyclictest9133-21kworker/0:120:57:090
261869944,0cyclictest9133-21kworker/0:119:57:210
261869944,0cyclictest25072-21kworker/0:023:32:220
261869944,0cyclictest25072-21kworker/0:023:15:500
261869944,0cyclictest25072-21kworker/0:023:07:380
261869944,0cyclictest25072-21kworker/0:022:30:010
261869944,0cyclictest25072-21kworker/0:021:32:090
261869943,0cyclictest9206-21awk19:22:180
261869943,0cyclictest4229-21awk23:37:150
261869943,0cyclictest3556-21lldpd23:47:100
261869943,0cyclictest3556-21lldpd23:17:390
261869943,0cyclictest3556-21lldpd21:57:390
261869943,0cyclictest3556-21lldpd20:14:390
261869943,0cyclictest3544-21awk23:57:160
261869943,0cyclictest25072-21kworker/0:021:48:170
261869943,0cyclictest24264-21sort21:27:130
261869943,0cyclictest14983-21munin-node19:27:180
259940,0migration/29269-21latency_hist19:47:022
259940,0migration/25740-21kthreadcore20:07:212
259940,0migration/2362-21runrttasks18:51:572
259940,0migration/232622-21kthreadcore22:12:172
259940,0migration/230450-21fschecks_time22:32:132
259940,0migration/228499-21timerwakeupswit22:07:242
259940,0migration/224778-21kthreadcore19:07:192
259940,0migration/218148-21cpuspeed_turbos20:42:122
259940,0migration/216067-21kthreadcore22:42:182
259940,0migration/215365-21kthreadcore20:12:202
259940,0migration/215045-21kthreadcore23:02:182
259940,0migration/213922-21kthreadcore00:02:192
259940,0migration/210408-21kthreadcore18:57:172
249940,0watchdog/232384-21ssh20:52:042
249940,0watchdog/231201-21grep23:52:192
249940,0watchdog/228477-21wc19:57:242
249940,0watchdog/221749-21cat19:52:242
249940,0watchdog/217968-21iostat_ios20:17:162
169940,0watchdog/10-21swapper/123:47:151
169940,0watchdog/10-21swapper/123:42:271
169940,0watchdog/10-21swapper/121:42:161
169940,0watchdog/10-21swapper/120:32:241
169940,0watchdog/10-21swapper/120:27:241
149940,0migration/09530-21kthreadcore22:57:190
149940,0migration/08763-21kthreadcore18:57:170
149940,0migration/08038-21needreboot19:42:190
149940,0migration/031274-21kthreadcore20:02:190
149940,0migration/02984-21kthreadcore20:52:190
149940,0migration/016863-21kthreadcore23:02:190
149940,0migration/014310-21kthreadcore19:47:180
29715030,0irq/26-eth0-rx-0-21swapper/320:42:113
29715030,0irq/26-eth0-rx-0-21swapper/319:32:123
29715030,0irq/26-eth0-rx-0-21swapper/319:05:513
261889933,0cyclictest3514-21snmpd19:24:342
261889932,0cyclictest15836-21awk19:27:162
261879932,0cyclictest4562-21awk20:07:201
261879932,0cyclictest4481-21kthreadcore19:42:181
261879932,0cyclictest3556-21lldpd19:37:091
261879932,0cyclictest3514-21snmpd19:47:051
261879932,0cyclictest3462-21awk23:57:161
261879932,0cyclictest10471-21sensors22:57:231
261879930,0cyclictest29574-21cut20:02:141
261879930,0cyclictest20677-21aten2.4-expect23:07:131
261879930,0cyclictest0-21swapper/120:15:021
261879930,0cyclictest0-21swapper/119:53:161
261869933,0cyclictest9133-21kworker/0:120:32:150
261869933,0cyclictest9133-21kworker/0:118:47:170
261869932,0cyclictest22588-21awk19:32:160
261869932,0cyclictest0-21swapper/019:07:130
261869930,0cyclictest0-21swapper/020:37:120
249930,0watchdog/20-21swapper/219:32:202
169930,0watchdog/10-21swapper/123:25:031
169930,0watchdog/10-21swapper/122:42:071
169930,0watchdog/10-21swapper/122:03:031
169930,0watchdog/10-21swapper/121:37:201
169930,0watchdog/10-21swapper/119:32:201
29715020,0irq/26-eth0-rx-0-21swapper/319:22:223
169920,0watchdog/10-21swapper/122:52:031
169920,0watchdog/10-21swapper/120:42:081
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional