You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-10 - 01:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Wed Jun 10, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450560,0irq/25-eth10-21swapper/318:51:253
2165823623,0sleep00-21swapper/018:50:060
2168623523,0sleep10-21swapper/118:50:271
2156423329,0sleep20-21swapper/218:49:002
8215060,0irq/24-0000:00:18147-21munin-run23:53:072
339960,0migration/39140-21sh23:24:113
339960,0migration/32909-21sh22:21:573
339960,0migration/328227-21sh21:17:153
339960,0migration/327086-21sh22:37:033
339960,0migration/324880-21sh00:15:193
339960,0migration/317639-21sh23:51:433
339960,0migration/31213-21sh23:19:383
29715060,0irq/26-eth0-rx-5186-21interrupts21:03:233
29715060,0irq/26-eth0-rx-4571-21kthreadcore23:43:253
29715060,0irq/26-eth0-rx-25611-21yum22:53:323
29715060,0irq/26-eth0-rx-0-21swapper/300:21:463
149960,0migration/09956-21sh22:44:330
149960,0migration/09476-21sh23:25:090
149960,0migration/02574-21taskset20:59:470
149960,0migration/02574-21taskset20:59:470
149960,0migration/018662-21sh21:49:080
149960,0migration/018413-21sh22:30:120
149960,0migration/01372-21sh00:23:000
149960,0migration/012538-21aten_r1power_po21:08:190
8215050,0irq/24-0000:00:0-21swapper/220:23:092
339950,0migration/37648-21kthreadcore19:53:253
339950,0migration/36414-21sh22:03:253
339950,0migration/34104-21aten_r1power_en19:28:193
339950,0migration/33956-21ksmtuned21:22:273
339950,0migration/332524-21kthreadcore19:48:243
339950,0migration/329713-21latency_hist19:23:093
339950,0migration/326504-21aten_r1power_cu23:58:203
339950,0migration/326039-21munin-node20:08:233
339950,0migration/319708-21sh21:31:253
339950,0migration/319514-21aten_r1power_fr20:28:193
339950,0migration/318961-21kthreadcore19:13:263
339950,0migration/317765-21latency21:08:263
339950,0migration/314188-21kthreadcore23:08:253
339950,0migration/312869-21timerandwakeup20:43:313
339950,0migration/312127-21latency_hist21:48:073
339950,0migration/312080-21kthreadcore19:33:243
29725050,0irq/27-eth0-tx-9709-21netstat21:03:272
29725050,0irq/27-eth0-tx-31372-21cut22:18:242
29725050,0irq/27-eth0-tx-30731-21munin-node19:48:300
29725050,0irq/27-eth0-tx-27146-21munin-node23:18:302
29725050,0irq/27-eth0-tx-25265-21ntp_kernel_err22:33:262
29725050,0irq/27-eth0-tx-24043-21munin-node19:43:290
29725050,0irq/27-eth0-tx-18143-21ssh00:13:172
29725050,0irq/27-eth0-tx-1705-21ssh21:58:292
29725050,0irq/27-eth0-tx-10403-21yum21:43:332
29725050,0irq/27-eth0-tx-0-21swapper/223:38:272
29725050,0irq/27-eth0-tx-0-21swapper/223:13:292
29725050,0irq/27-eth0-tx-0-21swapper/223:10:032
29725050,0irq/27-eth0-tx-0-21swapper/222:08:292
29725050,0irq/27-eth0-tx-0-21swapper/200:08:252
29725050,0irq/27-eth0-tx-0-21swapper/018:57:190
29715050,0irq/26-eth0-rx-8710-21kthreadcore21:23:263
29715050,0irq/26-eth0-rx-7815-21grep21:43:253
29715050,0irq/26-eth0-rx-6559-21runrttasks22:16:353
29715050,0irq/26-eth0-rx-384-21munin-node23:38:333
29715050,0irq/26-eth0-rx-30837-21kthreadcore21:38:253
29715050,0irq/26-eth0-rx-29010-21perl20:58:243
29715050,0irq/26-eth0-rx-29010-21perl20:58:243
29715050,0irq/26-eth0-rx-14739-21cut20:23:253
29715050,0irq/26-eth0-rx-0-21swapper/323:35:583
29715050,0irq/26-eth0-rx-0-21swapper/323:05:083
29715050,0irq/26-eth0-rx-0-21swapper/322:25:103
29715050,0irq/26-eth0-rx-0-21swapper/321:53:213
259950,0migration/23908-21fschecks_count22:43:202
259950,0migration/228739-21kthreadcore00:18:232
259950,0migration/228438-21fschecks_time22:38:222
259950,0migration/228369-21latency_hist21:38:072
259950,0migration/227710-21cpuspeed_turbos22:58:212
259950,0migration/227078-21sh21:14:202
259950,0migration/222327-21kthreadcore23:53:242
259950,0migration/220887-21munin-node22:13:232
259950,0migration/220258-21latency_hist20:53:092
259950,0migration/216731-21cpuspeed_turbos19:13:212
259950,0migration/211548-21sh21:26:072
249950,0watchdog/27431-21tr23:43:262
249950,0watchdog/215589-21kthreadcore22:48:262
219909955,0cyclictest0-21swapper/223:27:412
219909955,0cyclictest0-21swapper/221:40:382
219909950,0cyclictest0-21swapper/219:28:122
219889955,0cyclictest0-21swapper/022:14:080
19150,0ktimersoftd/120181-21diskmemload00:21:221
179950,0migration/19591-21munin-node22:43:321
179950,0migration/132498-21kthreadcore22:18:251
179950,0migration/132473-21timerwakeupswit23:58:361
179950,0migration/127355-21fschecks_time23:38:221
179950,0migration/12652-21kthreadcore19:48:251
179950,0migration/126062-21munin-node21:53:291
179950,0migration/125430-21kthreadcore19:43:261
179950,0migration/117755-21sh23:09:561
179950,0migration/113083-21fschecks_time21:08:211
169950,0watchdog/17430-21cut23:43:261
169950,0watchdog/16691-21grep20:18:231
149950,0migration/09961-21timerwakeupswit19:28:310
149950,0migration/08368-21kthreadcore21:43:250
149950,0migration/06973-21kthreadcore21:03:250
149950,0migration/05252-21kthreadcore23:03:250
149950,0migration/05009-21taskset19:53:150
149950,0migration/03412-21taskset21:20:580
149950,0migration/032695-21latency_hist20:38:090
149950,0migration/028167-21munin-node22:18:190
149950,0migration/025437-21kthreadcore19:18:270
149950,0migration/024742-21sh00:14:550
149950,0migration/02386-21sh23:23:040
149950,0migration/022056-21kthreadcore20:03:250
149950,0migration/02113-21switchtime18:58:300
149950,0migration/021013-21fschecks_count21:33:200
149950,0migration/020043-21taskset20:51:430
149950,0migration/019999-21kthreadcore23:53:240
149950,0migration/018898-21aten_r1power_vo23:33:200
149950,0migration/017609-21sh23:09:300
149950,0migration/016880-21kthreadcore20:23:260
149950,0migration/016293-21munin-node23:28:270
149950,0migration/012673-21kthreadcore23:48:290
149950,0migration/012310-21taskset20:20:450
149950,0migration/011932-21irqrtprio19:33:240
149950,0migration/011496-21taskset22:07:250
149950,0migration/01065-21munin-node22:58:320
339940,0migration/320711-21aten_r1power_vo21:33:183
339940,0migration/319279-21diskmemload23:53:223
339940,0migration/315400-21kthreadcore23:28:253
339940,0migration/315004-21kthreadcore00:08:253
29725040,0irq/27-eth0-tx-26918-21ssh20:55:012
29725040,0irq/27-eth0-tx-26531-21ssh23:58:202
29725040,0irq/27-eth0-tx-12497-21ssh21:28:122
29725040,0irq/27-eth0-tx-10780-21munin-node23:28:202
29725040,0irq/27-eth0-tx-0-21swapper/223:33:192
29725040,0irq/27-eth0-tx-0-21swapper/222:28:282
29725040,0irq/27-eth0-tx-0-21swapper/221:53:202
29725040,0irq/27-eth0-tx-0-21swapper/221:19:112
29725040,0irq/27-eth0-tx-0-21swapper/020:13:250
29725040,0irq/27-eth0-tx-0-21swapper/019:08:180
29715040,0irq/26-eth0-rx-3622-21cpuspeed_turbos22:43:193
29715040,0irq/26-eth0-rx-0-21swapper/323:13:233
29715040,0irq/26-eth0-rx-0-21swapper/322:58:163
29715040,0irq/26-eth0-rx-0-21swapper/322:49:333
29715040,0irq/26-eth0-rx-0-21swapper/322:39:113
29715040,0irq/26-eth0-rx-0-21swapper/322:29:093
29715040,0irq/26-eth0-rx-0-21swapper/322:10:353
29715040,0irq/26-eth0-rx-0-21swapper/321:58:543
29715040,0irq/26-eth0-rx-0-21swapper/320:53:263
29715040,0irq/26-eth0-rx-0-21swapper/319:03:273
29715040,0irq/26-eth0-rx-0-21swapper/300:04:373
259940,0migration/25361-21kthreadcore22:03:252
259940,0migration/25177-21timerandwakeup20:13:322
259940,0migration/231222-21kthreadcore18:58:252
259940,0migration/222767-21kthreadcore20:03:252
259940,0migration/219854-21fschecks_count20:28:212
259940,0migration/217257-21kthreadcore20:23:262
259940,0migration/214020-21kthreadcore21:48:252
259940,0migration/211055-21cpuspeed_turbos19:33:202
259940,0migration/210816-21munin-node19:08:232
259940,0migration/210667-21proc_pri19:53:302
259940,0migration/210130-21kthreadcore20:43:252
249940,0watchdog/26559-21runrttasks00:03:222
249940,0watchdog/23840-21ssh23:03:222
249940,0watchdog/222359-21awk18:53:192
249940,0watchdog/20-21swapper/222:53:222
219909944,0cyclictest0-21swapper/220:58:232
219909944,0cyclictest0-21swapper/220:58:232
219909943,0cyclictest3556-21lldpd19:58:192
219909943,0cyclictest3514-21snmpd22:23:082
219909943,0cyclictest3514-21snmpd20:40:382
219909943,0cyclictest3514-21snmpd19:40:372
219909943,0cyclictest3514-21snmpd19:23:222
219909943,0cyclictest31583-21awk19:48:222
219909943,0cyclictest24022-21awk19:18:252
219909943,0cyclictest13316-21awk21:08:232
219899943,0cyclictest4957-21awk22:03:241
219899943,0cyclictest3556-21lldpd20:43:191
219899943,0cyclictest3514-21snmpd20:28:371
219899943,0cyclictest3514-21snmpd20:15:371
219899943,0cyclictest3514-21snmpd18:54:521
219899943,0cyclictest3514-21snmpd00:14:391
219899943,0cyclictest3514-21snmpd00:08:391
219899943,0cyclictest3241-21irqbalance23:50:361
219899943,0cyclictest3241-21irqbalance00:03:161
219899943,0cyclictest21422-21awk20:53:241
219899943,0cyclictest19988-21awk23:13:221
219899943,0cyclictest12601-21awk19:58:201
219899943,0cyclictest12325-21awk22:48:231
219889944,0cyclictest0-21swapper/021:58:510
219889944,0cyclictest0-21swapper/021:24:570
219889943,0cyclictest4085-21awk19:03:250
219889943,0cyclictest3556-21lldpd19:59:190
219889943,0cyclictest3514-21snmpd21:55:230
219889943,0cyclictest3241-21irqbalance23:45:460
219889943,0cyclictest3241-21irqbalance22:33:160
219889943,0cyclictest3241-21irqbalance22:25:060
219889943,0cyclictest3241-21irqbalance00:01:360
219889943,0cyclictest3063-21sadc22:43:070
219889943,0cyclictest2977-21awk00:03:220
219889943,0cyclictest27641-21awk23:38:240
219889943,0cyclictest20277-21awk20:28:220
219889943,0cyclictest18382-21awk19:38:230
19140,0ktimersoftd/10-21swapper/121:49:381
179940,0migration/16862-21kthreadcore19:53:251
179940,0migration/16048-21kthreadcore22:23:251
179940,0migration/13568-21sh21:02:211
179940,0migration/13568-21sh21:02:211
179940,0migration/130951-21kthreadcore21:58:241
179940,0migration/129973-21kthreadcore20:08:251
179940,0migration/121978-21munin-node19:13:291
179940,0migration/121474-21kthreadcore23:33:251
179940,0migration/120563-21kthreadcore23:53:241
179940,0migration/120013-21kthreadcore20:03:251
179940,0migration/11846-21needreboot21:18:261
179940,0migration/116919-21kthreadcore20:48:261
179940,0migration/116173-21runrttasks19:12:431
179940,0migration/113976-21kthreadcore21:28:251
169940,0watchdog/13371-21ssh21:41:301
169940,0watchdog/131487-21kthreadcore22:38:261
169940,0watchdog/130567-21hwlatdetect19:23:231
169940,0watchdog/127819-21ssh21:16:101
169940,0watchdog/126980-21ssh21:34:181
169940,0watchdog/12046-21ssh23:22:061
169940,0watchdog/120320-21sh22:53:221
169940,0watchdog/111473-21ssh21:06:341
169940,0watchdog/110063-21switchtime21:43:301
169940,0watchdog/10-21swapper/123:23:261
169940,0watchdog/10-21swapper/122:33:181
169940,0watchdog/10-21swapper/122:30:221
169940,0watchdog/10-21swapper/122:13:141
169940,0watchdog/10-21swapper/120:23:301
169940,0watchdog/10-21swapper/119:03:271
149940,0migration/03426-21sh21:41:380
149940,0migration/030031-21kthreadcore20:08:250
149940,0migration/027516-21sh20:56:340
149940,0migration/021962-21kthreadcore22:53:240
149940,0migration/018224-21runrttasks22:08:490
339930,0migration/31536-21kthreadcore18:58:263
29715030,0irq/26-eth0-rx-0-21swapper/320:48:203
29715030,0irq/26-eth0-rx-0-21swapper/320:38:313
29715030,0irq/26-eth0-rx-0-21swapper/320:33:293
29715030,0irq/26-eth0-rx-0-21swapper/320:13:253
29715030,0irq/26-eth0-rx-0-21swapper/320:03:283
29715030,0irq/26-eth0-rx-0-21swapper/319:58:253
29715030,0irq/26-eth0-rx-0-21swapper/319:42:283
29715030,0irq/26-eth0-rx-0-21swapper/319:21:183
29715030,0irq/26-eth0-rx-0-21swapper/319:09:573
259930,0migration/226844-21kthreadcore20:08:242
249930,0watchdog/20-21swapper/219:43:272
219909933,0cyclictest0-21swapper/220:33:372
219909931,0cyclictest3668-21fschecks_time19:03:232
219899933,0cyclictest4964-21awk19:28:231
219899932,0cyclictest6009-21rt-features20:38:291
219899932,0cyclictest24038-21awk19:18:251
219899932,0cyclictest12737-21cat19:33:241
219899930,0cyclictest2148-21sed18:58:301
219899930,0cyclictest0-21swapper/119:38:091
219889933,0cyclictest848-21kworker/0:219:23:120
219889933,0cyclictest848-21kworker/0:219:13:100
219889933,0cyclictest19536-21kworker/0:200:08:090
219889933,0cyclictest17422-21kworker/0:021:28:230
219889933,0cyclictest17422-21kworker/0:020:43:140
219889933,0cyclictest17422-21kworker/0:020:33:100
219889932,0cyclictest3514-21snmpd23:13:080
219889932,0cyclictest21564-21awk21:13:230
219889930,0cyclictest11623-21aten_r1power_vo22:48:200
19130,0ktimersoftd/13523-21ssh23:03:211
179930,0migration/110743-21runrttasks23:28:121
169930,0watchdog/120181-21diskmemload22:08:341
169930,0watchdog/111518-21chrt21:26:021
169930,0watchdog/10-21swapper/122:58:261
339920,0migration/324441-21diskstats19:43:213
29715020,0irq/26-eth0-rx-0-21swapper/320:18:203
29715020,0irq/26-eth0-rx-0-21swapper/318:53:293
219899921,0cyclictest260512chrt20:33:091
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional