You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-27 - 08:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Mon Apr 27, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
417924434,0sleep10-21swapper/118:54:501
432723723,0sleep00-21swapper/018:56:370
414423726,0sleep30-21swapper/318:54:283
406723626,0sleep20-21swapper/218:53:352
44639965,0cyclictest2719-21cut23:37:342
44619960,0cyclictest0-21swapper/123:08:211
44619960,0cyclictest0-21swapper/122:18:421
44609960,0cyclictest0-21swapper/023:43:260
44609960,0cyclictest0-21swapper/022:59:360
35160,0ktimersoftd/30-21swapper/323:04:503
339960,0migration/39376-21sh23:21:413
339960,0migration/33754-21munin-node21:57:333
339960,0migration/326209-21sh21:09:483
339960,0migration/316205-21switchtime22:42:413
339960,0migration/31176-21sh21:12:453
29715060,0irq/26-eth0-rx-25188-21sh22:28:493
149960,0migration/018147-21sh22:26:360
149960,0migration/011521-21aten2.4-expect21:22:290
44639955,0cyclictest0-21swapper/223:27:052
44639955,0cyclictest0-21swapper/200:24:002
44639950,0cyclictest0-21swapper/222:50:592
44639950,0cyclictest0-21swapper/221:17:112
44639950,0cyclictest0-21swapper/220:58:352
44619955,0cyclictest0-21swapper/121:09:571
44619955,0cyclictest0-21swapper/120:32:351
44619955,0cyclictest0-21swapper/119:52:421
44619950,0cyclictest0-21swapper/123:31:031
44619950,0cyclictest0-21swapper/123:24:071
44609955,0cyclictest0-21swapper/021:40:460
44609950,0cyclictest0-21swapper/021:56:320
44609950,0cyclictest0-21swapper/021:29:060
44609950,0cyclictest0-21swapper/000:20:570
4150,0ktimersoftd/00-21swapper/023:18:140
339950,0migration/3885-21taskset22:54:543
339950,0migration/37026-21sh23:57:383
339950,0migration/35507-21latency_hist19:22:193
339950,0migration/34342-21kthreadcore20:32:353
339950,0migration/33481-21kthreadcore23:37:353
339950,0migration/331759-21kthreadcore20:52:363
339950,0migration/329341-21kthreadcore21:32:353
339950,0migration/326810-21aten_r1power_vo22:32:303
339950,0migration/324971-21cpuspeed_turbos19:12:323
339950,0migration/324449-21kthreadcore21:27:363
339950,0migration/323940-21kthreadcore19:57:373
339950,0migration/322985-21irqcore20:47:353
339950,0migration/319594-21irqrtprio22:47:343
339950,0migration/319370-21taskset19:53:123
339950,0migration/316958-21munin-node21:22:383
339950,0migration/315380-21munin-node20:42:313
339950,0migration/313490-21kthreadcore21:42:363
339950,0migration/312355-21aten_r1power_cu19:27:313
29725050,0irq/27-eth0-tx-6964-21kthreadcore21:37:382
29725050,0irq/27-eth0-tx-3372-21kthreadcore22:57:362
29725050,0irq/27-eth0-tx-30629-21kthreadcore22:52:362
29725050,0irq/27-eth0-tx-27494-21df21:52:312
29725050,0irq/27-eth0-tx-26913-21munin-node22:12:312
29725050,0irq/27-eth0-tx-25666-21munin-node23:52:402
29725050,0irq/27-eth0-tx-24990-21sed22:07:432
29725050,0irq/27-eth0-tx-23482-21open_files23:27:392
29725050,0irq/27-eth0-tx-20961-21munin-node20:22:330
29725050,0irq/27-eth0-tx-1857-21munin-node20:32:340
29725050,0irq/27-eth0-tx-16282-21kthreadcore21:22:362
29725050,0irq/27-eth0-tx-12819-21kthreadcore22:02:352
29725050,0irq/27-eth0-tx-1193-21cpuspeed_turbos00:17:312
29725050,0irq/27-eth0-tx-10545-21ssh21:20:342
29725050,0irq/27-eth0-tx-0-21swapper/222:31:472
29725050,0irq/27-eth0-tx-0-21swapper/222:21:322
29725050,0irq/27-eth0-tx-0-21swapper/221:34:572
29725050,0irq/27-eth0-tx-0-21swapper/200:02:322
29725050,0irq/27-eth0-tx-0-21swapper/020:57:350
29725050,0irq/27-eth0-tx-0-21swapper/020:49:040
29715050,0irq/26-eth0-rx-9366-21sh00:02:243
29715050,0irq/26-eth0-rx-921-21ssh00:17:223
29715050,0irq/26-eth0-rx-7781-21ps22:57:403
29715050,0irq/26-eth0-rx-6559-21runrttasks22:02:473
29715050,0irq/26-eth0-rx-27987-21munin-node21:52:333
29715050,0irq/26-eth0-rx-22934-21ntp_kernel_pll_00:07:383
29715050,0irq/26-eth0-rx-18844-21if_eth123:27:343
29715050,0irq/26-eth0-rx-14220-21kthreadcore21:02:373
29715050,0irq/26-eth0-rx-11453-21kthreadcore20:37:373
29715050,0irq/26-eth0-rx-10664-21ssh21:20:523
29715050,0irq/26-eth0-rx-0-21swapper/323:42:353
29715050,0irq/26-eth0-rx-0-21swapper/323:24:443
29715050,0irq/26-eth0-rx-0-21swapper/322:12:323
29715050,0irq/26-eth0-rx-0-21swapper/321:39:083
29715050,0irq/26-eth0-rx-0-21swapper/321:00:293
29715050,0irq/26-eth0-rx-0-21swapper/300:22:353
27150,0ktimersoftd/20-21swapper/223:18:142
27150,0ktimersoftd/20-21swapper/223:03:422
259950,0migration/28207-21switchtime22:37:422
259950,0migration/232418-21sh23:33:482
259950,0migration/232043-21timerandwakeup23:12:422
259950,0migration/225396-21taskset21:48:012
259950,0migration/220218-21kthreadcore23:47:362
259950,0migration/21664-21gltestperf20:07:332
259950,0migration/212278-21kthreadcore22:42:342
249950,0watchdog/222098-21kthreadcore19:07:372
249950,0watchdog/211433-21hwlatdetect22:22:322
19150,0ktimersoftd/10-21swapper/123:18:141
19150,0ktimersoftd/10-21swapper/100:00:231
179950,0migration/19506-21aten_r1power_po00:02:311
179950,0migration/16404-21latency_hist19:47:191
179950,0migration/16404-21latency_hist19:47:191
179950,0migration/15043-21kthreadcore21:57:351
179950,0migration/126381-21munin-node20:22:371
179950,0migration/111156-21munin-node19:22:381
169950,0watchdog/126625-21ssh22:32:201
169950,0watchdog/126137-21grep19:37:331
169950,0watchdog/10-21swapper/122:42:361
169950,0watchdog/10-21swapper/121:52:371
169950,0watchdog/10-21swapper/121:22:291
149950,0migration/08948-21kernelversion20:12:370
149950,0migration/08604-21timerwakeupswit22:17:410
149950,0migration/07700-21latency22:37:370
149950,0migration/07123-21taskset20:08:510
149950,0migration/05041-21kthreadcore23:57:340
149950,0migration/04091-21gltestperf21:17:330
149950,0migration/03562-21gltestperf21:57:320
149950,0migration/029252-21kthreadcore00:12:370
149950,0migration/027505-21kthreadcore23:32:340
149950,0migration/027191-21sh21:12:180
149950,0migration/025995-21df_abs19:37:320
149950,0migration/02327-21munin-node23:37:320
149950,0migration/021945-21kthreadcore21:47:360
149950,0migration/021699-21turbostat20:47:180
149950,0migration/020802-21kthreadcore22:47:340
149950,0migration/020323-21kthreadcore23:47:360
149950,0migration/018189-21sh21:05:100
149950,0migration/017401-21kthreadcore19:52:360
149950,0migration/017099-21taskset22:44:190
149950,0migration/016649-21latency19:02:370
149950,0migration/014711-21taskset20:38:370
149950,0migration/012416-21aten_r1power_fr19:27:310
149950,0migration/012293-21kthreadcore00:22:360
149950,0migration/011680-21gltestperf22:02:310
149950,0migration/01052-21taskset22:13:550
8215040,0irq/24-0000:00:628-21perf20:07:192
44639944,0cyclictest0-21swapper/219:32:392
44639943,0cyclictest3556-21lldpd19:51:292
44639943,0cyclictest3514-21snmpd23:07:202
44639943,0cyclictest3514-21snmpd19:56:492
44639943,0cyclictest3514-21snmpd19:12:332
44639943,0cyclictest11969-21awk21:02:342
44619944,0cyclictest0-21swapper/123:03:001
44619944,0cyclictest0-21swapper/100:12:501
44619943,0cyclictest3556-21lldpd21:34:001
44619943,0cyclictest3514-21snmpd20:54:041
44619943,0cyclictest3514-21snmpd00:08:051
44619943,0cyclictest27315-21awk22:52:331
44619943,0cyclictest1970-21awk00:17:341
44619943,0cyclictest18402-21sadc22:27:181
44619940,0cyclictest0-21swapper/121:43:271
44609944,0cyclictest0-21swapper/020:20:510
44609944,0cyclictest0-21swapper/000:05:490
44609943,0cyclictest786-21kworker/0:121:45:580
44609943,0cyclictest3556-21lldpd23:29:330
44609943,0cyclictest3556-21lldpd22:28:020
44609943,0cyclictest3514-21snmpd23:02:350
44609943,0cyclictest29472-21awk20:52:330
44609943,0cyclictest28383-21awk21:12:340
44609943,0cyclictest27540-21awk22:32:330
44609943,0cyclictest19873-21awk22:07:340
44609940,0cyclictest4672-21munin-node18:57:360
339940,0migration/37846-21kthreadcore22:17:353
339940,0migration/3768-21latency_hist20:07:193
339940,0migration/36655-21sensors_temp20:07:413
339940,0migration/331159-21sensors_volt00:12:423
339940,0migration/324713-21ntp_states21:47:393
339940,0migration/324393-21ntp_kernel_err19:32:373
339940,0migration/320627-21kthreadcore19:07:373
339940,0migration/317559-21latency_hist23:47:183
339940,0migration/312850-21taskset19:49:453
29725040,0irq/27-eth0-tx-5851-21kthreadcore23:57:352
29725040,0irq/27-eth0-tx-26773-21telnet20:02:310
29725040,0irq/27-eth0-tx-17440-21ssh21:43:082
29725040,0irq/27-eth0-tx-0-21swapper/222:33:482
29725040,0irq/27-eth0-tx-0-21swapper/221:57:292
29725040,0irq/27-eth0-tx-0-21swapper/221:07:282
29725040,0irq/27-eth0-tx-0-21swapper/200:12:222
29725040,0irq/27-eth0-tx-0-21swapper/200:07:212
29725040,0irq/27-eth0-tx-0-21swapper/019:47:350
29725040,0irq/27-eth0-tx-0-21swapper/019:07:350
29715040,0irq/26-eth0-rx-0-21swapper/323:52:343
29715040,0irq/26-eth0-rx-0-21swapper/323:32:243
29715040,0irq/26-eth0-rx-0-21swapper/323:12:573
29715040,0irq/26-eth0-rx-0-21swapper/323:08:333
29715040,0irq/26-eth0-rx-0-21swapper/322:37:233
29715040,0irq/26-eth0-rx-0-21swapper/322:22:543
29715040,0irq/26-eth0-rx-0-21swapper/322:09:273
29715040,0irq/26-eth0-rx-0-21swapper/320:27:353
259940,0migration/25444-21pmu-power19:42:402
259940,0migration/25444-21pmu-power19:42:402
259940,0migration/23490-21kthreadcore20:32:352
259940,0migration/232496-21kthreadcore20:52:362
259940,0migration/230343-21kthreadcore20:27:362
259940,0migration/226163-21kthreadcore20:22:362
259940,0migration/221692-21kthreadcore19:57:362
259940,0migration/214589-21cpuspeed_turbos20:17:312
259940,0migration/211802-21runrttasks19:23:502
249940,0watchdog/29493-21kthreadcore20:12:372
249940,0watchdog/25605-21if_eth1.218:57:332
249940,0watchdog/22989-21kthreadcore19:17:372
249940,0watchdog/226136-21tune2fs19:37:332
249940,0watchdog/216545-21kthreadcore19:27:372
249940,0watchdog/215459-21python23:42:402
179940,0migration/18668-21aten_r1power_fr20:37:311
179940,0migration/15515-21kthreadcore22:57:361
179940,0migration/15155-21kthreadcore23:37:351
179940,0migration/14235-21kthreadcore22:37:361
179940,0migration/13210-21df20:57:301
179940,0migration/131184-21kthreadcore22:12:361
179940,0migration/131044-21kthreadcore23:32:351
179940,0migration/128570-21kthreadcore23:52:351
179940,0migration/12599-21kthreadcore19:17:371
179940,0migration/123826-21kthreadcore19:32:351
179940,0migration/119734-21kthreadcore23:47:361
179940,0migration/119692-21irqrtprio22:47:341
179940,0migration/117706-21sh22:04:351
179940,0migration/113902-21kthreadcore19:02:361
179940,0migration/113442-21timerandwakeup20:12:431
179940,0migration/112857-21kthreadcore23:42:351
179940,0migration/11088-21unixbench-2d20:27:421
169940,0watchdog/128949-21kthreadcore19:12:371
169940,0watchdog/125211-21latency19:57:371
169940,0watchdog/122534-21kthreadcore22:27:361
169940,0watchdog/122099-21kthreadcore19:07:371
169940,0watchdog/119157-21ssh21:47:291
169940,0watchdog/11644-21ssh21:13:531
169940,0watchdog/10-21swapper/122:07:371
169940,0watchdog/10-21swapper/121:37:331
169940,0watchdog/10-21swapper/121:17:371
169940,0watchdog/10-21swapper/121:02:371
169940,0watchdog/10-21swapper/118:57:331
149940,0migration/0570-21open_inodes21:32:390
149940,0migration/04128-21kthreadcore19:17:380
149940,0migration/03939-21kthreadcore19:42:370
149940,0migration/03939-21kthreadcore19:42:370
149940,0migration/031424-21diskmemload23:52:390
149940,0migration/010604-21kthreadcore19:22:360
44639932,0cyclictest9463-21awk20:37:352
44639930,0cyclictest23523-21grep20:47:362
44619932,0cyclictest16124-21awk20:42:351
44619930,0cyclictest0-21swapper/123:12:181
44609933,0cyclictest27955-21kworker/0:023:22:190
44609933,0cyclictest27955-21kworker/0:023:12:270
44609933,0cyclictest27955-21kworker/0:023:07:190
44609933,0cyclictest27955-21kworker/0:022:52:200
44609933,0cyclictest21726-21kworker/0:020:27:320
44609933,0cyclictest21726-21kworker/0:019:57:340
44609933,0cyclictest21726-21kworker/0:019:32:220
44609933,0cyclictest21726-21kworker/0:019:12:340
44609932,0cyclictest18266-21awk00:07:320
29725030,0irq/27-eth0-tx-0-21swapper/221:27:262
29715030,0irq/26-eth0-rx-26571-21if_eth1.219:37:353
29715030,0irq/26-eth0-rx-0-21swapper/320:17:363
29715030,0irq/26-eth0-rx-0-21swapper/319:47:073
29715030,0irq/26-eth0-rx-0-21swapper/319:47:073
29715030,0irq/26-eth0-rx-0-21swapper/319:22:353
29715030,0irq/26-eth0-rx-0-21swapper/319:03:443
29715030,0irq/26-eth0-rx-0-21swapper/318:57:293
249930,0watchdog/20-21swapper/220:42:372
249930,0watchdog/20-21swapper/219:02:372
169930,0watchdog/1318-21runrttasks20:03:571
169930,0watchdog/10-21swapper/121:27:331
169930,0watchdog/10-21swapper/120:47:371
169930,0watchdog/10-21swapper/120:07:371
169930,0watchdog/10-21swapper/119:47:291
169930,0watchdog/10-21swapper/119:27:371
169930,0watchdog/10-21swapper/100:22:321
44619920,0cyclictest0-21swapper/120:17:201
29715020,0irq/26-eth0-rx-0-21swapper/320:22:363
29715020,0irq/26-eth0-rx-0-21swapper/320:12:333
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional