You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-08 - 10:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sat Aug 08, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450830,0irq/25-eth10-21swapper/318:44:053
2647424435,0sleep10-21swapper/118:45:361
2632323523,0sleep00-21swapper/018:43:460
2654623329,0sleep20-21swapper/218:46:252
339970,0migration/314986-21munin-node20:57:533
267119977,0cyclictest0-21swapper/020:49:190
8215060,0irq/24-0000:00:13514-21perf23:02:302
339960,0migration/34648-21sh23:37:323
339960,0migration/330875-21sh22:11:413
339960,0migration/323195-21munin-node22:47:433
29725060,0irq/27-eth0-tx-21703-21munin-node23:07:432
29725060,0irq/27-eth0-tx-16594-21munin-node19:52:440
29715060,0irq/26-eth0-rx-23280-21diskstats22:27:423
29715060,0irq/26-eth0-rx-23280-21diskstats22:27:423
29715060,0irq/26-eth0-rx-11823-21grep21:37:473
267139965,0cyclictest8666-21idleruntime-cro19:22:302
267119965,0cyclictest0-21swapper/021:15:340
149960,0migration/03558-21sh23:13:150
149960,0migration/01983-21latency_hist19:17:300
149960,0migration/012854-21run-parts22:38:290
35150,0ktimersoftd/30-21swapper/323:54:203
339950,0migration/37808-21kthreadcore20:07:473
339950,0migration/35229-21kthreadcore20:52:473
339950,0migration/35159-21latency_hist20:32:303
339950,0migration/34499-21latency_hist23:37:293
339950,0migration/332407-21df_abs21:52:433
339950,0migration/329398-21fschecks_count19:37:423
339950,0migration/326639-21kthreadcore20:22:473
339950,0migration/326034-21kthreadcore19:32:473
339950,0migration/322252-21kthreadcore00:07:483
339950,0migration/321025-21munin-node19:27:503
339950,0migration/320917-21kthreadcore19:52:493
339950,0migration/320721-21kthreadcore22:02:463
339950,0migration/320395-21kthreadcore21:42:473
339950,0migration/319766-21irqrtprio20:42:463
339950,0migration/318305-21taskset00:03:073
339950,0migration/316444-21kthreadcore22:22:463
339950,0migration/315207-21gltestperf22:42:423
339950,0migration/314853-21sh22:01:073
339950,0migration/312505-21unixbench-2d22:37:523
29725050,0irq/27-eth0-tx-687-21munin-node21:12:502
29725050,0irq/27-eth0-tx-5241-21munin-node23:17:522
29725050,0irq/27-eth0-tx-30903-21munin-node20:27:540
29725050,0irq/27-eth0-tx-23324-21interrupts22:47:442
29725050,0irq/27-eth0-tx-2018-21kthreadcore23:12:472
29725050,0irq/27-eth0-tx-19370-21kthreadcore21:02:472
29725050,0irq/27-eth0-tx-18594-21munin-node20:42:420
29725050,0irq/27-eth0-tx-13774-21munin-node23:02:502
29725050,0irq/27-eth0-tx-12681-21munin-node23:42:482
29725050,0irq/27-eth0-tx-1029-21wc00:12:492
29725050,0irq/27-eth0-tx-0-21swapper/222:46:512
29725050,0irq/27-eth0-tx-0-21swapper/222:24:562
29725050,0irq/27-eth0-tx-0-21swapper/222:04:232
29725050,0irq/27-eth0-tx-0-21swapper/221:55:082
29725050,0irq/27-eth0-tx-0-21swapper/221:22:412
29725050,0irq/27-eth0-tx-0-21swapper/220:59:242
29725050,0irq/27-eth0-tx-0-21swapper/200:04:202
29725050,0irq/27-eth0-tx-0-21swapper/019:36:360
29715050,0irq/26-eth0-rx-9908-21kthreadcore18:57:463
29715050,0irq/26-eth0-rx-30655-21cut00:12:483
29715050,0irq/26-eth0-rx-28311-21kthreadcore21:07:463
29715050,0irq/26-eth0-rx-22821-21cut23:27:453
29715050,0irq/26-eth0-rx-2273-21grep22:12:463
29715050,0irq/26-eth0-rx-21927-21cpu23:07:413
29715050,0irq/26-eth0-rx-19941-21kthreadcore20:17:473
29715050,0irq/26-eth0-rx-16752-21cut21:22:413
29715050,0irq/26-eth0-rx-13040-21kthreadcore19:22:493
29715050,0irq/26-eth0-rx-12685-40yum-updatesd-he20:37:473
29715050,0irq/26-eth0-rx-0-21swapper/323:49:533
29715050,0irq/26-eth0-rx-0-21swapper/323:43:443
29715050,0irq/26-eth0-rx-0-21swapper/323:17:443
29715050,0irq/26-eth0-rx-0-21swapper/322:52:433
29715050,0irq/26-eth0-rx-0-21swapper/322:19:233
29715050,0irq/26-eth0-rx-0-21swapper/321:51:483
29715050,0irq/26-eth0-rx-0-21swapper/321:28:103
29715050,0irq/26-eth0-rx-0-21swapper/321:17:473
29715050,0irq/26-eth0-rx-0-21swapper/321:12:483
29715050,0irq/26-eth0-rx-0-21swapper/320:27:403
29715050,0irq/26-eth0-rx-0-21swapper/320:02:443
267139955,0cyclictest0-21swapper/220:17:462
267139953,0cyclictest8717-21sadc20:57:302
267139950,0cyclictest0-21swapper/220:49:372
267129954,0cyclictest14822-21grep23:02:441
267129954,0cyclictest14287-21cut23:22:481
267129953,0cyclictest3556-21lldpd20:57:491
267119955,0cyclictest0-21swapper/023:41:430
267119955,0cyclictest0-21swapper/023:30:310
267119955,0cyclictest0-21swapper/022:59:180
267119955,0cyclictest0-21swapper/022:31:520
267119955,0cyclictest0-21swapper/022:31:520
267119950,0cyclictest0-21swapper/023:55:350
267119950,0cyclictest0-21swapper/021:20:460
259950,0migration/2996-21latency_hist18:52:302
259950,0migration/23519-21sh23:56:302
259950,0migration/232471-21sh21:11:192
259950,0migration/23235-21kthreadcore21:32:462
259950,0migration/224024-21sh21:47:352
259950,0migration/222508-21kthreadcore23:47:452
259950,0migration/221941-21taskset21:42:522
259950,0migration/213585-21sh22:40:432
259950,0migration/212075-21kthreadcore21:57:482
249950,0watchdog/216532-21kthreadcore20:37:482
249950,0watchdog/210044-21sort20:07:522
249950,0watchdog/20-21swapper/221:27:522
149950,0migration/09092-21kthreadcore21:57:470
149950,0migration/0493-21kthreadcore19:37:460
149950,0migration/04018-21latency_hist23:57:290
149950,0migration/031803-21sh21:30:470
149950,0migration/031542-21fschecks_time22:32:420
149950,0migration/029088-21irqcore00:12:460
149950,0migration/024316-21kthreadcore00:07:490
149950,0migration/023235-21kthreadcore23:07:450
149950,0migration/021223-21sendmail_mailtr19:27:510
149950,0migration/015672-21aten_r1power_fr22:02:400
149950,0migration/013976-21kthreadcore00:02:450
149950,0migration/013350-21aten_r1power_po23:22:440
149950,0migration/012992-21kthreadcore18:57:470
149950,0migration/010756-21missed_timers23:17:480
339940,0migration/36320-21kthreadcore19:42:483
339940,0migration/36016-21kthreadcore23:57:463
339940,0migration/328855-21kthreadcore20:47:463
339940,0migration/313345-21kthreadcore19:47:473
29725040,0irq/27-eth0-tx-8809-21munin-node21:17:512
29725040,0irq/27-eth0-tx-30836-21munin-node22:32:442
29725040,0irq/27-eth0-tx-30219-21ssh22:52:322
29725040,0irq/27-eth0-tx-0-21swapper/223:57:542
29725040,0irq/27-eth0-tx-0-21swapper/223:32:362
29725040,0irq/27-eth0-tx-0-21swapper/222:12:322
29725040,0irq/27-eth0-tx-0-21swapper/200:07:322
29725040,0irq/27-eth0-tx-0-21swapper/019:47:480
29725040,0irq/27-eth0-tx-0-21swapper/019:22:430
29725040,0irq/27-eth0-tx-0-21swapper/018:52:490
29715040,0irq/26-eth0-rx-0-21swapper/323:22:413
29715040,0irq/26-eth0-rx-0-21swapper/323:12:413
29715040,0irq/26-eth0-rx-0-21swapper/323:02:393
29715040,0irq/26-eth0-rx-0-21swapper/322:58:123
29715040,0irq/26-eth0-rx-0-21swapper/322:32:403
29715040,0irq/26-eth0-rx-0-21swapper/321:32:473
29715040,0irq/26-eth0-rx-0-21swapper/321:02:543
29715040,0irq/26-eth0-rx-0-21swapper/319:57:473
29715040,0irq/26-eth0-rx-0-21swapper/319:12:473
267139943,0cyclictest9738-21awk19:22:462
267139943,0cyclictest3556-21lldpd19:51:472
267139943,0cyclictest3556-21lldpd19:30:472
267139943,0cyclictest28861-21awk19:12:462
267139943,0cyclictest2119-21awk18:52:472
267129944,0cyclictest25024-21diskmemload20:54:501
267129944,0cyclictest0-21swapper/120:50:441
267129943,0cyclictest9675-21awk21:17:441
267129943,0cyclictest8852-21awk18:57:451
267129943,0cyclictest5605-21awk23:37:451
267129943,0cyclictest429-21awk21:52:451
267129943,0cyclictest3556-21lldpd23:52:491
267129943,0cyclictest3556-21lldpd23:43:501
267129943,0cyclictest3556-21lldpd23:17:201
267129943,0cyclictest3556-21lldpd22:55:491
267129943,0cyclictest3556-21lldpd22:26:191
267129943,0cyclictest3556-21lldpd21:41:191
267129943,0cyclictest3556-21lldpd21:13:191
267129943,0cyclictest3556-21lldpd20:33:181
267129943,0cyclictest3556-21lldpd20:19:181
267129943,0cyclictest3556-21lldpd20:12:481
267129943,0cyclictest3556-21lldpd19:23:171
267129943,0cyclictest3556-21lldpd19:02:461
267129943,0cyclictest3556-21lldpd00:15:511
267129943,0cyclictest3556-21lldpd00:07:211
267129943,0cyclictest3514-21snmpd20:46:341
267129943,0cyclictest3514-21snmpd20:23:491
267129943,0cyclictest3241-21irqbalance19:59:291
267129943,0cyclictest3241-21irqbalance19:52:391
267129943,0cyclictest3241-21irqbalance19:48:391
267129943,0cyclictest31883-21awk20:27:451
267129943,0cyclictest30878-21awk20:02:461
267129943,0cyclictest3042-21awk19:17:421
267129943,0cyclictest28836-21awk19:12:451
267129943,0cyclictest25543-21awk21:27:441
267129943,0cyclictest24387-21awk22:07:441
267129943,0cyclictest23730-21awk22:27:431
267129943,0cyclictest23730-21awk22:27:431
267129943,0cyclictest22607-21awk23:07:431
267129943,0cyclictest22041-21awk23:27:431
267129943,0cyclictest20984-21awk00:07:461
267129943,0cyclictest17030-21awk21:42:441
267129943,0cyclictest15304-21awk22:42:431
267129940,0cyclictest0-21swapper/123:47:371
267119944,0cyclictest3955-21kworker/0:123:52:290
267119943,0cyclictest6142-21awk20:32:450
267119943,0cyclictest5161-21awk20:07:450
267119943,0cyclictest4133-21awk19:42:460
267119943,0cyclictest3514-21snmpd23:04:350
267119943,0cyclictest3514-21snmpd22:12:050
267119943,0cyclictest3514-21snmpd20:58:340
267119943,0cyclictest31151-21awk22:52:440
267119943,0cyclictest30161-21awk23:32:440
267119943,0cyclictest29947-21munin-node20:02:430
267119943,0cyclictest26074-21awk21:07:440
267119943,0cyclictest24989-21awk21:47:440
267119943,0cyclictest15913-21awk22:22:450
267119943,0cyclictest11779-21awk20:12:450
267119940,0cyclictest17594-21munin-node20:17:430
259940,0migration/29811-21kthreadcore21:37:472
259940,0migration/27834-21idleruntime22:17:432
259940,0migration/26584-21kthreadcore19:42:482
259940,0migration/25619-21df_abs20:32:432
259940,0migration/24796-21aten_r1power_fr23:37:422
259940,0migration/22975-21kthreadcore20:27:472
259940,0migration/223574-21kthreadcore20:42:472
259940,0migration/221166-21ksmtuned23:27:382
259940,0migration/211760-21idleruntime20:12:452
249940,0watchdog/229864-40yum-updatesd-he19:37:452
249940,0watchdog/229762-21ssh22:08:162
249940,0watchdog/20-21swapper/223:22:442
249940,0watchdog/20-21swapper/222:27:322
249940,0watchdog/20-21swapper/222:27:322
249940,0watchdog/20-21swapper/219:07:492
179940,0migration/15724-21fschecks_count23:17:421
179940,0migration/124464-21taskset21:06:241
179940,0migration/123041-21kthreadcore19:07:461
179940,0migration/119822-21kthreadcore21:22:481
179940,0migration/117240-21kthreadcore19:27:471
179940,0migration/116860-21irqrtprio22:02:441
179940,0migration/11064-21kthreadcore23:32:461
169940,0watchdog/16646-21hwlatdetect22:57:441
169940,0watchdog/15047-21kthreadcore18:52:491
169940,0watchdog/14576-21ssh22:12:481
169940,0watchdog/131607-21sh21:52:081
169940,0watchdog/113009-21munin-node22:17:521
169940,0watchdog/11140-21ssh21:32:441
169940,0watchdog/111317-21cut21:57:481
169940,0watchdog/110043-21ls20:07:521
169940,0watchdog/10-21swapper/120:37:481
169940,0watchdog/10-21swapper/119:42:491
169940,0watchdog/10-21swapper/100:02:031
149940,0migration/09192-21kthreadcore22:17:460
149940,0migration/04543-21kthreadcore20:52:470
149940,0migration/03831-21kthreadcore22:12:460
149940,0migration/028383-21kthreadcore18:47:460
149940,0migration/028042-21kthreadcore20:22:470
149940,0migration/021149-21kthreadcore21:02:470
149940,0migration/019454-21kthreadcore21:22:470
149940,0migration/012337-21kthreadcore21:37:480
8215030,0irq/24-0000:00:0-21swapper/219:33:142
35130,0ktimersoftd/30-21swapper/319:06:093
29715030,0irq/26-eth0-rx-0-21swapper/320:12:443
29715030,0irq/26-eth0-rx-0-21swapper/319:07:423
29715030,0irq/26-eth0-rx-0-21swapper/318:52:533
29715030,0irq/26-eth0-rx-0-21swapper/318:51:273
267139933,0cyclictest0-21swapper/219:57:492
267139932,0cyclictest32013-21tr20:02:472
267139932,0cyclictest15480-21awk19:02:452
267129932,0cyclictest3556-21lldpd22:49:501
267129932,0cyclictest3556-21lldpd19:32:471
267129930,0cyclictest32380-21grep19:37:461
267119933,0cyclictest3955-21kworker/0:123:42:390
267119933,0cyclictest3955-21kworker/0:122:47:310
267119933,0cyclictest3955-21kworker/0:122:42:330
267119933,0cyclictest3955-21kworker/0:121:52:310
267119933,0cyclictest3955-21kworker/0:121:42:310
267119933,0cyclictest3955-21kworker/0:121:32:310
267119933,0cyclictest3955-21kworker/0:120:37:410
267119933,0cyclictest3955-21kworker/0:119:57:360
267119933,0cyclictest3955-21kworker/0:119:17:380
267119933,0cyclictest3955-21kworker/0:119:02:440
267119930,0cyclictest0-21swapper/019:07:430
259930,0migration/28963-21irqcore18:57:452
249930,0watchdog/20-21swapper/220:22:442
249930,0watchdog/20-21swapper/219:52:482
169930,0watchdog/125024-21diskmemload21:09:241
169930,0watchdog/10-21swapper/122:37:401
169930,0watchdog/10-21swapper/122:32:441
169930,0watchdog/10-21swapper/118:47:451
29715020,0irq/26-eth0-rx-0-21swapper/319:17:403
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional