You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-20 - 11:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sun Sep 20, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1731426261,0sleep00-21swapper/018:42:260
304450390,0irq/25-eth10-21swapper/318:43:083
1715623725,0sleep20-21swapper/218:40:362
1712723324,0sleep10-21swapper/118:40:151
339960,0migration/324334-21munin-node20:48:393
339960,0migration/322406-21sh21:04:413
339960,0migration/321217-21sh22:27:383
29715060,0irq/26-eth0-rx-23831-21iostat21:48:403
19160,0ktimersoftd/115669-21diskmemload22:18:421
174709960,0cyclictest20053-21forks23:48:382
174709960,0cyclictest0-21swapper/219:58:462
174699960,0cyclictest23281-21ssh21:07:171
149960,0migration/032189-21cpuspeed_turbos19:18:400
149960,0migration/029360-21sh22:33:160
149960,0migration/011461-21sh22:38:570
8215050,0irq/24-0000:00:15232-21cat21:23:252
8215050,0irq/24-0000:00:13476-21sadc22:23:242
4150,0ktimersoftd/00-21swapper/021:02:240
4150,0ktimersoftd/00-21swapper/021:02:240
339950,0migration/36846-21latency_hist21:38:243
339950,0migration/35874-21taskset19:22:003
339950,0migration/34102-21taskset22:57:163
339950,0migration/331392-21munin-node18:53:383
339950,0migration/331242-21kthreadcore23:53:413
339950,0migration/327428-21timerwakeupswit20:23:463
339950,0migration/325366-21timerandwakeup19:33:483
339950,0migration/323110-21munin-node22:08:393
339950,0migration/321800-21kthreadcore23:48:423
339950,0migration/321356-21hddtemp_smartct19:58:363
339950,0migration/320412-21kthreadcore18:43:423
339950,0migration/318852-21runrttasks23:25:313
339950,0migration/314952-21switchtime20:38:473
339950,0migration/314104-21taskset20:59:003
339950,0migration/314104-21taskset20:59:003
339950,0migration/313844-21irqcore23:03:413
339950,0migration/312683-21taskset19:28:183
339950,0migration/312542-21fschecks_time19:03:393
339950,0migration/312256-21irqrtprio00:03:413
339950,0migration/310354-21munin-node23:18:503
339950,0migration/310327-21taskset23:40:093
29725050,0irq/27-eth0-tx-9438-21processes23:38:462
29725050,0irq/27-eth0-tx-5349-21telnet18:58:380
29725050,0irq/27-eth0-tx-30986-21munin-node18:53:500
29725050,0irq/27-eth0-tx-25315-21munin-node19:13:460
29725050,0irq/27-eth0-tx-23926-21munin-node21:08:432
29725050,0irq/27-eth0-tx-23416-21munin-node21:28:452
29725050,0irq/27-eth0-tx-21576-21munin-node20:23:360
29725050,0irq/27-eth0-tx-20428-21ssh22:25:142
29725050,0irq/27-eth0-tx-17307-21ssh00:04:142
29725050,0irq/27-eth0-tx-15987-21munin-node21:03:502
29725050,0irq/27-eth0-tx-12640-21ssh22:42:282
29725050,0irq/27-eth0-tx-11691-21kthreadcore21:38:432
29725050,0irq/27-eth0-tx-0-21swapper/222:34:162
29725050,0irq/27-eth0-tx-0-21swapper/222:18:002
29725050,0irq/27-eth0-tx-0-21swapper/020:43:380
29725050,0irq/27-eth0-tx-0-21swapper/020:21:530
29725050,0irq/27-eth0-tx-0-21swapper/020:13:350
29725050,0irq/27-eth0-tx-0-21swapper/019:12:450
29715050,0irq/26-eth0-rx-5228-21ssh22:17:403
29715050,0irq/26-eth0-rx-4045-21cut21:33:403
29715050,0irq/26-eth0-rx-29925-21ssh21:30:053
29715050,0irq/26-eth0-rx-29471-21ntp_kernel_err21:08:453
29715050,0irq/26-eth0-rx-26831-21ssh23:30:383
29715050,0irq/26-eth0-rx-20198-21cut00:08:423
29715050,0irq/26-eth0-rx-18877-21grep22:03:413
29715050,0irq/26-eth0-rx-13150-21cat22:43:243
29715050,0irq/26-eth0-rx-12688-21kthreadcore21:18:413
29715050,0irq/26-eth0-rx-0-21swapper/323:58:533
29715050,0irq/26-eth0-rx-0-21swapper/323:17:473
29715050,0irq/26-eth0-rx-0-21swapper/322:50:493
29715050,0irq/26-eth0-rx-0-21swapper/322:38:453
29715050,0irq/26-eth0-rx-0-21swapper/322:29:483
29715050,0irq/26-eth0-rx-0-21swapper/322:18:393
29715050,0irq/26-eth0-rx-0-21swapper/321:58:503
29715050,0irq/26-eth0-rx-0-21swapper/321:53:423
29715050,0irq/26-eth0-rx-0-21swapper/321:45:323
29715050,0irq/26-eth0-rx-0-21swapper/321:13:253
29715050,0irq/26-eth0-rx-0-21swapper/320:53:493
29715050,0irq/26-eth0-rx-0-21swapper/320:43:363
29715050,0irq/26-eth0-rx-0-21swapper/319:53:393
259950,0migration/220137-21sh22:46:052
259950,0migration/212697-21gltestperf19:03:392
249950,0watchdog/27544-21kthreadcore18:58:432
249950,0watchdog/25792-21kthreadcore23:58:422
19150,0ktimersoftd/10-21swapper/122:13:111
174709955,0cyclictest15669-21diskmemload22:58:112
174709955,0cyclictest0-21swapper/223:34:462
174709955,0cyclictest0-21swapper/223:22:002
174709955,0cyclictest0-21swapper/221:58:452
174709955,0cyclictest0-21swapper/221:54:392
174709950,0cyclictest0-21swapper/223:28:562
174709950,0cyclictest0-21swapper/223:07:202
174699955,0cyclictest0-21swapper/123:27:171
174699955,0cyclictest0-21swapper/123:09:001
174699955,0cyclictest0-21swapper/121:59:471
174699955,0cyclictest0-21swapper/121:31:531
174699954,0cyclictest4337-21grep23:58:411
174699954,0cyclictest3668-21sed19:43:411
174699950,0cyclictest0-21swapper/123:02:031
174689955,0cyclictest0-21swapper/023:56:420
174689955,0cyclictest0-21swapper/022:18:380
174689955,0cyclictest0-21swapper/021:19:400
174689950,0cyclictest0-21swapper/022:05:140
174689950,0cyclictest0-21swapper/021:04:420
179950,0migration/14959-21needreboot19:18:461
179950,0migration/14199-21sh22:14:331
179950,0migration/128452-21munin-node21:48:451
179950,0migration/122868-21sh20:46:231
179950,0migration/120936-21missed_timers21:23:441
169950,0watchdog/10-21swapper/123:43:421
149950,0migration/0634-21kthreadcore23:33:430
149950,0migration/05207-21needreboot20:53:460
149950,0migration/032611-21missed_timers20:03:440
149950,0migration/031733-21fschecks_count21:33:360
149950,0migration/031616-21kthreadcore22:13:410
149950,0migration/029187-21munin-node20:28:410
149950,0migration/027205-21unixbench-2d22:48:470
149950,0migration/026776-21kthreadcore20:48:430
149950,0migration/024014-21kthreadcore23:28:420
149950,0migration/019299-21sh23:48:150
149950,0migration/019092-21taskset23:26:140
149950,0migration/017268-21kthreadcore22:43:430
149950,0migration/014508-21sh21:43:070
149950,0migration/013074-21kthreadcore20:38:420
149950,0migration/01010-21kthreadcore21:53:420
8215040,0irq/24-0000:00:31715-21perf19:18:252
339940,0migration/332158-21kthreadcore20:03:433
339940,0migration/330068-21df_abs22:33:373
339940,0migration/323523-21kthreadcore19:08:433
339940,0migration/31650-21irqcore19:43:403
339940,0migration/311476-21taskset19:00:233
29725040,0irq/27-eth0-tx-7447-21aten2.4-expect19:48:370
29725040,0irq/27-eth0-tx-32475-21forks20:53:402
29725040,0irq/27-eth0-tx-18693-21ssh23:25:022
29725040,0irq/27-eth0-tx-12692-21ssh23:43:402
29725040,0irq/27-eth0-tx-0-21swapper/223:08:432
29725040,0irq/27-eth0-tx-0-21swapper/222:58:262
29725040,0irq/27-eth0-tx-0-21swapper/222:48:402
29725040,0irq/27-eth0-tx-0-21swapper/222:03:402
29725040,0irq/27-eth0-tx-0-21swapper/221:43:482
29725040,0irq/27-eth0-tx-0-21swapper/221:13:332
29725040,0irq/27-eth0-tx-0-21swapper/019:38:500
29725040,0irq/27-eth0-tx-0-21swapper/019:28:420
29725040,0irq/27-eth0-tx-0-21swapper/018:43:390
29715040,0irq/26-eth0-rx-20444-21kthreadcore21:23:433
29715040,0irq/26-eth0-rx-0-21swapper/323:43:353
29715040,0irq/26-eth0-rx-0-21swapper/323:34:123
29715040,0irq/26-eth0-rx-0-21swapper/323:08:563
29715040,0irq/26-eth0-rx-0-21swapper/322:58:353
29715040,0irq/26-eth0-rx-0-21swapper/320:08:373
259940,0migration/27527-21cpuspeed_turbos19:48:372
259940,0migration/2707-21cpuspeed_turbos19:43:372
259940,0migration/23763-21kthreadcore20:08:422
259940,0migration/228750-21irqrtprio23:53:402
259940,0migration/228558-21sendmail_mailst21:48:452
259940,0migration/228530-21sh23:13:252
259940,0migration/22538-21kthreadcore21:33:402
259940,0migration/221740-21cpu20:23:352
259940,0migration/218526-21kthreadcore19:53:452
249940,0watchdog/227947-21perl20:03:392
249940,0watchdog/220241-21irqrtprio00:08:422
249940,0watchdog/214649-21grep19:28:432
249940,0watchdog/211687-21kthreadcore20:58:432
249940,0watchdog/211687-21kthreadcore20:58:432
249940,0watchdog/20-21swapper/222:28:422
249940,0watchdog/20-21swapper/222:08:262
249940,0watchdog/20-21swapper/221:23:432
249940,0watchdog/20-21swapper/220:48:432
249940,0watchdog/20-21swapper/220:28:432
249940,0watchdog/20-21swapper/219:23:472
174709943,0cyclictest3556-21lldpd20:46:242
174709943,0cyclictest3556-21lldpd20:19:542
174709943,0cyclictest3556-21lldpd19:42:232
174709943,0cyclictest3556-21lldpd18:53:542
174709943,0cyclictest3514-21snmpd20:36:062
174709943,0cyclictest10110-21awk20:38:402
174709940,0cyclictest0-21swapper/219:35:242
174699944,0cyclictest0-21swapper/122:03:531
174699943,0cyclictest7967-21awk21:38:411
174699943,0cyclictest6205-21awk18:58:411
174699943,0cyclictest3241-21irqbalance23:35:221
174699943,0cyclictest3241-21irqbalance23:13:321
174699943,0cyclictest30678-21awk22:33:401
174699943,0cyclictest25315-21awk18:48:411
174699943,0cyclictest24791-21awk21:08:401
174699943,0cyclictest22138-21awk22:48:391
174699943,0cyclictest18658-21awk18:43:401
174699943,0cyclictest15671-21sadc20:43:251
174689944,0cyclictest0-21swapper/022:37:050
174689943,0cyclictest6247-21munin-node19:23:420
174689943,0cyclictest381-21awk21:13:410
174689943,0cyclictest3514-21snmpd22:27:360
174689943,0cyclictest3514-21snmpd19:46:360
174689943,0cyclictest3241-21irqbalance23:01:320
174689943,0cyclictest3241-21irqbalance21:51:330
174689943,0cyclictest3241-21irqbalance21:23:530
174689943,0cyclictest3241-21irqbalance21:10:330
174689943,0cyclictest30143-21awk22:53:410
174689943,0cyclictest24369-21awk21:28:400
174689943,0cyclictest21556-21awk23:08:380
174689943,0cyclictest21523-21awk19:58:380
174689943,0cyclictest19990-21awk00:08:410
174689943,0cyclictest19687-21kworker/0:222:09:360
174689943,0cyclictest19687-21kworker/0:200:02:130
174689943,0cyclictest15853-21awk21:43:430
174689943,0cyclictest13568-21awk23:03:390
174689943,0cyclictest12034-21awk00:03:400
174689942,0cyclictest19687-21kworker/0:219:35:240
179940,0migration/18982-21runrttasks20:38:091
179940,0migration/18342-21idleruntime21:18:381
179940,0migration/15950-21kthreadcore20:08:431
179940,0migration/15342-21kthreadcore23:38:411
179940,0migration/132165-21cpuspeed_turbos21:13:381
179940,0migration/131918-21kthreadcore20:03:431
179940,0migration/131379-21kthreadcore22:53:421
179940,0migration/131278-21fschecks_count21:53:381
179940,0migration/126542-21kthreadcore22:28:431
179940,0migration/124072-21kthreadcore20:23:401
179940,0migration/120120-21aten_r1power_cu23:28:361
179940,0migration/11476-21kthreadcore18:53:421
179940,0migration/113885-21rt-features20:13:451
179940,0migration/113823-21fschecks_time22:43:391
179940,0migration/11230-21kthreadcore21:33:401
179940,0migration/11128-21unixbench-2d23:53:471
169940,0watchdog/18820-21cut22:38:421
169940,0watchdog/18460-21perl20:58:391
169940,0watchdog/18460-21perl20:58:391
169940,0watchdog/16559-21runrttasks23:04:141
169940,0watchdog/16348-21kthreadcore23:18:421
169940,0watchdog/132255-21users19:38:511
169940,0watchdog/125283-21python19:33:471
169940,0watchdog/121793-21kthreadcore23:48:421
169940,0watchdog/120500-21ssh22:25:261
169940,0watchdog/119340-21fschecks_time19:08:391
169940,0watchdog/10-21swapper/119:53:511
169940,0watchdog/10-21swapper/119:23:471
169940,0watchdog/10-21swapper/100:08:421
169940,0watchdog/10-21swapper/100:06:501
149940,0migration/06031-21kthreadcore23:18:420
149940,0migration/020372-21latency_hist19:58:250
29715030,0irq/26-eth0-rx-0-21swapper/320:33:393
29715030,0irq/26-eth0-rx-0-21swapper/320:18:463
29715030,0irq/26-eth0-rx-0-21swapper/320:17:333
29715030,0irq/26-eth0-rx-0-21swapper/319:48:453
29715030,0irq/26-eth0-rx-0-21swapper/319:39:063
29715030,0irq/26-eth0-rx-0-21swapper/319:14:123
29715030,0irq/26-eth0-rx-0-21swapper/318:48:373
249930,0watchdog/223539-21timerwakeupswit18:43:472
249930,0watchdog/20-21swapper/219:08:392
174709933,0cyclictest3556-21lldpd18:51:532
174709932,0cyclictest32676-21head19:18:412
174709931,0cyclictest0-21swapper/220:13:372
174699932,0cyclictest3514-21snmpd21:43:361
174699932,0cyclictest14454-21kthreadcore19:28:431
174699932,0cyclictest12961-21awk19:03:411
174699930,0cyclictest17184-21cut20:18:421
174699930,0cyclictest0-21swapper/119:13:431
174689933,0cyclictest19687-21kworker/0:223:48:250
174689933,0cyclictest19687-21kworker/0:223:38:290
174689933,0cyclictest19687-21kworker/0:223:13:310
174689933,0cyclictest19687-21kworker/0:221:58:280
174689933,0cyclictest19687-21kworker/0:220:33:260
174689933,0cyclictest19687-21kworker/0:220:08:280
174689933,0cyclictest19687-21kworker/0:219:03:260
174689933,0cyclictest19687-21kworker/0:218:48:260
169930,0watchdog/126924-21runrttasks20:02:271
169930,0watchdog/10-21swapper/120:53:431
169930,0watchdog/10-21swapper/120:48:431
169930,0watchdog/10-21swapper/120:28:431
29715020,0irq/26-eth0-rx-0-21swapper/320:28:283
29715020,0irq/26-eth0-rx-0-21swapper/319:28:383
169920,0watchdog/10-21swapper/119:48:311
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional