You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-26 - 15:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Fri Jun 26, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
711023725,0sleep20-21swapper/206:47:072
304450350,0irq/25-eth10-21swapper/306:46:543
740923322,0sleep00-21swapper/006:50:330
727623221,0sleep10-21swapper/106:49:021
756599109,0cyclictest5912-21munin-node08:51:520
75659971,0cyclictest0-21swapper/011:22:540
75709965,0cyclictest14169-21cut11:56:482
75669960,0cyclictest0-21swapper/107:16:531
339960,0migration/329396-21munin-node12:06:453
339960,0migration/328468-21sh10:43:293
339960,0migration/328359-21sh10:22:373
339960,0migration/320633-21sh10:38:593
339960,0migration/320574-21sh09:17:103
339960,0migration/320217-21sh10:58:223
339960,0migration/312529-21sh10:54:173
29715060,0irq/26-eth0-rx-4103-21grep09:26:573
29715060,0irq/26-eth0-rx-27275-21python11:21:533
29715060,0irq/26-eth0-rx-0-21swapper/309:32:423
149960,0migration/03694-21sh12:09:360
149960,0migration/031411-21idleruntime08:21:480
149960,0migration/029200-21sh11:46:390
149960,0migration/022092-21latency_hist10:01:330
149960,0migration/022058-21sh09:01:430
149960,0migration/014633-21idleruntime08:56:470
149960,0migration/012053-21sh11:13:180
8215050,0irq/24-0000:00:20505-21latency_hist12:21:322
8215050,0irq/24-0000:00:18059-21grep08:36:332
75709955,0cyclictest0-21swapper/210:26:532
75709950,0cyclictest0-21swapper/211:19:322
75669955,0cyclictest0-21swapper/111:31:211
75669955,0cyclictest0-21swapper/111:00:461
75669955,0cyclictest0-21swapper/109:27:541
75669950,0cyclictest0-21swapper/111:15:251
75669950,0cyclictest0-21swapper/109:19:141
75659955,0cyclictest0-21swapper/011:55:130
75659950,0cyclictest0-21swapper/011:46:330
75659950,0cyclictest0-21swapper/011:36:370
75659950,0cyclictest0-21swapper/010:21:060
75659950,0cyclictest0-21swapper/007:07:580
35150,0ktimersoftd/30-21swapper/310:01:263
339950,0migration/38406-21fschecks_time06:51:473
339950,0migration/37761-21kthreadcore11:31:483
339950,0migration/37761-21kthreadcore11:31:483
339950,0migration/35235-21munin-node08:26:463
339950,0migration/34368-21taskset08:23:033
339950,0migration/330800-21hddtemp_smartct10:26:483
339950,0migration/330220-21missed_timers08:41:513
339950,0migration/329752-21aten2.4-expect07:56:453
339950,0migration/328559-21munin-node07:06:473
339950,0migration/324213-21kthreadcore11:01:503
339950,0migration/321879-21munin-node07:01:483
339950,0migration/320281-21kthreadcore07:21:513
339950,0migration/317880-21kthreadcore12:16:503
339950,0migration/316534-21kthreadcore11:16:503
339950,0migration/315240-21idleruntime06:56:523
339950,0migration/314716-21fschecks_count09:36:473
339950,0migration/312483-21if_eth008:31:483
339950,0migration/311198-21kthreadcore08:51:513
339950,0migration/310781-21munin-node12:11:553
339950,0migration/310371-21gltestperf07:41:473
29725050,0irq/27-eth0-tx-7016-21idleruntime09:31:472
29725050,0irq/27-eth0-tx-5880-21munin-node10:11:442
29725050,0irq/27-eth0-tx-4706-21ssh09:08:392
29725050,0irq/27-eth0-tx-3233-21grep11:26:562
29725050,0irq/27-eth0-tx-29692-21munin-node11:06:532
29725050,0irq/27-eth0-tx-25553-21kthreadcore09:21:502
29725050,0irq/27-eth0-tx-22027-21munin-node07:26:510
29725050,0irq/27-eth0-tx-0-21swapper/211:34:042
29725050,0irq/27-eth0-tx-0-21swapper/211:34:042
29725050,0irq/27-eth0-tx-0-21swapper/210:51:352
29725050,0irq/27-eth0-tx-0-21swapper/210:51:332
29725050,0irq/27-eth0-tx-0-21swapper/210:02:262
29725050,0irq/27-eth0-tx-0-21swapper/008:36:530
29725050,0irq/27-eth0-tx-0-21swapper/007:21:470
29715050,0irq/26-eth0-rx-6476-21gltestperf10:31:463
29715050,0irq/26-eth0-rx-4613-21ssh09:48:143
29715050,0irq/26-eth0-rx-31448-21kthreadcore11:26:493
29715050,0irq/26-eth0-rx-30408-21irqrtprio11:46:493
29715050,0irq/26-eth0-rx-30183-21munin-run09:26:333
29715050,0irq/26-eth0-rx-26908-21timerwakeupswit12:01:563
29715050,0irq/26-eth0-rx-1482-21grep09:06:513
29715050,0irq/26-eth0-rx-0-21swapper/311:52:563
29715050,0irq/26-eth0-rx-0-21swapper/311:45:193
29715050,0irq/26-eth0-rx-0-21swapper/311:06:503
29715050,0irq/26-eth0-rx-0-21swapper/310:18:353
29715050,0irq/26-eth0-rx-0-21swapper/309:55:463
29715050,0irq/26-eth0-rx-0-21swapper/309:41:333
29715050,0irq/26-eth0-rx-0-21swapper/309:01:493
29715050,0irq/26-eth0-rx-0-21swapper/308:57:393
259950,0migration/26966-21kthreadcore12:11:482
259950,0migration/2500-21sh12:06:502
259950,0migration/23240-21missed_timers10:06:512
259950,0migration/231354-21gltestperf08:21:472
259950,0migration/228328-21sh11:23:562
259950,0migration/214051-21fschecks_count10:56:462
249950,0watchdog/29094-21cut08:26:522
249950,0watchdog/216126-21cut09:16:482
179950,0migration/13810-21taskset11:49:141
179950,0migration/128235-21latency07:51:511
179950,0migration/121091-21latency_hist11:41:331
179950,0migration/112556-21sh10:54:211
179950,0migration/112398-21idleruntime08:31:471
179950,0migration/110773-21switchtime11:51:551
149950,0migration/09750-21kthreadcore12:11:490
149950,0migration/09181-21kthreadcore09:51:500
149950,0migration/09041-21kthreadcore09:31:500
149950,0migration/06132-21munin-node09:11:430
149950,0migration/05544-21fschecks_time08:26:470
149950,0migration/04329-21taskset09:47:250
149950,0migration/04162-21irqrtprio07:36:510
149950,0migration/03774-21proc_pri09:26:540
149950,0migration/03440-21taskset07:59:150
149950,0migration/03292-21switchtime10:46:550
149950,0migration/030322-21aten_r1power_fr10:06:430
149950,0migration/029903-21latency_hist10:26:330
149950,0migration/029847-21latency_hist10:26:330
149950,0migration/029371-21taskset07:56:190
149950,0migration/028731-21taskset11:04:370
149950,0migration/02865-21munin-node11:26:540
149950,0migration/025882-21kthreadcore08:16:500
149950,0migration/024374-21kthreadcore10:41:500
149950,0migration/024040-21kthreadcore09:21:490
149950,0migration/022472-21kthreadcore12:01:490
149950,0migration/020236-21kthreadcore07:46:520
149950,0migration/019585-21needreboot09:56:510
149950,0migration/019431-21unixbench-2d11:16:560
149950,0migration/015042-21fschecks_time09:16:450
149950,0migration/013614-21aten_r1power_cu10:56:440
149950,0migration/013443-21latency_hist10:56:330
149950,0migration/013084-21cpuspeed_turbos12:16:440
149950,0migration/010804-21irqcore07:41:490
75709943,0cyclictest9602-21awk07:16:482
75709943,0cyclictest6886-21awk08:51:482
75709943,0cyclictest6288-21awk11:11:492
75709943,0cyclictest3831-21awk07:36:502
75709943,0cyclictest3514-21snmpd11:43:002
75709943,0cyclictest3514-21snmpd09:52:142
75709943,0cyclictest3514-21snmpd08:48:592
75709943,0cyclictest3514-21snmpd08:18:292
75709943,0cyclictest3514-21snmpd07:56:442
75709943,0cyclictest3514-21snmpd07:32:282
75709943,0cyclictest25894-21awk08:41:482
75709943,0cyclictest22994-21awk09:01:482
75709943,0cyclictest19165-21awk08:36:482
75669944,0cyclictest0-21swapper/109:54:331
75669944,0cyclictest0-21swapper/109:36:341
75669943,0cyclictest6656-21awk10:31:481
75669943,0cyclictest4777-21awk08:01:471
75669943,0cyclictest3556-21lldpd12:05:251
75669943,0cyclictest3556-21lldpd10:39:241
75669943,0cyclictest3556-21lldpd08:59:541
75669943,0cyclictest3556-21lldpd08:53:541
75669943,0cyclictest3556-21lldpd06:51:541
75669943,0cyclictest3514-21snmpd07:21:431
75669943,0cyclictest3241-21irqbalance11:58:411
75669943,0cyclictest31130-21awk10:06:471
75669943,0cyclictest30779-21awk10:46:481
75669943,0cyclictest30495-21awk07:56:481
75669943,0cyclictest28678-21awk07:06:481
75669943,0cyclictest25767-21awk08:41:471
75669943,0cyclictest22668-21awk10:41:481
75669943,0cyclictest22004-21awk07:01:491
75669943,0cyclictest18140-21awk08:11:481
75669943,0cyclictest14873-21awk10:16:481
75669943,0cyclictest14397-21awk11:16:481
75669943,0cyclictest10493-21awk07:41:481
75659944,0cyclictest0-21swapper/006:53:180
75659943,0cyclictest3241-21irqbalance11:33:010
75659943,0cyclictest3241-21irqbalance11:33:010
75659943,0cyclictest3241-21irqbalance11:10:410
75659943,0cyclictest3241-21irqbalance10:11:520
75659943,0cyclictest3241-21irqbalance09:45:020
75659943,0cyclictest2867-21awk07:11:500
75659943,0cyclictest21941-21awk07:01:480
75659943,0cyclictest14756-21awk10:36:470
339940,0migration/35761-21kthreadcore07:11:523
339940,0migration/328401-21nfs4_client07:51:523
339940,0migration/316260-21latency_hist07:46:343
339940,0migration/310798-21kthreadcore07:16:493
29725040,0irq/27-eth0-tx-6114-21ssh09:11:412
29725040,0irq/27-eth0-tx-24916-21munin-node08:41:460
29725040,0irq/27-eth0-tx-20977-21munin-node12:01:492
29725040,0irq/27-eth0-tx-17314-21aten2.4-expect08:11:450
29725040,0irq/27-eth0-tx-14212-21ssh09:36:382
29725040,0irq/27-eth0-tx-0-21swapper/211:55:182
29725040,0irq/27-eth0-tx-0-21swapper/211:47:022
29725040,0irq/27-eth0-tx-0-21swapper/211:36:472
29725040,0irq/27-eth0-tx-0-21swapper/211:01:342
29725040,0irq/27-eth0-tx-0-21swapper/210:36:382
29725040,0irq/27-eth0-tx-0-21swapper/210:21:362
29725040,0irq/27-eth0-tx-0-21swapper/210:16:492
29725040,0irq/27-eth0-tx-0-21swapper/209:56:532
29725040,0irq/27-eth0-tx-0-21swapper/209:46:552
29725040,0irq/27-eth0-tx-0-21swapper/208:56:352
29725040,0irq/27-eth0-tx-0-21swapper/007:33:360
29715040,0irq/26-eth0-rx-0-21swapper/311:58:143
29715040,0irq/26-eth0-rx-0-21swapper/311:38:423
29715040,0irq/26-eth0-rx-0-21swapper/311:12:083
29715040,0irq/26-eth0-rx-0-21swapper/310:46:443
29715040,0irq/26-eth0-rx-0-21swapper/310:15:203
29715040,0irq/26-eth0-rx-0-21swapper/310:11:063
29715040,0irq/26-eth0-rx-0-21swapper/310:01:443
29715040,0irq/26-eth0-rx-0-21swapper/309:11:343
259940,0migration/28376-21fschecks_time06:51:472
259940,0migration/2738-21kthreadcore09:26:502
259940,0migration/25612-21latency_hist10:31:332
259940,0migration/23872-21latency_hist08:01:342
259940,0migration/228818-21timerwakeupswit07:51:562
259940,0migration/224790-21kthreadcore09:41:502
259940,0migration/222462-21munin-node10:41:472
259940,0migration/218235-21munin-node08:11:492
259940,0migration/218153-21kthreadcore07:21:502
259940,0migration/216136-21kthreadcore06:56:552
259940,0migration/212827-21kthreadcore07:41:502
259940,0migration/211891-21irqrtprio08:06:502
249940,0watchdog/25181-21cut07:11:522
249940,0watchdog/20-21swapper/207:26:522
179940,0migration/129198-21taskset10:25:021
179940,0migration/129096-21aten_r1power_fr12:06:441
179940,0migration/128430-21sh11:03:451
179940,0migration/12756-21missed_timers11:06:511
179940,0migration/125408-21kthreadcore09:41:511
179940,0migration/124688-21gltestperf08:16:471
179940,0migration/122942-21munin-node10:01:461
179940,0migration/122541-21fschecks_count09:01:451
179940,0migration/118138-21kthreadcore07:46:511
179940,0migration/117242-21kthreadcore09:56:491
179940,0migration/114858-21kthreadcore12:16:491
179940,0migration/111631-21missed_timers09:31:521
179940,0migration/11088-21kthreadcore08:46:491
179940,0migration/110625-21kthreadcore10:11:491
179940,0migration/110045-21kthreadcore11:31:491
179940,0migration/110045-21kthreadcore11:31:491
169940,0watchdog/16559-21runrttasks08:24:481
169940,0watchdog/16044-21kthreadcore07:36:521
169940,0watchdog/14487-21ssh09:08:081
169940,0watchdog/131304-21ssh09:46:481
169940,0watchdog/122568-21munin-node07:26:481
169940,0watchdog/119718-21grep06:56:561
169940,0watchdog/118698-21open_inodes11:36:511
169940,0watchdog/10-21swapper/112:15:031
169940,0watchdog/10-21swapper/111:23:151
169940,0watchdog/10-21swapper/107:11:521
149940,0migration/09775-21kthreadcore10:31:500
149940,0migration/018709-21kthreadcore09:36:520
149940,0migration/018087-21latency_hist08:36:330
75709933,0cyclictest3556-21lldpd07:09:542
75709932,0cyclictest3514-21snmpd07:48:582
75709932,0cyclictest3514-21snmpd07:04:582
75669932,0cyclictest6748-21kthreadcore08:26:511
75669932,0cyclictest30950-21awk10:26:491
75669932,0cyclictest23915-21sensors08:36:551
75659933,0cyclictest27686-21kworker/0:008:06:450
75659933,0cyclictest27686-21kworker/0:007:16:490
75659933,0cyclictest16275-21kworker/0:111:56:360
75659933,0cyclictest16275-21kworker/0:109:06:430
75659933,0cyclictest16275-21kworker/0:108:46:470
75659932,0cyclictest4649-21expr08:01:460
29725030,0irq/27-eth0-tx-0-21swapper/006:56:490
29715030,0irq/26-eth0-rx-0-21swapper/308:46:433
29715030,0irq/26-eth0-rx-0-21swapper/308:16:433
29715030,0irq/26-eth0-rx-0-21swapper/308:11:453
29715030,0irq/26-eth0-rx-0-21swapper/308:06:553
29715030,0irq/26-eth0-rx-0-21swapper/307:26:453
179930,0migration/116752-21runrttasks08:08:301
169930,0watchdog/122458-21ssh09:21:441
169930,0watchdog/10-21swapper/109:11:401
169930,0watchdog/10-21swapper/107:31:481
339920,0migration/34306-21diskstats08:01:453
339920,0migration/33326-21diskstats07:36:483
29715020,0irq/26-eth0-rx-0-21swapper/308:36:363
29715020,0irq/26-eth0-rx-0-21swapper/307:31:463
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional