You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-12 - 15:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Thu Mar 12, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2665723930,0sleep20-21swapper/206:59:352
2669023626,0sleep30-21swapper/306:59:563
2662623127,0sleep10-21swapper/106:59:101
2646823127,0sleep00-21swapper/006:57:210
339960,0migration/37302-21aten_r1power_fr11:31:463
339960,0migration/36556-21sh12:11:443
339960,0migration/35638-21sh11:27:523
339960,0migration/33582-21latency12:26:523
339960,0migration/324412-21sh10:21:443
339960,0migration/315373-21sh10:14:113
29725060,0irq/27-eth0-tx-17670-21munin-node08:31:490
29715060,0irq/26-eth0-rx-980-21perl10:06:483
269049960,0cyclictest0-21swapper/211:44:172
269049960,0cyclictest0-21swapper/211:23:022
149960,0migration/032169-21sh09:04:090
149960,0migration/032013-21sh10:05:090
149960,0migration/022578-21taskset10:58:430
149960,0migration/015599-21sh10:35:560
8215050,0irq/24-0000:00:7289-21latency_hist11:11:352
8215050,0irq/24-0000:00:16535-21cat09:56:352
339950,0migration/39882-21munin-node07:36:493
339950,0migration/39698-21kthreadcore08:46:533
339950,0migration/3878-21kthreadcore08:16:533
339950,0migration/38739-21taskset09:51:383
339950,0migration/36590-21taskset11:09:393
339950,0migration/35511-21kthreadcore09:46:533
339950,0migration/332682-21kthreadcore07:26:533
339950,0migration/33137-21kthreadcore07:06:513
339950,0migration/331153-21cpuspeed_turbos12:06:463
339950,0migration/328873-21timerwakeupswit12:01:573
339950,0migration/326567-21kthreadcore09:41:513
339950,0migration/326545-21kthreadcore10:01:513
339950,0migration/323363-21latency_hist11:21:353
339950,0migration/322302-21kthreadcore08:56:513
339950,0migration/320501-21pmu-power11:56:553
339950,0migration/316221-21taskset08:03:003
339950,0migration/315143-21df_abs07:16:493
339950,0migration/315143-21df_abs07:16:493
339950,0migration/315082-21kthreadcore08:51:523
339950,0migration/314038-21kthreadcore09:11:533
339950,0migration/311970-21munin-node08:26:503
339950,0migration/310790-21taskset08:26:263
29725050,0irq/27-eth0-tx-798-21fschecks_count10:06:472
29725050,0irq/27-eth0-tx-28439-21wc12:21:572
29725050,0irq/27-eth0-tx-2376-21kernelversion09:26:512
29725050,0irq/27-eth0-tx-22939-21ssh10:38:552
29725050,0irq/27-eth0-tx-15871-21munin-node10:56:512
29725050,0irq/27-eth0-tx-0-21swapper/210:19:502
29725050,0irq/27-eth0-tx-0-21swapper/008:28:530
29725050,0irq/27-eth0-tx-0-21swapper/008:10:530
29725050,0irq/27-eth0-tx-0-21swapper/007:51:470
29725050,0irq/27-eth0-tx-0-21swapper/007:24:160
29715050,0irq/26-eth0-rx-7670-21smartctl11:51:473
29715050,0irq/26-eth0-rx-6559-21runrttasks10:26:583
29715050,0irq/26-eth0-rx-5713-21ssh11:49:033
29715050,0irq/26-eth0-rx-28147-21nfs4_client12:21:533
29715050,0irq/26-eth0-rx-26975-21grep11:41:513
29715050,0irq/26-eth0-rx-23733-21taskset09:17:393
29715050,0irq/26-eth0-rx-17013-21munin-node09:56:473
29715050,0irq/26-eth0-rx-14753-21ssh10:54:073
29715050,0irq/26-eth0-rx-0-21swapper/312:19:513
29715050,0irq/26-eth0-rx-0-21swapper/311:39:063
29715050,0irq/26-eth0-rx-0-21swapper/311:21:533
29715050,0irq/26-eth0-rx-0-21swapper/311:11:373
29715050,0irq/26-eth0-rx-0-21swapper/311:01:453
29715050,0irq/26-eth0-rx-0-21swapper/310:46:543
29715050,0irq/26-eth0-rx-0-21swapper/310:46:183
29715050,0irq/26-eth0-rx-0-21swapper/310:16:413
29715050,0irq/26-eth0-rx-0-21swapper/309:40:353
29715050,0irq/26-eth0-rx-0-21swapper/309:28:293
29715050,0irq/26-eth0-rx-0-21swapper/309:22:253
29715050,0irq/26-eth0-rx-0-21swapper/309:10:343
29715050,0irq/26-eth0-rx-0-21swapper/307:56:523
29715050,0irq/26-eth0-rx-0-21swapper/307:41:483
27150,0ktimersoftd/20-21swapper/211:48:442
27150,0ktimersoftd/20-21swapper/210:11:492
269049950,0cyclictest0-21swapper/211:37:422
269039955,0cyclictest0-21swapper/108:06:551
269039954,0cyclictest32573-21ssh10:26:461
269039950,0cyclictest0-21swapper/110:48:221
269039950,0cyclictest0-21swapper/110:40:381
269039950,0cyclictest0-21swapper/109:06:211
269029955,0cyclictest0-21swapper/012:23:560
269029955,0cyclictest0-21swapper/011:15:300
269029950,0cyclictest0-21swapper/012:09:160
269029950,0cyclictest0-21swapper/011:47:120
269029950,0cyclictest0-21swapper/009:31:460
259950,0migration/28678-21kthreadcore12:11:522
259950,0migration/28631-21idleruntime10:51:472
259950,0migration/26787-21sh10:28:312
259950,0migration/231394-21fschecks_count12:06:472
259950,0migration/231058-21sh11:05:012
259950,0migration/231046-21sh10:02:202
259950,0migration/228999-21latency_hist07:51:362
259950,0migration/220041-21latency07:16:542
259950,0migration/220041-21latency07:16:542
259950,0migration/216538-21munin-run08:06:352
259950,0migration/215059-21unixbench_singl07:36:592
19150,0ktimersoftd/10-21swapper/110:11:491
179950,0migration/130734-21sh11:04:051
179950,0migration/125460-21kthreadcore12:21:511
179950,0migration/124794-21irqrtprio11:21:501
179950,0migration/119647-21kthreadcore09:56:521
179950,0migration/11819-21kthreadcore12:06:511
179950,0migration/11607-21cpuspeed_turbos07:06:471
149950,0migration/07615-21kthreadcore07:56:530
149950,0migration/07611-21kthreadcore08:21:500
149950,0migration/06839-21sh11:31:180
149950,0migration/05575-21taskset12:30:290
149950,0migration/031202-21kthreadcore07:01:530
149950,0migration/030953-21if_eth008:16:510
149950,0migration/028168-21aten2.4-expect07:26:460
149950,0migration/027320-21kthreadcore10:21:520
149950,0migration/026478-21kthreadcore08:36:540
149950,0migration/025559-21kthreadcore08:11:510
149950,0migration/025329-21kthreadcore11:21:500
149950,0migration/025072-21kthreadcore07:46:520
149950,0migration/024907-21gltestperf10:41:490
149950,0migration/024243-21taskset09:19:080
149950,0migration/02369-21kthreadcore11:06:510
149950,0migration/022680-21ntp_kernel_pll_09:36:550
149950,0migration/02237-21kernelversion09:06:510
149950,0migration/022165-21taskset12:21:090
149950,0migration/021508-21latency10:36:530
149950,0migration/020030-21kthreadcore11:36:510
149950,0migration/018503-21kthreadcore07:41:520
149950,0migration/016357-21sh09:56:120
149950,0migration/016177-21kthreadcore08:51:520
149950,0migration/015215-21munin-node09:11:580
149950,0migration/012051-21kthreadcore10:11:520
149950,0migration/010931-21kthreadcore07:11:520
149950,0migration/010758-21munin-node08:46:550
149950,0migration/010548-21kthreadcore10:51:500
339940,0migration/37418-21kthreadcore07:31:523
339940,0migration/332517-21kthreadcore08:41:523
339940,0migration/324678-21kthreadcore07:21:523
339940,0migration/324374-21kthreadcore07:46:523
339940,0migration/314353-21kthreadcore09:31:523
29725040,0irq/27-eth0-tx-8113-21munin-node10:31:542
29725040,0irq/27-eth0-tx-25054-21diskmemload09:49:262
29725040,0irq/27-eth0-tx-0-21swapper/212:17:042
29725040,0irq/27-eth0-tx-0-21swapper/211:58:282
29725040,0irq/27-eth0-tx-0-21swapper/211:32:102
29725040,0irq/27-eth0-tx-0-21swapper/211:26:542
29725040,0irq/27-eth0-tx-0-21swapper/211:18:252
29725040,0irq/27-eth0-tx-0-21swapper/211:11:442
29725040,0irq/27-eth0-tx-0-21swapper/210:46:412
29725040,0irq/27-eth0-tx-0-21swapper/210:41:532
29725040,0irq/27-eth0-tx-0-21swapper/210:24:192
29725040,0irq/27-eth0-tx-0-21swapper/209:32:142
29725040,0irq/27-eth0-tx-0-21swapper/209:21:382
29725040,0irq/27-eth0-tx-0-21swapper/209:16:452
29725040,0irq/27-eth0-tx-0-21swapper/008:41:560
29725040,0irq/27-eth0-tx-0-21swapper/007:16:500
29725040,0irq/27-eth0-tx-0-21swapper/007:16:500
29715040,0irq/26-eth0-rx-0-21swapper/310:56:383
29715040,0irq/26-eth0-rx-0-21swapper/310:36:593
29715040,0irq/26-eth0-rx-0-21swapper/310:33:233
29715040,0irq/26-eth0-rx-0-21swapper/309:06:163
29715040,0irq/26-eth0-rx-0-21swapper/307:01:463
269049943,0cyclictest3514-21snmpd09:41:402
269049943,0cyclictest3514-21snmpd08:58:402
269049943,0cyclictest3514-21snmpd08:34:252
269049943,0cyclictest30597-21munin-node12:26:572
269049943,0cyclictest29941-21awk07:51:492
269049943,0cyclictest1930-21awk09:06:492
269039944,0cyclictest0-21swapper/112:27:221
269039944,0cyclictest0-21swapper/111:07:171
269039943,0cyclictest6224-21awk08:46:511
269039943,0cyclictest3556-21lldpd11:52:531
269039943,0cyclictest3556-21lldpd11:27:241
269039943,0cyclictest3556-21lldpd11:18:241
269039943,0cyclictest3556-21lldpd08:36:231
269039943,0cyclictest3514-21snmpd12:01:551
269039943,0cyclictest3514-21snmpd10:53:401
269039943,0cyclictest18018-21awk09:36:501
269039940,0cyclictest0-21swapper/111:42:261
269029943,0cyclictest9106-21munin-node07:36:560
269029943,0cyclictest7675-21kworker/0:112:01:500
269029943,0cyclictest3556-21lldpd10:29:240
269029943,0cyclictest3241-21irqbalance10:07:240
269029943,0cyclictest3241-21irqbalance09:42:040
269029943,0cyclictest29878-21kworker/0:009:21:440
269029943,0cyclictest19549-21awk08:56:490
269029943,0cyclictest17615-21awk09:56:490
269029940,0cyclictest2356-21munin-node07:31:480
259940,0migration/29609-21forks09:11:482
259940,0migration/25894-21kthreadcore08:21:492
259940,0migration/24860-21runrttasks08:44:472
259940,0migration/228947-21idleruntime07:26:492
259940,0migration/228615-21kthreadcore07:01:522
259940,0migration/224857-21kthreadcore12:01:512
259940,0migration/224361-21aten_r1power_cu08:36:482
259940,0migration/224151-21kthreadcore07:21:512
259940,0migration/222477-21latency09:36:532
259940,0migration/21315-21latency_hist07:06:362
259940,0migration/212765-21idleruntime08:51:492
259940,0migration/210635-21kthreadcore07:11:522
249940,0watchdog/27217-21df11:51:452
249940,0watchdog/226114-21idleruntime09:01:502
249940,0watchdog/20-21swapper/209:56:462
249940,0watchdog/20-21swapper/207:56:502
179940,0migration/17254-21munin-node11:31:451
179940,0migration/16840-21cpuspeed_turbos12:11:471
179940,0migration/14723-21kthreadcore09:46:521
179940,0migration/132353-21sh09:45:111
179940,0migration/131545-21taskset10:45:381
179940,0migration/130521-21taskset08:39:021
179940,0migration/129175-21kthreadcore07:01:521
179940,0migration/127214-21kthreadcore09:21:511
179940,0migration/123592-21kthreadcore07:21:511
179940,0migration/123236-21kthreadcore08:56:521
179940,0migration/120360-21kthreadcore11:36:511
179940,0migration/119302-21kthreadcore12:16:521
179940,0migration/117159-21fschecks_time10:16:481
179940,0migration/115873-21taskset10:56:461
179940,0migration/114585-21munin-node07:36:551
169940,0watchdog/16715-21ssh10:07:181
169940,0watchdog/127206-21kworker/u8:007:26:461
169940,0watchdog/118232-21if_err_eth1.209:16:501
169940,0watchdog/11279-21kthreadcore11:46:531
169940,0watchdog/11074-21aten_r1power_vo09:06:461
169940,0watchdog/10-21swapper/111:11:491
169940,0watchdog/10-21swapper/109:51:461
169940,0watchdog/10-21swapper/109:26:461
169940,0watchdog/10-21swapper/109:11:581
169940,0watchdog/10-21swapper/108:21:501
149940,0migration/06300-21kthreadcore07:06:520
149940,0migration/016866-21df_inode10:16:470
149940,0migration/012701-21sensors_temp11:51:550
8215030,0irq/24-0000:00:0-21swapper/208:27:002
339930,0migration/314378-21runrttasks07:14:233
29725030,0irq/27-eth0-tx-0-21swapper/008:01:460
29715030,0irq/26-eth0-rx-0-21swapper/308:36:493
29715030,0irq/26-eth0-rx-0-21swapper/308:34:283
29715030,0irq/26-eth0-rx-0-21swapper/308:11:463
29715030,0irq/26-eth0-rx-0-21swapper/307:51:513
269049932,0cyclictest3340-21awk07:31:502
269049932,0cyclictest24559-21irqrtprio08:11:502
269049932,0cyclictest17628-21awk08:06:512
269049932,0cyclictest11718-21sadc08:51:352
269049930,0cyclictest30446-21diskstats08:16:492
269039933,0cyclictest24346-21awk08:11:501
269039932,0cyclictest8993-21awk07:11:501
269039932,0cyclictest4304-21awk07:56:501
269039932,0cyclictest25640-21awk10:01:491
269039932,0cyclictest23707-21sed07:46:511
269039932,0cyclictest2013-21kthreadcore08:41:521
269039932,0cyclictest11893-21awk08:26:491
269039932,0cyclictest11001-21awk08:01:501
269029933,0cyclictest7675-21kworker/0:112:11:380
269029933,0cyclictest7675-21kworker/0:111:56:360
269029933,0cyclictest29878-21kworker/0:011:41:380
269029933,0cyclictest29878-21kworker/0:011:31:400
269029933,0cyclictest29878-21kworker/0:011:16:360
269029933,0cyclictest29878-21kworker/0:011:01:370
269029933,0cyclictest29878-21kworker/0:010:46:370
269029933,0cyclictest29878-21kworker/0:009:46:390
269029933,0cyclictest29878-21kworker/0:009:26:390
179930,0migration/19123-21runrttasks09:31:441
179930,0migration/17017-21kthreadcore07:31:521
169930,0watchdog/125054-21diskmemload10:31:371
169930,0watchdog/10-21swapper/111:56:491
169930,0watchdog/10-21swapper/110:22:091
169930,0watchdog/10-21swapper/108:18:581
169930,0watchdog/10-21swapper/107:16:381
169930,0watchdog/10-21swapper/107:16:381
29715020,0irq/26-eth0-rx-0-21swapper/308:06:473
269049921,0cyclictest0-21swapper/207:41:362
269039921,0cyclictest3197-17auditd08:51:351
169920,0watchdog/10-21swapper/107:51:381
169920,0watchdog/10-21swapper/107:41:381
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional