You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-02 - 15:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Tue Jun 02, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
651524939,0sleep30-21swapper/306:50:203
663023826,0sleep20-21swapper/206:51:392
663323423,0sleep00-21swapper/006:51:410
678523222,0sleep10-21swapper/106:53:181
6902991010,0cyclictest8360-21kworker/0:210:49:100
69029999,0cyclictest8360-21kworker/0:209:39:020
69029999,0cyclictest8360-21kworker/0:208:24:080
69029976,0cyclictest0-21swapper/012:18:000
69049960,0cyclictest0-21swapper/210:09:142
69039966,0cyclictest0-21swapper/111:06:481
69029966,0cyclictest8360-21kworker/0:207:49:070
69029966,0cyclictest8360-21kworker/0:206:59:070
69029966,0cyclictest29765-21kworker/0:011:49:080
69029966,0cyclictest29765-21kworker/0:011:39:080
69029960,0cyclictest0-21swapper/010:11:530
35160,0ktimersoftd/30-21swapper/310:10:193
339960,0migration/320418-21sh11:23:103
339960,0migration/319784-21sh10:40:133
339960,0migration/314799-21munin-node09:39:053
339960,0migration/314737-21munin-node07:44:133
339960,0migration/313130-21sh09:37:173
339960,0migration/311952-21sh09:54:273
29725060,0irq/27-eth0-tx-11090-21port_sshpriv08:54:130
29715060,0irq/26-eth0-rx-30434-21df09:09:023
29715060,0irq/26-eth0-rx-30159-21irqrtprio11:29:063
29715060,0irq/26-eth0-rx-24419-21grep07:29:073
149960,0migration/029960-21irqrtprio12:09:040
149960,0migration/021868-21idleruntime-cro09:23:510
149960,0migration/018908-21munin-node10:59:130
69049950,0cyclictest0-21swapper/210:50:042
69049950,0cyclictest0-21swapper/210:47:142
69039955,0cyclictest0-21swapper/108:29:091
69039950,0cyclictest0-21swapper/110:45:311
69029955,0cyclictest8360-21kworker/0:210:34:320
69029955,0cyclictest8360-21kworker/0:210:25:160
69029955,0cyclictest8360-21kworker/0:210:19:080
69029955,0cyclictest8360-21kworker/0:210:06:340
69029955,0cyclictest8360-21kworker/0:209:59:080
69029955,0cyclictest8360-21kworker/0:209:29:080
69029955,0cyclictest8360-21kworker/0:209:11:220
69029955,0cyclictest8360-21kworker/0:207:44:090
69029950,0cyclictest0-21swapper/009:05:590
4150,0ktimersoftd/00-21swapper/007:14:150
339950,0migration/33465-21taskset11:51:383
339950,0migration/33434-21pmu-power09:29:113
339950,0migration/331480-21kthreadcore10:29:083
339950,0migration/330529-21fschecks_count09:49:043
339950,0migration/330171-21aten_r1power_po08:24:033
339950,0migration/328669-21munin-node12:08:593
339950,0migration/327418-21taskset11:04:253
339950,0migration/326505-21kthreadcore08:44:083
339950,0migration/325243-21kthreadcore07:04:093
339950,0migration/323622-21kthreadcore09:44:083
339950,0migration/323035-21kthreadcore11:24:073
339950,0migration/322703-21munin-node09:04:043
339950,0migration/322149-21taskset07:53:203
339950,0migration/318329-21ntp_offset11:39:113
339950,0migration/316021-21kthreadcore10:59:083
339950,0migration/314452-21fschecks_time09:59:053
339950,0migration/311668-21unixbench_singl10:14:133
339950,0migration/310832-21kthreadcore07:19:093
339950,0migration/310048-21latency_hist08:08:513
29725050,0irq/27-eth0-tx-5014-21munin-node10:54:122
29725050,0irq/27-eth0-tx-30106-21munin-node09:09:062
29725050,0irq/27-eth0-tx-28785-21ssh10:27:222
29725050,0irq/27-eth0-tx-21151-21ssh10:23:312
29725050,0irq/27-eth0-tx-14118-21munin-node09:19:032
29725050,0irq/27-eth0-tx-11700-21ssh11:36:362
29725050,0irq/27-eth0-tx-0-21swapper/211:50:142
29725050,0irq/27-eth0-tx-0-21swapper/211:47:002
29725050,0irq/27-eth0-tx-0-21swapper/211:09:362
29725050,0irq/27-eth0-tx-0-21swapper/210:39:382
29725050,0irq/27-eth0-tx-0-21swapper/210:01:362
29725050,0irq/27-eth0-tx-0-21swapper/209:49:202
29725050,0irq/27-eth0-tx-0-21swapper/209:39:082
29725050,0irq/27-eth0-tx-0-21swapper/209:07:152
29715050,0irq/26-eth0-rx-6885-21kthreadcore10:54:063
29715050,0irq/26-eth0-rx-6559-21runrttasks11:46:403
29715050,0irq/26-eth0-rx-30413-21kthreadcore07:59:083
29715050,0irq/26-eth0-rx-26063-21kthreadcore08:19:083
29715050,0irq/26-eth0-rx-23057-21kthreadcore10:24:073
29715050,0irq/26-eth0-rx-22197-21ntp_kernel_err08:14:103
29715050,0irq/26-eth0-rx-18901-21cut08:59:103
29715050,0irq/26-eth0-rx-13634-21munin-node11:59:053
29715050,0irq/26-eth0-rx-12193-21ssh11:58:263
29715050,0irq/26-eth0-rx-11563-21ssh11:15:423
29715050,0irq/26-eth0-rx-0-21swapper/312:15:193
29715050,0irq/26-eth0-rx-0-21swapper/311:36:303
29715050,0irq/26-eth0-rx-0-21swapper/310:48:043
29715050,0irq/26-eth0-rx-0-21swapper/310:19:513
29715050,0irq/26-eth0-rx-0-21swapper/310:04:083
29715050,0irq/26-eth0-rx-0-21swapper/309:19:493
29715050,0irq/26-eth0-rx-0-21swapper/309:15:223
27150,0ktimersoftd/20-21swapper/212:14:342
259950,0migration/29673-21kthreadcore10:34:092
259950,0migration/229265-21kthreadcore07:09:082
259950,0migration/228302-21sh10:05:212
259950,0migration/217717-21kthreadcore11:39:092
259950,0migration/213124-21aten_r1power_cu10:59:022
259950,0migration/210149-21taskset11:54:102
249950,0watchdog/225158-21cut08:44:052
249950,0watchdog/215024-21kthreadcore08:59:092
179950,0migration/14648-21latency_hist11:13:511
179950,0migration/129719-21munin-node10:29:031
179950,0migration/122161-21kthreadcore11:44:061
179950,0migration/120346-21taskset09:19:301
179950,0migration/118382-21munin-node11:59:111
169950,0watchdog/129076-21diskstats12:09:001
169950,0watchdog/125156-21grep08:44:051
149950,0migration/09777-21kthreadcore11:34:080
149950,0migration/07834-21kthreadcore08:04:060
149950,0migration/06361-21fschecks_count09:34:020
149950,0migration/04811-21latency_hist11:13:510
149950,0migration/04578-21taskset10:32:460
149950,0migration/04547-21aten_r1power_cu11:54:010
149950,0migration/029994-21gltestperf11:09:040
149950,0migration/028452-21df_inode07:34:040
149950,0migration/027333-21kthreadcore08:44:090
149950,0migration/02597-21cpuspeed_turbos07:39:050
149950,0migration/025660-21kthreadcore11:24:080
149950,0migration/024464-21irqcore08:19:070
149950,0migration/024359-21kthreadcore09:44:080
149950,0migration/023016-21kthreadcore12:04:060
149950,0migration/022352-21munin-node09:24:020
149950,0migration/021844-21fschecks_count07:29:030
149950,0migration/020098-21taskset12:03:050
149950,0migration/019136-21kthreadcore08:39:080
149950,0migration/014276-21kthreadcore08:09:100
149950,0migration/013655-21taskset08:58:540
149950,0migration/012671-21sh09:56:320
149950,0migration/010065-21kthreadcore07:19:080
69049944,0cyclictest0-21swapper/212:03:512
69049943,0cyclictest7985-21awk06:54:072
69049943,0cyclictest6913-21awk09:14:052
69049943,0cyclictest4268-21awk08:04:032
69049943,0cyclictest30937-21awk08:24:062
69049943,0cyclictest21928-21awk11:24:062
69039943,0cyclictest9006-21awk07:19:071
69039943,0cyclictest5427-21awk11:54:051
69039943,0cyclictest3514-21snmpd09:38:571
69039943,0cyclictest3514-21snmpd09:28:571
69039943,0cyclictest3514-21snmpd09:23:571
69039943,0cyclictest3514-21snmpd08:23:411
69039943,0cyclictest3514-21snmpd07:00:401
69039943,0cyclictest3241-21irqbalance11:51:191
69039943,0cyclictest3241-21irqbalance11:14:491
69039943,0cyclictest3241-21irqbalance10:52:591
69039943,0cyclictest3241-21irqbalance09:57:491
69039943,0cyclictest31944-21awk08:49:041
69039943,0cyclictest30990-21awk09:09:051
69039943,0cyclictest22527-21awk10:24:061
69039943,0cyclictest13844-21awk11:19:061
69039940,0cyclictest0-21swapper/107:41:291
69029944,0cyclictest8360-21kworker/0:211:04:080
69029944,0cyclictest8360-21kworker/0:207:04:090
69029944,0cyclictest29765-21kworker/0:011:48:080
69029944,0cyclictest0-21swapper/011:32:170
69029943,0cyclictest8360-21kworker/0:210:46:300
69029943,0cyclictest3514-21snmpd07:56:110
69029943,0cyclictest17648-21awk08:14:060
69029943,0cyclictest14196-21awk10:39:060
339940,0migration/39594-21taskset08:05:183
339940,0migration/38724-21kthreadcore06:54:093
339940,0migration/319472-21kthreadcore08:39:093
29725040,0irq/27-eth0-tx-0-21swapper/212:19:032
29725040,0irq/27-eth0-tx-0-21swapper/212:08:592
29725040,0irq/27-eth0-tx-0-21swapper/211:58:552
29725040,0irq/27-eth0-tx-0-21swapper/211:28:582
29725040,0irq/27-eth0-tx-0-21swapper/211:19:042
29725040,0irq/27-eth0-tx-0-21swapper/211:14:092
29725040,0irq/27-eth0-tx-0-21swapper/211:04:102
29725040,0irq/27-eth0-tx-0-21swapper/210:13:522
29725040,0irq/27-eth0-tx-0-21swapper/209:54:142
29725040,0irq/27-eth0-tx-0-21swapper/209:34:052
29725040,0irq/27-eth0-tx-0-21swapper/209:29:082
29725040,0irq/27-eth0-tx-0-21swapper/209:24:042
29725040,0irq/27-eth0-tx-0-21swapper/006:54:030
29715040,0irq/26-eth0-rx-0-21swapper/312:20:453
29715040,0irq/26-eth0-rx-0-21swapper/312:04:293
29715040,0irq/26-eth0-rx-0-21swapper/311:09:023
29715040,0irq/26-eth0-rx-0-21swapper/310:48:513
29715040,0irq/26-eth0-rx-0-21swapper/310:33:553
29715040,0irq/26-eth0-rx-0-21swapper/309:24:403
29715040,0irq/26-eth0-rx-0-21swapper/308:54:163
29715040,0irq/26-eth0-rx-0-21swapper/307:14:023
259940,0migration/28388-21kthreadcore08:54:092
259940,0migration/25953-21kthreadcore08:29:082
259940,0migration/23073-21runrttasks08:03:132
259940,0migration/223593-21kthreadcore09:44:082
259940,0migration/223338-21kthreadcore07:04:082
259940,0migration/217628-21kthreadcore07:49:072
259940,0migration/214107-21runrttasks07:19:422
259940,0migration/211176-21aten_r1power_fr08:34:032
249940,0watchdog/25910-21cut07:39:092
249940,0watchdog/230202-21perl10:29:052
249940,0watchdog/20-21swapper/207:24:102
19140,0ktimersoftd/10-21swapper/109:18:481
179940,0migration/18881-21kthreadcore10:14:071
179940,0migration/18279-21kthreadcore08:54:091
179940,0migration/16708-21kthreadcore10:34:081
179940,0migration/130624-21kthreadcore07:09:081
179940,0migration/130580-21gltestperf10:09:051
179940,0migration/130163-21aten2.4-expect08:24:031
179940,0migration/124870-21kthreadcore10:04:081
179940,0migration/123953-21kthreadcore07:54:051
179940,0migration/123547-21kthreadcore07:04:081
179940,0migration/121209-21kthreadcore08:14:081
179940,0migration/12117-21latency_hist07:38:511
179940,0migration/118241-21switchtime12:19:131
179940,0migration/111026-21kthreadcore09:34:071
169940,0watchdog/13812-21diskstats08:04:011
169940,0watchdog/129963-21awk07:59:051
169940,0watchdog/118429-21kthreadcore10:39:091
169940,0watchdog/118028-21cut09:59:091
169940,0watchdog/117936-21kthreadcore10:19:091
169940,0watchdog/117862-21kthreadcore07:24:101
169940,0watchdog/112882-21kthreadcore08:09:091
169940,0watchdog/111884-21kthreadcore06:54:101
169940,0watchdog/111770-21ssh10:55:491
169940,0watchdog/10-21swapper/112:14:241
169940,0watchdog/10-21swapper/111:39:051
169940,0watchdog/10-21swapper/111:34:051
169940,0watchdog/10-21swapper/110:59:171
169940,0watchdog/10-21swapper/109:49:011
169940,0watchdog/10-21swapper/108:39:091
169940,0watchdog/10-21swapper/107:29:021
149940,0migration/06114-21fschecks_time10:14:030
149940,0migration/04529-21runrttasks09:51:210
8215030,0irq/24-0000:00:0-21swapper/206:58:512
69049932,0cyclictest3556-21lldpd07:35:372
69049932,0cyclictest3514-21snmpd07:53:562
69049932,0cyclictest32001-21awk08:49:042
69049932,0cyclictest17746-21awk08:14:062
69049932,0cyclictest11067-21awk08:09:082
69049932,0cyclictest10954-21grep07:44:082
69049930,0cyclictest24421-21iostat_ios08:19:072
69039932,0cyclictest2378-21sensors11:29:121
69039932,0cyclictest22758-21awk09:04:041
69039932,0cyclictest21805-21awk11:24:051
69039932,0cyclictest21438-21sensors07:49:111
69039932,0cyclictest11965-21awk08:34:061
69029933,0cyclictest8360-21kworker/0:211:18:560
69029933,0cyclictest8360-21kworker/0:210:53:560
69029933,0cyclictest8360-21kworker/0:209:14:120
69029933,0cyclictest8360-21kworker/0:208:49:120
69029933,0cyclictest8360-21kworker/0:208:34:080
69029933,0cyclictest8360-21kworker/0:207:58:530
69029933,0cyclictest8360-21kworker/0:207:09:050
69029933,0cyclictest29765-21kworker/0:012:18:560
69029932,0cyclictest17928-21tr07:24:100
29725030,0irq/27-eth0-tx-0-21swapper/008:29:140
29715030,0irq/26-eth0-rx-0-21swapper/308:51:483
29715030,0irq/26-eth0-rx-0-21swapper/308:34:033
29715030,0irq/26-eth0-rx-0-21swapper/308:29:033
29715030,0irq/26-eth0-rx-0-21swapper/307:54:003
29715030,0irq/26-eth0-rx-0-21swapper/307:43:113
29715030,0irq/26-eth0-rx-0-21swapper/307:23:513
29715030,0irq/26-eth0-rx-0-21swapper/307:09:033
249930,0watchdog/20-21swapper/208:39:092
249930,0watchdog/20-21swapper/207:29:022
179930,0migration/19217-21aten_r1power_vo07:44:031
169930,0watchdog/10-21swapper/112:04:041
169930,0watchdog/10-21swapper/109:44:051
169930,0watchdog/10-21swapper/108:59:091
69039921,0cyclictest1326-21aten_r1power_cu07:14:021
339920,0migration/328455-21diskstats07:34:043
339920,0migration/314164-21diskstats06:59:033
249920,0watchdog/20-21swapper/207:13:542
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional