You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-01 - 02:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Mon Jun 01, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
962924737,0sleep30-21swapper/318:50:063
971223430,0sleep00-21swapper/018:51:030
961623425,0sleep10-21swapper/118:49:561
966323324,0sleep20-21swapper/218:50:332
339970,0migration/37924-21sh23:56:243
100379970,0cyclictest0-21swapper/123:09:171
339960,0migration/36992-21sh22:32:023
339960,0migration/36047-21munin-node21:29:183
339960,0migration/331729-21sh00:10:403
339960,0migration/331441-21sh21:45:533
339960,0migration/331148-21sh21:24:293
339960,0migration/324142-21sh00:06:513
29725060,0irq/27-eth0-tx-14136-21munin-node20:34:130
29715060,0irq/26-eth0-rx-6407-21timerwakeupswit21:49:233
29715060,0irq/26-eth0-rx-341-21munin-run21:09:003
29715060,0irq/26-eth0-rx-341-21munin-run21:09:003
29715060,0irq/26-eth0-rx-30259-21unixbench_multi22:24:213
29715060,0irq/26-eth0-rx-21873-21load21:59:173
29715060,0irq/26-eth0-rx-13554-21open_inodes22:34:203
149960,0migration/05111-21munin-node23:29:210
149960,0migration/030099-21sh23:04:540
100389960,0cyclictest0-21swapper/221:25:572
100379960,0cyclictest0-21swapper/123:35:181
8215050,0irq/24-0000:00:23489-21latency_hist23:03:592
4150,0ktimersoftd/00-21swapper/022:33:010
35150,0ktimersoftd/30-21swapper/322:05:323
339950,0migration/39154-21kthreadcore19:39:163
339950,0migration/3890-21kernelversion22:49:153
339950,0migration/38319-21munin-node20:29:153
339950,0migration/37189-21sh21:10:053
339950,0migration/33422-21munin-node19:09:233
339950,0migration/331732-21munin-node20:19:173
339950,0migration/323916-21taskset22:44:033
339950,0migration/320938-21latency23:19:173
339950,0migration/318997-21munin-node19:24:163
339950,0migration/314732-21taskset23:17:233
339950,0migration/314100-21kthreadcore19:19:163
339950,0migration/312208-21kthreadcore18:54:143
339950,0migration/312036-21kthreadcore22:14:173
339950,0migration/311930-21kthreadcore23:34:173
339950,0migration/310699-21kthreadcore23:59:173
29725050,0irq/27-eth0-tx-5517-21pmu-power22:29:202
29725050,0irq/27-eth0-tx-4484-21munin-node19:14:120
29725050,0irq/27-eth0-tx-31305-21ssh21:05:082
29725050,0irq/27-eth0-tx-31305-21ssh21:05:082
29725050,0irq/27-eth0-tx-28148-21kthreadcore22:44:172
29725050,0irq/27-eth0-tx-24732-21munin-node21:44:192
29725050,0irq/27-eth0-tx-230132sleep223:43:402
29725050,0irq/27-eth0-tx-1483-21munin-node21:09:132
29725050,0irq/27-eth0-tx-14403-21ssh20:54:230
29725050,0irq/27-eth0-tx-11200-21munin-node19:19:180
29725050,0irq/27-eth0-tx-0-21swapper/223:33:082
29725050,0irq/27-eth0-tx-0-21swapper/222:50:102
29725050,0irq/27-eth0-tx-0-21swapper/222:24:112
29725050,0irq/27-eth0-tx-0-21swapper/222:13:092
29725050,0irq/27-eth0-tx-0-21swapper/200:19:492
29725050,0irq/27-eth0-tx-0-21swapper/200:10:542
29725050,0irq/27-eth0-tx-0-21swapper/019:59:110
29725050,0irq/27-eth0-tx-0-21swapper/018:58:330
29715050,0irq/26-eth0-rx-912-21stty00:14:103
29715050,0irq/26-eth0-rx-29916-21sh23:45:263
29715050,0irq/26-eth0-rx-27006-40yum-updatesd-he20:41:333
29715050,0irq/26-eth0-rx-25974-21ssh23:24:173
29715050,0irq/26-eth0-rx-23297-21chrt21:19:563
29715050,0irq/26-eth0-rx-21101-21kthreadcore22:39:173
29715050,0irq/26-eth0-rx-0-21swapper/323:43:473
29715050,0irq/26-eth0-rx-0-21swapper/323:33:183
29715050,0irq/26-eth0-rx-0-21swapper/322:57:553
29715050,0irq/26-eth0-rx-0-21swapper/322:12:133
29715050,0irq/26-eth0-rx-0-21swapper/321:43:403
29715050,0irq/26-eth0-rx-0-21swapper/321:34:053
29715050,0irq/26-eth0-rx-0-21swapper/320:59:263
29715050,0irq/26-eth0-rx-0-21swapper/320:56:093
29715050,0irq/26-eth0-rx-0-21swapper/319:29:223
259950,0migration/26109-21fschecks_time19:39:122
259950,0migration/229849-21sh23:45:142
259950,0migration/224307-21latency_hist22:03:592
259950,0migration/223967-21kthreadcore20:39:172
259950,0migration/221802-21munin-node22:19:192
259950,0migration/217498-21kthreadcore22:59:152
259950,0migration/213573-21munin-node20:09:132
259950,0migration/213140-21kthreadcore20:54:172
259950,0migration/212102-21latency_hist19:44:002
19150,0ktimersoftd/10-21swapper/122:33:011
19150,0ktimersoftd/10-21swapper/122:05:321
19150,0ktimersoftd/10-21swapper/120:02:561
179950,0migration/17040-21sh21:30:021
179950,0migration/15200-21gltestperf19:14:131
179950,0migration/121116-21rt-features23:39:211
179950,0migration/119846-21kthreadcore18:59:181
179950,0migration/115603-21taskset21:57:071
179950,0migration/113981-21munin-node22:14:221
179950,0migration/110897-21fschecks_time18:54:111
169950,0watchdog/112224-21kthreadcore20:29:181
149950,0migration/08319-21sh23:34:150
149950,0migration/07533-21taskset21:11:010
149950,0migration/07164-21sh23:13:450
149950,0migration/0472-21kthreadcore19:09:180
149950,0migration/03497-21kthreadcore20:49:180
149950,0migration/03252-21kthreadcore20:24:170
149950,0migration/032228-21turbostat22:08:590
149950,0migration/032082-21taskset21:47:420
149950,0migration/026492-21irqcore19:54:180
149950,0migration/024340-21aten_r1power_fr22:24:090
149950,0migration/018580-21kthreadcore18:59:180
149950,0migration/017885-21irqrtprio20:59:180
149950,0migration/017052-21kthreadcore23:39:160
149950,0migration/016777-21fschecks_time22:19:130
149950,0migration/015682-21sh00:21:000
149950,0migration/014600-21kthreadcore20:09:170
149950,0migration/010097-21kthreadcore22:34:170
100389955,0cyclictest0-21swapper/221:22:292
100389950,0cyclictest0-21swapper/223:53:312
100379955,0cyclictest8278-21diskmemload23:49:581
100379955,0cyclictest0-21swapper/123:27:151
100379955,0cyclictest0-21swapper/122:44:321
100379955,0cyclictest0-21swapper/121:48:151
100379955,0cyclictest0-21swapper/121:34:221
100379955,0cyclictest0-21swapper/121:04:161
100379955,0cyclictest0-21swapper/121:04:161
100379955,0cyclictest0-21swapper/120:08:551
100379950,0cyclictest0-21swapper/122:24:591
100379950,0cyclictest0-21swapper/121:11:311
8215040,0irq/24-0000:00:0-21swapper/219:14:002
339940,0migration/324415-21kthreadcore20:14:173
339940,0migration/324078-21cpuspeed_turbos23:04:113
339940,0migration/323102-21taskset19:01:383
339940,0migration/321676-21kthreadcore19:49:193
339940,0migration/31916-21kthreadcore19:34:183
339940,0migration/311437-21kthreadcore21:14:163
29725040,0irq/27-eth0-tx-9064-21df_abs21:34:112
29725040,0irq/27-eth0-tx-31815-21munin-node23:09:132
29725040,0irq/27-eth0-tx-17681-21if_eth1.221:39:152
29725040,0irq/27-eth0-tx-14446-21ssh22:14:422
29725040,0irq/27-eth0-tx-0-21swapper/223:59:182
29725040,0irq/27-eth0-tx-0-21swapper/223:19:072
29725040,0irq/27-eth0-tx-0-21swapper/223:14:112
29725040,0irq/27-eth0-tx-0-21swapper/221:54:012
29725040,0irq/27-eth0-tx-0-21swapper/221:29:372
29725040,0irq/27-eth0-tx-0-21swapper/221:14:092
29725040,0irq/27-eth0-tx-0-21swapper/200:14:052
29725040,0irq/27-eth0-tx-0-21swapper/020:44:190
29715040,0irq/26-eth0-rx-0-21swapper/323:49:113
29715040,0irq/26-eth0-rx-0-21swapper/323:09:223
29715040,0irq/26-eth0-rx-0-21swapper/323:00:313
29715040,0irq/26-eth0-rx-0-21swapper/322:22:073
29715040,0irq/26-eth0-rx-0-21swapper/321:54:193
29715040,0irq/26-eth0-rx-0-21swapper/320:38:053
29715040,0irq/26-eth0-rx-0-21swapper/319:59:113
29715040,0irq/26-eth0-rx-0-21swapper/319:54:193
29715040,0irq/26-eth0-rx-0-21swapper/319:14:173
29715040,0irq/26-eth0-rx-0-21swapper/319:04:183
29715040,0irq/26-eth0-rx-0-21swapper/300:19:173
259940,0migration/29739-21kthreadcore22:54:152
259940,0migration/29601-21kthreadcore20:29:172
259940,0migration/231200-21iostat19:09:172
259940,0migration/229659-21sshd19:05:322
259940,0migration/223242-21unixbench_singl00:04:252
259940,0migration/220076-21cpuspeed_turbos20:14:122
259940,0migration/219014-21kthreadcore20:34:182
259940,0migration/21098-21fschecks_time21:49:132
249940,0watchdog/29296-21kthreadcore22:34:172
249940,0watchdog/2909-21sort20:44:222
249940,0watchdog/27377-21ssh23:34:092
249940,0watchdog/2737-21kthreadcore19:34:182
249940,0watchdog/229366-21grep19:29:182
249940,0watchdog/227423-21kthreadcore23:24:172
249940,0watchdog/210642-21diskstats18:54:102
249940,0watchdog/20-21swapper/220:59:182
179940,0migration/13947-21kthreadcore00:14:151
179940,0migration/12941-21kthreadcore22:49:161
179940,0migration/128104-21kthreadcore23:04:161
179940,0migration/127383-21if_eth120:19:141
179940,0migration/127083-21taskset20:42:241
179940,0migration/121902-21runrttasks22:59:291
179940,0migration/119275-21kthreadcore21:19:161
179940,0migration/119214-21kthreadcore23:19:171
179940,0migration/118703-21kthreadcore21:59:161
179940,0migration/118291-21kthreadcore22:19:171
179940,0migration/117485-21kthreadcore22:39:151
179940,0migration/116170-21runrttasks20:58:221
179940,0migration/114995-21kthreadcore19:44:191
179940,0migration/111145-21kthreadcore21:14:161
169940,0watchdog/18278-21diskmemload23:31:571
169940,0watchdog/132476-21ssh22:09:051
169940,0watchdog/1323-21ssh21:49:061
169940,0watchdog/124015-21ssh21:02:381
169940,0watchdog/10-21swapper/122:34:171
169940,0watchdog/10-21swapper/120:44:221
169940,0watchdog/10-21swapper/120:09:141
169940,0watchdog/10-21swapper/100:21:291
149940,0migration/0741-21aten_r1power_en00:14:090
149940,0migration/030785-21kthreadcore20:19:160
149940,0migration/023470-21aten_r1power_en23:44:100
149940,0migration/020408-21kthreadcore19:49:190
149940,0migration/017266-21aten_r1power_fr00:04:130
149940,0migration/016682-21turbostat21:23:550
149940,0migration/015739-21sh21:57:320
149940,0migration/01209-21kthreadcore22:49:160
100389943,0cyclictest3514-21snmpd19:54:052
100389943,0cyclictest3241-21irqbalance20:04:282
100389943,0cyclictest24486-21munin-node22:04:112
100389943,0cyclictest1888-21awk23:54:102
100389943,0cyclictest16970-21awk22:39:142
100379944,0cyclictest0-21swapper/100:03:591
100379943,0cyclictest3556-21lldpd23:55:271
100379943,0cyclictest3556-21lldpd19:49:571
100379943,0cyclictest3556-21lldpd00:13:271
100379943,0cyclictest3556-21lldpd00:00:561
100379943,0cyclictest3514-21snmpd20:36:501
100379943,0cyclictest3514-21snmpd19:57:501
100379943,0cyclictest3514-21snmpd19:41:201
100379943,0cyclictest3514-21snmpd19:34:501
100379943,0cyclictest3514-21snmpd19:33:501
100379943,0cyclictest3514-21snmpd19:22:501
100379943,0cyclictest3241-21irqbalance22:54:371
100379943,0cyclictest3241-21irqbalance21:41:281
100379943,0cyclictest31053-21awk19:09:161
100379943,0cyclictest25958-21awk21:24:151
100379943,0cyclictest24295-21awk23:44:141
100369943,0cyclictest9814-21awk21:14:140
100369943,0cyclictest8630-21awk22:54:130
100369943,0cyclictest8430-21sadc21:34:000
100369943,0cyclictest3556-21lldpd23:23:570
100369943,0cyclictest3556-21lldpd20:30:570
100369943,0cyclictest3556-21lldpd19:46:270
100369943,0cyclictest3556-21lldpd19:04:570
100369943,0cyclictest3514-21snmpd20:07:500
100369943,0cyclictest3241-21irqbalance23:24:170
100369943,0cyclictest32114-21awk19:34:170
100369943,0cyclictest27233-21sadc20:44:000
100369943,0cyclictest1818-21awk23:54:090
100369940,0cyclictest20201-21diskstats20:14:120
100369940,0cyclictest0-21swapper/022:18:590
100369940,0cyclictest0-21swapper/021:41:330
4130,0ktimersoftd/032470-21runrttasks22:09:050
29725030,0irq/27-eth0-tx-0-21swapper/019:24:110
29715030,0irq/26-eth0-rx-0-21swapper/320:49:203
29715030,0irq/26-eth0-rx-0-21swapper/320:44:113
29715030,0irq/26-eth0-rx-0-21swapper/320:24:123
29715030,0irq/26-eth0-rx-0-21swapper/319:48:123
23547230,0sleep00-21swapper/022:43:400
179930,0migration/120879-21irqcore20:14:151
169930,0watchdog/17929-21runrttasks20:50:141
169930,0watchdog/10-21swapper/119:04:181
149930,0migration/07908-21sh21:53:060
149930,0migration/015846-21sh21:37:190
149930,0migration/011572-21runrttasks19:40:160
100389933,0cyclictest3556-21lldpd20:00:562
100389933,0cyclictest3556-21lldpd19:26:272
100389932,0cyclictest3533-21grep20:49:182
100389932,0cyclictest27323-21awk20:19:142
100389932,0cyclictest19713-21awk19:49:172
100389932,0cyclictest17915-21irqcore18:59:172
100389932,0cyclictest12131-21awk19:19:142
100389932,0cyclictest1097-21entropy20:24:132
100379932,0cyclictest8532-21awk23:14:141
100379932,0cyclictest6431-21sensors20:24:221
100379930,0cyclictest23010-21cut19:24:171
100369932,0cyclictest9552-21kthreadcore23:14:150
100369932,0cyclictest6559-21runrttasks23:49:590
100369932,0cyclictest3556-21lldpd23:59:270
100369932,0cyclictest3514-21snmpd21:59:200
100369932,0cyclictest3514-21snmpd19:29:500
100369932,0cyclictest27601-21grep00:09:160
100369932,0cyclictest26183-21irqrtprio21:24:160
100369932,0cyclictest25713-21tr22:44:160
100369932,0cyclictest15980-21sort22:59:100
100369930,0cyclictest25273-21df_inode21:04:120
100369930,0cyclictest25273-21df_inode21:04:120
339920,0migration/37502-21iostat_ios20:04:183
29715020,0irq/26-eth0-rx-0-21swapper/320:09:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional