You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-14 - 02:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Mon Sep 14, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1922423625,0sleep00-21swapper/018:41:070
304450340,0irq/25-eth10-21swapper/318:39:133
1929422824,0sleep10-21swapper/118:42:001
1935522622,0sleep20-21swapper/218:42:412
35160,0ktimersoftd/30-21swapper/321:39:213
339960,0migration/36262-21munin-node23:59:133
339960,0migration/330120-21munin-node22:29:213
339960,0migration/322354-21taskset19:56:483
339960,0migration/313184-21munin-node22:39:193
29715060,0irq/26-eth0-rx-23241-21unixbench_multi21:44:203
29715060,0irq/26-eth0-rx-14501-21perl23:44:153
195379960,0cyclictest0-21swapper/223:28:542
195379960,0cyclictest0-21swapper/221:08:162
195379960,0cyclictest0-21swapper/220:58:202
8215050,0irq/24-0000:00:29955-21latency_hist23:33:582
8215050,0irq/24-0000:00:29955-21latency_hist23:33:582
4150,0ktimersoftd/00-21swapper/021:56:450
35150,0ktimersoftd/30-21swapper/321:54:093
339950,0migration/37524-21switchtime19:19:223
339950,0migration/37514-21kthreadcore20:34:163
339950,0migration/35337-21taskset23:16:323
339950,0migration/328754-21kthreadcore22:09:173
339950,0migration/327973-21munin-node19:14:143
339950,0migration/327830-21kthreadcore21:09:153
339950,0migration/327317-21irqcore20:49:163
339950,0migration/327175-21munin-node23:49:173
339950,0migration/323325-21irqcore23:29:123
339950,0migration/323325-21irqcore23:29:123
339950,0migration/322991-21aten_r1power_po23:09:093
339950,0migration/322370-21munin-node00:09:163
339950,0migration/321839-21kthreadcore21:04:163
339950,0migration/320898-21aten_r1power_vo19:09:103
339950,0migration/320527-21munin-node23:04:183
339950,0migration/31150-21kthreadcore22:34:163
339950,0migration/311492-21kthreadcore20:59:153
339950,0migration/310061-21fschecks_time19:49:143
29725050,0irq/27-eth0-tx-9773-21interrupts21:59:142
29725050,0irq/27-eth0-tx-6435-21munin-node23:19:142
29725050,0irq/27-eth0-tx-30254-21munin-node23:34:162
29725050,0irq/27-eth0-tx-27097-21tr21:29:162
29725050,0irq/27-eth0-tx-16141-21munin-node22:24:132
29725050,0irq/27-eth0-tx-0-21swapper/019:44:130
29715050,0irq/26-eth0-rx-5156-21kthreadcore22:14:193
29715050,0irq/26-eth0-rx-25200-21sh21:28:183
29715050,0irq/26-eth0-rx-14678-21df23:24:093
29715050,0irq/26-eth0-rx-14270-21ntp_kernel_pll_21:59:193
29715050,0irq/26-eth0-rx-12520-21ntp_kernel_err22:59:183
29715050,0irq/26-eth0-rx-1245-21kthreadcore22:54:153
29715050,0irq/26-eth0-rx-0-21swapper/323:35:083
29715050,0irq/26-eth0-rx-0-21swapper/322:51:413
29715050,0irq/26-eth0-rx-0-21swapper/322:24:143
29715050,0irq/26-eth0-rx-0-21swapper/321:36:583
29715050,0irq/26-eth0-rx-0-21swapper/321:29:113
29715050,0irq/26-eth0-rx-0-21swapper/321:18:593
29715050,0irq/26-eth0-rx-0-21swapper/321:14:103
29715050,0irq/26-eth0-rx-0-21swapper/320:24:203
29715050,0irq/26-eth0-rx-0-21swapper/320:14:153
29715050,0irq/26-eth0-rx-0-21swapper/318:49:133
259950,0migration/26281-21kthreadcore20:34:152
259950,0migration/23863-21kthreadcore21:34:162
259950,0migration/211528-21kthreadcore18:59:152
195379955,0cyclictest0-21swapper/220:04:152
195379955,0cyclictest0-21swapper/218:54:252
195379950,0cyclictest0-21swapper/222:16:322
195379950,0cyclictest0-21swapper/220:46:402
195379950,0cyclictest0-21swapper/200:00:262
195359950,0cyclictest17882-21diskmemload20:51:531
195349955,0cyclictest0-21swapper/023:54:310
195349955,0cyclictest0-21swapper/022:37:350
195349955,0cyclictest0-21swapper/021:50:260
195349955,0cyclictest0-21swapper/021:23:480
195349950,0cyclictest0-21swapper/023:53:060
195349950,0cyclictest0-21swapper/023:39:130
195349950,0cyclictest0-21swapper/023:19:500
195349950,0cyclictest0-21swapper/022:05:250
195349950,0cyclictest0-21swapper/021:45:520
195349950,0cyclictest0-21swapper/020:32:050
179950,0migration/17394-21latency_hist18:58:591
179950,0migration/132462-21latency_hist22:13:591
179950,0migration/130539-21timerwakeupswit22:09:231
179950,0migration/126660-21munin-node00:09:191
179950,0migration/123731-21latency_hist20:23:591
179950,0migration/117369-21fschecks_time22:04:161
179950,0migration/110087-21cpuspeed_turbos21:19:111
16843250,0sleep317085-21diskstats22:04:163
169950,0watchdog/13481-21expr19:44:131
149950,0migration/05849-21kthreadcore20:09:140
149950,0migration/031218-21sh22:32:350
149950,0migration/014354-21aten_r1power_cu23:24:070
149950,0migration/012560-21irqcore20:39:140
8646240,0sleep00-21swapper/021:37:580
8215040,0irq/24-0000:00:0-21swapper/220:14:102
339940,0migration/329078-21fschecks_time19:39:133
339940,0migration/327506-21switchtime19:34:243
339940,0migration/322249-21kthreadcore20:44:173
339940,0migration/322239-21kthreadcore18:44:193
339940,0migration/319450-21kthreadcore20:19:173
339940,0migration/318923-21kthreadcore22:44:153
29725040,0irq/27-eth0-tx-8471-21ssh21:15:462
29725040,0irq/27-eth0-tx-4927-21telnet20:34:100
29725040,0irq/27-eth0-tx-28621-21ssh23:09:192
29725040,0irq/27-eth0-tx-0-21swapper/223:54:002
29725040,0irq/27-eth0-tx-0-21swapper/222:54:132
29725040,0irq/27-eth0-tx-0-21swapper/222:44:472
29725040,0irq/27-eth0-tx-0-21swapper/222:39:022
29725040,0irq/27-eth0-tx-0-21swapper/222:09:062
29725040,0irq/27-eth0-tx-0-21swapper/222:04:032
29725040,0irq/27-eth0-tx-0-21swapper/221:44:202
29725040,0irq/27-eth0-tx-0-21swapper/221:19:102
29725040,0irq/27-eth0-tx-0-21swapper/200:09:132
29725040,0irq/27-eth0-tx-0-21swapper/200:04:482
29725040,0irq/27-eth0-tx-0-21swapper/020:19:150
29715040,0irq/26-eth0-rx-0-21swapper/323:54:173
29715040,0irq/26-eth0-rx-0-21swapper/323:39:063
29715040,0irq/26-eth0-rx-0-21swapper/323:20:363
29715040,0irq/26-eth0-rx-0-21swapper/322:19:123
29715040,0irq/26-eth0-rx-0-21swapper/321:49:233
29715040,0irq/26-eth0-rx-0-21swapper/320:56:413
29715040,0irq/26-eth0-rx-0-21swapper/319:59:163
29715040,0irq/26-eth0-rx-0-21swapper/319:06:383
29715040,0irq/26-eth0-rx-0-21swapper/318:54:113
29715040,0irq/26-eth0-rx-0-21swapper/300:05:253
259940,0migration/231490-21sh20:29:152
259940,0migration/223400-21taskset22:49:002
259940,0migration/215117-21sendmail_mailst19:49:212
259940,0migration/214085-21timerandwakeup22:19:212
259940,0migration/213711-21latency_hist23:43:582
259940,0migration/210229-21if_eth121:39:162
249940,0watchdog/2651-21ssh21:54:092
249940,0watchdog/226590-21fschecks_count20:49:132
249940,0watchdog/225631-21tr20:24:172
249940,0watchdog/223070-21kthreadcore19:34:172
249940,0watchdog/222433-21perl23:49:122
249940,0watchdog/22159-21grep22:34:172
249940,0watchdog/219559-21kthreadcore20:19:172
249940,0watchdog/212127-21cut22:59:162
249940,0watchdog/20-21swapper/223:39:122
249940,0watchdog/20-21swapper/219:44:132
195379944,0cyclictest0-21swapper/220:39:062
195379943,0cyclictest3514-21snmpd20:11:212
195379943,0cyclictest3514-21snmpd19:42:512
195379943,0cyclictest3514-21snmpd19:31:062
195379943,0cyclictest3514-21snmpd18:44:222
195379943,0cyclictest3241-21irqbalance22:29:272
195379943,0cyclictest3241-21irqbalance21:24:072
195379943,0cyclictest31632-21awk23:14:132
195379943,0cyclictest27381-21awk18:49:142
195379943,0cyclictest27092-21awk21:09:122
195379943,0cyclictest2637-21awk19:19:152
195379943,0cyclictest26129-21awk21:49:142
195379943,0cyclictest15778-21awk23:04:132
195379943,0cyclictest11009-21awk20:59:132
195359944,0cyclictest0-21swapper/122:59:161
195359943,0cyclictest3514-21snmpd23:45:071
195359943,0cyclictest3514-21snmpd22:01:371
195359943,0cyclictest3514-21snmpd20:39:061
195359943,0cyclictest3514-21snmpd20:33:061
195359943,0cyclictest3514-21snmpd19:30:361
195359943,0cyclictest3514-21snmpd19:09:371
195359943,0cyclictest30347-21awk20:04:151
195359943,0cyclictest29367-21awk19:39:141
195359943,0cyclictest28270-21awk19:14:151
195359943,0cyclictest25368-21ps22:29:141
195359943,0cyclictest2528-21awk19:19:141
195359943,0cyclictest24307-21awk22:49:121
195359943,0cyclictest16376-21awk22:44:121
195359942,0cyclictest22674-21awk19:34:161
195349944,0cyclictest0-21swapper/022:24:580
195349944,0cyclictest0-21swapper/022:12:020
195349944,0cyclictest0-21swapper/021:28:410
195349944,0cyclictest0-21swapper/019:49:120
195349943,0cyclictest9748-21awk21:59:140
195349943,0cyclictest9285-21awk19:24:140
195349943,0cyclictest3556-21lldpd23:15:510
195349943,0cyclictest3556-21lldpd21:05:210
195349943,0cyclictest3556-21lldpd21:00:510
195349943,0cyclictest3556-21lldpd20:57:510
195349943,0cyclictest3556-21lldpd19:12:500
195349943,0cyclictest3514-21snmpd22:46:520
195349943,0cyclictest3514-21snmpd21:41:220
195349943,0cyclictest3241-21irqbalance23:44:160
195349943,0cyclictest3241-21irqbalance23:34:460
195349943,0cyclictest3241-21irqbalance23:30:260
195349943,0cyclictest3241-21irqbalance23:30:260
195349943,0cyclictest3241-21irqbalance23:04:370
195349943,0cyclictest3241-21irqbalance21:30:370
195349943,0cyclictest3241-21irqbalance20:50:470
195349943,0cyclictest3241-21irqbalance18:56:180
195349943,0cyclictest3241-21irqbalance00:10:060
195349943,0cyclictest29302-21awk19:39:140
195349943,0cyclictest27287-21awk18:49:130
195349940,0cyclictest20888-21idleruntime-cro00:08:570
179940,0migration/17286-21kthreadcore20:34:151
179940,0migration/17240-21hddtemp_smartct23:19:121
179940,0migration/131115-21munin-node21:29:171
179940,0migration/130500-21runrttasks23:54:121
179940,0migration/128958-21kthreadcore21:09:151
179940,0migration/128586-21timerandwakeup19:59:211
179940,0migration/128271-21kthreadcore18:49:151
179940,0migration/12730-21munin-node20:54:171
179940,0migration/123742-21kthreadcore18:44:191
179940,0migration/122494-21kthreadcore21:04:161
179940,0migration/118974-21kthreadcore20:19:171
179940,0migration/117601-21kthreadcore19:54:161
179940,0migration/117232-21kthreadcore23:24:141
179940,0migration/116265-21taskset20:59:351
179940,0migration/115154-21switchtime21:39:231
179940,0migration/110682-21kthreadcore19:24:161
169940,0watchdog/19851-21diskstats19:49:131
169940,0watchdog/19282-21cut23:39:161
169940,0watchdog/15255-21ssh23:38:001
169940,0watchdog/13514-21snmpd00:00:081
169940,0watchdog/131648-21ssh21:50:251
169940,0watchdog/125844-21cut23:49:161
169940,0watchdog/120715-21python23:04:201
169940,0watchdog/115781-21missed_timers20:14:171
169940,0watchdog/114752-21perl19:04:131
169940,0watchdog/111204-21kthreadcore22:39:161
169940,0watchdog/10-21swapper/123:33:361
169940,0watchdog/10-21swapper/123:33:361
169940,0watchdog/10-21swapper/122:24:091
169940,0watchdog/10-21swapper/122:19:411
169940,0watchdog/10-21swapper/121:34:171
169940,0watchdog/10-21swapper/121:24:171
149940,0migration/07647-21cpuspeed_turbos18:59:100
149940,0migration/07145-21aten_r1power_vo22:59:100
149940,0migration/04692-21kthreadcore19:19:170
149940,0migration/031470-21aten_r1power_fr22:54:100
149940,0migration/028891-21kthreadcore21:09:150
149940,0migration/027469-21kthreadcore23:09:150
149940,0migration/026710-21kthreadcore19:59:160
149940,0migration/024407-21kthreadcore19:34:180
149940,0migration/024128-21kthreadcore18:44:190
149940,0migration/022034-21kthreadcore20:44:160
149940,0migration/015837-21kthreadcore19:04:170
149940,0migration/014392-21sh22:19:310
8215030,0irq/24-0000:00:0-21swapper/219:59:122
29725030,0irq/27-eth0-tx-0-21swapper/020:14:200
29715030,0irq/26-eth0-rx-7503-21aten2.4-expect18:59:103
29715030,0irq/26-eth0-rx-0-21swapper/320:43:173
29715030,0irq/26-eth0-rx-0-21swapper/320:29:103
29715030,0irq/26-eth0-rx-0-21swapper/320:09:083
29715030,0irq/26-eth0-rx-0-21swapper/319:30:463
259930,0migration/28437-21runrttasks19:24:022
249930,0watchdog/218393-21kthreadcore19:04:172
249930,0watchdog/20-21swapper/219:14:132
249930,0watchdog/20-21swapper/219:09:132
195379932,0cyclictest17059-21awk19:54:142
195359933,0cyclictest2721-21awk21:14:141
195359932,0cyclictest3514-21snmpd20:10:061
195359932,0cyclictest32238-21awk22:54:131
195359932,0cyclictest28606-21sensors23:09:191
195359932,0cyclictest19809-21grep21:44:141
195359932,0cyclictest1555-21awk21:54:131
195359932,0cyclictest14194-21awk00:04:141
195359930,0cyclictest18530-21diskstats20:44:121
195349933,0cyclictest0-21swapper/020:04:110
195349933,0cyclictest0-21swapper/019:30:550
195349932,0cyclictest7993-21vmstat21:14:220
195349932,0cyclictest6043-21wc23:59:110
195349932,0cyclictest3556-21lldpd22:39:510
195349932,0cyclictest3241-21irqbalance20:24:070
195349932,0cyclictest30359-21grep19:14:170
195349932,0cyclictest24456-21awk22:49:130
195349932,0cyclictest17084-21awk19:54:140
195349931,0cyclictest564-21fschecks_count22:14:140
169930,0watchdog/130729-21sh23:14:001
169930,0watchdog/10-21swapper/122:34:171
169930,0watchdog/10-21swapper/118:54:171
29715020,0irq/26-eth0-rx-0-21swapper/320:04:043
29715020,0irq/26-eth0-rx-0-21swapper/319:44:103
29715020,0irq/26-eth0-rx-0-21swapper/319:24:103
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional