You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-13 - 07:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sun Sep 13, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
592328279,0sleep10-21swapper/118:41:161
304450460,0irq/25-eth10-21swapper/318:40:443
597824024,0sleep20-21swapper/218:41:532
583023322,0sleep00-21swapper/018:40:110
62519965,0cyclictest4612-21cut20:19:222
62469960,0cyclictest0-21swapper/123:16:261
62459960,0cyclictest0-21swapper/000:08:010
339960,0migration/39906-21sh22:06:243
339960,0migration/33784-21sh21:23:483
339960,0migration/325894-21sh22:16:353
339960,0migration/319762-21sh21:33:593
339960,0migration/315821-21sh23:53:073
29715060,0irq/26-eth0-rx-30549-21kthreadcore19:49:233
29715060,0irq/26-eth0-rx-26732-21irqstats23:19:203
149960,0migration/018122-21sh22:33:450
149960,0migration/015468-21kthreadcore19:14:210
62519955,0cyclictest5395-21kthreadcore23:24:232
62519954,0cyclictest3556-21lldpd20:29:152
62519954,0cyclictest26551-21ssh21:57:032
62469955,0cyclictest0-21swapper/123:51:261
62469955,0cyclictest0-21swapper/122:21:251
62469955,0cyclictest0-21swapper/122:10:131
62469955,0cyclictest0-21swapper/121:30:481
62459955,0cyclictest0-21swapper/023:48:470
62459950,0cyclictest0-21swapper/022:24:350
62459950,0cyclictest0-21swapper/021:42:110
62459950,0cyclictest0-21swapper/021:21:310
62459950,0cyclictest0-21swapper/000:11:380
339950,0migration/39147-21munin-node23:29:173
339950,0migration/38065-21kthreadcore21:44:223
339950,0migration/36974-21kthreadcore20:44:223
339950,0migration/36128-21kthreadcore23:04:203
339950,0migration/35150-21kthreadcore22:24:273
339950,0migration/33255-21irqrtprio22:44:223
339950,0migration/332406-21munin-node22:39:273
339950,0migration/330404-21munin-node23:39:243
339950,0migration/327344-21if_eth018:59:223
339950,0migration/326259-21taskset21:34:323
339950,0migration/32576-21aten_r1power_en19:54:173
339950,0migration/32413-21kthreadcore00:04:263
339950,0migration/323937-21kthreadcore19:19:243
339950,0migration/323545-21taskset23:57:283
339950,0migration/323121-21sh23:34:493
339950,0migration/321609-21taskset19:44:073
339950,0migration/321379-21munin-node20:04:253
339950,0migration/320578-21latency_hist20:54:043
339950,0migration/318998-21kthreadcore20:29:223
339950,0migration/315146-21timerwakeupswit19:59:293
339950,0migration/314767-21kthreadcore23:09:213
339950,0migration/313366-21fschecks_time21:09:193
339950,0migration/312572-21kthreadcore22:09:223
339950,0migration/310213-21latency_hist20:24:043
29725050,0irq/27-eth0-tx-4585-21munin-node20:44:170
29725050,0irq/27-eth0-tx-4338-21diskmemload23:43:102
29725050,0irq/27-eth0-tx-0-21swapper/222:47:552
29725050,0irq/27-eth0-tx-0-21swapper/221:19:232
29715050,0irq/26-eth0-rx-6282-21kthreadcore21:24:213
29715050,0irq/26-eth0-rx-26752-21hwlatdetect22:59:173
29715050,0irq/26-eth0-rx-24451-21sh23:59:153
29715050,0irq/26-eth0-rx-20394-21munin-node21:54:183
29715050,0irq/26-eth0-rx-18774-21python18:49:283
29715050,0irq/26-eth0-rx-15420-21latency22:49:233
29715050,0irq/26-eth0-rx-10834-21ssh21:04:353
29715050,0irq/26-eth0-rx-0-21swapper/323:24:103
29715050,0irq/26-eth0-rx-0-21swapper/322:54:203
29715050,0irq/26-eth0-rx-0-21swapper/322:33:113
29715050,0irq/26-eth0-rx-0-21swapper/322:21:483
29715050,0irq/26-eth0-rx-0-21swapper/322:01:373
29715050,0irq/26-eth0-rx-0-21swapper/321:49:173
29715050,0irq/26-eth0-rx-0-21swapper/321:15:033
29715050,0irq/26-eth0-rx-0-21swapper/321:04:043
29715050,0irq/26-eth0-rx-0-21swapper/320:57:493
29715050,0irq/26-eth0-rx-0-21swapper/320:19:203
249950,0watchdog/220026-21kthreadcore23:34:222
179950,0migration/13758-21kthreadcore00:04:261
179950,0migration/128798-21munin-node21:19:171
179950,0migration/127423-21kthreadcore22:59:201
179950,0migration/121946-21munin-node23:54:241
179950,0migration/114640-21kthreadcore21:09:231
179950,0migration/113365-21missed_timers00:09:231
169950,0watchdog/126288-21grep20:09:231
169950,0watchdog/114398-21cut20:49:231
169950,0watchdog/111810-21ssh20:47:471
149950,0migration/08148-21pmu-power19:54:260
149950,0migration/05126-21kthreadcore23:24:230
149950,0migration/05069-21kthreadcore21:44:210
149950,0migration/04690-21kthreadcore23:04:200
149950,0migration/032347-21unixbench_multi18:59:300
149950,0migration/028548-21kthreadcore23:39:220
149950,0migration/025916-21sh22:38:100
149950,0migration/025839-21latency_hist22:59:040
149950,0migration/024920-21fschecks_time23:59:170
149950,0migration/024632-21sh23:17:310
149950,0migration/019738-21latency_hist18:54:050
149950,0migration/017127-21munin-node21:49:240
149950,0migration/014894-21kthreadcore21:29:210
149950,0migration/013238-21timerwakeupswit19:09:260
149950,0migration/012494-21latency_hist20:49:040
149950,0migration/011965-21kthreadcore23:49:230
149950,0migration/011174-21aten2.4-expect22:09:170
149950,0migration/010863-21kthreadcore19:59:220
149950,0migration/010510-21kthreadcore18:44:240
149950,0migration/010181-21aten_r1power_po22:49:170
149950,0migration/010073-21kthreadcore19:34:190
8215040,0irq/24-0000:00:0-21swapper/221:34:272
62519944,0cyclictest0-21swapper/221:29:282
62519943,0cyclictest809-21awk00:04:242
62519943,0cyclictest3556-21lldpd22:54:462
62519943,0cyclictest3556-21lldpd20:24:452
62519943,0cyclictest3514-21snmpd23:59:162
62519943,0cyclictest3514-21snmpd23:49:312
62519943,0cyclictest3514-21snmpd23:20:152
62519943,0cyclictest3514-21snmpd22:19:152
62519943,0cyclictest3514-21snmpd19:58:432
62519943,0cyclictest3514-21snmpd19:04:122
62519943,0cyclictest3514-21snmpd18:54:122
62519943,0cyclictest3514-21snmpd18:44:122
62519943,0cyclictest3241-21irqbalance23:09:122
62519943,0cyclictest3241-21irqbalance22:24:122
62519943,0cyclictest3241-21irqbalance20:44:132
62519943,0cyclictest3241-21irqbalance20:34:132
62519943,0cyclictest3241-21irqbalance20:04:132
62519943,0cyclictest3241-21irqbalance19:49:132
62519943,0cyclictest3241-21irqbalance19:34:232
62519943,0cyclictest3241-21irqbalance19:29:332
62519943,0cyclictest3241-21irqbalance19:24:132
62519943,0cyclictest3241-21irqbalance19:19:432
62519943,0cyclictest3241-21irqbalance19:14:132
62519943,0cyclictest3241-21irqbalance19:10:332
62519943,0cyclictest30134-21awk20:14:172
62519943,0cyclictest28989-21awk21:39:192
62519943,0cyclictest2402-21awk23:04:172
62519943,0cyclictest22599-21awk19:44:202
62519943,0cyclictest15860-21awk19:39:202
62469944,0cyclictest0-21swapper/123:10:171
62469944,0cyclictest0-21swapper/122:25:211
62469944,0cyclictest0-21swapper/121:39:291
62469943,0cyclictest5462-21awk21:04:221
62469943,0cyclictest3556-21lldpd23:59:161
62469943,0cyclictest3556-21lldpd23:44:151
62469943,0cyclictest3556-21lldpd22:39:161
62469943,0cyclictest3556-21lldpd22:04:141
62469943,0cyclictest3556-21lldpd21:59:141
62469943,0cyclictest3556-21lldpd21:38:451
62469943,0cyclictest3556-21lldpd20:23:141
62469943,0cyclictest3556-21lldpd18:46:451
62469943,0cyclictest3241-21irqbalance22:49:521
62469943,0cyclictest3019-21awk22:44:211
62469943,0cyclictest29734-21awk20:59:181
62469943,0cyclictest23350-21sadc20:34:041
62469943,0cyclictest21670-21awk20:54:201
62469943,0cyclictest20513-21awk21:54:191
62469943,0cyclictest19912-21awk22:14:191
62469943,0cyclictest12550-21awk21:49:201
62469943,0cyclictest11562-21awk22:29:231
62459944,0cyclictest0-21swapper/021:59:120
62459944,0cyclictest0-21swapper/021:14:160
62459943,0cyclictest4946-21kworker/0:023:32:270
62459943,0cyclictest3556-21lldpd22:19:150
62459943,0cyclictest3514-21snmpd23:21:450
62459943,0cyclictest29112-21awk19:49:200
62459943,0cyclictest17880-21awk23:34:200
62459943,0cyclictest15972-21awk19:39:200
4140,0ktimersoftd/00-21swapper/021:12:040
339940,0migration/328902-21runrttasks20:12:513
339940,0migration/319711-21kthreadcore23:14:203
339940,0migration/31871-21cpuspeed_turbos19:29:193
339940,0migration/311366-21kthreadcore00:09:223
29725040,0irq/27-eth0-tx-9588-21ssh22:05:262
29725040,0irq/27-eth0-tx-7917-21ssh00:09:082
29725040,0irq/27-eth0-tx-3514-21snmpd20:49:052
29725040,0irq/27-eth0-tx-16421-21munin-node23:54:182
29725040,0irq/27-eth0-tx-13722-21kthreadcore23:29:232
29725040,0irq/27-eth0-tx-0-21swapper/223:44:052
29725040,0irq/27-eth0-tx-0-21swapper/222:39:152
29725040,0irq/27-eth0-tx-0-21swapper/222:29:252
29725040,0irq/27-eth0-tx-0-21swapper/222:14:152
29725040,0irq/27-eth0-tx-0-21swapper/221:15:052
29725040,0irq/27-eth0-tx-0-21swapper/221:09:212
29725040,0irq/27-eth0-tx-0-21swapper/221:04:252
29725040,0irq/27-eth0-tx-0-21swapper/020:39:220
29725040,0irq/27-eth0-tx-0-21swapper/020:36:170
29725040,0irq/27-eth0-tx-0-21swapper/020:29:160
29725040,0irq/27-eth0-tx-0-21swapper/020:20:520
29725040,0irq/27-eth0-tx-0-21swapper/019:25:070
29725040,0irq/27-eth0-tx-0-21swapper/019:04:170
29715040,0irq/26-eth0-rx-20309-21grep22:34:213
29715040,0irq/26-eth0-rx-0-21swapper/323:44:533
29715040,0irq/26-eth0-rx-0-21swapper/321:41:273
29715040,0irq/26-eth0-rx-0-21swapper/319:24:553
29715040,0irq/26-eth0-rx-0-21swapper/319:04:233
27044244,0sleep031913-21kworker/0:219:23:260
259940,0migration/23861-21cpuspeed_turbos21:44:172
259940,0migration/2319-21kthreadcore21:59:212
259940,0migration/227347-21munin-node18:59:222
259940,0migration/226785-21idleruntime22:59:172
259940,0migration/222862-21cpuspeed_turbos20:09:182
259940,0migration/218319-21idleruntime23:14:172
259940,0migration/213666-21fschecks_count18:49:192
259940,0migration/211383-21kthreadcore19:59:232
259940,0migration/210293-21munin-node21:24:282
249940,0watchdog/230912-21perl20:39:192
249940,0watchdog/229807-21iostat_ios20:59:192
249940,0watchdog/221505-21fschecks_time20:54:192
249940,0watchdog/213440-21kthreadcore22:09:222
249940,0watchdog/212388-21smartctl21:49:182
249940,0watchdog/20-21swapper/222:49:142
249940,0watchdog/20-21swapper/222:34:502
179940,0migration/17180-21kthreadcore21:24:211
179940,0migration/1588-21runrttasks19:04:081
179940,0migration/14284-21fschecks_time21:44:181
179940,0migration/131746-21taskset23:20:031
179940,0migration/12808-21kthreadcore23:24:231
179940,0migration/127799-21kthreadcore23:39:211
179940,0migration/125245-21kthreadcore20:34:221
179940,0migration/125052-21kthreadcore21:14:201
179940,0migration/124040-21kthreadcore19:44:221
179940,0migration/12214-21gltestperf23:04:161
179940,0migration/121417-21gltestperf19:19:201
179940,0migration/118659-21kthreadcore23:34:211
179940,0migration/116832-21kthreadcore19:39:221
179940,0migration/114436-21kthreadcore20:24:221
179940,0migration/113963-21sendmail_mailst19:34:241
179940,0migration/111460-21kthreadcore19:59:231
179940,0migration/11133-21latency19:49:241
169940,0watchdog/16559-21runrttasks22:54:061
169940,0watchdog/15273-21cut19:54:231
169940,0watchdog/12595-21iostat19:29:231
169940,0watchdog/125739-21unixbench_singl18:54:311
169940,0watchdog/124319-21ssh22:34:261
169940,0watchdog/12332-21kthreadcore20:39:231
169940,0watchdog/117778-21cut18:49:231
169940,0watchdog/111007-21grep23:29:221
169940,0watchdog/10-21swapper/120:14:191
169940,0watchdog/10-21swapper/120:04:231
149940,0migration/06935-21kthreadcore21:24:210
149940,0migration/031647-21kthreadcore20:59:200
149940,0migration/030962-21kthreadcore22:39:220
149940,0migration/026737-21kthreadcore19:44:230
149940,0migration/025910-21sh22:16:390
149940,0migration/020788-21kthreadcore20:04:230
149940,0migration/019292-21kthreadcore23:54:220
149940,0migration/010157-21sh22:07:070
62469932,0cyclictest530-21sensors19:24:271
62469932,0cyclictest3556-21lldpd19:09:151
62459933,0cyclictest4946-21kworker/0:023:09:050
62459933,0cyclictest4946-21kworker/0:022:54:110
62459933,0cyclictest4946-21kworker/0:022:44:110
62459933,0cyclictest4946-21kworker/0:021:34:060
62459933,0cyclictest31913-21kworker/0:221:04:060
62459933,0cyclictest31913-21kworker/0:220:54:180
62459933,0cyclictest31913-21kworker/0:220:24:160
62459933,0cyclictest31913-21kworker/0:220:14:060
62459933,0cyclictest31913-21kworker/0:220:09:060
62459933,0cyclictest31913-21kworker/0:219:29:140
62459933,0cyclictest19538-21munin-node21:54:220
62459932,0cyclictest14016-21awk18:49:200
29715030,0irq/26-eth0-rx-0-21swapper/320:34:183
29715030,0irq/26-eth0-rx-0-21swapper/320:14:133
29715030,0irq/26-eth0-rx-0-21swapper/319:40:283
29715030,0irq/26-eth0-rx-0-21swapper/319:34:143
29715030,0irq/26-eth0-rx-0-21swapper/319:14:163
29715030,0irq/26-eth0-rx-0-21swapper/319:11:493
29715030,0irq/26-eth0-rx-0-21swapper/318:58:003
29715030,0irq/26-eth0-rx-0-21swapper/318:44:183
169930,0watchdog/10-21swapper/119:14:271
169930,0watchdog/10-21swapper/118:59:191
29715020,0irq/26-eth0-rx-0-21swapper/320:39:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional