You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-24 - 21:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sun May 24, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450560,0irq/25-eth10-21swapper/306:52:093
2217224231,0sleep00-21swapper/006:51:420
2208924230,0sleep10-21swapper/106:50:431
2210023228,0sleep20-21swapper/206:50:522
225069975,0cyclictest0-21swapper/212:07:232
225069973,0cyclictest3514-21snmpd08:49:582
225069973,0cyclictest28596-21awk11:59:562
225069973,0cyclictest21413-21awk10:54:562
225069973,0cyclictest21139-21awk11:14:572
225069972,0cyclictest5392-21munin-node09:24:582
225069972,0cyclictest25506-21awk07:44:582
225069972,0cyclictest14551-21grep09:49:582
225069972,0cyclictest11112-21latency_hist07:34:422
35160,0ktimersoftd/30-21swapper/311:45:353
339960,0migration/326842-21sh11:16:273
339960,0migration/320037-21ksmtuned10:12:363
339960,0migration/31906-21sh12:21:393
339960,0migration/312776-21sh09:49:113
339960,0migration/312192-21sh09:26:563
29715060,0irq/26-eth0-rx-19989-21entropy12:14:543
29715060,0irq/26-eth0-rx-14065-21idleruntime09:49:563
29715060,0irq/26-eth0-rx-12353-21perl11:49:553
29715060,0irq/26-eth0-rx-10029-21ntp_states10:45:043
225069962,0cyclictest4582-21awk07:04:572
225069962,0cyclictest16797-21kthreadcore08:00:012
225069962,0cyclictest13992-21awk10:09:572
225069962,0cyclictest13454-21stty09:29:522
225069962,0cyclictest0-21swapper/211:41:162
225069962,0cyclictest0-21swapper/211:10:542
225069962,0cyclictest0-21swapper/210:40:472
225069962,0cyclictest0-21swapper/210:04:462
225069962,0cyclictest0-21swapper/208:55:482
225069961,0cyclictest27435-21sh10:36:322
225069961,0cyclictest23692-21awk06:54:562
225069961,0cyclictest21981-21awk10:14:572
225069961,0cyclictest19092-21kthreadcore07:14:592
225069961,0cyclictest11222-21awk07:09:572
225069960,0cyclictest8936-21kthreadcore10:45:022
225069960,0cyclictest5190-21irqstats11:24:572
225069960,0cyclictest4679-21latency_hist09:04:422
225069960,0cyclictest32250-21latency_hist08:14:422
225069960,0cyclictest29726-21munin-node09:19:562
225069960,0cyclictest29472-21if_eth110:59:572
225069960,0cyclictest29091-21telnet08:59:532
225069960,0cyclictest27298-21ssh09:15:042
225069960,0cyclictest26167-21cut09:54:592
225069960,0cyclictest17994-21ssh12:10:582
225069960,0cyclictest17247-21ntpdc11:50:012
225069960,0cyclictest11945-21munin-node11:30:042
225069960,0cyclictest0-21swapper/212:17:532
225069960,0cyclictest0-21swapper/211:54:582
225069960,0cyclictest0-21swapper/211:44:542
225069960,0cyclictest0-21swapper/211:24:422
225069960,0cyclictest0-21swapper/210:53:262
225069960,0cyclictest0-21swapper/210:33:142
225069960,0cyclictest0-21swapper/209:46:352
225069960,0cyclictest0-21swapper/209:39:572
225069960,0cyclictest0-21swapper/209:35:422
225069960,0cyclictest0-21swapper/209:10:012
225039966,0cyclictest0-21swapper/012:00:020
149960,0migration/04804-21sh09:44:310
149960,0migration/027224-21sh11:17:340
149960,0migration/018583-21fschecks_time07:39:570
339950,0migration/35133-21kthreadcore08:40:013
339950,0migration/332483-21cpu08:14:523
339950,0migration/33155-21runrttasks11:44:223
339950,0migration/330052-21gltestperf09:59:553
339950,0migration/329473-21sh09:39:533
339950,0migration/329021-21missed_timers07:20:013
339950,0migration/328773-21runrttasks10:39:463
339950,0migration/328207-21fschecks_count11:59:553
339950,0migration/321052-21aten_r1power_po08:54:533
339950,0migration/316788-21munin-node07:35:033
339950,0migration/314995-21kthreadcore11:10:003
339950,0migration/313218-21sh09:09:523
339950,0migration/313180-21taskset07:59:583
29725050,0irq/27-eth0-tx-5614-21munin-node07:55:020
29725050,0irq/27-eth0-tx-3693-21munin-node07:05:020
29725050,0irq/27-eth0-tx-31305-21munin-node07:50:050
29725050,0irq/27-eth0-tx-22823-21kthreadcore08:05:000
29725050,0irq/27-eth0-tx-0-21swapper/006:55:040
29715050,0irq/26-eth0-rx-6861-21kthreadcore11:24:583
29715050,0irq/26-eth0-rx-5438-21fschecks_count10:04:553
29715050,0irq/26-eth0-rx-4996-21expr10:24:543
29715050,0irq/26-eth0-rx-4814-21cut11:04:553
29715050,0irq/26-eth0-rx-31982-21kthreadcore10:59:593
29715050,0irq/26-eth0-rx-29709-21fschecks_time10:19:563
29715050,0irq/26-eth0-rx-21818-21kthreadcore10:54:583
29715050,0irq/26-eth0-rx-20991-21grep10:34:543
29715050,0irq/26-eth0-rx-19153-21rt-features09:30:023
29715050,0irq/26-eth0-rx-16961-21tr10:30:003
29715050,0irq/26-eth0-rx-0-21swapper/312:14:313
29715050,0irq/26-eth0-rx-0-21swapper/311:56:553
29715050,0irq/26-eth0-rx-0-21swapper/311:37:453
29715050,0irq/26-eth0-rx-0-21swapper/309:19:553
29715050,0irq/26-eth0-rx-0-21swapper/309:08:243
29715050,0irq/26-eth0-rx-0-21swapper/309:04:233
225069951,0cyclictest8321-21tail08:44:582
225069951,0cyclictest7990-21kthreadcore08:19:592
225069951,0cyclictest7119-21cut07:54:592
225069951,0cyclictest4782-21sh07:29:542
225069951,0cyclictest31135-21hwlatdetect07:24:572
225069951,0cyclictest29419-21telnet09:59:532
225069951,0cyclictest29161-21latency_hist06:59:432
225069951,0cyclictest27051-21fschecks_count08:34:562
225069951,0cyclictest26930-21kernelversion08:10:002
225069951,0cyclictest23694-21seq07:19:512
225069951,0cyclictest14077-21sh08:24:562
225069951,0cyclictest0-21swapper/208:40:012
225069950,0cyclictest4957-21cpuspeed_turbos10:24:542
225069950,0cyclictest4186-21munin-node11:04:532
225069950,0cyclictest31395-21aten2.4-expect07:49:542
225069950,0cyclictest21778-21kthreadcore11:34:592
225069950,0cyclictest19838-21munin-node08:04:572
225069950,0cyclictest0-21swapper/212:19:532
225069950,0cyclictest0-21swapper/210:19:422
225069950,0cyclictest0-21swapper/208:29:532
225069950,0cyclictest0-21swapper/207:39:592
225049955,0cyclictest20707-21diskmemload11:24:471
225049955,0cyclictest20707-21diskmemload10:50:531
225049955,0cyclictest0-21swapper/110:15:051
225049955,0cyclictest0-21swapper/107:29:421
225039955,0cyclictest2796-21kworker/0:207:21:260
225039955,0cyclictest20707-21diskmemload11:43:290
225039955,0cyclictest0-21swapper/010:21:400
225039955,0cyclictest0-21swapper/009:06:090
225039950,0cyclictest0-21swapper/009:17:490
225039950,0cyclictest0-21swapper/009:11:590
179950,0migration/15435-21aten_r1power_en09:24:531
179950,0migration/15130-21sh11:04:571
179950,0migration/14343-21latency_hist10:44:421
179950,0migration/13921-21cpu07:04:541
179950,0migration/129310-21munin-node10:19:541
179950,0migration/128863-21sh11:39:571
179950,0migration/126380-21taskset11:36:041
179950,0migration/120960-21taskset09:54:371
179950,0migration/119838-21aten_r1power_po11:54:531
179950,0migration/118761-21munin-node08:25:011
179950,0migration/118414-21taskset11:10:161
179950,0migration/11716-21kthreadcore09:20:001
179950,0migration/114049-21kthreadcore08:00:001
149950,0migration/09321-21kthreadcore11:05:000
149950,0migration/09207-21ntp_kernel_pll_11:45:040
149950,0migration/08905-21kthreadcore10:24:590
149950,0migration/0848-21kthreadcore07:25:000
149950,0migration/07890-21munin-node08:19:580
149950,0migration/07048-21taskset08:41:110
149950,0migration/02691-21unixbench_multi09:00:060
149950,0migration/026642-21kthreadcore07:45:000
149950,0migration/026206-21fschecks_time08:09:570
149950,0migration/025592-21munin-node08:30:030
149950,0migration/023152-21kthreadcore08:54:590
149950,0migration/016944-21kthreadcore10:50:000
149950,0migration/016101-21kthreadcore09:49:590
149950,0migration/012235-21kthreadcore08:45:020
149950,0migration/010930-21taskset07:32:420
339940,0migration/329906-21kthreadcore08:10:013
339940,0migration/320546-21fschecks_time08:29:553
339940,0migration/319708-21gltestperf08:04:563
339940,0migration/31602-21taskset11:20:033
339940,0migration/310783-21kthreadcore08:45:013
29725040,0irq/27-eth0-tx-0-21swapper/007:00:020
29715040,0irq/26-eth0-rx-0-21swapper/312:04:533
29715040,0irq/26-eth0-rx-0-21swapper/311:30:333
29715040,0irq/26-eth0-rx-0-21swapper/310:50:003
29715040,0irq/26-eth0-rx-0-21swapper/310:14:553
29715040,0irq/26-eth0-rx-0-21swapper/309:54:583
29715040,0irq/26-eth0-rx-0-21swapper/309:36:523
29715040,0irq/26-eth0-rx-0-21swapper/309:15:093
29715040,0irq/26-eth0-rx-0-21swapper/308:24:533
29715040,0irq/26-eth0-rx-0-21swapper/307:30:033
29715040,0irq/26-eth0-rx-0-21swapper/306:54:523
225049944,0cyclictest20707-21diskmemload11:04:361
225049944,0cyclictest0-21swapper/107:45:001
225049943,0cyclictest3556-21lldpd10:55:181
225049943,0cyclictest3556-21lldpd10:40:181
225049943,0cyclictest3556-21lldpd08:19:481
225049943,0cyclictest3241-21irqbalance10:06:111
225049943,0cyclictest29965-21awk08:59:571
225049943,0cyclictest29106-21awk11:19:551
225049943,0cyclictest22170-21awk09:54:561
225049943,0cyclictest1700-21awk08:39:581
225049943,0cyclictest12640-21awk11:49:571
225049940,0cyclictest0-21swapper/109:14:521
225039944,0cyclictest0-21swapper/010:45:190
225039944,0cyclictest0-21swapper/007:38:390
225039943,0cyclictest6362-21awk09:24:570
225039943,0cyclictest5840-21awk10:04:570
225039943,0cyclictest3556-21lldpd12:19:470
225039943,0cyclictest3556-21lldpd11:55:470
225039943,0cyclictest3556-21lldpd11:37:180
225039943,0cyclictest3556-21lldpd11:32:480
225039943,0cyclictest3556-21lldpd11:28:480
225039943,0cyclictest3556-21lldpd11:19:480
225039943,0cyclictest3556-21lldpd11:14:170
225039943,0cyclictest3556-21lldpd10:41:480
225039943,0cyclictest3556-21lldpd10:31:480
225039943,0cyclictest3556-21lldpd10:19:180
225039943,0cyclictest3556-21lldpd08:36:170
225039943,0cyclictest21488-21awk10:54:570
225039943,0cyclictest20578-21awk12:14:560
225039943,0cyclictest1106-21kworker/0:212:13:170
179940,0migration/17801-21kthreadcore10:24:591
179940,0migration/17763-21kthreadcore07:54:591
179940,0migration/15826-21kthreadcore11:44:581
179940,0migration/15566-21sendmail_mailtr08:15:011
179940,0migration/15555-21kthreadcore12:04:581
179940,0migration/15503-21fschecks_time09:04:561
179940,0migration/131311-21aten_r1power_cu07:49:531
179940,0migration/124764-21kthreadcore09:34:591
179940,0migration/123307-21kthreadcore08:05:001
179940,0migration/12147-21kthreadcore06:59:591
179940,0migration/121390-21kthreadcore08:29:591
179940,0migration/120789-21kthreadcore07:40:011
179940,0migration/12030-21sh12:01:461
179940,0migration/11876-21kthreadcore09:40:011
179940,0migration/118668-21timerwakeupswit10:30:061
179940,0migration/118467-21kthreadcore07:14:591
179940,0migration/11836-21kthreadcore09:59:591
179940,0migration/115070-21idleruntime08:49:561
179940,0migration/11479-21sh12:20:251
179940,0migration/114309-21irqcore09:09:591
179940,0migration/113899-21fschecks_count09:29:551
169940,0watchdog/126592-21swap10:35:041
169940,0watchdog/125347-21grep11:15:001
169940,0watchdog/118420-21memory10:10:001
169940,0watchdog/117177-21kthreadcore11:30:001
149940,0migration/032308-21kthreadcore09:19:590
149940,0migration/029656-21irqcore10:59:580
149940,0migration/019369-21sh10:10:400
149940,0migration/016940-21latency_hist07:14:420
149940,0migration/01109-21kthreadcore09:59:580
35130,0ktimersoftd/30-21swapper/308:21:033
29725030,0irq/27-eth0-tx-14358-21aten2.4-expect08:49:540
29715030,0irq/26-eth0-rx-0-21swapper/308:50:043
29715030,0irq/26-eth0-rx-0-21swapper/308:35:043
29715030,0irq/26-eth0-rx-0-21swapper/307:56:113
29715030,0irq/26-eth0-rx-0-21swapper/307:52:383
29715030,0irq/26-eth0-rx-0-21swapper/307:44:473
29715030,0irq/26-eth0-rx-0-21swapper/307:40:053
29715030,0irq/26-eth0-rx-0-21swapper/307:28:213
29715030,0irq/26-eth0-rx-0-21swapper/307:09:543
29715030,0irq/26-eth0-rx-0-21swapper/307:00:053
225049932,0cyclictest9169-21kthreadcore09:44:591
225049932,0cyclictest3556-21lldpd07:24:461
225049932,0cyclictest26474-21awk08:09:581
225049932,0cyclictest24628-21awk07:19:581
225049932,0cyclictest20716-21cut12:14:571
225039933,0cyclictest6660-21kworker/0:108:24:560
225039933,0cyclictest5501-21kworker/0:111:49:450
225039933,0cyclictest5501-21kworker/0:110:34:510
225039933,0cyclictest2796-21kworker/0:208:14:440
225039933,0cyclictest22221-21kworker/0:209:54:500
225039933,0cyclictest22221-21kworker/0:209:44:540
225039933,0cyclictest22221-21kworker/0:209:34:480
225039933,0cyclictest22221-21kworker/0:209:29:460
225039933,0cyclictest1106-21kworker/0:212:04:430
225039932,0cyclictest3556-21lldpd07:59:470
225039930,0cyclictest10781-21diskstats07:09:560
179930,0migration/124201-21kthreadcore06:54:571
169930,0watchdog/115690-21missed_timers07:10:011
169930,0watchdog/10-21swapper/112:10:041
169930,0watchdog/10-21swapper/108:54:491
169930,0watchdog/10-21swapper/108:45:011
169930,0watchdog/10-21swapper/107:35:011
29715020,0irq/26-eth0-rx-0-21swapper/307:14:543
29715020,0irq/26-eth0-rx-0-21swapper/307:05:013
225049920,0cyclictest26530-21latency_hist08:34:421
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional