You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-24 - 14:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Wed Jun 24, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1382324132,0sleep30-21swapper/306:49:393
1378623622,0sleep00-21swapper/006:49:120
1388023329,0sleep20-21swapper/206:50:182
1398223121,0sleep10-21swapper/106:51:291
8215060,0irq/24-0000:00:18642-21diskstats08:31:572
339960,0migration/328725-21sh10:01:533
339960,0migration/327505-21sh10:19:443
339960,0migration/32476-21sh11:04:393
339960,0migration/32471-21sh10:22:573
339960,0migration/321556-21idleruntime09:56:583
339960,0migration/319690-21sh10:15:223
339960,0migration/319015-21sh10:55:053
339960,0migration/317722-21sh11:12:183
339960,0migration/317667-21sh11:33:023
339960,0migration/314391-21aten_r1power_po06:51:573
339960,0migration/311426-21runrttasks09:48:463
339960,0migration/310439-21sh11:51:073
29725060,0irq/27-eth0-tx-27590-21munin-node07:01:570
29725060,0irq/27-eth0-tx-18241-21munin-node08:32:070
29715060,0irq/26-eth0-rx-6233-21cut07:07:023
29715060,0irq/26-eth0-rx-27326-40yum-updatesd-he10:40:153
29715060,0irq/26-eth0-rx-25384-21seq11:37:153
29715060,0irq/26-eth0-rx-22461-21kthreadcore10:57:023
140769960,0cyclictest0-21swapper/211:36:562
140769960,0cyclictest0-21swapper/210:51:222
149960,0migration/05693-21kthreadcore12:07:010
149960,0migration/04080-21sh09:25:190
149960,0migration/04080-21sh09:25:190
4150,0ktimersoftd/00-21swapper/009:34:150
339950,0migration/39986-21runrttasks10:47:093
339950,0migration/39424-21munin-node07:11:593
339950,0migration/35159-21sh10:06:583
339950,0migration/34885-21munin-node08:42:043
339950,0migration/331569-21kthreadcore09:02:033
339950,0migration/331133-21kthreadcore07:52:023
339950,0migration/324663-21kthreadcore11:17:023
339950,0migration/322803-21munin-node08:07:073
339950,0migration/321190-21aten_r1power_cu09:16:573
339950,0migration/320178-21diskmemload09:14:533
339950,0migration/319001-21taskset08:53:123
339950,0migration/318946-21munin-node09:32:083
339950,0migration/316745-21kthreadcore10:32:033
339950,0migration/315857-21kthreadcore09:52:013
29725050,0irq/27-eth0-tx-4873-21munin-node08:21:590
29725050,0irq/27-eth0-tx-4747-21munin-node09:07:032
29725050,0irq/27-eth0-tx-4366-21munin-node10:07:092
29725050,0irq/27-eth0-tx-19288-21ssh08:54:092
29725050,0irq/27-eth0-tx-17586-21sed10:32:032
29725050,0irq/27-eth0-tx-0-21swapper/211:26:202
29725050,0irq/27-eth0-tx-0-21swapper/211:14:572
29725050,0irq/27-eth0-tx-0-21swapper/209:52:012
29725050,0irq/27-eth0-tx-0-21swapper/209:46:502
29725050,0irq/27-eth0-tx-0-21swapper/209:15:392
29725050,0irq/27-eth0-tx-0-21swapper/008:52:000
29725050,0irq/27-eth0-tx-0-21swapper/008:41:560
29725050,0irq/27-eth0-tx-0-21swapper/008:08:120
29715050,0irq/26-eth0-rx-6856-21kthreadcore07:32:013
29715050,0irq/26-eth0-rx-30375-21cut11:42:023
29715050,0irq/26-eth0-rx-22862-21kthreadcore12:17:013
29715050,0irq/26-eth0-rx-18136-21sh12:16:033
29715050,0irq/26-eth0-rx-12382-21hwlatdetect08:26:593
29715050,0irq/26-eth0-rx-0-21swapper/311:26:583
29715050,0irq/26-eth0-rx-0-21swapper/310:42:023
29715050,0irq/26-eth0-rx-0-21swapper/310:27:013
29715050,0irq/26-eth0-rx-0-21swapper/309:39:183
29715050,0irq/26-eth0-rx-0-21swapper/309:27:023
29715050,0irq/26-eth0-rx-0-21swapper/309:22:043
29715050,0irq/26-eth0-rx-0-21swapper/309:22:043
29715050,0irq/26-eth0-rx-0-21swapper/308:57:193
29715050,0irq/26-eth0-rx-0-21swapper/308:46:593
29715050,0irq/26-eth0-rx-0-21swapper/308:23:293
29715050,0irq/26-eth0-rx-0-21swapper/307:37:023
259950,0migration/25994-21kthreadcore11:47:032
259950,0migration/23836-21sh09:45:042
259950,0migration/232714-21needreboot11:42:042
259950,0migration/23168-21sh10:04:112
259950,0migration/226285-21proc_pri08:57:072
259950,0migration/219678-21aten_r1power_vo11:16:562
259950,0migration/219488-21idleruntime12:16:572
259950,0migration/218914-21sh11:56:492
259950,0migration/214293-21kthreadcore08:27:022
19150,0ktimersoftd/10-21swapper/110:46:181
179950,0migration/15316-21kthreadcore10:47:011
179950,0migration/129863-21idleruntime09:41:581
179950,0migration/127476-21sh09:58:541
179950,0migration/120073-21latency_hist10:36:441
179950,0migration/117272-21munin-node08:06:571
179950,0migration/114821-21kthreadcore11:12:011
169950,0watchdog/110204-21grep07:36:561
140769955,0cyclictest0-21swapper/210:57:122
140769955,0cyclictest0-21swapper/210:45:142
140769950,0cyclictest0-21swapper/209:26:522
140759955,0cyclictest0-21swapper/111:26:171
140759955,0cyclictest0-21swapper/111:08:281
140759955,0cyclictest0-21swapper/109:52:001
140759955,0cyclictest0-21swapper/109:11:581
140759955,0cyclictest0-21swapper/109:02:111
140759950,0cyclictest0-21swapper/110:05:341
140759950,0cyclictest0-21swapper/109:39:051
140749955,0cyclictest0-21swapper/010:32:250
140749954,0cyclictest21195-21irqcore10:36:580
140749950,0cyclictest0-21swapper/011:36:450
140749950,0cyclictest0-21swapper/010:10:590
140749950,0cyclictest0-21swapper/009:49:330
149950,0migration/09260-21sh11:47:420
149950,0migration/07421-21munin-node07:07:040
149950,0migration/06403-21kthreadcore07:32:010
149950,0migration/05929-21kthreadcore07:57:020
149950,0migration/04319-21fschecks_count10:46:580
149950,0migration/031746-21kthreadcore12:02:010
149950,0migration/030867-21kthreadcore11:02:010
149950,0migration/030602-21aten_r1power_cu08:16:570
149950,0migration/030252-21kthreadcore10:42:020
149950,0migration/029014-21munin-node07:26:570
149950,0migration/028758-21latency_hist09:01:450
149950,0migration/028498-21sh09:01:370
149950,0migration/028273-21ksmtuned11:21:580
149950,0migration/025962-21irqcore08:37:000
149950,0migration/024837-21kthreadcore07:47:040
149950,0migration/024591-21kthreadcore07:22:030
149950,0migration/020890-21latency_hist06:56:460
149950,0migration/018897-21taskset11:15:420
149950,0migration/018263-21munin-node09:52:030
149950,0migration/017528-21unixbench_multi08:27:090
149950,0migration/016282-21latency11:52:020
149950,0migration/016119-21pmu-power08:02:050
149950,0migration/015738-21kthreadcore10:12:020
149950,0migration/015363-21timerandwakeup07:37:050
149950,0migration/012368-21irqcore11:31:580
149950,0migration/010669-21timerandwakeup09:07:060
339940,0migration/331382-21kthreadcore07:27:013
339940,0migration/327070-21taskset06:58:293
339940,0migration/326845-21kthreadcore08:12:013
339940,0migration/326168-21kthreadcore07:22:043
339940,0migration/323480-21kthreadcore11:57:003
339940,0migration/321915-21kthreadcore08:32:023
29725040,0irq/27-eth0-tx-8757-21ssh12:07:082
29725040,0irq/27-eth0-tx-24609-21kthreadcore09:57:012
29725040,0irq/27-eth0-tx-20992-21munin-node09:37:042
29725040,0irq/27-eth0-tx-11963-21ssh10:51:552
29725040,0irq/27-eth0-tx-0-21swapper/212:01:552
29725040,0irq/27-eth0-tx-0-21swapper/211:26:442
29725040,0irq/27-eth0-tx-0-21swapper/211:06:502
29725040,0irq/27-eth0-tx-0-21swapper/210:36:512
29725040,0irq/27-eth0-tx-0-21swapper/210:27:012
29725040,0irq/27-eth0-tx-0-21swapper/210:18:272
29725040,0irq/27-eth0-tx-0-21swapper/209:21:462
29725040,0irq/27-eth0-tx-0-21swapper/209:21:462
29725040,0irq/27-eth0-tx-0-21swapper/209:02:172
29715040,0irq/26-eth0-rx-32623-21ssh12:02:043
29715040,0irq/26-eth0-rx-0-21swapper/312:07:123
29715040,0irq/26-eth0-rx-0-21swapper/311:51:553
29715040,0irq/26-eth0-rx-0-21swapper/311:21:473
29715040,0irq/26-eth0-rx-0-21swapper/311:07:333
29715040,0irq/26-eth0-rx-0-21swapper/309:42:413
29715040,0irq/26-eth0-rx-0-21swapper/309:09:343
29715040,0irq/26-eth0-rx-0-21swapper/308:02:473
29715040,0irq/26-eth0-rx-0-21swapper/307:01:563
259940,0migration/25915-21irqcore08:22:002
259940,0migration/230902-21kthreadcore10:22:012
259940,0migration/228844-21kthreadcore08:12:022
259940,0migration/228441-21latency_hist07:26:462
259940,0migration/215423-21kthreadcore10:12:022
259940,0migration/211408-21sh12:11:582
249940,0watchdog/2349-21sed08:41:592
249940,0watchdog/223197-21kthreadcore09:17:032
249940,0watchdog/221809-21kthreadcore08:07:032
249940,0watchdog/212514-21kernelversion11:31:592
249940,0watchdog/210205-21fschecks_time07:36:562
249940,0watchdog/20-21swapper/208:16:592
18315240,0sleep118319-21ssh11:55:431
179940,0migration/18219-21taskset07:10:191
179940,0migration/17915-21kthreadcore07:57:021
179940,0migration/14555-21kthreadcore12:07:001
179940,0migration/13633-21gltestperf11:46:591
179940,0migration/131586-21kthreadcore07:52:021
179940,0migration/130108-21kthreadcore10:22:011
179940,0migration/129920-21kthreadcore11:42:021
179940,0migration/127953-21kthreadcore08:12:011
179940,0migration/126154-21kthreadcore07:22:041
179940,0migration/121583-21kthreadcore11:17:011
179940,0migration/120959-21irqcore10:57:011
179940,0migration/120437-21latency_hist08:56:451
179940,0migration/120239-21kthreadcore08:32:011
179940,0migration/119383-21kthreadcore07:42:021
179940,0migration/118390-21taskset10:53:171
179940,0migration/117975-21kthreadcore06:52:031
179940,0migration/115822-21fschecks_time07:16:591
179940,0migration/11564-21sshd07:06:281
179940,0migration/112982-21idleruntime10:31:591
169940,0watchdog/19542-21kthreadcore09:47:031
169940,0watchdog/14398-21aten_r1power_cu10:06:551
169940,0watchdog/1348-21cut08:41:591
169940,0watchdog/126146-21ssh12:21:101
169940,0watchdog/124579-21cut07:47:041
169940,0watchdog/111543-21ssh09:08:351
169940,0watchdog/111466-21iwlist08:01:591
169940,0watchdog/110308-21ssh10:27:111
169940,0watchdog/10-21swapper/112:11:581
169940,0watchdog/10-21swapper/110:12:031
169940,0watchdog/10-21swapper/108:17:031
140769943,0cyclictest9471-21awk07:11:592
140769943,0cyclictest3556-21lldpd08:02:352
140769943,0cyclictest3556-21lldpd07:05:332
140769943,0cyclictest3241-21irqbalance11:51:532
140769943,0cyclictest3241-21irqbalance09:31:532
140769943,0cyclictest3241-21irqbalance07:47:042
140769943,0cyclictest3241-21irqbalance07:27:042
140769943,0cyclictest2827-21awk07:07:002
140769943,0cyclictest27861-21munin-node11:02:002
140769943,0cyclictest15221-21awk06:52:002
140759944,0cyclictest0-21swapper/110:19:551
140759943,0cyclictest9441-21awk07:11:591
140759943,0cyclictest6819-21awk08:47:001
140759943,0cyclictest4125-21awk11:26:591
140759943,0cyclictest3556-21lldpd09:23:341
140759943,0cyclictest3556-21lldpd09:23:341
140759943,0cyclictest3556-21lldpd09:17:351
140759943,0cyclictest3556-21lldpd08:25:061
140759943,0cyclictest3556-21lldpd07:01:041
140759943,0cyclictest28727-21awk11:01:581
140759943,0cyclictest27910-21awk12:01:591
140759943,0cyclictest25739-21awk08:36:581
140759943,0cyclictest13854-21awk09:32:001
140759943,0cyclictest12401-21sort08:26:591
140759940,0cyclictest0-21swapper/111:40:141
140749944,0cyclictest12360-21diskmemload09:36:560
140749944,0cyclictest0-21swapper/010:57:010
140749943,0cyclictest5760-21awk09:26:590
140749943,0cyclictest3556-21lldpd07:54:050
140749943,0cyclictest27926-21kworker/0:011:44:240
140749943,0cyclictest21331-21awk10:16:590
140749943,0cyclictest19843-21awk11:56:580
140749943,0cyclictest15173-21awk06:52:000
149940,0migration/030552-21kthreadcore09:42:010
149940,0migration/022295-21kthreadcore12:17:010
149940,0migration/017608-21diskmemload12:14:290
29715030,0irq/26-eth0-rx-0-21swapper/308:17:063
29715030,0irq/26-eth0-rx-0-21swapper/307:50:043
249930,0watchdog/20-21swapper/207:57:082
169930,0watchdog/12967-21munin-node07:31:561
169930,0watchdog/10-21swapper/111:31:591
140769933,0cyclictest3556-21lldpd07:42:052
140769932,0cyclictest3556-21lldpd08:50:052
140769932,0cyclictest3241-21irqbalance07:32:042
140769932,0cyclictest26194-21kernelversion08:37:002
140769932,0cyclictest15424-21aten2.4-expect07:16:572
140759932,0cyclictest3556-21lldpd07:27:051
140759932,0cyclictest18381-21sensors08:52:061
140759930,0cyclictest6815-21grep09:27:021
140759930,0cyclictest19794-21if_err_eth011:56:571
140749933,0cyclictest27926-21kworker/0:011:26:480
140749933,0cyclictest27926-21kworker/0:011:16:480
140749933,0cyclictest27926-21kworker/0:011:06:500
140749933,0cyclictest27926-21kworker/0:010:51:460
140749933,0cyclictest27926-21kworker/0:010:26:560
140749933,0cyclictest27926-21kworker/0:010:21:460
140749933,0cyclictest27926-21kworker/0:010:01:460
140749933,0cyclictest27926-21kworker/0:009:56:480
140749933,0cyclictest27926-21kworker/0:009:16:480
140749933,0cyclictest27926-21kworker/0:009:11:480
140749933,0cyclictest27926-21kworker/0:008:46:560
140749933,0cyclictest27926-21kworker/0:008:11:470
140749933,0cyclictest27926-21kworker/0:007:41:550
140749933,0cyclictest27926-21kworker/0:007:16:470
140749933,0cyclictest27926-21kworker/0:007:11:590
35120,0ktimersoftd/36130-21kthreadcore07:57:023
329920,0watchdog/326387-21cut08:37:003
29715020,0irq/26-eth0-rx-0-21swapper/307:42:083
29715020,0irq/26-eth0-rx-0-21swapper/307:16:563
249920,0watchdog/20-21swapper/206:56:482
140769921,0cyclictest29504-21latency_hist07:51:462
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional