You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-13 - 19:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack4slot1s.osadl.org (updated Sat Dec 13, 2025 13:37:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
992921390,4sleep20-21swapper/211:56:592
3182521260,2chrt0-21swapper/208:35:042
3182521260,2chrt0-21swapper/208:35:042
1909121160,2chrt0-21swapper/110:55:041
1909121160,2chrt0-21swapper/110:55:041
1046821150,2sleep20-21swapper/210:31:532
942321080,4sleep11648-21ntpd07:35:011
183842960,3sleep20-21swapper/207:57:012
187232930,3sleep10-21swapper/108:00:011
110672720,2sleep111068-21cat10:32:001
224452710,3sleep10-21swapper/108:10:021
224452710,3sleep10-21swapper/108:10:021
141572570,3sleep20-21swapper/212:07:002
194262510,2sleep119427-21/usr/sbin/munin12:21:591
288662460,3chrt0-21swapper/209:53:022
251062450,1sleep10-21swapper/111:11:521
319022400,2sleep131242-21/usr/sbin/munin10:01:541
143392400,3sleep30-21swapper/307:47:063
32708993728,7cyclictest30893-21idleruntime-cro10:00:011
32708993727,7cyclictest18161-21latency_hist12:20:021
32707993528,5cyclictest23537-21processes08:11:570
32707993528,5cyclictest16424-21processes10:46:570
11232350,5sleep11126-21grep11:32:021
32707993425,7cyclictest6229-21threads08:51:590
32707993425,7cyclictest6229-21threads08:51:590
32708993328,4cyclictest23240-21sshd08:11:521
32708993328,3cyclictest1899-21cut08:41:531
32708993328,3cyclictest1899-21cut08:41:531
32708993328,3cyclictest14716-21uniq09:16:501
32707993328,3cyclictest0-21swapper/012:26:510
32708993226,4cyclictest545-21in:imuxsock08:50:011
32707993226,5cyclictest17966-21latency10:51:530
32707993226,5cyclictest17966-21latency10:51:530
32707993224,6cyclictest550-21cron08:05:010
32707993224,6cyclictest16033-21sendmail09:20:010
32708993127,3cyclictest20462-21unixbench_multi10:57:001
32708993127,2cyclictest0-21swapper/108:36:571
32708993126,3cyclictest17104-21idleruntime-cro10:50:011
32708993124,5cyclictest13906-21cut10:41:511
32707993126,3cyclictest26106-21latency_hist08:20:010
32707993126,3cyclictest26106-21latency_hist08:20:010
32707993125,4cyclictest17833-21runrttasks09:24:140
32707993125,4cyclictest17833-21runrttasks09:24:140
30042310,2chrt3006-21sed11:37:001
30042310,2chrt3006-21sed11:37:001
32708993023,5cyclictest5158-21sshd08:50:521
32708993023,5cyclictest5158-21sshd08:50:521
32708993022,6cyclictest30313-21fschecks_count08:31:511
32708993022,6cyclictest30313-21fschecks_count08:31:511
32707993024,4cyclictest32706-21cyclictest12:06:510
32707993022,6cyclictest9199-21fschecks_time09:01:530
32707993022,6cyclictest9199-21fschecks_time09:01:530
236682300,3sleep20-21swapper/211:06:542
32708992923,3cyclictest0-21swapper/111:51:591
32708992922,5cyclictest13757-21cut07:46:571
32708992922,5cyclictest10612-21sendmail_mailst07:36:591
32707992924,4cyclictest2949-21gltestperf10:11:520
32707992924,4cyclictest27835-21unixbench-2d11:17:000
32707992924,4cyclictest20790-21latency_hist11:00:010
32707992924,3cyclictest32297-21fschecks_time08:36:500
32707992920,7cyclictest30049-21needreboot09:56:570
32708992823,4cyclictest572-21cups-browsed11:41:581
32708992823,4cyclictest572-21cups-browsed11:41:581
32708992822,4cyclictest9744-21latency_hist10:30:021
32708992822,4cyclictest9744-21latency_hist10:30:021
32708992822,4cyclictest28237-21sendmail11:20:011
32708992821,5cyclictest25953-21cut09:46:521
32708992821,5cyclictest25953-21cut09:46:521
32708992819,7cyclictest21674-21latency_hist09:35:031
32708992819,7cyclictest21674-21latency_hist09:35:031
32708992818,7cyclictest24070-21cut09:41:521
32707992822,5cyclictest30926-21kernelversion11:26:530
32707992822,5cyclictest30926-21kernelversion11:26:530
32707992822,4cyclictest17784-21unixbench_multi12:17:010
32707992822,4cyclictest0-21swapper/010:30:010
32707992822,4cyclictest0-21swapper/010:30:010
32707992820,6cyclictest13450-21latency_hist10:40:030
32708992721,4cyclictest547-21rs:main1
32708992721,4cyclictest19828-21proc_pri08:01:581
32708992721,4cyclictest0-21swapper/109:21:511
32708992721,4cyclictest0-21swapper/109:21:511
32708992721,3cyclictest0-21swapper/112:11:591
32708992721,3cyclictest0-21swapper/111:01:501
32708992721,3cyclictest0-21swapper/111:01:501
32708992719,6cyclictest28749-21cut11:21:501
32708992719,6cyclictest28749-21cut11:21:501
32707992721,4cyclictest25561-21latency_hist12:40:010
32707992720,5cyclictest22450-21kernelversion09:36:550
32708992621,4cyclictest16222-21systemctl07:51:591
32708992621,4cyclictest16222-21systemctl07:51:591
32708992621,3cyclictest0-21swapper/107:42:001
32708992621,2cyclictest0-21swapper/112:01:501
32708992621,2cyclictest0-21swapper/109:02:001
32708992621,2cyclictest0-21swapper/109:02:001
32708992619,4cyclictest0-21swapper/111:07:001
32708992618,6cyclictest9206-21/usr/sbin/munin11:56:591
32708992617,7cyclictest6034-21ls11:46:551
32708992617,7cyclictest6034-21ls11:46:551
32707992621,4cyclictest18428-21fschecks_count09:26:510
32707992621,3cyclictest26026-21gltestperf09:46:520
32707992621,3cyclictest26026-21gltestperf09:46:520
32707992621,3cyclictest15610-21gltestperf07:51:530
32707992621,3cyclictest15610-21gltestperf07:51:530
32707992619,6cyclictest9675-21sshd07:35:520
32707992618,6cyclictest2076-21grep11:36:510
32707992618,6cyclictest2076-21grep11:36:510
32707992617,7cyclictest28994-21needreboot08:26:550
32707992616,8cyclictest17848-21needreboot07:56:560
32708992519,4cyclictest3488-21systemctl10:11:581
32708992519,4cyclictest12146-21kworker/u9:4-xprtiod09:15:021
32708992519,4cyclictest12146-21kworker/u9:4-xprtiod09:15:021
32708992519,3cyclictest0-21swapper/109:26:521
32708992519,3cyclictest0-21swapper/108:16:571
32708992519,3cyclictest0-21swapper/108:16:571
32708992518,4cyclictest0-21swapper/109:06:521
32708992512,3cyclictest70512grep10:21:561
32708992512,3cyclictest70512grep10:21:561
32707992518,5cyclictest7217-21fschecks_count08:56:510
32707992518,5cyclictest7217-21fschecks_count08:56:510
32707992518,5cyclictest27095-21missed_timers08:21:540
32707992518,5cyclictest11990-21gltestperf07:41:530
32708992419,3cyclictest0-21swapper/112:40:011
32708992416,6cyclictest32706-21cyclictest10:05:501
32708992416,6cyclictest32706-21cyclictest10:05:501
32707992420,2cyclictest0-21swapper/012:11:510
32707992419,4cyclictest31242-21/usr/sbin/munin10:01:560
32707992419,4cyclictest29551-21switchtime11:21:590
32707992419,4cyclictest29551-21switchtime11:21:590
32707992419,3cyclictest0-21swapper/012:00:020
32707992419,3cyclictest0-21swapper/009:32:020
32707992419,3cyclictest0-21swapper/009:32:020
32707992419,3cyclictest0-21swapper/008:41:530
32707992419,3cyclictest0-21swapper/008:41:530
32707992418,5cyclictest18432-21sshd12:20:510
32707992418,4cyclictest12803-21fschecks_count09:11:520
32707992418,4cyclictest12803-21fschecks_count09:11:520
32707992417,5cyclictest28016-21kernelversion09:51:530
32707992417,4cyclictest0-21swapper/007:31:520
32707992416,5cyclictest0-21swapper/012:01:510
3270899231,8cyclictest129312/usr/sbin/munin12:06:491
32708992317,4cyclictest0-21swapper/109:51:511
32708992316,4cyclictest0-21swapper/110:16:581
32707992319,2cyclictest0-21swapper/008:50:010
32707992318,3cyclictest0-21swapper/011:46:590
32707992318,3cyclictest0-21swapper/011:46:590
32707992318,3cyclictest0-21swapper/009:41:530
32707992317,5cyclictest6985-21strings10:21:550
32707992317,5cyclictest6985-21strings10:21:550
32707992317,5cyclictest30486-21gltestperf08:31:520
32707992317,5cyclictest30486-21gltestperf08:31:520
32707992317,5cyclictest23678-21needreboot11:06:560
32707992317,4cyclictest0-21swapper/010:06:500
32707992317,4cyclictest0-21swapper/010:06:500
32707992317,4cyclictest0-21swapper/007:46:560
32707992317,3cyclictest0-21swapper/011:41:590
32707992317,3cyclictest0-21swapper/011:41:590
32707992316,6cyclictest10518-21kernelversion10:31:540
32707992313,8cyclictest142-21systemd-journal10:45:010
32707992313,8cyclictest142-21systemd-journal10:18:000
32707992313,7cyclictest22798-21latency_hist11:05:040
32707992313,7cyclictest22798-21latency_hist11:05:040
32708992217,4cyclictest20848-21kernelversion12:26:531
32708992217,3cyclictest0-21swapper/109:36:591
32708992216,3cyclictest0-21swapper/108:58:431
32708992216,3cyclictest0-21swapper/108:58:431
32708992214,6cyclictest550-21cron12:30:051
32708992214,6cyclictest550-21cron12:30:051
32708992214,6cyclictest29164-21gunzip08:26:571
32708992214,6cyclictest12501-21sort10:36:551
32707992217,3cyclictest7490-21fschecks_count11:51:510
32707992217,3cyclictest0-21swapper/008:06:580
32707992217,3cyclictest0-21swapper/008:06:580
32707992216,4cyclictest0-21swapper/012:31:520
32707992216,4cyclictest0-21swapper/012:31:520
32708992114,5cyclictest0-21swapper/111:26:191
32708992114,5cyclictest0-21swapper/111:26:191
32707992117,3cyclictest11991-21grep09:07:070
32707992115,4cyclictest26051-21grep11:12:010
32707992114,5cyclictest1161-21head11:32:020
32710991913,4cyclictest324962sleep310:01:593
3270999191,13cyclictest26544-21taskset08:21:492
3271099181,12cyclictest3315-21chrt10:11:563
3270999183,9cyclictest0-21swapper/210:48:122
3271099171,11cyclictest4125-21chrt11:41:533
3271099171,11cyclictest4125-21chrt11:41:533
3271099171,11cyclictest0-21swapper/308:11:583
3270999171,12cyclictest12318-21chrt09:10:012
3270999171,11cyclictest13143-21chrt09:11:542
3270999171,11cyclictest13143-21chrt09:11:542
3271099161,12cyclictest23334-21chrt11:06:513
3271099161,11cyclictest1656-21chrt10:06:583
3271099161,11cyclictest1656-21chrt10:06:583
3271099161,11cyclictest16321-21taskset09:20:513
3271099161,11cyclictest16321-21taskset09:20:513
3271099161,11cyclictest12772-21chrt09:11:513
3271099161,11cyclictest12772-21chrt09:11:513
3271099161,11cyclictest0-21swapper/308:25:013
3271099161,10cyclictest8996-21chrt11:55:033
3271099161,10cyclictest3441-21chrt11:40:043
3271099161,10cyclictest3441-21chrt11:40:043
3271099161,10cyclictest0-21swapper/310:16:493
3270999163,9cyclictest0-21swapper/209:42:512
3270999163,9cyclictest0-21swapper/209:22:512
3270999163,9cyclictest0-21swapper/209:22:512
3270999162,10cyclictest0-21swapper/208:11:482
3270999161,11cyclictest9485-21chrt07:35:022
3270999161,11cyclictest8413-21chrt10:26:512
3270999161,11cyclictest8413-21chrt10:26:512
3270999161,11cyclictest30333-21chrt09:57:002
3270999161,11cyclictest29240-21taskset11:21:542
3270999161,11cyclictest29240-21taskset11:21:542
3270999161,11cyclictest26995-21taskset11:16:512
3270999161,11cyclictest0-21swapper/207:41:522
3270999161,10cyclictest7570-21chrt10:22:002
3270999161,10cyclictest7570-21chrt10:22:002
3270999161,10cyclictest10620-21chrt07:36:592
32709991610,3cyclictest0-21swapper/211:45:012
32709991610,3cyclictest0-21swapper/211:45:012
91712150,3sleep30-21swapper/310:27:003
91712150,3sleep30-21swapper/310:27:003
3271099151,8cyclictest9557-21taskset07:35:033
3271099151,10cyclictest30533-21chrt11:26:493
3271099151,10cyclictest30533-21chrt11:26:493
3271099151,10cyclictest25348-21chrt11:11:543
3271099151,10cyclictest22250-21taskset12:31:493
3271099151,10cyclictest22250-21taskset12:31:493
3271099151,10cyclictest21110-21chrt08:06:513
3271099151,10cyclictest21110-21chrt08:06:513
3270999158,4cyclictest181072sleep210:51:552
3270999158,4cyclictest181072sleep210:51:552
3270999153,9cyclictest0-21swapper/212:13:302
3270999151,11cyclictest3876-21chrt08:46:572
3270999151,11cyclictest0-21swapper/210:01:512
3270999151,10cyclictest16511-21chrt12:15:202
190322151,2sleep30-21swapper/308:01:413
3271099149,3cyclictest315962chrt08:34:043
3271099149,3cyclictest315962chrt08:34:043
3271099148,3cyclictest152222chrt07:50:313
3271099148,3cyclictest152222chrt07:50:313
3271099143,6cyclictest0-21swapper/309:46:563
3271099143,6cyclictest0-21swapper/309:46:563
3271099141,9cyclictest753-21chrt11:32:003
3271099141,9cyclictest28871-21taskset11:21:513
3271099141,9cyclictest28871-21taskset11:21:513
3271099141,9cyclictest28248-21chrt08:25:523
3271099141,9cyclictest26596-21chrt11:15:243
3271099141,9cyclictest17105-21chrt07:55:573
3271099141,9cyclictest0-21swapper/310:32:513
3271099141,9cyclictest0-21swapper/310:23:083
3271099141,9cyclictest0-21swapper/310:23:083
3271099141,11cyclictest12390-21chrt09:10:023
3271099141,11cyclictest0-21swapper/309:56:503
3271099141,10cyclictest28439-21taskset09:51:593
3271099141,10cyclictest25199-21chrt09:43:263
3271099141,10cyclictest22333-21chrt11:02:013
3271099141,10cyclictest22333-21chrt11:02:013
3271099141,10cyclictest0-21swapper/312:06:503
3270999148,4cyclictest161062sleep207:51:592
3270999148,4cyclictest161062sleep207:51:592
3270999143,8cyclictest0-21swapper/211:13:512
3270999142,7cyclictest0-21swapper/211:46:532
3270999142,7cyclictest0-21swapper/211:46:532
3270999141,10cyclictest9082-21chrt09:01:532
3270999141,10cyclictest9082-21chrt09:01:532
3270999141,10cyclictest0-21swapper/211:31:562
132592141,2sleep20-21swapper/210:38:382
3271099139,2cyclictest0-21swapper/308:49:563
3271099138,3cyclictest53882chrt11:45:223
3271099138,3cyclictest53882chrt11:45:223
3271099138,3cyclictest228002sleep309:37:003
3271099138,3cyclictest154672chrt10:45:133
3271099138,3cyclictest136662chrt10:40:513
3271099138,2cyclictest0-21swapper/308:56:033
3271099138,2cyclictest0-21swapper/308:56:033
3271099137,4cyclictest134412sleep310:40:033
3271099137,3cyclictest129152chrt07:42:233
3271099131,9cyclictest8924-21chrt09:01:263
3271099131,9cyclictest8924-21chrt09:01:263
3271099131,9cyclictest16527-21chrt12:15:333
3271099131,8cyclictest5118-21taskset08:50:203
3271099131,8cyclictest5118-21taskset08:50:203
3271099131,8cyclictest19986-21chrt09:30:203
3271099131,8cyclictest19986-21chrt09:30:203
3271099131,8cyclictest19171-21chrt10:55:183
3271099131,8cyclictest18114-21taskset09:25:053
3271099131,8cyclictest17334-21chrt10:50:273
3271099131,8cyclictest17334-21chrt10:50:273
3271099131,8cyclictest14391-21taskset09:15:123
3271099131,8cyclictest0-21swapper/308:18:513
3271099131,8cyclictest0-21swapper/308:18:513
3271099131,10cyclictest9213-21chrt11:56:523
3270999139,2cyclictest0-21swapper/208:00:262
3270999138,3cyclictest39022chrt10:12:402
3270999138,3cyclictest316772chrt11:27:002
3270999138,3cyclictest316772chrt11:27:002
3270999131,9cyclictest19985-21chrt09:30:192
3270999131,9cyclictest19985-21chrt09:30:192
3270999131,9cyclictest19012-21chrt09:26:572
3270999131,9cyclictest18478-21chrt12:21:272
3270999131,8cyclictest7229-21chrt11:50:122
3270999131,8cyclictest24477-21chrt08:15:182
3270999131,8cyclictest24477-21chrt08:15:182
3270999131,8cyclictest23937-21chrt12:35:182
3270999131,8cyclictest20765-21chrt08:05:092
3270999131,8cyclictest20765-21chrt08:05:092
3270999131,8cyclictest14385-21chrt09:15:072
3270999131,8cyclictest0-21swapper/210:43:512
3270999131,7cyclictest0-21swapper/212:26:592
16712130,4sleep30-21swapper/308:41:523
16712130,4sleep30-21swapper/308:41:523
123622131,2sleep20-21swapper/212:02:192
3271099127,3cyclictest96442chrt07:35:273
3271099121,9cyclictest25366-21chrt12:37:403
3271099121,9cyclictest20277-21chrt12:25:503
3271099121,9cyclictest19852-21chrt12:23:053
3271099121,9cyclictest14666-21chrt12:10:233
3271099121,8cyclictest31892-21chrt08:35:093
3271099121,8cyclictest10944-21chrt12:00:063
3270999128,2cyclictest0-21swapper/211:01:082
3270999128,2cyclictest0-21swapper/211:01:082
3270999127,3cyclictest319582chrt08:36:002
3270999127,3cyclictest256702chrt09:46:472
3270999127,3cyclictest256702chrt09:46:472
3270999127,3cyclictest147762chrt07:47:322
3270999121,9cyclictest29694-21chrt08:28:242
3270999121,9cyclictest23616-21chrt12:33:532
3270999121,9cyclictest23616-21chrt12:33:532
3270999121,8cyclictest6975-21taskset08:55:262
3270999121,8cyclictest6975-21taskset08:55:262
3270999121,8cyclictest519-21chrt10:05:122
3270999121,8cyclictest519-21chrt10:05:122
3270999121,8cyclictest5102-21chrt08:50:072
3270999121,8cyclictest5102-21chrt08:50:072
3270999121,8cyclictest4311-21taskset10:15:092
3270999121,8cyclictest19165-21chrt10:55:132
3270999121,8cyclictest1651-21chrt11:35:122
3270999121,8cyclictest1651-21chrt11:35:122
3270999121,7cyclictest21821-21taskset09:35:092
3270999120,8cyclictest1415-21chrt08:40:222
3270999120,8cyclictest1415-21chrt08:40:222
plot09:55:358
setyrange[0.8:*]5
setylabel"Numberoflatencysamples"6
setxrange[0:400]4
setxlabel"Latencyus-Maximumusplottedon2
settitle"Latencyrack4slot1s"0
setterminalpbmcolor1
setoutput"r4s1s.ppm"7
setlogscaley3
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional