You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-14 - 17:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Fri Aug 14, 2026 12:44:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
442821050,2chrt4429-21/usr/sbin/munin09:44:120
191782970,3sleep30-21swapper/307:33:503
191782970,3sleep30-21swapper/307:33:503
271392910,4sleep0201rcuc/007:54:010
24192750,3sleep30-21swapper/311:08:493
24192750,3sleep30-21swapper/311:08:493
293642700,2sleep00-21swapper/007:59:070
293642700,2sleep00-21swapper/007:59:070
38902680,2chrt0-21swapper/112:38:561
317762670,3sleep20-21swapper/208:04:122
317762670,3sleep20-21swapper/208:04:122
305582600,3chrt0-21swapper/209:29:062
226722570,3chrt0-21swapper/211:59:132
226722570,3chrt0-21swapper/211:59:132
93012560,2sleep19163-21latency_hist08:33:551
93012560,2sleep19163-21latency_hist08:33:551
150322550,3sleep2351rcuc/210:14:052
150322550,3sleep2351rcuc/210:14:052
185282530,3sleep30-21swapper/308:58:483
185282530,3sleep30-21swapper/308:58:483
20892500,1sleep02092-21wc09:39:090
20892500,1sleep02092-21wc09:39:090
269602490,3sleep30-21swapper/307:54:003
17152480,1sleep00-21swapper/011:04:110
17152480,1sleep00-21swapper/011:04:110
61252460,3sleep00-21swapper/008:24:040
256192460,3sleep30-21swapper/310:43:523
256192460,3sleep30-21swapper/310:43:523
256192460,3sleep30-21swapper/310:43:523
293202450,3sleep20-21swapper/209:24:122
86142430,2sleep30-21swapper/309:58:503
86142430,2sleep30-21swapper/309:58:503
197662430,2sleep119929-21tail08:59:151
197662430,2sleep119929-21tail08:59:151
156972420,2sleep115706-21uname08:49:061
183752400,2sleep20-21swapper/210:24:022
175932400,3sleep20-21swapper/210:19:112
175932400,3sleep20-21swapper/210:19:112
265892390,2sleep20-21swapper/209:19:012
265892390,2sleep20-21swapper/209:19:012
266812380,3chrt0-21swapper/309:19:023
266812380,3chrt0-21swapper/309:19:023
33782370,1sleep12634-21/usr/sbin/munin11:09:081
12233993731,4cyclictest12906-21latency_hist08:43:491
12233993731,4cyclictest12906-21latency_hist08:43:491
119462360,2sleep011996-21sort11:33:550
273562350,3sleep20-21swapper/207:54:032
12233993428,4cyclictest20026-21kernelversion11:54:031
12229993428,4cyclictest171ktimers/010:32:090
12229993428,4cyclictest171ktimers/010:32:090
12229993427,4cyclictest729-21dbus-daemon10:23:490
12229993427,4cyclictest729-21dbus-daemon10:23:490
12229993426,6cyclictest29050-21fschecks_count12:19:020
12229993426,6cyclictest29050-21fschecks_count12:19:020
12229993425,6cyclictest28232-21unixbench_singl12:14:120
12229993425,6cyclictest28232-21unixbench_singl12:14:120
34142330,5sleep20-21swapper/211:09:082
1224199331,6cyclictest6550-21chrt09:51:593
1224199331,6cyclictest6550-21chrt09:51:593
12233993324,7cyclictest4421-21netstat08:19:081
12233993324,7cyclictest4421-21netstat08:19:081
23582320,3sleep20-21swapper/209:39:112
23582320,3sleep20-21swapper/209:39:112
12233993223,7cyclictest550-21cron12:28:481
12233993223,7cyclictest550-21cron12:28:481
12229993228,3cyclictest24680-21gltestperf09:14:020
12229993225,5cyclictest3148-21kernelversion11:09:030
12229993222,8cyclictest7234-21gltestperf09:54:020
12229993222,8cyclictest7234-21gltestperf09:54:020
12229993222,7cyclictest8445-21fschecks_count11:24:000
12229993222,7cyclictest8445-21fschecks_count11:24:000
84672310,3sleep30-21swapper/311:24:003
84672310,3sleep30-21swapper/311:24:003
12233993123,6cyclictest26969-21cut07:54:001
256702300,4sleep20-21swapper/210:43:552
256702300,4sleep20-21swapper/210:43:552
256702300,4sleep20-21swapper/210:43:552
12233993024,3cyclictest0-21swapper/107:38:481
12233993024,3cyclictest0-21swapper/107:38:481
12229993025,3cyclictest90-1pr/ttyS012:41:420
12229993025,3cyclictest90-1pr/ttyS012:41:420
12229993025,3cyclictest90-1pr/ttyS009:12:210
12229993025,3cyclictest90-1pr/ttyS009:12:210
12229993024,5cyclictest26740-21threads10:44:110
12229993024,4cyclictest12228-21cyclictest07:39:020
12229993024,4cyclictest12228-21cyclictest07:39:020
12229993023,5cyclictest12716-21needreboot11:34:060
12229993023,5cyclictest12716-21needreboot11:34:060
120032300,2chrt0-21swapper/208:39:092
120032300,2chrt0-21swapper/208:39:092
302472290,3sleep20-21swapper/210:54:082
1224199291,9cyclictest15763-21chrt08:49:073
12233992924,3cyclictest1236-21timerandwakeup12:29:121
12233992923,4cyclictest2948-21latency_hist09:43:481
12233992923,4cyclictest2948-21latency_hist09:43:481
12233992922,5cyclictest6900-21kernelversion11:19:041
12233992922,5cyclictest6900-21kernelversion11:19:041
12233992922,5cyclictest6900-21kernelversion11:19:041
12233992922,5cyclictest23943-21sshd09:11:221
12233992922,5cyclictest23943-21sshd09:11:221
1222999297,4cyclictest201rcuc/010:43:390
1222999297,4cyclictest201rcuc/010:43:390
1222999297,4cyclictest201rcuc/010:43:390
12229992923,5cyclictest32699-21processes09:34:100
12229992923,5cyclictest32699-21processes09:34:100
12229992922,5cyclictest550-21cron09:08:490
12229992922,2cyclictest181rcu_preempt08:07:350
12229992922,2cyclictest181rcu_preempt08:07:350
12229992921,6cyclictest3706-21idleruntime-cro12:38:490
12229992919,8cyclictest3102-21unixbench_singl08:14:120
12229992917,3cyclictest181rcu_preempt08:44:010
112712290,4chrt0-21swapper/211:29:102
293742280,2sleep029377-21sort10:53:540
293742280,2sleep029377-21sort10:53:540
1224199281,7cyclictest15302-21chrt11:40:293
1224199281,7cyclictest15302-21chrt11:40:293
1224199281,4cyclictest213452sleep309:04:073
1224199280,7cyclictest27223-21chrt10:47:023
12233992822,5cyclictest26223-21timerwakeupswit12:09:131
12233992821,5cyclictest24150-21gltestperf10:39:021
12233992821,5cyclictest24150-21gltestperf10:39:021
12233992821,5cyclictest24150-21gltestperf10:39:021
12233992819,7cyclictest32231-21latency_hist08:08:491
12233992819,7cyclictest32231-21latency_hist08:08:491
12233992819,7cyclictest32172-21grep10:59:101
12233992819,7cyclictest32172-21grep10:59:101
12229992816,7cyclictest90-1pr/ttyS009:49:050
12229992816,7cyclictest90-1pr/ttyS009:49:050
298932270,3sleep0171ktimers/010:54:020
1224199278,16cyclictest303842chrt10:54:093
1224199271,9cyclictest2583-21chrt09:39:243
1224199271,9cyclictest2583-21chrt09:39:243
1224199271,7cyclictest7664-21chrt11:19:143
1224199271,7cyclictest7664-21chrt11:19:143
1224199271,7cyclictest7664-21chrt11:19:143
1224199271,7cyclictest22795-21chrt12:00:473
1224199271,7cyclictest22795-21chrt12:00:473
1224199271,6cyclictest5478-21chrt12:42:313
1224199271,6cyclictest5478-21chrt12:42:313
1224199271,6cyclictest5132-21chrt08:20:533
1224199271,6cyclictest5132-21chrt08:20:533
1224199271,6cyclictest3258-21chrt08:15:513
1224199271,6cyclictest30011-21chrt08:00:033
1224199271,6cyclictest30011-21chrt08:00:033
1224199271,6cyclictest29100-21chrt10:52:173
1224199271,6cyclictest29100-21chrt10:52:173
1224199271,6cyclictest26499-21chrt12:10:153
1224199271,6cyclictest25691-21chrt09:14:443
1224199271,6cyclictest23613-21chrt10:38:463
1224199271,6cyclictest23613-21chrt10:38:463
1224199271,6cyclictest11620-21chrt11:31:283
1224199270,7cyclictest4707-21chrt09:47:323
1224199270,7cyclictest24593-21chrt12:04:413
1224199270,7cyclictest19010-21chrt11:50:013
1224199270,7cyclictest19010-21chrt11:50:013
1224199270,6cyclictest24523-21chrt07:46:203
12233992722,4cyclictest30900-21systemctl09:29:111
12233992722,3cyclictest0-21swapper/110:28:491
12233992722,3cyclictest0-21swapper/109:34:021
12233992722,3cyclictest0-21swapper/109:34:021
12233992722,2cyclictest0-21swapper/111:24:001
12233992722,2cyclictest0-21swapper/111:24:001
12233992721,4cyclictest5161-21unixbench_singl12:39:131
12233992721,4cyclictest5161-21unixbench_singl12:39:131
12233992720,5cyclictest25925-21cut10:44:011
12233992719,6cyclictest2701-21processes08:14:091
12229992722,4cyclictest90-1pr/ttyS008:35:360
12229992722,3cyclictest90-1pr/ttyS012:02:120
12229992722,3cyclictest90-1pr/ttyS012:02:120
12229992722,3cyclictest90-1pr/ttyS008:12:350
12229992721,5cyclictest1346-21avahi-daemon11:43:490
12229992721,5cyclictest1346-21avahi-daemon11:43:490
12229992720,6cyclictest23572-21kernelversion07:44:030
12229992720,5cyclictest8222-21ntp_kernel_pll_08:29:070
12229992720,5cyclictest8222-21ntp_kernel_pll_08:29:070
12229992720,5cyclictest18583-21gltestperf10:24:030
12229992720,5cyclictest15516-21threads10:14:110
12229992720,5cyclictest15516-21threads10:14:110
12229992718,7cyclictest30662-21needreboot09:29:080
12229992718,7cyclictest22228-21cut10:34:010
12229992718,7cyclictest22228-21cut10:34:010
12229992717,8cyclictest16616-21processes11:44:090
12229992717,8cyclictest16616-21processes11:44:090
116342270,8chrt171ktimers/010:04:100
1224199268,14cyclictest108092chrt08:36:053
1224199262,4cyclictest0-21swapper/309:09:083
1224199262,4cyclictest0-21swapper/309:09:083
1224199261,7cyclictest29661-21chrt09:27:343
1224199261,6cyclictest951-21chrt09:37:313
1224199261,6cyclictest951-21chrt09:37:313
1224199261,6cyclictest4145-21chrt11:12:143
1224199261,6cyclictest32739-21taskset11:01:093
1224199261,6cyclictest32739-21taskset11:01:093
1224199261,6cyclictest31868-21chrt08:04:413
1224199261,6cyclictest31868-21chrt08:04:413
1224199261,6cyclictest30381-21chrt12:22:133
1224199261,6cyclictest30381-21chrt12:22:133
1224199261,6cyclictest22726-21chrt07:42:263
1224199261,6cyclictest22726-21chrt07:42:263
1224199261,6cyclictest21713-21chrt10:33:193
1224199261,6cyclictest21713-21chrt10:33:193
1224199261,6cyclictest20921-21chrt07:38:083
1224199261,6cyclictest20921-21chrt07:38:083
1224199261,6cyclictest19728-21chrt10:26:443
1224199261,6cyclictest17987-21chrt10:23:343
1224199261,6cyclictest17987-21chrt10:23:343
1224199260,6cyclictest5924-21chrt11:15:483
1224199260,6cyclictest1370-21chrt08:10:363
1224199260,6cyclictest12173-21chrt10:06:463
12233992621,4cyclictest12228-21cyclictest08:09:051
12233992620,5cyclictest14935-21threads11:39:101
12233992620,5cyclictest14935-21threads11:39:101
12233992619,5cyclictest3686-21kernelversion09:44:031
12233992618,6cyclictest20834-21tr10:29:061
12233992618,6cyclictest20834-21tr10:29:061
1222999262,4cyclictest171ktimers/010:10:080
12229992622,3cyclictest11610-21head08:39:040
12229992622,3cyclictest11610-21head08:39:040
12229992622,2cyclictest0-21swapper/012:33:490
12229992620,4cyclictest20192-21tail11:54:050
12229992619,4cyclictest15756-21ntp_kernel_pll_08:49:070
12229992616,3cyclictest181rcu_preempt08:23:050
12229992616,3cyclictest181rcu_preempt08:23:050
233182250,3sleep20-21swapper/212:03:592
1224199251,7cyclictest15341-21chrt10:14:103
1224199251,7cyclictest15341-21chrt10:14:103
1224199251,6cyclictest28328-21chrt12:14:503
1224199251,6cyclictest28328-21chrt12:14:503
1224199251,6cyclictest20130-21chrt09:00:293
1224199251,6cyclictest20130-21chrt09:00:293
1224199251,6cyclictest14462-21chrt08:44:253
1224199251,6cyclictest13487-21taskset11:36:273
1224199251,6cyclictest13487-21taskset11:36:273
1224199251,5cyclictest0-21swapper/312:29:053
1224199250,6cyclictest8781-21chrt08:29:173
1224199250,6cyclictest8781-21chrt08:29:173
1224199250,6cyclictest3597-21chrt12:37:373
1224199250,6cyclictest12848-21chrt08:43:163
1224199250,6cyclictest12848-21chrt08:43:163
12233992520,3cyclictest0-21swapper/109:04:091
12233992518,5cyclictest26233-21sshd07:49:221
12229992520,3cyclictest90-1pr/ttyS012:28:420
12229992520,3cyclictest90-1pr/ttyS012:28:420
12229992520,3cyclictest0-21swapper/008:59:130
12229992520,3cyclictest0-21swapper/008:59:130
12229992519,4cyclictest29763-21latency_hist09:28:490
12229992518,5cyclictest17972-21kernelversion07:29:070
12229992518,5cyclictest17972-21kernelversion07:29:070
12229992516,7cyclictest31980-21head10:59:070
12229992516,7cyclictest31980-21head10:59:070
12229992510,3cyclictest90-1pr/ttyS011:14:110
8672240,3sleep20-21swapper/211:04:012
8672240,3sleep20-21swapper/211:04:012
1224199241,8cyclictest26289-21chrt07:50:063
1224199241,7cyclictest10148-21chrt09:59:593
1224199241,7cyclictest10148-21chrt09:59:593
1224199241,7cyclictest10148-21chrt09:59:593
1224199241,6cyclictest32094-21chrt12:24:593
1224199241,6cyclictest32094-21chrt12:24:593
1224199241,6cyclictest31397-21chrt09:30:563
1224199240,7cyclictest17146-21taskset11:44:593
1224199240,7cyclictest17146-21taskset11:44:593
1224199240,7cyclictest13956-21chrt10:10:203
12233992419,4cyclictest13808-21unixbench_singl10:09:121
12233992418,4cyclictest5586-21latency09:49:051
12233992418,4cyclictest5586-21latency09:49:051
12233992418,3cyclictest0-21swapper/112:19:101
12233992418,3cyclictest0-21swapper/112:19:101
12233992418,3cyclictest0-21swapper/108:34:111
12233992417,5cyclictest22236-21fschecks_time10:34:011
12233992417,5cyclictest22236-21fschecks_time10:34:011
12233992416,6cyclictest17223-21grep10:19:091
12233992416,6cyclictest17223-21grep10:19:091
12233992415,7cyclictest17381-21kernelversion08:54:031
12233992415,7cyclictest17381-21kernelversion08:54:031
12229992419,4cyclictest19834-21kernelversion07:34:070
12229992419,4cyclictest19834-21kernelversion07:34:070
12229992418,4cyclictest0-21swapper/009:19:100
12229992418,4cyclictest0-21swapper/009:19:100
12229992418,3cyclictest0-21swapper/011:23:480
12229992418,3cyclictest0-21swapper/011:23:480
12229992418,3cyclictest0-21swapper/011:23:480
12229992417,5cyclictest23441-21cut12:04:010
1222999241,20cyclictest201rcuc/010:02:380
1222999241,20cyclictest201rcuc/010:02:380
1222999241,20cyclictest201rcuc/010:02:380
81532230,3sleep20-21swapper/208:29:042
81532230,3sleep20-21swapper/208:29:042
1224199232,4cyclictest202812sleep311:54:073
1224199230,6cyclictest5635-21taskset08:23:593
12240992311,8cyclictest9792-21chrt11:26:572
12240992311,8cyclictest9792-21chrt11:26:572
12233992318,3cyclictest0-21swapper/111:59:001
12233992318,3cyclictest0-21swapper/111:59:001
12233992318,3cyclictest0-21swapper/107:39:101
12233992318,3cyclictest0-21swapper/107:39:101
12233992318,2cyclictest0-21swapper/111:14:111
12233992317,4cyclictest0-21swapper/111:49:041
12233992317,4cyclictest0-21swapper/111:49:041
12233992316,5cyclictest15945-21sshd10:16:201
12233992316,5cyclictest15945-21sshd10:16:201
12233992314,7cyclictest28223-21sort09:24:001
12233992314,7cyclictest16523-21tr11:44:071
12233992314,7cyclictest16523-21tr11:44:071
12229992318,4cyclictest17021-21fschecks_count08:54:010
12229992318,4cyclictest17021-21fschecks_count08:54:010
12229992317,3cyclictest0-21swapper/012:09:040
12229992315,2cyclictest181rcu_preempt11:49:040
12229992315,2cyclictest181rcu_preempt11:49:040
12240992211,8cyclictest5271-21chrt08:22:212
12240992211,8cyclictest5271-21chrt08:22:212
12233992218,3cyclictest6712-21timerwakeupswit08:24:121
12233992218,3cyclictest12228-21cyclictest09:19:011
12233992218,3cyclictest12228-21cyclictest09:19:011
12233992218,2cyclictest0-21swapper/112:14:101
12233992218,2cyclictest0-21swapper/112:14:101
12233992217,3cyclictest0-21swapper/111:34:111
12233992217,3cyclictest0-21swapper/111:34:111
12233992217,3cyclictest0-21swapper/109:54:381
12233992217,3cyclictest0-21swapper/109:54:381
12233992216,3cyclictest0-21swapper/110:53:591
12233992215,5cyclictest18767-21sshd07:29:211
12233992215,5cyclictest18767-21sshd07:29:211
12233992215,5cyclictest11243-21timerwakeupswit11:29:101
1223399221,11cyclictest90422fschecks_time09:59:021
1223399221,11cyclictest90422fschecks_time09:59:021
1223399221,11cyclictest90422fschecks_time09:59:021
12229992219,2cyclictest0-21swapper/007:49:350
12240992112,7cyclictest26690-21chrt12:12:442
12240992112,6cyclictest21930-21chrt09:04:222
12240992112,6cyclictest10211-21chrt10:00:462
12240992112,6cyclictest10211-21chrt10:00:462
12240992112,6cyclictest10211-21chrt10:00:462
12233992117,2cyclictest0-21swapper/109:14:041
12233992117,2cyclictest0-21swapper/108:45:061
12240992016,2cyclictest0-21swapper/212:19:122
12240992016,2cyclictest0-21swapper/212:19:122
12240992011,7cyclictest0-21swapper/208:44:362
12240992010,7cyclictest27269-21chrt10:47:372
12233992016,3cyclictest28330-21ntp_offset10:49:091
12233992016,3cyclictest28330-21ntp_offset10:49:091
12233992014,5cyclictest23935-21rt-features07:44:081
12233992014,4cyclictest10830-21fschecks_count10:04:001
12233992013,4cyclictest0-21swapper/111:04:031
12233992013,4cyclictest0-21swapper/111:04:031
12240991915,2cyclictest0-21swapper/208:10:352
12240991915,2cyclictest0-21swapper/207:51:352
12240991913,3cyclictest0-21swapper/208:18:352
12240991911,6cyclictest16470-21chrt08:51:192
12240991910,6cyclictest22591-21chrt07:40:402
12240991910,6cyclictest22591-21chrt07:40:402
12233991915,2cyclictest0-21swapper/107:59:091
12233991915,2cyclictest0-21swapper/107:59:091
12233991914,4cyclictest24260-21switchtime12:04:101
57792180,4sleep20-21swapper/209:49:082
57792180,4sleep20-21swapper/209:49:082
1224099189,7cyclictest21068-21chrt11:57:322
1224099189,6cyclictest7710-21chrt11:19:492
1224099189,6cyclictest7710-21chrt11:19:492
1224099189,6cyclictest7710-21chrt11:19:492
1224099189,6cyclictest23799-21chrt09:09:282
1224099189,6cyclictest23799-21chrt09:09:282
1224099188,7cyclictest32616-21chrt10:59:312
1224099188,7cyclictest32616-21chrt10:59:312
1224099188,7cyclictest15279-21chrt11:40:112
1224099188,7cyclictest15279-21chrt11:40:112
12240991814,2cyclictest0-21swapper/211:53:112
12240991814,2cyclictest0-21swapper/211:53:112
12240991811,5cyclictest4601-21chrt09:46:112
12240991811,5cyclictest0-21swapper/210:05:082
12240991810,6cyclictest19095-21chrt07:33:372
12240991810,6cyclictest19095-21chrt07:33:372
12240991810,6cyclictest13608-21chrt11:38:022
12240991810,6cyclictest13608-21chrt11:38:022
12240991810,6cyclictest10788-21chrt08:35:482
12240991810,5cyclictest1044-21chrt09:38:432
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional