You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-26 - 00:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Tue Aug 25, 2026 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
848221150,2sleep30-21swapper/307:34:113
207121070,4chrt0-21swapper/310:09:173
2050021020,2chrt20502-21sed08:04:190
198002900,3sleep30-21swapper/308:04:103
90912810,3sleep20-21swapper/207:34:182
87422810,3sleep30-21swapper/308:59:223
87422810,3sleep30-21swapper/308:59:223
246172810,1sleep3431rcuc/309:44:123
246172810,1sleep3431rcuc/309:44:123
64102770,3sleep00-21swapper/007:29:100
208062740,3sleep30-21swapper/309:34:113
208062740,3sleep30-21swapper/309:34:113
148712730,5chrt14875-21mailstats12:09:210
148712730,5chrt14875-21mailstats12:09:210
274162690,3chrt0-21swapper/308:24:123
118532690,3sleep30-21swapper/309:09:153
118532690,3sleep30-21swapper/309:09:153
170932680,2chrt17092-21head10:49:151
170932680,2chrt17092-21head10:49:151
184932670,3sleep20-21swapper/210:54:142
184932670,3sleep20-21swapper/210:54:142
176612670,3sleep30-21swapper/312:19:053
167782660,2sleep20-21swapper/210:49:122
167782660,2sleep20-21swapper/210:49:122
100872640,3sleep20-21swapper/209:04:152
100872640,3sleep20-21swapper/209:04:152
250612600,3sleep20-21swapper/209:44:152
250612600,3sleep20-21swapper/209:44:152
116462600,2chrt0-21swapper/310:34:173
116462600,2chrt0-21swapper/310:34:173
63112580,3sleep20-21swapper/208:54:142
63112580,3sleep20-21swapper/208:54:142
276202580,2chrt0-21swapper/208:24:152
4002570,3chrt0-21swapper/308:39:123
4002570,3chrt0-21swapper/308:39:123
310882540,2sleep031281-21unixbench_singl09:59:220
310882540,2sleep031281-21unixbench_singl09:59:220
98642530,2chrt9863-21tail09:04:130
98642530,2chrt9863-21tail09:04:130
14192520,3chrt0-21swapper/211:34:142
72992470,3sleep30-21swapper/311:49:183
72992470,3sleep30-21swapper/311:49:183
31912470,2sleep20-21swapper/208:44:212
219692460,3sleep30-21swapper/308:09:183
219692460,3sleep30-21swapper/308:09:183
219162440,3sleep20-21swapper/212:29:132
136222410,2sleep2351rcuc/209:14:122
324412390,3chrt0-21swapper/308:39:043
255772390,3chrt0-21swapper/311:14:013
255772390,3chrt0-21swapper/311:14:013
299022380,2sleep20-21swapper/208:29:222
1053993831,5cyclictest545-21in:imuxsock09:03:581
1053993831,5cyclictest545-21in:imuxsock09:03:581
223742360,2sleep022406-21latency_hist09:39:000
223742360,2sleep022406-21latency_hist09:39:000
1053993527,6cyclictest16501-21processes07:54:181
312542340,2sleep10-21swapper/111:29:021
1053993425,7cyclictest32631-21needreboot10:04:171
98632330,2sleep04218-21kworker/u9:0-nfsiod07:38:590
320812330,2chrt0-21swapper/311:29:163
1053993327,4cyclictest1346-21avahi-daemon10:03:581
1053993327,4cyclictest1346-21avahi-daemon10:03:581
1053993327,4cyclictest1039-21cyclictest08:19:201
1053993324,7cyclictest6165-21threads10:19:211
1053993324,7cyclictest6165-21threads10:19:211
1053993324,7cyclictest17516-21kernelversion09:24:141
1053993324,7cyclictest17516-21kernelversion09:24:141
1052993327,4cyclictest11038-21fschecks_time10:34:100
1052993327,4cyclictest11038-21fschecks_time10:34:100
1052993324,7cyclictest25010-21latency_hist08:19:050
1053993226,5cyclictest18532-21fschecks_time10:54:141
1053993226,5cyclictest18532-21fschecks_time10:54:141
1052993224,6cyclictest3111-21latency_hist10:14:020
1052993223,7cyclictest3610-21cron08:48:580
326652310,4sleep20-21swapper/210:04:182
1052993126,3cyclictest9252-21cron09:03:580
1052993126,3cyclictest9252-21cron09:03:580
1052993124,5cyclictest26249-21kernelversion11:14:140
1052993124,5cyclictest26249-21kernelversion11:14:140
1052993124,5cyclictest2464-21latency_hist11:38:580
1053993022,6cyclictest20332-21fschecks_count10:59:121
1053993022,6cyclictest20332-21fschecks_count10:59:121
1053993022,6cyclictest19084-21fschecks_time09:29:121
1053993022,6cyclictest19084-21fschecks_time09:29:121
1053993022,6cyclictest17839-21fschecks_count12:19:111
1053993022,6cyclictest17839-21fschecks_count12:19:111
1053993021,7cyclictest15062-21kernelversion10:44:151
1053993021,7cyclictest15062-21kernelversion10:44:151
1052993022,6cyclictest12793-21netstat12:04:170
1052993022,6cyclictest12793-21netstat12:04:170
197042290,4sleep30-21swapper/312:24:123
197042290,4sleep30-21swapper/312:24:123
1053992924,3cyclictest982-21kworker/u9:3-rpciod08:03:591
1053992924,3cyclictest982-21kworker/u9:3-rpciod08:03:591
1053992920,7cyclictest12371-21threads09:09:211
1053992920,7cyclictest12371-21threads09:09:211
1052992920,7cyclictest14419-21latency_hist10:44:010
1052992920,7cyclictest14419-21latency_hist10:44:010
1053992822,5cyclictest23864-21netstat08:14:161
1053992821,5cyclictest1039-21cyclictest12:39:181
1053992821,5cyclictest1039-21cyclictest12:39:181
1053992818,7cyclictest4485-21latency_hist11:44:061
1053992818,7cyclictest4485-21latency_hist11:44:061
1053992818,7cyclictest4485-21latency_hist11:44:061
1052992823,4cyclictest1039-21cyclictest10:17:210
1052992823,4cyclictest1039-21cyclictest10:17:210
1052992823,3cyclictest0-21swapper/012:14:200
1052992823,3cyclictest0-21swapper/008:24:080
1052992821,5cyclictest25140-21needreboot09:44:180
1052992821,5cyclictest25140-21needreboot09:44:180
1052992821,5cyclictest10060-21/usr/sbin/munin07:39:170
1052992821,5cyclictest10060-21/usr/sbin/munin07:39:170
192922270,2chrt19295-21if_err_wlan009:29:140
192922270,2chrt19295-21if_err_wlan009:29:140
1053992723,3cyclictest2348-21swap10:09:211
1053992721,5cyclictest6224-21kernelversion08:54:141
1053992721,5cyclictest6224-21kernelversion08:54:141
1053992721,4cyclictest16046-21fschecks_time12:14:111
1053992720,5cyclictest4729-21tune2fs11:44:121
1053992720,5cyclictest4729-21tune2fs11:44:121
1053992720,5cyclictest11013-21switchtime07:39:201
1053992720,5cyclictest11013-21switchtime07:39:201
1053992718,7cyclictest7031-21tr07:29:171
1053992718,7cyclictest1491-21needreboot11:34:161
1052992722,3cyclictest60-21kcompactd012:01:230
1052992722,3cyclictest60-21kcompactd012:01:230
1052992722,3cyclictest0-21swapper/009:54:210
1052992722,2cyclictest0-21swapper/011:09:120
1052992722,2cyclictest0-21swapper/011:09:120
1052992721,3cyclictest0-21swapper/011:39:180
1052992721,3cyclictest0-21swapper/011:39:180
1052992721,3cyclictest0-21swapper/011:39:180
1052992720,5cyclictest17750-21sshd10:49:570
1052992720,5cyclictest17750-21sshd10:49:570
108592260,3sleep20-21swapper/210:34:082
108592260,3sleep20-21swapper/210:34:082
1053992620,5cyclictest8688-21idleruntime-cro10:28:591
1053992620,4cyclictest10144-21sed10:29:231
1053992620,4cyclictest10144-21sed10:29:231
105399260,22cyclictest13420-21runrttasks07:46:581
105399260,22cyclictest13420-21runrttasks07:46:581
1052992622,3cyclictest30951-21tail08:34:140
1052992622,2cyclictest0-21swapper/008:09:120
1052992622,2cyclictest0-21swapper/008:09:120
1052992621,4cyclictest21950-21kernelversion12:29:140
1052992620,4cyclictest0-21swapper/012:23:590
1052992620,4cyclictest0-21swapper/012:23:590
1052992620,4cyclictest0-21swapper/009:49:120
1052992619,5cyclictest17495-21latency_hist07:59:040
1052992617,7cyclictest18805-21latency_hist09:29:050
1052992617,7cyclictest18805-21latency_hist09:29:050
1052992614,6cyclictest14146-21readlink09:14:190
60942250,2sleep06096-21head08:54:120
60942250,2sleep06096-21head08:54:120
1055992516,5cyclictest101552sleep307:39:103
1055992516,5cyclictest101552sleep307:39:103
1054992520,3cyclictest85982sleep208:59:222
1054992520,3cyclictest85982sleep208:59:222
1053992519,4cyclictest10576-21gltestperf11:59:121
1053992519,4cyclictest10576-21gltestperf11:59:121
1053992519,4cyclictest0-21swapper/110:39:121
1053992519,4cyclictest0-21swapper/110:39:121
1053992518,5cyclictest28917-21fschecks_count08:29:121
1053992518,5cyclictest23851-21latency_hist11:09:051
1053992518,5cyclictest22857-21fschecks_time09:39:111
1053992518,5cyclictest22857-21fschecks_time09:39:111
1053992518,5cyclictest22857-21fschecks_time09:39:111
1053992518,5cyclictest21661-21fschecks_time12:29:121
1053992518,5cyclictest14165-21gltestperf07:49:131
1053992517,6cyclictest19442-21sort08:04:081
105399251,22cyclictest3376-21chrt08:45:571
1052992521,3cyclictest1039-21cyclictest08:49:120
1052992521,3cyclictest1039-21cyclictest08:49:120
1052992520,3cyclictest0-21swapper/009:39:120
1052992520,3cyclictest0-21swapper/009:39:120
1052992520,3cyclictest0-21swapper/009:39:120
1052992520,3cyclictest0-21swapper/008:29:180
1052992519,5cyclictest30007-21kernelversion11:24:150
1052992519,4cyclictest545-21in:imuxsock10:54:070
1052992519,4cyclictest545-21in:imuxsock10:54:070
1052992519,4cyclictest0-21swapper/011:44:140
1052992519,4cyclictest0-21swapper/011:44:140
1052992519,4cyclictest0-21swapper/010:29:220
1052992519,4cyclictest0-21swapper/010:29:220
1052992518,5cyclictest25675-21needreboot08:19:160
1053992416,6cyclictest1-21systemd08:53:571
1053992416,6cyclictest1-21systemd08:53:571
1052992419,4cyclictest1039-21cyclictest08:02:270
1052992419,4cyclictest1039-21cyclictest08:02:270
1052992419,3cyclictest0-21swapper/010:24:180
1052992418,4cyclictest0-21swapper/011:50:580
1052992418,4cyclictest0-21swapper/011:50:580
1052992418,3cyclictest0-21swapper/011:54:180
1052992418,3cyclictest0-21swapper/011:54:180
1052992418,3cyclictest0-21swapper/011:19:210
1052992418,3cyclictest0-21swapper/011:19:210
1052992417,5cyclictest25667-21kernelversion12:39:140
1052992417,5cyclictest25667-21kernelversion12:39:140
105399239,12cyclictest14678-21systemd-journal07:38:581
1053992319,2cyclictest0-21swapper/109:19:111
1053992319,2cyclictest0-21swapper/109:19:111
1053992318,4cyclictest32672-21fschecks_count08:39:111
1053992318,4cyclictest32672-21fschecks_count08:39:111
1053992318,3cyclictest0-21swapper/108:34:151
1052992319,2cyclictest0-21swapper/011:04:230
1052992318,3cyclictest0-21swapper/008:43:590
1052992318,3cyclictest0-21swapper/008:43:590
1052992317,5cyclictest15377-21fschecks_time09:19:110
1052992317,5cyclictest15377-21fschecks_time09:19:110
1052992316,4cyclictest0-21swapper/007:44:580
1052992316,4cyclictest0-21swapper/007:44:580
1053992218,3cyclictest1039-21cyclictest08:27:471
1053992218,2cyclictest0-21swapper/108:09:201
1053992218,2cyclictest0-21swapper/108:09:201
1053992217,3cyclictest0-21swapper/109:04:121
1053992217,3cyclictest0-21swapper/109:04:121
1053992217,2cyclictest0-21swapper/111:54:201
1053992217,2cyclictest0-21swapper/111:54:201
1053992216,4cyclictest28571-21gltestperf09:54:131
1053992216,3cyclictest0-21swapper/112:09:161
1053992216,3cyclictest0-21swapper/112:09:161
1053992215,4cyclictest0-21swapper/110:34:171
1053992215,4cyclictest0-21swapper/110:34:171
1052992218,2cyclictest0-21swapper/012:34:150
1052992217,4cyclictest20834-21/usr/sbin/munin10:59:170
1052992217,4cyclictest20834-21/usr/sbin/munin10:59:170
1054992115,4cyclictest18172sleep208:44:012
1054992115,4cyclictest18172sleep208:44:012
105399217,4cyclictest181rcu_preempt12:04:191
105399217,4cyclictest181rcu_preempt12:04:191
1053992117,3cyclictest26830-21/usr/sbin/munin09:49:131
1053992117,2cyclictest0-21swapper/112:28:581
1053992117,2cyclictest0-21swapper/112:28:581
1053992117,2cyclictest0-21swapper/109:14:111
1053992116,3cyclictest0-21swapper/109:34:131
1053992116,3cyclictest0-21swapper/109:34:131
1053992115,5cyclictest23577-21fschecks_time12:34:131
1053992114,5cyclictest24114-21fschecks_time11:09:111
1053992114,5cyclictest24114-21fschecks_time11:09:111
1053992114,5cyclictest0-21swapper/111:49:111
1053992114,5cyclictest0-21swapper/111:49:111
105399211,11cyclictest26035-21fschecks_time11:14:121
105399211,11cyclictest26035-21fschecks_time11:14:121
105299216,12cyclictest544-21lldpd12:26:540
105299216,12cyclictest544-21lldpd12:26:540
1052992116,3cyclictest5368-21fschecks_time10:19:120
1052992116,3cyclictest5368-21fschecks_time10:19:120
1052992116,3cyclictest0-21swapper/009:09:210
1052992116,3cyclictest0-21swapper/009:09:210
1052992115,3cyclictest0-21swapper/011:29:190
1052992113,6cyclictest578-21cat10:04:210
124402200,3sleep20-21swapper/209:09:222
124402200,3sleep20-21swapper/209:09:222
105599204,9cyclictest151122sleep307:49:243
1053992016,2cyclictest0-21swapper/109:44:231
1053992016,2cyclictest0-21swapper/109:44:231
105399201,4cyclictest31863-21irqstats11:29:141
1053992014,4cyclictest0-21swapper/111:19:201
1053992014,4cyclictest0-21swapper/111:19:201
1052992016,2cyclictest0-21swapper/010:44:110
1052992016,2cyclictest0-21swapper/010:44:110
1052992015,3cyclictest14259-21if_err_wlan007:49:140
45042190,3sleep20-21swapper/208:49:162
45042190,3sleep20-21swapper/208:49:162
105499193,10cyclictest0-21swapper/211:56:582
105499193,10cyclictest0-21swapper/211:56:582
105499193,10cyclictest0-21swapper/210:46:572
105499193,10cyclictest0-21swapper/210:46:572
105499193,10cyclictest0-21swapper/207:55:572
1053991910,7cyclictest3415-21fschecks_count10:14:121
1053991910,7cyclictest3415-21fschecks_count10:14:121
105599183,11cyclictest0-21swapper/310:29:583
105599183,11cyclictest0-21swapper/310:29:583
105599181,12cyclictest13749-21chrt09:14:133
105499182,13cyclictest24252-21chrt09:43:592
105499182,13cyclictest24252-21chrt09:43:592
105499182,13cyclictest24252-21chrt09:43:592
105499181,13cyclictest12014-21chrt12:04:052
105499181,13cyclictest12014-21chrt12:04:052
105499181,11cyclictest0-21swapper/209:54:052
105599173,10cyclictest0-21swapper/311:56:583
105599173,10cyclictest0-21swapper/311:56:583
105599173,10cyclictest0-21swapper/307:55:573
105599172,7cyclictest0-21swapper/309:54:053
1055991712,3cyclictest0-21swapper/309:43:203
1055991712,3cyclictest0-21swapper/309:43:203
1055991712,3cyclictest0-21swapper/309:43:203
105599171,13cyclictest1706-21taskset11:34:193
105599171,12cyclictest12973-21taskset10:39:123
105599171,12cyclictest12973-21taskset10:39:123
105499171,13cyclictest3051-21taskset11:39:122
105499171,13cyclictest3051-21taskset11:39:122
105499171,13cyclictest3051-21taskset11:39:122
105499171,13cyclictest27730-21taskset11:19:102
105499171,13cyclictest27730-21taskset11:19:102
105499171,13cyclictest13554-21taskset10:39:192
105499171,13cyclictest13554-21taskset10:39:192
105499171,12cyclictest28468-21chrt09:54:122
105499171,11cyclictest17616-21chrt12:19:042
105599163,9cyclictest0-21swapper/310:46:573
105599163,9cyclictest0-21swapper/310:46:573
105599161,13cyclictest18756-21chrt12:19:213
105599161,13cyclictest18756-21chrt12:19:213
1055991611,3cyclictest0-21swapper/311:02:523
1055991611,3cyclictest0-21swapper/311:02:523
105599161,12cyclictest26113-21chrt11:14:133
105599161,12cyclictest26113-21chrt11:14:133
105599161,12cyclictest23414-21taskset08:14:113
105599161,12cyclictest15420-21taskset09:19:123
105599161,12cyclictest15420-21taskset09:19:123
1055991610,4cyclictest104512sleep311:59:123
1055991610,4cyclictest104512sleep311:59:123
105499168,5cyclictest186272sleep212:19:212
105499168,5cyclictest186272sleep212:19:212
105499163,8cyclictest0-21swapper/207:49:242
105499161,9cyclictest0-21swapper/209:24:582
105499161,9cyclictest0-21swapper/209:24:582
105499161,6cyclictest0-21swapper/211:04:122
105499161,11cyclictest21461-21taskset08:09:122
105499161,11cyclictest21461-21taskset08:09:122
105499161,11cyclictest0-21swapper/207:44:142
105499161,11cyclictest0-21swapper/207:44:142
189592151,2sleep20-21swapper/208:01:012
189592151,2sleep20-21swapper/208:01:012
105599153,9cyclictest0-21swapper/310:56:583
105599153,9cyclictest0-21swapper/310:56:583
105599152,9cyclictest0-21swapper/312:31:583
105599152,11cyclictest0-21swapper/310:19:153
105599152,11cyclictest0-21swapper/310:19:153
105599152,11cyclictest0-21swapper/308:54:213
105599152,11cyclictest0-21swapper/308:54:213
1055991511,3cyclictest0-21swapper/310:01:213
1055991511,3cyclictest0-21swapper/310:01:213
105599151,11cyclictest25979-21taskset12:39:193
105599151,11cyclictest25979-21taskset12:39:193
105599151,10cyclictest29938-21taskset11:24:143
105599150,11cyclictest25123-21taskset08:19:103
105499152,9cyclictest23750-21chrt08:14:142
105499152,9cyclictest0-21swapper/211:51:582
105499152,9cyclictest0-21swapper/211:51:582
105499152,11cyclictest8147-21chrt10:24:192
105499152,10cyclictest0-21swapper/209:19:112
105499152,10cyclictest0-21swapper/209:19:112
105499151,7cyclictest0-21swapper/212:09:122
105499151,7cyclictest0-21swapper/212:09:122
105499151,7cyclictest0-21swapper/207:29:122
105499151,11cyclictest25665-21chrt12:39:142
105499151,11cyclictest25665-21chrt12:39:142
105499151,11cyclictest0-21swapper/210:19:152
105499151,11cyclictest0-21swapper/210:19:152
105499151,10cyclictest30185-21chrt09:59:112
105499151,10cyclictest30185-21chrt09:59:112
105499151,10cyclictest25022-21chrt08:19:092
105499151,10cyclictest0-21swapper/211:24:112
105499151,10cyclictest0-21swapper/210:29:132
105499151,10cyclictest0-21swapper/210:29:132
105599149,3cyclictest54472sleep311:44:213
105599149,3cyclictest54472sleep311:44:213
105599149,3cyclictest297332chrt09:57:353
105599149,3cyclictest0-21swapper/310:27:213
105599149,3cyclictest0-21swapper/307:31:173
105599148,4cyclictest176882sleep307:59:133
105599148,4cyclictest176882sleep307:59:133
105599148,4cyclictest145712chrt12:09:163
105599148,4cyclictest145712chrt12:09:163
105599141,9cyclictest0-21swapper/309:24:583
105599141,9cyclictest0-21swapper/309:24:583
105599141,9cyclictest0-21swapper/308:44:573
105599141,11cyclictest19812-21chrt09:29:213
105599141,11cyclictest19812-21chrt09:29:213
105599141,10cyclictest12835-21taskset12:04:183
105599141,10cyclictest12835-21taskset12:04:183
105599141,10cyclictest0-21swapper/307:44:143
105599141,10cyclictest0-21swapper/307:44:143
1055991410,3cyclictest0-21swapper/311:40:533
1055991410,3cyclictest0-21swapper/311:40:533
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional