You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-29 - 18:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Sat Aug 29, 2026 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2007021330,2sleep2351rcuc/208:59:152
2007021330,2sleep2351rcuc/208:59:152
2559121080,3sleep20-21swapper/209:14:152
2559121080,3sleep20-21swapper/209:14:152
83392780,3sleep30-21swapper/311:19:263
83392780,3sleep30-21swapper/311:19:263
38122780,3sleep00-21swapper/011:09:140
38122780,3sleep00-21swapper/011:09:140
12212670,4sleep20-21swapper/209:34:212
12212670,4sleep20-21swapper/209:34:212
152112660,3sleep30-21swapper/311:39:163
152112660,3sleep30-21swapper/311:39:163
33902640,1sleep00-21swapper/012:34:160
12782570,10sleep0171ktimers/008:09:170
80862550,2chrt8085-21sshd08:26:090
286442550,4sleep30-21swapper/312:14:183
286442550,4sleep30-21swapper/312:14:183
8932540,2sleep0931-21cut08:09:050
8932540,2sleep0931-21cut08:09:050
198472540,2chrt0-21swapper/008:59:130
198472540,2chrt0-21swapper/008:59:130
98052530,2sleep10-21swapper/109:59:081
98052530,2sleep10-21swapper/109:59:081
307832520,2sleep20-21swapper/210:54:172
320542510,2sleep032056-21xargs09:29:240
143312510,3sleep20-21swapper/208:44:172
198012500,3chrt0-21swapper/311:49:253
198012500,3chrt0-21swapper/311:49:253
274032470,3chrt0-21swapper/009:19:150
274032470,3chrt0-21swapper/009:19:150
257702460,2chrt0-21swapper/309:14:163
257702460,2chrt0-21swapper/309:14:163
81372450,2chrt0-21swapper/309:54:163
81372450,2chrt0-21swapper/309:54:163
319262450,1sleep3431rcuc/309:29:233
278532440,2sleep016-21ksoftirqd/007:54:130
10232440,3sleep11027-21latency_hist12:29:031
10232440,3sleep11027-21latency_hist12:29:031
46912420,2sleep20-21swapper/208:19:072
46912420,2sleep20-21swapper/208:19:072
41612420,3sleep20-21swapper/209:44:102
41612420,3sleep20-21swapper/209:44:102
25842400,3sleep30-21swapper/309:39:163
25842400,3sleep30-21swapper/309:39:163
13274994031,7cyclictest4005-21sendmail09:44:020
13274994031,7cyclictest4005-21sendmail09:44:020
45272390,8sleep14528-21cron08:19:021
45272390,8sleep14528-21cron08:19:021
107172390,3sleep30-21swapper/308:34:163
43052380,2sleep14369-21awk11:09:201
43052380,2sleep14369-21awk11:09:201
241002380,3sleep20-21swapper/207:44:102
241002380,3sleep20-21swapper/207:44:102
324212370,2sleep132456-21fschecks_count10:59:151
324212370,2sleep132456-21fschecks_count10:59:151
13274993728,7cyclictest18229-21gltestperf08:54:170
322432360,3sleep10-21swapper/109:29:251
13274993627,7cyclictest30726-21threads07:59:240
13274993627,7cyclictest30726-21threads07:59:240
121822360,2sleep012358-21sed11:29:250
121822360,2sleep012358-21sed11:29:250
10442360,3sleep20-21swapper/208:09:152
72352350,2sleep2351rcuc/209:49:242
72352350,2sleep2351rcuc/209:49:242
1327799351,28cyclictest0-21swapper/207:45:402
13275993527,6cyclictest17825-21threads11:44:241
13275993527,6cyclictest17825-21threads11:44:241
13275993429,3cyclictest90-1pr/ttyS012:36:081
13274993428,5cyclictest23866-21gltestperf09:09:160
13274993425,7cyclictest15105-21fschecks_count11:39:160
13274993425,7cyclictest15105-21fschecks_count11:39:160
13274993419,13cyclictest0-21swapper/009:49:150
13274993419,13cyclictest0-21swapper/009:49:150
23402330,3sleep30-21swapper/311:04:193
23402330,3sleep30-21swapper/311:04:193
1327499335,14cyclictest30657-21runrttasks09:26:590
1327499335,14cyclictest30657-21runrttasks09:26:590
13274993327,5cyclictest31577-21latency_hist12:24:030
13274993327,5cyclictest31577-21latency_hist12:24:030
13274993324,7cyclictest29605-21threads10:49:260
13274993324,7cyclictest29605-21threads10:49:260
13274993322,8cyclictest700-21192.168.115.40-manager12:05:490
13274993320,11cyclictest23410-21threads11:59:250
13274993320,11cyclictest23410-21threads11:59:250
1327799321,26cyclictest0-21swapper/210:01:142
1327799321,26cyclictest0-21swapper/210:01:142
1327799321,26cyclictest0-21swapper/210:01:142
1327799321,24cyclictest0-21swapper/210:53:092
1327799321,24cyclictest0-21swapper/210:53:092
13275993225,5cyclictest25173-21cron09:14:021
13274993224,6cyclictest22532-21gltestperf07:39:160
13274993224,6cyclictest22532-21gltestperf07:39:160
181042310,3chrt0-21swapper/110:19:221
181042310,3chrt0-21swapper/110:19:221
1327799311,26cyclictest0-21swapper/209:55:272
1327799311,26cyclictest0-21swapper/209:55:272
1327799311,23cyclictest0-21swapper/211:49:322
1327799311,23cyclictest0-21swapper/211:49:322
1327799311,23cyclictest0-21swapper/209:25:172
1327799311,23cyclictest0-21swapper/209:25:172
1327799311,22cyclictest0-21swapper/211:57:322
13275993125,4cyclictest572-21cups-browsed09:44:221
13275993125,4cyclictest572-21cups-browsed09:44:221
13275993124,5cyclictest29484-21cron07:59:021
13275993122,7cyclictest20711-21fschecks_count11:54:151
1327499317,12cyclictest27479-21taskset12:09:320
1327499317,12cyclictest27479-21taskset12:09:320
1327499315,12cyclictest20254-21taskset11:53:190
1327499315,12cyclictest20254-21taskset11:53:190
13274993125,4cyclictest0-21swapper/011:54:230
13274993124,5cyclictest13846-21cut10:09:170
13274993124,5cyclictest13846-21cut10:09:170
13274993120,8cyclictest25341-21kernelversion10:39:200
13274993120,8cyclictest25341-21kernelversion10:39:200
1327799301,20cyclictest0-21swapper/211:42:182
1327799301,20cyclictest0-21swapper/211:42:182
1327599302,5cyclictest0-21swapper/112:34:041
13275993023,5cyclictest29087-21kernelversion10:49:191
13275993023,5cyclictest29087-21kernelversion10:49:191
13275993021,7cyclictest6776-21needreboot09:49:191
13275993021,7cyclictest6776-21needreboot09:49:191
1327499308,10cyclictest14860-21sshd11:39:080
1327499308,10cyclictest14860-21sshd11:39:080
1327499306,8cyclictest11834-21taskset08:36:060
1327499305,13cyclictest21733-21chrt07:35:200
13274993024,5cyclictest24632-21kernelversion07:44:190
13274993023,5cyclictest13272-21cyclictest09:57:430
13274993023,5cyclictest13272-21cyclictest09:57:430
13274993022,6cyclictest5707-21fschecks_count11:14:170
13274993021,7cyclictest3488-21latency_hist11:09:050
13274993021,7cyclictest3488-21latency_hist11:09:050
1327799291,23cyclictest0-21swapper/211:36:502
1327799291,23cyclictest0-21swapper/211:36:502
1327799291,20cyclictest0-21swapper/208:03:412
1327799291,20cyclictest0-21swapper/208:03:412
1327799291,20cyclictest0-21swapper/207:57:212
13275992923,5cyclictest3355-21threads09:39:261
13275992923,5cyclictest3355-21threads09:39:261
13275992923,4cyclictest13272-21cyclictest10:39:181
13275992923,4cyclictest13272-21cyclictest10:39:181
13275992922,5cyclictest26692-21kernelversion12:09:171
13275992922,5cyclictest26692-21kernelversion12:09:171
13275992922,5cyclictest15272-21gltestperf11:39:161
13275992922,5cyclictest15272-21gltestperf11:39:161
13275992920,7cyclictest22691-21threads09:04:261
13275992920,7cyclictest22691-21threads09:04:261
1327499295,7cyclictest18801-21chrt10:21:180
1327499295,7cyclictest18801-21chrt10:21:180
1327499294,8cyclictest13257-21runrttasks10:07:230
1327499294,11cyclictest6452-21taskset12:41:460
1327499294,11cyclictest6452-21taskset12:41:460
1327499294,11cyclictest11322-21taskset10:01:450
1327499294,11cyclictest11322-21taskset10:01:450
1327499294,11cyclictest11322-21taskset10:01:450
13274992924,4cyclictest601-21snmpd10:54:150
13274992923,3cyclictest0-21swapper/008:29:190
13274992923,3cyclictest0-21swapper/008:29:190
13274992921,6cyclictest23184-21cut10:34:150
13274992919,7cyclictest0-21swapper/011:22:080
13274992919,7cyclictest0-21swapper/011:22:080
1327799281,20cyclictest0-21swapper/212:36:082
1327799281,19cyclictest0-21swapper/208:32:262
1327799281,19cyclictest0-21swapper/208:32:262
13275992823,4cyclictest1346-21avahi-daemon10:24:251
13275992823,4cyclictest1346-21avahi-daemon10:24:251
13275992821,5cyclictest25892-21if_wlan009:14:171
13275992821,5cyclictest25892-21if_wlan009:14:171
13275992821,5cyclictest23301-21ls07:39:251
13275992821,5cyclictest23301-21ls07:39:251
13275992821,5cyclictest14141-21kernelversion10:09:191
13275992821,5cyclictest14141-21kernelversion10:09:191
13275992821,4cyclictest0-21swapper/112:39:261
13275992821,4cyclictest0-21swapper/112:39:261
13275992820,6cyclictest30391-21needreboot07:59:201
13275992820,6cyclictest30391-21needreboot07:59:201
13275992820,6cyclictest19811-21cpu08:59:131
13275992820,6cyclictest19811-21cpu08:59:131
13274992823,3cyclictest32675-21gltestperf10:59:160
13274992823,3cyclictest32675-21gltestperf10:59:160
13274992819,7cyclictest700-21192.168.115.40-manager08:51:390
13274992819,7cyclictest700-21192.168.115.40-manager08:51:390
13274992817,9cyclictest13272-21cyclictest10:47:060
1327799271,21cyclictest12464-21chrt11:29:382
1327799271,21cyclictest12464-21chrt11:29:382
1327799271,20cyclictest3256-21chrt11:07:032
1327799271,20cyclictest3256-21chrt11:07:032
1327799271,19cyclictest0-21swapper/207:52:102
13275992721,5cyclictest12783-21kernelversion08:39:191
13275992721,5cyclictest12783-21kernelversion08:39:191
13275992720,5cyclictest30517-21sshd09:25:091
13275992720,5cyclictest30517-21sshd09:25:091
13275992718,7cyclictest27222-21kernelversion10:44:181
13275992718,7cyclictest10222-21latency_hist08:34:031
13275992718,7cyclictest10222-21latency_hist08:34:031
13275992717,7cyclictest20911-21latency07:34:171
13274992722,3cyclictest0-21swapper/008:24:020
13274992722,3cyclictest0-21swapper/008:24:020
13274992722,3cyclictest0-21swapper/007:49:180
13274992721,4cyclictest1027-21latency09:34:170
13274992721,4cyclictest1027-21latency09:34:170
13274992720,5cyclictest4384-21fschecks_count09:44:130
13274992720,5cyclictest4384-21fschecks_count09:44:130
13274992717,7cyclictest700-21192.168.115.40-manager09:05:280
13274992717,7cyclictest700-21192.168.115.40-manager09:05:280
13274992713,11cyclictest700-21192.168.115.40-manager08:39:270
13274992713,11cyclictest700-21192.168.115.40-manager08:39:270
127012270,3sleep30-21swapper/310:04:253
1327799261,21cyclictest22399-21chrt09:04:222
1327799261,21cyclictest22399-21chrt09:04:222
1327799261,20cyclictest5276-21chrt12:39:172
1327799261,20cyclictest5276-21chrt12:39:172
1327799261,19cyclictest8676-21chrt11:19:332
1327799261,19cyclictest8676-21chrt11:19:332
13275992620,5cyclictest14678-21systemd-journal10:18:101
13275992620,3cyclictest0-21swapper/112:24:031
13275992620,3cyclictest0-21swapper/112:24:031
13275992619,5cyclictest14795-21latency_hist11:39:051
13275992619,5cyclictest14795-21latency_hist11:39:051
1327499262,8cyclictest713-21taskset12:25:180
1327499262,8cyclictest713-21taskset12:25:180
1327499262,11cyclictest27006-21runrttasks09:18:180
1327499262,11cyclictest27006-21runrttasks09:18:180
13274992619,5cyclictest17516-21netstat11:44:200
13274992619,5cyclictest17516-21netstat11:44:200
13274992616,7cyclictest0-21swapper/008:14:440
13274992616,7cyclictest0-21swapper/008:14:440
14422250,2chrt0-21swapper/108:09:181
1327799251,20cyclictest5141-21chrt11:12:222
1327799251,20cyclictest5141-21chrt11:12:222
1327799251,20cyclictest31259-21chrt12:20:152
1327799251,20cyclictest31259-21chrt12:20:152
1327799251,20cyclictest28001-21chrt09:19:212
1327799251,20cyclictest28001-21chrt09:19:212
1327799251,20cyclictest2799-21chrt12:33:022
1327799251,20cyclictest25937-21chrt12:08:422
1327799251,20cyclictest19475-21chrt08:57:512
1327799251,20cyclictest168982sleep210:15:542
1327799251,20cyclictest14707-21chrt10:09:262
1327799251,20cyclictest14707-21chrt10:09:262
1327799251,20cyclictest12665-21chrt08:39:172
1327799251,20cyclictest12665-21chrt08:39:172
1327799251,19cyclictest6013-21chrt11:14:192
1327799251,19cyclictest518-21chrt08:05:492
1327799251,19cyclictest518-21chrt08:05:492
1327799251,19cyclictest18365-21chrt11:47:592
1327799251,19cyclictest18365-21chrt11:47:592
1327799251,19cyclictest17533-21chrt08:51:522
1327799251,19cyclictest17533-21chrt08:51:522
1327799251,19cyclictest1262-21chrt11:00:442
1327799251,19cyclictest1262-21chrt11:00:442
1327799251,19cyclictest11781-21taskset08:35:242
1327799250,20cyclictest23764-21chrt12:00:342
1327799250,20cyclictest23764-21chrt12:00:342
13275992519,3cyclictest0-21swapper/110:29:171
13275992519,3cyclictest0-21swapper/110:29:171
13275992518,5cyclictest23883-21sshd12:02:081
13275992518,5cyclictest23883-21sshd12:02:081
13275992518,5cyclictest14807-21missed_timers08:44:201
13275992516,7cyclictest23687-21netstat10:34:201
13275992516,7cyclictest11389-21sort08:34:241
1327499252,8cyclictest28055-21/usr/sbin/munin12:14:160
1327499252,8cyclictest28055-21/usr/sbin/munin12:14:160
13274992519,3cyclictest0-21swapper/008:44:180
13274992512,11cyclictest700-21192.168.115.40-manager10:16:170
13274992510,4cyclictest90-1pr/ttyS010:33:210
13274992510,4cyclictest90-1pr/ttyS010:33:210
13286992412,9cyclictest27804-21chrt12:13:453
13286992412,9cyclictest27804-21chrt12:13:453
13286992411,10cyclictest7115-21chrt11:18:303
1327799241,19cyclictest32434-21chrt09:30:552
1327799241,19cyclictest27639-21taskset10:44:242
1327799241,19cyclictest24555-21chrt09:09:242
1327799241,19cyclictest22983-21chrt10:34:112
1327799241,19cyclictest20640-21taskset10:25:422
1327799241,19cyclictest20640-21taskset10:25:422
1327799241,18cyclictest8052-21taskset08:25:432
1327799241,18cyclictest21693-21chrt07:34:492
1327799241,18cyclictest13178-21taskset10:06:212
1327799241,18cyclictest0-21swapper/212:10:272
1327799241,18cyclictest0-21swapper/212:10:272
1327799240,20cyclictest22555-21chrt10:31:252
1327799240,20cyclictest22555-21chrt10:31:252
1327799240,20cyclictest18891-21chrt10:22:292
1327799240,20cyclictest18891-21chrt10:22:292
1327799240,19cyclictest5530-21chrt09:44:262
1327799240,19cyclictest5530-21chrt09:44:262
13275992420,2cyclictest0-21swapper/107:49:021
13275992419,3cyclictest0-21swapper/110:04:251
13275992419,3cyclictest0-21swapper/108:54:191
13275992418,3cyclictest32318-21ntp_kernel_pll_08:04:211
13275992418,3cyclictest32318-21ntp_kernel_pll_08:04:211
13275992418,3cyclictest0-21swapper/111:04:161
13275992418,3cyclictest0-21swapper/111:04:161
13275992417,6cyclictest7748-21gltestperf11:19:191
13275992417,6cyclictest7748-21gltestperf11:19:191
13274992415,7cyclictest0-21swapper/010:24:450
13274992415,7cyclictest0-21swapper/010:24:450
1327799231,18cyclictest9592-21chrt11:24:162
1327799231,18cyclictest9592-21chrt11:24:162
1327799231,18cyclictest26193-21chrt10:40:182
1327799231,18cyclictest26193-21chrt10:40:182
13275992319,3cyclictest6760-21unixbench_singl11:14:271
13275992318,3cyclictest0-21swapper/111:29:181
13275992318,3cyclictest0-21swapper/111:29:181
13275992318,3cyclictest0-21swapper/110:54:241
13275992317,5cyclictest25505-21unixbench_singl12:04:251
13275992314,7cyclictest17047-21switchtime08:49:251
13275992314,7cyclictest17047-21switchtime08:49:251
1327499237,13cyclictest9854-21sed11:24:180
1327499237,13cyclictest9854-21sed11:24:180
13274992317,5cyclictest1747-21kernelversion12:29:210
49012220,4sleep30-21swapper/311:09:253
49012220,4sleep30-21swapper/311:09:253
13286992212,7cyclictest2558-21chrt08:12:373
13286992211,8cyclictest25142-21chrt09:13:403
13286992211,8cyclictest1331-21chrt11:01:373
13286992211,8cyclictest1331-21chrt11:01:373
1327799221,18cyclictest29351-21chrt12:14:412
1327799221,18cyclictest29351-21chrt12:14:412
1327799220,18cyclictest708-21chrt12:25:142
1327799220,18cyclictest708-21chrt12:25:142
13275992217,4cyclictest19201-21latency11:49:181
13275992217,4cyclictest19201-21latency11:49:181
13275992217,3cyclictest0-21swapper/109:59:261
13275992217,3cyclictest0-21swapper/109:59:261
13275992217,3cyclictest0-21swapper/109:59:261
13275992216,4cyclictest28416-21gltestperf12:14:151
13275992216,4cyclictest28416-21gltestperf12:14:151
13275992216,4cyclictest0-21swapper/109:34:141
13275992216,4cyclictest0-21swapper/109:34:141
13275992216,3cyclictest0-21swapper/111:24:231
13275992216,3cyclictest0-21swapper/111:24:231
13275992216,3cyclictest0-21swapper/107:49:151
13275992214,6cyclictest8462-21latency_hist08:29:071
13286992112,6cyclictest23986-21chrt12:03:283
13286992112,6cyclictest23986-21chrt12:03:283
13286992112,6cyclictest14681-21chrt11:38:483
13286992112,6cyclictest14681-21chrt11:38:483
13286992111,7cyclictest4532-21chrt12:36:213
13286992111,7cyclictest31385-21chrt12:21:493
13286992111,7cyclictest31385-21chrt12:21:493
13286992111,7cyclictest26436-21chrt10:43:283
13286992111,7cyclictest26436-21chrt10:43:283
13286992111,7cyclictest1848-21chrt09:35:343
13286992111,7cyclictest1848-21chrt09:35:343
13286992110,8cyclictest10620-21chrt11:24:533
13286992110,8cyclictest10620-21chrt11:24:533
1327799211,18cyclictest6320-21chrt08:22:412
1327799211,18cyclictest6320-21chrt08:22:412
13275992116,3cyclictest0-21swapper/108:19:141
13275992116,3cyclictest0-21swapper/108:19:141
20012200,1sleep3431rcuc/312:29:253
1328699209,9cyclictest6506-21chrt12:42:283
1328699209,9cyclictest6506-21chrt12:42:283
13286992012,6cyclictest9980-21chrt08:31:103
13286992012,6cyclictest9980-21chrt08:31:103
13286992011,7cyclictest20805-21chrt10:27:533
13286992011,7cyclictest20805-21chrt10:27:533
13286992011,6cyclictest23728-21chrt07:42:063
13286992011,6cyclictest23728-21chrt07:42:063
13286992011,6cyclictest23051-21chrt09:05:403
13286992011,6cyclictest23051-21chrt09:05:403
13286992011,6cyclictest18239-21chrt11:46:203
13286992011,6cyclictest18239-21chrt11:46:203
13286992011,6cyclictest15527-21chrt08:44:573
13286992010,8cyclictest24499-21chrt10:37:293
13286992010,7cyclictest30178-21chrt10:53:253
13286992010,7cyclictest30178-21chrt10:53:253
1328699199,7cyclictest25425-21chrt07:44:393
1328699198,8cyclictest11417-21chrt11:29:153
1328699198,8cyclictest11417-21chrt11:29:153
13286991912,5cyclictest29184-21chrt07:55:083
13286991911,6cyclictest5717-21chrt09:46:523
13286991911,6cyclictest5717-21chrt09:46:523
13286991911,6cyclictest31322-21chrt08:03:453
13286991911,6cyclictest31322-21chrt08:03:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional