You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-18 - 07:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Sat Apr 18, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
675121250,2chrt0-21swapper/323:22:023
675121250,2chrt0-21swapper/323:22:023
2526321100,3chrt0-21swapper/300:10:223
2526321100,3chrt0-21swapper/300:10:223
306292830,3chrt0-21swapper/200:22:232
306292830,3chrt0-21swapper/200:22:232
313672800,3chrt0-21swapper/220:07:132
313672800,3chrt0-21swapper/220:07:132
264442720,2sleep20-21swapper/222:47:122
145792710,1sleep014738-21gltestperf23:42:140
145792710,1sleep014738-21gltestperf23:42:140
30232670,3sleep20-21swapper/200:37:152
30232670,3sleep20-21swapper/200:37:152
30232670,3sleep20-21swapper/200:37:152
167112610,3sleep30-21swapper/320:52:203
113772570,3sleep20-21swapper/223:32:192
113772570,3sleep20-21swapper/223:32:192
28322560,3chrt2836-21gltestperf20:17:131
28322560,3chrt2836-21gltestperf20:17:131
242722540,2chrt24231-21unixbench_multi21:12:230
242722540,2chrt24231-21unixbench_multi21:12:230
242722540,2chrt24231-21unixbench_multi21:12:230
292842510,3sleep20-21swapper/222:52:232
1072299501,3cyclictest0-21swapper/122:42:311
1072299501,3cyclictest0-21swapper/122:42:311
285842490,2sleep10-21swapper/100:17:241
285842490,2sleep10-21swapper/100:17:241
192742490,3sleep30-21swapper/321:02:093
192742490,3sleep30-21swapper/321:02:093
192742490,3sleep30-21swapper/321:02:093
104352490,2chrt0-21swapper/323:31:593
104352490,2chrt0-21swapper/323:31:593
104352490,2chrt0-21swapper/323:31:593
104352490,2chrt0-21swapper/323:31:593
18362480,3sleep10-21swapper/121:42:071
18362480,3sleep10-21swapper/121:42:071
255922470,3chrt25587-21gzip21:17:181
255922470,3chrt25587-21gzip21:17:181
1072299471,10cyclictest18233-21taskset22:23:211
1072299471,10cyclictest18233-21taskset22:23:211
1072299471,10cyclictest18233-21taskset22:23:211
6522460,3chrt0-21swapper/320:12:123
86762440,3chrt0-21swapper/121:57:221
86762440,3chrt0-21swapper/121:57:221
62992440,3chrt0-21swapper/220:27:112
62992440,3chrt0-21swapper/220:27:112
138802440,2sleep20-21swapper/220:47:132
1072299441,3cyclictest700-21192.168.115.40-manager19:56:181
1072299441,3cyclictest700-21192.168.115.40-manager19:56:181
1072299441,3cyclictest0-21swapper/123:55:131
1072299441,3cyclictest0-21swapper/123:55:131
1072299441,2cyclictest0-21swapper/122:51:371
10721994420,17cyclictest22180-21gltestperf00:02:150
10721994420,17cyclictest22180-21gltestperf00:02:150
198432430,2sleep20-21swapper/222:27:222
198432430,2sleep20-21swapper/222:27:222
132752430,3sleep07278-21kworker/u9:1+xprtiod22:12:130
132752430,3sleep07278-21kworker/u9:1+xprtiod22:12:130
1072299431,5cyclictest749-21runrttasks20:04:531
1072299431,5cyclictest749-21runrttasks20:04:531
1072299431,3cyclictest0-21swapper/121:31:051
1072299431,3cyclictest0-21swapper/121:31:051
1072299431,3cyclictest0-21swapper/120:44:531
1072299431,3cyclictest0-21swapper/120:44:531
1072299430,5cyclictest700-21192.168.115.40-manager23:10:251
1072299430,5cyclictest700-21192.168.115.40-manager23:10:251
201272420,3sleep30-21swapper/321:02:213
201272420,3sleep30-21swapper/321:02:213
1072299421,6cyclictest2265-21runrttasks00:35:441
1072299421,6cyclictest2265-21runrttasks00:35:441
1072299421,3cyclictest0-21swapper/123:43:251
1072299421,3cyclictest0-21swapper/123:43:251
1072299421,3cyclictest0-21swapper/123:27:381
1072299421,3cyclictest0-21swapper/123:27:381
1072299421,3cyclictest0-21swapper/123:27:381
1072299421,3cyclictest0-21swapper/123:27:381
1072299421,2cyclictest0-21swapper/120:36:371
1072299421,2cyclictest0-21swapper/120:36:371
1072299421,2cyclictest0-21swapper/119:34:311
1072299421,2cyclictest0-21swapper/100:27:421
1072299421,2cyclictest0-21swapper/100:27:421
1072299421,1cyclictest0-21swapper/123:05:081
1072299421,1cyclictest0-21swapper/123:05:081
1072299421,1cyclictest0-21swapper/123:05:081
1072299421,1cyclictest0-21swapper/122:34:431
1072299421,1cyclictest0-21swapper/122:34:431
1072299420,5cyclictest14042-21taskset23:40:251
1072299420,5cyclictest14042-21taskset23:40:251
1072299420,3cyclictest700-21192.168.115.40-manager21:49:261
1072299420,3cyclictest700-21192.168.115.40-manager21:49:261
1072299420,3cyclictest700-21192.168.115.40-manager21:49:261
1072299411,3cyclictest0-21swapper/122:04:521
1072299411,3cyclictest0-21swapper/122:04:521
1072299411,3cyclictest0-21swapper/120:57:361
1072299411,3cyclictest0-21swapper/120:57:361
1072299411,3cyclictest0-21swapper/120:57:361
1072299411,3cyclictest0-21swapper/120:09:231
1072299411,3cyclictest0-21swapper/120:09:231
1072299411,3cyclictest0-21swapper/100:15:391
1072299411,31cyclictest14830-21sshd20:47:231
1072299411,2cyclictest0-21swapper/123:24:381
1072299411,2cyclictest0-21swapper/123:24:381
1072299411,2cyclictest0-21swapper/123:24:381
1072299411,2cyclictest0-21swapper/120:12:321
1072299411,2cyclictest0-21swapper/100:24:391
1072299411,2cyclictest0-21swapper/100:24:391
1072299410,4cyclictest700-21192.168.115.40-manager20:54:521
10722994019,18cyclictest0-21swapper/100:02:481
10722994019,18cyclictest0-21swapper/100:02:481
1072299401,3cyclictest0-21swapper/123:47:391
1072299401,3cyclictest0-21swapper/123:47:391
1072299401,3cyclictest0-21swapper/123:14:221
1072299401,3cyclictest0-21swapper/123:14:221
1072299401,3cyclictest0-21swapper/119:44:171
1072299401,3cyclictest0-21swapper/119:44:171
1072299401,3cyclictest0-21swapper/100:41:131
1072299401,3cyclictest0-21swapper/100:41:131
1072299401,3cyclictest0-21swapper/100:41:131
1072299401,2cyclictest0-21swapper/123:20:251
1072299401,2cyclictest0-21swapper/123:20:251
1072299401,2cyclictest0-21swapper/122:38:251
1072299401,2cyclictest0-21swapper/122:38:251
1072299401,2cyclictest0-21swapper/122:10:361
1072299401,2cyclictest0-21swapper/122:10:361
1072299401,2cyclictest0-21swapper/121:43:241
1072299401,2cyclictest0-21swapper/121:43:241
1072299401,2cyclictest0-21swapper/121:35:051
1072299401,2cyclictest0-21swapper/121:35:051
1072299401,2cyclictest0-21swapper/121:16:041
1072299401,2cyclictest0-21swapper/121:16:041
1072299401,2cyclictest0-21swapper/121:16:041
1072299401,2cyclictest0-21swapper/120:31:031
1072299401,2cyclictest0-21swapper/120:31:031
1072299401,2cyclictest0-21swapper/119:59:041
1072299401,2cyclictest0-21swapper/119:59:041
1072299401,1cyclictest0-21swapper/123:35:121
1072299401,1cyclictest0-21swapper/123:35:121
1072299401,1cyclictest0-21swapper/122:29:061
1072299401,1cyclictest0-21swapper/122:29:061
1072299401,1cyclictest0-21swapper/122:16:061
1072299401,1cyclictest0-21swapper/122:16:061
1072299401,1cyclictest0-21swapper/121:54:591
1072299401,1cyclictest0-21swapper/121:54:591
1072299401,1cyclictest0-21swapper/120:37:371
1072299401,1cyclictest0-21swapper/120:37:371
1072299400,3cyclictest700-21192.168.115.40-manager23:57:271
1072299400,3cyclictest700-21192.168.115.40-manager23:57:271
1072299400,3cyclictest700-21192.168.115.40-manager23:57:271
1072299400,2cyclictest700-21192.168.115.40-manager21:24:351
1072299400,2cyclictest700-21192.168.115.40-manager21:24:351
1072299400,2cyclictest700-21192.168.115.40-manager21:24:351
1072299400,2cyclictest700-21192.168.115.40-manager19:22:311
1072299400,2cyclictest700-21192.168.115.40-manager19:22:311
1072299400,2cyclictest700-21192.168.115.40-manager19:22:311
1072499391,19cyclictest21759-21taskset00:02:052
1072499391,19cyclictest21759-21taskset00:02:052
1072499391,19cyclictest21759-21taskset00:02:052
1072299391,3cyclictest0-21swapper/121:07:341
1072299391,3cyclictest0-21swapper/121:07:341
1072299391,3cyclictest0-21swapper/121:07:341
1072299391,3cyclictest0-21swapper/119:39:471
1072299391,3cyclictest0-21swapper/119:39:471
1072299391,2cyclictest0-21swapper/122:57:341
1072299391,2cyclictest0-21swapper/122:57:341
1072299391,2cyclictest0-21swapper/122:57:341
1072299391,2cyclictest0-21swapper/119:49:321
1072299391,2cyclictest0-21swapper/119:49:321
1072299391,2cyclictest0-21swapper/119:49:321
1072299391,1cyclictest0-21swapper/100:11:301
1072299391,1cyclictest0-21swapper/100:11:301
1072299390,2cyclictest700-21192.168.115.40-manager22:52:371
1072299390,2cyclictest700-21192.168.115.40-manager19:18:311
234802380,3sleep20-21swapper/219:47:032
234802380,3sleep20-21swapper/219:47:032
141962380,1sleep014301-21/usr/sbin/munin20:47:160
1072299381,3cyclictest0-21swapper/121:02:391
1072299381,3cyclictest0-21swapper/121:02:391
1072299381,2cyclictest0-21swapper/120:25:361
1072299381,2cyclictest0-21swapper/120:25:361
1072299381,2cyclictest0-21swapper/119:30:231
1072299381,2cyclictest0-21swapper/119:30:231
1072299381,1cyclictest0-21swapper/122:20:261
1072299381,1cyclictest0-21swapper/122:20:261
1072199374,28cyclictest7278-21kworker/u9:1+rpciod00:02:070
1072199374,28cyclictest7278-21kworker/u9:1+rpciod00:02:070
1072199374,28cyclictest7278-21kworker/u9:1+rpciod00:02:070
10721993728,7cyclictest664-21netstat21:37:190
10721993728,7cyclictest664-21netstat21:37:190
10721993526,7cyclictest1807-21kernelversion23:07:160
10721993526,7cyclictest1807-21kernelversion23:07:160
10721993427,5cyclictest1-21systemd21:52:220
10721993427,5cyclictest1-21systemd21:52:220
10721993425,6cyclictest23808-21fschecks_count19:47:120
10721993225,5cyclictest27870-21kernelversion19:57:150
10721993225,5cyclictest27870-21kernelversion19:57:150
1073099314,23cyclictest21769-21chrt00:02:063
1073099314,23cyclictest21769-21chrt00:02:063
1073099314,23cyclictest21769-21chrt00:02:063
10721993126,3cyclictest15939-21gltestperf20:52:120
10721993125,4cyclictest749-21runrttasks23:37:240
10721993125,4cyclictest749-21runrttasks23:37:240
10721993125,4cyclictest26812-21sshd19:52:400
10721993125,4cyclictest26812-21sshd19:52:400
10721993124,6cyclictest14144-21timerandwakeup22:12:220
10721993124,6cyclictest14144-21timerandwakeup22:12:220
101992310,3sleep20-21swapper/222:02:182
101992310,3sleep20-21swapper/222:02:182
131892300,2chrt0-21swapper/223:37:172
131892300,2chrt0-21swapper/223:37:172
10721993024,4cyclictest547-21rs:main0
10721993024,4cyclictest547-21rs:main0
10721993023,5cyclictest4712-21gltestperf20:22:140
10721993023,5cyclictest4712-21gltestperf20:22:140
10721993022,5cyclictest171ktimers/020:12:020
10721993022,5cyclictest171ktimers/020:12:020
10721993021,7cyclictest4457-21needreboot21:47:180
10721993021,7cyclictest4457-21needreboot21:47:180
10721993021,7cyclictest4457-21needreboot21:47:180
10721993021,7cyclictest19752-21threads22:27:220
10721993021,7cyclictest19752-21threads22:27:220
10721993017,12cyclictest595-21sshd20:03:230
10721993017,12cyclictest595-21sshd20:03:230
268592290,2sleep20-21swapper/200:12:222
135982290,3sleep20-21swapper/222:12:152
135982290,3sleep20-21swapper/222:12:152
10721992920,7cyclictest14641-21gltestperf19:22:130
10721992920,7cyclictest14641-21gltestperf19:22:130
10721992920,7cyclictest14641-21gltestperf19:22:130
77522280,3chrt0-21swapper/321:57:123
77522280,3chrt0-21swapper/321:57:123
10730992820,6cyclictest2207-21chrt21:42:133
10730992820,6cyclictest2207-21chrt21:42:133
10721992823,4cyclictest4445-21latency_hist00:42:100
10721992823,4cyclictest4445-21latency_hist00:42:100
10721992823,4cyclictest4445-21latency_hist00:42:100
10721992823,4cyclictest31151-21unixbench_multi22:57:250
10721992823,4cyclictest31151-21unixbench_multi22:57:250
10721992823,4cyclictest31151-21unixbench_multi22:57:250
10721992822,4cyclictest16638-21latency_hist22:22:010
10721992822,4cyclictest16638-21latency_hist22:22:010
10721992821,5cyclictest7668-21cut21:57:120
10721992821,5cyclictest7668-21cut21:57:120
10721992821,5cyclictest21358-21fschecks_count21:07:130
10721992821,5cyclictest11475-21sshd20:40:220
10721992821,5cyclictest11475-21sshd20:40:220
10721992821,5cyclictest10718-21cyclictest23:36:320
10721992821,5cyclictest10718-21cyclictest23:36:320
10721992820,5cyclictest9681-21sshd20:36:220
10721992820,5cyclictest9681-21sshd20:36:220
10721992818,8cyclictest27973-21kernelversion00:17:170
10721992818,8cyclictest27973-21kernelversion00:17:170
10721992722,4cyclictest2255-21latency_hist20:17:010
10721992722,3cyclictest0-21swapper/023:27:230
10721992722,3cyclictest0-21swapper/023:27:230
10721992722,3cyclictest0-21swapper/023:27:230
10721992722,3cyclictest0-21swapper/023:27:230
10721992721,4cyclictest22072-21gltestperf19:42:130
10721992719,6cyclictest2974-21kernelversion20:17:140
10721992719,6cyclictest2974-21kernelversion20:17:140
72822260,3chrt0-21swapper/321:57:003
72822260,3chrt0-21swapper/321:57:003
10721992622,3cyclictest90-1pr/ttyS021:45:520
10721992622,3cyclictest90-1pr/ttyS021:45:520
10721992620,5cyclictest32316-21kernelversion23:02:160
10721992620,5cyclictest32316-21kernelversion23:02:160
10721992620,5cyclictest32316-21kernelversion23:02:160
10721992620,3cyclictest0-21swapper/019:32:110
10721992620,3cyclictest0-21swapper/000:37:000
10721992620,3cyclictest0-21swapper/000:37:000
10721992618,6cyclictest19026-21sshd21:01:220
10721992618,6cyclictest19026-21sshd21:01:220
10721992618,6cyclictest19026-21sshd21:01:220
190902250,4sleep20-21swapper/223:52:202
190902250,4sleep20-21swapper/223:52:202
10730992517,5cyclictest26562sleep300:37:123
10730992517,5cyclictest26562sleep300:37:123
10730992517,5cyclictest26562sleep300:37:123
10721992520,3cyclictest0-21swapper/020:32:010
10721992520,3cyclictest0-21swapper/020:32:010
10721992519,4cyclictest547-21rs:main0
10721992518,5cyclictest28839-21latency_hist21:27:130
10721992516,7cyclictest10402-21threads22:02:190
10721992516,7cyclictest10402-21threads22:02:190
22122240,3sleep20-21swapper/223:07:222
22122240,3sleep20-21swapper/223:07:222
10721992415,7cyclictest550-21cron23:47:130
10721992415,7cyclictest550-21cron23:47:130
10730992317,4cyclictest431rcuc/320:46:333
10730992317,4cyclictest431rcuc/320:46:333
1072499231,14cyclictest0-21swapper/200:02:202
1072499231,14cyclictest0-21swapper/200:02:202
10721992318,3cyclictest0-21swapper/022:37:010
10721992318,3cyclictest0-21swapper/022:37:010
10721992318,3cyclictest0-21swapper/021:07:220
10721992318,3cyclictest0-21swapper/021:07:220
10721992318,3cyclictest0-21swapper/021:07:220
10721992317,5cyclictest26293-21needreboot00:12:170
10721992317,5cyclictest19491-21sshd23:53:230
10721992317,5cyclictest19491-21sshd23:53:230
10721992317,3cyclictest0-21swapper/022:22:130
10721992317,3cyclictest0-21swapper/022:22:130
10721992317,3cyclictest0-21swapper/022:22:130
10721992315,6cyclictest25442-21cut21:17:160
10721992315,6cyclictest25442-21cut21:17:160
10721992315,6cyclictest23327-21grep22:37:210
10721992315,6cyclictest23327-21grep22:37:210
10721992311,10cyclictest0-21swapper/020:42:190
10721992311,10cyclictest0-21swapper/020:42:190
57412220,3chrt0-21swapper/221:52:132
57412220,3chrt0-21swapper/221:52:132
1072199222,10cyclictest12760-21sed19:17:140
10721992217,4cyclictest29037-21gltestperf21:27:140
10721992217,4cyclictest29037-21gltestperf21:27:140
10721992217,3cyclictest0-21swapper/022:52:230
10721992217,3cyclictest0-21swapper/022:42:240
10721992217,3cyclictest0-21swapper/022:42:240
10721992217,3cyclictest0-21swapper/000:22:150
10721992217,3cyclictest0-21swapper/000:22:150
10721992215,5cyclictest21058-21latency_hist21:07:050
209692210,3sleep30-21swapper/322:32:143
209692210,3sleep30-21swapper/322:32:143
143682210,3sleep20-21swapper/219:22:102
1073099211,14cyclictest26150-21chrt22:47:093
1073099211,14cyclictest26150-21chrt22:47:093
10721992117,2cyclictest0-21swapper/021:22:130
10721992117,2cyclictest0-21swapper/021:22:130
10721992116,4cyclictest5294-21fschecks_time23:17:120
10721992116,4cyclictest5294-21fschecks_time23:17:120
10721992116,3cyclictest0-21swapper/000:07:240
10721992116,3cyclictest0-21swapper/000:07:240
10721992116,2cyclictest0-21swapper/019:37:130
10721992116,2cyclictest0-21swapper/019:37:130
10721992115,4cyclictest0-21swapper/019:27:230
10721992115,4cyclictest0-21swapper/019:27:230
10721992113,6cyclictest8822-21cut23:27:110
10721992113,6cyclictest8822-21cut23:27:110
10721992113,6cyclictest8822-21cut23:27:110
23572200,3sleep20-21swapper/220:17:062
10721992016,3cyclictest90-1pr/ttyS023:17:080
10721992016,3cyclictest90-1pr/ttyS023:17:080
1073099195,10cyclictest0-21swapper/319:29:233
1073099195,10cyclictest0-21swapper/319:29:233
10721991913,4cyclictest0-21swapper/021:32:180
10721991913,4cyclictest0-21swapper/021:32:180
1073099181,13cyclictest7688-21chrt23:22:193
1073099181,13cyclictest7688-21chrt23:22:193
1073099181,13cyclictest7688-21chrt23:22:193
1072499181,12cyclictest30530-21chrt22:57:172
1072499181,12cyclictest30530-21chrt22:57:172
1072499181,12cyclictest30530-21chrt22:57:172
1072499181,12cyclictest15576-21taskset19:22:222
1072499181,12cyclictest15576-21taskset19:22:222
1072499181,12cyclictest15576-21taskset19:22:222
1072499181,12cyclictest12950-21chrt22:12:032
1072499181,12cyclictest12950-21chrt22:12:032
1072499181,10cyclictest30000-21taskset21:27:572
1072499181,10cyclictest30000-21taskset21:27:572
10721991813,3cyclictest0-21swapper/019:47:170
10721991813,3cyclictest0-21swapper/019:47:170
10721991813,3cyclictest0-21swapper/019:47:170
1073099175,7cyclictest0-21swapper/300:02:143
1073099175,7cyclictest0-21swapper/300:02:143
1073099171,13cyclictest4137-21taskset23:12:223
1073099171,13cyclictest4137-21taskset23:12:223
1072499179,5cyclictest27910-21chrt22:52:032
1072499173,9cyclictest0-21swapper/221:57:232
1072499173,9cyclictest0-21swapper/221:57:232
1072499171,12cyclictest7369-21chrt21:57:032
1072499171,12cyclictest7369-21chrt21:57:032
1072499171,12cyclictest27963-21chrt19:57:162
1072499171,12cyclictest27963-21chrt19:57:162
1072499171,11cyclictest626-21taskset21:37:172
1072499171,11cyclictest626-21taskset21:37:172
1072499171,11cyclictest31287-21chrt21:32:192
1072499171,11cyclictest31287-21chrt21:32:192
1072499171,11cyclictest25253-21chrt22:42:222
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional