You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-14 - 01:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Sun Sep 13, 2026 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1730921080,10sleep117312-21latency_hist08:29:161
816721010,4sleep07568-21/usr/sbin/munin09:29:330
27152660,3sleep20-21swapper/207:49:292
25032660,3sleep00-21swapper/007:49:270
169032650,3sleep30-21swapper/309:54:243
319872640,3sleep20-21swapper/210:34:272
39002620,7sleep00-21swapper/009:19:280
39002620,7sleep00-21swapper/009:19:280
25972590,3chrt0-21swapper/010:39:400
25972590,3chrt0-21swapper/010:39:400
66822580,4sleep00-21swapper/007:59:280
66822580,4sleep00-21swapper/007:59:280
161812570,3sleep20-21swapper/211:19:182
161812570,3sleep20-21swapper/211:19:182
144702560,3sleep20-21swapper/209:44:382
144702560,3sleep20-21swapper/209:44:382
21492540,3sleep30-21swapper/309:14:283
21492540,3sleep30-21swapper/309:14:283
98452530,3sleep30-21swapper/310:59:373
98452530,3sleep30-21swapper/310:59:373
237362500,2sleep20-21swapper/208:44:332
138152480,3sleep30-21swapper/309:44:313
138152480,3sleep30-21swapper/309:44:313
317282470,3sleep00-21swapper/010:34:170
317282470,3sleep00-21swapper/010:34:170
204762470,3chrt0-21swapper/210:04:162
204762470,3chrt0-21swapper/210:04:162
93432460,3sleep20-21swapper/212:24:382
93432460,3sleep20-21swapper/212:24:382
264742450,3chrt0-21swapper/011:44:360
264742450,3chrt0-21swapper/011:44:360
38652410,3chrt0-21swapper/212:09:392
38652410,3chrt0-21swapper/212:09:392
22572410,3sleep20-21swapper/210:39:382
22572410,3sleep20-21swapper/210:39:382
241272380,2sleep024288-21/usr/sbin/munin11:39:310
241272380,2sleep024288-21/usr/sbin/munin11:39:310
206652350,3sleep30-21swapper/311:29:323
206652350,3sleep30-21swapper/311:29:323
104332350,4sleep30-21swapper/312:29:293
22123993425,7cyclictest30752-21netstat10:29:341
22123993425,7cyclictest30752-21netstat10:29:341
2212299337,4cyclictest171ktimers/009:10:010
2212299337,4cyclictest171ktimers/009:10:010
22122993329,2cyclictest90-1pr/ttyS008:13:290
22122993329,2cyclictest90-1pr/ttyS008:13:290
111822330,3sleep20-21swapper/211:04:302
106582330,1sleep110757-21memory12:29:321
22122993226,4cyclictest15272-21fschecks_count09:49:320
22122993224,6cyclictest20473-21ls10:04:160
22122993224,6cyclictest20473-21ls10:04:160
22122993224,6cyclictest11629-21mailstats11:04:370
179492320,2sleep00-21swapper/009:54:410
179492320,2sleep00-21swapper/009:54:410
153972320,3sleep30-21swapper/311:14:403
153972320,3sleep30-21swapper/311:14:403
22122993123,6cyclictest171ktimers/009:45:320
22122993123,6cyclictest171ktimers/009:45:320
66422300,3sleep20-21swapper/209:24:362
282982300,2sleep028438-21grep10:24:290
282982300,2sleep028438-21grep10:24:290
22123993024,5cyclictest28867-21fschecks_count08:59:291
22123993024,5cyclictest28867-21fschecks_count08:59:291
22123993024,5cyclictest12386-21kernelversion08:14:331
22123993024,5cyclictest12386-21kernelversion08:14:331
22123993023,5cyclictest3355-21ntp_kernel_pll_12:09:341
22123993023,5cyclictest3355-21ntp_kernel_pll_12:09:341
22123993022,5cyclictest15086-21unixbench_multi12:39:381
22123993022,5cyclictest15086-21unixbench_multi12:39:381
22122993025,3cyclictest3559-21gltestperf10:44:320
22122993025,3cyclictest3559-21gltestperf10:44:320
22122993024,4cyclictest10114-21needreboot09:34:380
22122993023,5cyclictest4854-21kernelversion07:54:320
22122993022,6cyclictest14452-21needreboot08:19:340
22122993022,6cyclictest14452-21needreboot08:19:340
22122993019,4cyclictest181rcu_preempt10:34:300
307772290,3sleep20-21swapper/207:36:592
307772290,3sleep20-21swapper/207:36:592
284922290,4sleep20-21swapper/211:49:372
284922290,4sleep20-21swapper/211:49:372
22122992925,3cyclictest22121-21cyclictest09:28:250
22122992924,3cyclictest171ktimers/008:18:590
22122992924,3cyclictest171ktimers/008:18:590
22122992924,3cyclictest0-21swapper/010:49:380
22122992922,5cyclictest26786-21latency_hist08:54:200
22122992922,5cyclictest26786-21latency_hist08:54:200
22122992922,5cyclictest12533-21kernelversion12:34:340
22122992922,5cyclictest12533-21kernelversion12:34:340
22122992921,6cyclictest90-1pr/ttyS008:49:000
22123992823,3cyclictest0-21swapper/108:09:291
22123992823,3cyclictest0-21swapper/108:09:291
22123992822,5cyclictest23637-21kernelversion08:44:321
22123992821,5cyclictest25201-21sshd11:40:421
22123992821,5cyclictest25201-21sshd11:40:421
22123992821,5cyclictest0-21swapper/110:04:161
22123992821,5cyclictest0-21swapper/110:04:161
2212299287,3cyclictest181rcu_preempt11:04:040
2212299287,3cyclictest181rcu_preempt11:04:040
22122992824,3cyclictest5267-21ntp_offset12:14:350
22122992824,3cyclictest5267-21ntp_offset12:14:350
22122992822,4cyclictest22121-21cyclictest12:09:290
22122992822,4cyclictest22121-21cyclictest12:09:290
22122992822,4cyclictest21030-21gltestperf10:04:280
22122992821,5cyclictest22121-21cyclictest11:09:330
22122992820,6cyclictest6623-21cut12:19:310
22122992820,6cyclictest6623-21cut12:19:310
22122992820,6cyclictest6623-21cut12:19:310
2212299281,6cyclictest201rcuc/007:46:360
2212299281,6cyclictest201rcuc/007:46:360
22122992816,3cyclictest181rcu_preempt11:59:380
22122992816,3cyclictest181rcu_preempt11:59:380
22122992815,3cyclictest181rcu_preempt11:32:530
22122992815,3cyclictest181rcu_preempt11:32:530
22123992721,4cyclictest3950-21ntp_kernel_err10:44:361
22123992721,4cyclictest3950-21ntp_kernel_err10:44:361
22123992721,4cyclictest23523-21cat10:09:371
22123992721,4cyclictest23523-21cat10:09:371
22123992721,4cyclictest0-21swapper/107:34:301
22123992721,4cyclictest0-21swapper/107:34:301
22123992720,5cyclictest22121-21cyclictest12:09:231
22123992720,5cyclictest1346-21avahi-daemon09:09:381
22123992720,5cyclictest1346-21avahi-daemon09:09:381
22123992719,6cyclictest12817-21fschecks_time11:09:281
22122992723,2cyclictest0-21swapper/009:39:370
22122992723,2cyclictest0-21swapper/009:39:370
22122992723,2cyclictest0-21swapper/009:39:370
22122992721,5cyclictest1256-21kernelversion12:04:320
22122992721,5cyclictest1256-21kernelversion12:04:320
22122992720,5cyclictest22473-21kernelversion11:34:310
22122992720,5cyclictest20750-21sshd08:35:420
22122992717,3cyclictest90-1pr/ttyS010:54:410
22122992712,4cyclictest90-1pr/ttyS008:42:420
22122992712,4cyclictest90-1pr/ttyS008:42:420
22123992622,3cyclictest22121-21cyclictest08:49:381
22123992622,3cyclictest22121-21cyclictest08:49:381
22123992620,4cyclictest6267-21unixbench-2d10:49:391
22123992620,4cyclictest3571-21cat09:19:161
22123992620,4cyclictest3571-21cat09:19:161
22123992619,5cyclictest8382-21fschecks_time08:04:331
22123992619,5cyclictest8382-21fschecks_time08:04:331
22123992619,5cyclictest19735-21gltestperf08:34:301
22123992619,5cyclictest12497-21latency_hist11:09:191
22123992618,6cyclictest14008-21cut08:19:291
22123992618,6cyclictest14008-21cut08:19:291
22122992621,4cyclictest14409-21kernelversion12:39:300
22122992621,4cyclictest14409-21kernelversion12:39:300
22122992621,3cyclictest0-21swapper/010:24:160
22122992621,3cyclictest0-21swapper/010:24:160
22122992620,4cyclictest171ktimers/008:24:290
22122992619,5cyclictest29399-21needreboot08:59:340
22122992619,5cyclictest29399-21needreboot08:59:340
22122992612,4cyclictest90-1pr/ttyS011:19:390
22122992612,4cyclictest90-1pr/ttyS011:19:390
22123992521,3cyclictest22121-21cyclictest12:19:391
22123992521,3cyclictest22121-21cyclictest12:19:391
22123992521,3cyclictest22121-21cyclictest12:19:391
22123992520,3cyclictest4715-21gltestperf07:54:301
22123992520,3cyclictest27184-21tail08:54:291
22123992520,3cyclictest0-21swapper/110:59:161
22123992519,5cyclictest20855-21ntp_offset11:29:351
22123992519,5cyclictest20855-21ntp_offset11:29:351
22123992519,5cyclictest17264-21gltestperf09:54:331
22123992519,5cyclictest17264-21gltestperf09:54:331
22123992519,5cyclictest10419-21switchtime09:34:421
22123992519,4cyclictest23620-21latency_hist11:39:161
22123992519,4cyclictest0-21swapper/108:44:241
22123992518,5cyclictest14876-21latency_hist09:49:161
22123992518,5cyclictest14876-21latency_hist09:49:161
2212299252,4cyclictest171ktimers/009:17:310
2212299252,4cyclictest171ktimers/009:17:310
22122992520,4cyclictest20341-21munin-node11:59:220
22122992520,3cyclictest0-21swapper/007:39:280
22122992520,3cyclictest0-21swapper/007:39:280
22122992520,3cyclictest0-21swapper/007:34:330
22122992520,3cyclictest0-21swapper/007:34:330
22122992519,5cyclictest31116-21kernelversion09:04:320
22122992519,5cyclictest31116-21kernelversion09:04:320
22122992519,5cyclictest27676-21processes08:54:360
22122992515,3cyclictest181rcu_preempt12:26:160
22122992515,3cyclictest181rcu_preempt12:26:160
22122992514,4cyclictest181rcu_preempt11:49:380
22122992514,4cyclictest181rcu_preempt11:49:380
251052240,3sleep20-21swapper/210:14:372
22123992419,4cyclictest3639-21unixbench-2d07:49:391
22123992419,3cyclictest13191-21unixbench-2d12:34:411
22123992419,3cyclictest13191-21unixbench-2d12:34:411
22123992419,3cyclictest0-21swapper/108:04:161
22123992419,3cyclictest0-21swapper/108:04:161
22123992418,5cyclictest5911-21fschecks_time09:24:281
22123992418,4cyclictest32537-21sshd07:40:411
22123992418,4cyclictest32537-21sshd07:40:411
22123992418,4cyclictest28853-21vmstat11:49:391
22123992418,4cyclictest28853-21vmstat11:49:391
22123992418,4cyclictest0-21swapper/110:14:331
22123992418,3cyclictest0-21swapper/110:24:291
22123992418,3cyclictest0-21swapper/110:24:291
22122992419,3cyclictest0-21swapper/011:14:310
22122992419,3cyclictest0-21swapper/011:14:310
2212299241,6cyclictest201rcuc/011:27:460
22122992414,8cyclictest14678-21systemd-journal08:09:160
22122992414,8cyclictest14678-21systemd-journal08:09:160
2212299241,3cyclictest181rcu_preempt08:32:000
2212299241,3cyclictest181rcu_preempt08:32:000
128402240,3sleep20-21swapper/212:34:392
128402240,3sleep20-21swapper/212:34:392
22126992317,3cyclictest156262chrt08:24:233
22126992317,3cyclictest156262chrt08:24:233
22123992319,2cyclictest0-21swapper/110:34:391
22123992318,4cyclictest4863-21head12:14:301
22123992318,4cyclictest4863-21head12:14:301
22123992318,2cyclictest0-21swapper/111:49:161
22123992318,2cyclictest0-21swapper/111:49:161
22123992316,5cyclictest2282-21latency_hist07:49:161
22123992316,5cyclictest2282-21latency_hist07:49:161
22123992316,5cyclictest12043-21ntp_kernel_pll_09:39:351
22123992316,5cyclictest12043-21ntp_kernel_pll_09:39:351
22123992316,5cyclictest12043-21ntp_kernel_pll_09:39:351
22123992315,6cyclictest31650-21gltestperf11:59:301
22123992315,6cyclictest31650-21gltestperf11:59:301
22123992313,8cyclictest4504-21ntp_kernel_pll_09:19:341
22123992313,8cyclictest4504-21ntp_kernel_pll_09:19:341
22122992318,3cyclictest0-21swapper/012:29:380
22122992317,5cyclictest24364-21latency_hist10:14:230
22122992317,5cyclictest24364-21latency_hist10:14:230
22123992218,2cyclictest0-21swapper/110:39:291
22123992218,2cyclictest0-21swapper/110:39:291
22123992218,2cyclictest0-21swapper/108:39:411
22123992217,4cyclictest8977-21fschecks_count10:59:271
22123992217,4cyclictest8977-21fschecks_count10:59:271
22123992217,3cyclictest0-21swapper/112:04:291
22123992216,4cyclictest0-21swapper/111:14:331
22123992216,4cyclictest0-21swapper/111:14:331
22123992214,5cyclictest0-21swapper/109:49:421
22123992213,7cyclictest8956-21needreboot12:24:341
22123992213,7cyclictest8956-21needreboot12:24:341
22123992212,2cyclictest181rcu_preempt11:24:331
2212399221,12cyclictest16705-21grep11:19:301
2212399221,12cyclictest16705-21grep11:19:301
22125992115,4cyclictest58362sleep210:49:352
22123992117,2cyclictest0-21swapper/109:29:371
22123992116,3cyclictest0-21swapper/110:19:381
22123992116,3cyclictest0-21swapper/110:19:381
22123992116,3cyclictest0-21swapper/110:04:281
22123992113,5cyclictest0-21swapper/108:29:381
22123992113,5cyclictest0-21swapper/108:29:381
22123992112,7cyclictest14678-21systemd-journal09:09:001
22123992112,7cyclictest14678-21systemd-journal09:09:001
22122992115,4cyclictest0-21swapper/010:14:410
119232210,4sleep30-21swapper/309:39:333
119232210,4sleep30-21swapper/309:39:333
119232210,4sleep30-21swapper/309:39:333
273002200,3sleep30-21swapper/310:19:373
273002200,3sleep30-21swapper/310:19:373
22125992014,4cyclictest266242chrt11:44:382
22125992014,4cyclictest266242chrt11:44:382
22123992016,2cyclictest0-21swapper/111:54:301
83172190,5sleep30-21swapper/309:29:373
300732191,10sleep30-21swapper/309:00:303
300732191,10sleep30-21swapper/309:00:303
2212699191,13cyclictest26421-21chrt11:44:353
2212699191,13cyclictest26421-21chrt11:44:353
22125991911,4cyclictest299392sleep210:29:212
22125991911,4cyclictest299392sleep210:29:212
2212599191,13cyclictest16591-21chrt11:19:302
2212599191,13cyclictest16591-21chrt11:19:302
210092190,3sleep20-21swapper/210:04:282
2212699181,9cyclictest0-21swapper/312:04:423
2212699181,9cyclictest0-21swapper/312:04:423
2212599183,9cyclictest0-21swapper/212:20:012
2212599183,9cyclictest0-21swapper/212:20:012
2212599183,9cyclictest0-21swapper/212:20:012
2212599181,12cyclictest8333-21taskset08:04:332
2212599181,12cyclictest8333-21taskset08:04:332
2212599181,12cyclictest5110-21chrt07:54:362
2212599181,12cyclictest31707-21taskset07:39:322
2212599181,12cyclictest31707-21taskset07:39:322
2212599181,12cyclictest27232-21taskset08:54:292
95342170,3sleep20-21swapper/210:59:322
95342170,3sleep20-21swapper/210:59:322
75482170,3sleep30-21swapper/309:29:243
2212699171,11cyclictest6373-21chrt10:49:403
2212699171,11cyclictest3132-21taskset10:44:213
2212699171,11cyclictest3132-21taskset10:44:213
2212699171,11cyclictest30982-21taskset10:29:383
2212699171,11cyclictest30982-21taskset10:29:383
2212699171,11cyclictest17682-21chrt08:29:303
2212699171,11cyclictest17682-21chrt08:29:303
2212699171,10cyclictest25547-21chrt10:14:423
2212599174,8cyclictest14948-21chrt12:39:372
2212599174,8cyclictest14948-21chrt12:39:372
2212599171,12cyclictest0-21swapper/208:14:292
2212599171,12cyclictest0-21swapper/208:14:292
2212599171,11cyclictest13880-21chrt08:19:282
2212599171,11cyclictest13880-21chrt08:19:282
222602160,3sleep30-21swapper/308:39:393
222602160,3sleep30-21swapper/308:39:393
2212699168,5cyclictest34792sleep307:49:393
2212699162,11cyclictest0-21swapper/311:59:303
2212699162,11cyclictest0-21swapper/311:59:303
2212699161,11cyclictest23357-21chrt08:44:303
2212699161,11cyclictest23222-21chrt10:09:323
2212699161,11cyclictest23222-21chrt10:09:323
2212699161,11cyclictest13945-21chrt12:39:263
2212699161,11cyclictest13945-21chrt12:39:263
2212699161,11cyclictest12130-21chrt08:14:313
2212699161,11cyclictest12130-21chrt08:14:313
2212699161,11cyclictest10570-21taskset09:34:423
2212699161,11cyclictest0-21swapper/312:09:313
2212699161,11cyclictest0-21swapper/312:09:313
2212699161,11cyclictest0-21swapper/311:54:413
2212699161,11cyclictest0-21swapper/311:24:303
2212599161,11cyclictest827-21taskset12:04:282
2212599161,11cyclictest827-21taskset12:04:282
2212599161,11cyclictest5381-21chrt12:14:372
2212599161,11cyclictest5381-21chrt12:14:372
2212599161,11cyclictest19896-21chrt08:34:322
2212599161,11cyclictest0-21swapper/211:34:372
2212599161,11cyclictest0-21swapper/211:14:192
2212599161,11cyclictest0-21swapper/210:44:322
2212599161,11cyclictest0-21swapper/210:44:322
2212599161,11cyclictest0-21swapper/207:44:312
2212599161,11cyclictest0-21swapper/207:44:312
2212599161,10cyclictest31548-21taskset11:59:292
2212599161,10cyclictest31548-21taskset11:59:292
2212599161,10cyclictest23939-21taskset11:39:282
2212599161,10cyclictest23939-21taskset11:39:282
2212599161,10cyclictest18288-21chrt08:29:372
2212599161,10cyclictest18288-21chrt08:29:372
2212599161,10cyclictest10734-21chrt08:09:352
2212599161,10cyclictest10734-21chrt08:09:352
22125991610,3cyclictest7942sleep209:09:372
22125991610,3cyclictest7942sleep209:09:372
2212699151,9cyclictest8515-21chrt08:04:343
2212699151,9cyclictest8515-21chrt08:04:343
2212699151,9cyclictest0-21swapper/311:09:273
2212699151,9cyclictest0-21swapper/309:59:333
2212699151,9cyclictest0-21swapper/309:59:333
2212699151,11cyclictest0-21swapper/309:14:223
2212699151,11cyclictest0-21swapper/309:14:223
2212699151,10cyclictest8333-21chrt12:24:273
2212699151,10cyclictest8333-21chrt12:24:273
2212699151,10cyclictest7426-21chrt12:19:413
2212699151,10cyclictest7426-21chrt12:19:413
2212699151,10cyclictest7426-21chrt12:19:413
2212699151,10cyclictest4535-21chrt09:19:353
2212699151,10cyclictest4535-21chrt09:19:353
2212699151,10cyclictest28223-21chrt10:24:273
2212699151,10cyclictest28223-21chrt10:24:273
2212699151,10cyclictest27342-21taskset08:54:313
2212699151,10cyclictest2459-21taskset07:49:223
2212699151,10cyclictest2459-21taskset07:49:223
2212699151,10cyclictest21146-21chrt10:04:293
2212699151,10cyclictest0-21swapper/311:39:293
2212699151,10cyclictest0-21swapper/311:39:293
2212599152,9cyclictest0-21swapper/211:54:552
2212599151,9cyclictest30162-21chrt10:29:292
2212599151,9cyclictest30162-21chrt10:29:292
2212599151,9cyclictest25119-21chrt08:49:272
2212599151,9cyclictest25119-21chrt08:49:272
2212599151,7cyclictest0-21swapper/209:14:262
2212599151,7cyclictest0-21swapper/209:14:262
2212599151,11cyclictest0-21swapper/211:29:302
2212599151,11cyclictest0-21swapper/211:29:302
2212599151,11cyclictest0-21swapper/208:24:272
2212599151,10cyclictest29996-21taskset08:59:402
2212599151,10cyclictest29996-21taskset08:59:402
2212599151,10cyclictest19564-21chrt11:25:042
2212599151,10cyclictest11343-21chrt09:39:282
2212599151,10cyclictest11343-21chrt09:39:282
2212599151,10cyclictest11343-21chrt09:39:282
2212599151,10cyclictest10282-21chrt12:29:282
2212599151,10cyclictest0-21swapper/209:49:412
2212699149,3cyclictest211432chrt08:39:193
2212699141,9cyclictest4781-21chrt12:14:303
2212699141,9cyclictest4781-21chrt12:14:303
2212699141,9cyclictest25672-21chrt08:49:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional