You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-26 - 23:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Sun Jul 26, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3641355995421,8cyclictest3700312-21grep09:55:262
3641350995432,19cyclictest3708802-21unixbench_multi10:20:241
3641346995323,3cyclictest0-21swapper/011:25:000
3641346995323,26cyclictest3665754-21grep08:15:250
3641355995124,23cyclictest0-21swapper/211:15:012
3641359995039,7cyclictest3753346-21grep12:30:253
3641355995027,20cyclictest3741881-21idleruntime-cro12:00:002
3641355995027,20cyclictest3741881-21idleruntime-cro11:59:592
3641346995039,8cyclictest3650356-21grep07:30:230
3641359994936,10cyclictest391ktimers/312:00:143
3641346994922,4cyclictest0-21swapper/012:35:170
3641346994919,3cyclictest0-21swapper/011:55:000
3641346994818,25cyclictest0-21swapper/009:55:250
3641355994637,6cyclictest311ktimers/210:45:102
3641350994636,6cyclictest3742258-21fschecks_count12:00:161
3641346994619,4cyclictest0-21swapper/009:50:010
3641355994520,7cyclictest3686441-21grep09:15:252
3641355994519,4cyclictest3677864-21unixbench_multi08:50:242
3641355994518,4cyclictest0-21swapper/211:40:002
3641350994537,4cyclictest3666209-21idleruntime-cro08:20:011
364135099451,9cyclictest3733688-21/usr/sbin/munin11:35:161
364134699453,14cyclictest3669692-21sshd08:28:450
3641346994519,3cyclictest0-21swapper/007:30:020
3641355994412,6cyclictest0-21swapper/209:00:002
3641350994419,20cyclictest0-21swapper/112:10:251
3641346994419,3cyclictest0-21swapper/007:20:250
3641350994334,5cyclictest3740159-21cron11:55:001
3641359994232,6cyclictest391ktimers/307:50:123
3641355994215,5cyclictest0-21swapper/210:35:252
364135099421,8cyclictest3675369-21/usr/sbin/munin08:45:151
364135099421,8cyclictest3675369-21/usr/sbin/munin08:45:151
3641350994214,25cyclictest3700964-21/usr/sbin/munin10:00:151
3641359994133,4cyclictest0-21swapper/307:15:033
3641359994132,6cyclictest3717305-21unixbench_multi10:45:243
3641355994131,7cyclictest3645089-21grep07:15:292
3641355994114,5cyclictest3673240-21sendmail-msp08:40:012
364135099419,29cyclictest3650923-21cut07:35:011
364135099413,7cyclictest3747795-21/usr/sbin/munin12:15:241
3641350994131,6cyclictest0-21swapper/108:20:161
3641350994129,6cyclictest0-21swapper/111:55:241
3641350994129,6cyclictest0-21swapper/111:55:241
364135099411,9cyclictest3704885-21/usr/sbin/munin10:10:191
364135099411,36cyclictest3726933-21fschecks_time11:15:181
3641350994112,24cyclictest231ktimers/107:25:141
3641346994132,6cyclictest3722707-21grep11:00:270
3641346994131,6cyclictest0-21swapper/008:10:000
364135099401,9cyclictest3670737-21/usr/sbin/munin08:30:261
364135099401,8cyclictest3721920-21/usr/sbin/munin11:00:181
364135099401,7cyclictest3668944-21/usr/sbin/munin08:25:241
364135099401,7cyclictest3641907-21/usr/sbin/munin07:10:191
364135099401,5cyclictest3684031-21/usr/sbin/munin09:10:221
364135099401,3cyclictest0-21swapper/110:55:141
364135099401,36cyclictest3703115-21meminfo10:05:201
364135099400,3cyclictest0-21swapper/108:10:131
3641346994030,7cyclictest3699010-21sh09:55:000
3641359993925,10cyclictest391ktimers/307:35:123
3641355993931,5cyclictest3681425-21kworker/u8:3+events_unbound09:08:522
3641355993928,8cyclictest311ktimers/207:30:102
364135099396,28cyclictest3714845-21fschecks_time10:40:181
364135099393,33cyclictest3707145-21users10:15:251
364135099393,31cyclictest3711875-21/usr/sbin/munin10:30:241
364135099392,9cyclictest3749280-21irqstats12:20:171
3641350993928,7cyclictest0-21swapper/109:40:011
364135099392,3cyclictest3723344-21/usr/sbin/munin11:05:261
364135099391,9cyclictest3735387-21/usr/sbin/munin11:40:141
364135099391,9cyclictest3716683-21/usr/sbin/munin10:45:161
364135099391,9cyclictest3656801-21/usr/sbin/munin07:50:231
3641350993917,19cyclictest0-21swapper/107:45:201
3641350993917,18cyclictest0-21swapper/109:15:251
364135099391,6cyclictest3744268-21memory12:05:181
364135099391,5cyclictest3645109-21users07:15:281
364135099391,4cyclictest3754168-21diskstats12:35:161
364135099391,4cyclictest3709615-21diskstats10:25:201
364135099391,4cyclictest3699249-21apt-get09:55:131
364135099391,3cyclictest0-21swapper/111:30:121
364135099391,3cyclictest0-21swapper/110:50:131
364135099391,3cyclictest0-21swapper/107:20:131
364135099391,11cyclictest3713338-21meminfo10:35:191
364135099390,3cyclictest0-21swapper/108:00:131
3641355993830,4cyclictest3745297-21idleruntime-cro12:10:002
3641355993830,4cyclictest0-21swapper/209:40:012
3641355993828,7cyclictest3666325-21latency_hist08:20:022
364135099389,25cyclictest3671947-21fschecks_time08:35:161
3641350993826,7cyclictest3730361-21fschecks_time11:25:161
364135099382,32cyclictest3662768-21cron08:09:591
364135099381,9cyclictest3753920-21grep12:35:011
364135099381,9cyclictest3653153-21/usr/sbin/munin07:40:181
3641350993818,15cyclictest0-21swapper/107:55:181
3641350993818,15cyclictest0-21swapper/107:55:181
364135099381,7cyclictest3680619-21/usr/sbin/munin09:00:181
364135099381,5cyclictest3682100-21diskstats09:05:141
364135099381,3cyclictest3737671-21/usr/sbin/munin11:45:231
364135099381,3cyclictest0-21swapper/111:10:131
364135099381,3cyclictest0-21swapper/109:50:111
364135099381,3cyclictest0-21swapper/109:30:151
364135099381,3cyclictest0-21swapper/109:25:131
364135099381,32cyclictest3696195-21ntpq09:45:201
364135099372,5cyclictest3695469-21grep09:45:011
3641350993717,15cyclictest0-21swapper/108:40:261
364135099371,6cyclictest3688131-21grep09:20:231
364135099371,5cyclictest3676968-21df08:50:141
364135099371,3cyclictest3728581-21df_inode11:20:141
364135099371,3cyclictest3651060-21apt-get07:35:131
364135099371,31cyclictest3679016-21memory08:55:221
3641346993730,3cyclictest0-21swapper/009:10:000
3641359993628,4cyclictest3683458-21cron09:10:003
3641359993628,4cyclictest0-21swapper/310:00:003
3641355993629,4cyclictest0-21swapper/208:35:012
3641355993626,6cyclictest3691566-21grep09:30:282
364135099361,3cyclictest0-21swapper/112:25:121
3641359993525,6cyclictest0-21swapper/309:00:003
3641355993528,4cyclictest3722685-21unixbench_singl11:00:262
3641355993525,6cyclictest0-21swapper/207:15:022
3641346993527,5cyclictest0-21swapper/007:15:030
3641346993523,8cyclictest3724401-21grep11:05:250
3641359993427,4cyclictest0-21swapper/308:40:163
3641359993425,5cyclictest0-21swapper/308:28:453
3641355993428,3cyclictest0-21swapper/207:50:152
3641355993425,5cyclictest0-21swapper/209:45:002
3641346993427,4cyclictest3709261-21sh10:25:010
3641346993426,4cyclictest0-21swapper/011:40:000
3641359993321,9cyclictest391ktimers/308:10:123
3641355993326,3cyclictest0-21swapper/212:40:002
3641355993321,9cyclictest438-21cron07:50:012
3641346993324,5cyclictest0-21swapper/008:55:000
3641359993223,6cyclictest0-21swapper/311:00:003
3641359993222,7cyclictest0-21swapper/307:35:013
3641355993220,6cyclictest0-21swapper/207:20:262
3641346993224,5cyclictest3645090-21unixbench_singl07:15:290
3641346993212,4cyclictest13550irq/42-30be0000.ethernet10:30:140
3641359993124,4cyclictest0-21swapper/312:25:263
3641359993122,6cyclictest0-21swapper/308:20:013
3641359993122,5cyclictest0-21swapper/310:10:253
3641359993121,6cyclictest0-21swapper/312:10:003
3641359993119,6cyclictest37037252grep10:05:263
3641355993124,4cyclictest3721399-21cat11:00:012
3641355993123,4cyclictest0-21swapper/209:45:162
3641355993122,5cyclictest3662364-21grep08:05:282
3641359993022,5cyclictest0-21swapper/307:20:003
3641359993022,4cyclictest0-21swapper/309:45:263
3641359993022,4cyclictest0-21swapper/307:40:173
3641359993019,7cyclictest0-21swapper/311:50:263
3641359993018,7cyclictest0-21swapper/310:30:013
3641346993020,6cyclictest3751701-21grep12:25:260
3641359992923,3cyclictest0-21swapper/307:25:263
3641359992922,4cyclictest0-21swapper/311:10:283
3641359992921,4cyclictest0-21swapper/309:10:213
3641359992920,6cyclictest0-21swapper/311:35:263
3641359992919,7cyclictest3711346-21grep10:30:163
3641359992918,6cyclictest0-21swapper/308:00:263
3641359992915,11cyclictest3641339-21cyclictest10:50:143
3641355992921,4cyclictest3724395-21head11:05:242
3641355992920,5cyclictest0-21swapper/208:45:222
3641355992920,5cyclictest0-21swapper/208:45:222
3641355992919,6cyclictest0-21swapper/212:10:252
3641355992918,8cyclictest3663568-21ntp_states08:10:212
364135599291,25cyclictest3716077-21sh10:45:002
364134699294,6cyclictest11-21ksoftirqd/007:35:420
3641346992920,6cyclictest0-21swapper/012:20:000
3641346992920,4cyclictest0-21swapper/009:18:540
3641346992919,6cyclictest0-21swapper/007:50:250
3641346992918,7cyclictest3705357-21grep10:10:240
3641359992821,4cyclictest0-21swapper/310:15:253
3641359992821,4cyclictest0-21swapper/309:35:003
3641359992820,5cyclictest0-21swapper/311:45:253
3641359992816,8cyclictest0-21swapper/307:45:153
3641346992823,3cyclictest3743598-21munin-plugin-st12:05:000
3641346992821,4cyclictest13550irq/42-30be0000.ethernet08:40:000
3641346992819,6cyclictest3664062-21grep08:10:250
3641346992819,5cyclictest0-21swapper/012:10:240
3641346992818,6cyclictest0-21swapper/011:25:270
364135999279,5cyclictest40-21ksoftirqd/311:55:113
364135999279,5cyclictest40-21ksoftirqd/311:55:113
3641359992717,3cyclictest131rcu_preempt08:30:173
3641359992716,7cyclictest0-21swapper/309:50:253
3641359992712,8cyclictest131rcu_preempt12:16:573
3641355992721,3cyclictest0-21swapper/210:35:012
3641355992720,4cyclictest0-21swapper/207:25:172
3641355992716,7cyclictest3719479-21apt-get10:55:012
3641355992714,7cyclictest3753340-21grep12:30:252
3641346992720,3cyclictest0-21swapper/010:45:240
3641346992719,4cyclictest3654638-21fschecks_count07:45:150
3641346992715,8cyclictest3719492-21cut10:54:590
364135999269,9cyclictest131rcu_preempt07:58:243
364135999269,9cyclictest131rcu_preempt07:58:233
364135999267,12cyclictest0-21swapper/308:23:383
3641359992618,5cyclictest0-21swapper/312:35:273
3641359992618,4cyclictest0-21swapper/312:20:253
3641359992618,4cyclictest0-21swapper/311:40:173
3641359992617,6cyclictest0-21swapper/311:30:163
3641359992616,6cyclictest0-21swapper/309:25:273
3641359992610,9cyclictest131rcu_preempt10:20:483
364135999260,16cyclictest40-21ksoftirqd/311:29:183
3641355992617,6cyclictest3703615-21ls10:05:252
364134699263,5cyclictest3674009-21awk08:40:200
3641346992619,3cyclictest0-21swapper/011:55:140
3641346992619,3cyclictest0-21swapper/011:55:140
3641346992619,3cyclictest0-21swapper/007:40:170
3641346992618,4cyclictest0-21swapper/011:10:280
3641346992617,7cyclictest121ktimers/008:20:120
3641346992616,7cyclictest3732078-21grep11:30:160
3641346992615,7cyclictest3691885-21sshd09:33:590
364135999259,9cyclictest131rcu_preempt11:24:143
364135999258,4cyclictest131rcu_preempt09:22:403
364135999256,12cyclictest40-21ksoftirqd/311:15:153
364135999255,12cyclictest40-21ksoftirqd/310:00:363
3641359992519,3cyclictest0-21swapper/308:05:183
3641359992516,6cyclictest0-21swapper/311:05:253
3641359992516,3cyclictest131rcu_preempt09:44:123
3641359992512,6cyclictest131rcu_preempt09:03:503
3641359992511,8cyclictest131rcu_preempt11:02:023
3641359992510,9cyclictest131rcu_preempt12:10:383
3641359992510,8cyclictest131rcu_preempt10:41:543
364135599256,4cyclictest6250watchdogd10:10:202
3641355992520,3cyclictest0-21swapper/210:00:152
3641355992517,5cyclictest3738494-21sort11:50:002
3641355992517,4cyclictest0-21swapper/210:20:252
3641355992516,6cyclictest0-21swapper/211:45:002
3641355992515,7cyclictest3710504-21sed10:25:312
3641355992512,5cyclictest311ktimers/208:20:272
364134699252,19cyclictest3736343-21unixbench_singl11:40:270
3641346992518,4cyclictest13850irq/36-mmc109:25:010
3641346992516,6cyclictest0-21swapper/008:05:000
364134699251,20cyclictest0-21swapper/011:19:230
364135999249,8cyclictest131rcu_preempt09:35:513
364135999249,8cyclictest131rcu_preempt09:15:543
364135999247,8cyclictest131rcu_preempt08:37:483
364135999247,14cyclictest3646219-21sed07:20:213
3641359992415,7cyclictest3675348-21fschecks_time08:45:153
3641359992415,7cyclictest3675348-21fschecks_time08:45:143
3641359992413,6cyclictest131rcu_preempt10:36:273
3641359992410,7cyclictest131rcu_preempt08:54:333
364135599242,11cyclictest3674526-21unixbench_singl08:40:262
3641355992418,3cyclictest0-21swapper/212:20:242
3641355992418,3cyclictest0-21swapper/210:15:172
3641355992417,5cyclictest3693550-21kworker/u8:2+events_unbound09:53:262
3641355992417,5cyclictest3681858-21ls09:05:012
3641355992416,5cyclictest3752107-21cron12:30:002
3641355992416,4cyclictest0-21swapper/211:15:182
3641346992418,3cyclictest0-21swapper/011:45:170
3641346992417,4cyclictest3714364-21sh10:40:010
3641346992414,6cyclictest0-21swapper/009:25:270
364134699241,19cyclictest0-21swapper/010:56:070
364134699241,19cyclictest0-21swapper/010:40:400
364134699241,19cyclictest0-21swapper/009:40:460
3641355992317,3cyclictest0-21swapper/209:10:272
364135599231,4cyclictest37310502cat11:25:262
364134699232,19cyclictest0-21swapper/010:25:290
364134699232,17cyclictest3680062-21sendmail-msp09:00:000
3641346992317,3cyclictest0-21swapper/012:10:000
3641346992317,3cyclictest0-21swapper/009:35:250
3641346992316,4cyclictest13550irq/42-30be0000.ethernet10:15:160
3641346992315,6cyclictest121ktimers/010:00:130
3641346992312,9cyclictest151rcuc/008:30:280
364134699231,18cyclictest0-21swapper/009:14:080
364134699230,19cyclictest0-21swapper/012:24:430
364135599226,10cyclictest6250watchdogd09:29:212
3641355992216,3cyclictest0-21swapper/212:15:272
3641355992216,3cyclictest0-21swapper/208:00:262
3641355992215,3cyclictest0-21swapper/207:40:262
3641355992214,5cyclictest0-21swapper/211:50:182
3641355992213,6cyclictest3743710-21cat12:05:002
364134699222,13cyclictest3681278-21unixbench_multi09:00:260
3641346992211,6cyclictest0-21swapper/012:30:250
364134699220,18cyclictest0-21swapper/007:56:130
364134699220,18cyclictest0-21swapper/007:56:130
3641355992114,4cyclictest3669387-21grep08:25:262
3641355992114,4cyclictest3652305-21sshd07:37:282
3641355992114,4cyclictest1-21systemd11:34:232
364134699211,18cyclictest0-21swapper/008:46:560
364134699211,18cyclictest0-21swapper/008:46:550
3641355992012,5cyclictest0-21swapper/207:55:272
3641355992012,5cyclictest0-21swapper/207:55:262
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional