You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-30 - 21:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Mon Mar 30, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3916898995144,5cyclictest3972541-21kworker/u8:1+events_unbound10:05:320
3916907995036,10cyclictest311ktimers/207:20:142
3916907995036,10cyclictest311ktimers/207:20:142
3916911994739,5cyclictest4013144-21cron11:45:003
3916902994734,11cyclictest231ktimers/108:45:131
3916898994736,8cyclictest3947874-21grep08:35:240
3916902994634,8cyclictest3974344-21sh09:55:001
3916902994434,6cyclictest3993530-21cron10:50:011
3916911994332,7cyclictest4031490-21grep12:35:253
3916911994234,4cyclictest0-21swapper/308:20:003
3916911994234,4cyclictest0-21swapper/308:19:593
3916907994230,9cyclictest311ktimers/212:05:132
3916902994133,5cyclictest4006125-21idleruntime-cro11:25:011
3916902994126,5cyclictest131rcu_preempt10:33:151
3916898994133,4cyclictest0-21swapper/010:55:000
3916902994031,5cyclictest3970481-21unixbench_multi09:40:251
3916902994028,8cyclictest3963702-21apt09:25:001
3916911993927,7cyclictest0-21swapper/309:00:243
3916907993930,5cyclictest3958583-21sh09:10:012
3916911993830,6cyclictest3949978-21kworker/u8:1+events_unbound08:50:233
3916907993827,7cyclictest3968545-21grep09:35:242
3916907993825,9cyclictest311ktimers/212:20:112
3916902993821,4cyclictest131rcu_preempt08:39:061
3916911993730,5cyclictest3927332-21kworker/u8:1+events_unbound08:10:143
3916911993728,5cyclictest0-21swapper/312:30:013
3916911993728,5cyclictest0-21swapper/310:25:003
3916907993728,6cyclictest3937671-21unixbench_multi08:05:262
3916902993730,5cyclictest3919356-21kworker/u8:0+events_unbound07:15:071
3916902993729,4cyclictest0-21swapper/112:05:541
3916898993727,6cyclictest3923825-21grep07:25:240
3916898993723,9cyclictest3972192-21grep09:45:270
3916911993628,4cyclictest0-21swapper/310:55:433
3916911993628,4cyclictest0-21swapper/309:35:163
3916911993626,5cyclictest0-21swapper/311:45:283
3916907993625,6cyclictest0-21swapper/207:15:062
3916902993627,6cyclictest4017833-21grep11:55:271
3916902993627,5cyclictest4004209-21dpkg11:20:001
3916902993627,5cyclictest4004209-21dpkg11:20:001
3916902993619,10cyclictest131rcu_preempt09:15:211
3916911993528,4cyclictest0-21swapper/309:35:013
3916907993527,4cyclictest0-21swapper/208:40:012
3916902993524,8cyclictest4002034-21grep11:10:261
3916902993524,8cyclictest4002034-21grep11:10:261
3916902993517,11cyclictest131rcu_preempt07:30:011
3916898993528,4cyclictest4031923-21sendmail12:40:000
3916911993426,4cyclictest0-21swapper/312:30:263
3916911993426,4cyclictest0-21swapper/311:59:593
3916902993424,7cyclictest3966917-21grep09:30:231
3916902993424,7cyclictest3927191-21grep07:35:251
3916902993423,8cyclictest0-21swapper/111:25:211
3916902993421,9cyclictest3991419-21grep10:40:241
3916902993417,10cyclictest131rcu_preempt10:35:211
3916902993414,6cyclictest24-21ksoftirqd/107:50:211
391689899344,5cyclictest131rcu_preempt09:15:130
3916911993325,4cyclictest0-21swapper/309:10:263
3916911993324,4cyclictest0-21swapper/307:55:173
3916911993324,4cyclictest0-21swapper/307:30:013
3916911993323,6cyclictest0-21swapper/309:50:253
3916911993323,6cyclictest0-21swapper/308:00:273
3916907993326,4cyclictest0-21swapper/212:20:012
3916907993323,6cyclictest0-21swapper/210:20:012
3916907993322,8cyclictest0-21swapper/211:05:002
391690299337,16cyclictest24-21ksoftirqd/108:25:001
3916902993323,6cyclictest3945304-21cut08:30:161
3916902993323,6cyclictest0-21swapper/111:35:001
3916902993321,8cyclictest0-21swapper/112:10:531
3916902993319,4cyclictest131rcu_preempt09:29:471
3916902993318,4cyclictest131rcu_preempt07:30:231
3916902993317,5cyclictest131rcu_preempt10:30:011
3916902993317,3cyclictest0-21swapper/111:48:171
3916902993316,10cyclictest131rcu_preempt10:05:131
3916902993312,5cyclictest131rcu_preempt09:10:221
3916898993325,4cyclictest0-21swapper/009:00:230
3916898993323,6cyclictest0-21swapper/011:50:290
3916898993323,6cyclictest0-21swapper/011:50:280
3916911993224,5cyclictest0-21swapper/310:54:593
3916907993225,3cyclictest0-21swapper/210:10:262
3916907993224,4cyclictest0-21swapper/210:40:012
3916907993222,6cyclictest0-21swapper/211:20:002
3916907993222,6cyclictest0-21swapper/211:19:592
3916907993221,8cyclictest3946625-21cron08:35:012
3916907993221,7cyclictest4005758-21sshd11:20:462
3916902993225,4cyclictest0-21swapper/109:45:181
3916902993223,5cyclictest3977352-21grep10:00:231
3916902993222,6cyclictest0-21swapper/110:20:011
3916902993217,5cyclictest131rcu_preempt09:39:011
3916902993217,4cyclictest131rcu_preempt10:55:151
3916902993215,10cyclictest131rcu_preempt07:45:141
3916911993123,4cyclictest0-21swapper/312:20:243
3916911993123,4cyclictest0-21swapper/311:30:243
3916907993124,4cyclictest0-21swapper/209:50:242
3916907993123,4cyclictest0-21swapper/209:20:162
3916907993122,5cyclictest0-21swapper/211:40:482
3916907993121,6cyclictest0-21swapper/211:55:272
391690299319,5cyclictest131rcu_preempt11:05:011
391690299316,13cyclictest4025283-21sort12:20:011
391690299315,5cyclictest24-21ksoftirqd/108:05:151
3916902993121,7cyclictest3938504-21grep08:10:171
3916902993121,7cyclictest231ktimers/112:30:251
3916902993120,5cyclictest131rcu_preempt10:50:021
3916902993120,4cyclictest131rcu_preempt12:35:211
3916902993120,3cyclictest131rcu_preempt07:24:591
3916902993120,3cyclictest131rcu_preempt07:24:591
3916902993115,9cyclictest131rcu_preempt12:20:171
3916902993115,9cyclictest131rcu_preempt09:00:201
3916902993114,9cyclictest131rcu_preempt11:05:111
3916902993114,10cyclictest131rcu_preempt08:41:221
3916902993113,9cyclictest131rcu_preempt07:55:191
3916902993113,4cyclictest131rcu_preempt12:25:241
3916902993112,6cyclictest131rcu_preempt08:25:141
3916898993124,3cyclictest0-21swapper/009:55:280
3916911993022,5cyclictest3927264-21unixbench_singl07:35:273
3916911993022,4cyclictest0-21swapper/311:20:243
3916911993021,6cyclictest0-21swapper/311:50:293
3916911993021,6cyclictest0-21swapper/311:50:293
3916911993020,7cyclictest3954177-21grep08:55:213
3916907993024,4cyclictest3931081-21munin-plugin-st07:50:012
391690299301,9cyclictest0-21swapper/111:40:231
3916902993019,8cyclictest231ktimers/111:40:001
3916902993017,5cyclictest131rcu_preempt12:00:161
3916902993014,9cyclictest131rcu_preempt08:50:341
3916902993013,9cyclictest131rcu_preempt09:55:191
3916902993013,10cyclictest131rcu_preempt08:00:141
391689899302,6cyclictest131rcu_preempt09:50:120
3916898993024,3cyclictest4028494-21auditctl12:30:010
3916898993023,4cyclictest3951342-21unixbench_singl08:45:260
3916898993020,6cyclictest0-21swapper/009:25:260
391689899301,3cyclictest0-21swapper/008:15:120
391689899301,3cyclictest0-21swapper/008:15:120
3916911992919,6cyclictest0-21swapper/310:10:263
3916907992922,4cyclictest3984805-21auditctl10:25:012
3916907992921,5cyclictest3967324-21idleruntime-cro09:35:012
3916907992920,6cyclictest0-21swapper/208:20:002
3916907992920,6cyclictest0-21swapper/208:20:002
3916902992921,6cyclictest3958330-21kworker/u8:0+events_unbound09:07:141
3916902992919,7cyclictest231ktimers/110:10:141
3916902992911,11cyclictest131rcu_preempt07:43:571
3916902992911,10cyclictest131rcu_preempt10:20:131
3916902992910,3cyclictest0-21swapper/108:15:181
3916902992910,3cyclictest0-21swapper/108:15:181
3916898992923,3cyclictest0-21swapper/007:15:010
3916898992922,5cyclictest121ktimers/007:40:130
3916898992922,4cyclictest0-21swapper/009:10:250
3916898992921,5cyclictest0-21swapper/009:35:250
3916898992921,4cyclictest0-21swapper/011:20:000
3916898992921,4cyclictest0-21swapper/011:20:000
3916898992921,4cyclictest0-21swapper/010:35:340
3916898992921,4cyclictest0-21swapper/007:55:110
3916898992920,6cyclictest0-21swapper/011:00:000
3916898992920,5cyclictest13550irq/42-30be0000.ethernet11:45:280
3916898992920,5cyclictest0-21swapper/012:00:530
3916911992821,4cyclictest0-21swapper/311:10:263
3916911992821,4cyclictest0-21swapper/311:10:253
3916911992820,6cyclictest391ktimers/309:25:063
3916911992820,4cyclictest0-21swapper/310:30:253
3916911992820,4cyclictest0-21swapper/307:10:293
3916911992819,6cyclictest0-21swapper/308:25:243
3916911992818,6cyclictest0-21swapper/307:45:253
3916911992817,7cyclictest0-21swapper/308:35:253
3916907992821,3cyclictest0-21swapper/208:25:242
3916907992820,4cyclictest0-21swapper/211:15:002
3916907992820,4cyclictest0-21swapper/211:15:002
3916907992818,7cyclictest3979476-21munin-plugin-st10:10:002
3916907992818,6cyclictest0-21swapper/209:10:262
3916902992817,8cyclictest231ktimers/107:10:181
3916902992814,4cyclictest131rcu_preempt11:50:201
3916902992814,4cyclictest131rcu_preempt11:50:191
3916898992812,13cyclictest0-21swapper/011:30:020
3916911992719,5cyclictest0-21swapper/309:15:243
3916911992718,6cyclictest0-21swapper/311:05:253
3916911992718,6cyclictest0-21swapper/307:30:253
3916898992720,4cyclictest0-21swapper/009:40:240
3916898992718,6cyclictest3963303-21grep09:20:260
391689899271,22cyclictest3958168-21grep09:05:260
3916911992618,5cyclictest3993546-21idleruntime-cro10:50:003
3916911992617,6cyclictest0-21swapper/307:20:013
3916911992616,7cyclictest0-21swapper/307:40:263
3916911992615,8cyclictest0-21swapper/310:05:173
3916911992611,12cyclictest0-21swapper/308:05:263
3916907992621,3cyclictest3932841-21runrttasks07:55:012
3916907992620,3cyclictest0-21swapper/210:00:212
3916907992619,5cyclictest178-21systemd-udevd12:32:392
3916907992619,4cyclictest0-21swapper/209:00:252
3916907992618,4cyclictest0-21swapper/211:30:242
3916907992618,4cyclictest0-21swapper/209:00:002
3916907992616,7cyclictest1-21systemd08:40:202
3916898992619,5cyclictest4002463-21kworker/u8:3+events_unbound11:31:210
3916898992619,5cyclictest3927332-21kworker/u8:1+events_unbound08:00:120
3916898992616,6cyclictest3954697-21grep08:55:260
3916911992519,3cyclictest0-21swapper/308:30:223
3916911992517,5cyclictest3950056-21idleruntime-cro08:45:003
3916911992517,5cyclictest0-21swapper/312:05:273
3916907992519,3cyclictest0-21swapper/212:35:172
3916907992519,3cyclictest0-21swapper/211:50:222
3916907992519,3cyclictest0-21swapper/211:50:222
3916907992517,6cyclictest311ktimers/208:20:132
3916907992516,5cyclictest0-21swapper/207:40:002
3916907992515,8cyclictest3995742-21sed10:55:012
3916907992514,7cyclictest1-21systemd07:30:062
3916898992518,5cyclictest3998811-21kworker/u8:2+events_unbound11:09:410
3916898992515,4cyclictest3891063-21kworker/u8:3+events_unbound07:20:070
3916898992515,4cyclictest3891063-21kworker/u8:3+events_unbound07:20:060
3916898992514,7cyclictest0-21swapper/010:40:240
3916911992418,3cyclictest0-21swapper/312:10:193
3916911992418,3cyclictest0-21swapper/311:25:233
3916911992418,3cyclictest0-21swapper/309:45:003
3916911992416,5cyclictest0-21swapper/310:15:053
3916911992416,4cyclictest0-21swapper/312:15:253
3916911992415,6cyclictest0-21swapper/310:00:003
3916911992413,8cyclictest204-21dbus-daemon07:20:063
3916911992413,8cyclictest204-21dbus-daemon07:20:053
3916907992419,3cyclictest3934395-21runrttasks07:59:042
3916907992418,3cyclictest0-21swapper/212:10:262
3916907992418,3cyclictest0-21swapper/210:30:232
3916907992418,3cyclictest0-21swapper/209:45:202
3916907992417,4cyclictest438-21cron12:04:592
3916907992417,4cyclictest0-21swapper/212:25:262
3916907992417,3cyclictest0-21swapper/211:25:182
3916907992416,5cyclictest0-21swapper/210:50:012
3916907992414,7cyclictest3997371-21sendmail10:59:592
3916907992414,7cyclictest3976047-21sh09:59:592
3916898992418,4cyclictest4007454-21kworker/u8:2+events_unbound11:41:550
3916898992418,3cyclictest13850irq/36-mmc110:35:010
3916898992418,3cyclictest0-21swapper/007:15:020
3916898992417,4cyclictest4029733-21grep12:30:260
3916898992417,4cyclictest0-21swapper/010:15:240
3916898992417,3cyclictest0-21swapper/011:02:210
3916898992417,3cyclictest0-21swapper/008:14:320
3916898992414,7cyclictest3945715-21ntpq08:30:220
391689899241,19cyclictest0-21swapper/008:29:360
391689899241,19cyclictest0-21swapper/007:35:530
391689899241,19cyclictest0-21swapper/007:32:350
391689899241,12cyclictest0-21swapper/008:50:140
391689899240,20cyclictest0-21swapper/007:54:000
3916911992316,4cyclictest3963233-21grep09:20:263
3916911992316,4cyclictest0-21swapper/311:00:253
3916911992315,5cyclictest0-21swapper/311:15:273
3916911992315,5cyclictest0-21swapper/311:15:263
3916911992315,5cyclictest0-21swapper/310:30:023
3916911992315,5cyclictest0-21swapper/308:45:253
3916911992313,6cyclictest0-21swapper/310:35:243
3916911992312,8cyclictest3991848-21pluginstate10:45:013
3916907992317,4cyclictest3951758-21latency_hist08:50:012
3916907992317,4cyclictest208-21systemd-logind11:09:402
3916907992316,5cyclictest164-21systemd-journal09:29:402
3916907992316,3cyclictest0-21swapper/211:35:162
3916898992317,4cyclictest3975832-21kworker/u8:0+events_unbound10:00:180
3916898992317,4cyclictest13850irq/36-mmc112:20:000
3916898992317,3cyclictest13850irq/36-mmc107:50:000
3916898992316,3cyclictest0-21swapper/011:20:080
3916898992316,3cyclictest0-21swapper/010:49:050
3916898992315,5cyclictest121ktimers/011:35:160
391689899231,3cyclictest3979701-21apt-get10:10:110
391689899231,18cyclictest0-21swapper/012:22:030
391689899231,18cyclictest0-21swapper/008:41:120
391689899230,2cyclictest0-21swapper/009:30:120
391689899230,19cyclictest0-21swapper/010:26:330
391689899230,19cyclictest0-21swapper/008:22:270
3916911992216,4cyclictest4007454-21kworker/u8:2+events_unbound11:35:223
3916911992216,3cyclictest0-21swapper/310:00:243
3916911992214,5cyclictest0-21swapper/307:55:003
3916907992216,4cyclictest164-21systemd-journal08:12:402
3916907992216,3cyclictest0-21swapper/209:15:162
3916907992212,7cyclictest3986097-21grep10:25:252
3916898992216,3cyclictest0-21swapper/012:10:160
3916898992216,3cyclictest0-21swapper/008:05:190
3916898992215,4cyclictest645-21runrttasks12:10:000
391689899221,19cyclictest0-21swapper/011:14:400
391689899221,19cyclictest0-21swapper/011:14:390
3916911992115,3cyclictest0-21swapper/308:20:183
3916907992114,5cyclictest311ktimers/209:40:192
3916907992110,7cyclictest3953062-21grep08:50:252
3916898992115,3cyclictest0-21swapper/010:20:130
3916911992012,5cyclictest0-21swapper/309:45:173
391690799209,8cyclictest3917516-21cut07:10:232
3916907992014,4cyclictest311ktimers/210:40:162
3916907992012,5cyclictest0-21swapper/207:30:002
3916907992010,7cyclictest4015044-21date11:50:012
3916907991912,5cyclictest311ktimers/208:00:052
3916907991912,5cyclictest311ktimers/207:40:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional