You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-04 - 21:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Mon May 04, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
637880995244,6cyclictest655145-21kworker/u8:2+events_unbound08:05:171
637888994943,4cyclictest670699-21kworker/u8:3+events_unbound09:40:453
637888994834,10cyclictest391ktimers/312:20:123
637880994739,4cyclictest752251-21munin-plugin-st12:40:011
637875994735,9cyclictest121ktimers/007:30:130
637884994633,10cyclictest311ktimers/208:15:142
637875994637,5cyclictest665700-21sh08:30:000
637888994434,6cyclictest677379-21grep09:00:243
637880994430,9cyclictest231ktimers/111:30:121
637888994336,5cyclictest717549-21kworker/u8:1+events_unbound11:00:503
637884994333,6cyclictest1-21systemd08:00:152
637884994332,7cyclictest729658-21grep11:30:252
637880994337,4cyclictest616068-21kworker/u8:2+events_unbound07:15:031
637884994213,17cyclictest0-21swapper/207:20:012
637880994231,7cyclictest0-21swapper/111:40:001
637875994223,16cyclictest649301-21runrttasks07:40:180
637888994131,7cyclictest641370-21grep07:15:263
637880994133,5cyclictest645244-21idleruntime-cro07:30:011
637888993929,7cyclictest735618-21cut11:50:163
637880993932,5cyclictest736571-21kworker/u8:0+events_unbound12:02:411
637880993930,5cyclictest0-21swapper/112:24:591
637880993927,9cyclictest438-21cron12:00:001
637888993829,5cyclictest0-21swapper/311:45:013
637884993826,5cyclictest689930-21kworker/u8:0+events_unbound10:20:432
637884993826,5cyclictest689930-21kworker/u8:0+events_unbound10:20:422
637880993831,5cyclictest689930-21kworker/u8:0+events_unbound10:15:461
637888993729,4cyclictest0-21swapper/311:35:013
637884993728,6cyclictest724974-21sendmail11:20:012
637884993728,4cyclictest0-21swapper/210:45:172
637884993727,5cyclictest0-21swapper/211:35:162
637884993726,6cyclictest0-21swapper/209:40:252
637884993725,7cyclictest0-21swapper/212:05:572
637884993725,7cyclictest0-21swapper/212:05:572
637880993728,5cyclictest726689-21idleruntime-cro11:25:011
637880993726,5cyclictest738412-21kworker/u8:3+events_unbound12:10:591
637880993725,8cyclictest231ktimers/109:45:121
637880993711,4cyclictest131rcu_preempt09:15:131
637880993711,4cyclictest131rcu_preempt09:15:131
637875993727,6cyclictest0-21swapper/007:20:000
637888993622,11cyclictest391ktimers/308:55:123
637888993622,11cyclictest391ktimers/308:55:123
637884993625,5cyclictest0-21swapper/209:20:002
637884993625,5cyclictest0-21swapper/209:20:002
637884993624,7cyclictest0-21swapper/211:10:162
637880993630,4cyclictest733213-21kworker/u8:1+events_unbound11:54:421
637875993625,6cyclictest0-21swapper/009:45:020
63788899353,4cyclictest131rcu_preempt08:40:143
637888993527,4cyclictest0-21swapper/307:40:103
637888993526,6cyclictest738991-21fschecks_count12:00:143
637884993528,5cyclictest715841-21kworker/u8:4+events_unbound11:04:412
637880993529,3cyclictest0-21swapper/111:00:011
637880993525,6cyclictest697262-21sendmail10:00:011
637888993427,4cyclictest643526-21cron07:25:003
637888993426,4cyclictest0-21swapper/309:50:173
63788499347,6cyclictest301rcuc/207:45:262
637884993424,6cyclictest0-21swapper/211:25:142
637884993422,6cyclictest0-21swapper/207:30:252
637884993415,9cyclictest131rcu_preempt08:46:082
637880993427,4cyclictest0-21swapper/110:05:251
637880993426,4cyclictest0-21swapper/107:25:011
637880993425,6cyclictest678637-21ntp_kernel_pll_09:05:221
637875993428,4cyclictest651771-21kworker/u8:0+events_unbound08:15:230
637888993327,4cyclictest655145-21kworker/u8:2+events_unbound08:36:413
637888993324,6cyclictest0-21swapper/310:00:003
637888993322,7cyclictest686144-21grep09:25:243
637884993324,4cyclictest0-21swapper/210:10:162
637884993322,7cyclictest0-21swapper/210:30:232
637884993321,6cyclictest717549-21kworker/u8:1+events_unbound10:59:022
637884993316,14cyclictest311ktimers/208:21:322
637880993327,4cyclictest707110-21kworker/u8:1+events_unbound10:40:471
637880993326,5cyclictest743480-21kworker/u8:2+events_unbound12:15:591
637880993325,4cyclictest0-21swapper/107:55:251
637880993324,4cyclictest0-21swapper/108:45:001
637880993316,4cyclictest665704-21apt08:30:011
637875993327,3cyclictest707483-21cron10:30:000
637875993326,3cyclictest0-21swapper/007:40:010
637875993325,4cyclictest0-21swapper/010:15:250
637888993223,4cyclictest0-21swapper/308:05:263
637888993212,6cyclictest728051-21kworker/u8:2+events_unbound11:26:563
63788499329,13cyclictest32-21ksoftirqd/212:05:002
63788499326,6cyclictest32-21ksoftirqd/208:35:232
637884993224,4cyclictest0-21swapper/208:05:162
637884993222,7cyclictest311ktimers/209:50:182
637884993221,8cyclictest311ktimers/209:00:172
637884993221,8cyclictest311ktimers/207:50:252
637884993216,4cyclictest0-21swapper/209:30:182
637884993213,5cyclictest131rcu_preempt08:40:172
637884993213,3cyclictest131rcu_preempt12:33:272
637884993213,3cyclictest131rcu_preempt09:56:562
637884993212,3cyclictest131rcu_preempt10:28:442
637880993224,5cyclictest682758-21kworker/u8:2+events_unbound09:35:181
637875993225,3cyclictest0-21swapper/011:50:000
637875993223,7cyclictest121ktimers/012:05:120
637875993223,7cyclictest121ktimers/012:05:120
637875993222,6cyclictest0-21swapper/010:24:590
637875993222,6cyclictest0-21swapper/010:24:590
637875993221,7cyclictest0-21swapper/011:10:000
637888993122,6cyclictest660998-21fschecks_time08:15:163
63788499319,7cyclictest32-21ksoftirqd/210:40:012
63788499316,7cyclictest32-21ksoftirqd/212:00:002
637884993121,8cyclictest311ktimers/207:35:242
637884993121,7cyclictest311ktimers/212:14:592
637884993121,7cyclictest311ktimers/207:25:022
637884993117,7cyclictest726316-21kworker/u8:0+events_unbound11:23:102
637884993116,3cyclictest131rcu_preempt09:10:232
637884993115,3cyclictest131rcu_preempt08:58:222
637884993115,3cyclictest131rcu_preempt08:58:212
637884993113,9cyclictest131rcu_preempt08:30:532
637884993110,11cyclictest131rcu_preempt07:55:212
637880993124,4cyclictest0-21swapper/110:35:151
637880993123,4cyclictest0-21swapper/110:55:011
637880993123,4cyclictest0-21swapper/107:45:001
637880993117,7cyclictest131rcu_preempt10:45:171
637875993123,5cyclictest646879-21kworker/u8:1+events_unbound07:45:100
637875993122,4cyclictest0-21swapper/008:35:270
637875993111,18cyclictest121ktimers/008:50:100
637875993111,18cyclictest121ktimers/008:50:090
63788899303,3cyclictest131rcu_preempt10:25:123
637888993024,4cyclictest715841-21kworker/u8:4+events_unbound10:50:423
637888993024,3cyclictest0-21swapper/312:40:003
637888993023,5cyclictest696934-21kworker/u8:3+events_unbound10:06:483
637888993023,5cyclictest670699-21kworker/u8:3+events_unbound08:53:063
637888993023,5cyclictest670699-21kworker/u8:3+events_unbound08:53:053
637888993022,5cyclictest0-21swapper/309:15:003
637888993022,4cyclictest0-21swapper/310:55:253
637888993021,5cyclictest0-21swapper/308:25:243
637888993021,5cyclictest0-21swapper/307:25:033
637888993021,4cyclictest0-21swapper/308:10:173
637888993015,5cyclictest655145-21kworker/u8:2+events_unbound08:47:413
637888993011,9cyclictest0-21swapper/312:33:493
63788499304,6cyclictest32-21ksoftirqd/212:20:242
63788499304,6cyclictest32-21ksoftirqd/211:40:142
637884993022,5cyclictest311ktimers/208:26:092
637884993020,7cyclictest311ktimers/210:15:182
637884993020,7cyclictest311ktimers/208:10:222
637884993016,6cyclictest733213-21kworker/u8:1+events_unbound11:47:322
637884993015,4cyclictest131rcu_preempt07:40:262
637884993012,4cyclictest131rcu_preempt09:20:592
637880993024,4cyclictest704304-21kworker/u8:2+events_unbound10:23:491
637880993024,4cyclictest704304-21kworker/u8:2+events_unbound10:23:491
637880993022,4cyclictest0-21swapper/108:10:191
637880993022,4cyclictest0-21swapper/107:50:001
637880993020,7cyclictest677377-21unixbench_multi09:00:251
637880993020,6cyclictest0-21swapper/107:35:241
637880993012,12cyclictest0-21swapper/110:05:011
637875993019,7cyclictest0-21swapper/008:40:260
63788899297,4cyclictest131rcu_preempt09:35:173
637888992922,3cyclictest0-21swapper/310:50:003
637888992915,5cyclictest689930-21kworker/u8:0+events_unbound10:15:063
63788899291,18cyclictest0-21swapper/310:35:543
63788499299,5cyclictest32-21ksoftirqd/209:25:252
63788499296,6cyclictest32-21ksoftirqd/209:05:252
63788499293,7cyclictest32-21ksoftirqd/211:05:272
63788499291,9cyclictest32-21ksoftirqd/210:05:242
637884992919,7cyclictest311ktimers/207:25:162
637884992919,7cyclictest311ktimers/207:10:252
637884992919,7cyclictest301rcuc/212:35:142
637884992919,7cyclictest301rcuc/212:16:402
637884992918,8cyclictest311ktimers/210:50:212
637884992917,5cyclictest696934-21kworker/u8:3+events_unbound10:03:202
637884992917,4cyclictest131rcu_preempt12:25:192
637884992910,4cyclictest131rcu_preempt09:35:142
637884992910,16cyclictest311ktimers/208:51:022
637884992910,16cyclictest311ktimers/208:51:022
63788099297,13cyclictest131rcu_preempt11:15:251
637880992923,4cyclictest726316-21kworker/u8:0+events_unbound11:40:541
637880992922,3cyclictest0-21swapper/108:55:011
637880992922,3cyclictest0-21swapper/108:55:001
637880992920,4cyclictest0-21swapper/112:30:001
637875992923,3cyclictest0-21swapper/010:55:130
637875992921,5cyclictest698666-21kworker/u8:1+events_unbound10:15:010
637875992920,4cyclictest0-21swapper/011:45:000
637875992919,6cyclictest743308-21unixbench_singl12:10:250
63788899288,5cyclictest670699-21kworker/u8:3+events_unbound09:15:553
63788899288,5cyclictest670699-21kworker/u8:3+events_unbound09:15:553
63788899287,5cyclictest712143-21unixbench_multi10:40:253
63788899284,3cyclictest131rcu_preempt08:30:123
637888992822,4cyclictest612044-21kworker/u8:1+events_unbound07:13:443
637888992821,4cyclictest0-21swapper/311:35:263
637888992820,6cyclictest676100-21kworker/u8:0+events_unbound09:05:333
637888992820,4cyclictest0-21swapper/310:10:173
637888992815,8cyclictest391ktimers/307:55:103
637888992814,6cyclictest645095-21kworker/u8:3+events_unbound07:36:413
637884992819,6cyclictest311ktimers/211:50:192
637884992810,4cyclictest131rcu_preempt09:45:182
63788099287,14cyclictest131rcu_preempt09:40:151
63788099286,13cyclictest131rcu_preempt11:00:241
63788099286,12cyclictest131rcu_preempt12:34:461
637880992821,4cyclictest668814-21kworker/u8:0+events_unbound08:45:221
637880992821,3cyclictest0-21swapper/107:10:201
637880992820,4cyclictest0-21swapper/108:30:251
637880992815,4cyclictest53-21kcompactd010:10:151
637880992813,6cyclictest682758-21kworker/u8:2+events_unbound09:27:071
637875992819,5cyclictest0-21swapper/012:31:000
637875992815,10cyclictest121ktimers/011:10:110
63787599281,23cyclictest727858-21wc11:25:250
63788899277,8cyclictest131rcu_preempt12:30:013
63788899276,8cyclictest131rcu_preempt10:05:003
63788899276,7cyclictest131rcu_preempt10:24:013
63788899276,7cyclictest131rcu_preempt10:24:013
63788899274,8cyclictest131rcu_preempt12:15:143
63788899271,13cyclictest0-21swapper/311:23:523
63788099277,12cyclictest131rcu_preempt09:12:151
63788099272,3cyclictest0-21swapper/108:55:111
63788099272,3cyclictest0-21swapper/108:55:111
637880992718,6cyclictest663564-21tail08:20:271
637880992718,6cyclictest0-21swapper/111:15:001
63788099270,16cyclictest0-21swapper/111:45:111
637875992721,4cyclictest689547-21unixbench_multi09:35:260
637875992720,4cyclictest13850irq/36-mmc111:20:000
637875992720,4cyclictest0-21swapper/007:25:250
637875992720,3cyclictest13550irq/42-30be0000.ethernet09:10:000
63788899266,12cyclictest131rcu_preempt12:10:233
637888992618,6cyclictest712544-21kworker/u8:3+events_unbound11:15:523
637888992611,4cyclictest651771-21kworker/u8:0+events_unbound07:50:503
637888992610,5cyclictest736571-21kworker/u8:0+events_unbound12:06:583
637888992610,5cyclictest736571-21kworker/u8:0+events_unbound12:06:573
637888992610,3cyclictest131rcu_preempt09:45:203
63788099269,5cyclictest682758-21kworker/u8:2+events_unbound09:20:041
63788099266,12cyclictest131rcu_preempt09:30:111
637880992618,4cyclictest0-21swapper/108:15:251
637880992613,7cyclictest24-21ksoftirqd/107:30:241
63787599267,5cyclictest725470-21cat11:20:160
63787599263,5cyclictest692793-21ps09:45:220
637875992619,4cyclictest0-21swapper/012:00:000
637875992619,3cyclictest0-21swapper/009:20:010
637875992619,3cyclictest0-21swapper/009:20:010
637875992618,4cyclictest0-21swapper/008:00:010
637875992617,4cyclictest0-21swapper/008:55:240
637875992617,4cyclictest0-21swapper/008:55:230
637875992615,8cyclictest438-21cron08:50:000
637875992615,7cyclictest744954-21grep12:15:260
63788899256,3cyclictest131rcu_preempt09:20:273
63788899252,6cyclictest721077-21grep11:05:283
637888992518,5cyclictest649995-21kworker/u8:2+events_unbound07:45:293
637888992517,4cyclictest0-21swapper/311:55:243
637888992511,12cyclictest40-21ksoftirqd/308:00:483
63788899250,14cyclictest0-21swapper/311:45:543
63788099259,4cyclictest131rcu_preempt11:27:351
63788099256,7cyclictest131rcu_preempt07:50:151
63788099255,12cyclictest131rcu_preempt08:02:521
637880992517,5cyclictest0-21swapper/110:34:591
637875992518,4cyclictest0-21swapper/011:40:010
637875992517,5cyclictest0-21swapper/012:20:250
637875992516,7cyclictest121ktimers/011:00:050
63787599251,5cyclictest751855-21users12:35:250
63787599251,20cyclictest0-21swapper/010:36:400
63787599251,20cyclictest0-21swapper/008:23:190
63788899247,7cyclictest131rcu_preempt11:10:253
637888992414,7cyclictest686949-21diskstats09:30:143
63788099248,3cyclictest131rcu_preempt09:50:211
63788099244,3cyclictest131rcu_preempt11:05:271
637880992418,4cyclictest662253-21kworker/u8:1+events_unbound08:35:141
637880992416,4cyclictest231ktimers/110:25:131
637880992410,3cyclictest131rcu_preempt12:05:221
637880992410,3cyclictest131rcu_preempt12:05:221
63787599241,7cyclictest6977412idleruntime10:00:170
637875992417,3cyclictest0-21swapper/010:47:280
637875992416,4cyclictest0-21swapper/009:00:240
637875992415,6cyclictest121ktimers/010:50:020
63787599241,3cyclictest685131-21apt-get09:25:120
63787599241,20cyclictest656260-21/usr/sbin/munin08:00:210
63787599241,19cyclictest0-21swapper/007:14:440
63788899237,6cyclictest131rcu_preempt07:30:123
63787599232,5cyclictest740321-21apt12:05:000
637875992318,3cyclictest0-21swapper/008:31:100
637875992317,3cyclictest0-21swapper/012:25:150
637875992317,3cyclictest0-21swapper/010:05:260
63787599231,6cyclictest658420-21grep08:05:260
637875992316,5cyclictest730865-21kworker/u8:4+events_unbound11:50:560
637875992316,4cyclictest711350-21fschecks_time10:40:160
637875992315,6cyclictest0-21swapper/010:30:340
63787599231,18cyclictest0-21swapper/008:13:420
63787599230,19cyclictest0-21swapper/009:22:480
63787599230,19cyclictest0-21swapper/007:23:030
63787599221,19cyclictest0-21swapper/011:30:220
63787599221,19cyclictest0-21swapper/009:58:510
63787599221,19cyclictest0-21swapper/009:50:390
63787599220,18cyclictest0-21swapper/009:31:570
637875992012,5cyclictest121ktimers/009:10:150
63787599200,18cyclictest0-21swapper/007:50:300
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional