You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-15 - 20:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sat Aug 15, 2026 12:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2356413994741,4cyclictest2363555-21kworker/u8:1+events_unbound07:45:051
2356408994636,7cyclictest2367181-21sendmail07:40:000
2356422994437,5cyclictest2404845-21kworker/u8:0+events_unbound09:40:343
2356413994433,7cyclictest1-21systemd08:55:241
2356408994331,7cyclictest2437502-21grep11:00:250
2356422994225,10cyclictest131rcu_preempt08:07:193
2356413994232,6cyclictest2365053-21grep07:30:271
2356408994230,8cyclictest2380817-21idleruntime-cro08:20:010
2356422994133,6cyclictest2401342-21kworker/u8:1+events_unbound09:32:423
2356413994134,4cyclictest2463540-21munin-run12:20:011
2356413994132,5cyclictest0-21swapper/107:25:011
2356413994132,4cyclictest2367175-21idleruntime-cro07:40:011
2356408994129,9cyclictest2449887-21sendmail11:40:000
2356417994030,6cyclictest0-21swapper/211:40:262
2356413994034,4cyclictest2409977-21kworker/u8:1+events_unbound09:55:351
2356413994021,8cyclictest131rcu_preempt10:45:121
2356413994016,5cyclictest0-21swapper/109:50:121
2356422993932,5cyclictest2439880-21kworker/u8:1+events_unbound11:15:483
2356422993924,4cyclictest131rcu_preempt07:55:533
2356413993914,7cyclictest131rcu_preempt07:10:131
235641399391,24cyclictest0-21swapper/107:25:141
2356422993830,4cyclictest0-21swapper/307:20:003
2356422993823,4cyclictest131rcu_preempt09:58:563
2356422993822,6cyclictest2437595-21kworker/u8:2+events_unbound11:23:403
2356422993822,10cyclictest131rcu_preempt12:04:003
2356422993821,5cyclictest131rcu_preempt12:39:593
2356413993832,4cyclictest2409977-21kworker/u8:1+events_unbound09:45:331
2356413993831,5cyclictest2437595-21kworker/u8:2+events_unbound11:10:451
2356422993731,4cyclictest2375557-21kworker/u8:1+events_unbound08:15:113
2356422993731,4cyclictest2375557-21kworker/u8:1+events_unbound08:10:103
2356422993730,5cyclictest2461589-21kworker/u8:0+events_unbound12:14:423
2356422993725,8cyclictest2463526-21sh12:20:013
2356422993720,4cyclictest131rcu_preempt12:08:083
2356422993719,4cyclictest131rcu_preempt08:51:043
2356417993727,6cyclictest0-21swapper/208:55:242
2356413993731,4cyclictest2437595-21kworker/u8:2+events_unbound11:20:471
2356413993728,5cyclictest0-21swapper/112:15:011
2356413993726,7cyclictest2422189-21sendmail10:20:001
2356413993713,6cyclictest0-21swapper/111:15:121
2356422993627,6cyclictest0-21swapper/309:00:253
2356422993623,3cyclictest0-21swapper/307:50:253
2356422993620,5cyclictest131rcu_preempt09:05:193
2356422993620,4cyclictest131rcu_preempt10:25:133
2356422993619,4cyclictest131rcu_preempt08:45:263
2356422993618,5cyclictest131rcu_preempt08:40:263
2356417993630,4cyclictest2375557-21kworker/u8:1+events_unbound08:20:152
2356417993626,6cyclictest0-21swapper/211:45:262
2356417993626,6cyclictest0-21swapper/208:30:262
2356413993629,5cyclictest2444696-21kworker/u8:0+events_unbound11:50:501
2356413993629,5cyclictest2444696-21kworker/u8:0+events_unbound11:50:501
2356413993628,4cyclictest0-21swapper/111:00:011
2356413993626,7cyclictest0-21swapper/108:35:171
2356413993621,8cyclictest2445005-21/usr/sbin/munin11:25:151
2356422993523,5cyclictest2444696-21kworker/u8:0+events_unbound11:38:423
2356422993522,5cyclictest131rcu_preempt10:45:383
2356422993520,8cyclictest131rcu_preempt07:14:533
2356422993520,4cyclictest131rcu_preempt08:21:093
2356422993519,4cyclictest131rcu_preempt10:39:493
2356422993519,3cyclictest0-21swapper/311:33:443
2356422993514,5cyclictest131rcu_preempt12:30:013
2356422993512,5cyclictest131rcu_preempt08:25:173
2356417993529,3cyclictest24362602chrt11:00:012
235641399356,5cyclictest131rcu_preempt10:10:111
235641399355,18cyclictest24-21ksoftirqd/110:20:271
2356413993525,6cyclictest0-21swapper/111:35:251
2356413993519,5cyclictest131rcu_preempt09:25:141
2356413993519,5cyclictest131rcu_preempt08:15:271
2356408993528,3cyclictest0-21swapper/009:59:590
2356422993428,4cyclictest2404845-21kworker/u8:0+events_unbound10:06:423
2356422993428,4cyclictest2404845-21kworker/u8:0+events_unbound10:06:423
2356422993426,4cyclictest0-21swapper/310:40:263
2356422993420,4cyclictest131rcu_preempt07:31:383
2356422993419,4cyclictest131rcu_preempt11:26:013
2356422993418,5cyclictest131rcu_preempt09:50:223
2356422993417,9cyclictest131rcu_preempt09:10:243
2356422993417,5cyclictest131rcu_preempt10:10:113
2356422993417,4cyclictest131rcu_preempt10:57:333
2356422993413,5cyclictest131rcu_preempt07:50:013
2356422993413,11cyclictest131rcu_preempt10:15:143
2356417993426,5cyclictest2456706-21munin-run12:00:002
2356417993426,5cyclictest0-21swapper/208:50:162
2356417993425,6cyclictest0-21swapper/211:20:012
2356413993424,6cyclictest0-21swapper/108:10:011
2356413993412,6cyclictest24-21ksoftirqd/108:25:271
2356408993426,4cyclictest0-21swapper/007:25:160
2356408993424,6cyclictest0-21swapper/009:20:010
2356422993327,4cyclictest2360015-21kworker/u8:1+events_unbound07:20:023
2356422993326,3cyclictest0-21swapper/308:55:173
2356422993319,4cyclictest131rcu_preempt11:46:293
2356422993319,3cyclictest131rcu_preempt11:43:523
2356422993318,4cyclictest131rcu_preempt08:35:233
2356422993317,5cyclictest131rcu_preempt12:35:003
2356422993317,4cyclictest131rcu_preempt11:53:363
2356422993317,4cyclictest131rcu_preempt11:53:363
2356422993317,4cyclictest131rcu_preempt10:20:033
2356422993315,9cyclictest131rcu_preempt09:35:123
2356422993314,3cyclictest131rcu_preempt11:05:133
2356417993326,4cyclictest0-21swapper/210:40:012
2356413993324,6cyclictest0-21swapper/109:00:251
2356413993322,7cyclictest0-21swapper/110:00:291
2356408993326,5cyclictest2385930-21audit_send_reply08:35:010
2356408993326,3cyclictest0-21swapper/011:20:270
2356422993219,4cyclictest131rcu_preempt07:28:263
2356422993216,6cyclictest131rcu_preempt11:56:223
2356422993216,4cyclictest131rcu_preempt09:47:023
2356422993215,4cyclictest131rcu_preempt10:50:123
2356422993215,4cyclictest131rcu_preempt09:16:573
2356422993214,9cyclictest131rcu_preempt10:30:253
2356422993214,4cyclictest131rcu_preempt11:03:413
2356422993212,5cyclictest131rcu_preempt10:00:163
2356417993224,4cyclictest0-21swapper/207:14:572
2356417993223,6cyclictest0-21swapper/207:40:252
2356417993223,6cyclictest0-21swapper/207:40:252
235641399329,7cyclictest24-21ksoftirqd/109:34:451
2356413993226,4cyclictest2423540-21kworker/u8:2+events_unbound10:51:411
2356413993224,6cyclictest2446432-21kworker/u8:1+events_unbound11:34:411
2356413993223,6cyclictest0-21swapper/112:30:261
2356413993222,6cyclictest0-21swapper/108:00:271
2356413993219,8cyclictest131rcu_preempt12:35:171
2356413993215,6cyclictest2382172-21kworker/u8:2+events_unbound08:53:031
2356408993225,4cyclictest2468869-21munin-plugin-st12:35:000
2356422993118,5cyclictest131rcu_preempt08:30:253
2356422993117,4cyclictest131rcu_preempt12:24:373
2356422993116,4cyclictest131rcu_preempt09:22:563
2356422993110,11cyclictest40-21ksoftirqd/309:30:003
2356417993125,3cyclictest2470562-21kthreadd12:40:002
2356417993123,4cyclictest0-21swapper/208:45:172
2356417993123,4cyclictest0-21swapper/208:15:172
2356417993122,5cyclictest0-21swapper/211:10:262
2356417993122,5cyclictest0-21swapper/208:05:012
235641399319,12cyclictest24-21ksoftirqd/110:10:011
235641399319,12cyclictest24-21ksoftirqd/110:10:011
235641399318,11cyclictest24-21ksoftirqd/109:40:271
2356413993120,7cyclictest0-21swapper/109:15:151
2356413993119,6cyclictest131rcu_preempt10:35:011
2356413993117,6cyclictest131rcu_preempt11:55:241
2356413993115,10cyclictest131rcu_preempt12:30:001
2356413993114,11cyclictest2356403-21cyclictest12:07:391
2356413993110,12cyclictest24-21ksoftirqd/107:40:231
2356413993110,12cyclictest24-21ksoftirqd/107:40:231
2356413993110,10cyclictest24-21ksoftirqd/107:15:211
2356408993125,4cyclictest2463345-21kworker/u8:2+events_unbound12:25:520
2356408993121,6cyclictest0-21swapper/008:40:010
235642299309,11cyclictest40-21ksoftirqd/308:00:243
2356422993019,7cyclictest391ktimers/307:40:163
2356422993019,7cyclictest391ktimers/307:40:153
2356417993024,4cyclictest2418301-21unixbench_multi10:05:252
2356417993024,4cyclictest2418301-21unixbench_multi10:05:242
2356417993024,4cyclictest2389353-21cron08:45:002
2356417993021,6cyclictest2404695-21grep09:25:272
2356417993021,6cyclictest0-21swapper/212:05:252
2356417993021,6cyclictest0-21swapper/209:05:012
2356417993021,6cyclictest0-21swapper/208:30:012
2356417993021,5cyclictest0-21swapper/207:30:262
235641399309,11cyclictest131rcu_preempt12:20:221
2356413993016,7cyclictest2377287-21kworker/u8:0+events_unbound08:21:591
2356413993015,4cyclictest131rcu_preempt10:43:121
2356413993015,4cyclictest131rcu_preempt08:00:021
2356408993022,4cyclictest0-21swapper/008:15:010
2356422992912,5cyclictest131rcu_preempt07:35:153
2356417992919,7cyclictest2361650-21unixbench_singl07:20:262
2356417992919,6cyclictest0-21swapper/211:25:252
235641399298,13cyclictest24-21ksoftirqd/111:00:201
2356413992921,4cyclictest0-21swapper/111:45:001
2356413992914,5cyclictest131rcu_preempt11:45:121
2356413992913,3cyclictest131rcu_preempt10:40:001
2356413992912,4cyclictest131rcu_preempt09:15:021
2356408992921,6cyclictest2401342-21kworker/u8:1+events_unbound09:35:310
2356408992921,4cyclictest0-21swapper/008:20:140
2356408992919,6cyclictest2470076-21grep12:35:260
2356417992821,4cyclictest0-21swapper/212:15:492
2356417992821,4cyclictest0-21swapper/210:40:262
2356417992820,5cyclictest0-21swapper/211:00:242
2356417992817,7cyclictest2447711-21grep11:30:252
235641399288,13cyclictest24-21ksoftirqd/108:10:261
235641399286,4cyclictest131rcu_preempt10:30:011
2356413992816,3cyclictest131rcu_preempt08:45:171
2356413992815,9cyclictest204-21dbus-daemon08:30:151
2356408992822,4cyclictest2361745-21kworker/u8:2+events_unbound07:40:050
2356408992822,4cyclictest2361745-21kworker/u8:2+events_unbound07:40:050
2356408992821,4cyclictest2456222-21unixbench_multi11:55:250
2356417992720,4cyclictest0-21swapper/212:20:262
2356417992719,5cyclictest0-21swapper/212:05:002
2356417992719,5cyclictest0-21swapper/209:40:002
2356417992719,5cyclictest0-21swapper/209:10:262
2356417992719,5cyclictest0-21swapper/209:10:002
2356417992717,7cyclictest2363763-21idleruntime-cro07:30:012
235641399279,10cyclictest24-21ksoftirqd/109:05:171
2356413992719,5cyclictest0-21swapper/108:40:171
2356413992714,4cyclictest131rcu_preempt09:35:241
2356413992711,10cyclictest131rcu_preempt07:50:211
235640899279,5cyclictest121ktimers/008:25:200
2356408992719,5cyclictest0-21swapper/010:10:000
2356408992719,5cyclictest0-21swapper/010:10:000
2356408992716,7cyclictest2458421-21sh12:05:000
2356417992619,4cyclictest0-21swapper/208:40:012
2356417992618,5cyclictest0-21swapper/212:30:012
2356417992618,5cyclictest0-21swapper/208:05:272
2356417992618,5cyclictest0-21swapper/207:55:162
235641399266,7cyclictest24-21ksoftirqd/112:03:571
235641399266,12cyclictest24-21ksoftirqd/111:05:221
2356413992619,5cyclictest2401342-21kworker/u8:1+events_unbound09:20:121
235640899263,4cyclictest2431363-21apt-get10:45:110
235640899262,3cyclictest2396937-21df_inode09:05:140
2356408992619,4cyclictest0-21swapper/009:40:270
2356408992618,5cyclictest0-21swapper/010:20:170
2356408992618,4cyclictest0-21swapper/010:25:110
2356417992516,6cyclictest0-21swapper/209:30:272
2356417992516,5cyclictest2468857-21auditctl12:35:002
2356417992515,8cyclictest2378510-21sed08:10:262
2356408992519,4cyclictest2372045-21kworker/u8:0+events_unbound07:53:420
2356408992519,4cyclictest2357687-21kworker/u8:3+events_unbound07:12:410
2356408992518,4cyclictest13550irq/42-30be0000.ethernet10:45:010
235640899251,21cyclictest2396393-21munin-run09:05:010
235640899251,20cyclictest2435542-21cat10:55:240
235640899251,20cyclictest0-21swapper/010:51:390
2356417992418,4cyclictest2409977-21kworker/u8:1+events_unbound09:48:052
2356417992417,4cyclictest0-21swapper/210:20:272
2356417992416,5cyclictest0-21swapper/211:50:262
2356417992416,5cyclictest0-21swapper/211:50:252
2356417992416,5cyclictest0-21swapper/211:35:262
2356417992414,6cyclictest0-21swapper/210:15:252
2356408992418,3cyclictest2429019-21sendmail10:40:010
2356408992418,3cyclictest0-21swapper/011:10:250
2356408992418,3cyclictest0-21swapper/008:45:250
2356408992416,6cyclictest2450112-21kworker/u8:1+events_unbound11:40:500
2356408992416,5cyclictest2453688-21grep11:50:170
2356408992416,5cyclictest2453688-21grep11:50:170
2356408992416,5cyclictest0-21swapper/008:55:160
2356408992416,4cyclictest0-21swapper/008:00:010
2356408992413,7cyclictest2461357-21grep12:10:270
2356408992412,8cyclictest204-21dbus-daemon11:05:450
235640899241,20cyclictest2448195-21basename11:35:000
235640899241,19cyclictest0-21swapper/012:09:160
235640899241,19cyclictest0-21swapper/007:21:090
235640899240,20cyclictest0-21swapper/009:28:050
2356417992317,3cyclictest0-21swapper/207:50:252
2356417992316,4cyclictest0-21swapper/210:50:262
2356417992315,5cyclictest0-21swapper/210:10:252
2356417992312,8cyclictest2360368-21tr07:20:012
2356408992319,2cyclictest13550irq/42-30be0000.ethernet11:45:110
2356408992318,2cyclictest0-21swapper/010:30:250
2356408992317,4cyclictest11-21ksoftirqd/007:15:140
2356408992316,5cyclictest0-21swapper/007:46:290
2356408992316,4cyclictest0-21swapper/010:15:250
2356408992316,3cyclictest0-21swapper/009:50:170
2356408992315,5cyclictest0-21swapper/010:10:250
235640899231,18cyclictest0-21swapper/012:16:000
235640899231,18cyclictest0-21swapper/010:04:320
235640899231,18cyclictest0-21swapper/009:20:370
235640899231,18cyclictest0-21swapper/008:41:010
235640899230,19cyclictest0-21swapper/011:28:440
235640899230,19cyclictest0-21swapper/009:49:200
235640899230,19cyclictest0-21swapper/009:32:430
235640899230,19cyclictest0-21swapper/008:10:000
2356417992216,4cyclictest2363555-21kworker/u8:1+events_unbound07:47:202
2356417992216,3cyclictest2460904-21ntpq12:10:222
2356417992216,3cyclictest0-21swapper/209:20:182
2356417992215,5cyclictest53-21kcompactd010:00:192
2356417992214,5cyclictest0-21swapper/210:30:242
2356408992216,2cyclictest0-21swapper/008:00:440
2356408992215,3cyclictest0-21swapper/012:20:170
2356408992215,3cyclictest0-21swapper/009:12:250
235640899221,19cyclictest0-21swapper/007:30:130
2356417992115,4cyclictest23658162sleep207:35:172
2356417992115,3cyclictest0-21swapper/211:05:252
2356417992114,4cyclictest0-21swapper/210:25:252
2356417992113,5cyclictest0-21swapper/211:20:252
2356417992113,5cyclictest0-21swapper/209:55:162
2356417992113,5cyclictest0-21swapper/209:40:272
2356417992111,7cyclictest2432490-21seq10:45:572
2356408992116,3cyclictest13550irq/42-30be0000.ethernet08:50:150
235640899210,3cyclictest0-21swapper/011:16:460
2356417992012,5cyclictest0-21swapper/209:50:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional