You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-07 - 16:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Tue Jul 07, 2026 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3354869995640,13cyclictest3379698-21munin-plugin-st08:20:013
3354860995547,6cyclictest3402019-21kworker/u8:1+events_unbound09:29:421
3354869995143,4cyclictest3384610-21unixbench_singl08:30:273
3354869995118,7cyclictest0-21swapper/311:15:253
3354860995138,10cyclictest231ktimers/111:55:121
3354860995036,10cyclictest231ktimers/110:45:111
3354865994824,19cyclictest0-21swapper/208:40:262
3354857994737,6cyclictest3406157-21grep09:35:170
3354860994638,5cyclictest3362211-21cron07:30:011
3354860994539,4cyclictest3363538-21kworker/u8:3+events_unbound07:39:221
3354860994539,4cyclictest3360432-21kworker/u8:2+events_unbound07:24:191
3354865994430,10cyclictest311ktimers/208:30:142
335486599441,38cyclictest3389262-21/usr/sbin/munin08:45:222
335486599441,12cyclictest3433527-21/usr/sbin/munin10:55:172
3354865994334,6cyclictest3376706-21fschecks_time08:10:152
3354865994331,8cyclictest311ktimers/209:10:122
3354860994331,9cyclictest3388442-21cron08:45:011
3354869994230,8cyclictest391ktimers/309:40:133
3354865994230,7cyclictest3361781-21grep07:25:272
3354865994225,12cyclictest311ktimers/212:00:132
3354865994225,12cyclictest0-21swapper/207:15:282
335486599421,36cyclictest3464565-21sshd12:25:072
335486599421,13cyclictest3383318-21cron08:30:012
3354860994235,5cyclictest3425913-21kworker/u8:1+events_unbound10:39:521
3354869994129,8cyclictest3369091-21apt-key07:50:023
335486599413,11cyclictest3449127-21cp11:40:012
3354865994129,7cyclictest3429599-21cron10:45:012
3354865994129,6cyclictest0-21swapper/211:35:002
335486599412,10cyclictest3366207-21irqstats07:40:172
335486599411,8cyclictest3375083-21/usr/sbin/munin08:05:172
335486599411,3cyclictest0-21swapper/209:35:122
335486599411,37cyclictest3403915-21cron09:29:012
335486599411,10cyclictest3379293-21/usr/sbin/munin08:15:232
3354869994033,4cyclictest3421089-21sendmail10:20:013
335486599403,6cyclictest3404348-21df09:30:142
335486599403,5cyclictest3444007-21df11:25:132
3354865994032,5cyclictest3426579-21fschecks_count10:35:162
335486599402,33cyclictest438-21cron07:55:012
3354865994020,17cyclictest0-21swapper/209:40:202
335486599401,9cyclictest3432557-21/usr/sbin/munin10:50:252
335486599401,9cyclictest3373117-21/usr/sbin/munin08:00:272
335486599401,10cyclictest3372650-21cron08:00:012
335486599401,10cyclictest3355075-21/usr/sbin/munin07:10:142
3354860994032,4cyclictest3414248-21sh10:00:011
3354869993927,7cyclictest0-21swapper/312:25:253
3354865993927,7cyclictest0-21swapper/207:40:002
335486599392,6cyclictest3443610-21sshd11:24:282
335486599392,34cyclictest3425302-21open_files10:30:222
3354865993921,14cyclictest0-21swapper/212:35:242
335486599391,9cyclictest3462989-21df12:20:162
335486599391,9cyclictest3391458-21users08:50:272
335486599391,8cyclictest3385312-21/usr/sbin/munin08:35:132
335486599391,7cyclictest3360337-21cron07:23:012
335486599391,5cyclictest3434955-21/usr/sbin/munin11:00:102
335486599391,4cyclictest3447866-21ntp_states11:35:192
335486599391,4cyclictest0-21swapper/211:45:112
335486599391,3cyclictest0-21swapper/212:05:112
335486599391,3cyclictest0-21swapper/210:10:132
335486599391,3cyclictest0-21swapper/208:20:162
335486599391,35cyclictest3362904-21memory07:30:232
335486599390,3cyclictest0-21swapper/212:15:132
3354860993932,4cyclictest3441975-21sendmail11:20:011
3354860993932,4cyclictest3356745-21tune2fs07:15:021
3354860993931,6cyclictest3384726-21kworker/u8:1+events_unbound08:34:341
3354857993932,4cyclictest3448900-21apt-config11:40:000
3354869993826,7cyclictest0-21swapper/311:10:253
335486599389,26cyclictest3452923-21/usr/sbin/munin11:50:172
335486599382,4cyclictest3466604-21/usr/sbin/munin12:30:182
335486599382,4cyclictest3466604-21/usr/sbin/munin12:30:172
335486599381,9cyclictest3437943-21awk11:05:262
335486599381,5cyclictest3424344-21sshd10:28:292
335486599381,5cyclictest3394534-21/usr/sbin/munin09:00:202
335486599381,4cyclictest3409498-21/usr/sbin/munin09:45:162
335486599381,3cyclictest3401616-21/usr/sbin/munin09:20:252
335486599381,3cyclictest0-21swapper/209:50:122
335486599381,34cyclictest3460702-21sshd12:12:272
3354865993813,22cyclictest3439176-21latency11:10:192
3354865993810,26cyclictest3395713-21/usr/sbin/munin09:05:242
335486599380,3cyclictest0-21swapper/211:55:122
3354860993822,9cyclictest131rcu_preempt11:00:141
3354860993821,10cyclictest131rcu_preempt07:49:001
3354860993819,4cyclictest131rcu_preempt12:30:141
3354860993819,4cyclictest131rcu_preempt12:30:141
3354857993827,8cyclictest121ktimers/011:25:120
3354869993727,6cyclictest3436424-21debian-sa111:05:013
3354869993725,8cyclictest0-21swapper/307:50:253
335486599379,23cyclictest0-21swapper/209:55:162
335486599371,9cyclictest3440758-21/usr/sbin/munin11:15:182
335486599371,9cyclictest3393096-21sed08:55:252
335486599371,8cyclictest3417254-21unixbench_singl10:05:252
335486599371,7cyclictest3419752-21cut10:15:162
335486599371,5cyclictest3414824-21irqstats10:00:192
335486599371,5cyclictest3414824-21irqstats10:00:182
335486599371,4cyclictest3421560-21/usr/sbin/munin10:20:182
335486599371,3cyclictest0-21swapper/210:45:132
335486599371,11cyclictest3367676-21ls07:45:142
335486599370,3cyclictest0-21swapper/209:15:132
3354860993719,5cyclictest131rcu_preempt09:20:001
3354869993627,6cyclictest3381617-21sh08:25:003
3354860993620,4cyclictest131rcu_preempt10:02:381
3354860993620,4cyclictest131rcu_preempt10:02:381
3354860993618,5cyclictest131rcu_preempt10:50:191
3354869993528,3cyclictest0-21swapper/308:40:003
3354869993527,4cyclictest0-21swapper/312:00:273
3354869993526,6cyclictest3469442-21apt12:40:003
3354860993519,4cyclictest131rcu_preempt07:55:191
3354860993515,12cyclictest131rcu_preempt09:45:011
3354857993526,4cyclictest0-21swapper/008:50:230
3354869993426,4cyclictest0-21swapper/312:15:183
3354869993424,6cyclictest0-21swapper/310:00:263
3354869993424,6cyclictest0-21swapper/310:00:263
3354869993424,6cyclictest0-21swapper/308:10:263
3354869993423,7cyclictest0-21swapper/309:25:263
3354869993423,6cyclictest0-21swapper/310:35:263
3354869993422,7cyclictest3407434-21sendmail09:40:013
3354860993421,5cyclictest3372380-21kworker/u8:0+events_unbound08:28:131
3354860993417,9cyclictest131rcu_preempt11:50:011
3354860993416,5cyclictest131rcu_preempt09:24:031
3354860993415,5cyclictest131rcu_preempt12:20:231
3354857993425,5cyclictest0-21swapper/008:20:010
3354857993424,7cyclictest3417221-21grep10:05:260
3354869993324,6cyclictest3358800-21cron07:20:013
3354869993323,7cyclictest3434302-21grep10:55:253
3354860993325,4cyclictest0-21swapper/111:40:151
3354860993321,5cyclictest131rcu_preempt12:04:421
3354860993318,5cyclictest131rcu_preempt09:30:151
3354860993315,11cyclictest131rcu_preempt11:30:161
3354860993314,5cyclictest131rcu_preempt11:05:201
3354860993313,12cyclictest131rcu_preempt08:15:151
3354860993313,10cyclictest131rcu_preempt08:35:281
3354857993326,3cyclictest0-21swapper/008:10:010
335486099329,6cyclictest131rcu_preempt10:20:261
3354860993227,3cyclictest3378188-21latency_hist08:15:021
3354860993217,4cyclictest131rcu_preempt08:00:211
3354860993216,9cyclictest131rcu_preempt12:35:161
3354860993210,15cyclictest131rcu_preempt09:10:361
3354860993210,14cyclictest24-21ksoftirqd/110:05:141
3354857993224,6cyclictest121ktimers/010:45:110
3354857993222,6cyclictest0-21swapper/007:25:250
3354869993123,4cyclictest0-21swapper/312:05:153
3354869993123,4cyclictest0-21swapper/311:35:233
335486099319,13cyclictest3434715-21munin-run11:00:011
335486099318,9cyclictest24-21ksoftirqd/111:39:591
335486099315,5cyclictest24-21ksoftirqd/107:50:061
3354860993125,4cyclictest3419284-21kworker/u8:3+events_unbound10:33:421
3354860993124,4cyclictest0-21swapper/108:45:251
3354860993118,9cyclictest3412124-21grep09:50:251
3354860993117,4cyclictest131rcu_preempt08:51:051
3354860993117,4cyclictest131rcu_preempt07:40:261
3354860993116,5cyclictest131rcu_preempt10:15:161
3354860993114,10cyclictest131rcu_preempt08:05:191
3354860993111,4cyclictest131rcu_preempt09:09:381
3354860993110,5cyclictest131rcu_preempt11:25:161
3354857993121,7cyclictest0-21swapper/010:35:010
3354857993120,8cyclictest438-21cron08:30:000
3354857993120,8cyclictest3446659-21grep11:30:260
3354857993120,7cyclictest3372192-21grep07:55:260
3354857993120,6cyclictest0-21swapper/010:20:250
3354869993020,6cyclictest0-21swapper/307:55:273
3354869993019,7cyclictest3363475-21grep07:30:283
335486099307,20cyclictest231ktimers/111:50:191
335486099305,8cyclictest24-21ksoftirqd/108:55:201
3354860993024,4cyclictest3357320-21kworker/u8:3+events_unbound07:16:321
3354860993020,4cyclictest131rcu_preempt09:40:011
3354860993014,5cyclictest131rcu_preempt12:15:051
3354860993013,9cyclictest131rcu_preempt10:25:191
3354860993013,4cyclictest131rcu_preempt09:45:141
3354860993012,4cyclictest131rcu_preempt12:05:191
3354857993025,3cyclictest3457311-21kworker/u8:2+events_unbound12:20:150
3354857993025,3cyclictest3393573-21sendmail09:00:000
3354857993022,5cyclictest3466049-21idleruntime-cro12:29:590
3354857993022,5cyclictest0-21swapper/009:05:170
3354857993022,4cyclictest0-21swapper/007:40:260
3354869992922,4cyclictest0-21swapper/309:10:253
3354869992922,3cyclictest0-21swapper/312:30:163
3354869992922,3cyclictest0-21swapper/312:30:163
3354869992922,3cyclictest0-21swapper/311:45:003
3354869992920,5cyclictest0-21swapper/307:20:163
3354869992917,8cyclictest0-21swapper/309:00:003
335486099299,4cyclictest131rcu_preempt07:30:211
335486099294,4cyclictest24-21ksoftirqd/112:10:251
3354860992922,5cyclictest3431148-21kworker/u8:0+events_unbound11:20:071
3354860992917,4cyclictest131rcu_preempt10:41:461
3354860992916,6cyclictest3415911-21kworker/u8:0+events_unbound10:13:151
3354860992915,4cyclictest131rcu_preempt12:25:161
3354860992915,4cyclictest131rcu_preempt11:10:161
3354860992913,4cyclictest0-21swapper/109:00:211
3354857992922,5cyclictest121ktimers/009:55:110
3354869992821,3cyclictest0-21swapper/311:05:263
3354869992821,3cyclictest0-21swapper/307:10:263
3354869992819,6cyclictest0-21swapper/308:50:263
3354869992819,5cyclictest3390155-21idleruntime-cro08:50:013
3354869992818,6cyclictest0-21swapper/311:30:263
3354869992818,6cyclictest0-21swapper/310:05:263
335485799288,3cyclictest3388946-21if_err_eth008:45:180
3354857992820,4cyclictest3369049-21idleruntime-cro07:50:020
3354857992820,3cyclictest0-21swapper/007:35:260
3354857992818,7cyclictest3421059-21sh10:20:010
3354857992818,6cyclictest0-21swapper/009:20:010
335485799281,22cyclictest3371064-21latency_hist07:55:020
335485799272,6cyclictest3415488-21sed10:00:270
335485799272,6cyclictest3415488-21sed10:00:260
3354857992723,2cyclictest13550irq/42-30be0000.ethernet12:05:110
335485799271,9cyclictest3398089-21ps09:10:230
3354857992717,7cyclictest3462208-21unixbench_singl12:15:280
3354869992619,4cyclictest3451095-21grep11:45:153
3354869992618,5cyclictest0-21swapper/311:25:223
335485799261,9cyclictest3427913-21awk10:40:010
3354857992617,6cyclictest3432545-21grep10:50:240
3354857992616,6cyclictest0-21swapper/011:55:260
3354869992520,3cyclictest3453634-21unixbench_multi11:50:263
3354869992519,3cyclictest0-21swapper/310:30:273
3354869992517,5cyclictest0-21swapper/308:40:243
3354869992517,4cyclictest0-21swapper/312:10:243
3354869992517,4cyclictest0-21swapper/311:55:263
3354869992517,4cyclictest0-21swapper/307:30:003
3354857992517,6cyclictest3469529-21ls12:40:000
3354857992516,5cyclictest0-21swapper/009:41:360
3354857992515,6cyclictest0-21swapper/012:15:000
3354857992515,5cyclictest3358789-21cron07:20:010
335485799250,2cyclictest0-21swapper/011:10:050
3354869992418,3cyclictest0-21swapper/309:55:013
3354869992414,5cyclictest0-21swapper/311:20:163
3354857992418,3cyclictest13850irq/36-mmc107:15:020
3354857992417,4cyclictest0-21swapper/009:20:150
3354857992417,3cyclictest0-21swapper/009:50:200
3354857992417,3cyclictest0-21swapper/008:24:470
3354857992417,3cyclictest0-21swapper/007:20:200
3354857992415,6cyclictest3428946-21sort10:40:240
335485799241,19cyclictest0-21swapper/011:46:210
335485799241,19cyclictest0-21swapper/011:19:070
335485799241,19cyclictest0-21swapper/008:38:540
3354869992317,3cyclictest0-21swapper/309:55:253
3354869992316,4cyclictest0-21swapper/310:10:283
3354869992316,4cyclictest0-21swapper/309:15:263
3354869992315,5cyclictest0-21swapper/310:45:163
3354869992315,5cyclictest0-21swapper/309:20:263
3354869992312,7cyclictest3382921-21grep08:25:263
335485799231,7cyclictest3467767-21grep12:35:000
335485799231,7cyclictest3467767-21grep12:34:590
3354857992317,3cyclictest0-21swapper/009:05:000
3354857992317,2cyclictest0-21swapper/009:45:190
3354857992316,4cyclictest3403558-21tail09:25:260
335485799231,5cyclictest3434957-21apt-get11:00:130
3354857992314,5cyclictest33631382sleep007:30:260
335485799231,18cyclictest0-21swapper/011:42:220
335485799231,18cyclictest0-21swapper/011:21:150
335485799231,18cyclictest0-21swapper/010:29:050
3354869992215,3cyclictest0-21swapper/309:35:003
3354869992214,5cyclictest0-21swapper/312:20:263
3354869992213,6cyclictest0-21swapper/310:20:113
3354869992213,5cyclictest0-21swapper/310:25:193
3354869992213,4cyclictest0-21swapper/307:35:263
3354857992216,3cyclictest3418079-21fschecks_time10:10:180
3354857992214,4cyclictest3388046-21grep08:40:270
3354857992212,6cyclictest0-21swapper/009:30:260
335485799221,19cyclictest0-21swapper/008:02:150
335485799220,18cyclictest0-21swapper/008:13:240
3354869992115,3cyclictest3395664-21latency_hist09:05:013
3354869992114,5cyclictest391ktimers/308:00:053
3354869992113,5cyclictest0-21swapper/308:05:243
3354869992112,6cyclictest0-21swapper/310:45:013
335485799213,13cyclictest34338692chrt10:55:240
335485799210,19cyclictest0-21swapper/012:02:160
3354869991914,2cyclictest0-21swapper/310:50:103
3354869991910,6cyclictest3395805-21/usr/sbin/munin09:05:133
3354869991810,5cyclictest391ktimers/309:50:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional