You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-14 - 16:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Sat Mar 14, 2026 12:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3365347995343,7cyclictest204-21dbus-daemon07:15:151
3365347995343,7cyclictest204-21dbus-daemon07:15:151
3365351995122,4cyclictest0-21swapper/209:30:152
3365342995043,4cyclictest3388652-21fschecks_count08:15:170
3365351994939,7cyclictest311ktimers/211:00:132
3365351994921,7cyclictest0-21swapper/212:19:592
3365351994820,3cyclictest0-21swapper/207:30:222
3365342994634,9cyclictest121ktimers/010:30:130
3365356994435,5cyclictest3455206-21unixbench_singl11:25:263
3365347994415,10cyclictest3431738-21latency_hist10:20:011
3365342994435,5cyclictest3469693-21munin-plugin-st12:09:590
3365356994336,5cyclictest3389739-21kworker/u8:2+events_unbound09:30:353
3365347994336,4cyclictest3369705-21fschecks_count07:20:171
3365347994336,4cyclictest3369705-21fschecks_count07:20:171
3365347994119,13cyclictest0-21swapper/107:25:131
3365342994133,5cyclictest3369277-21cron07:20:000
3365342994133,5cyclictest3369277-21cron07:19:590
3365342994125,12cyclictest121ktimers/011:15:110
3365356994033,4cyclictest3389981-21sendmail08:20:003
3365351994031,6cyclictest3439819-21grep10:40:232
3365351994029,7cyclictest3396773-21cron08:40:002
3365351994029,7cyclictest3396773-21cron08:39:592
3365347994013,17cyclictest3476594-21cat12:30:011
3365356993925,11cyclictest391ktimers/307:10:133
3365356993925,11cyclictest391ktimers/307:10:133
3365351993927,8cyclictest3476098-21grep12:25:262
3365351993829,4cyclictest0-21swapper/208:00:002
3365347993829,5cyclictest3438566-21cron10:40:001
3365342993828,6cyclictest3410015-21unixbench_singl09:15:250
3365342993822,14cyclictest3360091-21kworker/u8:2+events_unbound07:55:240
3365356993728,4cyclictest0-21swapper/307:40:203
3365351993730,4cyclictest3459030-21cut11:40:002
3365347993726,7cyclictest3425508-21/usr/sbin/munin10:00:191
3365347993726,7cyclictest3425508-21/usr/sbin/munin10:00:191
3365347993724,9cyclictest3418865-21/usr/sbin/munin09:40:201
3365356993628,4cyclictest0-21swapper/309:25:003
3365351993626,7cyclictest0-21swapper/208:05:012
3365347993628,4cyclictest0-21swapper/109:20:011
3365342993628,4cyclictest0-21swapper/012:40:000
3365342993628,4cyclictest0-21swapper/007:55:010
3365356993525,6cyclictest0-21swapper/309:55:163
3365351993525,6cyclictest0-21swapper/210:25:152
3365347993527,4cyclictest0-21swapper/108:20:261
3365347993527,4cyclictest0-21swapper/108:20:261
3365347993526,4cyclictest3471616-21apt-get12:15:101
3365347993524,7cyclictest3403960-21/usr/sbin/munin09:00:131
3365347993524,7cyclictest3392916-21grep08:25:251
3365347993522,8cyclictest3421743-21apt-get09:50:101
3365347993520,10cyclictest3383289-21df_inode08:00:141
3365347993515,15cyclictest3430216-21grep10:15:011
3365342993525,6cyclictest0-21swapper/009:00:150
3365342993524,7cyclictest3424513-21grep09:55:260
3365342993523,8cyclictest3458605-21grep11:35:250
3365356993425,5cyclictest3375649-21grep07:35:273
3365356993424,7cyclictest391ktimers/312:00:133
3365356993424,7cyclictest3391674-21sh08:25:003
3365356993424,7cyclictest3391674-21sh08:25:003
3365356993419,11cyclictest391ktimers/308:45:113
3365356993419,11cyclictest391ktimers/308:45:103
3365351993427,3cyclictest0-21swapper/209:55:002
3365351993426,4cyclictest0-21swapper/212:40:002
3365351993423,7cyclictest3394681-21grep08:30:272
3365351993422,8cyclictest3429616-21grep10:10:232
3365347993427,4cyclictest3455851-21apt-get11:30:101
3365347993427,4cyclictest3376135-21sendmail07:40:001
3365347993427,4cyclictest3365509-21apt-get07:10:121
3365347993427,4cyclictest3365509-21apt-get07:10:111
3365347993427,3cyclictest3466517-21apt-get12:00:141
3365347993423,7cyclictest3470258-21/usr/sbin/munin12:10:181
3365347993422,9cyclictest3457553-21apt-get11:35:121
3365347993422,7cyclictest3401567-21cron08:51:001
3365347993418,10cyclictest3432593-21/usr/sbin/munin10:20:221
3365347993416,12cyclictest3393771-21/usr/sbin/munin08:30:161
3365342993427,4cyclictest3419825-21munin-plugin-st09:45:000
3365342993421,10cyclictest121ktimers/007:10:110
3365342993421,10cyclictest121ktimers/007:10:110
3365356993325,5cyclictest3475269-21fschecks_time12:25:163
3365356993325,4cyclictest0-21swapper/311:05:013
3365356993325,4cyclictest0-21swapper/309:15:253
3365356993322,7cyclictest0-21swapper/311:45:233
3365356993321,7cyclictest0-21swapper/307:30:253
3365351993324,6cyclictest3408724-21sh09:15:012
3365351993324,5cyclictest0-21swapper/207:45:212
3365347993325,4cyclictest0-21swapper/111:00:011
3365347993323,7cyclictest3428001-21cron10:06:001
3365347993323,7cyclictest3416759-21/usr/sbin/munin09:35:201
3365347993323,7cyclictest3380998-21sshd07:52:211
3365347993323,6cyclictest3411237-21/usr/sbin/munin09:20:201
3365347993322,8cyclictest3439941-21cron10:41:011
3365347993322,7cyclictest3450848-21/usr/sbin/munin11:15:141
3365347993321,9cyclictest3446845-21cron11:02:011
3365347993321,7cyclictest3388485-21/usr/sbin/munin08:15:191
3365347993320,9cyclictest3452567-21/usr/sbin/munin11:20:151
3365347993313,5cyclictest3402368-21perl08:55:161
3365342993326,4cyclictest0-21swapper/011:15:000
3365342993320,10cyclictest121ktimers/009:25:120
3365356993224,4cyclictest0-21swapper/309:15:003
3365356993224,4cyclictest0-21swapper/307:25:253
3365356993221,7cyclictest0-21swapper/308:55:253
3365356993219,8cyclictest0-21swapper/308:10:263
336535199327,4cyclictest3405788-21grep09:05:172
3365351993225,3cyclictest0-21swapper/210:35:262
3365351993224,4cyclictest0-21swapper/210:20:152
3365351993224,4cyclictest0-21swapper/209:00:152
3365351993224,4cyclictest0-21swapper/208:05:172
3365351993221,7cyclictest3450031-21grep11:10:232
3365347993226,3cyclictest3407260-21apt-get09:10:111
3365347993222,7cyclictest3477949-21cron12:32:001
3365347993222,7cyclictest3447453-21/usr/sbin/munin11:05:151
3365347993222,7cyclictest3421424-21cron09:49:001
3365347993220,9cyclictest3406770-21cron09:07:011
3365347993218,11cyclictest3423847-21/usr/sbin/munin09:55:191
3365347993215,12cyclictest3414495-21seq09:30:071
3365347993214,13cyclictest3397520-21missed_timers08:40:201
3365347993214,13cyclictest3397520-21missed_timers08:40:191
3365342993224,4cyclictest0-21swapper/012:25:260
3365342993223,5cyclictest0-21swapper/008:40:000
3365342993223,5cyclictest0-21swapper/008:40:000
3365342993221,7cyclictest3374879-21ls07:35:180
3365342993220,9cyclictest121ktimers/012:15:100
336535699314,7cyclictest131rcu_preempt11:55:113
3365356993123,4cyclictest0-21swapper/310:20:173
3365351993122,5cyclictest0-21swapper/210:00:002
3365347993125,3cyclictest3461182-21apt-get11:45:101
3365347993125,3cyclictest3442209-21apt-get10:50:131
3365347993123,4cyclictest0-21swapper/108:05:231
3365347993122,6cyclictest3396610-21cron08:38:001
3365347993122,6cyclictest3396610-21cron08:38:001
3365347993121,7cyclictest3469514-21cron12:08:001
3365347993121,7cyclictest3465095-21/usr/sbin/munin11:55:141
3365347993121,7cyclictest3455448-21cron11:28:001
3365347993121,7cyclictest3450325-21cron11:13:001
3365347993121,7cyclictest3441725-21cron10:47:011
3365347993121,7cyclictest3434986-21cron10:28:011
3365347993121,7cyclictest3377596-21sshd07:42:201
3365347993119,7cyclictest3398854-21diskstats08:45:151
3365347993119,7cyclictest3398854-21diskstats08:45:151
3365347993118,9cyclictest3478715-21/usr/sbin/munin12:35:181
3365347993118,9cyclictest3372990-21/usr/sbin/munin07:30:131
3365347993115,9cyclictest0-21swapper/111:50:111
3365342993124,5cyclictest3424554-21kworker/u8:0+events_unbound10:05:390
3365342993120,6cyclictest0-21swapper/008:00:240
336535699302,6cyclictest131rcu_preempt08:35:133
336535699302,6cyclictest131rcu_preempt08:35:133
3365356993022,4cyclictest0-21swapper/311:30:143
3365356993022,4cyclictest0-21swapper/310:45:243
3365356993021,5cyclictest0-21swapper/310:55:263
3365356993020,7cyclictest0-21swapper/312:39:593
336535699301,5cyclictest131rcu_preempt10:25:123
3365351993024,3cyclictest0-21swapper/211:05:262
3365351993024,3cyclictest0-21swapper/210:45:252
3365351993022,5cyclictest0-21swapper/207:20:172
3365351993022,5cyclictest0-21swapper/207:20:172
3365351993021,6cyclictest3369098-21kworker/u8:1+events_unbound07:25:212
3365351993019,7cyclictest3417918-21basename09:40:012
3365347993020,7cyclictest629-21snmpd08:12:481
3365347993018,7cyclictest3412924-21/usr/sbin/munin09:25:141
3365347993017,9cyclictest3382536-21/usr/sbin/munin07:55:271
3365347993016,11cyclictest3378826-21/usr/sbin/munin07:45:241
3365342993023,4cyclictest3403205-21unixbench_singl08:55:250
336534299301,8cyclictest3421519-21munin-plugin-st09:50:000
3365356992922,5cyclictest3462539-21kworker/u8:2+events_unbound12:30:583
3365356992922,3cyclictest0-21swapper/307:20:173
3365356992922,3cyclictest0-21swapper/307:20:163
3365356992921,4cyclictest0-21swapper/307:55:273
3365356992920,6cyclictest3422803-21grep09:50:243
3365356992920,6cyclictest0-21swapper/307:20:003
3365356992920,6cyclictest0-21swapper/307:20:003
3365356992919,6cyclictest3453453-21grep11:20:253
3365356992918,7cyclictest0-21swapper/311:15:233
3365351992922,3cyclictest0-21swapper/207:35:182
3365351992921,4cyclictest0-21swapper/212:00:172
3365351992920,6cyclictest0-21swapper/208:40:252
3365351992920,6cyclictest0-21swapper/208:40:252
3365351992919,7cyclictest3419345-21grep09:40:252
3365347992918,8cyclictest3459930-21/usr/sbin/munin11:40:191
3365347992918,7cyclictest3435508-21/usr/sbin/munin10:30:161
3365347992915,11cyclictest3473913-21/usr/sbin/munin12:20:231
3365342992922,4cyclictest3373955-21unixbench_multi07:30:250
3365342992918,7cyclictest0-21swapper/009:50:370
3365356992821,4cyclictest0-21swapper/311:40:003
3365356992821,3cyclictest0-21swapper/312:20:003
3365351992822,3cyclictest0-21swapper/212:05:242
3365351992820,4cyclictest0-21swapper/211:55:142
3365351992819,5cyclictest3412361-21apt-get09:25:002
3365342992820,4cyclictest0-21swapper/009:05:270
3365342992816,8cyclictest3470969-21grep12:10:250
3365356992720,5cyclictest3424554-21kworker/u8:0+events_unbound10:35:253
3365356992720,3cyclictest0-21swapper/308:50:153
3365356992719,6cyclictest3424554-21kworker/u8:0+events_unbound10:40:233
3365356992719,5cyclictest0-21swapper/309:40:153
3365351992720,3cyclictest0-21swapper/211:20:002
3365351992719,4cyclictest0-21swapper/210:30:422
3365351992719,4cyclictest0-21swapper/207:10:142
3365351992719,4cyclictest0-21swapper/207:10:142
3365342992719,5cyclictest3392073-21grep08:25:160
3365342992719,4cyclictest0-21swapper/008:40:250
3365342992719,4cyclictest0-21swapper/008:40:250
3365342992718,6cyclictest3457316-21sh11:35:000
3365356992619,5cyclictest391ktimers/310:05:133
3365356992619,5cyclictest3427428-21kworker/u8:1+events_unbound10:50:173
3365356992618,5cyclictest0-21swapper/309:25:253
3365356992614,4cyclictest3398143-21kworker/u8:1+events_unbound08:43:533
3365356992614,4cyclictest3398143-21kworker/u8:1+events_unbound08:43:533
336535199268,11cyclictest2273479-1kworker/2:2H+kblockd08:50:012
336535199268,11cyclictest2273479-1kworker/2:2H+kblockd08:50:012
3365351992620,4cyclictest3403017-21timerandwakeup08:55:242
3365351992620,3cyclictest0-21swapper/211:45:212
3365351992619,4cyclictest3365333-21cyclictest11:55:012
3365351992617,5cyclictest0-21swapper/207:40:232
336534299269,14cyclictest3407394-21fschecks_count09:10:150
336534299263,3cyclictest3416992-21ntp_states09:35:240
3365342992620,3cyclictest0-21swapper/011:30:010
3365342992619,4cyclictest13850irq/36-mmc111:10:010
3365342992618,5cyclictest11-21ksoftirqd/011:00:140
3365342992617,7cyclictest3453175-21mailstats11:20:230
3365342992617,6cyclictest0-21swapper/010:25:180
3365356992519,4cyclictest3434261-21kworker/u8:3+events_unbound10:31:133
3365356992518,5cyclictest3372538-21kworker/u8:3+events_unbound09:07:363
3365356992518,4cyclictest3445166-21kworker/u8:1+events_unbound12:22:493
3365356992516,6cyclictest0-21swapper/309:40:003
336535699251,12cyclictest0-21swapper/311:05:163
3365351992519,3cyclictest0-21swapper/212:30:202
3365351992518,3cyclictest0-21swapper/208:20:162
3365351992518,3cyclictest0-21swapper/208:20:152
3365351992514,7cyclictest1-21systemd09:15:342
336534299253,5cyclictest3425615-21memory10:00:210
336534299253,5cyclictest3425615-21memory10:00:210
3365342992521,2cyclictest13550irq/42-30be0000.ethernet07:40:210
3365342992519,3cyclictest13850irq/36-mmc111:55:010
3365342992519,3cyclictest0-21swapper/010:20:130
3365342992518,3cyclictest0-21swapper/007:45:210
3365342992516,5cyclictest3372326-1kworker/0:1H+mmc_complete08:25:010
3365342992516,5cyclictest3372326-1kworker/0:1H+mmc_complete08:25:010
3365356992418,4cyclictest3419435-21kworker/u8:1+events_unbound09:45:383
3365356992415,5cyclictest391ktimers/307:50:143
3365356992414,7cyclictest3385848-21sensors_temp08:05:253
3365356992413,7cyclictest3392253-21irqstats08:25:183
3365356992413,6cyclictest0-21swapper/312:10:253
3365351992418,3cyclictest0-21swapper/208:15:142
336534299243,19cyclictest0-21swapper/009:20:240
3365342992418,3cyclictest0-21swapper/008:10:140
3365342992417,4cyclictest3372538-21kworker/u8:3+events_unbound08:05:230
3365342992417,3cyclictest0-21swapper/011:59:390
3365342992417,3cyclictest0-21swapper/010:15:140
3365342992416,6cyclictest121ktimers/011:40:150
3365342992416,4cyclictest0-21swapper/011:00:010
3365342992413,7cyclictest3370996-21cron07:25:000
3365342992413,7cyclictest3370996-21cron07:25:000
3365342992412,10cyclictest3365333-21cyclictest08:45:110
3365342992412,10cyclictest3365333-21cyclictest08:45:110
336534299241,19cyclictest0-21swapper/010:47:480
3365356992317,4cyclictest3445166-21kworker/u8:1+events_unbound11:10:133
3365356992317,3cyclictest0-21swapper/310:00:183
3365356992317,3cyclictest0-21swapper/310:00:173
3365356992316,3cyclictest0-21swapper/310:10:143
3365356992315,4cyclictest3384634-21cron08:05:013
3365356992315,4cyclictest0-21swapper/307:45:153
3365356992312,6cyclictest0-21swapper/311:50:243
3365351992315,5cyclictest0-21swapper/208:10:162
3365351992315,4cyclictest0-21swapper/211:35:002
3365351992314,6cyclictest0-21swapper/208:50:122
3365351992314,5cyclictest0-21swapper/211:00:002
3365351992313,7cyclictest1-21systemd07:50:212
336534299231,9cyclictest3401006-21sshd08:50:210
3365342992316,3cyclictest0-21swapper/012:32:530
3365342992314,5cyclictest121ktimers/009:35:010
336534299231,18cyclictest0-21swapper/010:11:260
336534299230,19cyclictest0-21swapper/010:36:080
336534299230,19cyclictest0-21swapper/008:31:500
336535199228,6cyclictest3413912-21seq09:25:412
3365351992215,4cyclictest3473549-21fschecks_time12:20:162
3365351992214,5cyclictest311ktimers/210:05:192
3365351992214,5cyclictest0-21swapper/211:25:162
3365351992214,5cyclictest0-21swapper/207:15:262
3365351992214,5cyclictest0-21swapper/207:15:262
3365351992214,4cyclictest0-21swapper/210:15:212
336534299222,3cyclictest645-21runrttasks11:46:160
3365342992213,6cyclictest121ktimers/012:20:160
336534299221,19cyclictest0-21swapper/010:40:140
336534299220,18cyclictest0-21swapper/010:52:570
3365351992115,4cyclictest3393391-21idleruntime-cro08:30:002
3365351992115,3cyclictest3442376-21fschecks_count10:50:162
3365351992113,5cyclictest0-21swapper/210:00:272
3365351992113,5cyclictest0-21swapper/210:00:272
3365342992112,6cyclictest121ktimers/012:00:170
336534299211,18cyclictest0-21swapper/007:26:150
3365356992014,3cyclictest0-21swapper/308:30:173
3365356992011,5cyclictest0-21swapper/312:05:243
3365351992014,3cyclictest0-21swapper/211:20:472
336535199201,13cyclictest3460505-21tail11:40:252
336535199199,8cyclictest3470371-21wc12:10:202
336535199181,4cyclictest0-21swapper/209:45:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional