You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-16 - 21:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Sat May 16, 2026 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3267021994937,9cyclictest231ktimers/109:40:131
3267021994826,18cyclictest0-21swapper/109:05:011
3267030994739,5cyclictest3295064-21munin-plugin-st08:30:003
3267021994634,9cyclictest3316169-21munin-plugin-st09:30:001
3267030994537,5cyclictest3319556-21cron09:40:003
3267021994537,5cyclictest1-21systemd08:00:161
3267025994435,5cyclictest1-21systemd07:45:102
3267025994332,8cyclictest311ktimers/210:25:122
3267021994314,8cyclictest3271196-21basename07:20:011
3267030994221,14cyclictest3267010-21cyclictest12:25:123
3267025994238,2cyclictest3282897-21kworker/u8:1+events_unbound08:00:172
3267019994235,4cyclictest3328113-21munin-plugin-st10:05:010
3267030994135,4cyclictest3274263-21kworker/u8:3+events_unbound08:10:233
3267025994126,11cyclictest311ktimers/210:50:102
3267021994129,8cyclictest3312739-21sh09:20:001
3267030994032,4cyclictest0-21swapper/308:25:013
3267030994027,9cyclictest391ktimers/312:20:123
3267030993931,4cyclictest0-21swapper/309:15:003
3267030993930,6cyclictest3301873-21cron08:49:593
3267021993929,6cyclictest3289540-21unixbench_singl08:10:261
3267019993932,4cyclictest3305504-21cut09:00:010
3267019993928,8cyclictest3309129-21cron09:10:000
3267025993832,4cyclictest3293114-21kworker/u8:0+events_unbound08:35:352
3267025993830,4cyclictest3352185-21munin-plugin-st11:15:002
3267021993827,7cyclictest3348773-21auditctl11:05:011
3267021993827,7cyclictest3332747-21unixbench_multi10:15:251
3267021993824,9cyclictest0-21swapper/112:20:001
3267019993830,4cyclictest3268760-21latency_hist07:15:010
3267030993731,4cyclictest3372396-21kworker/u8:3+events_unbound12:31:073
3267025993725,8cyclictest3346605-21grep10:55:262
3267025993724,9cyclictest311ktimers/209:25:112
326702599371,7cyclictest0-21swapper/210:35:122
3267030993629,5cyclictest3252691-21kworker/u8:2+events_unbound07:55:143
3267030993629,4cyclictest3367530-21sendmail12:00:003
3267030993628,4cyclictest3309344-21latency_hist09:10:013
3267025993624,9cyclictest311ktimers/210:40:122
3267019993627,5cyclictest0-21swapper/009:55:010
3267019993619,14cyclictest11-21ksoftirqd/011:30:120
326703099353,4cyclictest131rcu_preempt08:15:133
3267030993529,4cyclictest3357071-21kworker/u8:0+events_unbound11:41:003
3267030993526,5cyclictest0-21swapper/312:35:163
3267030993526,5cyclictest0-21swapper/307:35:003
326702599355,4cyclictest131rcu_preempt08:20:112
3267021993524,7cyclictest0-21swapper/112:20:261
3267021993523,10cyclictest231ktimers/112:35:121
3267030993423,7cyclictest0-21swapper/307:15:013
3267025993426,4cyclictest0-21swapper/210:05:452
3267025993423,7cyclictest3381154-21sh12:40:002
3267025993418,10cyclictest3348524-21kworker/u8:2+events_unbound11:15:192
326703099334,4cyclictest0-21swapper/309:20:123
3267030993326,4cyclictest3343660-21munin-run10:50:013
326703099331,6cyclictest0-21swapper/311:10:103
326703099331,5cyclictest131rcu_preempt10:30:133
3267030993313,13cyclictest3324865-21latency_hist09:55:023
3267025993326,4cyclictest3309127-21kthreadd09:10:002
3267025993326,4cyclictest3269522-21fschecks_count07:15:042
3267025993326,4cyclictest0-21swapper/211:25:252
3267025993318,9cyclictest131rcu_preempt09:45:242
3267025993312,5cyclictest0-21swapper/210:00:272
3267021993326,4cyclictest3291666-21sendmail08:20:011
3267021993324,6cyclictest0-21swapper/110:45:011
3267021993324,5cyclictest0-21swapper/111:40:001
3267019993326,4cyclictest0-21swapper/010:50:260
3267019993324,5cyclictest1-21systemd12:16:030
326703099322,4cyclictest0-21swapper/311:35:133
3267030993217,7cyclictest3252691-21kworker/u8:2+events_unbound08:07:283
3267025993224,4cyclictest0-21swapper/211:10:002
3267025993224,4cyclictest0-21swapper/210:35:002
3267025993221,6cyclictest0-21swapper/212:10:242
326702599320,4cyclictest131rcu_preempt09:35:132
3267021993224,4cyclictest0-21swapper/107:10:261
3267019993224,5cyclictest11-21ksoftirqd/008:20:120
3267019993215,14cyclictest11-21ksoftirqd/008:45:130
3267030993125,4cyclictest3352052-21kworker/u8:3+events_unbound11:32:413
3267030993124,4cyclictest3348288-21grep11:00:253
3267030993123,4cyclictest0-21swapper/309:15:173
3267030993121,7cyclictest3297682-21fgrep08:35:243
3267030993121,6cyclictest0-21swapper/310:55:263
3267030993117,11cyclictest391ktimers/307:50:143
3267025993124,5cyclictest3317737-21kworker/u8:0+events_unbound09:40:162
3267025993124,5cyclictest3252691-21kworker/u8:2+events_unbound07:40:112
3267025993120,8cyclictest3373850-21grep12:15:242
3267025993120,8cyclictest3268762-21munin-node07:15:012
3267021993123,4cyclictest3313987-21unixbench_multi09:20:251
3267021993123,4cyclictest0-21swapper/110:00:171
3267021993123,4cyclictest0-21swapper/107:25:251
3267021993122,7cyclictest231ktimers/108:05:131
3267021993121,7cyclictest3342578-21latency10:45:191
3267019993125,3cyclictest3295060-21kthreadd08:30:000
3267019993124,4cyclictest13850irq/36-mmc110:00:010
3267019993123,4cyclictest0-21swapper/012:40:000
3267019993122,7cyclictest3269598-21kernelversion07:15:050
3267030993024,4cyclictest3317737-21kworker/u8:0+events_unbound11:08:413
3267030993023,4cyclictest391ktimers/308:40:103
3267030993023,4cyclictest0-21swapper/309:45:263
3267030993023,3cyclictest0-21swapper/310:20:253
3267030993019,5cyclictest3317737-21kworker/u8:0+events_unbound10:00:393
3267030993016,9cyclictest391ktimers/312:00:113
3267030993014,7cyclictest3267690-21kworker/u8:0+events_unbound07:46:383
3267025993024,4cyclictest3326383-21kthreadd10:00:012
3267025993023,3cyclictest0-21swapper/210:20:012
3267025993022,5cyclictest0-21swapper/211:50:002
3267025993022,5cyclictest0-21swapper/211:50:002
3267025993022,5cyclictest0-21swapper/209:35:002
3267025993022,5cyclictest0-21swapper/209:35:002
3267025993020,6cyclictest3367532-21sendmail12:00:002
326702599301,12cyclictest32-21ksoftirqd/208:10:132
3267025993011,12cyclictest3352052-21kworker/u8:3+events_unbound11:35:292
326702599300,4cyclictest131rcu_preempt10:10:112
3267021993023,4cyclictest0-21swapper/111:40:161
3267019993023,3cyclictest0-21swapper/011:15:250
3267019993022,5cyclictest3340029-21sh10:40:000
3267019993022,4cyclictest0-21swapper/011:40:170
326703099294,4cyclictest131rcu_preempt07:40:103
3267030992923,4cyclictest3357071-21kworker/u8:0+events_unbound12:12:283
3267025992923,4cyclictest3296418-21kworker/u8:2+events_unbound08:59:192
3267025992923,4cyclictest3274263-21kworker/u8:3+events_unbound08:30:342
3267025992923,4cyclictest311ktimers/210:45:132
3267025992923,3cyclictest0-21swapper/212:20:162
3267025992921,4cyclictest0-21swapper/208:25:302
3267025992919,7cyclictest1-21systemd08:05:182
3267025992916,4cyclictest131rcu_preempt11:40:262
326702599291,15cyclictest0-21swapper/212:26:002
3267021992921,4cyclictest0-21swapper/111:55:001
3267021992920,4cyclictest0-21swapper/109:30:161
3267021992920,4cyclictest0-21swapper/109:30:161
3267019992922,3cyclictest0-21swapper/008:00:010
326703099287,10cyclictest40-21ksoftirqd/308:50:223
3267030992822,4cyclictest3348524-21kworker/u8:2+events_unbound11:48:043
3267030992822,4cyclictest3348524-21kworker/u8:2+events_unbound11:48:043
3267030992821,4cyclictest3328550-21fschecks_time10:05:183
3267030992821,4cyclictest0-21swapper/310:40:153
3267030992821,3cyclictest0-21swapper/309:00:013
3267030992820,4cyclictest0-21swapper/310:35:273
3267030992819,6cyclictest3373398-21ntpq12:15:203
3267030992818,7cyclictest3365354-21grep11:50:263
3267030992817,7cyclictest3331499-21sh10:15:013
3267030992814,5cyclictest3348524-21kworker/u8:2+events_unbound11:26:023
3267025992820,4cyclictest3284816-21idleruntime-cro08:00:012
3267025992820,4cyclictest0-21swapper/211:50:172
3267025992818,6cyclictest0-21swapper/211:00:252
3267025992818,6cyclictest0-21swapper/210:20:252
3267025992817,8cyclictest3302887-21ntp_states08:50:212
326702599281,11cyclictest32-21ksoftirqd/207:35:132
3267021992821,4cyclictest0-21swapper/110:35:001
3267021992818,7cyclictest0-21swapper/111:15:001
3267021992817,5cyclictest0-21swapper/107:55:121
3267019992822,3cyclictest0-21swapper/009:50:010
326701999282,22cyclictest3379448-21cron12:35:000
3267019992818,7cyclictest3313988-21sed09:20:250
3267019992817,7cyclictest3372181-21grep12:10:240
326703099279,3cyclictest131rcu_preempt07:30:003
3267030992721,4cyclictest3267690-21kworker/u8:0+events_unbound07:20:083
326703099271,15cyclictest0-21swapper/310:53:223
326702599274,13cyclictest32-21ksoftirqd/207:50:452
3267025992719,4cyclictest0-21swapper/208:40:352
3267025992718,6cyclictest0-21swapper/208:50:002
3267025992715,4cyclictest131rcu_preempt08:15:212
3267025992711,6cyclictest3252691-21kworker/u8:2+events_unbound07:32:522
326702599270,8cyclictest3370530-21grep12:05:252
3267021992719,4cyclictest0-21swapper/109:55:241
3267021992719,4cyclictest0-21swapper/109:55:011
3267021992719,4cyclictest0-21swapper/107:50:261
3267021992719,4cyclictest0-21swapper/107:20:071
3267021992716,7cyclictest3279301-21grep07:40:231
3267019992721,3cyclictest0-21swapper/007:55:010
3267019992720,4cyclictest13850irq/36-mmc109:40:000
3267019992720,4cyclictest0-21swapper/011:20:260
3267019992720,3cyclictest0-21swapper/009:30:250
3267019992720,3cyclictest0-21swapper/009:30:250
326703099267,8cyclictest131rcu_preempt08:00:183
3267030992619,4cyclictest0-21swapper/310:15:253
3267030992619,4cyclictest0-21swapper/309:30:243
3267030992619,4cyclictest0-21swapper/309:30:243
3267030992618,6cyclictest3317737-21kworker/u8:0+events_unbound10:25:483
326703099261,6cyclictest3295291-21apt-get08:30:123
326702599264,3cyclictest131rcu_preempt09:20:142
3267025992619,5cyclictest3267690-21kworker/u8:0+events_unbound07:25:272
3267021992620,4cyclictest3276405-21latency_hist07:35:011
3267021992619,4cyclictest231ktimers/112:25:151
3267021992619,4cyclictest0-21swapper/108:25:171
3267021992618,4cyclictest0-21swapper/111:45:181
3267021992618,4cyclictest0-21swapper/111:45:181
3267021992618,4cyclictest0-21swapper/108:30:251
3267019992620,3cyclictest0-21swapper/008:40:000
3267019992620,3cyclictest0-21swapper/008:10:220
3267019992619,4cyclictest0-21swapper/008:00:270
3267019992619,3cyclictest0-21swapper/009:00:380
326701999261,6cyclictest3341318-21grep10:40:250
3267030992519,4cyclictest3298186-21kworker/u8:3+events_unbound09:00:223
3267030992518,5cyclictest3369457-21kworker/u8:2+events_unbound12:05:163
3267025992519,4cyclictest3298186-21kworker/u8:3+events_unbound09:14:342
3267025992519,3cyclictest0-21swapper/212:30:252
3267025992518,3cyclictest0-21swapper/209:50:442
326702599251,13cyclictest0-21swapper/209:00:312
3267021992518,4cyclictest0-21swapper/111:20:571
3267021992517,5cyclictest0-21swapper/112:00:231
3267021992517,4cyclictest0-21swapper/108:40:251
326701999255,5cyclictest131rcu_preempt10:15:110
3267019992519,3cyclictest0-21swapper/008:30:160
3267019992518,4cyclictest13550irq/42-30be0000.ethernet07:40:010
326701999251,20cyclictest0-21swapper/011:04:160
3267030992417,5cyclictest3323550-21kworker/u8:3+events_unbound09:59:053
3267030992417,5cyclictest3310676-21kworker/u8:1+events_unbound09:44:263
326702599247,10cyclictest32-21ksoftirqd/211:20:252
3267025992418,4cyclictest3296418-21kworker/u8:2+events_unbound09:19:042
3267021992418,3cyclictest0-21swapper/110:55:171
3267021992418,3cyclictest0-21swapper/110:05:271
3267019992418,3cyclictest0-21swapper/010:30:260
3267019992417,4cyclictest0-21swapper/010:25:250
3267019992417,3cyclictest0-21swapper/011:37:210
3267019992415,6cyclictest0-21swapper/008:40:230
3267019992413,8cyclictest3350466-21cron11:10:000
326701999241,20cyclictest3275931-21taskset07:30:460
326701999241,19cyclictest0-21swapper/012:09:210
326701999241,19cyclictest0-21swapper/012:04:300
326701999241,19cyclictest0-21swapper/008:17:220
326703099238,3cyclictest131rcu_preempt09:25:113
3267030992317,4cyclictest3252691-21kworker/u8:2+events_unbound07:36:093
326703099231,15cyclictest0-21swapper/311:23:413
326702599237,3cyclictest131rcu_preempt11:35:002
3267025992317,3cyclictest0-21swapper/212:00:212
3267021992317,3cyclictest0-21swapper/112:10:171
3267021992317,3cyclictest0-21swapper/109:10:261
3267021992315,5cyclictest0-21swapper/108:20:251
3267021992313,6cyclictest0-21swapper/108:39:591
3267019992317,4cyclictest3377327-21unixbench_singl12:25:260
3267019992317,4cyclictest3298186-21kworker/u8:3+events_unbound09:16:180
3267019992317,3cyclictest3321285-21cron09:45:000
3267019992317,3cyclictest0-21swapper/010:45:250
3267019992317,2cyclictest0-21swapper/012:22:320
3267019992316,3cyclictest0-21swapper/010:11:440
3267019992315,4cyclictest0-21swapper/007:40:090
326701999231,3cyclictest3314808-21df_inode09:25:140
326701999231,20cyclictest0-21swapper/010:08:380
326701999231,18cyclictest0-21swapper/011:55:350
326703099226,4cyclictest131rcu_preempt07:15:143
3267021992216,3cyclictest3319090-21grep09:35:271
3267021992216,3cyclictest0-21swapper/112:00:001
3267021992216,3cyclictest0-21swapper/111:25:251
3267021992215,4cyclictest3278007-21sendmail07:40:011
3267019992216,3cyclictest0-21swapper/011:50:210
3267019992215,3cyclictest0-21swapper/008:06:220
3267019992213,7cyclictest3350476-21latency_hist11:10:010
3267019992212,8cyclictest3244038-21kworker/u8:1-ext4-rsv-conversion07:20:010
326701999221,19cyclictest0-21swapper/010:55:170
326701999221,18cyclictest3357288-21cron11:30:000
326701999220,18cyclictest0-21swapper/010:21:300
326702199218,5cyclictest3369457-21kworker/u8:2+events_unbound12:06:481
326702199212,14cyclictest3358049-21ntpq11:30:201
3267021992115,4cyclictest3352404-21/usr/sbin/munin11:15:221
3267021992115,4cyclictest231ktimers/109:45:131
3267021992114,4cyclictest0-21swapper/107:45:181
3267021992114,3cyclictest0-21swapper/112:30:201
3267021992112,6cyclictest0-21swapper/110:55:011
3267021992112,6cyclictest0-21swapper/108:55:171
3267019992114,3cyclictest0-21swapper/007:25:250
3267019992113,5cyclictest121ktimers/007:45:190
326701999211,18cyclictest0-21swapper/009:10:140
3267021992014,3cyclictest3301982-21latency_hist08:50:011
3267021992013,5cyclictest0-21swapper/110:35:121
3267021992013,4cyclictest0-21swapper/110:10:251
3267021992011,5cyclictest231ktimers/108:50:251
326701999201,17cyclictest0-21swapper/008:53:030
3267021991913,4cyclictest231ktimers/111:07:371
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional