You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-03 - 00:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Sat May 02, 2026 12:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3703907995346,4cyclictest3797168-21munin-run11:40:002
3703911994735,9cyclictest391ktimers/310:40:113
3703902994739,5cyclictest3749203-21munin-plugin-st09:20:011
3703898994723,21cyclictest0-21swapper/008:30:250
370389899471,5cyclictest3722388-21meminfo08:00:190
3703898994620,23cyclictest13550irq/42-30be0000.ethernet09:40:000
3703911994329,10cyclictest391ktimers/311:25:123
3703907994335,4cyclictest3803995-21munin-run12:00:002
370389899435,4cyclictest0-21swapper/007:55:130
3703898994312,28cyclictest3707860-21tr07:20:010
370389899431,10cyclictest3816276-21/usr/sbin/munin12:35:160
370389899431,10cyclictest3787610-21/usr/sbin/munin11:10:180
3703911994232,6cyclictest3776487-21grep10:40:013
3703907994236,4cyclictest3754238-21kworker/u8:1+events_unbound09:50:342
3703907994227,4cyclictest3706905-21kworker/u8:1+events_unbound08:35:152
3703902994231,7cyclictest3750501-21grep09:20:261
3703898994235,4cyclictest3793764-21idleruntime-cro11:30:000
3703898994221,18cyclictest0-21swapper/011:17:010
370389899421,9cyclictest3807939-21/usr/sbin/munin12:10:170
370389899421,9cyclictest3773832-21/usr/sbin/munin10:30:210
370389899421,9cyclictest3729704-21/usr/sbin/munin08:20:250
3703898994217,21cyclictest0-21swapper/007:20:210
3703911994134,4cyclictest3712968-21munin-plugin-st07:35:003
3703911994131,6cyclictest3714193-21grep07:35:263
3703907994120,13cyclictest131rcu_preempt12:05:172
370389899413,6cyclictest3719597-21users07:50:260
370389899411,9cyclictest3814638-21/usr/sbin/munin12:30:150
370389899411,9cyclictest3741002-21df08:55:140
370389899411,11cyclictest3740201-21sed08:50:250
3703911994013,13cyclictest131rcu_preempt09:25:133
3703907994034,4cyclictest3748983-21kworker/u8:3+events_unbound09:20:282
3703902994028,8cyclictest3705629-21munin-node07:15:021
3703898994030,7cyclictest3800582-21idleruntime-cro11:50:000
370389899401,9cyclictest3758534-21ntp_states09:45:210
370389899401,9cyclictest3752977-21/usr/sbin/munin09:30:170
370389899401,8cyclictest3772625-21tail10:25:260
370389899401,8cyclictest3764063-21/usr/sbin/munin10:00:240
370389899401,8cyclictest3744559-21/usr/sbin/munin09:05:180
370389899401,8cyclictest3743315-21/usr/sbin/munin09:00:240
370389899401,5cyclictest3746584-21ntp_states09:10:220
3703898994013,24cyclictest13550irq/42-30be0000.ethernet07:25:220
370389899401,10cyclictest3775348-21irqstats10:35:170
3703907993933,4cyclictest3730240-21munin-plugin-st08:25:012
3703907993929,7cyclictest3767518-21grep10:10:242
370389899393,5cyclictest3798489-21users11:40:270
370389899392,8cyclictest3712094-21/usr/sbin/munin07:30:230
370389899392,6cyclictest3756832-21ntp_states09:40:200
370389899392,5cyclictest3784450-21find11:00:230
370389899391,9cyclictest3805938-21apt-get12:05:140
370389899391,9cyclictest3803035-21/usr/sbin/munin11:55:190
370389899391,9cyclictest3782146-21cstates10:55:130
370389899391,9cyclictest3751381-21/usr/sbin/munin09:25:170
370389899391,7cyclictest3747965-21/usr/sbin/munin09:15:150
370389899391,7cyclictest3717146-21/usr/sbin/munin07:45:180
370389899391,6cyclictest3813203-21meminfo12:25:190
370389899391,6cyclictest3810409-21/usr/sbin/munin12:15:250
370389899391,6cyclictest3737398-21latency_hist08:45:010
370389899391,6cyclictest3737398-21latency_hist08:45:010
370389899391,5cyclictest3785805-21irqstats11:05:190
370389899391,12cyclictest3734081-21sort08:35:160
3703898993911,24cyclictest0-21swapper/010:20:240
370389899391,10cyclictest3765364-21ntp_states10:05:220
370389899391,10cyclictest3765364-21ntp_states10:05:220
370389899391,10cyclictest3761605-21/usr/sbin/munin09:55:160
3703911993827,8cyclictest391ktimers/312:30:133
3703902993830,5cyclictest3810800-21cron12:20:001
3703902993828,6cyclictest0-21swapper/112:40:011
370389899388,7cyclictest3730898-21cat08:25:190
370389899381,9cyclictest3769312-21sshd10:15:540
370389899381,9cyclictest3723981-21/usr/sbin/munin08:05:200
370389899381,8cyclictest3766760-21/usr/sbin/munin10:10:150
370389899381,7cyclictest3705065-21unixbench_multi07:10:260
370389899381,6cyclictest3804791-21/usr/sbin/munin12:00:210
370389899381,6cyclictest3791311-21/usr/sbin/munin11:20:230
370389899381,5cyclictest3727040-21/usr/sbin/munin08:15:110
370389899381,11cyclictest3715566-21meminfo07:40:200
370389899381,10cyclictest3725679-21irqstats08:10:190
3703907993725,9cyclictest3805299-21grep12:00:262
3703902993728,6cyclictest231ktimers/109:00:121
3703902993726,7cyclictest3756035-21sendmail09:40:001
370389899373,5cyclictest3800931-21diskstats11:50:150
370389899372,4cyclictest3749690-21/usr/sbin/munin09:20:170
370389899372,4cyclictest3713737-21tr07:35:220
370389899371,6cyclictest3737629-21grep08:45:150
370389899371,11cyclictest3779668-21sed10:45:270
3703907993629,5cyclictest3732744-21kworker/u8:3+events_unbound08:50:202
370390799362,8cyclictest6250watchdogd12:35:132
3703907993628,6cyclictest3790054-21kworker/u8:3+events_unbound11:24:412
3703907993628,4cyclictest0-21swapper/209:10:252
3703907993625,7cyclictest0-21swapper/208:10:262
3703907993623,5cyclictest131rcu_preempt10:45:242
3703907993616,10cyclictest131rcu_preempt10:35:212
3703902993628,5cyclictest3785225-21cron11:05:001
370389899363,5cyclictest0-21swapper/010:40:240
370389899361,9cyclictest3780677-21/usr/sbin/munin10:50:170
370389899361,9cyclictest3780677-21/usr/sbin/munin10:50:170
370389899361,8cyclictest3796130-21load11:35:180
3703898993612,21cyclictest3811345-21if_eth012:20:160
3703898993612,21cyclictest3811345-21if_eth012:20:160
3703911993529,4cyclictest3721446-21kworker/u8:0+events_unbound08:00:073
3703911993527,4cyclictest3735432-21apt-key08:40:013
3703907993529,4cyclictest3756260-21kworker/u8:3+events_unbound10:30:402
3703907993525,7cyclictest3738962-21auditctl08:50:002
3703907993518,6cyclictest3721446-21kworker/u8:0+events_unbound08:25:062
3703907993515,7cyclictest131rcu_preempt09:00:132
3703902993525,6cyclictest0-21swapper/112:05:261
370389899353,6cyclictest3760004-21irqstats09:50:170
3703907993422,5cyclictest3732744-21kworker/u8:3+events_unbound08:44:422
3703907993422,5cyclictest3732744-21kworker/u8:3+events_unbound08:44:422
3703902993425,4cyclictest0-21swapper/110:05:161
3703902993425,4cyclictest0-21swapper/110:05:161
3703902993424,5cyclictest0-21swapper/107:29:581
3703907993326,4cyclictest3769698-21idleruntime-cro10:20:002
3703907993321,9cyclictest311ktimers/210:50:132
3703907993321,9cyclictest311ktimers/210:50:132
3703907993320,9cyclictest3757265-21grep09:40:242
3703907993316,6cyclictest131rcu_preempt10:55:122
3703902993325,4cyclictest0-21swapper/108:25:261
3703902993323,6cyclictest3776009-21grep10:35:251
3703902993322,7cyclictest0-21swapper/111:15:011
3703911993224,4cyclictest3786940-21munin-plugin-st11:10:003
3703911993224,4cyclictest0-21swapper/311:50:153
3703911993223,4cyclictest0-21swapper/308:55:003
3703911993221,8cyclictest391ktimers/310:10:123
3703907993226,4cyclictest3788256-21kworker/u8:0+events_unbound11:15:472
3703907993223,5cyclictest0-21swapper/208:15:262
3703907993222,7cyclictest3749190-21sh09:20:012
3703907993210,5cyclictest0-21swapper/211:40:122
3703902993224,4cyclictest0-21swapper/108:40:161
3703902993224,4cyclictest0-21swapper/108:40:161
3703902993220,7cyclictest0-21swapper/111:35:001
3703911993124,4cyclictest0-21swapper/310:25:263
3703907993122,7cyclictest3742748-21kworker/u8:0+events_unbound09:09:082
3703907993119,5cyclictest131rcu_preempt12:20:152
3703907993119,5cyclictest131rcu_preempt12:20:152
3703902993124,4cyclictest3778206-21idleruntime-cro10:45:001
3703902993122,5cyclictest0-21swapper/109:05:271
3703902993122,5cyclictest0-21swapper/108:45:251
3703902993122,4cyclictest0-21swapper/108:15:111
3703902993121,6cyclictest0-21swapper/111:40:261
3703911993023,3cyclictest0-21swapper/308:55:163
3703911993022,4cyclictest0-21swapper/309:10:263
3703907993023,4cyclictest0-21swapper/210:40:402
3703907993022,6cyclictest3706905-21kworker/u8:1+events_unbound07:26:412
3703907993022,4cyclictest0-21swapper/210:00:152
3703907993022,4cyclictest0-21swapper/207:40:172
3703907993017,9cyclictest311ktimers/209:25:122
3703907993014,3cyclictest131rcu_preempt12:19:142
3703907993012,4cyclictest0-21swapper/207:20:122
370390799301,13cyclictest32-21ksoftirqd/211:05:142
3703902993022,5cyclictest3756260-21kworker/u8:3+events_unbound10:45:421
3703902993022,4cyclictest0-21swapper/112:00:001
3703902993021,6cyclictest3811243-21fschecks_time12:20:151
3703902993021,6cyclictest3811243-21fschecks_time12:20:151
3703911992922,4cyclictest0-21swapper/308:10:173
3703907992923,4cyclictest3706905-21kworker/u8:1+events_unbound08:55:242
3703907992923,4cyclictest3696589-21kworker/u8:3+events_unbound07:39:422
3703907992922,5cyclictest3799357-21kworker/u8:0+events_unbound11:51:092
3703907992922,5cyclictest3764372-21kworker/u8:1+events_unbound10:08:422
3703907992922,5cyclictest3764372-21kworker/u8:1+events_unbound10:08:422
3703907992921,6cyclictest3788256-21kworker/u8:0+events_unbound11:12:572
3703907992921,4cyclictest0-21swapper/211:25:212
370390799291,6cyclictest32-21ksoftirqd/210:25:132
3703907992916,5cyclictest131rcu_preempt12:25:162
3703907992912,4cyclictest131rcu_preempt11:00:122
3703907992910,11cyclictest131rcu_preempt09:30:252
3703902992922,4cyclictest0-21swapper/108:20:251
3703902992921,4cyclictest0-21swapper/109:30:271
3703911992821,4cyclictest0-21swapper/312:25:263
3703911992820,4cyclictest0-21swapper/310:20:003
370390799289,5cyclictest131rcu_preempt09:45:182
370390799287,12cyclictest32-21ksoftirqd/207:15:012
370390799286,4cyclictest131rcu_preempt10:00:002
3703907992822,4cyclictest3696589-21kworker/u8:3+events_unbound08:03:412
3703907992822,3cyclictest0-21swapper/211:30:242
3703907992819,7cyclictest3756260-21kworker/u8:3+events_unbound10:23:422
3703907992812,7cyclictest32-21ksoftirqd/207:50:012
3703902992819,5cyclictest3741108-21fschecks_time08:55:161
370390299281,4cyclictest131rcu_preempt09:40:111
3703911992720,4cyclictest0-21swapper/307:45:263
3703911992714,9cyclictest1-21systemd10:05:363
3703911992714,9cyclictest1-21systemd10:05:363
370390799278,12cyclictest32-21ksoftirqd/212:30:182
370390799278,12cyclictest32-21ksoftirqd/209:35:212
370390799277,5cyclictest131rcu_preempt08:10:022
370390799277,5cyclictest131rcu_preempt07:30:262
370390799277,4cyclictest131rcu_preempt07:15:222
370390799274,13cyclictest32-21ksoftirqd/212:15:002
3703907992720,3cyclictest0-21swapper/208:35:012
3703907992716,3cyclictest131rcu_preempt07:55:162
3703902992721,4cyclictest3718342-21kworker/u8:2+events_unbound07:50:171
3703902992719,5cyclictest0-21swapper/110:55:151
3703902992719,4cyclictest0-21swapper/111:25:251
3703902992718,5cyclictest0-21swapper/111:50:251
3703902992715,8cyclictest3808684-21grep12:10:251
3703911992619,5cyclictest3696589-21kworker/u8:3+events_unbound07:50:033
3703911992618,5cyclictest3806936-21unixbench_multi12:05:263
3703911992618,5cyclictest0-21swapper/309:35:263
3703911992618,4cyclictest0-21swapper/309:15:153
370390799267,11cyclictest32-21ksoftirqd/211:45:232
370390299265,4cyclictest131rcu_preempt09:25:261
3703902992619,3cyclictest0-21swapper/107:20:181
3703902992618,6cyclictest3732744-21kworker/u8:3+events_unbound08:35:131
3703902992618,5cyclictest0-21swapper/109:45:251
3703902992618,4cyclictest0-21swapper/108:05:281
3703902992616,6cyclictest0-21swapper/109:50:251
3703902992615,7cyclictest0-21swapper/109:55:351
3703911992519,3cyclictest0-21swapper/308:30:253
3703911992518,4cyclictest0-21swapper/312:20:243
3703911992518,4cyclictest0-21swapper/312:20:243
3703911992517,6cyclictest3795303-21kworker/u8:3+events_unbound12:10:563
3703911992517,6cyclictest3703892-21cyclictest09:05:133
3703911992517,4cyclictest0-21swapper/311:55:243
3703911992517,4cyclictest0-21swapper/311:45:003
3703911992516,6cyclictest0-21swapper/311:00:003
3703911992514,8cyclictest3800143-21grep11:45:253
3703902992519,3cyclictest0-21swapper/111:20:161
3703902992518,4cyclictest3733628-21kthreadd08:35:011
3703902992518,3cyclictest0-21swapper/107:35:171
3703902992516,5cyclictest0-21swapper/111:20:011
3703902992514,8cyclictest24-21ksoftirqd/110:25:171
3703911992417,4cyclictest0-21swapper/311:35:253
3703911992417,3cyclictest0-21swapper/309:40:243
3703911992416,5cyclictest0-21swapper/310:50:163
3703911992416,5cyclictest0-21swapper/310:50:163
3703911992416,5cyclictest0-21swapper/310:05:003
3703911992415,6cyclictest0-21swapper/308:00:013
370390799244,11cyclictest32-21ksoftirqd/207:50:162
3703902992418,3cyclictest0-21swapper/111:35:241
3703902992417,4cyclictest3815460-21unixbench_multi12:30:251
3703902992417,3cyclictest0-21swapper/108:10:191
3703902992416,4cyclictest0-21swapper/110:30:161
3703902992414,6cyclictest3721694-21cat08:00:011
3703902992413,7cyclictest3740231-21grep08:50:261
3703911992317,3cyclictest0-21swapper/308:50:003
3703911992316,4cyclictest0-21swapper/307:20:173
3703911992315,5cyclictest3724174-21ntpq08:05:233
3703911992315,4cyclictest3749582-21fschecks_count09:20:163
3703911992315,4cyclictest0-21swapper/307:25:263
3703911992314,6cyclictest3790346-21sh11:20:013
3703902992317,4cyclictest3707861-21idleruntime-cro07:20:011
3703902992317,3cyclictest0-21swapper/110:50:221
3703902992317,3cyclictest0-21swapper/110:50:221
370390299231,3cyclictest3715120-21apt-get07:40:131
3703911992217,3cyclictest0-21swapper/310:30:263
3703911992216,3cyclictest0-21swapper/308:20:233
3703911992216,3cyclictest0-21swapper/308:20:013
3703911992216,3cyclictest0-21swapper/307:10:193
3703911992215,5cyclictest391ktimers/310:45:153
3703911992215,4cyclictest3805272-21grep12:00:253
3703911992214,5cyclictest0-21swapper/311:10:153
3703911992212,7cyclictest204-21dbus-daemon11:20:473
3703911992212,6cyclictest0-21swapper/309:30:273
3703902992216,4cyclictest3802095-21kworker/u8:2+events_unbound12:28:411
3703902992214,4cyclictest0-21swapper/111:45:251
3703902992213,6cyclictest645-21runrttasks10:15:121
3703911992115,3cyclictest0-21swapper/311:00:143
3703911992115,3cyclictest0-21swapper/308:40:163
3703911992115,3cyclictest0-21swapper/308:40:163
3703911992114,5cyclictest3780087-21kworker/u8:1+events_unbound12:15:123
3703911992113,5cyclictest3762400-21head09:55:263
3703911992112,5cyclictest3730683-21uniq08:25:173
3703911992111,7cyclictest0-21swapper/310:20:243
3703902992116,3cyclictest0-21swapper/110:00:161
3703902992115,4cyclictest3751717-21kworker/u8:2+events_unbound10:21:531
370391199202,14cyclictest3707840-21cron07:20:013
3703911992013,5cyclictest391ktimers/309:45:253
370390299202,10cyclictest131rcu_preempt08:00:121
3703902992014,3cyclictest0-21swapper/111:05:171
3703902992013,4cyclictest3805721-21idleruntime-cro12:05:001
3703902992013,3cyclictest0-21swapper/107:30:261
3703902992012,5cyclictest231ktimers/110:10:511
3703911991913,3cyclictest0-21swapper/309:00:263
370390299185,8cyclictest0-21swapper/109:10:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional