You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-18 - 17:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Sat Apr 18, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4190322995541,9cyclictest121ktimers/009:40:120
4190331995043,4cyclictest6865-21unixbench_multi07:35:252
4190331994841,5cyclictest26148-21kworker/u8:0+events_unbound09:02:412
4190322994716,12cyclictest83401-21cron11:20:000
4190334994434,7cyclictest96586-21seq11:55:243
4190334994235,4cyclictest93656-21munin-plugin-st11:50:003
4190334994235,4cyclictest93656-21munin-plugin-st11:50:003
4190331994235,4cyclictest1-21systemd07:15:122
4190331994231,8cyclictest311ktimers/209:50:152
419032299427,16cyclictest76593-21munin-plugin-st11:00:000
4190322994229,10cyclictest121ktimers/009:00:140
4190322994212,9cyclictest24662-21grep08:30:010
4190331994132,6cyclictest83398-21cron11:20:002
4190331994132,6cyclictest48882-21cron09:40:002
4190326994134,5cyclictest45277-21idleruntime-cro09:30:001
4190322994126,11cyclictest121ktimers/007:40:140
4190334994030,8cyclictest391ktimers/309:25:113
419033499396,5cyclictest131rcu_preempt10:55:133
4190334993933,3cyclictest0-21swapper/307:15:013
4190334993930,6cyclictest52301-21idleruntime-cro09:50:003
4190334993831,4cyclictest48889-21munin-plugin-st09:40:003
419032299383,20cyclictest0-21swapper/009:45:340
4190322993829,4cyclictest15843-21cron08:05:020
4190334993729,5cyclictest204-21dbus-daemon07:50:253
4190334993724,9cyclictest89745-21grep11:35:243
4190326993730,4cyclictest0-21swapper/107:15:021
4190326993727,6cyclictest0-21swapper/107:45:261
419032299379,10cyclictest19702-21grep08:15:140
4190322993728,5cyclictest0-21swapper/012:15:250
4190322993728,5cyclictest0-21swapper/007:20:010
4190331993629,4cyclictest0-21swapper/207:40:262
4190331993629,3cyclictest0-21swapper/208:05:282
4190331993626,6cyclictest26915-21grep08:35:172
4190326993625,7cyclictest0-21swapper/110:45:251
4190322993628,4cyclictest0-21swapper/010:20:000
4190334993529,4cyclictest26148-21kworker/u8:0+events_unbound09:10:473
4190334993528,4cyclictest109212-21munin-plugin-st12:35:003
4190334993525,6cyclictest0-21swapper/312:15:253
4190331993528,4cyclictest0-21swapper/208:10:252
419033199351,3cyclictest131rcu_preempt11:55:112
4190326993528,5cyclictest41853-21munin-plugin-st09:20:011
4190326993528,5cyclictest41853-21munin-plugin-st09:20:001
4190326993524,7cyclictest0-21swapper/108:45:261
4190331993428,4cyclictest84797-21kworker/u8:4+events_unbound11:26:042
4190331993427,5cyclictest2151-21kworker/u8:2+events_unbound07:25:142
4190331993427,5cyclictest2151-21kworker/u8:2+events_unbound07:25:142
4190331993422,9cyclictest77819-21grep11:00:252
4190326993427,4cyclictest0-21swapper/108:55:261
4190326993425,6cyclictest0-21swapper/112:00:001
4190326993424,6cyclictest0-21swapper/111:20:001
4190326993424,6cyclictest0-21swapper/109:30:241
4190326993424,6cyclictest0-21swapper/107:50:261
4190326993423,7cyclictest0-21swapper/107:45:011
419032299347,22cyclictest43750-21latency_hist09:25:020
419032299346,8cyclictest0-21swapper/010:51:490
4190322993426,5cyclictest48873-21cron09:40:000
4190322993423,7cyclictest88074-21grep11:30:220
4190334993325,5cyclictest26148-21kworker/u8:0+events_unbound08:55:013
4190334993325,4cyclictest0-21swapper/310:15:263
4190334993324,5cyclictest55902-21cron10:00:013
4190334993324,5cyclictest154172chrt08:00:253
4190334993322,8cyclictest391ktimers/307:20:133
4190334993322,8cyclictest391ktimers/307:20:123
4190334993322,7cyclictest0-21swapper/311:45:003
4190331993326,4cyclictest0-21swapper/210:30:152
4190331993326,4cyclictest0-21swapper/208:30:272
4190331993324,7cyclictest4191990-21latency_hist07:15:012
4190331993323,7cyclictest0-21swapper/210:10:152
4190326993324,6cyclictest0-21swapper/109:15:001
4190326993323,6cyclictest0-21swapper/109:35:261
4190322993323,6cyclictest0-21swapper/009:55:010
4190334993224,4cyclictest0-21swapper/311:10:243
4190331993225,4cyclictest35032-21idleruntime-cro09:00:002
4190331993225,4cyclictest0-21swapper/211:45:252
4190331993225,4cyclictest0-21swapper/211:45:252
4190326993225,4cyclictest0-21swapper/111:05:261
419032299328,9cyclictest54574-21awk09:55:150
4190322993225,4cyclictest0-21swapper/012:00:150
4190322993222,5cyclictest0-21swapper/010:30:570
4190322993219,10cyclictest4190489-21/usr/sbin/munin07:10:110
4190322993218,11cyclictest85477-21/usr/sbin/munin11:25:140
4190322993215,15cyclictest0-21swapper/011:55:110
4190322993214,14cyclictest41424-21grep09:15:270
4190322993214,14cyclictest41424-21grep09:15:270
4190322993212,7cyclictest64683-21apt10:25:110
4190334993125,4cyclictest4194097-21kworker/u8:0+events_unbound08:15:313
4190334993124,4cyclictest0-21swapper/311:20:003
4190334993124,4cyclictest0-21swapper/308:40:003
4190334993121,6cyclictest0-21swapper/308:45:263
4190331993123,5cyclictest0-21swapper/209:10:272
4190331993122,5cyclictest0-21swapper/211:40:002
4190331993118,10cyclictest311ktimers/209:15:132
4190331993118,10cyclictest311ktimers/209:15:132
4190326993121,6cyclictest0-21swapper/110:10:241
4190322993121,7cyclictest103872-21apt-get12:20:040
4190322993120,8cyclictest109644-21apt-get12:35:140
4190322993120,8cyclictest109644-21apt-get12:35:130
4190322993110,6cyclictest0-21swapper/012:10:200
4190334993023,4cyclictest69549-21cron10:40:003
419033199304,4cyclictest131rcu_preempt10:25:122
4190331993024,4cyclictest79373-21switchtime11:05:242
4190331993020,7cyclictest16062-21latency_hist08:05:012
4190331993018,10cyclictest4190315-21cyclictest09:40:122
4190326993020,7cyclictest43558-21cron09:25:001
4190326993020,7cyclictest15849-21cron08:05:011
4190326993020,6cyclictest0-21swapper/110:30:251
419032299307,21cyclictest0-21swapper/011:00:130
4190322993024,3cyclictest7406-21latency_hist07:40:000
4190322993023,4cyclictest0-21swapper/010:05:010
4190322993020,7cyclictest68928-21/usr/sbin/munin10:35:250
4190322993019,8cyclictest70241-21/usr/sbin/munin10:40:180
4190322993019,8cyclictest16926-21/usr/sbin/munin08:05:240
4190322993013,3cyclictest32411-21ntp_states08:50:210
4190322993013,14cyclictest26952-21fschecks_time08:35:170
4190334992921,4cyclictest0-21swapper/311:00:243
4190334992919,7cyclictest94934-21grep11:50:253
4190331992923,4cyclictest4190315-21cyclictest11:55:012
4190331992922,4cyclictest10738-21munin-run07:50:012
4190331992922,4cyclictest0-21swapper/210:35:262
4190331992921,6cyclictest311ktimers/210:40:112
4190331992921,5cyclictest0-21swapper/211:40:152
4190331992920,6cyclictest0-21swapper/208:20:232
4190331992919,7cyclictest12871-21fschecks_time07:55:152
4190326992922,4cyclictest0-21swapper/109:45:011
4190326992919,7cyclictest0-21swapper/111:15:011
419032299298,19cyclictest81740-21latency_hist11:15:000
419032299295,21cyclictest46107-21latency09:30:180
4190322992919,7cyclictest78983-21meminfo11:05:190
4190322992919,7cyclictest63102-21diskstats10:20:150
4190322992919,7cyclictest22791-21cron08:24:000
4190322992919,7cyclictest109109-21cron12:34:000
4190322992918,8cyclictest734-21/usr/sbin/munin07:20:120
4190322992918,8cyclictest734-21/usr/sbin/munin07:20:120
4190322992917,9cyclictest92733-21/usr/sbin/munin11:45:210
4190322992917,9cyclictest92733-21/usr/sbin/munin11:45:200
4190322992917,9cyclictest34536-21seq08:55:260
4190322992917,9cyclictest18512-21/usr/sbin/munin08:10:200
4190322992917,8cyclictest100639-21latency_hist12:10:010
4190322992915,9cyclictest28657-21grep08:40:140
4190322992913,3cyclictest93880-21apt-get11:50:110
4190322992911,14cyclictest25232-21fschecks_time08:30:180
4190334992822,4cyclictest4194097-21kworker/u8:0+events_unbound07:45:243
4190334992822,4cyclictest26148-21kworker/u8:0+events_unbound09:30:523
4190334992819,7cyclictest66145-21cron10:30:013
4190331992822,3cyclictest0-21swapper/210:45:252
4190331992821,4cyclictest0-21swapper/211:10:152
4190331992820,5cyclictest0-21swapper/208:45:172
4190331992814,5cyclictest2151-21kworker/u8:2+events_unbound09:23:152
4190326992821,3cyclictest0-21swapper/107:35:151
4190326992820,5cyclictest0-21swapper/107:20:001
4190326992820,4cyclictest0-21swapper/108:50:261
4190326992819,6cyclictest0-21swapper/112:15:251
4190326992818,6cyclictest0-21swapper/110:00:011
4190326992815,4cyclictest131rcu_preempt10:20:241
419032299286,8cyclictest0-21swapper/010:45:150
4190322992822,3cyclictest10964-21apt-get07:50:120
4190322992821,4cyclictest59562-21apt-get10:10:120
4190322992819,7cyclictest31282-21cron08:46:000
4190322992819,6cyclictest4708-21/usr/sbin/munin07:30:230
4190322992818,7cyclictest91352-21/usr/sbin/munin11:40:240
4190322992818,7cyclictest13958-21cron07:58:010
4190322992812,12cyclictest58707-21cat10:05:230
4190322992811,3cyclictest37534-21ntp_states09:05:210
4190322992811,13cyclictest45272-21idleruntime-cro09:30:000
4190334992721,4cyclictest78057-21kworker/u8:2+events_unbound12:11:103
4190334992721,3cyclictest0-21swapper/311:25:013
4190334992720,5cyclictest48581-21kworker/u8:2+events_unbound09:42:413
4190334992720,4cyclictest0-21swapper/307:40:263
4190334992719,4cyclictest0-21swapper/312:05:263
4190334992717,6cyclictest0-21swapper/312:01:073
4190331992721,4cyclictest62661-21kworker/u8:3+events_unbound10:20:572
4190331992720,5cyclictest16282-21kworker/u8:1+events_unbound08:44:422
4190331992720,4cyclictest0-21swapper/208:50:202
419033199271,9cyclictest32-21ksoftirqd/212:15:122
4190331992719,4cyclictest0-21swapper/207:30:182
4190331992718,5cyclictest55911-21sh10:00:012
419033199270,16cyclictest0-21swapper/210:15:132
4190326992720,4cyclictest0-21swapper/112:40:001
4190326992720,4cyclictest0-21swapper/112:40:001
4190326992720,4cyclictest0-21swapper/109:45:351
4190326992719,5cyclictest0-21swapper/111:45:161
4190326992719,5cyclictest0-21swapper/111:45:161
4190326992719,5cyclictest0-21swapper/109:00:171
4190326992719,4cyclictest0-21swapper/111:00:251
4190326992718,6cyclictest0-21swapper/112:20:241
4190326992718,6cyclictest0-21swapper/110:20:001
4190326992716,8cyclictest1-21systemd10:05:551
4190322992717,7cyclictest2557-21/usr/sbin/munin07:25:160
4190322992717,7cyclictest2557-21/usr/sbin/munin07:25:160
4190322992710,13cyclictest83669-21cpu11:20:120
419033499268,5cyclictest131rcu_preempt12:35:133
419033499268,5cyclictest131rcu_preempt12:35:123
4190334992619,4cyclictest0-21swapper/310:20:243
4190334992618,5cyclictest16282-21kworker/u8:1+events_unbound08:25:333
4190334992615,8cyclictest42203-21df09:20:153
4190331992620,4cyclictest78057-21kworker/u8:2+events_unbound12:05:202
4190331992619,4cyclictest0-21swapper/209:25:142
419033199261,4cyclictest131rcu_preempt12:30:132
4190322992615,7cyclictest39677-21grep09:10:260
4190334992519,4cyclictest2151-21kworker/u8:2+events_unbound07:38:433
4190334992518,4cyclictest0-21swapper/310:10:243
4190334992517,4cyclictest0-21swapper/310:50:253
4190334992517,4cyclictest0-21swapper/310:10:003
4190334992517,4cyclictest0-21swapper/309:00:263
4190334992517,4cyclictest0-21swapper/308:55:263
4190334992517,4cyclictest0-21swapper/308:00:013
4190334992514,7cyclictest0-21swapper/310:40:263
419033199255,5cyclictest74412-21grep10:50:242
4190331992519,4cyclictest53709-21kworker/u8:2+events_unbound10:02:412
4190331992519,4cyclictest2151-21kworker/u8:2+events_unbound08:27:242
4190331992519,4cyclictest2151-21kworker/u8:2+events_unbound07:50:052
4190331992517,6cyclictest311ktimers/209:30:212
4190331992512,5cyclictest50441-21kworker/u8:1+events_unbound10:56:472
419033199251,12cyclictest0-21swapper/210:07:172
419033199250,5cyclictest131rcu_preempt11:30:092
4190326992518,5cyclictest0-21swapper/111:25:251
4190326992518,4cyclictest2151-21kworker/u8:2+events_unbound09:05:161
4190326992517,5cyclictest14137-21munin-plugin-st08:00:011
4190326992517,5cyclictest0-21swapper/111:50:151
4190326992516,6cyclictest0-21swapper/112:00:161
4190326992516,5cyclictest21170-21sendmail08:20:011
4190326992515,7cyclictest0-21swapper/111:35:261
4190334992416,5cyclictest0-21swapper/307:30:013
4190334992416,5cyclictest0-21swapper/307:30:013
4190334992416,5cyclictest0-21swapper/307:15:023
4190334992416,4cyclictest0-21swapper/308:20:233
4190334992415,6cyclictest0-21swapper/310:50:013
4190334992414,6cyclictest0-21swapper/308:30:183
419033499241,11cyclictest0-21swapper/311:06:003
4190331992418,4cyclictest96658-21kworker/u8:1+events_unbound12:21:282
4190331992417,4cyclictest98289-21unixbench_multi12:00:242
4190331992416,4cyclictest0-21swapper/207:20:272
4190331992416,4cyclictest0-21swapper/207:20:262
4190331992415,6cyclictest0-21swapper/212:40:002
4190331992415,6cyclictest0-21swapper/212:40:002
419033199241,13cyclictest0-21swapper/212:27:502
4190326992418,3cyclictest0-21swapper/111:40:181
4190326992418,3cyclictest0-21swapper/111:20:241
4190326992418,3cyclictest0-21swapper/108:40:161
4190326992418,3cyclictest0-21swapper/108:35:141
4190326992417,5cyclictest0-21swapper/109:55:001
4190326992416,5cyclictest0-21swapper/112:10:201
4190326992416,5cyclictest0-21swapper/108:20:231
4190326992416,5cyclictest0-21swapper/108:15:011
4190326992416,5cyclictest0-21swapper/107:30:141
4190326992416,4cyclictest0-21swapper/112:30:251
4190334992314,6cyclictest53991-21cron09:55:003
4190334992312,7cyclictest1-21systemd07:30:143
4190331992314,7cyclictest50441-21kworker/u8:1+events_unbound09:45:042
419032699237,4cyclictest64685-21apt-get10:25:121
4190326992317,3cyclictest0-21swapper/107:20:241
4190326992317,3cyclictest0-21swapper/107:20:241
4190326992316,4cyclictest438-21cron11:00:001
419033499225,5cyclictest131rcu_preempt12:25:113
4190334992216,4cyclictest66523-21fschecks_count10:30:153
4190334992216,4cyclictest2151-21kworker/u8:2+events_unbound08:40:373
4190334992214,5cyclictest57619-21cron10:05:013
4190334992214,4cyclictest0-21swapper/309:05:163
4190334992210,8cyclictest41863-21tr09:20:003
4190334992210,8cyclictest41863-21tr09:20:003
419033199228,6cyclictest32-21ksoftirqd/211:20:182
419033199225,4cyclictest0-21swapper/208:16:012
4190326992216,3cyclictest0-21swapper/112:25:221
4190326992215,5cyclictest231ktimers/110:01:551
4190326992214,6cyclictest231ktimers/112:05:121
4190326992214,6cyclictest231ktimers/108:05:131
4190326992214,5cyclictest0-21swapper/110:35:261
4190326992213,7cyclictest231ktimers/110:50:121
4190326992212,6cyclictest0-21swapper/111:35:001
4190334992115,3cyclictest0-21swapper/308:10:203
4190334992114,5cyclictest72913-21kworker/u8:3+events_unbound11:34:433
4190331992112,6cyclictest100933-21/usr/sbin/munin12:10:162
4190326992115,4cyclictest24587-21idleruntime-cro08:30:001
4190326992112,6cyclictest0-21swapper/110:40:141
4190334992013,5cyclictest0-21swapper/308:05:193
4190326992014,3cyclictest0-21swapper/108:30:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional