You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-09 - 19:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Mon Mar 09, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2713212995431,19cyclictest0-21swapper/212:05:162
2713204995145,3cyclictest0-21swapper/008:45:110
2713208994734,9cyclictest231ktimers/107:40:141
2713215994637,4cyclictest0-21swapper/307:20:173
2713215994617,4cyclictest0-21swapper/309:50:003
2713215994617,3cyclictest0-21swapper/308:50:163
2713212994515,28cyclictest2743372-21/usr/sbin/munin08:35:222
2713215994436,4cyclictest0-21swapper/307:25:143
2713208994335,5cyclictest2782378-21unixbench_singl10:25:251
2713208994335,5cyclictest2779174-21munin-run10:20:001
271321599421,13cyclictest2804949-21cron11:35:013
2713212994220,19cyclictest2824317-21grep12:30:152
2713208994235,4cyclictest2748265-21sh08:50:011
2713215994113,6cyclictest2808812-21tune2fs11:45:153
2713212994131,7cyclictest2728180-21kernelversion07:50:182
271321299412,7cyclictest2731775-21grep08:00:222
271321299411,9cyclictest2819380-21irqstats12:15:172
271321299411,9cyclictest2773461-21/usr/sbin/munin10:00:252
271321299411,9cyclictest2736889-21/usr/sbin/munin08:15:192
2713212994118,19cyclictest0-21swapper/210:30:002
2713212994114,23cyclictest2776129-21uname10:10:182
2713212994112,25cyclictest0-21swapper/211:00:182
2713208994129,9cyclictest231ktimers/110:10:121
271320499416,5cyclictest131rcu_preempt09:10:130
271320499416,5cyclictest131rcu_preempt09:10:130
2713204994128,9cyclictest121ktimers/009:55:120
271320499411,5cyclictest131rcu_preempt11:00:130
2713212994029,7cyclictest2766569-21grep09:40:252
271321299402,5cyclictest2719671-21ntp_states07:25:212
2713212994021,15cyclictest0-21swapper/211:20:162
271321299401,9cyclictest2792072-21/usr/sbin/munin10:55:202
271321299401,8cyclictest2762677-21/usr/sbin/munin09:30:192
271321299401,8cyclictest2725341-21cron07:41:002
271321299401,6cyclictest2815416-21munin-run12:05:002
2713215993927,7cyclictest0-21swapper/311:40:273
2713215993916,3cyclictest0-21swapper/310:35:253
2713215993915,4cyclictest2806661-21sendmail11:40:013
2713215993911,6cyclictest2751182-21grep08:55:263
271321299398,7cyclictest2770989-21/usr/sbin/munin09:55:162
271321299396,5cyclictest2715044-21latency_hist07:15:012
2713212993929,7cyclictest438-21cron12:30:002
2713212993929,7cyclictest438-21cron12:29:592
271321299392,10cyclictest2757026-21apt-get09:15:102
271321299392,10cyclictest2757026-21apt-get09:15:102
271321299391,9cyclictest2817497-21/usr/sbin/munin12:10:152
271321299391,9cyclictest2797009-21/usr/sbin/munin11:10:192
271321299391,9cyclictest2783372-21/usr/sbin/munin10:30:172
271321299391,9cyclictest2764181-21/usr/sbin/munin09:35:172
271321299391,9cyclictest2761012-21ntp_states09:25:212
271321299391,9cyclictest2750645-21memory08:55:202
271321299391,9cyclictest2739974-21/usr/sbin/munin08:25:252
2713212993919,17cyclictest0-21swapper/207:45:252
271321299391,8cyclictest2808053-21sshd11:41:082
271321299391,8cyclictest2789850-21/usr/sbin/munin10:50:132
271321299391,7cyclictest2751914-21/usr/sbin/munin09:00:202
2713212993915,21cyclictest0-21swapper/211:05:232
2713212993914,21cyclictest2759733-21tail09:20:252
2713212993914,21cyclictest2759733-21tail09:20:242
271321299391,11cyclictest2781111-21basename10:25:002
271321299391,10cyclictest2715913-21/usr/sbin/munin07:15:162
2713208993930,6cyclictest0-21swapper/109:20:011
2713208993930,6cyclictest0-21swapper/109:20:011
2713215993829,4cyclictest0-21swapper/309:10:013
2713215993812,5cyclictest0-21swapper/311:00:163
271321299388,7cyclictest2738705-21cat08:20:182
271321299382,7cyclictest2742670-21grep08:30:222
271321299381,9cyclictest2810760-21memory11:50:192
271321299381,8cyclictest2769486-21/usr/sbin/munin09:50:212
271321299381,8cyclictest2767263-21/usr/sbin/munin09:45:222
2713212993811,9cyclictest2787084-21cut10:40:222
271321299381,10cyclictest2808616-21cpu11:45:142
271320899384,5cyclictest131rcu_preempt07:15:121
2713208993829,6cyclictest2713196-21cyclictest10:35:241
271320499383,5cyclictest131rcu_preempt10:00:130
2713204993827,7cyclictest2717157-21sendmail07:20:020
271321299379,3cyclictest0-21swapper/212:00:002
2713212993722,12cyclictest311ktimers/209:05:112
271321299371,9cyclictest629-21snmpd09:12:312
271321299371,9cyclictest629-21snmpd09:12:312
271321299371,9cyclictest2821205-21/usr/sbin/munin12:20:202
271321299371,9cyclictest2805528-21/usr/sbin/munin11:35:172
271321299371,9cyclictest2730091-21ntp_states07:55:202
271321299371,8cyclictest2748682-21cut08:50:162
271321299371,8cyclictest2745549-21missed_timers08:40:202
271321299371,8cyclictest2733022-21/usr/sbin/munin08:05:112
271321299371,8cyclictest2723256-21/usr/sbin/munin07:35:232
271321299371,7cyclictest2735066-21fschecks_time08:10:172
271321299371,7cyclictest2735066-21fschecks_time08:10:172
2713208993728,6cyclictest2768737-21idleruntime-cro09:49:591
2713204993728,4cyclictest0-21swapper/012:25:000
2713215993626,7cyclictest0-21swapper/309:45:013
271321299367,5cyclictest0-21swapper/211:25:162
2713212993626,4cyclictest0-21swapper/210:20:012
271321299361,9cyclictest2785198-21sed10:35:182
271321299361,9cyclictest2746913-21/usr/sbin/munin08:45:152
271321299361,8cyclictest2717946-21grep07:20:222
271321299361,7cyclictest2804947-21cron11:35:002
271321299361,10cyclictest2788745-21/usr/sbin/munin10:45:242
2713208993627,4cyclictest0-21swapper/107:25:011
271320899362,5cyclictest131rcu_preempt10:40:121
2713204993630,3cyclictest2743147-21sh08:35:020
2713204993628,4cyclictest0-21swapper/009:00:010
2713204993627,5cyclictest2803254-21sh11:30:000
2713204993626,6cyclictest0-21swapper/008:10:180
2713204993626,6cyclictest0-21swapper/008:10:180
2713204993625,7cyclictest2820038-21grep12:15:240
271320499361,4cyclictest131rcu_preempt11:20:110
2713215993528,4cyclictest0-21swapper/312:24:593
2713215993527,6cyclictest2713323-21kworker/u8:1+events_unbound07:10:133
271321299351,9cyclictest2722163-21taskset07:34:002
271321299351,8cyclictest2774444-21tr10:05:182
271321299351,6cyclictest2799834-21sh11:20:012
2713208993528,3cyclictest0-21swapper/108:00:001
2713208993527,4cyclictest0-21swapper/108:40:011
2713208993527,4cyclictest0-21swapper/107:45:161
2713215993425,4cyclictest0-21swapper/307:30:243
271321299341,10cyclictest2825856-21chrt12:35:092
2713208993422,6cyclictest0-21swapper/112:00:161
2713208993327,3cyclictest0-21swapper/107:15:021
2713208993326,3cyclictest0-21swapper/110:45:271
2713204993326,3cyclictest2761917-21kthreadd09:30:000
2713204993323,6cyclictest0-21swapper/011:45:000
2713215993224,4cyclictest0-21swapper/312:25:253
2713215993224,4cyclictest0-21swapper/312:25:253
2713215993223,5cyclictest0-21swapper/308:15:263
2713208993225,5cyclictest2765201-21kworker/u8:2+events_unbound09:50:381
2713208993225,5cyclictest2751480-21kworker/u8:1+events_unbound10:20:401
2713208993225,4cyclictest2806666-21munin-plugin-st11:40:001
2713208993224,4cyclictest0-21swapper/111:30:261
2713208993223,5cyclictest0-21swapper/110:50:261
271320499322,4cyclictest131rcu_preempt09:30:110
2713204993224,4cyclictest0-21swapper/011:20:000
2713215993123,4cyclictest0-21swapper/310:25:243
271320899318,6cyclictest131rcu_preempt11:10:131
2713208993125,4cyclictest2745216-21kworker/u8:3+events_unbound09:30:371
2713208993121,7cyclictest2764865-21grep09:35:261
2713204993125,3cyclictest0-21swapper/011:40:010
2713204993124,4cyclictest2814129-21fschecks_time12:00:170
2713204993123,4cyclictest0-21swapper/010:30:260
2713204993122,6cyclictest0-21swapper/012:39:590
271320499311,28cyclictest0-21swapper/010:25:110
2713215993022,4cyclictest0-21swapper/309:50:153
2713215993021,6cyclictest0-21swapper/311:10:283
2713215993021,5cyclictest0-21swapper/307:40:003
2713215993020,7cyclictest2763143-21grep09:30:243
2713215993020,5cyclictest0-21swapper/310:15:263
2713208993023,3cyclictest0-21swapper/108:30:131
2713208993022,4cyclictest0-21swapper/109:25:341
2713208993022,4cyclictest0-21swapper/107:35:171
2713208993021,6cyclictest2749564-21grep08:50:271
2713208993021,6cyclictest0-21swapper/112:15:251
2713208993019,8cyclictest2738045-21awk08:20:001
271320899301,4cyclictest131rcu_preempt09:55:121
2713204993023,3cyclictest0-21swapper/009:05:010
2713204993021,6cyclictest2816065-21runrttasks12:05:170
2713204993017,9cyclictest204-21dbus-daemon09:20:350
2713204993017,9cyclictest204-21dbus-daemon09:20:340
2713215992922,3cyclictest0-21swapper/310:05:263
2713215992921,4cyclictest0-21swapper/307:45:263
2713208992922,4cyclictest0-21swapper/108:40:241
2713208992921,5cyclictest164-21systemd-journal12:25:561
2713208992921,5cyclictest164-21systemd-journal12:25:561
2713208992921,4cyclictest0-21swapper/111:40:261
2713208992921,4cyclictest0-21swapper/111:00:261
2713208992921,4cyclictest0-21swapper/108:30:011
2713208992919,6cyclictest0-21swapper/110:00:261
2713208992916,5cyclictest2809057-21kworker/u8:3+events_unbound12:33:551
2713204992922,3cyclictest0-21swapper/008:20:000
2713204992922,3cyclictest0-21swapper/007:10:250
2713204992921,5cyclictest2775098-21grep10:05:260
2713204992921,5cyclictest0-21swapper/012:00:010
2713204992921,4cyclictest13550irq/42-30be0000.ethernet10:10:270
2713204992920,4cyclictest0-21swapper/010:40:440
2713204992919,6cyclictest2771817-21kworker/u8:2+events_unbound10:24:590
2713204992913,8cyclictest2731474-21tune2fs08:00:170
2713204992911,3cyclictest2725712-21cat07:45:020
2713215992822,3cyclictest0-21swapper/307:55:233
2713215992820,4cyclictest0-21swapper/309:20:163
2713215992820,4cyclictest0-21swapper/309:20:163
2713215992820,4cyclictest0-21swapper/307:45:023
2713208992822,4cyclictest2818966-21kworker/u8:2+events_unbound12:22:011
2713208992820,5cyclictest0-21swapper/109:20:151
2713208992820,5cyclictest0-21swapper/109:20:151
2713208992820,4cyclictest0-21swapper/111:05:471
271320899281,8cyclictest2734414-21munin-run08:10:011
2713204992820,4cyclictest13550irq/42-30be0000.ethernet12:30:230
271320499281,4cyclictest131rcu_preempt07:20:120
2713215992720,3cyclictest0-21swapper/307:15:233
2713215992719,4cyclictest0-21swapper/310:30:413
2713215992717,6cyclictest2732261-21grep08:00:273
2713208992719,4cyclictest0-21swapper/108:20:151
271320499273,4cyclictest131rcu_preempt09:15:120
271320499273,4cyclictest131rcu_preempt09:15:110
2713204992719,6cyclictest2745216-21kworker/u8:3+events_unbound08:40:180
2713204992719,4cyclictest0-21swapper/010:35:250
2713215992619,4cyclictest2796439-21latency_hist11:10:013
2713215992619,3cyclictest0-21swapper/310:00:003
2713215992618,4cyclictest0-21swapper/308:30:233
2713215992616,6cyclictest2741046-21unixbench_singl08:25:253
2713215992615,7cyclictest0-21swapper/310:50:263
2713215992614,8cyclictest1-21systemd08:05:193
2713208992618,5cyclictest2827608-21latency_hist12:40:011
2713208992617,6cyclictest204-21dbus-daemon07:50:171
2713208992617,5cyclictest2765726-21cut09:40:161
2713208992614,9cyclictest204-21dbus-daemon07:25:141
2713204992622,2cyclictest13550irq/42-30be0000.ethernet10:55:140
2713215992518,3cyclictest0-21swapper/312:30:203
2713215992518,3cyclictest0-21swapper/308:25:003
2713215992517,5cyclictest0-21swapper/312:15:153
2713215992517,4cyclictest0-21swapper/312:00:173
2713215992516,6cyclictest2744414-21unixbench_singl08:35:263
2713215992515,6cyclictest2827548-21latency_hist12:40:003
2713215992515,6cyclictest2748263-21auditctl08:50:003
2713208992519,4cyclictest2706488-21kworker/u8:0+events_unbound08:13:081
2713208992519,4cyclictest2706488-21kworker/u8:0+events_unbound08:13:081
2713208992518,4cyclictest2793060-21cat11:00:011
2713208992517,4cyclictest0-21swapper/111:55:251
2713204992519,3cyclictest0-21swapper/008:55:000
2713204992516,6cyclictest2765432-21cat09:40:010
2713204992516,6cyclictest164-21systemd-journal11:45:510
2713204992515,6cyclictest0-21swapper/010:50:260
2713204992513,8cyclictest2733516-21sshd08:05:200
271320499251,11cyclictest2729574-21/usr/sbin/munin07:55:120
2713215992418,3cyclictest2777254-21auditctl10:15:013
2713215992418,3cyclictest0-21swapper/310:55:183
2713215992417,4cyclictest2800638-21ntpq11:20:193
2713215992417,3cyclictest0-21swapper/311:25:213
2713215992417,3cyclictest0-21swapper/310:40:193
2713215992416,5cyclictest0-21swapper/310:20:163
2713215992415,6cyclictest0-21swapper/308:15:013
2713215992415,6cyclictest0-21swapper/308:15:013
2713215992414,6cyclictest204-21dbus-daemon08:40:273
2713208992418,3cyclictest0-21swapper/111:20:241
2713208992416,6cyclictest2773569-21kworker/u8:3+events_unbound10:30:141
2713208992415,6cyclictest2774807-21cut10:05:231
271320499243,3cyclictest131rcu_preempt10:45:160
2713204992418,3cyclictest0-21swapper/007:50:190
2713204992417,5cyclictest2706488-21kworker/u8:0+events_unbound09:45:380
2713204992417,4cyclictest0-21swapper/007:25:240
2713204992417,3cyclictest0-21swapper/009:05:250
2713204992417,3cyclictest0-21swapper/008:20:230
2713204992416,5cyclictest2797209-21ntpq11:10:230
2713204992414,6cyclictest2741042-21grep08:25:250
271320499240,20cyclictest0-21swapper/012:29:550
271320499240,20cyclictest0-21swapper/012:29:550
2713215992316,4cyclictest2756310-21grep09:10:263
2713215992316,4cyclictest2756310-21grep09:10:263
2713215992315,6cyclictest2752970-21unixbench_singl09:00:263
2713215992315,5cyclictest2789612-21cron10:50:013
2713215992315,4cyclictest0-21swapper/309:15:253
2713215992315,4cyclictest0-21swapper/309:15:243
2713215992314,6cyclictest2817828-21ls12:10:193
2713208992316,4cyclictest438-21cron08:05:011
2713208992315,4cyclictest0-21swapper/112:10:241
2713204992317,3cyclictest0-21swapper/007:35:230
2713204992317,2cyclictest0-21swapper/011:33:020
2713204992316,5cyclictest0-21swapper/011:51:190
2713204992316,4cyclictest13550irq/42-30be0000.ethernet10:15:250
2713204992314,5cyclictest0-21swapper/011:05:250
271320499231,3cyclictest2726123-21apt-get07:45:140
2713204992311,9cyclictest645-21runrttasks07:30:220
271320499230,21cyclictest0-21swapper/012:11:030
271320499230,19cyclictest0-21swapper/009:42:220
2713215992216,3cyclictest0-21swapper/311:50:243
2713215992216,3cyclictest0-21swapper/310:00:243
2713215992214,5cyclictest2764452-21pluginstate09:35:223
2713208992216,3cyclictest0-21swapper/111:50:251
2713208992214,5cyclictest0-21swapper/111:45:261
2713208992213,5cyclictest2751664-21sh09:00:011
271320499221,17cyclictest2744380-21grep08:35:260
2713215992113,5cyclictest0-21swapper/307:55:023
2713215992112,6cyclictest0-21swapper/312:05:163
271321599211,16cyclictest2760588-21fschecks_count09:25:153
2713208992110,8cyclictest2817117-21basename12:10:001
2713208992014,4cyclictest2751480-21kworker/u8:1+events_unbound09:00:321
2713208992014,3cyclictest0-21swapper/111:15:231
2713208992014,3cyclictest0-21swapper/107:30:201
2713208992012,5cyclictest0-21swapper/109:10:271
2713208992012,5cyclictest0-21swapper/109:10:261
271320899200,18cyclictest231ktimers/111:25:171
2713215991912,3cyclictest0-21swapper/311:15:273
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional