You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-21 - 16:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Sun Jun 21, 2026 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2689320995747,5cyclictest2783212-21cron11:40:012
2689312995442,9cyclictest121ktimers/007:25:110
2689320994740,4cyclictest2776397-21munin-run11:20:002
2689325994619,10cyclictest2723098-21/usr/sbin/munin08:45:163
2689325994619,10cyclictest2723098-21/usr/sbin/munin08:45:153
2689320994537,4cyclictest0-21swapper/212:00:002
2689320994420,20cyclictest0-21swapper/211:50:242
2689312994438,4cyclictest2727493-21kworker/u8:0+events_unbound09:14:280
2689325994334,5cyclictest2732442-21unixbench_multi09:10:253
2689320994329,8cyclictest0-21swapper/208:35:002
2689320994316,21cyclictest0-21swapper/208:10:202
268932099431,11cyclictest2708440-21users08:00:272
2689312994336,5cyclictest2786716-21kworker/u8:0+events_unbound12:10:110
2689312994335,5cyclictest2734610-21cron09:20:000
2689312994324,15cyclictest0-21swapper/008:20:010
2689320994231,7cyclictest2751641-21grep10:05:282
2689317994235,4cyclictest2713956-21sendmail08:20:021
2689317994234,5cyclictest2781517-21idleruntime-cro11:35:001
2689312994236,4cyclictest2793666-21idleruntime-cro12:10:000
2689312994235,5cyclictest2767574-21kworker/u8:2+events_unbound12:25:120
2689312994231,6cyclictest0-21swapper/011:00:010
268932099408,29cyclictest2758295-21processes10:25:202
2689320994032,5cyclictest645-21runrttasks12:30:112
268932099402,33cyclictest2769593-21sendmail11:00:002
268932099401,9cyclictest2792829-21proc_pri12:05:242
268932099401,9cyclictest2691146-21latency_hist07:15:022
268932099401,35cyclictest2767393-21grep10:50:242
268932099401,34cyclictest2725063-21meminfo08:50:192
268932099401,34cyclictest2725063-21meminfo08:50:182
268932099401,13cyclictest2746769-21sh09:55:002
268932099401,13cyclictest2722220-21tail08:40:252
2689317994034,4cyclictest2767574-21kworker/u8:2+events_unbound11:30:001
2689317994031,5cyclictest0-21swapper/107:29:051
268932099392,33cyclictest2791058-21ntp_states12:00:212
268932099392,32cyclictest2800016-21grep12:25:242
268932099392,30cyclictest2763211-21grep10:40:172
268932099392,30cyclictest2763211-21grep10:40:172
268932099392,29cyclictest2727779-21cron09:00:012
268932099392,29cyclictest2705637-21apt-get07:55:112
268932099392,10cyclictest2709057-21/usr/sbin/munin08:05:172
2689320993917,19cyclictest2794061-21fschecks_count12:10:152
268932099391,3cyclictest2752332-21apt-get10:10:152
268932099391,3cyclictest2740180-21apt-get09:35:102
268932099391,3cyclictest2737502-21/usr/sbin/munin09:25:242
268932099391,3cyclictest0-21swapper/207:15:142
268932099391,35cyclictest2713026-21ntp_states08:15:222
268932099391,34cyclictest2760825-21cron10:35:002
268932099391,33cyclictest2696682-21cut07:30:002
268932099391,12cyclictest2774704-21awk11:15:012
268932099391,10cyclictest2785660-21/usr/sbin/munin11:45:152
268932099390,3cyclictest0-21swapper/208:35:142
2689317993930,5cyclictest0-21swapper/111:05:161
2689312993931,5cyclictest0-21swapper/011:40:000
268931299391,5cyclictest131rcu_preempt09:40:130
268931299391,5cyclictest131rcu_preempt09:40:120
2689325993828,5cyclictest2799022-21apt-get12:25:123
2689325993824,11cyclictest2690323-21/usr/sbin/munin07:10:253
268932099383,32cyclictest2704225-21/usr/sbin/munin07:50:192
268932099383,32cyclictest2704225-21/usr/sbin/munin07:50:192
2689320993830,4cyclictest0-21swapper/208:50:002
2689320993830,4cyclictest0-21swapper/208:50:002
268932099382,32cyclictest2738638-21/usr/sbin/munin09:30:162
268932099381,8cyclictest2728173-21/usr/sbin/munin09:00:162
268932099381,4cyclictest2802532-21df_inode12:35:142
268932099381,4cyclictest2780175-21/usr/sbin/munin11:30:142
268932099381,3cyclictest2797316-21/usr/sbin/munin12:20:242
268932099381,3cyclictest2697657-21/usr/sbin/munin07:30:252
268932099381,3cyclictest0-21swapper/209:20:132
268932099381,3cyclictest0-21swapper/209:10:102
268932099381,3cyclictest0-21swapper/208:25:112
268932099381,33cyclictest2744607-21grep09:45:262
268932099381,32cyclictest2785144-21sed11:45:002
268932099381,32cyclictest2772985-21cron11:10:012
268932099381,32cyclictest2715854-21cron08:25:002
268932099381,2cyclictest2754245-21apt-get10:15:162
268932099381,10cyclictest2796285-21find12:15:212
268932099381,10cyclictest2761280-21apt-get10:35:112
268932099380,3cyclictest0-21swapper/209:55:112
268931799382,5cyclictest131rcu_preempt10:10:131
268931299382,5cyclictest131rcu_preempt10:15:150
2689325993729,4cyclictest0-21swapper/310:40:013
2689325993728,5cyclictest2707360-21apt-get08:00:133
2689325993727,5cyclictest2743602-21apt-get09:45:123
2689325993723,10cyclictest2766310-21latency_hist10:50:003
2689325993715,18cyclictest2738619-21fschecks_count09:30:163
268932099371,4cyclictest2742471-21ntp_states09:40:222
268932099371,4cyclictest2742471-21ntp_states09:40:212
268932099371,4cyclictest2702356-21diskstats07:45:142
268932099371,4cyclictest2702356-21diskstats07:45:142
268932099371,4cyclictest2700725-21/usr/sbin/munin07:40:172
268932099371,3cyclictest2776643-21apt-get11:20:122
268932099371,3cyclictest2756099-21/usr/sbin/munin10:20:142
268932099371,3cyclictest2729739-21apt-get09:05:142
268932099371,33cyclictest2771322-21sed11:05:002
268932099371,30cyclictest2698786-21grep07:35:172
268932099370,3cyclictest0-21swapper/209:15:102
2689317993731,4cyclictest2741548-21kworker/u8:1+events_unbound09:39:331
268931299370,5cyclictest131rcu_preempt11:20:130
2689325993627,4cyclictest2729739-21apt-get09:05:133
2689325993622,9cyclictest2719271-21cut08:35:013
2689325993620,11cyclictest2724860-21/usr/sbin/munin08:50:173
2689325993620,11cyclictest2724860-21/usr/sbin/munin08:50:163
2689325993618,13cyclictest2778295-21grep11:25:013
2689325993616,15cyclictest2760838-21idleruntime-cro10:35:013
268932099361,8cyclictest2693502-21/usr/sbin/munin07:20:222
268932099361,8cyclictest2693502-21/usr/sbin/munin07:20:222
268932099361,3cyclictest0-21swapper/210:00:132
268932099361,11cyclictest2779303-21sed11:25:242
268931299367,4cyclictest131rcu_preempt09:05:140
2689312993630,4cyclictest2741548-21kworker/u8:1+events_unbound10:04:380
2689312993630,4cyclictest0-21swapper/007:35:130
2689325993528,3cyclictest2728039-21apt-get09:00:133
2689325993525,7cyclictest2767170-21/usr/sbin/munin10:50:233
2689325993523,9cyclictest2795596-21apt-get12:15:103
2689325993523,8cyclictest2754245-21apt-get10:15:153
2689325993520,12cyclictest2695544-21/usr/sbin/munin07:25:183
2689325993519,12cyclictest2771751-21fschecks_time11:05:163
2689325993518,11cyclictest2733276-21/usr/sbin/munin09:15:153
2689325993517,9cyclictest0-21swapper/308:55:113
2689325993517,11cyclictest2749140-21/usr/sbin/munin10:00:173
2689325993516,14cyclictest0-21swapper/312:35:113
268932099351,30cyclictest164-21systemd-journal10:49:492
2689317993526,5cyclictest0-21swapper/111:20:011
2689325993427,4cyclictest2793895-21apt-get12:10:103
2689325993427,3cyclictest0-21swapper/308:10:163
2689325993426,4cyclictest2741902-21apt-get09:40:133
2689325993426,4cyclictest2741902-21apt-get09:40:133
2689325993425,5cyclictest0-21swapper/307:20:253
2689325993425,5cyclictest0-21swapper/307:20:253
2689325993422,9cyclictest2769138-21awk10:55:263
2689325993420,11cyclictest2792431-21/usr/sbin/munin12:05:163
2689325993420,11cyclictest2786144-21/usr/sbin/munin11:45:223
2689325993419,12cyclictest2714519-21/usr/sbin/munin08:20:163
2689325993419,10cyclictest2797438-21/usr/sbin/munin12:20:153
2689325993417,12cyclictest2740378-21fschecks_time09:35:153
2689325993415,15cyclictest2773280-21seq11:10:133
2689312993427,4cyclictest2710535-21idleruntime-cro08:10:010
2689312993411,4cyclictest131rcu_preempt07:50:140
2689312993411,4cyclictest131rcu_preempt07:50:130
2689325993322,6cyclictest0-21swapper/311:55:243
2689325993320,9cyclictest2776127-21cron11:17:003
2689325993319,11cyclictest2712579-21/usr/sbin/munin08:15:153
2689325993319,10cyclictest2709185-21/usr/sbin/munin08:05:173
2689325993318,12cyclictest2779378-21head11:25:253
2689325993318,11cyclictest2697084-21tune2fs07:30:173
2689325993317,11cyclictest2783200-21cron11:40:013
2689325993315,15cyclictest2703028-21switchtime07:45:243
2689325993315,15cyclictest2703028-21switchtime07:45:233
2689325993315,13cyclictest2704244-21if_eth107:50:193
2689325993315,13cyclictest2704244-21if_eth107:50:183
2689325993315,12cyclictest2792065-21latency_hist12:05:013
2689325993314,14cyclictest2735824-21timerwakeupswit09:20:233
2689317993327,4cyclictest2767574-21kworker/u8:2+events_unbound11:24:571
2689317993325,6cyclictest2784617-21kworker/u8:1+events_unbound11:45:041
2689317993325,4cyclictest0-21swapper/110:45:271
268931299333,4cyclictest131rcu_preempt10:25:110
2689312993327,4cyclictest2734288-21kworker/u8:3+events_unbound10:09:400
2689312993323,7cyclictest2760417-21grep10:30:260
2689312993323,5cyclictest2701376-21grep07:40:240
268931299331,17cyclictest2784916-21cron11:45:000
268931299330,30cyclictest0-21swapper/011:15:120
2689325993226,3cyclictest2752332-21apt-get10:10:133
2689325993221,7cyclictest2698603-21munin-node07:35:113
2689325993220,8cyclictest2801709-21tail12:30:253
2689325993219,9cyclictest2737786-21unixbench_multi09:25:243
2689325993219,8cyclictest2745640-21/usr/sbin/munin09:50:183
2689325993216,8cyclictest0-21swapper/311:50:123
2689325993216,13cyclictest2782644-21sed11:35:243
2689325993215,14cyclictest2692491-21tr07:15:253
2689325993215,13cyclictest2759131-21cron10:30:013
268931799324,4cyclictest131rcu_preempt12:00:111
2689312993222,7cyclictest438-21cron09:00:000
268931299321,6cyclictest131rcu_preempt09:35:110
268931299321,4cyclictest131rcu_preempt09:00:130
268931299321,29cyclictest0-21swapper/011:55:100
2689325993117,9cyclictest2763114-21/usr/sbin/munin10:40:153
2689325993117,9cyclictest2763114-21/usr/sbin/munin10:40:153
2689325993116,12cyclictest2721922-21mailstats08:40:223
2689325993115,11cyclictest2719501-21cpu08:35:153
2689325993114,14cyclictest2780406-21kernelversion11:30:173
2689325993114,12cyclictest2750775-21fschecks_count10:05:193
2689317993125,3cyclictest0-21swapper/108:35:001
2689317993124,5cyclictest2675007-21kworker/u8:3+events_unbound08:44:211
2689317993124,4cyclictest0-21swapper/107:20:261
2689317993124,4cyclictest0-21swapper/107:20:261
2689317993123,6cyclictest2767574-21kworker/u8:2+events_unbound12:05:071
2689317993123,4cyclictest0-21swapper/109:20:001
2689312993122,5cyclictest0-21swapper/012:40:000
268931299311,4cyclictest131rcu_preempt08:30:140
2689312993110,6cyclictest131rcu_preempt08:45:110
2689312993110,6cyclictest131rcu_preempt08:45:100
2689325993020,7cyclictest2770583-21/usr/sbin/munin11:00:253
2689325993017,11cyclictest2705872-21/usr/sbin/munin07:55:153
2689325993012,15cyclictest2756342-21latency10:20:173
2689317993023,4cyclictest0-21swapper/109:40:241
2689317993023,4cyclictest0-21swapper/109:40:241
2689317993022,4cyclictest0-21swapper/110:00:011
268931299305,5cyclictest131rcu_preempt10:10:130
2689325992917,8cyclictest2716232-21cut08:25:163
2689317992921,4cyclictest0-21swapper/110:20:011
2689317992920,4cyclictest0-21swapper/112:15:011
2689317992822,4cyclictest2725736-21kworker/u8:1+events_unbound09:10:431
2689317992821,4cyclictest2782740-21unixbench_multi11:35:251
2689317992820,6cyclictest2732530-21kworker/u8:2+events_unbound09:30:171
2689317992820,4cyclictest0-21swapper/109:50:171
2689317992820,4cyclictest0-21swapper/108:00:171
2689312992821,4cyclictest0-21swapper/010:40:010
2689312992820,6cyclictest2741548-21kworker/u8:1+events_unbound09:54:370
2689312992817,7cyclictest2739512-21grep09:30:250
2689312992816,8cyclictest204-21dbus-daemon11:35:000
2689317992718,6cyclictest0-21swapper/109:45:161
2689317992714,8cyclictest0-21swapper/110:05:281
2689312992722,2cyclictest13550irq/42-30be0000.ethernet08:10:150
2689312992720,3cyclictest0-21swapper/007:30:260
2689312992718,6cyclictest2717143-21sed08:25:260
2689312992714,10cyclictest2720437-21/usr/sbin/munin08:35:270
2689317992620,3cyclictest0-21swapper/111:50:241
2689317992616,7cyclictest2697911-21unixbench_multi07:30:251
2689317992616,7cyclictest0-21swapper/108:25:261
2689317992614,5cyclictest2761276-21kworker/u8:0+events_unbound10:43:051
2689317992614,5cyclictest2761276-21kworker/u8:0+events_unbound10:43:041
268931799261,22cyclictest2756541-21ntpq10:20:211
268931299266,4cyclictest131rcu_preempt12:15:230
2689312992620,3cyclictest2765704-21unixbench_multi10:45:260
2689312992619,5cyclictest2761276-21kworker/u8:0+events_unbound11:12:080
2689312992617,7cyclictest2706175-21ntpq07:55:190
2689317992519,3cyclictest0-21swapper/110:30:131
2689317992518,4cyclictest0-21swapper/110:50:251
2689317992517,6cyclictest2725736-21kworker/u8:1+events_unbound08:51:341
2689317992517,6cyclictest2725736-21kworker/u8:1+events_unbound08:51:341
2689317992517,5cyclictest0-21swapper/107:50:151
2689317992517,5cyclictest0-21swapper/107:50:151
2689317992516,6cyclictest0-21swapper/112:25:001
2689317992515,7cyclictest2769594-21tr11:00:001
2689317992515,7cyclictest2710462-21seq08:09:181
2689317992515,7cyclictest0-21swapper/108:15:011
268931299258,6cyclictest11-21ksoftirqd/008:40:140
2689312992519,4cyclictest2796682-21kworker/u8:1+events_unbound12:20:480
2689312992519,4cyclictest2741548-21kworker/u8:1+events_unbound09:48:410
2689312992519,3cyclictest13850irq/36-mmc111:55:020
2689312992518,5cyclictest2673250-21kworker/u8:2+events_unbound07:12:330
2689312992515,7cyclictest2764067-21grep10:40:250
2689312992515,7cyclictest2764067-21grep10:40:250
2689317992418,4cyclictest2692751-21timerwakeupswit07:15:271
2689317992418,3cyclictest0-21swapper/111:10:141
2689317992417,5cyclictest2727493-21kworker/u8:0+events_unbound09:20:491
2689317992416,5cyclictest2767574-21kworker/u8:2+events_unbound12:33:071
2689317992415,6cyclictest0-21swapper/108:40:001
2689317992415,5cyclictest2715858-21sh08:25:011
2689317992414,7cyclictest2700792-21sed07:40:201
268931799241,3cyclictest131rcu_preempt10:00:161
2689317992413,8cyclictest204-21dbus-daemon11:55:061
268931299243,4cyclictest27670732gzip10:50:230
2689312992418,4cyclictest2702328-21kworker/u8:0+events_unbound07:48:260
2689312992418,4cyclictest2702328-21kworker/u8:0+events_unbound07:48:260
2689312992417,4cyclictest2725666-21unixbench_singl08:50:250
2689312992417,4cyclictest2725666-21unixbench_singl08:50:240
2689312992413,7cyclictest2779330-21grep11:25:250
268931299241,19cyclictest0-21swapper/009:56:490
268931299240,20cyclictest0-21swapper/011:47:260
268931299240,20cyclictest0-21swapper/008:20:570
2689317992317,3cyclictest0-21swapper/111:40:231
2689317992317,3cyclictest0-21swapper/107:40:011
2689317992315,5cyclictest0-21swapper/112:15:251
2689317992314,6cyclictest0-21swapper/107:55:201
268931799231,3cyclictest131rcu_preempt08:45:111
268931799231,3cyclictest131rcu_preempt08:45:111
2689317992313,7cyclictest2727811-21tr09:00:011
2689317992313,6cyclictest0-21swapper/111:00:211
268931299233,16cyclictest0-21swapper/012:00:230
2689312992317,2cyclictest0-21swapper/009:20:500
2689312992316,3cyclictest0-21swapper/007:18:300
2689312992311,8cyclictest164-21systemd-journal11:06:390
268931799222,5cyclictest2761842-21ntp_states10:35:211
2689317992216,3cyclictest0-21swapper/107:10:221
2689317992212,7cyclictest2737021-21basename09:25:161
2689312992218,2cyclictest0-21swapper/010:20:110
2689312992217,3cyclictest13550irq/42-30be0000.ethernet07:20:130
2689312992217,3cyclictest13550irq/42-30be0000.ethernet07:20:120
2689312992214,5cyclictest121ktimers/012:30:130
2689317992116,2cyclictest0-21swapper/109:05:201
2689317992114,5cyclictest183950-1kworker/1:0H+kblockd07:45:131
2689317992114,5cyclictest183950-1kworker/1:0H+kblockd07:45:121
268931799211,3cyclictest131rcu_preempt10:25:181
2689312992116,2cyclictest0-21swapper/008:00:230
2689312992114,3cyclictest0-21swapper/011:00:470
268931299209,8cyclictest2736759-21gdbus09:25:020
2689317991912,5cyclictest231ktimers/112:25:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional