You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 02:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Tue Nov 18, 2025 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3056438991187,17cyclictest3061725-21kworker/u8:3-writeback08:40:012
305644099971,66cyclictest0-21swapper/307:45:013
305643899865,27cyclictest30-21rcuc/210:10:022
305643899865,27cyclictest30-21rcuc/210:10:022
3056440997710,51cyclictest0-21swapper/312:30:163
3056440997710,51cyclictest0-21swapper/312:30:163
3056435997129,37cyclictest3106846-21grep12:00:301
3056435997129,37cyclictest3106846-21grep12:00:301
305643599676,14cyclictest3093942-21grep10:45:301
3056435996426,31cyclictest168350irq/126-8000000.ethernet-tx107:34:131
3056435996327,27cyclictest168350irq/126-8000000.ethernet-tx107:10:321
305643599623,19cyclictest3061738-21apt-get07:40:011
3056435996219,38cyclictest3090066-21dropbear10:25:181
305643499623,23cyclictest12-21ksoftirqd/012:20:020
3056435996125,31cyclictest0-21swapper/111:50:301
3056435996035,19cyclictest0-21swapper/109:05:301
3056435996025,29cyclictest0-21swapper/108:20:291
3056435996021,31cyclictest3101760-21grep11:30:271
3056435995928,24cyclictest0-21swapper/109:55:001
3056435995919,30cyclictest3057564-21fschecks_time07:15:021
3056435995917,33cyclictest0-21swapper/108:00:261
305643599591,49cyclictest3067175-21df_inode08:10:201
305643499593,15cyclictest0-21swapper/010:00:010
305643599586,9cyclictest3110192-21head12:20:301
305643599583,15cyclictest3078718-21grep09:15:311
3056435995819,31cyclictest0-21swapper/111:10:021
3056435995818,32cyclictest0-21swapper/107:50:021
3056435995818,32cyclictest0-21swapper/107:50:021
305643599574,10cyclictest3087211-21grep10:05:301
305643599574,10cyclictest3087211-21grep10:05:291
305643599573,12cyclictest3085470-21unixbench_multi09:55:281
3056435995727,24cyclictest0-21swapper/111:40:011
3056435995726,23cyclictest0-21swapper/110:10:301
3056435995720,28cyclictest0-21swapper/108:30:221
305643599565,8cyclictest3083009-21sed09:40:301
3056435995626,24cyclictest3080408-21grep09:25:281
3056435995618,31cyclictest0-21swapper/109:45:311
3056435995617,5cyclictest3076158-21grep09:00:291
3056435995613,6cyclictest0-21swapper/110:20:251
3056435995613,6cyclictest0-21swapper/110:20:251
3056435995613,33cyclictest0-21swapper/111:15:271
3056438995538,12cyclictest311ktimers/210:50:172
3056438995534,13cyclictest311ktimers/209:40:142
305643599554,11cyclictest3062572-21unixbench_multi07:40:271
3056435995530,20cyclictest3059953-21unixbench_multi07:25:291
3056435995530,19cyclictest3088896-21grep10:15:301
3056435995520,29cyclictest0-21swapper/111:00:021
3056435995519,28cyclictest0-21swapper/112:30:331
3056435995519,28cyclictest0-21swapper/112:30:331
3056435995517,30cyclictest0-21swapper/108:50:311
3056435995516,4cyclictest0-21swapper/110:40:271
305643499552,46cyclictest0-21swapper/010:20:260
305643499552,46cyclictest0-21swapper/010:20:260
305643599545,11cyclictest0-21swapper/107:55:001
3056435995426,23cyclictest3111004-21grep12:25:291
3056435995425,23cyclictest0-21swapper/112:15:311
3056435995425,23cyclictest0-21swapper/112:15:311
3056435995413,6cyclictest0-21swapper/107:55:261
305643599541,2cyclictest0-21swapper/109:40:011
3056435995410,5cyclictest3086357-21unixbench_singl10:00:291
305643599533,15cyclictest3077880-21sed09:10:291
3056435995329,20cyclictest3071908-21grep08:35:301
305643599532,12cyclictest3099925-21tail11:20:301
3056435995318,3cyclictest0-21swapper/108:45:291
305643899528,8cyclictest30-21rcuc/212:00:012
305643599526,8cyclictest3096508-21grep11:00:301
305643599524,10cyclictest3108457-21grep12:10:301
305643599522,4cyclictest3112785-21munin-run12:40:001
3056435995222,22cyclictest0-21swapper/110:50:291
3056434995247,2cyclictest3112783-21apt-get12:40:010
305643899517,23cyclictest877-21avahi-daemon08:00:012
305643599513,10cyclictest3091381-21grep10:30:301
305643599512,9cyclictest3107416-21phc2sys12:05:281
305643599512,12cyclictest3103407-21tail11:40:301
3056435995120,26cyclictest0-21swapper/107:20:211
3056435995111,7cyclictest0-21swapper/109:30:311
3056435995111,11cyclictest0-21swapper/108:40:241
3056434995142,6cyclictest3070291-21munin-plugin-st08:30:000
305643599507,9cyclictest0-21swapper/110:35:291
305643599507,9cyclictest0-21swapper/110:35:291
305643599504,9cyclictest3104243-21grep11:45:301
3056435995011,4cyclictest0-21swapper/108:05:281
3056435995010,7cyclictest0-21swapper/107:10:001
305643499509,35cyclictest0-21swapper/010:10:220
3056434995043,5cyclictest131ktimers/007:30:010
305643499501,11cyclictest3079853-21latency_hist09:25:020
305643599493,11cyclictest3106016-21cron12:00:001
305643599492,13cyclictest3098422-21latency_hist11:15:011
305643599492,13cyclictest3098422-21latency_hist11:15:011
3056435994911,9cyclictest3079161-21sh09:20:211
3056434994940,5cyclictest21250irq/208-8000000.ethernet09:10:210
305643499492,8cyclictest3064458-21latency_hist07:55:010
3056438994841,4cyclictest3082186-21cron09:40:012
3056438994838,5cyclictest3084728-21munin-plugin-st09:55:002
305643599482,9cyclictest3069775-21lsblk08:25:231
3056435994815,9cyclictest3100031-21cron11:25:021
3056434994812,29cyclictest3091598-21sed10:35:010
3056438994733,10cyclictest1287-21cron08:15:002
3056438994720,15cyclictest311ktimers/210:30:142
3056435994713,7cyclictest231ktimers/108:15:281
3056435994713,7cyclictest231ktimers/108:15:281
305643499477,38cyclictest0-21swapper/010:25:220
305643499473,4cyclictest15-21rcuc/011:00:290
3056434994734,9cyclictest0-21swapper/011:35:000
3056434994711,34cyclictest0-21swapper/009:45:310
3056438994619,14cyclictest311ktimers/212:25:152
305643599463,17cyclictest3075044-21phc2sys08:55:281
305643499468,33cyclictest0-21swapper/007:20:170
3056434994640,4cyclictest0-21swapper/010:05:160
3056434994640,4cyclictest0-21swapper/010:05:160
3056438994528,12cyclictest311ktimers/210:40:172
305643499458,35cyclictest0-21swapper/012:30:210
305643499458,35cyclictest0-21swapper/012:30:210
3056438994430,9cyclictest0-21swapper/210:00:002
3056438994426,12cyclictest311ktimers/209:15:152
305643499445,4cyclictest3057257-21munin-node07:15:000
305643499445,4cyclictest0-21swapper/012:25:250
3056434994437,4cyclictest21050irq/252-8000000.ethernet08:20:240
3056434994435,7cyclictest3061746-21munin-plugin-st07:40:000
305643499442,22cyclictest15-21rcuc/011:55:010
305643499441,7cyclictest12-21ksoftirqd/008:55:010
305643499441,6cyclictest12-21ksoftirqd/011:40:000
3056438994326,11cyclictest311ktimers/211:00:162
3056438994325,13cyclictest311ktimers/212:00:132
3056438994325,13cyclictest311ktimers/212:00:132
3056438994325,12cyclictest311ktimers/212:05:172
305643499435,4cyclictest15-21rcuc/010:55:230
305643499433,6cyclictest0-21swapper/008:05:240
3056434994328,10cyclictest0-21swapper/011:25:320
305643899423,24cyclictest0-21swapper/207:15:022
3056438994228,8cyclictest0-21swapper/207:25:292
3056438994227,9cyclictest0-21swapper/207:15:252
3056438994224,13cyclictest311ktimers/210:45:142
3056438994223,14cyclictest311ktimers/208:25:172
305643499425,3cyclictest15-21rcuc/008:30:190
3056434994234,4cyclictest0-21swapper/007:45:290
3056434994234,4cyclictest0-21swapper/007:45:290
305643499422,2cyclictest0-21swapper/009:20:000
305643499421,8cyclictest0-21swapper/009:30:250
3056438994132,5cyclictest3069380-21unixbench_singl08:20:292
3056438994128,8cyclictest0-21swapper/207:45:282
3056438994128,8cyclictest0-21swapper/207:45:282
3056438994126,9cyclictest0-21swapper/210:15:302
3056438994121,14cyclictest311ktimers/208:00:152
3056434994127,10cyclictest0-21swapper/009:00:000
305643499411,35cyclictest3108682-21latency_hist12:15:010
3056438994021,12cyclictest311ktimers/210:20:132
3056438994021,12cyclictest311ktimers/210:20:132
305643499409,27cyclictest15-21rcuc/007:20:000
3056434994030,7cyclictest3103502-21munin-plugin-st11:45:000
3056438993927,6cyclictest0-21swapper/209:00:282
3056438993910,24cyclictest311ktimers/211:26:202
305643499396,27cyclictest21250irq/208-8000000.ethernet09:25:020
3056434993932,4cyclictest21050irq/252-8000000.ethernet11:50:270
3056434993930,6cyclictest131ktimers/012:00:280
3056434993930,6cyclictest131ktimers/012:00:280
3056434993928,7cyclictest3107612-21grep12:05:300
305643499391,7cyclictest3067701-21unixbench_singl08:10:300
305643499391,6cyclictest3068556-21sed08:15:310
305643499391,6cyclictest3068556-21sed08:15:300
3056438993813,13cyclictest311ktimers/209:30:142
305643499389,4cyclictest131ktimers/011:45:290
3056434993827,8cyclictest3100228-21date11:25:010
3056434993821,13cyclictest0-21swapper/010:45:230
305643499381,8cyclictest0-21swapper/009:50:270
305643499381,3cyclictest3075643-21diskstats09:00:200
3056434993811,24cyclictest0-21swapper/009:05:230
305643899379,17cyclictest3083247-21/usr/sbin/munin09:45:202
3056438993725,6cyclictest0-21swapper/211:10:012
305643899371,4cyclictest0-21swapper/210:30:012
3056434993729,6cyclictest131ktimers/007:10:010
305643499371,9cyclictest0-21swapper/008:45:010
3056434993717,18cyclictest0-21swapper/010:35:310
3056434993717,18cyclictest0-21swapper/010:35:310
305643499371,2cyclictest0-21swapper/007:45:010
3056438993626,6cyclictest3092330-21munin-run10:40:002
3056438993626,6cyclictest3092330-21munin-run10:39:592
3056438993626,5cyclictest0-21swapper/210:55:292
3056438993624,5cyclictest3062681-21cron07:44:592
3056438993623,9cyclictest0-21swapper/209:10:282
3056438993622,10cyclictest0-21swapper/211:25:012
3056438993621,9cyclictest0-21swapper/208:30:222
3056434993630,4cyclictest21250irq/208-8000000.ethernet08:35:260
305643499362,5cyclictest3097492-21latency_hist11:10:010
3056434993620,11cyclictest0-21swapper/010:40:330
305643499360,9cyclictest0-21swapper/009:35:310
3056438993521,9cyclictest311ktimers/207:35:142
3056438993517,5cyclictest3058585-21/usr/sbin/munin07:20:182
3056434993510,23cyclictest0-21swapper/007:30:270
3056438993425,7cyclictest3098534-21/usr/sbin/munin11:15:302
3056438993423,7cyclictest0-21swapper/212:15:312
3056438993423,7cyclictest0-21swapper/212:15:312
3056438993419,10cyclictest311ktimers/211:10:142
3056438993419,10cyclictest311ktimers/211:10:142
305643899341,27cyclictest0-21swapper/211:40:182
3056434993428,4cyclictest3073670-21munin-plugin-st08:50:010
3056434993428,4cyclictest21250irq/208-8000000.ethernet10:50:290
3056434993428,4cyclictest21250irq/208-8000000.ethernet10:15:200
3056434993426,4cyclictest0-21swapper/008:00:010
3056438993327,3cyclictest3068527-21grep08:15:312
3056438993327,3cyclictest3068527-21grep08:15:312
3056438993324,6cyclictest3112141-21/usr/sbin/munin12:35:332
3056438993318,8cyclictest0-21swapper/212:15:012
3056438993316,13cyclictest311ktimers/208:05:152
305643899331,27cyclictest0-21swapper/208:40:282
3056438993311,11cyclictest311ktimers/208:55:162
305643499331,29cyclictest3066075-21latency_hist08:05:010
305643499331,27cyclictest3083047-21latency_hist09:45:010
3056438993222,7cyclictest3085784-21/usr/sbin/munin10:00:292
3056438993222,6cyclictest0-21swapper/211:30:272
3056438993222,6cyclictest0-21swapper/208:45:202
3056438993221,6cyclictest3076496-21/usr/sbin/munin09:05:252
305643899321,25cyclictest0-21swapper/209:25:172
305643499321,26cyclictest0-21swapper/011:10:020
305643499321,26cyclictest0-21swapper/011:10:020
3056438993124,4cyclictest0-21swapper/212:35:012
3056438993124,4cyclictest0-21swapper/212:35:012
3056434993123,6cyclictest131ktimers/012:15:190
3056434993123,6cyclictest131ktimers/012:15:190
305643499311,2cyclictest0-21swapper/011:20:010
305643899308,4cyclictest311ktimers/207:32:192
3056438993024,4cyclictest311ktimers/212:20:022
3056438993022,6cyclictest3079652-21sshd09:20:332
3056434993022,4cyclictest0-21swapper/010:00:280
3056438992921,6cyclictest0-21swapper/211:40:012
3056438992920,5cyclictest30-21rcuc/211:45:282
3056438992920,4cyclictest3074511-21munin-plugin-st08:55:002
3056438992820,5cyclictest3056428-21cyclictest07:50:282
3056438992720,5cyclictest0-21swapper/210:15:002
3056438992719,4cyclictest0-21swapper/211:50:212
3056438992315,5cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional