You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 17:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Wed Dec 10, 2025 12:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2426572996120,21cyclictest0-21swapper/307:20:283
2426560995334,16cyclictest2506412-21sendmail11:00:000
2426568994938,6cyclictest2514505-21grep11:20:252
2426572994831,13cyclictest2473579-21cron09:25:013
2426560994828,16cyclictest0-21swapper/010:20:000
2426565994732,11cyclictest231ktimers/107:55:131
2426572994632,11cyclictest391ktimers/312:10:123
2426572994626,16cyclictest0-21swapper/310:40:313
2426560994538,4cyclictest2499606-21sendmail10:40:010
2426572994419,21cyclictest0-21swapper/312:30:003
2426565994433,9cyclictest231ktimers/111:45:141
2426565994433,7cyclictest0-21swapper/110:35:011
2426560994420,22cyclictest146-21jbd2/mmcblk1p2-809:40:180
2426572994336,4cyclictest2450975-21cron08:20:003
2426572994318,21cyclictest0-21swapper/308:45:193
2426568994336,4cyclictest2447572-21idleruntime-cro08:10:012
2426565994330,10cyclictest231ktimers/108:20:131
2426572994218,19cyclictest0-21swapper/310:55:163
2426568994232,7cyclictest2444146-21sh08:00:002
2426560994235,4cyclictest2541155-21cron12:40:000
242656099422,9cyclictest2473122-21tail09:20:240
242656099421,9cyclictest2470181-21basename09:15:000
2426568994134,5cyclictest2457638-21kworker/u8:0+events_unbound08:44:072
242656099415,31cyclictest0-21swapper/008:15:270
2426560994134,4cyclictest2534136-21cron12:20:010
242656099411,10cyclictest2427071-21/usr/sbin/munin07:10:190
2426572994030,7cyclictest2520068-21munin-plugin-st11:39:593
242657299401,2cyclictest2465081-21apt-get09:00:153
242656099402,9cyclictest2434292-21fschecks_count07:30:190
242656099402,5cyclictest2442678-21apt-get07:55:130
242656099401,10cyclictest2494007-21sed10:20:250
242657299393,32cyclictest2537995-21apt-get12:30:133
242657299391,9cyclictest2533114-21memory12:15:213
2426572993914,22cyclictest0-21swapper/307:45:183
242657299391,10cyclictest2540219-21/usr/sbin/munin12:35:213
242657299391,10cyclictest2510056-21apt-get11:10:133
2426565993930,5cyclictest2513235-21munin-plugin-st11:20:001
242656099399,26cyclictest2471441-21unixbench_singl09:15:280
242656099399,26cyclictest2471441-21unixbench_singl09:15:280
242656099397,8cyclictest2504893-21cut10:55:010
242656099392,5cyclictest2497417-21grep10:30:260
242656099391,9cyclictest2481596-21grep09:45:250
242656099391,6cyclictest2474550-21/usr/sbin/munin09:25:270
2426560993914,22cyclictest2430509-21run-parts07:20:000
2426560993913,23cyclictest2455012-21fschecks_count08:30:160
242656099391,11cyclictest2466074-21tail09:00:270
242657299388,27cyclictest2459750-21wc08:45:013
242657299382,4cyclictest2491415-21/usr/sbin/munin10:15:183
242657299381,8cyclictest2481190-21/usr/sbin/munin09:45:193
242657299381,10cyclictest2478935-21idleruntime-cro09:40:003
242657299380,2cyclictest0-21swapper/311:15:123
242656099383,6cyclictest2532027-21unixbench_singl12:10:250
242656099382,4cyclictest2451564-21irqstats08:20:190
242656099381,9cyclictest2488928-21/usr/sbin/munin10:05:350
242656099381,5cyclictest2517886-21grep11:30:250
242656099381,5cyclictest2517886-21grep11:30:240
242656099381,5cyclictest2515910-21/usr/sbin/munin11:25:240
2426560993815,19cyclictest0-21swapper/011:20:140
242656099381,4cyclictest2487208-21/usr/sbin/munin10:00:250
242656099381,4cyclictest2487208-21/usr/sbin/munin10:00:240
2426560993814,20cyclictest0-21swapper/009:05:160
2426560993811,24cyclictest2276534-1kworker/0:2H+kblockd08:05:010
242656099381,10cyclictest2538333-21/usr/sbin/munin12:30:180
242656099381,10cyclictest2459966-21chrt08:45:150
2426560993810,25cyclictest2461768-21df_inode08:50:160
242656099380,6cyclictest2458850-21/usr/sbin/munin08:40:250
242657299378,26cyclictest2455641-21grep08:30:253
2426572993730,4cyclictest0-21swapper/308:30:013
242657299372,32cyclictest2476299-21ntp_states09:30:223
242657299372,32cyclictest2437576-21apt-get07:40:143
242657299371,9cyclictest2515183-21/usr/sbin/munin11:25:263
242657299371,8cyclictest2456533-21/usr/sbin/munin08:35:243
242657299371,8cyclictest2437231-21cron07:39:003
242657299371,7cyclictest2501879-21/usr/sbin/munin10:45:203
242657299371,3cyclictest0-21swapper/312:00:143
242657299371,33cyclictest2535610-21awk12:20:253
242657299371,11cyclictest2446823-21/usr/sbin/munin08:05:233
242657299371,10cyclictest2523805-21sort11:50:163
242657299371,10cyclictest2520664-21/usr/sbin/munin11:40:173
242657299371,10cyclictest2517339-21memory11:30:203
242657299371,10cyclictest2517339-21memory11:30:203
242657299371,10cyclictest2510007-21grep11:10:023
242657299371,10cyclictest2508276-21cat11:05:013
242657299371,10cyclictest2447906-21/usr/sbin/munin08:10:143
242657299371,10cyclictest2432587-21grep07:25:183
2426572993710,24cyclictest2484257-21/usr/sbin/munin09:55:183
2426568993729,4cyclictest0-21swapper/210:10:002
242656099372,6cyclictest2433912-21cron07:30:010
242656099371,9cyclictest2519035-21/usr/sbin/munin11:35:180
242656099371,9cyclictest2494850-21/usr/sbin/munin10:25:150
242656099371,9cyclictest2476253-21/usr/sbin/munin09:30:210
242656099371,8cyclictest2512767-21unixbench_multi11:15:270
242656099371,8cyclictest2489786-21grep10:10:170
242656099371,8cyclictest2426563-21latency_hist07:10:020
242656099371,6cyclictest2508898-21/usr/sbin/munin11:05:210
242656099371,6cyclictest2448850-21sed08:10:260
242656099371,5cyclictest2511670-21grep11:15:000
242656099371,4cyclictest2525538-21/usr/sbin/munin11:55:170
242656099371,4cyclictest2524169-21/usr/sbin/munin11:50:220
242657299362,27cyclictest2451363-21cut08:20:163
242657299361,9cyclictest2514457-21date11:20:253
242657299361,9cyclictest2479364-21/usr/sbin/munin09:40:173
242657299361,8cyclictest2429027-21apt-get07:15:133
242657299361,6cyclictest2522397-21grep11:45:193
242657299361,6cyclictest2494876-21cut10:25:153
2426572993616,17cyclictest2488675-21wc10:05:343
242657299361,5cyclictest2493174-21sort10:20:153
242657299361,4cyclictest2486181-21/usr/sbin/munin10:00:243
242657299361,4cyclictest2486181-21/usr/sbin/munin10:00:243
242657299361,3cyclictest2490111-21/usr/sbin/munin10:10:223
242657299361,3cyclictest0-21swapper/310:50:133
242657299361,32cyclictest2470063-21cron09:14:003
2426572993613,20cyclictest0-21swapper/309:20:013
2426572993613,20cyclictest0-21swapper/309:20:013
2426572993612,21cyclictest2444546-21cut08:00:173
2426572993611,22cyclictest0-21swapper/309:50:273
242657299361,10cyclictest2529193-21grep12:05:163
242657299360,3cyclictest0-21swapper/311:55:133
2426568993626,7cyclictest2460172-21grep08:45:192
2426568993623,8cyclictest0-21swapper/210:40:002
242656099363,6cyclictest2520526-21grep11:40:150
242656099362,5cyclictest2500602-21/usr/sbin/munin10:40:300
242656099361,9cyclictest2508065-21sshd11:04:290
242656099361,7cyclictest2477614-21fschecks_count09:35:170
242656099361,6cyclictest2503115-21latency_hist10:50:010
242656099361,5cyclictest2464420-21head08:55:360
242656099361,4cyclictest2536449-21grep12:25:140
242656099361,4cyclictest2534802-21grep12:20:160
242656099361,4cyclictest2530035-21grep12:05:260
242656099361,4cyclictest2484786-21tr09:55:220
2426560993610,22cyclictest0-21swapper/011:45:180
242657299359,23cyclictest2473814-21/usr/sbin/munin09:25:273
242657299353,28cyclictest2442677-21/usr/sbin/munin07:55:133
242657299351,9cyclictest2462103-21meminfo08:50:203
242657299351,8cyclictest2496753-21irqstats10:30:183
242657299351,4cyclictest2463923-21ntp_states08:55:313
242657299351,3cyclictest0-21swapper/309:05:113
242657299351,3cyclictest0-21swapper/307:10:143
2426568993525,7cyclictest2504250-21unixbench_multi10:50:272
2426568993525,6cyclictest2535658-21grep12:20:242
242656099352,8cyclictest2454592-21grep08:30:010
242656099352,8cyclictest2438265-21find07:40:240
242656099351,8cyclictest2446729-21wc08:05:220
242656099351,8cyclictest2441137-21sort07:50:180
242656099351,7cyclictest2527428-21/usr/sbin/munin12:00:180
242656099351,7cyclictest2457523-21sed08:35:260
242656099351,4cyclictest2439514-21/usr/sbin/munin07:45:180
242656099351,11cyclictest2435975-21diskstats07:35:170
242657299348,23cyclictest2498647-21/usr/sbin/munin10:35:213
242657299341,9cyclictest2441423-21meminfo07:50:233
242657299341,3cyclictest0-21swapper/307:30:173
2426568993427,4cyclictest0-21swapper/210:20:262
2426565993426,4cyclictest0-21swapper/109:40:161
242656099341,4cyclictest2482767-21grep09:50:170
242656099341,11cyclictest2430858-21df07:20:180
2426568993325,4cyclictest0-21swapper/210:25:252
2426568993325,4cyclictest0-21swapper/208:15:282
2426568993323,7cyclictest2520055-21sh11:40:002
2426568993323,6cyclictest2466145-21grep09:00:282
2426565993325,4cyclictest0-21swapper/111:00:011
2426565993322,7cyclictest2441962-21grep07:50:281
2426568993224,4cyclictest0-21swapper/209:40:162
2426568993222,6cyclictest2453943-21grep08:25:252
2426568993222,6cyclictest2438640-21grep07:40:282
2426565993224,4cyclictest0-21swapper/110:25:261
2426565993221,6cyclictest0-21swapper/112:10:011
2426568993123,4cyclictest0-21swapper/211:40:242
2426568993122,5cyclictest0-21swapper/212:30:262
2426568993119,8cyclictest2427784-21grep07:10:272
2426565993124,3cyclictest0-21swapper/107:20:291
2426565993119,8cyclictest231ktimers/112:20:101
2426568993022,5cyclictest0-21swapper/210:15:292
242656899301,6cyclictest131rcu_preempt08:00:132
2426565993022,4cyclictest0-21swapper/110:09:201
2426565993019,6cyclictest0-21swapper/108:05:161
242656899293,5cyclictest131rcu_preempt08:35:132
2426568992923,3cyclictest0-21swapper/207:20:282
2426568992922,3cyclictest0-21swapper/209:50:282
2426568992919,6cyclictest0-21swapper/211:25:252
2426568992919,6cyclictest0-21swapper/209:50:002
2426568992918,8cyclictest2464849-21basename09:00:002
2426565992923,4cyclictest2463574-21fschecks_time08:55:191
2426565992920,7cyclictest2501165-21kworker/u8:1+events_unbound11:34:351
2426565992920,7cyclictest2501165-21kworker/u8:1+events_unbound11:34:351
2426565992919,6cyclictest0-21swapper/107:45:281
2426565992917,9cyclictest2450968-21sh08:20:011
2426568992820,6cyclictest311ktimers/211:30:122
2426568992820,6cyclictest311ktimers/211:30:112
2426568992820,5cyclictest2523392-21kworker/u8:2+events_unbound11:59:162
2426568992820,4cyclictest0-21swapper/210:00:012
2426568992820,4cyclictest0-21swapper/209:10:152
2426565992822,3cyclictest0-21swapper/111:05:011
2426565992821,4cyclictest2485938-21apt-key10:00:011
2426565992820,4cyclictest0-21swapper/111:20:171
2426565992820,4cyclictest0-21swapper/109:05:001
2426565992819,6cyclictest0-21swapper/111:10:001
2426565992818,6cyclictest2538210-21fschecks_time12:30:171
2426565992813,11cyclictest231ktimers/110:10:141
2426568992719,4cyclictest0-21swapper/211:05:152
2426568992719,4cyclictest0-21swapper/207:35:272
2426568992717,5cyclictest0-21swapper/207:28:532
2426568992716,6cyclictest2505321-21ls10:55:192
2426568992715,8cyclictest2473149-21grep09:20:252
2426565992720,4cyclictest2458031-21idleruntime-cro08:40:001
2426565992720,3cyclictest0-21swapper/110:05:011
2426565992720,3cyclictest0-21swapper/110:05:011
2426568992620,3cyclictest0-21swapper/212:40:002
2426568992620,3cyclictest0-21swapper/212:05:272
2426568992618,4cyclictest0-21swapper/212:00:182
2426568992614,8cyclictest1-21systemd08:34:012
2426565992619,4cyclictest0-21swapper/112:15:171
2426565992619,3cyclictest0-21swapper/109:30:271
2426565992618,4cyclictest0-21swapper/109:25:001
2426565992617,6cyclictest0-21swapper/110:20:001
2426565992616,6cyclictest0-21swapper/109:45:121
2426565992616,6cyclictest0-21swapper/108:00:251
2426568992519,4cyclictest2467971-21unixbench_multi09:05:262
2426568992519,3cyclictest0-21swapper/212:25:162
2426568992518,4cyclictest2534135-21sh12:20:002
2426568992517,5cyclictest0-21swapper/211:50:272
2426568992515,7cyclictest2497459-21grep10:30:262
2426565992519,3cyclictest0-21swapper/110:25:011
2426565992518,4cyclictest0-21swapper/109:35:261
2426565992517,4cyclictest0-21swapper/108:25:161
2426565992517,4cyclictest0-21swapper/108:10:171
2426565992515,6cyclictest0-21swapper/107:30:281
2426568992417,4cyclictest0-21swapper/210:00:252
2426568992417,4cyclictest0-21swapper/210:00:252
2426568992416,4cyclictest0-21swapper/210:49:272
2426568992416,4cyclictest0-21swapper/207:33:542
2426568992415,6cyclictest2508148-21grep11:05:002
2426568992415,6cyclictest2490353-21cat10:10:282
2426568992414,5cyclictest2500328-21sort10:40:222
2426565992417,4cyclictest2526896-21sendmail12:00:001
2426565992417,3cyclictest0-21swapper/111:35:241
2426565992416,5cyclictest0-21swapper/110:40:181
2426568992317,3cyclictest0-21swapper/207:50:182
2426568992315,5cyclictest311ktimers/209:30:242
2426568992314,5cyclictest2451714-21sort08:20:202
2426565992318,3cyclictest2430235-21sh07:17:011
2426565992316,4cyclictest0-21swapper/111:50:271
2426565992315,5cyclictest2523392-21kworker/u8:2+events_unbound12:00:151
2426568992216,3cyclictest0-21swapper/211:15:222
2426568992216,3cyclictest0-21swapper/209:30:012
2426568992216,3cyclictest0-21swapper/208:55:002
2426568992215,5cyclictest2530942-21kworker/u8:0+events_unbound12:14:422
2426568992215,4cyclictest2429209-21fschecks_time07:15:172
2426565992217,3cyclictest2532605-21latency_hist12:15:011
2426565992216,3cyclictest0-21swapper/110:35:271
2426565992216,3cyclictest0-21swapper/109:10:011
2426565992216,3cyclictest0-21swapper/108:40:191
2426565992216,3cyclictest0-21swapper/107:40:001
2426565992215,4cyclictest2428307-21latency_hist07:15:011
2426565992213,6cyclictest0-21swapper/110:50:221
2426565992212,6cyclictest0-21swapper/107:30:001
2426568992113,4cyclictest0-21swapper/211:45:212
2426568992112,6cyclictest2477820-21sort09:35:182
2426568992112,5cyclictest0-21swapper/211:10:232
2426565992116,3cyclictest0-21swapper/111:40:241
2426565992115,3cyclictest2460171-21fschecks_time08:45:201
2426565992115,3cyclictest0-21swapper/109:25:161
2426565992115,3cyclictest0-21swapper/109:10:161
2426565992115,3cyclictest0-21swapper/108:35:001
242656599211,17cyclictest2461906-21basename08:50:171
2426568992013,4cyclictest2471875-21sendmail09:20:002
2426568992013,4cyclictest2471875-21sendmail09:20:002
2426568992013,4cyclictest2447795-21/usr/sbin/munin08:10:172
2426568992010,7cyclictest2439991-21grep07:45:252
2426565992014,3cyclictest2510053-21/usr/sbin/munin11:10:121
2426565992014,3cyclictest0-21swapper/110:45:171
2426565992014,3cyclictest0-21swapper/109:20:001
2426565992014,3cyclictest0-21swapper/109:20:001
2426565992013,5cyclictest231ktimers/112:25:101
2426565991913,3cyclictest231ktimers/111:28:311
242656599191,15cyclictest2438202-21wc07:40:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional