You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 00:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Wed Jun 10, 2026 12:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2715225996246,12cyclictest121ktimers/011:25:120
2715237995442,9cyclictest391ktimers/310:00:133
2715237995241,7cyclictest2808298-21grep11:35:253
2715237995139,9cyclictest391ktimers/307:55:123
2715229995141,5cyclictest2814066-21munin-plugin-st11:55:001
2715233994527,10cyclictest311ktimers/210:45:122
2715233994434,7cyclictest2736670-21apt-get08:10:122
2715233994433,7cyclictest2721114-21apt-get07:25:132
2715237994332,8cyclictest391ktimers/310:35:123
2715233994333,6cyclictest2801900-21auditctl11:20:002
2715233994333,6cyclictest2759015-21fschecks_count09:15:162
2715229994335,5cyclictest2768868-21cron09:45:001
2715233994231,8cyclictest2732605-21grep07:55:262
2715229994232,6cyclictest2775498-21unixbench_singl10:00:251
2715233994135,3cyclictest2757150-21apt-get09:10:122
2715233994128,8cyclictest0-21swapper/210:15:002
2715225994134,5cyclictest27245122sleep007:35:110
2715233994034,3cyclictest2772718-21apt-get09:55:112
2715233994032,4cyclictest2805332-21idleruntime-cro11:30:012
2715233994027,10cyclictest2752021-21munin-node08:55:102
2715233994026,9cyclictest2715661-21/usr/sbin/munin07:10:152
2715233994024,11cyclictest2724634-21/usr/sbin/munin07:35:142
2715233994022,6cyclictest2795348-21perl11:00:152
2715225994031,6cyclictest2825989-21grep12:25:220
2715225994031,6cyclictest2825989-21grep12:25:220
2715225994031,6cyclictest2808301-21unixbench_singl11:35:260
2715233993934,3cyclictest2823250-21apt-get12:20:112
2715233993933,3cyclictest2826652-21apt-get12:30:112
2715233993933,3cyclictest2746918-21apt-get08:40:122
2715233993932,4cyclictest2760574-21apt-get09:20:102
2715233993931,5cyclictest2755445-21apt-get09:05:132
2715233993930,6cyclictest2792267-21ntp_states10:50:222
2715233993926,10cyclictest2726494-21/usr/sbin/munin07:40:152
2715233993924,3cyclictest2807702-21meminfo11:35:182
2715233993921,13cyclictest2788619-21/usr/sbin/munin10:40:162
2715233993921,13cyclictest2788619-21/usr/sbin/munin10:40:162
2715233993921,13cyclictest2763743-21cron09:30:002
2715233993919,14cyclictest2780236-21wc10:15:172
271522599394,4cyclictest131rcu_preempt10:55:110
2715225993927,7cyclictest2751350-21grep08:50:230
2715237993824,10cyclictest391ktimers/310:10:093
2715233993832,3cyclictest2812586-21apt-get11:50:132
2715233993832,3cyclictest2802152-21apt-get11:20:122
2715233993831,4cyclictest2793396-21apt-get10:55:132
2715233993831,4cyclictest2753742-21apt-get09:00:122
2715233993831,4cyclictest2748622-21apt-get08:45:132
2715233993828,7cyclictest2751014-21/usr/sbin/munin08:50:212
2715233993827,9cyclictest2816218-21apt-get12:00:112
2715233993827,7cyclictest2764161-21/usr/sbin/munin09:30:142
2715233993826,7cyclictest2738491-21/usr/sbin/munin08:15:162
2715233993826,7cyclictest2738491-21/usr/sbin/munin08:15:152
2715233993824,10cyclictest2776801-21memory10:05:212
2715233993822,9cyclictest2771014-21/usr/sbin/munin09:50:142
2715233993819,15cyclictest2784649-21latency_hist10:30:002
2715237993731,4cyclictest2821098-21munin-plugin-st12:15:013
2715233993731,3cyclictest2729636-21apt-get07:50:132
2715233993729,4cyclictest2743498-21apt-get08:30:112
2715233993727,7cyclictest2740941-21/usr/sbin/munin08:20:262
2715233993726,8cyclictest2784873-21munin-node10:30:112
2715233993726,8cyclictest2735488-21/usr/sbin/munin08:05:202
2715233993726,7cyclictest2814616-21df_inode11:55:162
2715233993725,9cyclictest2826042-21sshd12:25:342
2715233993725,9cyclictest2826042-21sshd12:25:332
2715233993725,7cyclictest2766214-21/usr/sbin/munin09:35:192
2715233993723,11cyclictest2797259-21/usr/sbin/munin11:05:172
2715233993723,11cyclictest2723264-21/usr/sbin/munin07:30:202
2715233993722,12cyclictest2821645-21/usr/sbin/munin12:15:142
2715233993720,9cyclictest2781613-21cut10:20:142
2715233993720,13cyclictest2818458-21tr12:05:222
2715233993719,13cyclictest2729405-21apt07:50:002
2715233993713,5cyclictest0-21swapper/208:00:162
271522599372,4cyclictest131rcu_preempt09:55:120
271522599371,5cyclictest131rcu_preempt12:30:120
2715237993624,8cyclictest0-21swapper/307:40:003
2715233993631,2cyclictest2805554-21apt-get11:30:122
2715233993630,3cyclictest2810888-21apt-get11:45:122
2715233993630,3cyclictest2774440-21apt-get10:00:142
2715233993626,7cyclictest2828354-21/usr/sbin/munin12:35:112
2715233993626,7cyclictest2809706-21/usr/sbin/munin11:40:202
2715233993626,7cyclictest2786575-21/usr/sbin/munin10:35:122
2715233993626,7cyclictest2745464-21/usr/sbin/munin08:35:182
2715233993626,7cyclictest2719503-21/usr/sbin/munin07:20:132
2715233993625,9cyclictest2770161-21/usr/sbin/munin09:45:232
2715233993625,7cyclictest2741799-21/usr/sbin/munin08:25:112
2715233993622,10cyclictest2819617-21munin-node12:10:102
2715233993621,9cyclictest2767564-21cut09:40:162
2715233993618,14cyclictest2717620-21cut07:15:052
2715229993628,4cyclictest0-21swapper/111:15:001
2715225993628,5cyclictest0-21swapper/012:20:000
271522599361,5cyclictest131rcu_preempt11:45:120
2715233993529,3cyclictest2798726-21apt-get11:10:112
271522599354,4cyclictest131rcu_preempt11:40:140
271522599353,5cyclictest131rcu_preempt11:00:110
2715225993528,3cyclictest0-21swapper/008:00:160
271522599350,5cyclictest131rcu_preempt08:45:120
2715237993426,4cyclictest0-21swapper/310:40:153
2715237993426,4cyclictest0-21swapper/310:40:153
2715237993425,5cyclictest2719171-21sendmail07:20:023
2715237993423,7cyclictest0-21swapper/307:35:003
2715237993422,9cyclictest391ktimers/312:20:103
271522999347,9cyclictest2769514-21grep09:45:161
2715229993425,6cyclictest2810663-21idleruntime-cro11:45:001
2715229993425,6cyclictest0-21swapper/112:30:001
2715229993425,6cyclictest0-21swapper/112:30:001
2715225993423,8cyclictest2816372-21tune2fs12:00:140
2715225993423,7cyclictest2820669-21grep12:10:260
271523799332,5cyclictest131rcu_preempt09:00:123
2715237993325,4cyclictest0-21swapper/311:10:233
271523799331,4cyclictest131rcu_preempt09:40:113
2715229993323,7cyclictest2779521-21auditctl10:15:011
2715229993322,7cyclictest0-21swapper/112:24:361
2715229993321,9cyclictest2753499-21sendmail09:00:011
271522599330,4cyclictest131rcu_preempt07:15:110
2715229993224,4cyclictest0-21swapper/111:55:271
2715229993224,4cyclictest0-21swapper/107:45:261
2715229993223,6cyclictest0-21swapper/108:35:261
2715225993224,5cyclictest0-21swapper/009:40:000
271522599321,4cyclictest131rcu_preempt11:50:120
2715237993123,4cyclictest0-21swapper/311:25:263
2715237993119,7cyclictest0-21swapper/308:50:233
271522999319,6cyclictest24-21ksoftirqd/110:40:131
271522999319,6cyclictest24-21ksoftirqd/110:40:131
2715229993123,5cyclictest0-21swapper/108:50:001
2715229993123,4cyclictest0-21swapper/110:00:001
2715229993120,7cyclictest2757147-21munin-node09:10:101
2715229993120,7cyclictest2720137-21/usr/sbin/munin07:20:241
2715229993119,8cyclictest2715828-21/usr/sbin/munin07:10:181
2715229993117,11cyclictest2776340-21apt-get10:05:051
2715229993111,16cyclictest2819381-21cron12:10:001
2715225993123,5cyclictest2764980-21grep09:30:240
271522599310,4cyclictest131rcu_preempt11:30:110
2715237993023,4cyclictest0-21swapper/309:05:263
2715237993021,6cyclictest0-21swapper/308:15:273
2715237993021,6cyclictest0-21swapper/308:15:263
2715229993022,4cyclictest0-21swapper/111:20:151
2715229993020,7cyclictest2796914-21/usr/sbin/munin11:05:141
2715229993020,7cyclictest2785507-21/usr/sbin/munin10:30:231
2715229993020,7cyclictest2754764-21/usr/sbin/munin09:00:241
2715229993020,7cyclictest2747828-21/usr/sbin/munin08:40:231
2715229993020,6cyclictest2744544-21unixbench_singl08:30:231
2715229993019,8cyclictest0-21swapper/108:05:141
2715229993019,7cyclictest2760665-21/usr/sbin/munin09:20:141
2715229993019,7cyclictest2722203-21sshd07:25:341
2715229993019,6cyclictest0-21swapper/108:20:001
2715229993019,6cyclictest0-21swapper/108:20:001
2715225993024,3cyclictest0-21swapper/008:20:000
2715225993024,3cyclictest0-21swapper/008:20:000
2715225993023,4cyclictest0-21swapper/007:25:250
2715237992922,4cyclictest0-21swapper/310:05:263
2715237992922,4cyclictest0-21swapper/308:55:243
2715237992922,4cyclictest0-21swapper/308:40:243
2715237992921,4cyclictest0-21swapper/312:30:263
2715237992920,7cyclictest2809178-21kworker/u8:2+events_unbound11:44:293
271522999299,16cyclictest2782552-21taskset10:20:251
271522999298,6cyclictest24-21ksoftirqd/108:00:171
2715229992923,3cyclictest2805554-21apt-get11:30:121
2715229992921,4cyclictest0-21swapper/109:50:161
2715229992918,8cyclictest2827940-21cron12:32:591
2715229992918,8cyclictest2791928-21/usr/sbin/munin10:50:151
2715229992918,7cyclictest2756167-21/usr/sbin/munin09:05:241
2715229992917,9cyclictest2790748-21/usr/sbin/munin10:45:251
2715229992917,9cyclictest2730711-21/usr/sbin/munin07:50:241
2715229992914,7cyclictest131rcu_preempt11:17:091
2715229992912,13cyclictest2804838-21grep11:25:261
2715225992923,3cyclictest0-21swapper/010:00:240
2715225992921,5cyclictest0-21swapper/009:40:240
271522599291,3cyclictest0-21swapper/008:40:110
271523799288,3cyclictest131rcu_preempt08:05:253
271523799284,4cyclictest131rcu_preempt08:40:023
2715237992822,3cyclictest0-21swapper/311:10:003
2715237992821,5cyclictest2714893-21kworker/u8:1+events_unbound07:13:333
2715237992820,4cyclictest0-21swapper/311:00:243
2715229992821,4cyclictest0-21swapper/108:55:011
2715229992820,5cyclictest0-21swapper/111:00:251
2715229992819,6cyclictest2758854-21apt-get09:15:131
2715229992818,7cyclictest2794686-21cron10:58:001
2715229992818,7cyclictest2763407-21cron09:26:001
2715229992818,7cyclictest0-21swapper/111:40:011
2715229992817,8cyclictest53-21kcompactd007:33:291
2715229992817,8cyclictest2766055-21/usr/sbin/munin09:35:161
2715229992816,9cyclictest2811726-21/usr/sbin/munin11:45:251
2715229992816,9cyclictest2742522-21/usr/sbin/munin08:25:241
2715229992816,9cyclictest2740256-21/usr/sbin/munin08:20:161
2715229992816,9cyclictest2726287-21/usr/sbin/munin07:40:131
2715229992813,12cyclictest2819724-21/usr/sbin/munin12:10:131
2715225992822,3cyclictest0-21swapper/010:25:010
2715225992822,3cyclictest0-21swapper/008:25:250
2715225992822,3cyclictest0-21swapper/007:20:260
2715225992820,4cyclictest0-21swapper/010:09:080
2715225992819,6cyclictest0-21swapper/008:00:000
271523799272,4cyclictest131rcu_preempt11:15:123
2715237992721,4cyclictest391ktimers/307:43:443
2715237992720,5cyclictest2724256-21kworker/u8:2+events_unbound08:00:423
2715237992720,3cyclictest0-21swapper/309:35:013
2715237992720,3cyclictest0-21swapper/307:55:023
2715237992719,4cyclictest0-21swapper/312:15:243
2715237992718,7cyclictest2763385-21kworker/u8:3+events_unbound09:27:343
2715237992718,5cyclictest2815130-21grep11:55:233
2715229992721,3cyclictest2821528-21apt-get12:15:091
2715229992718,6cyclictest2718219-21/usr/sbin/munin07:15:181
2715229992717,7cyclictest2783514-21irqstats10:25:151
2715229992717,7cyclictest2737794-21cron08:11:001
2715229992716,8cyclictest2725723-21cron07:37:011
2715229992716,6cyclictest2786627-21grep10:35:141
271522999270,17cyclictest0-21swapper/110:15:211
271522599275,4cyclictest131rcu_preempt09:20:100
2715225992723,2cyclictest13550irq/42-30be0000.ethernet08:55:150
2715225992721,3cyclictest13550irq/42-30be0000.ethernet08:35:020
2715225992719,4cyclictest0-21swapper/011:19:230
2715225992719,4cyclictest0-21swapper/008:10:250
2715225992717,6cyclictest2741709-21latency_hist08:25:000
2715237992619,5cyclictest2729045-21kworker/u8:1+events_unbound07:48:403
2715237992619,4cyclictest0-21swapper/310:50:263
2715237992619,4cyclictest0-21swapper/309:45:243
2715237992618,5cyclictest0-21swapper/311:50:153
271523799261,4cyclictest131rcu_preempt09:10:113
2715229992616,7cyclictest2829441-21sshd12:35:331
2715229992610,12cyclictest2732072-21grep07:55:191
2715225992620,4cyclictest2766916-21kworker/u8:0+events_unbound09:49:040
2715225992619,5cyclictest2749723-21kworker/u8:0+events_unbound09:10:100
2715225992617,6cyclictest2760369-21grep09:20:000
271523799254,5cyclictest131rcu_preempt08:30:113
2715237992519,4cyclictest2781149-21kworker/u8:3+events_unbound10:20:183
2715237992518,4cyclictest0-21swapper/308:30:003
2715237992517,4cyclictest0-21swapper/307:20:263
2715229992515,7cyclictest2816325-21df12:00:141
2715229992514,7cyclictest2764117-21fschecks_count09:30:141
2715225992519,4cyclictest2756437-21unixbench_multi09:05:250
2715225992517,4cyclictest0-21swapper/009:05:010
271522599251,20cyclictest0-21swapper/012:38:130
271522599251,20cyclictest0-21swapper/012:22:520
271522599251,20cyclictest0-21swapper/007:32:060
2715237992418,4cyclictest2766916-21kworker/u8:0+events_unbound09:59:083
2715237992418,3cyclictest0-21swapper/311:45:263
2715237992418,3cyclictest0-21swapper/309:15:153
2715237992415,6cyclictest2825842-21cat12:25:223
2715237992415,6cyclictest2825842-21cat12:25:223
271523799241,3cyclictest131rcu_preempt12:00:103
271523799241,3cyclictest131rcu_preempt08:10:233
271522599249,6cyclictest2815667-21kworker/u8:2+events_unbound12:06:430
2715225992418,3cyclictest0-21swapper/010:15:220
2715225992416,5cyclictest2771100-21ls09:50:130
271522599241,4cyclictest131rcu_preempt07:45:130
271522599241,19cyclictest0-21swapper/010:47:580
271522599240,22cyclictest0-21swapper/007:54:030
2715237992317,3cyclictest0-21swapper/310:45:173
2715237992316,4cyclictest391ktimers/310:26:043
2715237992315,4cyclictest0-21swapper/308:45:253
271523799231,3cyclictest131rcu_preempt09:55:003
2715225992318,2cyclictest0-21swapper/010:55:000
2715225992317,4cyclictest13850irq/36-mmc108:40:020
2715225992317,4cyclictest0-21swapper/008:05:250
2715225992317,3cyclictest0-21swapper/007:10:230
271522599231,6cyclictest2815965-21cron12:00:000
2715225992316,5cyclictest2781149-21kworker/u8:3+events_unbound10:35:120
271522599231,20cyclictest0-21swapper/010:26:520
271522599230,19cyclictest0-21swapper/011:24:520
271523799225,3cyclictest131rcu_preempt08:20:173
271523799221,5cyclictest2781239-21awk10:20:003
2715237992215,4cyclictest0-21swapper/312:05:283
2715237992213,5cyclictest0-21swapper/310:55:153
271522599222,5cyclictest2779514-21cron10:15:000
2715225992215,3cyclictest0-21swapper/011:07:380
271522599220,2cyclictest0-21swapper/009:25:140
2715237992115,3cyclictest0-21swapper/310:30:153
2715237992114,4cyclictest2802334-21fschecks_time11:20:153
2715237992114,4cyclictest0-21swapper/307:25:253
271523799210,10cyclictest0-21swapper/311:31:443
2715225992116,3cyclictest13850irq/36-mmc111:10:130
2715225992113,5cyclictest151rcuc/010:40:130
2715225992113,5cyclictest151rcuc/010:40:120
271522599211,17cyclictest2726699-21cat07:40:200
2715237992010,7cyclictest2761026-21/usr/sbin/munin09:20:193
271523799200,6cyclictest2766209-21tr09:35:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional