You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-30 - 19:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Sat May 30, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2789546995546,5cyclictest2862095-21unixbench_multi10:35:271
2789542995243,5cyclictest2903903-21cron12:40:000
2789546995041,6cyclictest208-21systemd-logind07:15:111
2789546994817,10cyclictest2804992-21sed07:50:271
2789554994536,6cyclictest2800324-21sendmail07:40:013
2789546994435,4cyclictest2893685-21munin-run12:10:011
2789546994326,12cyclictest2839157-21/usr/sbin/munin09:30:201
2789542994335,5cyclictest2810504-21grep08:05:270
2789554994226,12cyclictest391ktimers/311:05:143
2789550994234,5cyclictest2898794-21cron12:25:002
2789550994135,4cyclictest2862251-21kworker/u8:1+events_unbound10:51:022
2789546994132,5cyclictest2814620-21apt-get08:20:121
2789546994130,7cyclictest2841410-21grep09:35:261
2789546994129,9cyclictest2807799-21apt-get08:00:131
2789546994121,16cyclictest2871521-21apt-get11:05:051
2789554994030,6cyclictest2876416-21idleruntime-cro11:20:003
2789550994030,6cyclictest0-21swapper/210:40:002
2789546994029,6cyclictest2809502-21apt-get08:05:141
2789546994028,9cyclictest2868879-21/usr/sbin/munin10:55:261
2789546994027,9cyclictest2836002-21/usr/sbin/munin09:20:251
2789546994026,11cyclictest2879653-21cron11:28:011
2789546994022,3cyclictest2842690-21ntp_states09:40:211
2789542994029,8cyclictest2808848-21grep08:00:260
2789554993930,5cyclictest2829915-21apt-key09:05:013
2789554993930,5cyclictest2829915-21apt-key09:05:013
2789550993932,4cyclictest2873008-21idleruntime-cro11:10:002
2789550993931,4cyclictest0-21swapper/208:40:002
2789550993928,8cyclictest311ktimers/209:00:112
2789550993928,8cyclictest311ktimers/209:00:112
2789546993931,4cyclictest0-21swapper/111:30:181
2789546993929,6cyclictest2833587-21apt-get09:15:141
2789546993927,9cyclictest2831883-21apt-get09:10:141
2789546993927,8cyclictest2818702-21/usr/sbin/munin08:30:231
2789546993926,10cyclictest2864941-21/usr/sbin/munin10:45:171
2789546993924,11cyclictest2837134-21/usr/sbin/munin09:25:151
2789542993929,6cyclictest0-21swapper/009:00:010
2789542993929,6cyclictest0-21swapper/009:00:000
2789554993828,6cyclictest0-21swapper/312:35:003
2789550993828,6cyclictest0-21swapper/209:55:002
2789550993812,6cyclictest32-21ksoftirqd/211:30:002
2789546993828,6cyclictest2797130-21apt-get07:30:131
2789546993827,8cyclictest2902997-21/usr/sbin/munin12:35:201
2789546993827,8cyclictest2812191-21grep08:10:261
2789546993827,7cyclictest2844153-21/usr/sbin/munin09:45:161
2789546993827,7cyclictest2830871-21/usr/sbin/munin09:05:231
2789546993826,9cyclictest2895206-21cron12:13:011
2789546993826,7cyclictest2901481-21/usr/sbin/munin12:30:231
2789546993825,10cyclictest2821889-21memory08:40:181
2789554993726,7cyclictest2821213-21sendmail08:40:003
2789554993725,7cyclictest0-21swapper/308:25:243
2789550993727,6cyclictest0-21swapper/210:40:242
2789550993726,6cyclictest0-21swapper/210:30:232
2789550993725,7cyclictest0-21swapper/211:35:162
2789546993730,4cyclictest2850861-21apt-get10:05:141
2789546993730,3cyclictest2798832-21apt-get07:35:121
2789546993729,4cyclictest2869621-21apt-get11:00:131
2789546993729,4cyclictest2869621-21apt-get11:00:121
2789546993728,6cyclictest2899036-21apt-get12:25:131
2789546993727,7cyclictest2896365-21/usr/sbin/munin12:15:221
2789546993727,7cyclictest2891577-21/usr/sbin/munin12:00:251
2789546993727,7cyclictest2874934-21apt-get11:15:111
2789546993727,7cyclictest2794863-21cron07:21:011
2789546993726,8cyclictest2888813-21/usr/sbin/munin11:55:151
2789546993726,8cyclictest2888813-21/usr/sbin/munin11:55:151
2789546993726,8cyclictest2856823-21/usr/sbin/munin10:20:271
2789546993726,8cyclictest2847551-21/usr/sbin/munin09:55:141
2789546993726,7cyclictest2883237-21idleruntime-cro11:40:001
2789546993725,9cyclictest2826056-21cron08:52:001
2789546993725,9cyclictest2819723-21apt-get08:35:131
2789546993725,8cyclictest2874140-21/usr/sbin/munin11:10:241
2789546993724,9cyclictest2887411-21/usr/sbin/munin11:50:221
2789546993724,9cyclictest2887411-21/usr/sbin/munin11:50:211
2789546993724,8cyclictest2852999-21/usr/sbin/munin10:10:211
2789546993724,7cyclictest2845740-21apt-get09:50:131
2789542993729,5cyclictest2883221-21cron11:40:010
2789542993724,10cyclictest438-21cron08:30:000
2789550993627,6cyclictest0-21swapper/210:45:152
2789550993625,7cyclictest0-21swapper/207:10:272
2789550993624,7cyclictest0-21swapper/212:05:242
2789546993630,3cyclictest2883477-21apt-get11:40:121
2789546993629,4cyclictest2789713-21apt-get07:10:141
2789546993628,5cyclictest2816321-21apt-get08:25:131
2789546993628,5cyclictest2795432-21apt-get07:25:131
2789546993628,4cyclictest0-21swapper/107:55:161
2789546993627,6cyclictest2885178-21apt-get11:45:111
2789546993627,5cyclictest2876657-21apt-get11:20:111
2789546993626,7cyclictest2860009-21/usr/sbin/munin10:30:211
2789546993626,7cyclictest2829640-21cron09:04:001
2789546993626,7cyclictest2829640-21cron09:04:001
2789546993624,9cyclictest2867496-21cron10:53:001
278954299366,5cyclictest131rcu_preempt11:05:150
2789542993629,4cyclictest0-21swapper/011:45:130
2789542993627,5cyclictest2796449-21grep07:25:260
2789554993527,4cyclictest0-21swapper/311:30:003
2789554993527,4cyclictest0-21swapper/307:25:133
2789554993524,7cyclictest2867247-21grep10:50:263
2789550993527,4cyclictest0-21swapper/212:00:002
2789550993527,4cyclictest0-21swapper/211:59:592
2789550993527,4cyclictest0-21swapper/208:10:372
2789550993525,6cyclictest0-21swapper/212:00:262
2789550993525,6cyclictest0-21swapper/211:01:032
2789550993525,6cyclictest0-21swapper/211:01:032
2789550993524,7cyclictest0-21swapper/208:55:012
2789546993526,6cyclictest2826544-21apt-get08:55:131
2789546993526,6cyclictest2826544-21apt-get08:55:121
2789546993524,8cyclictest2897782-21memory12:20:191
2789546993523,8cyclictest2863018-21fschecks_time10:40:151
2789546993521,11cyclictest2800600-21/usr/sbin/munin07:40:121
2789546993521,10cyclictest2803150-21/usr/sbin/munin07:45:241
2789542993528,4cyclictest2791182-21munin-plugin-st07:15:010
2789554993424,6cyclictest0-21swapper/310:25:253
2789550993427,3cyclictest0-21swapper/209:20:012
2789550993426,5cyclictest0-21swapper/209:00:002
2789550993426,5cyclictest0-21swapper/209:00:002
2789550993423,7cyclictest2903452-21grep12:35:252
2789550993423,6cyclictest0-21swapper/210:00:252
2789550993421,9cyclictest311ktimers/208:45:142
2789546993428,3cyclictest2849158-21apt-get10:00:101
2789546993422,9cyclictest0-21swapper/108:15:121
2789546993420,11cyclictest2854309-21/usr/sbin/munin10:15:141
2789542993426,5cyclictest2863791-21grep10:40:250
2789542993417,14cyclictest11-21ksoftirqd/012:05:110
2789554993324,6cyclictest2825055-21fschecks_time08:50:173
2789554993324,5cyclictest0-21swapper/311:50:263
2789554993324,5cyclictest0-21swapper/311:50:263
2789554993324,4cyclictest2828012-21sh09:00:003
2789554993324,4cyclictest2828012-21sh09:00:003
2789550993325,5cyclictest0-21swapper/211:40:182
2789550993324,6cyclictest0-21swapper/208:00:022
2789546993323,8cyclictest2857791-21df_inode10:25:141
2789546993316,13cyclictest2824187-21head08:45:251
2789542993323,7cyclictest0-21swapper/012:30:240
2789554993225,4cyclictest2898814-21munin-plugin-st12:25:013
2789554993224,5cyclictest0-21swapper/308:05:013
2789554993224,4cyclictest0-21swapper/310:55:263
2789550993225,3cyclictest0-21swapper/207:50:002
2789550993224,4cyclictest2852330-21latency_hist10:10:012
2789550993222,6cyclictest0-21swapper/212:15:242
278954299327,6cyclictest131rcu_preempt09:25:130
2789554993124,3cyclictest0-21swapper/310:20:013
2789554993123,4cyclictest0-21swapper/311:30:253
2789554993121,6cyclictest0-21swapper/309:30:263
2789554993117,10cyclictest391ktimers/309:45:133
278955099316,22cyclictest311ktimers/207:26:522
278955099313,16cyclictest311ktimers/209:57:492
2789550993124,4cyclictest0-21swapper/209:25:252
2789550993123,4cyclictest0-21swapper/209:45:262
2789550993123,4cyclictest0-21swapper/208:35:002
2789550993121,6cyclictest0-21swapper/211:20:252
2789550993121,6cyclictest0-21swapper/209:40:012
2789550993119,4cyclictest131rcu_preempt07:36:412
2789550993111,9cyclictest131rcu_preempt08:41:332
2789550993111,6cyclictest32-21ksoftirqd/208:00:202
2789542993124,5cyclictest2805822-21kworker/u8:1+events_unbound08:15:380
2789542993123,5cyclictest2878127-21auditctl11:25:000
2789542993123,4cyclictest0-21swapper/007:20:010
2789542993121,6cyclictest0-21swapper/007:35:200
2789554993023,4cyclictest2871095-21latency_hist11:05:003
2789554993023,4cyclictest2871095-21latency_hist11:05:003
2789554993023,3cyclictest0-21swapper/310:05:163
2789554993022,4cyclictest0-21swapper/311:10:253
2789554993022,4cyclictest0-21swapper/309:40:243
2789554993021,6cyclictest0-21swapper/308:10:273
2789554993021,4cyclictest0-21swapper/310:45:253
2789554993020,6cyclictest0-21swapper/308:30:243
2789554993013,12cyclictest2805822-21kworker/u8:1-events_unbound08:21:263
278955099309,13cyclictest2789535-21cyclictest10:15:342
278955099306,6cyclictest32-21ksoftirqd/212:35:012
278955099305,12cyclictest311ktimers/210:57:482
2789550993021,5cyclictest0-21swapper/209:10:272
2789550993020,6cyclictest0-21swapper/210:20:292
2789542993025,3cyclictest0-21swapper/007:20:120
2789542993024,3cyclictest2824616-21kthreadd08:50:000
2789542993023,4cyclictest0-21swapper/008:50:260
2789542993022,4cyclictest0-21swapper/010:10:160
2789542993021,5cyclictest0-21swapper/009:45:260
2789542993019,7cyclictest2820268-21ntpq08:35:220
278955499295,5cyclictest2790061-21/usr/sbin/munin07:10:203
2789554992922,3cyclictest0-21swapper/310:30:233
2789554992918,7cyclictest0-21swapper/307:40:253
278955099296,20cyclictest311ktimers/210:13:032
278955099296,12cyclictest311ktimers/207:18:112
278955099295,12cyclictest311ktimers/209:33:142
278955099294,22cyclictest311ktimers/207:22:492
278955099294,14cyclictest311ktimers/211:51:062
278955099294,14cyclictest311ktimers/211:51:062
278955099294,14cyclictest311ktimers/209:24:422
2789550992922,4cyclictest2895378-21sh12:15:002
2789550992920,6cyclictest0-21swapper/207:40:232
2789550992919,7cyclictest311ktimers/211:19:092
2789542992924,3cyclictest2824421-21kworker/u8:2+events_unbound09:15:480
2789542992922,5cyclictest2798826-21kworker/u8:3+events_unbound07:40:240
2789542992922,5cyclictest0-21swapper/010:30:230
2789542992922,4cyclictest0-21swapper/009:10:010
2789542992921,4cyclictest2895795-21grep12:15:160
2789542992921,4cyclictest0-21swapper/011:00:000
278954299291,4cyclictest131rcu_preempt10:50:130
278955499288,5cyclictest0-21swapper/311:45:183
278955499284,6cyclictest40-21ksoftirqd/309:28:183
278955499283,6cyclictest0-21swapper/311:35:213
2789554992821,5cyclictest2798826-21kworker/u8:3+events_unbound08:47:403
2789554992820,5cyclictest0-21swapper/309:20:183
2789554992819,6cyclictest2863837-21unixbench_singl10:40:243
2789554992819,3cyclictest0-21swapper/310:00:023
2789554992818,7cyclictest391ktimers/308:15:133
2789554992818,7cyclictest2802675-21fschecks_time07:45:173
2789554992816,7cyclictest204-21dbus-daemon11:56:113
2789554992816,7cyclictest204-21dbus-daemon11:56:103
2789554992814,8cyclictest0-21swapper/312:13:523
2789554992813,8cyclictest2789535-21cyclictest10:00:193
278955499281,20cyclictest0-21swapper/310:39:533
2789554992810,12cyclictest0-21swapper/307:50:203
278955099288,12cyclictest0-21swapper/207:31:452
278955099286,19cyclictest311ktimers/211:11:422
278955099284,6cyclictest32-21ksoftirqd/209:40:242
2789550992819,6cyclictest311ktimers/211:45:202
2789550992818,7cyclictest311ktimers/208:21:222
2789550992817,6cyclictest0-21swapper/208:05:272
2789550992817,4cyclictest131rcu_preempt08:25:392
2789542992821,4cyclictest2862100-21unixbench_multi10:35:260
278955499279,4cyclictest131rcu_preempt07:20:253
278955499276,11cyclictest40-21ksoftirqd/310:21:463
278955499272,18cyclictest0-21swapper/308:44:553
2789554992721,3cyclictest0-21swapper/307:20:013
2789554992717,7cyclictest391ktimers/308:05:243
2789554992717,5cyclictest0-21swapper/307:30:253
2789554992715,7cyclictest131rcu_preempt11:21:203
2789554992714,4cyclictest131rcu_preempt10:11:323
2789554992713,11cyclictest2884957-21basename11:45:003
2789554992711,5cyclictest131rcu_preempt12:01:523
2789554992711,5cyclictest131rcu_preempt09:35:133
2789550992719,5cyclictest0-21swapper/207:50:192
2789550992718,7cyclictest311ktimers/211:30:122
2789550992717,7cyclictest311ktimers/212:28:472
2789550992717,7cyclictest311ktimers/209:05:032
2789550992717,7cyclictest311ktimers/208:18:052
2789542992720,5cyclictest2898689-21kworker/u8:1+events_unbound12:26:140
2789542992720,4cyclictest0-21swapper/007:30:250
2789542992719,4cyclictest2877914-21kworker/u8:3+events_unbound11:30:160
278955499268,4cyclictest131rcu_preempt12:35:193
278955499266,5cyclictest40-21ksoftirqd/309:05:013
2789554992617,6cyclictest0-21swapper/309:50:263
2789554992617,5cyclictest0-21swapper/312:25:213
2789554992611,8cyclictest131rcu_preempt12:18:503
2789554992610,6cyclictest131rcu_preempt09:15:183
2789554992610,13cyclictest2832061-21tune2fs09:10:173
278955099267,16cyclictest311ktimers/210:28:232
2789542992618,4cyclictest0-21swapper/011:25:140
2789542992618,4cyclictest0-21swapper/009:45:010
2789542992617,6cyclictest0-21swapper/009:35:190
2789542992616,6cyclictest0-21swapper/007:45:260
278954299261,5cyclictest131rcu_preempt09:10:130
2789554992510,4cyclictest131rcu_preempt07:55:033
2789542992519,3cyclictest0-21swapper/010:30:000
2789542992517,6cyclictest2850604-21kworker/u8:0+events_unbound10:08:350
2789542992515,6cyclictest0-21swapper/010:00:010
278954299251,3cyclictest2854831-21ntp_states10:15:230
278954299251,11cyclictest2835934-21ps09:20:240
2789542992418,3cyclictest0-21swapper/012:00:170
2789542992416,6cyclictest2815303-21sendmail_mailqu08:20:230
2789542992414,5cyclictest2812668-21cron08:15:020
278954299241,20cyclictest2873803-21ntp_states11:10:210
278954299241,19cyclictest0-21swapper/008:43:010
278954299231,4cyclictest131rcu_preempt09:50:130
2789542992314,6cyclictest2883660-21grep11:40:150
278954299231,3cyclictest2818020-21apt-get08:30:120
278954299231,18cyclictest0-21swapper/012:21:560
278954299231,18cyclictest0-21swapper/009:33:590
278954299230,19cyclictest0-21swapper/012:10:510
278954299230,19cyclictest0-21swapper/009:00:500
278954299230,19cyclictest0-21swapper/009:00:490
278954299221,9cyclictest2875504-21ntp_states11:15:210
2789542992217,3cyclictest13850irq/36-mmc110:20:240
2789542992215,5cyclictest151rcuc/007:55:150
278954299221,17cyclictest0-21swapper/011:01:290
278954299221,17cyclictest0-21swapper/011:01:290
278954299220,18cyclictest0-21swapper/011:52:130
278954299220,18cyclictest0-21swapper/011:52:120
2789542992115,3cyclictest2850214-21grep10:00:240
278954299210,19cyclictest0-21swapper/011:55:350
278954299210,19cyclictest0-21swapper/011:55:340
278954299210,19cyclictest0-21swapper/010:49:390
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional