You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-19 - 18:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Tue May 19, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2875709995831,5cyclictest2962350-21cron11:20:001
2875714995138,9cyclictest311ktimers/212:25:112
2875709994935,11cyclictest231ktimers/112:35:151
2875705994918,9cyclictest131rcu_preempt10:00:120
2875705994842,4cyclictest2886910-21kworker/u8:0+events_unbound07:58:350
2875705994740,5cyclictest2969343-21kworker/u8:0+events_unbound11:44:060
2875705994740,5cyclictest2969343-21kworker/u8:0+events_unbound11:44:060
2875705994438,4cyclictest2875695-21cyclictest07:15:010
2875705994435,5cyclictest2923127-21cron09:25:010
2875714994333,7cyclictest2987723-21grep12:30:262
2875705994336,5cyclictest2954363-21kworker/u8:3+events_unbound12:04:090
2875714994229,9cyclictest311ktimers/212:05:112
2875705994236,4cyclictest2881292-21kworker/u8:3+events_unbound07:48:330
2875718994130,8cyclictest2989846-21apt12:40:003
2875718994129,9cyclictest391ktimers/311:50:113
2875709994134,4cyclictest2877481-21dpkg07:15:011
2875709994131,8cyclictest231ktimers/110:25:121
2875705994133,4cyclictest0-21swapper/011:35:000
2875705994122,10cyclictest131rcu_preempt11:23:020
2875718994030,7cyclictest391ktimers/310:55:143
2875714994025,11cyclictest311ktimers/210:15:132
2875705994035,3cyclictest0-21swapper/009:05:130
2875705994019,13cyclictest645-21runrttasks11:57:310
2875714993932,4cyclictest2953837-21munin-plugin-st10:55:002
2875714993931,4cyclictest0-21swapper/209:20:012
2875709993930,5cyclictest0-21swapper/111:00:001
287570599397,25cyclictest0-21swapper/007:39:290
2875705993933,4cyclictest2812032-21kworker/u8:1+events_unbound07:28:270
2875705993931,5cyclictest2879860-21sendmail07:20:000
2875705993929,7cyclictest2943184-21grep10:20:250
2875705993919,12cyclictest131rcu_preempt11:05:220
2875709993828,6cyclictest0-21swapper/108:15:291
2875705993830,5cyclictest2900525-21sh08:20:000
2875705993829,6cyclictest2905455-21grep08:30:250
2875705993825,9cyclictest121ktimers/011:10:120
2875705993818,12cyclictest131rcu_preempt10:45:220
2875705993812,7cyclictest131rcu_preempt09:55:130
2875705993810,21cyclictest0-21swapper/009:30:010
287571899371,6cyclictest0-21swapper/307:35:133
2875705993731,4cyclictest2912481-21kworker/u8:3+events_unbound09:53:490
2875714993627,5cyclictest0-21swapper/211:44:052
2875714993627,5cyclictest0-21swapper/211:44:052
2875705993628,5cyclictest2927775-21unixbench_multi09:35:250
2875705993626,7cyclictest2898145-21grep08:10:260
2875705993621,10cyclictest121ktimers/010:55:140
287571899356,6cyclictest131rcu_preempt08:20:133
287571899356,6cyclictest131rcu_preempt08:20:133
287571899353,5cyclictest131rcu_preempt09:20:103
2875718993525,6cyclictest0-21swapper/310:50:003
2875718993524,5cyclictest0-21swapper/307:50:003
287571499355,11cyclictest2922237-21ntp_states09:20:202
2875705993526,6cyclictest2957244-21auditctl11:05:000
2875705993526,6cyclictest0-21swapper/009:40:240
2875705993517,11cyclictest131rcu_preempt08:00:170
2875705993515,5cyclictest131rcu_preempt10:20:010
2875718993426,3cyclictest0-21swapper/310:43:563
287571499347,9cyclictest2927602-21cat09:35:242
287571499344,11cyclictest2888398-21latency_hist07:45:012
2875709993426,4cyclictest0-21swapper/109:40:011
2875709993422,8cyclictest2879402-21grep07:15:271
2875705993420,5cyclictest131rcu_preempt10:30:210
2875718993325,5cyclictest2957012-21kworker/u8:2+events_unbound11:03:583
2875718993324,5cyclictest0-21swapper/307:20:263
2875714993326,3cyclictest0-21swapper/211:30:262
2875714993325,4cyclictest0-21swapper/211:05:182
2875714993325,4cyclictest0-21swapper/210:00:252
2875714993324,6cyclictest2896912-21sh08:10:012
2875714993322,7cyclictest2929957-21debian-sa109:45:002
2875714993310,6cyclictest2963584-21/usr/sbin/munin11:20:232
2875709993324,5cyclictest0-21swapper/109:20:011
2875709993324,4cyclictest0-21swapper/110:30:231
2875709993320,10cyclictest231ktimers/108:35:131
2875705993315,4cyclictest131rcu_preempt07:43:030
2875705993315,4cyclictest0-21swapper/012:29:280
2875705993315,11cyclictest131rcu_preempt12:05:120
2875705993314,11cyclictest131rcu_preempt12:15:200
287571899324,4cyclictest131rcu_preempt08:00:123
2875718993225,4cyclictest0-21swapper/307:55:253
2875718993224,6cyclictest2943467-21kworker/u8:1+events_unbound10:53:593
2875718993224,5cyclictest2936357-21unixbench_singl10:00:253
2875718993222,6cyclictest0-21swapper/312:05:003
287571499328,9cyclictest32-21ksoftirqd/210:25:002
287571499328,6cyclictest32-21ksoftirqd/212:15:012
2875714993224,4cyclictest0-21swapper/209:50:152
2875714993221,8cyclictest438-21cron10:10:002
2875714993221,8cyclictest438-21cron10:10:002
2875709993224,4cyclictest0-21swapper/109:50:001
2875709993222,6cyclictest0-21swapper/109:15:011
2875709993220,8cyclictest0-21swapper/111:10:001
287570599327,6cyclictest11-21ksoftirqd/008:30:010
287570599327,6cyclictest11-21ksoftirqd/008:30:010
2875705993224,5cyclictest2907554-21cron08:40:010
2875705993224,4cyclictest0-21swapper/011:40:000
2875705993224,4cyclictest0-21swapper/011:30:000
2875705993224,4cyclictest0-21swapper/008:50:260
2875705993222,6cyclictest0-21swapper/011:50:000
2875705993215,10cyclictest131rcu_preempt09:45:210
2875705993214,3cyclictest0-21swapper/012:24:540
2875705993213,9cyclictest0-21swapper/008:42:370
2875705993213,10cyclictest131rcu_preempt12:30:260
2875705993211,12cyclictest11-21ksoftirqd/012:35:260
2875718993125,4cyclictest2962022-21kworker/u8:1+events_unbound12:05:193
2875718993123,5cyclictest0-21swapper/310:00:003
2875718993120,7cyclictest2961865-21grep11:15:263
287571499315,9cyclictest2902481-21/usr/sbin/munin08:25:162
287571499315,9cyclictest2902481-21/usr/sbin/munin08:25:162
2875714993123,4cyclictest0-21swapper/212:00:012
2875714993123,4cyclictest0-21swapper/210:25:262
2875714993123,4cyclictest0-21swapper/208:50:162
2875714993123,4cyclictest0-21swapper/207:10:252
2875714993110,6cyclictest32-21ksoftirqd/210:35:232
2875714993110,5cyclictest32-21ksoftirqd/211:00:012
2875709993123,4cyclictest0-21swapper/107:50:161
2875709993120,7cyclictest0-21swapper/109:55:271
2875709993118,10cyclictest231ktimers/109:50:121
2875705993125,3cyclictest2901885-21kworker/u8:1-ext4-rsv-conversion09:05:010
2875705993120,4cyclictest131rcu_preempt10:50:140
2875705993116,5cyclictest131rcu_preempt10:10:190
2875705993113,11cyclictest131rcu_preempt10:42:220
2875705993112,3cyclictest131rcu_preempt08:24:310
2875705993112,3cyclictest131rcu_preempt08:24:310
2875705993112,12cyclictest131rcu_preempt10:05:160
2875705993112,12cyclictest131rcu_preempt10:05:160
2875705993111,12cyclictest131rcu_preempt10:25:240
287571899302,5cyclictest131rcu_preempt09:30:123
2875718993024,3cyclictest0-21swapper/307:15:013
2875718993023,4cyclictest0-21swapper/307:40:253
2875718993022,4cyclictest0-21swapper/308:55:273
2875718993021,6cyclictest0-21swapper/309:40:003
2875714993022,4cyclictest0-21swapper/208:15:012
2875714993020,6cyclictest0-21swapper/208:00:252
2875714993017,8cyclictest2983827-21/usr/sbin/munin12:20:202
2875709993022,4cyclictest0-21swapper/111:50:231
2875709993022,4cyclictest0-21swapper/111:30:151
2875709993022,4cyclictest0-21swapper/108:50:251
2875709993021,4cyclictest0-21swapper/111:55:271
2875709993020,6cyclictest0-21swapper/107:20:171
2875709993018,7cyclictest0-21swapper/110:20:001
2875705993024,3cyclictest0-21swapper/012:10:260
2875705993018,5cyclictest131rcu_preempt07:20:170
2875705993017,8cyclictest121ktimers/011:55:000
2875705993017,4cyclictest131rcu_preempt07:31:480
2875705993017,4cyclictest131rcu_preempt07:31:480
2875705993014,5cyclictest131rcu_preempt09:10:180
2875705993012,4cyclictest131rcu_preempt11:16:470
2875705993011,4cyclictest0-21swapper/009:20:010
2875705993010,12cyclictest0-21swapper/007:55:010
287571899298,5cyclictest2948431-21sshd10:36:533
2875718992922,4cyclictest0-21swapper/309:10:003
2875718992920,6cyclictest0-21swapper/308:50:253
2875718992919,7cyclictest2877853-21switchtime07:15:033
2875714992917,9cyclictest2919149-21sshd09:10:552
2875714992916,8cyclictest2939719-21grep10:10:252
2875714992915,10cyclictest2882156-21/usr/sbin/munin07:25:202
2875709992922,3cyclictest0-21swapper/110:10:241
2875709992921,4cyclictest0-21swapper/112:05:251
2875709992921,4cyclictest0-21swapper/111:20:151
2875709992921,4cyclictest0-21swapper/109:30:251
2875709992921,4cyclictest0-21swapper/108:20:161
2875709992921,4cyclictest0-21swapper/108:20:161
287570599299,13cyclictest11-21ksoftirqd/008:45:130
2875705992916,5cyclictest131rcu_preempt08:55:270
2875705992914,3cyclictest131rcu_preempt08:08:350
2875705992910,9cyclictest11-21ksoftirqd/009:30:300
2875705992910,11cyclictest131rcu_preempt10:40:010
2875718992820,4cyclictest0-21swapper/307:30:253
2875718992820,4cyclictest0-21swapper/307:30:253
2875718992820,4cyclictest0-21swapper/307:25:263
2875718992817,7cyclictest2924433-21grep09:25:253
287571899281,5cyclictest131rcu_preempt08:25:143
287571899281,5cyclictest131rcu_preempt08:25:143
2875718992814,11cyclictest391ktimers/312:30:133
287571499289,4cyclictest32-21ksoftirqd/208:20:222
287571499289,4cyclictest32-21ksoftirqd/208:20:222
2875714992821,4cyclictest0-21swapper/209:50:002
2875714992820,4cyclictest0-21swapper/212:35:272
2875714992820,4cyclictest0-21swapper/208:15:292
2875714992819,5cyclictest0-21swapper/209:55:272
2875714992818,7cyclictest2960624-21sshd11:14:532
2875714992817,8cyclictest2983019-21cron12:20:002
2875714992815,10cyclictest2976796-21/usr/sbin/munin12:00:192
2875714992815,10cyclictest2904921-21/usr/sbin/munin08:30:212
2875709992820,4cyclictest0-21swapper/110:05:011
2875709992818,6cyclictest2965975-21cron11:30:001
2875709992818,6cyclictest2898179-21grep08:10:271
2875718992719,6cyclictest2958728-21kworker/u8:0+events_unbound11:08:593
2875718992719,5cyclictest0-21swapper/311:40:253
2875718992719,5cyclictest0-21swapper/311:40:253
2875718992719,4cyclictest0-21swapper/308:15:203
287571499277,7cyclictest0-21swapper/210:30:102
2875714992721,3cyclictest2883506-21apt-get07:30:122
2875714992721,3cyclictest2883506-21apt-get07:30:122
2875714992717,7cyclictest2973373-21/usr/sbin/munin11:50:172
2875714992717,7cyclictest2892366-21/usr/sbin/munin07:55:182
2875714992717,7cyclictest2881300-21sshd07:21:552
2875714992717,3cyclictest131rcu_preempt08:58:432
2875714992716,7cyclictest2950999-21/usr/sbin/munin10:45:192
2875714992713,11cyclictest2971865-21/usr/sbin/munin11:45:192
2875709992721,3cyclictest0-21swapper/110:40:191
2875709992718,5cyclictest0-21swapper/107:25:171
2875718992620,4cyclictest2901885-21kworker/u8:1+events_unbound09:10:173
2875718992620,4cyclictest2881292-21kworker/u8:3+events_unbound08:08:333
2875718992617,5cyclictest0-21swapper/312:15:273
2875718992616,7cyclictest2963336-21ntp_kernel_err11:20:193
287571499267,13cyclictest2950570-21wc10:45:022
287571499264,7cyclictest0-21swapper/208:35:192
2875714992616,7cyclictest2925070-21apt-get09:30:122
2875714992616,7cyclictest2924747-21cron09:29:012
2875714992616,7cyclictest2916779-21/usr/sbin/munin09:05:202
2875714992616,7cyclictest2888950-21/usr/sbin/munin07:45:182
2875714992615,8cyclictest2908722-21/usr/sbin/munin08:40:252
2875714992613,10cyclictest2961401-21/usr/sbin/munin11:15:222
2875714992610,9cyclictest131rcu_preempt11:29:162
2875714992610,10cyclictest131rcu_preempt07:15:082
2875709992619,5cyclictest164-21systemd-journal12:02:401
2875709992619,5cyclictest164-21systemd-journal08:02:401
2875709992619,4cyclictest2960163-21tail11:10:251
2875709992618,5cyclictest231ktimers/111:35:111
287570999261,22cyclictest2902669-21fschecks_time08:25:181
287570999261,22cyclictest2902669-21fschecks_time08:25:181
2875718992518,4cyclictest0-21swapper/309:45:253
2875718992517,5cyclictest0-21swapper/311:10:253
2875714992516,7cyclictest2969039-21cron11:36:002
2875714992515,8cyclictest2915196-21ntp_states09:00:222
2875714992515,7cyclictest2956340-21/usr/sbin/munin11:00:222
2875714992513,9cyclictest2886761-21ls07:40:012
2875714992510,12cyclictest2890448-21/usr/sbin/munin07:50:162
2875709992519,3cyclictest0-21swapper/107:30:131
2875709992519,3cyclictest0-21swapper/107:30:131
2875709992518,5cyclictest2962022-21kworker/u8:1+events_unbound11:44:351
2875709992518,5cyclictest2962022-21kworker/u8:1+events_unbound11:44:351
2875709992517,5cyclictest0-21swapper/108:30:251
2875709992517,4cyclictest0-21swapper/112:25:241
2875709992516,6cyclictest0-21swapper/109:40:251
2875718992418,4cyclictest391ktimers/309:44:323
2875718992418,4cyclictest2985327-21kernelversion12:25:173
2875718992418,4cyclictest2962022-21kworker/u8:1+events_unbound11:55:063
2875718992418,4cyclictest2881292-21kworker/u8:3+events_unbound08:38:373
2875718992417,4cyclictest0-21swapper/312:20:253
2875718992417,3cyclictest0-21swapper/311:35:233
2875718992415,5cyclictest0-21swapper/307:50:263
287571899241,4cyclictest2905446-21unixbench_singl08:30:253
2875718992413,8cyclictest2898730-21apt-config08:15:023
2875709992418,3cyclictest0-21swapper/108:05:201
2875709992417,4cyclictest2983803-21ntpq12:20:201
2875709992415,6cyclictest2887552-21grep07:40:211
2875709992413,7cyclictest0-21swapper/111:00:241
2875718992317,4cyclictest2969343-21kworker/u8:0+events_unbound11:46:423
2875718992316,4cyclictest0-21swapper/310:20:253
2875718992314,6cyclictest0-21swapper/308:40:253
2875709992317,3cyclictest0-21swapper/108:45:221
2875709992315,6cyclictest0-21swapper/107:40:011
2875709992313,7cyclictest2889089-21sort07:45:211
2875718992216,3cyclictest0-21swapper/311:30:233
2875718992216,3cyclictest0-21swapper/310:10:243
287571899221,11cyclictest0-21swapper/309:54:273
2875709992216,3cyclictest0-21swapper/108:40:251
2875709992216,3cyclictest0-21swapper/107:55:181
2875709992213,6cyclictest0-21swapper/109:05:171
2875709992212,7cyclictest2980569-21cut12:10:231
2875709992210,8cyclictest2942371-21/usr/sbin/munin10:20:171
2875718992115,4cyclictest2905799-21kworker/u8:0+events_unbound08:45:203
2875718992114,5cyclictest29798562sleep312:10:133
2875718992114,5cyclictest2934941-21kworker/u8:2+events_unbound10:15:193
2875718992112,6cyclictest391ktimers/309:15:173
2875709992115,3cyclictest2986889-21fschecks_time12:30:181
2875709992115,3cyclictest0-21swapper/110:05:171
2875709992115,3cyclictest0-21swapper/110:05:171
2875709992114,4cyclictest2950841-21fschecks_time10:45:171
2875709992114,4cyclictest2913144-21fschecks_time08:55:181
2875709992114,4cyclictest0-21swapper/109:20:141
2875709992113,5cyclictest231ktimers/111:50:001
287570999209,8cyclictest2923481-21df_inode09:25:141
2875709992014,3cyclictest2981721-21fschecks_count12:15:161
287571899191,3cyclictest131rcu_preempt10:05:113
287571899191,3cyclictest131rcu_preempt10:05:113
2875718991913,3cyclictest0-21swapper/310:30:153
2875718991912,5cyclictest391ktimers/310:25:133
2875709991910,6cyclictest2953326-21cat10:50:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional