You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-07 - 07:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Tue Apr 07, 2026 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2920336995849,6cyclictest2938050-21kworker/u8:2+events_unbound20:20:141
2920336995432,18cyclictest2922085-21munin-node19:15:011
2920336995432,18cyclictest2922085-21munin-node19:15:011
2920340995140,8cyclictest2965422-21sh21:20:012
2920332995139,7cyclictest151rcuc/019:20:120
2920336994837,6cyclictest2997128-21cut22:50:161
2920344994738,5cyclictest2929979-21fschecks_count19:35:183
2920336994732,12cyclictest231ktimers/120:10:121
2920340994639,4cyclictest2967130-21cron21:25:012
2920340994639,4cyclictest2967130-21cron21:25:012
2920336994633,9cyclictest231ktimers/121:50:121
2920332994634,9cyclictest121ktimers/019:40:120
2920332994618,9cyclictest131rcu_preempt22:00:110
2920336994534,7cyclictest2951777-21sh20:40:001
2920336994534,7cyclictest2951777-21sh20:40:001
2920340994435,6cyclictest2960759-21fschecks_time21:05:172
2920336994416,25cyclictest0-21swapper/100:00:231
2920340994334,6cyclictest2987543-21grep22:20:262
292033699438,8cyclictest2952688-21cut20:40:211
2920336994319,20cyclictest0-21swapper/121:20:221
2920336994319,20cyclictest0-21swapper/121:20:221
2920332994337,4cyclictest2949767-21kworker/u8:0+events_unbound22:58:010
2920340994234,4cyclictest2938121-21cron20:00:012
2920340994232,8cyclictest311ktimers/223:35:132
2920340994230,8cyclictest2988607-21seq22:25:192
2920336994217,22cyclictest0-21swapper/122:00:221
292033699421,11cyclictest2984592-21cron22:15:001
2920344994127,10cyclictest391ktimers/320:00:123
292033699415,4cyclictest2926316-21awk19:25:131
2920336994135,4cyclictest3003386-21kworker/u8:3+events_unbound00:28:121
2920344994033,4cyclictest2922185-21munin-node19:15:013
2920344994033,4cyclictest2922185-21munin-node19:15:013
2920344994031,6cyclictest2935970-21unixbench_multi19:50:253
2920344994029,8cyclictest391ktimers/323:20:103
2920336994032,5cyclictest3013810-21sendmail23:40:001
2920344993931,4cyclictest0-21swapper/320:45:173
2920344993930,6cyclictest2927226-21grep19:25:253
2920344993928,7cyclictest3029124-21unixbench_multi00:20:253
2920344993928,7cyclictest3029124-21unixbench_multi00:20:253
2920340993930,6cyclictest0-21swapper/219:20:002
2920336993914,3cyclictest0-21swapper/121:25:241
2920336993914,3cyclictest0-21swapper/121:25:241
2920332993933,4cyclictest2941170-21kworker/u8:3+events_unbound20:47:320
2920332993928,7cyclictest0-21swapper/022:20:000
2920332993917,12cyclictest2972384-21kworker/u8:1-events_freezable_power_22:24:490
2920340993830,4cyclictest0-21swapper/222:40:002
2920336993813,3cyclictest438-21cron19:20:001
2920332993830,4cyclictest2944975-21sendmail20:20:010
2920332993825,9cyclictest2953028-21grep20:40:240
2920344993730,4cyclictest2970549-21cut21:35:003
2920344993728,5cyclictest3034690-21cron00:40:003
2920340993729,5cyclictest2994594-21unixbench_multi22:40:262
2920340993729,5cyclictest2994594-21unixbench_multi22:40:262
2920340993727,7cyclictest2946662-21sh20:25:002
2920340993722,12cyclictest311ktimers/223:05:122
2920336993729,4cyclictest0-21swapper/123:08:011
2920336993727,6cyclictest0-21swapper/122:20:261
2920336993726,6cyclictest0-21swapper/119:35:001
2920336993713,4cyclictest0-21swapper/121:19:511
2920336993710,5cyclictest0-21swapper/100:35:241
2920332993730,5cyclictest2936049-21kworker/u8:1+events_unbound19:50:420
2920344993628,4cyclictest0-21swapper/321:15:173
2920344993626,7cyclictest3021458-21fschecks_count00:00:153
2920340993628,3cyclictest0-21swapper/220:50:152
2920340993627,7cyclictest3003386-21kworker/u8:3+events_unbound23:18:022
2920340993624,7cyclictest0-21swapper/220:55:242
2920344993525,6cyclictest0-21swapper/319:40:253
2920336993527,5cyclictest2944956-21munin-run20:20:001
2920332993525,7cyclictest121ktimers/021:15:140
2920340993425,5cyclictest0-21swapper/221:55:262
2920340993424,6cyclictest0-21swapper/221:05:012
2920340993424,6cyclictest0-21swapper/219:45:252
2920340993423,7cyclictest0-21swapper/219:25:012
2920336993427,4cyclictest2962014-21kthreadd21:10:011
2920332993426,6cyclictest2959999-21kworker/u8:2+events_unbound21:26:420
2920332993426,6cyclictest2959999-21kworker/u8:2+events_unbound21:26:420
2920332993424,5cyclictest0-21swapper/021:07:310
2920332993422,8cyclictest3029154-21grep00:20:250
2920332993422,8cyclictest3029154-21grep00:20:250
2920332993422,7cyclictest0-21swapper/020:55:240
2920332993414,7cyclictest131rcu_preempt21:50:120
2920340993327,4cyclictest2972384-21kworker/u8:1+events_unbound21:47:452
2920336993322,7cyclictest0-21swapper/119:35:271
2920336993321,9cyclictest231ktimers/121:45:111
2920336993313,4cyclictest231ktimers/121:05:011
292033699331,12cyclictest3021075-21awk00:00:001
2920332993325,4cyclictest0-21swapper/023:55:000
2920332993324,4cyclictest0-21swapper/019:30:160
2920332993323,6cyclictest2994604-21grep22:40:260
2920332993323,6cyclictest2994604-21grep22:40:260
2920332993322,6cyclictest0-21swapper/022:10:000
2920332993311,12cyclictest11-21ksoftirqd/022:10:260
292033299330,11cyclictest11-21ksoftirqd/020:05:130
2920344993224,4cyclictest0-21swapper/321:50:163
2920340993223,5cyclictest0-21swapper/223:30:162
2920340993223,5cyclictest0-21swapper/222:50:262
2920340993221,7cyclictest0-21swapper/200:30:252
2920340993221,7cyclictest0-21swapper/200:10:252
2920340993215,14cyclictest32-21ksoftirqd/220:35:122
2920340993215,14cyclictest32-21ksoftirqd/220:35:122
2920336993223,4cyclictest0-21swapper/123:40:151
2920336993223,4cyclictest0-21swapper/121:00:001
2920336993222,6cyclictest3001464-21grep23:00:261
2920336993221,7cyclictest0-21swapper/119:45:011
2920336993220,8cyclictest231ktimers/123:45:101
292033699321,11cyclictest2996306-21tail22:45:251
2920332993226,4cyclictest3003386-21kworker/u8:3+events_unbound23:26:420
2920332993224,5cyclictest2937695-21unixbench_singl19:55:250
2920332993224,4cyclictest0-21swapper/019:25:250
2920332993216,10cyclictest131rcu_preempt19:39:520
2920344993125,4cyclictest2968638-21kworker/u8:3+events_unbound21:37:443
2920344993123,4cyclictest0-21swapper/323:43:063
2920344993123,4cyclictest0-21swapper/321:20:273
2920344993123,4cyclictest0-21swapper/321:20:273
2920340993126,3cyclictest3003386-21kworker/u8:3+events_unbound23:23:032
2920340993121,6cyclictest0-21swapper/221:50:252
2920340993121,6cyclictest0-21swapper/200:00:262
2920336993123,4cyclictest0-21swapper/120:00:011
2920336993120,7cyclictest3032511-21grep00:30:251
2920336993112,4cyclictest231ktimers/123:30:131
292033299318,13cyclictest11-21ksoftirqd/023:10:200
292033299316,9cyclictest11-21ksoftirqd/019:15:120
2920332993116,6cyclictest131rcu_preempt20:05:010
292033299311,14cyclictest2975865-21cron21:50:000
2920344993023,4cyclictest2993294-21latency_hist22:40:013
2920344993020,6cyclictest0-21swapper/319:20:003
2920344993017,9cyclictest2951787-21tr20:40:003
2920344993017,9cyclictest2951787-21tr20:40:003
2920340993020,6cyclictest0-21swapper/223:40:242
2920340993020,6cyclictest0-21swapper/221:30:002
2920340993020,6cyclictest0-21swapper/221:30:002
2920340993020,6cyclictest0-21swapper/200:09:592
2920336993024,4cyclictest231ktimers/100:10:121
292033299309,12cyclictest11-21ksoftirqd/000:10:230
292033299305,8cyclictest11-21ksoftirqd/021:35:000
2920332993026,2cyclictest0-21swapper/021:40:240
2920332993024,4cyclictest2949767-21kworker/u8:0+events_unbound21:57:490
2920332993023,5cyclictest2993103-21kworker/u8:1+events_unbound22:45:200
2920332993021,5cyclictest0-21swapper/023:59:590
2920332993019,3cyclictest131rcu_preempt00:35:210
2920332993018,9cyclictest3014745-21wc23:40:190
2920332993013,3cyclictest131rcu_preempt20:52:480
2920332993010,12cyclictest0-21swapper/020:27:480
2920344992922,4cyclictest2936871-21fschecks_time19:55:153
2920344992918,7cyclictest2961555-21grep21:05:263
2920340992923,3cyclictest2931305-21kthreadd19:40:002
2920340992921,5cyclictest0-21swapper/221:15:012
2920340992920,6cyclictest0-21swapper/219:50:252
2920340992920,5cyclictest0-21swapper/222:10:262
2920340992920,5cyclictest0-21swapper/220:20:012
2920336992920,5cyclictest0-21swapper/100:10:001
292033299299,3cyclictest30220542sh00:00:250
292033299298,13cyclictest11-21ksoftirqd/023:40:010
292033299297,13cyclictest131rcu_preempt00:30:140
292033299297,12cyclictest0-21swapper/000:08:010
2920332992923,4cyclictest2951171-21timerandwakeup20:35:240
2920332992923,4cyclictest2951171-21timerandwakeup20:35:240
292033299291,9cyclictest11-21ksoftirqd/020:20:140
2920332992918,5cyclictest131rcu_preempt22:30:000
2920332992912,5cyclictest131rcu_preempt23:08:210
2920332992910,11cyclictest11-21ksoftirqd/020:10:240
2920344992822,4cyclictest2968638-21kworker/u8:3+events_unbound21:29:403
2920344992822,4cyclictest2968638-21kworker/u8:3+events_unbound21:29:403
2920344992821,5cyclictest2972384-21kworker/u8:1+events_unbound21:42:463
2920344992820,4cyclictest2941914-21fschecks_count20:10:153
2920344992815,11cyclictest391ktimers/322:00:113
2920340992820,5cyclictest30287482sleep200:20:232
2920340992820,5cyclictest30287482sleep200:20:232
2920340992819,6cyclictest3004877-21grep23:10:252
292033299288,11cyclictest11-21ksoftirqd/021:10:240
292033299287,12cyclictest131rcu_preempt23:45:230
292033299287,11cyclictest131rcu_preempt21:20:230
292033299287,11cyclictest131rcu_preempt21:20:230
2920332992821,3cyclictest0-21swapper/022:30:260
292033299281,6cyclictest3030893-21sed00:25:250
2920332992816,8cyclictest2971319-21taskset21:35:150
2920332992813,4cyclictest131rcu_preempt00:18:120
2920332992812,4cyclictest131rcu_preempt22:50:180
2920344992721,4cyclictest3015360-21kworker/u8:0+events_unbound23:48:083
2920344992721,3cyclictest0-21swapper/322:50:003
2920344992718,6cyclictest0-21swapper/300:20:003
2920344992716,6cyclictest0-21swapper/322:25:253
2920336992721,3cyclictest0-21swapper/120:05:141
2920336992720,4cyclictest0-21swapper/123:50:251
2920336992719,4cyclictest0-21swapper/122:35:251
2920336992719,4cyclictest0-21swapper/120:50:001
2920336992718,4cyclictest3006987-21kthreadd23:20:001
2920336992716,7cyclictest0-21swapper/123:20:241
2920336992715,8cyclictest2979294-21basename22:00:001
292033299277,12cyclictest11-21ksoftirqd/020:30:190
2920332992713,11cyclictest3007230-21/usr/sbin/munin23:20:140
2920332992711,9cyclictest131rcu_preempt19:45:250
2920344992620,3cyclictest0-21swapper/322:40:193
2920344992620,3cyclictest0-21swapper/322:40:183
2920344992619,3cyclictest0-21swapper/322:10:263
2920344992618,4cyclictest3013798-21cron23:40:003
2920344992618,4cyclictest0-21swapper/323:25:263
2920344992618,4cyclictest0-21swapper/322:20:263
2920344992618,4cyclictest0-21swapper/300:25:253
2920344992617,6cyclictest391ktimers/322:15:103
2920344992617,6cyclictest2957350-21grep20:55:163
2920344992610,2cyclictest131rcu_preempt23:50:113
2920340992619,4cyclictest0-21swapper/220:30:242
2920340992618,4cyclictest0-21swapper/220:05:012
2920340992616,7cyclictest1-21systemd20:12:262
2920340992616,6cyclictest0-21swapper/221:35:212
2920340992614,7cyclictest2932586-21grep19:40:252
2920336992619,4cyclictest0-21swapper/121:30:241
2920336992614,8cyclictest1-21systemd23:28:041
292033299269,3cyclictest0-21swapper/023:17:330
292033299269,10cyclictest11-21ksoftirqd/023:00:140
292033299267,4cyclictest0-21swapper/021:02:150
2920332992610,11cyclictest131rcu_preempt19:15:010
2920332992610,11cyclictest131rcu_preempt19:15:010
292034499259,3cyclictest131rcu_preempt22:10:003
292034499251,5cyclictest131rcu_preempt21:00:133
2920340992517,5cyclictest0-21swapper/200:15:242
2920340992517,4cyclictest2969227-21fschecks_count21:30:152
2920336992519,2cyclictest0-21swapper/122:15:151
2920336992516,6cyclictest0-21swapper/121:40:011
292033299254,3cyclictest131rcu_preempt23:30:240
2920344992418,4cyclictest2929380-21kworker/u8:3+events_unbound19:45:293
2920344992418,3cyclictest0-21swapper/320:15:143
2920344992418,3cyclictest0-21swapper/300:10:233
2920344992416,6cyclictest2941170-21kworker/u8:3+events_unbound20:40:113
2920344992416,4cyclictest0-21swapper/322:50:263
2920344992416,4cyclictest0-21swapper/322:00:003
2920344992415,5cyclictest0-21swapper/323:15:263
2920344992412,9cyclictest2946178-21unixbench_multi20:20:263
2920344992411,8cyclictest1-21systemd20:27:283
2920340992417,4cyclictest3017425-21cron23:50:002
2920340992416,5cyclictest0-21swapper/223:00:012
2920340992415,5cyclictest0-21swapper/219:30:002
2920340992414,7cyclictest1-21systemd22:17:532
2920340992414,6cyclictest0-21swapper/222:45:252
2920336992418,4cyclictest2956890-21cron20:55:011
2920336992418,3cyclictest0-21swapper/122:30:251
2920336992418,3cyclictest0-21swapper/100:15:221
2920336992416,4cyclictest0-21swapper/120:30:241
2920336992416,4cyclictest0-21swapper/120:05:011
2920336992415,5cyclictest0-21swapper/122:05:281
2920344992318,3cyclictest0-21swapper/323:10:233
2920344992317,4cyclictest2941170-21kworker/u8:3+events_unbound20:07:263
2920344992317,3cyclictest0-21swapper/320:50:233
2920344992316,4cyclictest0-21swapper/300:05:253
2920344992313,6cyclictest0-21swapper/300:30:253
2920344992311,8cyclictest0-21swapper/319:25:013
292034099237,12cyclictest3010396-21cron23:30:002
2920340992317,3cyclictest0-21swapper/220:40:232
2920340992315,5cyclictest0-21swapper/222:30:252
2920340992313,7cyclictest0-21swapper/222:05:182
2920340992313,5cyclictest0-21swapper/221:40:262
2920340992311,9cyclictest2981012-21http22:05:002
2920336992317,3cyclictest0-21swapper/119:25:011
2920336992315,4cyclictest2972885-21fschecks_time21:40:171
2920344992216,4cyclictest2949767-21kworker/u8:0+events_unbound20:32:303
2920344992216,3cyclictest0-21swapper/319:35:013
2920344992215,5cyclictest2959999-21kworker/u8:2+events_unbound21:14:083
2920344992214,5cyclictest0-21swapper/323:55:153
2920340992212,7cyclictest3018936-21grep23:50:252
2920336992216,3cyclictest0-21swapper/122:25:211
2920336992211,7cyclictest0-21swapper/119:50:261
292034499213,12cyclictest30021082sleep323:05:123
2920344992115,3cyclictest0-21swapper/323:00:253
2920344992114,3cyclictest0-21swapper/323:35:013
2920344992114,3cyclictest0-21swapper/323:00:013
2920340992115,4cyclictest2896990-21kworker/u8:1+events_unbound19:32:232
2920340992115,3cyclictest0-21swapper/223:00:222
2920340992115,3cyclictest0-21swapper/220:05:252
2920340992113,5cyclictest0-21swapper/219:10:232
2920340992113,5cyclictest0-21swapper/219:10:232
2920336992115,3cyclictest0-21swapper/122:40:211
2920336992115,3cyclictest0-21swapper/122:40:211
2920336992115,3cyclictest0-21swapper/120:25:241
2920336992114,4cyclictest2933984-21mailstats19:45:231
2920340992015,3cyclictest0-21swapper/220:45:172
2920340992014,3cyclictest3029939-21sh00:25:142
2920336992015,3cyclictest3004006-21fschecks_time23:10:151
2920336992013,5cyclictest231ktimers/122:55:121
2920344991910,6cyclictest2990497-21/usr/sbin/munin22:30:213
2920336991911,5cyclictest3029609-21idleruntime-cro00:25:001
2920336991911,5cyclictest3029609-21idleruntime-cro00:25:001
292034499182,12cyclictest2975864-21cron21:50:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional