You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-31 - 07:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Fri Oct 31, 2025 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3089231995827,27cyclictest0-21swapper/100:00:001
3089232995426,4cyclictest0-21swapper/219:55:182
3089232995426,4cyclictest0-21swapper/219:55:172
3089231995026,20cyclictest0-21swapper/120:00:001
3089231995026,20cyclictest0-21swapper/120:00:001
3089231994819,4cyclictest0-21swapper/122:20:011
3089232994538,4cyclictest3089228-21cyclictest20:30:292
3089231994534,8cyclictest231ktimers/123:50:131
3089232994431,9cyclictest311ktimers/220:25:182
3089231994431,10cyclictest231ktimers/119:30:131
3089231994415,3cyclictest0-21swapper/120:35:291
3089231994413,5cyclictest3134697-21latency_hist21:20:011
3089231994413,5cyclictest3134697-21latency_hist21:20:001
3089233994133,5cyclictest3131165-21munin-run21:10:013
3089231994132,4cyclictest0-21swapper/120:32:311
3089231994115,4cyclictest0-21swapper/120:55:201
308923199411,16cyclictest3162280-21latency_hist22:40:001
3089231994030,6cyclictest3192571-21unixbench_singl00:05:281
3089231994014,3cyclictest0-21swapper/122:40:161
3089232993930,6cyclictest3194474-21unixbench_singl00:10:252
3089231993915,3cyclictest3128172-21fschecks_time21:00:181
3089231993915,3cyclictest0-21swapper/119:55:011
3089230993928,8cyclictest121ktimers/023:10:150
3089233993831,5cyclictest53-21kcompactd000:25:203
3089233993825,9cyclictest3137991-21idleruntime-cro21:30:003
3089232993827,8cyclictest3134160-21grep21:15:262
3089232993827,8cyclictest3134160-21grep21:15:262
3089232993826,8cyclictest3182763-21sendmail23:40:002
3089232993731,4cyclictest3162282-21cron22:39:592
3089232993730,4cyclictest3200223-21cron00:30:002
3089232993728,6cyclictest3104950-21unixbench_singl19:50:262
3089232993725,8cyclictest3158427-21grep22:25:272
3089232993725,8cyclictest3158427-21grep22:25:272
3089231993713,5cyclictest0-21swapper/100:30:001
3089230993729,4cyclictest3181050-21munin-plugin-st23:35:000
3089233993628,4cyclictest0-21swapper/320:50:273
3089233993628,4cyclictest0-21swapper/300:30:303
3089233993627,4cyclictest0-21swapper/322:00:013
3089232993628,4cyclictest0-21swapper/219:25:172
3089230993629,5cyclictest3122469-21kworker/u8:0+events_unbound21:02:390
3089233993528,4cyclictest3203635-21cron00:40:003
3089232993527,4cyclictest0-21swapper/200:00:302
3089231993527,5cyclictest0-21swapper/122:15:011
3089231993526,6cyclictest0-21swapper/119:40:001
3089230993526,6cyclictest3098519-21cron19:35:000
3089233993416,14cyclictest391ktimers/323:45:123
3089231993427,4cyclictest0-21swapper/121:10:261
3089231993426,5cyclictest440-21cron20:55:001
3089231993425,6cyclictest3091905-21fschecks_time19:15:191
3089230993425,6cyclictest3172517-21apt23:10:010
3089230993425,6cyclictest3160095-21unixbench_multi22:30:260
3089230993424,5cyclictest0-21swapper/019:30:020
3089230993420,10cyclictest215-21dbus-daemon20:37:310
3089230993416,15cyclictest11-21ksoftirqd/020:45:140
3089233993326,5cyclictest3129259-21kworker/u8:1+events_unbound21:17:423
3089233993326,5cyclictest3129259-21kworker/u8:1+events_unbound21:17:423
3089233993325,4cyclictest0-21swapper/323:55:283
3089233993324,6cyclictest0-21swapper/322:20:003
3089233993323,6cyclictest3094446-21grep19:20:263
3089232993326,4cyclictest3139679-21cron21:35:002
3089232993325,4cyclictest0-21swapper/222:45:262
3089232993321,9cyclictest311ktimers/222:55:142
3089231993325,4cyclictest0-21swapper/123:20:181
3089231993324,6cyclictest0-21swapper/120:30:001
3089230993315,15cyclictest11-21ksoftirqd/021:40:130
3089230993315,15cyclictest11-21ksoftirqd/021:40:130
3089233993224,5cyclictest3160573-21sh22:35:003
3089233993223,5cyclictest0-21swapper/300:15:003
3089233993223,4cyclictest0-21swapper/320:05:223
3089233993223,4cyclictest0-21swapper/320:05:223
3089233993222,7cyclictest0-21swapper/321:40:013
3089233993222,6cyclictest0-21swapper/320:00:273
3089231993225,4cyclictest0-21swapper/121:05:261
3089231993224,5cyclictest0-21swapper/120:20:291
3089231993224,4cyclictest0-21swapper/119:20:181
3089230993224,4cyclictest3093185-21cron19:20:000
3089230993224,4cyclictest3089228-21cyclictest22:50:000
3089230993224,4cyclictest0-21swapper/020:25:300
3089230993222,6cyclictest3106798-21sed19:55:270
3089230993222,6cyclictest3106798-21sed19:55:260
3089233993125,4cyclictest3100115-21kworker/u8:1+events_unbound19:57:253
3089233993125,4cyclictest3100115-21kworker/u8:1+events_unbound19:57:243
3089233993122,5cyclictest0-21swapper/321:30:203
3089232993123,4cyclictest3098518-21cron19:35:002
3089232993119,8cyclictest3146320-21grep21:50:272
3089232993119,7cyclictest0-21swapper/219:20:272
3089231993124,4cyclictest3096198-21head19:25:281
3089231993119,9cyclictest3141401-21run-parts21:40:001
3089230993122,6cyclictest3133310-21fschecks_time21:15:150
3089230993122,6cyclictest3133310-21fschecks_time21:15:150
3089230993122,4cyclictest3168650-21grep22:55:270
308923399303,5cyclictest131rcu_preempt19:50:133
3089233993022,4cyclictest3182741-21kthreadd23:39:593
3089233993021,6cyclictest0-21swapper/319:10:173
3089233993020,6cyclictest0-21swapper/322:20:193
3089233993020,5cyclictest0-21swapper/322:02:483
3089233993019,7cyclictest3135865-21grep21:20:283
3089233993012,6cyclictest3160491-21kworker/u8:0+events_unbound22:35:273
3089232993023,4cyclictest3115367-21unixbench_multi20:20:292
3089232993023,4cyclictest0-21swapper/223:55:272
3089232993023,3cyclictest0-21swapper/220:15:192
3089232993022,4cyclictest0-21swapper/222:10:262
3089232993020,6cyclictest0-21swapper/223:45:262
3089231993022,4cyclictest0-21swapper/123:45:171
3089231993021,6cyclictest0-21swapper/120:00:281
3089230993023,4cyclictest3127743-21munin-plugin-st21:00:000
3089230993023,3cyclictest0-21swapper/023:39:590
3089230993023,3cyclictest0-21swapper/023:25:260
3089230993023,3cyclictest0-21swapper/023:25:250
3089230993022,5cyclictest3140980-21unixbench_singl21:35:260
3089230993022,5cyclictest11-21ksoftirqd/022:15:160
3089230993022,4cyclictest0-21swapper/022:05:000
308923099301,10cyclictest31973742ntp_kernel_err00:20:240
308923099301,10cyclictest31973742ntp_kernel_err00:20:240
3089233992923,4cyclictest3146385-21kworker/u8:1+events_unbound21:52:473
3089233992921,6cyclictest3165927-21kworker/u8:2+events_unbound23:13:423
3089233992921,4cyclictest0-21swapper/300:00:273
3089233992920,5cyclictest0-21swapper/322:50:283
3089233992920,5cyclictest0-21swapper/322:25:263
3089233992920,5cyclictest0-21swapper/322:25:263
3089232992922,4cyclictest3198341-21http00:25:002
3089232992922,4cyclictest3198341-21http00:25:002
3089232992922,4cyclictest31879242chrt23:55:002
3089232992922,3cyclictest0-21swapper/221:10:172
3089232992921,4cyclictest0-21swapper/221:00:272
3089232992919,6cyclictest0-21swapper/219:40:012
3089231992923,3cyclictest0-21swapper/123:15:271
3089231992922,4cyclictest0-21swapper/123:30:261
3089231992922,4cyclictest0-21swapper/121:45:011
3089231992922,4cyclictest0-21swapper/121:45:001
3089231992920,4cyclictest0-21swapper/123:13:021
3089230992921,4cyclictest0-21swapper/019:40:260
3089230992919,6cyclictest3166934-21grep22:50:280
3089230992916,9cyclictest121ktimers/021:10:130
3089233992822,4cyclictest3165927-21kworker/u8:2+events_unbound23:18:033
3089233992821,4cyclictest0-21swapper/320:40:263
3089233992820,4cyclictest0-21swapper/323:00:003
3089233992820,3cyclictest0-21swapper/321:40:283
3089233992820,3cyclictest0-21swapper/321:40:283
308923399281,4cyclictest131rcu_preempt19:35:133
3089232992821,4cyclictest3148000-21head21:55:262
3089232992821,4cyclictest0-21swapper/221:20:282
3089232992819,6cyclictest3125604-21grep20:50:282
3089232992817,7cyclictest3155265-21dpkg22:20:002
3089231992819,6cyclictest0-21swapper/123:00:011
3089231992819,6cyclictest0-21swapper/100:25:001
3089231992819,6cyclictest0-21swapper/100:25:001
3089230992821,5cyclictest11-21ksoftirqd/021:20:150
3089230992820,5cyclictest11-21ksoftirqd/023:40:130
3089230992820,4cyclictest0-21swapper/020:20:010
3089230992819,7cyclictest3100115-21kworker/u8:1+events_unbound19:45:540
3089230992819,5cyclictest0-21swapper/000:10:010
3089230992818,6cyclictest0-21swapper/000:25:290
3089230992817,6cyclictest0-21swapper/020:10:290
3089230992814,11cyclictest11-21ksoftirqd/023:55:150
3089233992721,4cyclictest3189197-21kworker/u8:2+events_unbound00:05:083
3089233992721,4cyclictest3165927-21kworker/u8:2+events_unbound23:28:053
3089233992721,4cyclictest3165927-21kworker/u8:2+events_unbound23:28:053
3089233992721,4cyclictest3103583-21kworker/u8:2-ext4-rsv-conversion20:50:023
3089233992719,5cyclictest3197866-21tail00:20:303
3089233992719,5cyclictest3197866-21tail00:20:303
3089233992719,4cyclictest0-21swapper/321:45:293
3089233992717,7cyclictest3112825-21grep20:15:213
3089232992720,3cyclictest0-21swapper/220:00:212
3089232992719,4cyclictest0-21swapper/223:10:292
3089232992719,4cyclictest0-21swapper/200:15:312
3089232992717,5cyclictest3144614-21grep21:45:292
3089232992716,7cyclictest3141412-21sendmail21:40:002
3089231992718,6cyclictest0-21swapper/122:00:161
3089231992718,6cyclictest0-21swapper/120:10:281
3089231992718,4cyclictest0-21swapper/119:47:221
3089231992716,8cyclictest3196621-21sendmail00:20:011
3089230992721,4cyclictest0-21swapper/021:30:160
3089230992720,4cyclictest3194894-21sh00:15:000
3089230992716,6cyclictest0-21swapper/022:20:300
3089233992620,4cyclictest3125952-21kworker/u8:1+events_unbound20:56:503
3089233992620,4cyclictest3087248-21kworker/u8:2+events_unbound19:28:443
3089233992616,7cyclictest3150460-21ls22:05:153
3089233992615,8cyclictest391ktimers/320:35:183
3089232992618,5cyclictest0-21swapper/220:40:002
3089232992617,5cyclictest0-21swapper/223:20:012
3089232992615,8cyclictest3202271-21df00:35:172
3089231992620,3cyclictest0-21swapper/122:50:001
3089231992619,4cyclictest0-21swapper/122:25:261
3089231992619,4cyclictest0-21swapper/122:25:261
3089231992619,4cyclictest0-21swapper/100:15:011
3089230992619,5cyclictest11-21ksoftirqd/022:35:150
3089230992617,4cyclictest0-21swapper/020:00:170
3089230992615,6cyclictest0-21swapper/023:15:260
3089230992614,8cyclictest3187398-21tail23:50:270
3089233992518,5cyclictest3107099-21kworker/u8:0+events_unbound20:11:463
3089233992517,6cyclictest3186388-21kworker/u8:0+events_unbound23:52:213
3089233992517,5cyclictest3115575-21kworker/u8:1+events_unbound20:25:303
3089233992517,4cyclictest3172100-21head23:05:273
3089233992517,4cyclictest0-21swapper/319:40:263
3089233992516,5cyclictest0-21swapper/300:20:003
308923399251,4cyclictest131rcu_preempt20:20:133
3089232992518,3cyclictest637-21runrttasks20:45:002
3089232992517,4cyclictest0-21swapper/223:30:162
3089232992515,8cyclictest3159857-21mailstats22:30:252
3089231992519,3cyclictest0-21swapper/121:45:201
3089231992517,4cyclictest0-21swapper/122:30:271
3089231992517,4cyclictest0-21swapper/122:20:291
3089230992516,6cyclictest3109913-21find20:05:300
3089230992516,6cyclictest3109913-21find20:05:300
3089230992516,5cyclictest0-21swapper/021:55:280
3089233992413,8cyclictest391ktimers/322:40:143
3089233992411,9cyclictest1-21systemd21:02:373
3089232992418,3cyclictest0-21swapper/219:45:012
3089232992416,4cyclictest0-21swapper/220:10:282
3089232992415,6cyclictest0-21swapper/200:10:012
3089232992415,5cyclictest0-21swapper/219:45:172
3089232992414,6cyclictest0-21swapper/219:10:242
3089231992418,3cyclictest0-21swapper/121:30:261
3089231992416,4cyclictest0-21swapper/123:00:151
3089231992414,8cyclictest3181374-21df23:35:131
3089231992414,7cyclictest3101984-21date19:45:001
3089230992420,2cyclictest13650irq/42-30be0000.ethernet22:10:130
3089230992417,4cyclictest13950irq/36-mmc120:35:000
3089230992417,4cyclictest13650irq/42-30be0000.ethernet00:18:140
3089230992416,4cyclictest0-21swapper/022:10:000
3089230992414,8cyclictest0-21swapper/021:10:010
3089230992413,6cyclictest0-21swapper/021:30:010
308923099241,19cyclictest0-21swapper/020:50:080
308923099241,19cyclictest0-21swapper/000:36:340
3089233992317,3cyclictest0-21swapper/322:45:243
3089233992317,3cyclictest0-21swapper/319:45:173
3089233992316,5cyclictest3087248-21kworker/u8:2+events_unbound19:17:193
3089232992317,3cyclictest0-21swapper/223:25:222
3089232992317,3cyclictest0-21swapper/223:25:222
3089232992317,3cyclictest0-21swapper/222:05:282
3089232992317,3cyclictest0-21swapper/221:42:452
3089232992317,3cyclictest0-21swapper/221:42:442
3089232992315,5cyclictest0-21swapper/220:50:002
3089232992314,6cyclictest3155829-21/usr/sbin/munin22:20:182
3089232992314,6cyclictest0-21swapper/220:05:242
3089232992314,6cyclictest0-21swapper/220:05:242
3089231992317,3cyclictest0-21swapper/123:40:271
3089231992317,3cyclictest0-21swapper/122:05:261
3089231992317,3cyclictest0-21swapper/121:50:261
3089231992317,3cyclictest0-21swapper/120:40:181
3089231992316,5cyclictest0-21swapper/123:30:011
3089231992316,5cyclictest0-21swapper/123:30:001
3089231992315,5cyclictest0-21swapper/121:20:241
3089230992316,3cyclictest0-21swapper/022:25:210
3089230992316,3cyclictest0-21swapper/022:25:210
3089230992316,3cyclictest0-21swapper/020:44:190
3089230992316,3cyclictest0-21swapper/019:20:220
3089230992315,5cyclictest0-21swapper/000:30:190
3089230992312,7cyclictest0-21swapper/023:20:260
308923099231,18cyclictest0-21swapper/023:47:520
308923099231,18cyclictest0-21swapper/019:37:590
308923099231,18cyclictest0-21swapper/019:12:170
3089230992311,10cyclictest3162528-21/usr/sbin/munin22:40:130
308923099230,19cyclictest0-21swapper/023:03:310
308923099230,19cyclictest0-21swapper/020:20:080
3089233992216,4cyclictest3165927-21kworker/u8:2+events_unbound23:20:123
3089233992215,3cyclictest0-21swapper/322:10:263
3089233992215,3cyclictest0-21swapper/321:10:273
3089233992214,4cyclictest3184004-21unixbench_multi23:40:263
3089232992216,3cyclictest0-21swapper/221:05:262
3089232992215,4cyclictest3127737-21munin-plugin-st21:00:002
3089232992215,4cyclictest3093192-21latency_hist19:20:002
3089232992215,4cyclictest0-21swapper/222:50:192
3089232992214,4cyclictest0-21swapper/223:05:262
308923299221,10cyclictest3149245-21ntp_states22:00:232
3089231992216,3cyclictest0-21swapper/123:05:151
3089231992214,5cyclictest1-21systemd00:33:171
3089231992214,5cyclictest0-21swapper/120:15:211
3089231992212,7cyclictest3110265-21grep20:05:331
3089231992212,7cyclictest3110265-21grep20:05:331
3089231992212,7cyclictest0-21swapper/121:25:241
3089230992211,6cyclictest0-21swapper/000:00:290
3089233992115,4cyclictest391ktimers/319:30:033
3089233992115,4cyclictest3180944-21kworker/u8:1+events_unbound23:34:273
3089232992115,3cyclictest0-21swapper/200:34:012
3089232992113,5cyclictest3137351-21cat21:25:252
3089232992112,6cyclictest3183712-21cut23:40:262
308923299211,18cyclictest311ktimers/223:00:172
3089231992115,3cyclictest0-21swapper/122:50:181
3089231992111,7cyclictest3202666-21cat00:35:241
3089230992115,3cyclictest0-21swapper/021:50:150
3089232992014,3cyclictest0-21swapper/222:40:192
3089231992010,7cyclictest3147405-21memory21:55:201
3089232991914,3cyclictest0-21swapper/223:20:252
3089231991912,5cyclictest231ktimers/120:50:011
3089231991910,4cyclictest31900282chrt00:00:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional