You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-15 - 18:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Mon Sep 15, 2025 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3035496995828,26cyclictest0-21swapper/308:00:013
3035486995222,25cyclictest0-21swapper/107:55:271
3035496994924,4cyclictest0-21swapper/309:40:273
3035479994939,7cyclictest3149023-21sendmail12:40:000
3035490994635,8cyclictest3081038-21apt-key09:20:012
3035490994334,6cyclictest3145196-21grep12:25:292
3035490994333,7cyclictest3035613-21apt-key07:10:012
3035486994316,23cyclictest0-21swapper/110:45:171
3035486994314,26cyclictest0-21swapper/110:00:001
3035486994313,3cyclictest0-21swapper/108:00:201
3035486994313,3cyclictest0-21swapper/108:00:201
3035486994310,3cyclictest0-21swapper/108:20:201
3035479994336,4cyclictest3060324-21sendmail08:20:010
3035490994234,5cyclictest3056906-21idleruntime-cro08:10:002
3035490994232,7cyclictest3058121-21grep08:10:252
3035479994227,11cyclictest121ktimers/007:30:140
3035496994129,8cyclictest3127678-21auditctl11:35:013
303548699419,8cyclictest3095394-21sed10:00:221
303548699419,5cyclictest0-21swapper/110:30:201
3035486994131,7cyclictest3092919-21cron09:55:001
3035486994116,21cyclictest3080771-21cron09:20:001
3035486994115,23cyclictest0-21swapper/107:20:261
3035486994113,3cyclictest0-21swapper/112:25:161
3035486994113,3cyclictest0-21swapper/109:45:571
3035496994029,7cyclictest3108285-21grep10:35:263
3035490994033,4cyclictest3069212-21cut08:45:142
303548699409,3cyclictest0-21swapper/107:45:191
3035486994023,13cyclictest0-21swapper/107:55:011
3035486994014,23cyclictest0-21swapper/111:05:161
3035486994011,3cyclictest3108950-21/usr/sbin/munin10:40:241
3035486994010,3cyclictest0-21swapper/111:50:221
3035490993932,5cyclictest3056840-21kworker/u8:0+events_unbound08:35:482
3035490993932,3cyclictest0-21swapper/212:20:002
3035490993932,3cyclictest0-21swapper/212:20:002
3035490993928,8cyclictest3084417-21munin-plugin-st09:30:012
3035490993927,7cyclictest3044333-21grep07:30:272
3035486993931,5cyclictest3097594-21unixbench_multi10:05:281
3035486993931,5cyclictest3097594-21unixbench_multi10:05:281
303548699393,10cyclictest3038776-21/usr/sbin/munin07:15:221
3035486993927,9cyclictest231ktimers/107:40:121
3035486993915,20cyclictest0-21swapper/111:30:171
3035479993932,5cyclictest3139939-21kworker/u8:2+events_unbound12:16:210
3035479993932,5cyclictest3139939-21kworker/u8:2+events_unbound12:16:210
3035479993930,6cyclictest3124274-21sh11:25:000
3035479993930,6cyclictest3042606-21grep07:25:290
303547999392,33cyclictest3094209-21grep09:55:270
3035490993830,4cyclictest0-21swapper/212:40:002
303548699387,6cyclictest3108524-21seq10:37:581
303548699385,8cyclictest3131178-21date11:45:011
3035486993812,6cyclictest3137632-21tr12:05:161
3035486993812,4cyclictest231ktimers/108:50:191
3035486993812,4cyclictest0-21swapper/112:15:161
3035486993812,4cyclictest0-21swapper/112:15:161
303548699381,10cyclictest3089060-21grep09:40:271
3035479993831,4cyclictest3133173-21fschecks_count11:50:160
3035479993827,7cyclictest3055189-21cron08:05:000
3035479993827,7cyclictest3055189-21cron08:05:000
3035496993728,6cyclictest3103387-21auditctl10:25:003
3035490993727,6cyclictest0-21swapper/212:20:262
303548699371,11cyclictest3058007-21wc08:10:241
303548699371,10cyclictest3129383-21sh11:40:011
303548699371,10cyclictest3042279-21wc07:25:271
3035496993627,6cyclictest391ktimers/311:25:153
3035490993628,4cyclictest0-21swapper/208:25:442
3035490993628,4cyclictest0-21swapper/207:40:012
3035490993623,8cyclictest3049451-21grep07:45:232
303548699369,5cyclictest0-21swapper/110:25:021
303548699369,5cyclictest0-21swapper/107:35:261
303548699367,6cyclictest3124154-21seq11:23:331
3035486993628,4cyclictest0-21swapper/108:05:151
3035486993627,6cyclictest0-21swapper/109:30:251
3035479993626,7cyclictest3117244-21apt11:05:000
3035479993626,6cyclictest3082272-21grep09:20:260
3035479993625,7cyclictest3092448-21grep09:50:250
3035490993528,4cyclictest3122112-21unixbench_multi11:15:252
3035490993528,4cyclictest3122112-21unixbench_multi11:15:252
3035490993528,4cyclictest0-21swapper/208:00:012
3035490993525,6cyclictest0-21swapper/209:55:172
3035486993528,4cyclictest3060301-21sh08:20:011
3035486993526,6cyclictest3115061-21unixbench_multi10:55:281
303548699351,4cyclictest3079072-21apt09:15:001
3035486993513,3cyclictest3082713-21latency_hist09:25:011
3035486993512,5cyclictest231ktimers/111:10:191
3035486993512,5cyclictest231ktimers/111:10:191
303548699351,12cyclictest3131444-21df_inode11:45:141
3035479993528,4cyclictest3047901-21kworker/u8:0+events_unbound07:55:280
3035479993527,4cyclictest0-21swapper/007:15:000
3035479993527,4cyclictest0-21swapper/007:15:000
3035490993426,4cyclictest0-21swapper/207:20:002
3035490993425,6cyclictest3090764-21grep09:45:282
303548699349,7cyclictest3076402-21cat09:05:221
303548699341,11cyclictest3103379-21cron10:25:001
3035479993426,4cyclictest0-21swapper/008:25:410
3035479993422,9cyclictest121ktimers/010:35:120
3035479993421,9cyclictest3046460-21sendmail07:40:010
3035496993325,5cyclictest3121549-21grep11:15:203
3035496993325,5cyclictest3121549-21grep11:15:203
3035496993325,4cyclictest0-21swapper/310:25:293
3035496993325,4cyclictest0-21swapper/310:05:003
3035496993324,6cyclictest0-21swapper/312:15:003
3035490993325,4cyclictest0-21swapper/207:20:162
3035486993323,6cyclictest0-21swapper/108:35:271
3035486993312,3cyclictest637-21runrttasks12:04:281
3035486993312,2cyclictest0-21swapper/111:15:171
3035486993312,2cyclictest0-21swapper/111:15:171
3035486993311,4cyclictest231ktimers/112:13:151
3035479993324,5cyclictest3058124-21unixbench_multi08:10:250
3035490993226,3cyclictest0-21swapper/208:25:012
3035490993223,6cyclictest0-21swapper/208:15:212
3035490993221,8cyclictest3120443-21grep11:10:302
3035490993221,8cyclictest3120443-21grep11:10:292
303548699326,5cyclictest3146173-21/usr/sbin/munin12:30:171
303548699322,9cyclictest3113814-21cron10:55:001
3035486993222,6cyclictest0-21swapper/108:40:171
3035479993225,4cyclictest0-21swapper/007:40:250
3035479993225,3cyclictest0-21swapper/011:40:010
3035479993224,5cyclictest11-21ksoftirqd/011:40:130
3035479993223,6cyclictest3087819-21idleruntime-cro09:40:000
3035479993222,6cyclictest3143415-21grep12:20:260
3035496993124,4cyclictest0-21swapper/311:40:013
3035496993124,4cyclictest0-21swapper/308:45:143
3035496993123,4cyclictest0-21swapper/309:50:583
3035496993123,4cyclictest0-21swapper/309:20:263
3035496993123,4cyclictest0-21swapper/307:35:273
3035496993121,7cyclictest3036390-21tr07:10:223
3035496993121,7cyclictest3036390-21tr07:10:223
3035490993124,4cyclictest3132356-21tail11:45:252
3035490993123,4cyclictest3127227-21tail11:30:262
3035490993123,4cyclictest0-21swapper/212:05:122
3035490993121,6cyclictest0-21swapper/210:20:292
3035490993120,9cyclictest3043048-21grep07:30:012
3035490993120,8cyclictest3099957-21cron10:15:012
3035490993120,7cyclictest0-21swapper/212:15:012
3035490993119,7cyclictest0-21swapper/209:50:252
3035486993122,6cyclictest0-21swapper/109:00:261
3035486993121,6cyclictest0-21swapper/110:10:261
3035486993110,3cyclictest3100540-21taskset10:15:191
3035479993124,4cyclictest3112127-21latency_hist10:50:000
3035479993124,4cyclictest0-21swapper/008:55:260
3035496993023,4cyclictest3060316-21sendmail08:20:013
3035496993023,3cyclictest0-21swapper/310:50:243
3035496993021,6cyclictest0-21swapper/308:35:013
3035496993021,5cyclictest0-21swapper/307:25:223
3035490993018,7cyclictest3054715-21grep08:00:272
3035490993018,7cyclictest3054715-21grep08:00:272
3035479993023,5cyclictest11-21ksoftirqd/010:10:140
3035479993019,6cyclictest0-21swapper/007:45:230
3035479993013,15cyclictest11-21ksoftirqd/011:55:130
3035496992922,4cyclictest0-21swapper/308:55:263
3035496992921,4cyclictest0-21swapper/310:10:263
3035496992921,4cyclictest0-21swapper/309:20:013
3035496992921,4cyclictest0-21swapper/307:20:263
3035496992918,7cyclictest3130684-21grep11:40:263
3035490992922,5cyclictest3129026-21kworker/u8:2+events_unbound11:56:202
3035490992921,4cyclictest0-21swapper/211:50:262
3035490992916,5cyclictest3147044-21kworker/u8:2+events_unbound12:34:402
3035486992911,5cyclictest0-21swapper/112:20:171
3035479992923,3cyclictest0-21swapper/010:05:200
3035479992923,3cyclictest0-21swapper/010:05:190
3035479992922,4cyclictest3078629-21grep09:10:290
3035479992920,6cyclictest11-21ksoftirqd/012:05:080
3035479992920,5cyclictest0-21swapper/012:30:250
3035496992824,2cyclictest0-21swapper/309:30:113
3035496992821,4cyclictest3075662-21sh09:05:013
3035496992821,4cyclictest0-21swapper/311:45:263
3035496992821,4cyclictest0-21swapper/309:35:563
3035496992820,5cyclictest3068371-21grep08:40:273
3035496992820,5cyclictest0-21swapper/308:10:253
3035490992822,3cyclictest0-21swapper/210:25:172
3035490992821,4cyclictest0-21swapper/209:35:182
3035490992820,4cyclictest0-21swapper/209:20:172
3035490992819,6cyclictest0-21swapper/209:00:022
3035486992822,3cyclictest0-21swapper/107:30:271
3035486992821,4cyclictest0-21swapper/111:25:161
3035479992821,5cyclictest3092874-21kworker/u8:2+events_unbound10:01:000
3035479992821,3cyclictest0-21swapper/012:15:000
3035496992721,3cyclictest0-21swapper/310:40:253
3035496992720,4cyclictest0-21swapper/312:25:283
3035496992720,4cyclictest0-21swapper/309:45:163
3035496992719,4cyclictest0-21swapper/310:55:283
3035496992718,5cyclictest3117243-21debian-sa111:05:003
3035490992721,3cyclictest0-21swapper/209:30:252
3035490992720,4cyclictest0-21swapper/211:00:002
303547999279,14cyclictest0-21swapper/008:40:010
3035479992719,6cyclictest0-21swapper/008:35:010
3035479992717,7cyclictest121ktimers/010:30:130
3035479992717,6cyclictest0-21swapper/011:10:290
3035479992717,6cyclictest0-21swapper/011:10:290
3035496992618,5cyclictest0-21swapper/308:20:273
3035496992617,5cyclictest0-21swapper/307:50:263
3035496992617,5cyclictest0-21swapper/307:45:013
3035490992620,3cyclictest0-21swapper/211:40:022
3035490992620,3cyclictest0-21swapper/210:20:022
3035490992620,3cyclictest0-21swapper/208:55:012
3035490992618,4cyclictest0-21swapper/211:30:002
3035490992615,8cyclictest1-21systemd07:40:242
303548699263,4cyclictest3136206-21latency_hist12:00:001
3035479992619,4cyclictest0-21swapper/009:45:280
3035479992617,6cyclictest13650irq/42-30be0000.ethernet11:25:160
3035496992518,4cyclictest0-21swapper/311:55:263
3035496992516,6cyclictest3063352-21grep08:25:433
3035496992514,8cyclictest0-21swapper/307:45:193
3035490992517,6cyclictest3070158-21kworker/u8:1+events_unbound09:05:502
3035490992517,5cyclictest0-21swapper/209:40:182
3035490992516,6cyclictest0-21swapper/211:40:192
3035486992516,6cyclictest0-21swapper/108:25:411
3035479992518,5cyclictest0-21swapper/010:25:000
3035479992518,3cyclictest0-21swapper/009:00:260
3035479992517,5cyclictest3137041-21cat12:05:010
303547999251,20cyclictest0-21swapper/007:54:090
3035496992418,3cyclictest0-21swapper/310:15:243
3035496992417,4cyclictest3039159-21tail07:15:253
3035496992416,5cyclictest0-21swapper/311:10:293
3035496992416,5cyclictest0-21swapper/311:10:293
3035496992416,5cyclictest0-21swapper/309:55:263
3035490992417,5cyclictest3136493-21kworker/u8:0+events_unbound12:01:192
3035486992418,3cyclictest0-21swapper/111:00:281
3035479992418,3cyclictest0-21swapper/011:15:260
3035479992418,3cyclictest0-21swapper/011:15:260
3035479992418,2cyclictest0-21swapper/009:30:250
3035479992417,5cyclictest3143618-21kworker/u8:0+events_unbound12:26:240
303547999241,3cyclictest3131566-21perl11:45:160
303547999241,3cyclictest0-21swapper/008:09:580
303547999241,19cyclictest0-21swapper/010:53:350
303547999241,19cyclictest0-21swapper/009:41:440
303547999241,19cyclictest0-21swapper/008:54:380
3035479992411,11cyclictest3114293-21/usr/sbin/munin10:55:170
3035496992317,3cyclictest0-21swapper/311:50:203
3035496992317,3cyclictest0-21swapper/308:35:233
3035496992316,4cyclictest440-21cron12:05:003
3035496992315,6cyclictest391ktimers/308:00:223
3035496992315,6cyclictest391ktimers/308:00:223
3035496992315,5cyclictest3076108-21seq09:05:183
3035496992315,4cyclictest0-21swapper/311:05:253
3035496992315,4cyclictest0-21swapper/309:10:523
3035490992316,3cyclictest0-21swapper/208:35:012
3035490992315,5cyclictest0-21swapper/207:15:012
3035490992315,4cyclictest4109215-1kworker/2:2H+kblockd11:10:012
3035490992313,7cyclictest3113415-21sed10:50:242
303549099231,14cyclictest0-21swapper/208:41:142
3035486992317,4cyclictest3036232-21systemd07:10:201
3035486992317,4cyclictest3036232-21systemd07:10:201
303547999231,8cyclictest3040108-21/usr/sbin/munin07:20:160
3035479992316,4cyclictest13950irq/36-mmc110:20:010
3035479992314,6cyclictest121ktimers/008:45:110
3035479992314,5cyclictest3104837-21grep10:25:290
303547999231,18cyclictest0-21swapper/011:07:340
303547999231,18cyclictest0-21swapper/010:44:060
303547999231,18cyclictest0-21swapper/009:27:510
303547999231,18cyclictest0-21swapper/009:16:200
303547999231,18cyclictest0-21swapper/009:07:030
303547999231,18cyclictest0-21swapper/008:21:000
3035496992216,3cyclictest0-21swapper/312:35:253
3035496992215,4cyclictest0-21swapper/312:20:003
3035496992215,4cyclictest0-21swapper/312:20:003
3035496992214,5cyclictest391ktimers/310:05:193
3035496992214,5cyclictest391ktimers/310:05:193
3035496992211,8cyclictest3055538-21df_inode08:05:143
3035490992216,3cyclictest0-21swapper/211:20:142
3035490992216,3cyclictest0-21swapper/210:40:162
3035490992216,3cyclictest0-21swapper/210:30:212
3035490992216,3cyclictest0-21swapper/209:00:252
3035490992214,6cyclictest311ktimers/210:00:152
3035490992213,6cyclictest0-21swapper/207:10:272
3035486992215,4cyclictest3073009-21ntpq08:55:211
3035486992214,5cyclictest0-21swapper/108:50:001
3035486992212,6cyclictest0-21swapper/109:25:271
303547999221,17cyclictest0-21swapper/011:31:260
3035496992115,4cyclictest391ktimers/310:45:203
3035496992115,3cyclictest3137202-21sh12:05:113
3035496992114,4cyclictest3146900-21head12:30:253
3035496992114,3cyclictest0-21swapper/312:25:013
3035496992113,4cyclictest0-21swapper/310:30:253
3035496992112,6cyclictest3083042-21ls09:25:153
3035490992115,3cyclictest0-21swapper/210:10:002
3035490992115,3cyclictest0-21swapper/210:10:002
3035490992110,8cyclictest3116654-21seq11:00:282
3035486992114,4cyclictest231ktimers/109:38:211
3035486992112,6cyclictest3064965-21unixbench_multi08:30:251
3035486992112,6cyclictest0-21swapper/112:35:271
303547999211,18cyclictest0-21swapper/007:16:390
3035479992111,7cyclictest3068389-21grep08:40:270
3035496992013,4cyclictest0-21swapper/311:20:263
3035496991913,4cyclictest0-21swapper/308:50:223
3035490991914,3cyclictest3107930-21sendmail_mailst10:35:232
3035490991913,3cyclictest3077750-21fschecks_count09:10:172
3035496991813,3cyclictest0-21swapper/307:30:203
3035490991811,5cyclictest0-21swapper/210:45:202
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional