You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-29 - 21:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Fri May 29, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
34464979913933,68cyclictest0-21swapper/012:04:130
34464989910294,5cyclictest231ktimers/112:04:131
344649799801,70cyclictest3456769-21/usr/sbin/munin08:35:240
344649799721,63cyclictest3479027-21sshd10:50:200
344649799711,63cyclictest3489443-21/usr/sbin/munin11:50:250
344649799711,2cyclictest0-21swapper/012:00:010
344649799691,4cyclictest3448423-21memory07:20:260
344649799683,8cyclictest1-21systemd08:50:160
344649799681,4cyclictest3493360-21perl12:10:190
344649799681,4cyclictest3486842-21meminfo11:35:230
3446498996613,25cyclictest3472079-21/usr/sbin/munin10:10:191
344649799661,62cyclictest3486003-21/usr/sbin/munin11:30:250
344649799661,61cyclictest3473965-21grep10:20:200
344649799661,5cyclictest0-21swapper/009:10:110
344649799661,59cyclictest0-21swapper/009:35:120
344649899658,25cyclictest0-21swapper/112:30:011
344649799652,3cyclictest3462868-21irqstats09:15:220
344649799651,4cyclictest3471310-21df_inode10:05:180
344649799651,4cyclictest3459630-21awk08:55:280
3446497996440,21cyclictest3456043-21munin-plugin-st08:29:590
3446497996434,25cyclictest0-21swapper/007:15:010
344649799642,4cyclictest3481268-21sshd11:03:200
344649799642,4cyclictest3457726-21perl08:45:170
344649799641,5cyclictest3473089-21grep10:15:210
344649799633,56cyclictest0-21swapper/007:30:270
344649799632,55cyclictest3484224-21cut11:20:210
344649799631,5cyclictest3492501-21perl12:05:200
344649799631,3cyclictest3454421-21fschecks_count08:15:180
344649799622,5cyclictest3457357-21wc08:45:000
344649799622,3cyclictest3451234-21latency_hist07:50:000
3446497996218,39cyclictest0-21swapper/010:45:260
3446497996218,39cyclictest0-21swapper/010:45:260
344649799621,56cyclictest3453578-21phc2sys08:05:250
344649799621,53cyclictest3481487-21apt-get11:05:110
344649799621,53cyclictest3481487-21apt-get11:05:100
344649799621,33cyclictest3446655-21latency_hist07:10:010
344649799613,4cyclictest3497335-21sort12:35:010
344649799613,4cyclictest3476661-21/usr/sbin/munin10:35:260
3446497996124,32cyclictest0-21swapper/010:10:210
344649799611,58cyclictest3485336-21grep11:25:260
344649799611,57cyclictest3467154-21fschecks_time09:40:200
344649799611,3cyclictest3482395-21diskstats11:10:160
344649799601,57cyclictest0-21swapper/009:20:240
344649799593,53cyclictest0-21swapper/009:00:260
3446497995921,6cyclictest0-21swapper/010:25:300
3446497995920,34cyclictest0-21swapper/010:00:190
344649799591,19cyclictest0-21swapper/009:35:010
3446497995822,32cyclictest0-21swapper/011:45:270
3446497995822,32cyclictest0-21swapper/011:45:270
344649799581,3cyclictest3496008-21meminfo12:25:250
3446497995810,14cyclictest0-21swapper/009:55:010
3446497995810,14cyclictest0-21swapper/009:55:000
344649799572,52cyclictest0-21swapper/010:55:190
344649799572,23cyclictest3468547-21latency_hist09:50:010
3446497995717,5cyclictest0-21swapper/009:55:210
344649799571,54cyclictest0-21swapper/011:15:160
3446497995627,26cyclictest20850irq/208-8000000.ethernet07:20:010
344649799562,51cyclictest0-21swapper/009:25:290
344649799561,53cyclictest0-21swapper/012:20:260
344649799561,4cyclictest3452835-21/usr/sbin/munin08:00:270
344649799551,52cyclictest0-21swapper/010:40:250
3446500995423,13cyclictest30-21rcuc/212:04:132
3446497995415,8cyclictest0-21swapper/011:40:260
344649799541,3cyclictest3451588-21irqstats07:50:190
344649799541,3cyclictest3450268-21apt07:40:100
344649799541,3cyclictest3450268-21apt07:40:100
344649799531,49cyclictest3475486-21grep10:30:130
344649799531,30cyclictest0-21swapper/007:37:250
3446498995241,8cyclictest3447550-21latency_hist07:15:021
3446498995239,9cyclictest0-21swapper/111:00:021
3446497995219,7cyclictest3494590-21grep12:15:270
344649799521,48cyclictest3448967-21sshd07:28:220
3446498995113,15cyclictest22-21rcuc/110:10:011
344649799511,29cyclictest0-21swapper/008:22:120
344649799511,29cyclictest0-21swapper/008:22:110
344649799501,30cyclictest0-21swapper/012:36:270
344650099491,40cyclictest0-21swapper/209:45:012
3446498994940,5cyclictest0-21swapper/109:35:271
3446498994911,16cyclictest3474641-21/usr/sbin/munin10:25:201
344649799491,27cyclictest0-21swapper/008:10:380
344649799481,26cyclictest0-21swapper/007:59:040
3446498994736,6cyclictest3474335-21grep10:20:281
3446498994716,7cyclictest0-21swapper/108:50:011
3446498994715,25cyclictest2-21kthreadd09:44:251
3446500994628,10cyclictest0-21swapper/207:15:052
3446498994640,4cyclictest231ktimers/109:30:021
3446498994621,7cyclictest22-21rcuc/107:50:011
3446498994615,26cyclictest231ktimers/110:40:241
3446500994534,4cyclictest47-21kauditd07:40:002
3446500994533,8cyclictest3463443-21latency_hist09:20:012
3446500994532,8cyclictest3447266-21unixbench_singl07:10:272
344649799451,31cyclictest0-21swapper/008:33:120
344649799441,41cyclictest0-21swapper/009:05:180
3446498994334,5cyclictest0-21swapper/111:15:001
3446498994319,19cyclictest3454313-21/usr/sbin/munin08:15:161
3446500994236,3cyclictest3457111-21sendmail08:40:012
3446500994230,8cyclictest0-21swapper/212:30:292
3446500994229,8cyclictest0-21swapper/208:45:242
3446500994227,10cyclictest0-21swapper/211:10:272
344650099421,3cyclictest0-21swapper/210:05:012
3446498994223,8cyclictest0-21swapper/112:35:191
3446498994211,12cyclictest3479494-21apt-get10:55:011
3446500994130,7cyclictest0-21swapper/211:45:272
3446500994130,7cyclictest0-21swapper/211:45:272
3446500994128,8cyclictest0-21swapper/209:10:282
3446500994126,10cyclictest0-21swapper/210:55:012
3446498994116,13cyclictest22-21rcuc/109:10:021
3446498994111,24cyclictest0-21swapper/111:50:261
3446500994020,9cyclictest0-21swapper/209:25:012
344649899409,17cyclictest3462607-21/usr/sbin/munin09:15:181
344649899409,13cyclictest3455400-21/usr/sbin/munin08:25:191
3446498994031,6cyclictest231ktimers/111:45:211
3446498994031,6cyclictest231ktimers/111:45:211
3446498994030,6cyclictest3451854-21grep07:50:241
3446500993928,6cyclictest3465490-21lsblk09:30:202
3446500993925,9cyclictest0-21swapper/211:00:202
3446500993925,8cyclictest0-21swapper/212:05:282
3446500993925,8cyclictest0-21swapper/211:55:282
3446500993923,8cyclictest0-21swapper/210:05:252
3446500993923,11cyclictest311ktimers/210:25:162
3446500993829,4cyclictest0-21swapper/211:20:212
3446500993825,8cyclictest0-21swapper/210:55:302
344649899384,15cyclictest24-21ksoftirqd/112:00:011
3446498993828,6cyclictest0-21swapper/111:00:291
3446498993824,7cyclictest0-21swapper/112:20:251
3446498993822,8cyclictest0-21swapper/110:35:281
3446500993729,5cyclictest0-21swapper/212:35:272
3446500993728,4cyclictest0-21swapper/211:40:172
3446500993727,7cyclictest0-21swapper/208:00:272
3446500993726,7cyclictest3478657-21munin-plugin-st10:50:002
3446500993726,7cyclictest3478657-21munin-plugin-st10:49:592
3446500993725,8cyclictest0-21swapper/211:25:262
3446500993725,8cyclictest0-21swapper/208:15:262
3446500993725,7cyclictest3459779-21grep08:55:302
3446500993724,7cyclictest0-21swapper/210:35:292
3446500993710,18cyclictest3493158-21/usr/sbin/munin12:10:172
3446498993727,6cyclictest0-21swapper/108:50:271
344649899371,28cyclictest1660-21snmpd09:24:581
3446500993626,6cyclictest3489649-21grep11:50:292
3446500993626,6cyclictest0-21swapper/212:20:272
344649899363,27cyclictest22-21rcuc/109:50:151
344649899363,27cyclictest22-21rcuc/109:50:151
3446498993627,6cyclictest231ktimers/110:20:001
3446498993626,7cyclictest231ktimers/110:45:121
3446498993626,7cyclictest231ktimers/110:45:121
3446498993626,6cyclictest0-21swapper/110:30:271
3446498993620,10cyclictest0-21swapper/112:15:201
3446500993524,7cyclictest0-21swapper/210:00:012
3446500993524,6cyclictest3449787-21grep07:30:282
3446500993523,8cyclictest0-21swapper/211:15:272
3446498993528,3cyclictest3460728-21munin-plugin-st09:05:001
3446498993524,7cyclictest231ktimers/112:05:111
3446498993524,7cyclictest0-21swapper/107:30:271
3446498993518,6cyclictest3465029-21kworker/u8:2+rpciod09:46:241
3446500993424,7cyclictest0-21swapper/207:40:292
3446500993424,7cyclictest0-21swapper/207:40:292
3446500993424,5cyclictest0-21swapper/208:44:592
3446500993423,6cyclictest3469390-21grep09:55:012
3446500993423,6cyclictest3469390-21grep09:55:012
3446498993427,4cyclictest3484194-21fschecks_time11:20:211
3446498993426,5cyclictest231ktimers/108:55:211
3446498993426,5cyclictest231ktimers/107:15:041
3446498993425,6cyclictest231ktimers/108:05:001
3446498993424,5cyclictest0-21swapper/108:35:201
344649899341,28cyclictest0-21swapper/109:55:251
3446500993325,4cyclictest0-21swapper/209:35:252
3446500993325,4cyclictest0-21swapper/207:50:162
3446500993324,6cyclictest3477700-21unixbench_multi10:40:282
3446500993324,6cyclictest3475478-21/usr/sbin/munin10:30:142
3446500993324,4cyclictest0-21swapper/212:15:172
3446500993323,7cyclictest0-21swapper/208:25:282
3446500993320,9cyclictest0-21swapper/207:25:002
3446498993323,7cyclictest231ktimers/110:00:281
344649899332,25cyclictest0-21swapper/107:39:281
3446498993316,10cyclictest24-21ksoftirqd/111:30:011
344649899331,24cyclictest3465029-21kworker/u8:2+rpciod09:34:231
3446500993223,7cyclictest3486286-21grep11:30:302
3446500993223,5cyclictest0-21swapper/211:05:272
3446500993223,5cyclictest0-21swapper/211:05:272
3446498993225,4cyclictest231ktimers/107:20:211
3446498993225,4cyclictest167450irq/126-8000000.ethernet-tx111:40:201
3446498993224,6cyclictest231ktimers/112:10:151
3446498993224,6cyclictest231ktimers/107:30:011
3446498993220,7cyclictest231ktimers/111:35:161
3446500993123,4cyclictest0-21swapper/210:15:262
3446500993122,6cyclictest3458966-21grep08:50:282
3446500993121,6cyclictest0-21swapper/209:25:282
344650099311,28cyclictest0-21swapper/209:05:202
3446498993125,3cyclictest2-21kthreadd08:06:191
3446498993124,4cyclictest231ktimers/112:30:291
3446498993123,5cyclictest0-21swapper/108:41:241
344649899311,24cyclictest0-21swapper/111:30:171
344649899311,21cyclictest0-21swapper/111:05:111
344649899311,21cyclictest0-21swapper/111:05:111
3446500993021,5cyclictest0-21swapper/210:20:282
3446500993018,8cyclictest0-21swapper/210:10:292
344649899302,7cyclictest0-21swapper/107:41:201
344649899302,7cyclictest0-21swapper/107:41:201
3446498993022,5cyclictest231ktimers/107:55:021
3446498993022,4cyclictest231ktimers/111:20:001
3446498993018,9cyclictest0-21swapper/109:10:281
3446500992920,7cyclictest0-21swapper/212:25:302
3446500992919,7cyclictest0-21swapper/209:00:272
344649899291,22cyclictest0-21swapper/108:32:221
3446500992819,5cyclictest0-21swapper/208:05:262
3446500992815,8cyclictest0-21swapper/207:50:012
344649899282,6cyclictest0-21swapper/108:21:241
344649899282,6cyclictest0-21swapper/108:21:241
3446500992716,6cyclictest0-21swapper/209:45:292
3446498992720,5cyclictest231ktimers/107:10:011
344649899271,4cyclictest0-21swapper/108:14:201
3446500992616,7cyclictest3487080-21grep11:35:282
3446500992614,7cyclictest3452174-21sshd07:57:212
3446500992515,7cyclictest3454107-21dropbear08:14:352
3446500992515,4cyclictest0-21swapper/207:30:012
3446500992415,6cyclictest0-21swapper/208:25:022
3446500992415,6cyclictest0-21swapper/208:25:022
3446500992013,3cyclictest0-21swapper/208:35:012
3446500992010,4cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional