You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-10 - 08:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Sun May 10, 2026 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3007664997265,4cyclictest131ktimers/019:30:000
300766499702,29cyclictest15-21rcuc/000:35:010
3007668996827,36cyclictest0-21swapper/222:40:272
3007668996628,33cyclictest0-21swapper/221:20:002
300766499656,28cyclictest15-21rcuc/020:20:010
3007667996337,21cyclictest0-21swapper/123:20:011
3007667996324,29cyclictest0-21swapper/120:25:231
3007667996324,29cyclictest0-21swapper/120:25:231
3007668996233,23cyclictest0-21swapper/222:45:272
300766899622,16cyclictest3019947-21apt-get20:20:152
300766899614,51cyclictest3057145-21apt-get00:00:022
300766899614,51cyclictest3057145-21apt-get00:00:022
3007668996136,21cyclictest3052922-21cron23:35:012
3007668996115,38cyclictest0-21swapper/222:50:252
3007667996123,32cyclictest0-21swapper/119:20:011
3007667996115,38cyclictest0-21swapper/100:00:001
3007667996115,38cyclictest0-21swapper/100:00:001
3007667996053,4cyclictest1653-21lldpd21:05:121
3007668995933,21cyclictest0-21swapper/223:00:272
3007668995924,26cyclictest0-21swapper/221:00:282
3007668995924,26cyclictest0-21swapper/221:00:282
3007668995919,34cyclictest3030737-21grep21:20:292
3007668995919,33cyclictest0-21swapper/223:45:282
3007668995919,33cyclictest0-21swapper/223:45:282
3007668995914,36cyclictest0-21swapper/223:35:262
3007668995912,39cyclictest3021426-21munin-plugin-st20:30:002
3007668995912,39cyclictest3021426-21munin-plugin-st20:30:002
3007668995820,31cyclictest0-21swapper/219:55:202
3007668995814,38cyclictest1660-21snmpd20:07:252
3007667995834,20cyclictest3048519-21unixbench_multi23:05:281
3007664995851,5cyclictest131ktimers/022:10:010
3007668995711,38cyclictest3011493-21/usr/sbin/munin19:30:192
3007667995717,31cyclictest0-21swapper/119:15:011
3007664995741,12cyclictest3029951-21sendmail21:20:000
300766899566,45cyclictest3050300-21apt-get23:20:022
3007668995612,36cyclictest0-21swapper/221:05:272
300766799569,6cyclictest3056263-21grep23:50:271
3007668995522,28cyclictest0-21swapper/200:25:202
3007668995517,29cyclictest0-21swapper/222:05:282
300766899551,33cyclictest0-21swapper/221:50:002
3007667995522,29cyclictest0-21swapper/123:45:271
3007667995522,29cyclictest0-21swapper/123:45:261
300766899544,10cyclictest3041737-21sed22:25:272
3007668995417,29cyclictest0-21swapper/223:10:272
3007668995416,32cyclictest0-21swapper/200:20:202
3007668995414,30cyclictest0-21swapper/222:20:192
3007668995414,30cyclictest0-21swapper/222:20:192
3007668995411,35cyclictest0-21swapper/200:10:242
3007668995411,35cyclictest0-21swapper/200:10:232
300766799542,9cyclictest3038239-21/usr/sbin/munin22:05:271
3007667995427,21cyclictest3060831-21/usr/sbin/munin00:20:291
3007667995412,33cyclictest0-21swapper/123:10:241
3007668995327,22cyclictest3019425-21phc2sys-jitter20:15:262
3007668995327,21cyclictest0-21swapper/219:35:222
3007668995314,30cyclictest0-21swapper/220:40:232
3007668995313,33cyclictest0-21swapper/220:50:302
300766799533,15cyclictest3015413-21tail19:50:281
3007667995331,17cyclictest3054558-21grep23:40:271
3007667995325,21cyclictest0-21swapper/123:00:271
3007667995319,27cyclictest0-21swapper/122:45:281
3007667995311,35cyclictest0-21swapper/120:55:301
300766499531,48cyclictest3036696-21cron22:00:000
300766899527,35cyclictest0-21swapper/222:15:212
300766899523,6cyclictest3023231-21apt-key20:40:012
300766899523,6cyclictest3023231-21apt-key20:40:002
3007668995216,27cyclictest0-21swapper/219:30:012
300766899521,10cyclictest3031915-21/usr/sbin/munin21:30:202
300766799522,9cyclictest3060055-21/usr/sbin/munin00:15:191
3007667995215,31cyclictest1660-21snmpd20:15:591
3007667995213,29cyclictest0-21swapper/121:25:251
3007667995210,34cyclictest0-21swapper/119:20:271
3007664995242,5cyclictest167350irq/118-8000000.ethernet-tx022:15:170
3007664995214,33cyclictest0-21swapper/021:40:220
3007664995214,33cyclictest0-21swapper/021:40:220
300766899512,9cyclictest3024588-21phc2sys20:45:272
3007668995125,18cyclictest0-21swapper/219:15:272
3007668995122,21cyclictest0-21swapper/221:10:292
3007668995121,23cyclictest3017109-21grep20:00:282
3007668995120,22cyclictest0-21swapper/200:30:252
300766899511,11cyclictest3035534-21/usr/sbin/munin21:50:232
300766899511,10cyclictest3036919-21apt-get22:00:162
3007668995110,31cyclictest0-21swapper/219:20:282
300766799518,6cyclictest0-21swapper/120:40:011
300766799518,6cyclictest0-21swapper/120:40:011
300766799515,12cyclictest3030706-21sed21:20:281
3007667995134,12cyclictest0-21swapper/100:40:001
300766799512,9cyclictest3042868-21grep22:35:011
300766799512,10cyclictest3041070-21sed22:25:021
300766799512,10cyclictest3041070-21sed22:25:011
3007667995119,26cyclictest3025674-21grep20:50:291
3007667995119,25cyclictest0-21swapper/121:40:011
3007667995115,29cyclictest0-21swapper/121:55:001
3007667995115,29cyclictest0-21swapper/119:35:221
3007667995112,31cyclictest231ktimers/121:45:011
3007667995112,31cyclictest231ktimers/121:45:001
300766799511,12cyclictest3018246-21apt-get20:10:141
3007664995113,7cyclictest0-21swapper/000:00:020
3007664995113,7cyclictest0-21swapper/000:00:010
300766899502,9cyclictest3046620-21/usr/sbin/munin22:55:272
300766899502,8cyclictest3050764-21cut23:20:222
300766899502,8cyclictest3018760-21/usr/sbin/munin20:10:292
300766899502,6cyclictest3057788-21phc2sys00:00:272
300766899501,10cyclictest3031008-21apt-get21:25:142
300766799505,36cyclictest0-21swapper/120:05:191
3007667995023,24cyclictest3050607-21/usr/sbin/munin23:20:281
300766799502,10cyclictest3011590-21ssh19:30:181
3007667995013,29cyclictest0-21swapper/121:10:241
300766799501,13cyclictest3036061-21apt-get21:55:151
3007667995010,5cyclictest3022229-21grep20:30:281
3007664995043,4cyclictest167350irq/118-8000000.ethernet-tx022:35:180
3007664995043,4cyclictest167350irq/118-8000000.ethernet-tx022:35:180
3007664995042,6cyclictest0-21swapper/023:35:180
3007664995041,5cyclictest3014672-21munin-plugin-st19:50:010
3007664995041,5cyclictest3014672-21munin-plugin-st19:50:010
300766899499,7cyclictest1660-21snmpd21:37:452
300766899491,9cyclictest3026278-21cut20:55:272
300766899491,9cyclictest3008696-21latency_hist19:15:022
3007668994918,24cyclictest0-21swapper/219:40:202
3007668994916,25cyclictest0-21swapper/221:40:282
3007668994916,25cyclictest0-21swapper/221:40:282
300766899491,10cyclictest3060228-21/usr/sbin/munin00:15:222
300766899491,10cyclictest3036673-21/usr/sbin/munin21:55:282
300766799499,6cyclictest3058014-21grep00:00:281
300766799498,33cyclictest3024837-21grep20:45:291
300766799497,34cyclictest3053690-21grep23:35:291
300766799492,9cyclictest3032017-21lsblk21:30:221
300766799492,9cyclictest3013750-21grep19:40:291
300766799492,10cyclictest3058750-21sendmail_mailqu00:05:281
300766799491,11cyclictest3061974-21memory00:25:261
300766899485,5cyclictest0-21swapper/222:10:212
300766899483,6cyclictest3063539-21sh00:35:222
3007668994822,20cyclictest3014868-21/usr/sbin/munin19:50:172
300766899482,11cyclictest3022313-21wc20:35:002
3007668994810,32cyclictest3042604-21unixbench_multi22:30:282
300766799485,34cyclictest0-21swapper/119:45:211
300766799485,34cyclictest0-21swapper/119:45:211
300766799484,6cyclictest3046442-21sh22:55:231
300766799483,6cyclictest3015769-21df19:55:171
300766799483,11cyclictest3039135-21grep22:10:301
300766799482,9cyclictest3010736-21/usr/sbin/munin19:25:191
300766799482,8cyclictest3045974-21unixbench_multi22:50:261
300766799481,13cyclictest3052285-21/usr/sbin/munin23:30:271
3007664994840,5cyclictest3012134-21grep19:35:000
3007664994821,20cyclictest15-21rcuc/019:55:190
300766499481,9cyclictest0-21swapper/000:30:020
300766899472,10cyclictest3054439-21wc23:40:252
300766899471,12cyclictest3043005-21cut22:35:192
300766899471,12cyclictest3043005-21cut22:35:192
3007668994710,31cyclictest3048522-21tail23:05:282
300766799477,6cyclictest0-21swapper/100:10:281
300766799477,6cyclictest0-21swapper/100:10:281
300766799477,5cyclictest0-21swapper/122:30:001
300766799475,6cyclictest0-21swapper/122:15:301
300766799474,8cyclictest3052251-21grep23:30:001
300766799473,9cyclictest3034904-21unixbench_multi21:45:291
300766799472,12cyclictest3062771-21/usr/sbin/munin00:30:221
300766799472,10cyclictest3043964-21/usr/sbin/munin22:40:201
3007667994710,30cyclictest0-21swapper/120:40:281
300766499472,4cyclictest3026949-21lsblk21:00:210
300766499472,4cyclictest3026949-21lsblk21:00:200
3007664994723,21cyclictest0-21swapper/022:40:170
300766899468,4cyclictest0-21swapper/223:50:252
300766899463,10cyclictest3058670-21/usr/sbin/munin00:05:272
3007664994638,4cyclictest167350irq/118-8000000.ethernet-tx019:50:200
3007664994634,7cyclictest3032413-21grep21:30:290
300766499463,37cyclictest0-21swapper/020:50:270
300766499462,4cyclictest3022265-21munin-run20:35:000
300766899456,5cyclictest0-21swapper/223:25:292
300766799455,32cyclictest0-21swapper/121:15:211
300766799452,6cyclictest0-21swapper/120:00:271
3007667994517,24cyclictest0-21swapper/122:35:201
3007667994517,24cyclictest0-21swapper/122:35:201
300766499451,5cyclictest3037524-21sed22:00:290
300766899447,28cyclictest0-21swapper/219:50:002
300766899447,28cyclictest0-21swapper/219:50:002
300766799445,6cyclictest0-21swapper/120:20:171
300766799442,9cyclictest3036970-21df22:00:171
300766799441,10cyclictest3026976-21tune2fs21:00:221
300766799441,10cyclictest3026976-21tune2fs21:00:211
3007664994437,4cyclictest167350irq/118-8000000.ethernet-tx023:20:250
3007664994437,4cyclictest167350irq/118-8000000.ethernet-tx020:25:230
3007664994437,4cyclictest167350irq/118-8000000.ethernet-tx020:25:230
3007664994437,4cyclictest0-21swapper/022:50:220
300766499436,9cyclictest0-21swapper/023:25:190
300766499434,9cyclictest3050300-21apt-get23:20:010
3007664994336,4cyclictest167350irq/118-8000000.ethernet-tx020:05:280
3007664994335,3cyclictest0-21swapper/019:15:050
300766499432,5cyclictest3031306-21memory21:25:230
3007664994323,7cyclictest3041436-1kworker/0:0H+mmc_complete22:30:020
3007664994237,3cyclictest167350irq/118-8000000.ethernet-tx023:50:180
3007664994228,9cyclictest0-21swapper/022:20:220
3007664994228,9cyclictest0-21swapper/022:20:220
300766499421,3cyclictest3034537-21dropbear21:45:220
3007664994134,4cyclictest0-21swapper/020:45:230
300766499412,4cyclictest3013577-21processes19:40:260
3007664994033,4cyclictest3042706-21munin-plugin-st22:35:000
3007664994028,6cyclictest0-21swapper/000:35:170
3007664994027,6cyclictest0-21swapper/019:15:010
3007664994024,7cyclictest167350irq/118-8000000.ethernet-tx000:10:100
3007664994024,7cyclictest167350irq/118-8000000.ethernet-tx000:10:100
300766499401,3cyclictest3018863-21sshd20:11:500
3007664993933,2cyclictest0-21swapper/022:05:280
300766499392,4cyclictest0-21swapper/023:35:010
300766499391,3cyclictest3057578-21lsblk00:00:200
300766499391,36cyclictest0-21swapper/000:15:180
300766499391,2cyclictest0-21swapper/021:25:000
3007664993912,8cyclictest15-21rcuc/023:15:010
3007668993811,3cyclictest3007767-21latency_hist19:10:012
3007664993831,3cyclictest3046448-21tune2fs22:55:230
3007664993830,5cyclictest0-21swapper/023:05:180
3007664993827,7cyclictest3045152-21grep22:45:290
300766499381,4cyclictest3012820-21mailstats19:35:270
300766499381,35cyclictest0-21swapper/021:06:400
300766499381,32cyclictest3047306-21grep23:00:210
300766499381,2cyclictest0-21swapper/023:50:020
300766799372,7cyclictest3007716-21latency_hist19:10:011
3007664993731,3cyclictest167350irq/118-8000000.ethernet-tx000:20:210
3007664993730,4cyclictest0-21swapper/021:35:140
3007664993729,5cyclictest0-21swapper/000:09:590
3007664993729,4cyclictest3028532-21df_inode21:10:180
3007664993722,14cyclictest0-21swapper/020:59:090
300766499371,3cyclictest3016569-21apt-get20:00:110
300766499371,34cyclictest0-21swapper/020:40:140
3007664993630,4cyclictest0-21swapper/019:24:270
300766499361,33cyclictest0-21swapper/021:52:210
300766499361,24cyclictest3007661-21cyclictest19:10:010
3007664993528,5cyclictest131ktimers/023:45:290
3007664993528,4cyclictest0-21swapper/020:20:220
3007664993426,4cyclictest3023076-21/usr/sbin/munin20:35:280
3007664993426,4cyclictest3023076-21/usr/sbin/munin20:35:280
300766499341,2cyclictest0-21swapper/023:45:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional