You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-21 - 22:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Thu May 21, 2026 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
58382799991,61cyclictest0-21swapper/111:35:011
58382799771,45cyclictest0-21swapper/110:05:011
58382799741,68cyclictest0-21swapper/110:35:021
58382799741,68cyclictest0-21swapper/110:35:021
58382799727,53cyclictest637170-21/usr/sbin/munin12:20:181
58382799711,39cyclictest0-21swapper/107:45:021
58382799661,51cyclictest0-21swapper/107:55:131
583827996526,32cyclictest0-21swapper/110:20:291
58382699651,27cyclictest604770-21rm09:10:000
583827996438,22cyclictest586606-21cron07:25:001
58382799641,41cyclictest0-21swapper/112:00:021
58382799641,41cyclictest0-21swapper/112:00:021
58382799611,47cyclictest583821-21cyclictest12:35:141
58382799611,47cyclictest583821-21cyclictest12:35:141
58382799611,2cyclictest0-21swapper/111:05:111
583827996020,32cyclictest0-21swapper/111:45:281
58382799601,50cyclictest584500-21/usr/sbin/munin07:10:271
58382799601,50cyclictest584500-21/usr/sbin/munin07:10:271
583827995926,28cyclictest594933-21grep08:10:271
58382799591,52cyclictest0-21swapper/109:10:221
58382799591,45cyclictest0-21swapper/108:00:131
58382699595,34cyclictest15-21rcuc/010:20:200
58382799582,47cyclictest624092-21grep11:00:271
58382799581,2cyclictest0-21swapper/110:30:131
58382799572,47cyclictest588498-21/usr/sbin/munin07:35:141
58382799572,47cyclictest588498-21/usr/sbin/munin07:35:131
58382799571,49cyclictest634273-21/usr/sbin/munin12:00:281
58382799571,49cyclictest598709-21/usr/sbin/munin08:35:281
58382799571,2cyclictest0-21swapper/108:40:131
58382799562,47cyclictest602711-21sshd08:55:261
58382799562,47cyclictest602711-21sshd08:55:251
58382799561,48cyclictest636671-21/usr/sbin/munin12:15:281
58382799561,47cyclictest630532-21/usr/sbin/munin11:40:211
58382799561,2cyclictest0-21swapper/111:15:131
58382799552,45cyclictest610044-21diskstats09:40:161
583827995516,32cyclictest0-21swapper/111:10:281
58382799551,47cyclictest639365-21/usr/sbin/munin12:30:271
58382799551,47cyclictest606599-21apt-get09:20:151
58382799551,46cyclictest634630-21/usr/sbin/munin12:05:291
58382799551,46cyclictest622170-21/usr/sbin/munin10:50:231
58382799551,46cyclictest595323-21/usr/sbin/munin08:15:201
58382799551,46cyclictest595323-21/usr/sbin/munin08:15:201
58382799551,46cyclictest585116-21apt-get07:15:141
58382799551,45cyclictest611987-21/usr/sbin/munin09:50:271
58382799551,44cyclictest591463-21/usr/sbin/munin07:50:271
583830995410,15cyclictest311ktimers/208:00:002
58382799543,44cyclictest635648-21/usr/sbin/munin12:10:221
583827995427,22cyclictest0-21swapper/107:34:591
58382799542,44cyclictest597376-21/usr/sbin/munin08:25:271
58382799542,44cyclictest597376-21/usr/sbin/munin08:25:271
58382799542,43cyclictest632090-21/usr/sbin/munin11:50:271
58382799541,47cyclictest616222-21/usr/sbin/munin10:15:261
58382799541,47cyclictest601206-21sshd08:46:071
58382799541,46cyclictest638372-21/usr/sbin/munin12:25:251
58382799541,46cyclictest608277-21apt-get09:30:151
58382799541,45cyclictest627400-21/usr/sbin/munin11:20:281
58382799541,45cyclictest609114-21munin-node09:35:101
58382799541,44cyclictest603125-21/usr/sbin/munin09:00:291
58382799541,2cyclictest0-21swapper/110:10:131
58382799541,2cyclictest0-21swapper/108:05:181
583830995319,19cyclictest626085-21/usr/sbin/munin11:15:192
58382799533,43cyclictest596706-21unixbench_singl08:20:281
58382799532,44cyclictest621033-21munin-node10:45:101
58382799532,43cyclictest627788-21apt-get11:25:161
58382799532,43cyclictest622783-21diskstats10:55:171
58382799532,42cyclictest612724-21/usr/sbin/munin09:55:211
58382799532,42cyclictest612724-21/usr/sbin/munin09:55:211
58382799531,46cyclictest614804-21sshd10:06:081
58382799531,45cyclictest617569-21munin-node10:25:091
58382799531,44cyclictest589352-21apt-get07:40:161
58382799531,44cyclictest586890-21/usr/sbin/munin07:25:181
583826995334,14cyclictest131ktimers/008:50:160
58382799522,43cyclictest607944-21/usr/sbin/munin09:25:271
58382799522,41cyclictest605736-21apt-get09:15:131
58382799521,44cyclictest620442-21/usr/sbin/munin10:40:241
58382799521,43cyclictest611050-21/usr/sbin/munin09:45:241
583826995242,5cyclictest621559-21unixbench_multi10:45:270
583830995131,9cyclictest0-21swapper/207:50:002
58382799511,43cyclictest597575-21apt-get08:30:051
58382799511,42cyclictest604178-21/usr/sbin/munin09:05:231
58382799511,42cyclictest601492-21/usr/sbin/munin08:50:171
58382699514,14cyclictest0-21swapper/008:15:000
583826995140,6cyclictest0-21swapper/007:25:010
583826995135,12cyclictest0-21swapper/010:10:290
58382799501,46cyclictest630031-21/usr/sbin/munin11:35:301
583830994926,17cyclictest311ktimers/207:25:112
583826994939,7cyclictest616513-21munin-plugin-st10:20:000
58382699491,12cyclictest0-21swapper/009:35:020
583830994812,26cyclictest32-21ksoftirqd/209:45:212
58382699486,15cyclictest0-21swapper/012:30:020
583830994735,8cyclictest0-21swapper/211:00:002
58382699475,5cyclictest0-21swapper/007:30:020
583826994737,7cyclictest613136-21munin-plugin-st10:00:010
583826994737,7cyclictest613136-21munin-plugin-st10:00:000
583830994617,10cyclictest32-21ksoftirqd/208:35:012
583826994625,19cyclictest20650irq/252-8000000.ethernet08:35:230
58382699462,4cyclictest0-21swapper/008:20:270
58382699462,37cyclictest583977-21latency_hist07:10:010
58383099456,8cyclictest14-21rcu_preempt07:20:002
583830994432,9cyclictest0-21swapper/208:45:012
583830994431,9cyclictest639376-21unixbench_multi12:30:282
583830994424,15cyclictest311ktimers/209:05:162
583830994423,14cyclictest311ktimers/207:10:112
583830994423,14cyclictest311ktimers/207:10:112
58382799442,35cyclictest583968-21latency_hist07:10:011
58382699441,6cyclictest628925-21meminfo11:30:230
58382699441,5cyclictest274-21systemd-journal08:17:000
58382699441,5cyclictest274-21systemd-journal08:17:000
583830994335,5cyclictest0-21swapper/207:20:272
583830994330,8cyclictest606321-21grep09:15:292
583830994328,9cyclictest0-21swapper/211:55:282
583830994328,9cyclictest0-21swapper/211:55:282
58382699435,7cyclictest0-21swapper/007:15:020
58382699435,7cyclictest0-21swapper/007:15:010
583826994330,8cyclictest0-21swapper/007:35:260
583826994330,8cyclictest0-21swapper/007:35:260
58382699432,5cyclictest599922-21irqstats08:40:230
583830994233,5cyclictest620744-21munin-run10:44:592
583826994230,8cyclictest0-21swapper/009:40:260
583826994229,8cyclictest0-21swapper/009:45:290
58382699422,5cyclictest623628-21df11:00:160
58382699422,5cyclictest602566-21meminfo08:55:220
58382699422,5cyclictest602566-21meminfo08:55:220
58382699422,37cyclictest0-21swapper/009:35:200
583830994132,5cyclictest0-21swapper/207:55:002
583830994128,9cyclictest0-21swapper/212:10:282
583830994126,8cyclictest0-21swapper/212:35:282
583830994126,8cyclictest0-21swapper/212:35:282
583830994118,16cyclictest311ktimers/207:35:092
583830994118,16cyclictest311ktimers/207:35:092
583826994134,5cyclictest606384-21run-parts09:20:010
583826994127,9cyclictest0-21swapper/008:25:210
583826994127,9cyclictest0-21swapper/008:25:200
583826994126,9cyclictest0-21swapper/009:50:290
583826994125,10cyclictest0-21swapper/009:10:300
58382699411,36cyclictest631424-21irqstats11:45:240
58382699411,35cyclictest619202-21sed10:35:000
583826994112,17cyclictest0-21swapper/012:35:170
583826994112,17cyclictest0-21swapper/012:35:170
583830994031,5cyclictest617316-21grep10:20:302
583830994028,8cyclictest0-21swapper/208:55:202
583830994028,8cyclictest0-21swapper/208:55:202
583830994028,6cyclictest0-21swapper/212:20:282
583830994027,8cyclictest0-21swapper/208:10:292
583830994021,14cyclictest311ktimers/210:45:132
583826994032,4cyclictest0-21swapper/011:15:200
583826994023,15cyclictest167350irq/118-8000000.ethernet-tx009:00:110
58382699401,4cyclictest0-21swapper/012:20:160
583830993927,7cyclictest593267-21grep08:00:282
583830993921,8cyclictest0-21swapper/210:15:292
583826993935,2cyclictest0-21swapper/009:20:110
583826993929,7cyclictest0-21swapper/007:55:300
583826993929,5cyclictest0-21swapper/012:10:290
583826993928,7cyclictest0-21swapper/012:30:290
58382699391,4cyclictest635242-21users12:05:280
58382699391,4cyclictest627004-21df11:20:170
58382699391,36cyclictest0-21swapper/011:35:080
583830993829,5cyclictest14-21rcu_preempt09:10:222
583826993829,6cyclictest594141-21grep08:05:290
583826993827,8cyclictest0-21swapper/011:10:270
583826993827,8cyclictest0-21swapper/010:05:300
583826993827,7cyclictest0-21swapper/011:55:270
583826993827,7cyclictest0-21swapper/011:55:270
583826993827,6cyclictest0-21swapper/007:50:280
583826993826,8cyclictest0-21swapper/011:40:270
58382699381,35cyclictest0-21swapper/010:50:220
58382699381,34cyclictest0-21swapper/008:45:030
58382699381,2cyclictest0-21swapper/010:45:010
583830993726,5cyclictest0-21swapper/209:25:242
583830993715,14cyclictest30-21rcuc/211:25:012
583826993731,4cyclictest20850irq/208-8000000.ethernet07:45:230
583826993728,5cyclictest0-21swapper/010:55:280
583826993726,7cyclictest0-21swapper/007:40:280
58382699372,33cyclictest0-21swapper/010:25:240
583826993717,4cyclictest583449-1kworker/0:2H+mmc_complete10:05:010
58382699371,4cyclictest0-21swapper/009:25:180
58382699371,34cyclictest0-21swapper/008:30:250
583830993628,4cyclictest0-21swapper/211:45:232
583830993623,8cyclictest311ktimers/209:30:112
58383099362,28cyclictest633789-21/usr/sbin/munin12:00:192
583830993621,8cyclictest0-21swapper/208:15:302
583830993621,8cyclictest0-21swapper/208:15:302
583830993621,10cyclictest0-21swapper/210:30:222
58382699361,3cyclictest0-21swapper/012:15:220
58382699361,33cyclictest0-21swapper/011:50:040
583830993526,6cyclictest635167-21grep12:05:262
583830993523,8cyclictest0-21swapper/210:05:292
583830993521,9cyclictest0-21swapper/211:05:192
583830993520,11cyclictest0-21swapper/208:50:202
583826993529,4cyclictest20850irq/208-8000000.ethernet10:35:160
583826993529,4cyclictest20850irq/208-8000000.ethernet10:35:150
583826993528,4cyclictest20850irq/208-8000000.ethernet11:25:190
583830993425,4cyclictest0-21swapper/210:35:272
583830993425,4cyclictest0-21swapper/210:35:272
583830993424,5cyclictest0-21swapper/208:30:282
583830993423,6cyclictest0-21swapper/209:00:212
583830993420,9cyclictest0-21swapper/210:25:262
58383099341,28cyclictest0-21swapper/208:25:212
58383099341,28cyclictest0-21swapper/208:25:202
58383099341,27cyclictest0-21swapper/209:55:162
58383099341,27cyclictest0-21swapper/209:55:152
58382699341,31cyclictest0-21swapper/012:03:300
583830993326,3cyclictest609711-21head09:35:292
58383099331,26cyclictest0-21swapper/212:15:222
583826993327,4cyclictest20850irq/208-8000000.ethernet08:00:210
58382699331,30cyclictest0-21swapper/007:30:280
583830993226,4cyclictest14-21rcu_preempt10:50:282
583830993224,5cyclictest0-21swapper/210:12:132
583830993223,5cyclictest30-21rcuc/211:30:212
583830993220,8cyclictest594121-21grep08:05:282
58382699321,29cyclictest0-21swapper/011:09:260
58382699321,29cyclictest0-21swapper/007:18:090
583830993122,6cyclictest606596-21/usr/sbin/munin09:20:102
583830993122,5cyclictest0-21swapper/211:40:012
583830993120,5cyclictest587651-21/usr/sbin/munin07:30:232
58383099311,28cyclictest0-21swapper/211:50:192
583830993021,6cyclictest596098-21/usr/sbin/munin08:20:222
583830993020,7cyclictest0-21swapper/208:45:292
583830993018,5cyclictest30-21rcuc/211:40:272
583830993017,8cyclictest0-21swapper/209:40:212
583830992922,5cyclictest0-21swapper/212:25:192
583830992918,8cyclictest0-21swapper/211:30:002
583830992918,7cyclictest0-21swapper/210:00:262
583830992915,9cyclictest0-21swapper/207:40:212
58383099281,3cyclictest0-21swapper/211:00:262
58383099271,24cyclictest0-21swapper/211:10:162
583830992619,5cyclictest0-21swapper/209:50:232
58383099193,8cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional