You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-05 - 07:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6s.osadl.org (updated Fri Sep 05, 2025 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
608772996448,9cyclictest311ktimers/220:30:132
608768996423,32cyclictest0-21swapper/021:15:290
60877299582,39cyclictest0-21swapper/219:45:012
60877299581,35cyclictest0-21swapper/221:35:012
608771995547,4cyclictest629835-21munin-plugin-st21:10:001
608768995444,5cyclictest131ktimers/021:35:130
608772995345,5cyclictest636687-21munin-plugin-st21:49:592
60877299534,26cyclictest0-21swapper/223:35:022
608772995340,9cyclictest0-21swapper/200:15:012
60877299531,26cyclictest30-21rcuc/221:55:002
60877299521,21cyclictest0-21swapper/200:25:012
60877299521,21cyclictest0-21swapper/200:25:012
60877299511,35cyclictest0-21swapper/200:35:012
608771995140,6cyclictest0-21swapper/119:50:011
60876899511,27cyclictest15-21rcuc/020:20:190
608768995111,27cyclictest662502-21/usr/sbin/munin00:20:230
608768995111,27cyclictest662502-21/usr/sbin/munin00:20:230
608771995039,6cyclictest0-21swapper/122:20:171
608771995036,9cyclictest0-21swapper/100:30:001
60877299491,24cyclictest0-21swapper/223:10:012
608771994838,5cyclictest0-21swapper/120:55:291
608768994837,9cyclictest652067-21munin-plugin-st23:20:010
608772994737,6cyclictest646913-21munin-plugin-st22:50:002
608772994734,8cyclictest0-21swapper/220:45:022
608771994714,27cyclictest231ktimers/100:05:281
60877299461,4cyclictest0-21swapper/221:35:012
60877299461,34cyclictest0-21swapper/223:25:002
60877199467,23cyclictest24-21ksoftirqd/122:30:201
608771994639,4cyclictest47-21kauditd23:25:001
608771994638,5cyclictest658818-21run-parts00:00:001
608771994636,6cyclictest651182-21grep23:10:341
608771994634,8cyclictest648694-21sendmail23:00:001
608771994631,11cyclictest0-21swapper/119:50:221
608771994631,11cyclictest0-21swapper/119:50:211
60876899464,5cyclictest0-21swapper/022:59:590
608768994636,6cyclictest0-21swapper/019:15:070
608768994624,19cyclictest20750irq/251-8000000.ethernet20:10:180
608768994624,16cyclictest131ktimers/020:25:160
60877299459,23cyclictest0-21swapper/219:15:012
608772994533,7cyclictest311ktimers/222:25:162
608771994537,4cyclictest637617-21munin-plugin-st21:55:001
608771994531,9cyclictest610809-21sendmail19:20:001
608771994530,5cyclictest0-21swapper/120:50:021
608771994527,10cyclictest628887-21grep21:00:311
608771994526,11cyclictest0-21swapper/122:40:301
608771994514,25cyclictest231ktimers/123:30:341
608768994518,20cyclictest15-21rcuc/023:50:180
608768994515,17cyclictest15-21rcuc/023:45:010
60877299441,4cyclictest0-21swapper/223:45:022
608771994433,5cyclictest0-21swapper/122:25:291
608771994432,8cyclictest0-21swapper/122:04:591
60876899441,3cyclictest0-21swapper/000:35:000
608772994328,11cyclictest311ktimers/221:20:162
608771994325,10cyclictest0-21swapper/121:25:301
60876899434,5cyclictest0-21swapper/019:45:020
60876899431,8cyclictest654854-21/usr/sbin/munin23:35:170
60876899431,25cyclictest27350irq/343-s-wl18xx22:35:010
608772994231,6cyclictest311ktimers/200:05:152
608772994225,12cyclictest0-21swapper/221:05:012
608771994232,5cyclictest0-21swapper/120:25:311
608771994230,7cyclictest655453-21sendmail23:39:591
608771994227,10cyclictest0-21swapper/121:55:231
60876899422,5cyclictest623290-21perl20:30:230
60876899421,35cyclictest0-21swapper/021:50:040
60877299417,15cyclictest30-21rcuc/219:40:012
608772994133,4cyclictest168450irq/135-8000000.ethernet-tx222:50:042
608772994132,5cyclictest0-21swapper/223:15:002
608772994130,6cyclictest0-21swapper/221:05:292
608772994130,6cyclictest0-21swapper/220:55:312
608772994129,8cyclictest311ktimers/222:20:122
60877299411,18cyclictest0-21swapper/223:05:012
60877299411,18cyclictest0-21swapper/223:05:012
608771994131,5cyclictest0-21swapper/120:20:291
608771994129,8cyclictest0-21swapper/120:10:201
608771994129,7cyclictest0-21swapper/123:25:271
608771994129,6cyclictest0-21swapper/121:30:291
608771994125,9cyclictest0-21swapper/119:25:341
608771994122,11cyclictest0-21swapper/122:10:281
60876899413,3cyclictest613416-21apt-get19:35:010
60876899411,22cyclictest0-21swapper/021:05:280
608772994031,5cyclictest0-21swapper/220:05:282
60877299402,8cyclictest0-21swapper/220:15:012
608772994023,7cyclictest0-21swapper/219:20:302
608772994023,13cyclictest311ktimers/219:55:142
608772994022,8cyclictest0-21swapper/200:00:282
608772994016,13cyclictest616049-21munin-plugin-st19:49:592
60877299401,29cyclictest0-21swapper/221:20:012
608771994030,5cyclictest623669-21grep20:30:301
608771994023,9cyclictest0-21swapper/119:10:231
608768994033,5cyclictest20950irq/209-8000000.ethernet20:45:010
608768994031,5cyclictest654603-21munin-plugin-st23:35:010
608768994031,4cyclictest0-21swapper/019:29:590
608768994029,8cyclictest630766-21munin-plugin-st21:15:010
608768994028,8cyclictest0-21swapper/019:15:020
608768994027,3cyclictest0-21swapper/020:52:180
60876899402,30cyclictest639469-21latency_hist22:05:010
60876899401,7cyclictest665435-21/usr/sbin/munin00:35:310
60876899401,2cyclictest0-21swapper/000:15:240
60876899401,27cyclictest0-21swapper/022:10:010
608772993930,5cyclictest14-21rcu_preempt21:25:312
608772993925,10cyclictest0-21swapper/219:15:062
608771993928,7cyclictest634995-21sendmail21:40:001
608771993927,5cyclictest0-21swapper/121:10:281
608771993924,9cyclictest0-21swapper/121:45:271
608771993915,12cyclictest231ktimers/119:40:171
60876899395,21cyclictest14-21rcu_preempt19:55:170
608768993932,4cyclictest0-21swapper/022:40:170
608768993928,7cyclictest0-21swapper/000:05:010
608768993924,9cyclictest0-21swapper/022:10:200
60876899392,22cyclictest20950irq/209-8000000.ethernet23:25:010
60876899391,36cyclictest0-21swapper/022:35:230
60876899391,36cyclictest0-21swapper/020:35:220
608772993825,7cyclictest0-21swapper/219:25:262
608772993822,13cyclictest311ktimers/222:55:132
608772993820,11cyclictest0-21swapper/200:15:342
60877299381,4cyclictest0-21swapper/220:55:012
608771993832,4cyclictest0-21swapper/123:15:191
608771993830,3cyclictest0-21swapper/122:40:011
608771993829,4cyclictest0-21swapper/123:00:191
608771993829,4cyclictest0-21swapper/123:00:191
608771993827,5cyclictest614228-21grep19:35:291
608768993830,5cyclictest632346-21grep21:20:300
608768993823,4cyclictest0-21swapper/020:45:150
60876899381,6cyclictest0-21swapper/021:35:000
60876899381,4cyclictest650744-21grep23:10:260
60876899381,4cyclictest0-21swapper/019:20:160
608768993813,13cyclictest0-21swapper/022:50:050
60876899381,21cyclictest0-21swapper/022:25:220
608772993721,9cyclictest0-21swapper/220:35:312
608771993729,5cyclictest231ktimers/120:35:221
608771993728,6cyclictest231ktimers/100:01:361
608771993726,6cyclictest663051-21grep00:20:321
608771993726,6cyclictest663051-21grep00:20:311
608771993725,8cyclictest0-21swapper/120:00:291
608771993724,8cyclictest0-21swapper/120:45:011
608771993722,7cyclictest0-21swapper/119:30:331
608771993718,11cyclictest0-21swapper/100:15:341
608768993730,4cyclictest14-21rcu_preempt21:40:290
608768993724,8cyclictest0-21swapper/020:00:290
60876899371,25cyclictest0-21swapper/020:16:180
608772993627,6cyclictest616333-21/usr/sbin/munin19:50:262
608772993627,6cyclictest616333-21/usr/sbin/munin19:50:262
608772993624,6cyclictest646036-21grep22:40:302
608772993614,16cyclictest168450irq/135-8000000.ethernet-tx223:25:102
608771993630,4cyclictest51-21kcompactd023:05:291
608771993630,3cyclictest617174-21/usr/sbin/munin19:55:201
608771993629,4cyclictest231ktimers/119:20:011
608771993626,6cyclictest664769-21grep00:30:301
608771993626,6cyclictest0-21swapper/121:15:121
60877199362,28cyclictest22-21rcuc/120:15:281
60876899369,8cyclictest659672-21apt-get00:05:010
608768993625,7cyclictest0-21swapper/000:00:010
608768993623,7cyclictest131ktimers/023:50:000
608768993620,12cyclictest131ktimers/000:25:130
608772993527,4cyclictest0-21swapper/219:35:022
608772993526,4cyclictest0-21swapper/223:35:222
60877199357,4cyclictest2-21kthreadd22:53:221
608771993527,4cyclictest0-21swapper/122:45:231
608771993512,16cyclictest231ktimers/123:40:171
608768993526,5cyclictest0-21swapper/022:50:020
60876899351,32cyclictest0-21swapper/022:15:150
608772993425,6cyclictest311ktimers/221:40:132
608772993422,9cyclictest311ktimers/222:00:132
60877199349,8cyclictest24-21ksoftirqd/100:15:011
60877199345,16cyclictest24-21ksoftirqd/122:20:011
608771993425,5cyclictest0-21swapper/121:40:211
608771993423,7cyclictest619442-21grep20:05:281
608771993423,7cyclictest231ktimers/123:50:311
608771993420,8cyclictest231ktimers/119:10:011
60877199341,3cyclictest0-21swapper/120:55:011
608768993427,4cyclictest20950irq/209-8000000.ethernet19:35:010
608768993420,11cyclictest131ktimers/021:45:130
608768993415,4cyclictest0-21swapper/022:23:130
608768993411,20cyclictest0-21swapper/021:00:190
608768993411,12cyclictest0-21swapper/019:47:260
60877299332,4cyclictest637921-21/usr/sbin/munin21:55:202
608772993319,7cyclictest0-21swapper/221:10:262
60877299331,3cyclictest0-21swapper/220:05:012
608771993326,5cyclictest0-21swapper/123:45:311
608771993324,4cyclictest0-21swapper/122:05:201
608768993327,4cyclictest20950irq/209-8000000.ethernet23:25:120
608768993327,4cyclictest20950irq/209-8000000.ethernet21:25:150
608768993327,3cyclictest0-21swapper/021:55:270
608768993321,8cyclictest0-21swapper/023:00:310
608768993321,8cyclictest0-21swapper/023:00:300
608768993310,12cyclictest0-21swapper/019:51:440
608768993310,12cyclictest0-21swapper/019:51:440
608772993226,4cyclictest0-21swapper/200:25:252
60877299322,5cyclictest640965-21users22:10:312
608772993223,6cyclictest0-21swapper/222:40:002
608772993223,5cyclictest0-21swapper/223:55:302
608771993222,7cyclictest231ktimers/121:20:141
608768993227,3cyclictest19950irq/27-20000000.i2c00:10:340
608768993223,6cyclictest627491-21/usr/sbin/munin20:55:320
60877299317,8cyclictest32-21ksoftirqd/223:50:012
608772993124,4cyclictest168450irq/135-8000000.ethernet-tx222:30:162
60877299311,28cyclictest0-21swapper/220:25:292
608768993125,4cyclictest20950irq/209-8000000.ethernet20:05:230
608768993124,5cyclictest649920-21fschecks_time23:05:210
608772993022,5cyclictest0-21swapper/220:45:292
608772993021,6cyclictest30-21rcuc/200:35:322
608772993021,5cyclictest0-21swapper/223:15:282
60877299301,27cyclictest0-21swapper/222:15:132
608771993023,4cyclictest231ktimers/100:35:271
60877299292,3cyclictest619712-21apt-get20:10:162
608772992922,4cyclictest168450irq/135-8000000.ethernet-tx223:50:272
608772992922,4cyclictest0-21swapper/222:05:292
608772992820,5cyclictest311ktimers/220:20:102
608768992719,4cyclictest0-21swapper/019:10:020
608772992417,5cyclictest0-21swapper/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional