You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-06 - 10:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot4s.osadl.org (updated Mon Jul 06, 2026 00:45:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
913399635,51cyclictest27346irq/40-dwc2_hso22:30:132
913399571,7cyclictest0-21swapper/222:15:122
913399571,7cyclictest0-21swapper/222:15:112
912599555,40cyclictest20217-21ssh22:35:111
913399544,27cyclictest4672-21ssh23:20:132
913399543,31cyclictest12232-21ssh21:55:122
912599544,40cyclictest13760-21ssh23:25:141
911799519,9cyclictest12-21ksoftirqd/022:15:120
911799519,9cyclictest12-21ksoftirqd/022:15:110
913399492,22cyclictest24799-21irqrtprio22:55:192
913399481,14cyclictest2086-21ssh22:25:132
9141994511,22cyclictest35966irq/58-eth022:50:153
913399452,4cyclictest0-21swapper/219:45:112
913399442,8cyclictest27346irq/40-dwc2_hso20:00:122
913399436,6cyclictest8528-21apt-get23:40:142
913399433,9cyclictest27346irq/40-dwc2_hso20:40:122
913399433,5cyclictest0-21swapper/220:25:142
913399432,3cyclictest0-21swapper/223:45:132
912599431,32cyclictest26675-21ssh21:45:121
9141994218,12cyclictest35966irq/58-eth000:05:153
913399422,34cyclictest24524-21ssh23:11:182
911799422,31cyclictest25035-21ssh00:25:140
914199412,29cyclictest35966irq/58-eth000:15:123
913399412,22cyclictest16853-21ssh23:07:572
911799416,7cyclictest131rcu_preempt00:20:130
912599403,10cyclictest0-21swapper/100:25:131
9141993923,8cyclictest0-21swapper/321:15:133
913399391,7cyclictest13042-21unixbench_multi19:10:272
913399391,7cyclictest1155366ssh22:46:132
914199381,24cyclictest35966irq/58-eth022:35:123
913399382,23cyclictest26702-21ssh23:50:132
913399382,18cyclictest7146-21sh22:10:152
911799381,25cyclictest4506-21ssh21:15:130
913399372,9cyclictest0-21swapper/223:00:232
913399372,9cyclictest0-21swapper/223:00:232
913399371,8cyclictest10301-21sh00:35:012
913399371,10cyclictest23867-21kthreadcore20:30:202
911799374,26cyclictest875-21ssh23:00:140
911799374,26cyclictest875-21ssh23:00:130
913399364,22cyclictest29424-21ssh22:40:142
9133993628,4cyclictest27-21ksoftirqd/200:10:132
913399362,5cyclictest0-21swapper/223:15:192
913399361,8cyclictest22884-21kthreadcore22:35:192
913399361,8cyclictest21042-21latency_hist00:05:022
913399361,8cyclictest0-21swapper/220:15:122
913399361,7cyclictest19376-21grep19:20:172
913399361,6cyclictest30277-21ntp_192.168.11421:45:252
913399361,6cyclictest17401-21ntp_kernel_pll_23:25:252
913399361,12cyclictest27159-21usage_Anybus23:30:292
913399361,10cyclictest28697-21awk00:25:262
913399360,11cyclictest27441-21latency_hist21:10:012
912599362,27cyclictest3246-21ssh23:55:131
912599361,26cyclictest13614-21ssh21:20:131
911799363,30cyclictest22795-21ssh23:30:140
9117993610,5cyclictest131rcu_preempt23:10:130
913399359,3cyclictest6718-21load23:55:222
913399351,9cyclictest592-21kthreadcore23:35:192
913399351,9cyclictest4093-21cron21:15:002
913399351,9cyclictest26308-21/usr/sbin/munin20:35:332
913399351,9cyclictest12104-21fschecks_count20:20:172
913399351,13cyclictest6844-21sort22:10:012
913399350,9cyclictest20212-21sort19:55:012
913399350,9cyclictest20212-21sort19:55:012
913399350,14cyclictest4630-21grep19:35:302
9141993417,12cyclictest35966irq/58-eth020:00:143
913399349,22cyclictest6656-21ssh21:33:212
913399348,5cyclictest0-21swapper/219:15:222
913399342,8cyclictest24463-21kthreadcore19:25:192
913399341,9cyclictest930-21snmpd00:22:272
913399341,9cyclictest20471-21tune2fs19:55:162
913399341,8cyclictest15444-21kthreadcore21:20:212
913399341,30cyclictest2827866ssh22:02:552
9133993411,21cyclictest930-21snmpd21:17:232
913399341,11cyclictest31520-21grep21:30:022
913399341,10cyclictest6579-21latency_hist00:15:022
9125993412,16cyclictest21-21ksoftirqd/100:35:141
911799346,23cyclictest12-21ksoftirqd/023:05:140
911799341,27cyclictest8539-21sh23:40:140
914199331,23cyclictest35966irq/58-eth023:55:143
913399331,9cyclictest0-21swapper/219:30:302
913399331,10cyclictest13503-21kthreadcore00:35:232
9133993310,20cyclictest24405-21ssh21:42:462
912599335,16cyclictest17595-21ssh21:40:131
912599332,24cyclictest17689-21ssh23:45:141
911799334,24cyclictest7122-21ssh22:10:130
911799332,26cyclictest10675-21ssh00:35:140
9117993316,13cyclictest12-21ksoftirqd/021:30:140
9117993313,5cyclictest131rcu_preempt19:55:130
913399326,21cyclictest27-21ksoftirqd/222:52:532
913399322,10cyclictest17201-21latency_hist21:40:022
913399322,10cyclictest17201-21latency_hist21:40:012
913399321,9cyclictest930-21snmpd21:52:572
913399321,9cyclictest930-21snmpd21:52:562
913399321,7cyclictest6105-21grep20:10:292
913399321,13cyclictest8329-21apt-get20:50:152
913399321,10cyclictest6351-21irqrtprio19:40:192
913399320,9cyclictest27433-21ssh00:06:542
912599322,26cyclictest27817-21ssh21:10:121
9125993220,8cyclictest0-21swapper/119:20:121
911799322,21cyclictest12-21ksoftirqd/020:45:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional