You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-02 - 07:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot4s.osadl.org (updated Thu Jul 02, 2026 00:45:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25397997644,20cyclictest35966irq/58-eth022:40:133
2534999564,41cyclictest22979-21ssh00:15:120
2534999564,40cyclictest28109-21ssh00:00:110
25397995333,12cyclictest35966irq/58-eth000:00:123
2536499537,4cyclictest131rcu_preempt19:50:111
2536499531,46cyclictest10080-21ssh21:45:121
2536499521,42cyclictest30424-21sd-accept19:15:131
2534999511,40cyclictest9979-21ssh23:50:120
2536499504,3cyclictest131rcu_preempt21:55:111
25364994731,8cyclictest21-21ksoftirqd/122:40:111
2537599463,3cyclictest131rcu_preempt22:30:132
2536499461,6cyclictest131rcu_preempt00:20:131
2536499452,8cyclictest131rcu_preempt20:50:121
2539799444,31cyclictest35966irq/58-eth000:10:153
2537599441,25cyclictest10088-21sh21:45:142
2536499442,31cyclictest17940-21ssh22:25:131
2534999444,34cyclictest8701-21ssh00:25:140
2539799422,26cyclictest35966irq/58-eth021:15:153
2534999411,28cyclictest23042-21ssh22:10:110
2539799403,23cyclictest0-21swapper/300:30:133
2539799403,23cyclictest0-21swapper/300:30:123
2539799403,22cyclictest35966irq/58-eth021:30:133
25349994018,8cyclictest17732-21sh23:17:190
25349994017,7cyclictest11416-21diskmemload22:04:080
25349994016,9cyclictest24474-21ssh23:56:090
2537599394,26cyclictest17753-21ssh00:30:132
2537599394,26cyclictest17753-21ssh00:30:132
2537599393,28cyclictest11807-21ssh21:10:122
25349993920,13cyclictest0-21swapper/021:45:130
25397993822,8cyclictest35966irq/58-eth023:10:113
2537599382,18cyclictest879-21munin-node23:45:112
25349993818,7cyclictest11416-21diskmemload23:26:410
25349993817,7cyclictest11416-21diskmemload22:53:160
25349993817,7cyclictest11416-21diskmemload22:44:460
25349993817,7cyclictest11416-21diskmemload22:08:010
25349993815,8cyclictest6365-21ssh23:46:120
2537599373,23cyclictest16674-21ssh23:00:142
25375993732,2cyclictest261rcuc/221:25:132
25349993718,6cyclictest11416-21diskmemload23:23:320
25349993716,7cyclictest11416-21diskmemload00:23:560
25349993716,6cyclictest10325-21ssh00:06:160
25349993713,8cyclictest11416-21diskmemload21:55:440
25349993712,9cyclictest30483-21ssh00:35:270
2534999371,26cyclictest6169-21ssh23:30:120
2539799362,22cyclictest35966irq/58-eth021:35:143
25375993617,11cyclictest27-21ksoftirqd/222:15:122
25349993617,6cyclictest11416-21diskmemload22:55:460
25349993615,7cyclictest11183-21ssh22:38:400
2539799357,17cyclictest35966irq/58-eth023:30:123
2539799353,20cyclictest35966irq/58-eth020:20:113
2539799353,20cyclictest35966irq/58-eth020:20:113
2537599352,23cyclictest20449-21ssh23:20:142
2534999356,17cyclictest12-21ksoftirqd/020:40:130
25349993518,13cyclictest0-21swapper/020:00:120
25349993514,7cyclictest14478-21ssh21:29:200
25397993416,13cyclictest0-21swapper/322:50:143
2539799341,20cyclictest35966irq/58-eth023:35:143
25349993415,6cyclictest9808-21ssh23:13:420
25349993414,7cyclictest22983-21ssh22:25:390
2539799336,18cyclictest35966irq/58-eth022:55:113
2537599333,21cyclictest29866-21ssh21:20:122
2536499332,23cyclictest32197-21ssh22:15:121
25364993319,5cyclictest21-21ksoftirqd/121:30:131
2537599326,20cyclictest261rcuc/223:05:122
25349993222,8cyclictest23462-21netstat20:45:240
2539799313,20cyclictest0-21swapper/323:25:123
2539799311,24cyclictest35966irq/58-eth022:45:133
2537599318,19cyclictest630-21Async09:36:312
2537599312,16cyclictest4866-21ssh00:05:172
25349993122,7cyclictest31005-21ssh23:06:080
25349993120,8cyclictest1461-21ssh22:32:510
25349993119,9cyclictest27225-21ssh21:17:180
25349993117,12cyclictest0-21swapper/021:10:110
25349993113,7cyclictest5980-21diskmemload21:24:560
25349993112,10cyclictest24014-21sh23:03:340
25349993111,7cyclictest29916-21ssh21:36:170
25349993110,7cyclictest11416-21diskmemload22:49:360
2539799304,19cyclictest33-21ksoftirqd/323:55:133
2539799302,16cyclictest35966irq/58-eth023:05:133
25364993021,6cyclictest11416-21diskmemload22:20:141
25364993011,10cyclictest131rcu_preempt20:05:111
25349993020,8cyclictest10075-21sshd20:34:100
25349993018,9cyclictest15752-21ssh22:22:550
25349993015,13cyclictest0-21swapper/020:10:120
25349993012,6cyclictest11416-21diskmemload23:44:560
2534999300,9cyclictest15564-21df_inode21:30:140
2539799290,18cyclictest35966irq/58-eth021:20:113
2536499291,23cyclictest4867-21ssh22:00:121
25349992924,3cyclictest15219-21apt-get23:35:150
25349992922,4cyclictest10084-21apt-get20:35:050
25349992919,8cyclictest30531-21/usr/sbin/munin19:15:160
25349992918,8cyclictest7531-21/usr/sbin/munin19:55:220
25349992918,8cyclictest7531-21/usr/sbin/munin19:55:220
25349992913,7cyclictest13831-21ssh00:10:090
25349992910,6cyclictest5417-21ssh22:16:250
2537599285,17cyclictest1042-21ssh21:40:132
2537599282,18cyclictest28254-21ssh21:55:142
2537599281,17cyclictest13939-21sh00:10:142
2536499288,9cyclictest25339-21cyclictest20:30:111
2536499282,19cyclictest844-21munin-node23:45:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional