You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-09 - 13:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot4s.osadl.org (updated Tue Jun 09, 2026 00:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1489799701,60cyclictest0-21swapper/220:15:122
1487899632,41cyclictest17287-21ssh22:50:110
14878995912,9cyclictest131rcu_preempt20:20:110
1487899573,5cyclictest131rcu_preempt19:55:140
1488799551,44cyclictest7354-21ssh21:50:151
1489799532,46cyclictest0-21swapper/223:40:122
1489799532,46cyclictest0-21swapper/223:40:122
1489799521,45cyclictest0-21swapper/200:35:122
1487899515,33cyclictest4001-21ssh21:30:130
1487899514,34cyclictest131rcu_preempt23:30:120
1489799502,35cyclictest26147-21apt-get22:55:132
14878995011,6cyclictest131rcu_preempt20:50:130
1487899491,39cyclictest26175-21ssh22:55:130
1489799481,43cyclictest6919-21apt-get00:15:142
1489799481,40cyclictest0-21swapper/223:30:122
1489799471,32cyclictest13391-21grep21:35:182
1489799471,30cyclictest8819-21grep22:25:272
1489799471,30cyclictest8819-21grep22:25:262
1487899474,28cyclictest20558-21ssh23:10:120
1489799460,30cyclictest9216-21ssh22:08:452
1487899464,32cyclictest22964-21ssh22:35:130
1489799451,29cyclictest28460-21/usr/sbin/munin21:05:162
1489799451,28cyclictest26962-21ssh23:50:132
1489799445,25cyclictest5058-21kthreadcore23:00:222
1489799445,25cyclictest5058-21kthreadcore23:00:222
1489799440,39cyclictest0-21swapper/221:10:142
1489799440,28cyclictest6643-21grep21:30:222
1489799431,37cyclictest22233-21apt-get20:25:122
1489799431,33cyclictest25207-21ssh22:00:132
1489799431,29cyclictest30091-21kthreadcore19:25:202
1489799430,2cyclictest21989-21apt-get21:40:142
1487899434,7cyclictest131rcu_preempt23:45:120
1489799423,34cyclictest0-21swapper/223:55:122
1489799421,36cyclictest11703-21apt-get23:05:152
1489799420,3cyclictest21430-21apt-get00:05:142
1489799420,2cyclictest14715-21ssh23:25:112
1489799410,28cyclictest4081-21ssh22:24:152
1489799410,27cyclictest26621-21tr19:20:202
1489799410,26cyclictest27776-21cut21:25:152
1488799415,26cyclictest28573-21ssh22:20:141
1487899416,30cyclictest11725-21ssh23:05:150
1490599402,22cyclictest35966irq/58-eth021:25:133
1489799402,34cyclictest0-21swapper/219:55:132
1489799402,33cyclictest0-21swapper/223:20:132
1489799402,27cyclictest16409-21fschecks_count19:45:172
1488799401,36cyclictest0-21swapper/123:35:121
1487899404,23cyclictest30809-21ssh21:45:140
1490599394,21cyclictest35966irq/58-eth022:25:123
1490599394,21cyclictest35966irq/58-eth022:25:123
1489799391,34cyclictest0-21swapper/219:30:052
1489799391,33cyclictest0-21swapper/221:20:112
1489799391,24cyclictest3233-21ntp_states22:40:262
1489799391,24cyclictest22323-21ssh21:56:542
1489799382,30cyclictest566-21cut23:35:162
1489799381,4cyclictest30368-21apt-get00:10:122
1489799381,34cyclictest17450-21switchtime20:50:282
1489799381,30cyclictest17266-21apt-get22:50:112
1489799381,27cyclictest0-21swapper/222:15:112
1489799381,20cyclictest1604-21ntp_192.168.11420:00:232
1490599372,21cyclictest35966irq/58-eth023:45:133
1490599370,22cyclictest35966irq/58-eth020:00:123
1489799372,30cyclictest27346irq/40-dwc2_hso20:40:132
1489799371,33cyclictest3970-21sendmail20:40:012
1489799370,5cyclictest20841-21sh22:32:542
1489799370,3cyclictest20547-21ssh23:10:122
1489799370,2cyclictest1377-21apt-get00:30:132
1488799373,29cyclictest18640-21ssh21:20:131
14887993715,19cyclictest0-21swapper/123:55:121
1487899372,22cyclictest131rcu_preempt23:50:120
1487899371,25cyclictest10635-21ssh22:10:120
1490599363,19cyclictest35966irq/58-eth021:35:123
1489799361,32cyclictest13473-21kthreadcore00:00:202
1489799361,31cyclictest665466/usr/sbin/munin19:35:122
1489799361,31cyclictest18868-21sed19:10:292
1489799361,30cyclictest25019-21fschecks_time00:25:162
1489799361,30cyclictest25019-21fschecks_time00:25:162
1489799360,2cyclictest0-21swapper/223:45:292
1489799351,31cyclictest7785-21/usr/sbin/munin20:10:242
1489799351,31cyclictest7785-21/usr/sbin/munin20:10:242
1489799351,31cyclictest24035-21cut21:00:182
1489799351,31cyclictest18237-21cron21:20:022
1489799351,31cyclictest12108-21ntp_kernel_err22:45:252
1489799351,26cyclictest12698-21/usr/sbin/munin20:45:292
1489799350,31cyclictest21536-21ssh00:21:302
1489799350,2cyclictest0-21swapper/220:05:152
14878993523,6cyclictest121ksoftirqd/023:25:130
1489799342,20cyclictest17403-21/usr/sbin/munin20:20:212
1489799341,22cyclictest0-21swapper/221:45:112
14878993417,10cyclictest131rcu_preempt22:15:110
14878993415,14cyclictest12-21ksoftirqd/022:00:120
1489799331,23cyclictest22926-21/usr/sbin/munin22:35:222
1489799330,30cyclictest21880-21sed20:55:212
1489799330,2cyclictest0-21swapper/220:30:122
1487899332,23cyclictest567-21sed23:35:170
1487899331,24cyclictest339-21diskmemload23:15:100
1489799321,28cyclictest21044-21kthreadcore19:15:182
1489799321,27cyclictest29767-21/usr/sbin/munin23:15:152
1489799320,30cyclictest0-21swapper/222:15:002
1489799320,29cyclictest25604-21sshd19:54:162
1488799321,24cyclictest1282-21kworker/u8:022:30:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional