You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-27 - 02:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System (updated Thu Mar 26, 2026 12:45:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2531199641,42cyclictest15847-21ssh12:10:132
2531199581,3cyclictest0-21swapper/207:50:142
2531199501,2cyclictest14723-21apt-get10:05:122
2529499503,7cyclictest131rcu_preempt09:15:141
25324994942,5cyclictest28366irq/58-eth010:35:123
2531199493,41cyclictest408-21apt-get08:25:132
2529499492,33cyclictest23138-21ssh10:45:141
2528199484,22cyclictest11797-21ssh11:50:120
2531199470,3cyclictest0-21swapper/208:45:122
2531199462,29cyclictest31177-21ssh11:25:132
2531199442,4cyclictest0-21swapper/208:30:132
2529499442,6cyclictest0-21swapper/111:55:121
2531199420,8cyclictest0-21swapper/207:30:122
2529499425,27cyclictest3916-21ssh11:10:131
2531199412,4cyclictest0-21swapper/207:45:122
2531199412,34cyclictest0-21swapper/210:23:002
2532499405,24cyclictest28366irq/58-eth010:00:123
2531199401,7cyclictest8567-21latency_hist10:55:022
2531199401,4cyclictest0-21swapper/212:05:122
2531199400,5cyclictest0-21swapper/212:25:132
2531199392,6cyclictest29372-21kthreadcore10:30:212
2529499390,30cyclictest27237-21ssh11:05:131
2531199382,4cyclictest20592-21ssh09:15:142
2529499381,31cyclictest15571-21ssh09:30:151
2531199371,9cyclictest5068-21ntp_states12:20:252
2531199371,7cyclictest29274-21acpi08:55:122
2531199371,7cyclictest18365-21ssh11:00:172
2531199370,4cyclictest24516-21apt-get08:50:142
2532499368,21cyclictest0-21swapper/310:30:143
25324993611,16cyclictest28366irq/58-eth010:15:133
2531199365,6cyclictest20354-21latency11:35:222
2531199365,4cyclictest27-21ksoftirqd/211:06:332
2531199362,7cyclictest23347-21kthreadcore11:20:192
2531199361,9cyclictest11555-21cpu09:10:142
2531199361,8cyclictest26072-21kthreadcore10:45:232
2531199361,6cyclictest24983-21kthreadcore08:15:202
2531199361,6cyclictest17459-21ssh09:47:492
2531199361,5cyclictest20734-21cat07:35:282
2531199361,32cyclictest24853-21kthreadcore07:40:212
2531199361,15cyclictest10084-21dpkg08:35:052
2531199361,10cyclictest7588-21ssh11:45:312
2531199351,7cyclictest24807-21wc11:55:262
2531199351,6cyclictest24770-21sort09:35:132
2531199351,6cyclictest23295-21ntp_states12:30:262
2531199351,6cyclictest17063-21sendmail_mailqu08:05:252
2531199351,6cyclictest16115-21rm09:30:202
2531199351,3cyclictest8488-21ntp_192.168.11410:35:252
2531199351,31cyclictest21232-21tr10:25:212
2531199350,5cyclictest21711-21netstat08:10:222
2529499359,5cyclictest8351-21kthreadcore10:00:201
2529499357,7cyclictest1589-21cut10:15:191
2529499351,28cyclictest8915-21ssh10:55:121
25294993512,5cyclictest0-21swapper/108:55:271
2529499351,10cyclictest29289-21grep07:10:271
2529499350,11cyclictest21059-21tr12:30:211
2532499344,18cyclictest28366irq/58-eth010:10:123
2531199345,3cyclictest10160-21sh09:25:262
2531199343,4cyclictest11785-21apt-get11:50:122
2531199341,8cyclictest26224-21fschecks_count11:40:152
2531199341,8cyclictest26224-21fschecks_count11:40:152
2531199341,7cyclictest8765-21ssh09:43:192
2531199341,7cyclictest12575-21sed10:55:242
2531199341,6cyclictest12314-21swap08:00:272
2529499341,9cyclictest22131-21grep08:10:271
2531199339,20cyclictest8930-21ssh10:19:312
2531199338,21cyclictest11449-21ntp_192.168.11411:30:252
2531199331,9cyclictest6646-21diskstats09:05:152
2531199331,7cyclictest6589-21kthreadcore07:55:202
2531199331,6cyclictest28032-21find08:20:122
2531199331,6cyclictest1031-21/usr/sbin/munin09:20:282
2531199331,5cyclictest28995-21processes07:10:242
2531199331,5cyclictest17820-21mailstats10:40:282
2531199331,4cyclictest23998-21ssh10:10:132
2529499337,5cyclictest14337-21kthreadcore11:15:211
2529499331,9cyclictest8008-21kthreadcore12:05:191
2529499331,9cyclictest28618-21/usr/sbin/munin12:35:121
2529499331,24cyclictest31196-21ssh11:25:131
2529499331,10cyclictest8378-21ssh09:25:191
2529499331,10cyclictest1222-21missed_timers12:00:241
2529499331,10cyclictest10359-21irqrtprio10:20:181
25281993326,4cyclictest11120-21diskmemload10:20:130
2532499325,19cyclictest28366irq/58-eth008:40:113
2532499323,20cyclictest28366irq/58-eth012:20:113
2532499323,18cyclictest28366irq/58-eth008:50:123
2532499321,17cyclictest28366irq/58-eth012:35:133
2531199327,23cyclictest4242-21sh12:02:332
2531199324,6cyclictest15793-21kthreadcore11:15:222
2531199323,2cyclictest0-21swapper/212:15:362
2531199321,7cyclictest28451-21cron09:55:022
2531199321,6cyclictest10453-21kthreadcore07:25:212
2531199321,5cyclictest28621-21/usr/sbin/munin12:35:112
2531199321,5cyclictest1663-21/usr/sbin/munin09:00:132
2531199321,27cyclictest28834-21ssh09:55:122
25311993211,19cyclictest11918-21ssh11:14:152
2529499321,9cyclictest29732-21ssh11:40:261
2529499321,9cyclictest29732-21ssh11:40:251
2529499321,13cyclictest22159-21ssh11:20:131
2529499321,10cyclictest20024-21irqcore08:45:171
2529499321,10cyclictest11735-21/usr/sbin/munin09:10:161
2529499320,10cyclictest23802-21cut07:40:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional