You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-28 - 14:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot4s.osadl.org (updated Fri Aug 28, 2026 00:45:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11212996523,9cyclictest131rcu_preempt22:20:131
1121299563,46cyclictest11086-21ssh00:35:151
1121299563,46cyclictest11086-21ssh00:35:141
1120399514,32cyclictest32077-21ssh22:05:150
1120399513,10cyclictest131rcu_preempt20:25:130
1121299503,9cyclictest131rcu_preempt19:25:121
1120399455,5cyclictest0-21swapper/019:40:140
11203994220,15cyclictest12-21ksoftirqd/023:15:140
1120399421,35cyclictest16072-21ssh22:50:140
1120399412,11cyclictest29320-21diskmemload21:40:130
1120399412,11cyclictest29320-21diskmemload21:40:120
1120399411,5cyclictest3346-21apt-get22:25:150
1120399411,5cyclictest0-21swapper/000:25:120
11203994111,23cyclictest12-21ksoftirqd/000:00:120
1122499403,24cyclictest35966irq/58-eth021:35:123
11212994023,10cyclictest0-21swapper/120:55:131
11212994023,10cyclictest0-21swapper/120:55:121
1121299401,30cyclictest9070-21ssh23:40:101
1122499374,22cyclictest35966irq/58-eth023:35:133
1122499373,26cyclictest35966irq/58-eth020:35:143
1120399371,9cyclictest18504-21head23:25:290
1121299365,24cyclictest8674-21ssh22:10:141
1121299363,26cyclictest12306-21ssh22:30:131
1120399362,13cyclictest25555-21ntp_states00:05:260
1122499351,23cyclictest35966irq/58-eth021:45:133
1120399355,24cyclictest30401-21ssh22:40:130
1120399353,7cyclictest9060-21ps22:10:180
1120399353,28cyclictest29320-21diskmemload00:30:120
1120399353,26cyclictest0-21swapper/022:45:140
1120399351,12cyclictest12602-21kthreadcore20:50:200
1122499343,12cyclictest35966irq/58-eth000:30:123
11224993422,7cyclictest35966irq/58-eth022:15:113
1122499342,21cyclictest35966irq/58-eth021:15:153
1122499342,21cyclictest35966irq/58-eth021:15:143
1121299345,20cyclictest2001-21ssh00:30:111
1120399346,24cyclictest3647-21kthreadcore20:40:220
1120399343,23cyclictest17693-21ssh22:15:120
1120399341,9cyclictest21738-21kthreadcore23:10:200
1120399341,8cyclictest26708-21kthreadcore19:25:180
1120399341,8cyclictest25586-21ntp_states19:55:250
1120399341,8cyclictest13674-21tr19:10:210
1120399341,6cyclictest23946-21sed20:30:180
1120399341,5cyclictest6090-21users21:30:330
11221993321,9cyclictest261rcuc/219:50:112
11221993321,9cyclictest261rcuc/219:50:102
1122199331,19cyclictest930-21snmpd21:10:142
1121299332,20cyclictest23075-21ssh22:00:131
1120399332,7cyclictest25478-21kthreadcore23:30:210
1120399331,9cyclictest6474-21mailstats19:35:270
1120399331,9cyclictest29770-21kthreadcore20:35:210
1120399331,9cyclictest15415-21/usr/sbin/munin21:20:150
1120399331,9cyclictest12467-21grep20:15:270
1120399331,8cyclictest5044-21df_inode21:50:150
1120399331,8cyclictest18281-21fschecks_count23:45:160
1120399331,7cyclictest7195-21tr21:15:210
1120399331,7cyclictest7195-21tr21:15:200
1120399331,7cyclictest27034-21timerandwakeup22:00:300
1120399331,6cyclictest8969-21ssh23:20:240
1120399331,5cyclictest1486-21cut00:10:230
1120399331,20cyclictest3797-21ssh23:55:150
1120399331,10cyclictest26728-21kthreadcore21:25:200
1120399330,9cyclictest29693-21/usr/sbin/munin21:10:160
1120399330,8cyclictest10332-21latency_hist23:05:010
1120399330,7cyclictest30191-21latency_hist22:40:010
1122499321,19cyclictest35966irq/58-eth022:00:143
11212993227,3cyclictest3796-21sh23:55:141
11212993217,10cyclictest29320-21diskmemload21:15:161
11212993217,10cyclictest29320-21diskmemload21:15:161
1120399328,21cyclictest15175-21fschecks_count20:55:160
1120399328,21cyclictest15175-21fschecks_count20:55:160
1120399328,20cyclictest14673-21cut22:30:220
1120399321,9cyclictest4225-21df_inode20:10:140
1120399321,9cyclictest29076-21/usr/sbin/munin21:45:210
1120399321,9cyclictest26760-21/usr/sbin/munin22:20:290
1120399321,8cyclictest21880-21kthreadcore21:00:190
1120399321,8cyclictest13530-21ssh00:35:230
1120399321,8cyclictest13530-21ssh00:35:220
1120399321,7cyclictest7394-21/usr/sbin/munin00:15:270
1120399321,7cyclictest21609-21irqstats19:20:180
11203993217,10cyclictest12-21ksoftirqd/021:55:140
1120399320,9cyclictest29403-21latency_hist21:10:020
1120399320,6cyclictest13006-21find23:40:260
1122499312,18cyclictest35966irq/58-eth000:35:153
1122499312,18cyclictest35966irq/58-eth000:35:143
1122199312,18cyclictest1681-21ssh23:00:142
1121299311,25cyclictest3369-21sh22:25:181
1120399318,20cyclictest17487-21fschecks_count19:50:150
1120399318,20cyclictest17487-21fschecks_count19:50:140
1120399311,9cyclictest15188-21kthreadcore20:20:200
1120399311,8cyclictest26382-21kthreadcore22:55:210
1120399311,7cyclictest10353-21diskstats21:35:150
1120399311,5cyclictest20319-21ssh00:20:300
1120399310,9cyclictest5966-21irqrtprio20:45:190
1120399310,8cyclictest16004-21ntp_states19:45:250
1122499304,19cyclictest0-21swapper/322:25:173
1122199304,10cyclictest11195-21cyclictest19:15:142
11212993012,8cyclictest21-21ksoftirqd/100:20:141
1120399301,9cyclictest31069-21timerandwakeup23:50:290
1120399301,8cyclictest16552-21irqcore19:15:170
1120399301,5cyclictest3548-21cat23:35:240
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional