You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 08:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack3slot6s.osadl.org (updated Thu Nov 27, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28238212198,18sleep10-21swapper/119:08:481
28117211998,15sleep20-21swapper/219:07:132
28278211195,11sleep30-21swapper/319:09:183
28053210696,6sleep00-21swapper/019:06:230
259472770,0sleep10-21swapper/122:00:411
91722720,1sleep011-21rcuc/022:52:190
258082690,0sleep30-21swapper/323:10:143
173212690,1sleep30-21swapper/322:26:093
204892280,1sleep20-21swapper/222:30:172
41102270,1sleep00-21swapper/023:55:250
137692220,1sleep2301ktimersoftd/222:23:002
2836599210,2cyclictest0-21swapper/219:40:112
189372210,1sleep1221ktimersoftd/123:37:071
28365992015,3cyclictest24704-21ssh22:35:122
28364992017,2cyclictest0-21swapper/121:25:101
241072200,1sleep121-21rcuc/123:42:471
28363991916,2cyclictest9434-21kworker/u8:021:34:040
2836399190,2cyclictest0-21swapper/020:15:140
2836399190,2cyclictest0-21swapper/020:15:130
28363991815,2cyclictest8353-21kworker/u8:222:39:050
28363991815,2cyclictest20668-21kworker/u8:023:43:040
28363991815,2cyclictest1753-21kworker/u8:121:48:020
2836699171,3cyclictest0-21swapper/320:24:583
2836699171,14cyclictest23564-21latency_hist21:24:593
2836599173,12cyclictest0-21swapper/222:06:472
2836599171,14cyclictest0-21swapper/223:00:112
28364991714,2cyclictest2728-21kworker/u8:122:16:011
28364991713,2cyclictest8353-21kworker/u8:222:40:041
177772170,1sleep00-21swapper/023:35:250
66852160,1sleep30-21swapper/321:00:233
2836699161,13cyclictest9458-21diskmemload21:10:243
2836699161,13cyclictest13137-21iostat19:50:153
2836599163,2cyclictest0-21swapper/223:43:262
2836599161,3cyclictest9458-21diskmemload21:10:012
28365991611,3cyclictest0-21swapper/221:15:192
28365991610,4cyclictest0-21swapper/223:10:002
2836599160,14cyclictest0-21swapper/200:30:172
28364991613,2cyclictest9434-21kworker/u8:021:35:041
28364991612,2cyclictest20668-21kworker/u8:023:09:041
28363991613,2cyclictest32116-21kworker/u8:100:27:050
2836699150,2cyclictest0-21swapper/300:11:063
2836699150,13cyclictest9458-21diskmemload22:00:493
2836699150,13cyclictest23190-21ssh22:33:053
2836699150,13cyclictest0-21swapper/322:48:503
2836699150,13cyclictest0-21swapper/320:45:113
2836599153,2cyclictest0-21swapper/222:27:562
2836599152,12cyclictest0-21swapper/221:25:152
2836599152,12cyclictest0-21swapper/200:25:192
28365991512,2cyclictest0-21swapper/223:57:012
2836599151,13cyclictest301ktimersoftd/200:05:172
2836599151,12cyclictest9458-21diskmemload21:45:142
2836599151,12cyclictest0-21swapper/222:55:162
2836599151,12cyclictest0-21swapper/200:04:362
28365991510,3cyclictest17442-21ssh21:52:062
28365991510,3cyclictest0-21swapper/222:11:082
28364991512,2cyclictest31296-21kworker/u8:121:05:041
28364991511,2cyclictest19524-21kworker/u8:222:07:041
2836499150,3cyclictest0-21swapper/123:20:111
28363991512,2cyclictest5405-21kworker/u8:200:38:040
28363991512,2cyclictest32527-21kworker/u8:223:19:040
28363991512,2cyclictest30124-21kworker/u8:022:06:040
28363991512,2cyclictest20668-21kworker/u8:023:49:040
28363991512,2cyclictest17192-21kworker/u8:200:14:040
2836399150,3cyclictest0-21swapper/000:15:170
2836399150,13cyclictest0-21swapper/023:06:440
2836699149,3cyclictest19547-21ssh21:55:113
2836699142,7cyclictest4046-21gpgv19:30:003
28366991411,2cyclictest9458-21diskmemload22:21:203
2836699141,11cyclictest1590-21ssh21:35:173
2836699140,2cyclictest0-21swapper/321:52:393
2836699140,2cyclictest0-21swapper/320:50:203
2836699140,2cyclictest0-21swapper/300:15:243
2836699140,13cyclictest0-21swapper/323:00:493
2836699140,13cyclictest0-21swapper/300:29:093
2836699140,12cyclictest9458-21diskmemload22:10:173
2836699140,12cyclictest17164-21modprobe20:00:173
2836699140,12cyclictest0-21swapper/321:15:113
2836599143,2cyclictest0-21swapper/222:18:082
2836599143,2cyclictest0-21swapper/221:55:382
2836599142,7cyclictest9458-21diskmemload22:00:002
2836599142,10cyclictest0-21swapper/221:31:092
2836599141,12cyclictest301ktimersoftd/222:47:362
2836599140,12cyclictest0-21swapper/220:45:242
2836499149,3cyclictest0-21swapper/119:10:201
2836499149,3cyclictest0-21swapper/100:22:421
2836499142,2cyclictest0-21swapper/121:16:011
28364991411,2cyclictest28362-21cyclictest22:50:001
28364991411,2cyclictest20668-21kworker/u8:023:32:041
28364991411,2cyclictest1753-21kworker/u8:121:41:041
28364991411,2cyclictest12147-21kworker/u8:021:51:041
28364991410,2cyclictest8229-21fschecks_time00:00:161
2836499140,8cyclictest0-21swapper/121:30:061
2836499140,13cyclictest0-21swapper/100:30:161
2836499140,12cyclictest9458-21diskmemload22:35:141
2836499140,12cyclictest6992-21munin-node1
2836499140,12cyclictest26158-21cat00:20:001
2836499140,12cyclictest0-21swapper/123:52:251
2836499140,12cyclictest0-21swapper/123:01:241
2836499140,12cyclictest0-21swapper/122:55:371
2836499140,12cyclictest0-21swapper/100:10:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional