You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-27 - 05:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Thu Aug 27, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
57252112101,6sleep10-21swapper/119:05:081
2430121120,5sleep0754299cyclictest00:33:330
7234211090,15sleep00-21swapper/019:06:220
7269210796,6sleep30-21swapper/319:06:513
7444210588,11sleep20-21swapper/219:09:062
307402800,0sleep20-21swapper/200:06:062
270292740,0sleep20-21swapper/222:55:072
165652730,0sleep00-21swapper/023:17:210
245572720,0sleep30-21swapper/323:25:263
261832690,0sleep20-21swapper/222:54:072
245202690,1sleep124526-21aten2.4_r3power21:45:101
212092680,0sleep30-21swapper/300:30:113
244672620,1sleep30-21swapper/321:10:303
7542993314,18cyclictest0-21swapper/023:40:110
229612250,0sleep20-21swapper/222:16:072
7545992421,2cyclictest5149-21kworker/u8:222:47:043
7545992320,2cyclictest29398-21kworker/u8:221:55:033
7545992320,2cyclictest25573-21kworker/u8:200:37:043
7545992320,2cyclictest19815-21kworker/u8:222:17:043
99152220,0sleep30-21swapper/321:29:463
7544992210,3cyclictest0-21swapper/222:00:142
7544992210,3cyclictest0-21swapper/220:26:032
7544992210,2cyclictest0-21swapper/220:51:012
754499220,2cyclictest0-21swapper/223:20:122
754499220,13cyclictest0-21swapper/223:49:242
7545992118,2cyclictest9065-21kworker/u8:221:39:043
7545992118,2cyclictest9065-21kworker/u8:221:07:033
754599210,2cyclictest0-21swapper/320:00:093
754499212,7cyclictest0-21swapper/219:52:592
754499210,12cyclictest0-21swapper/200:21:452
6252210,1sleep20-21swapper/220:15:002
7544992010,2cyclictest0-21swapper/222:29:352
7542992017,2cyclictest25723-21kworker/u8:122:28:040
7542992017,2cyclictest23631-21kworker/u8:022:18:010
7542992015,3cyclictest5149-21kworker/u8:222:50:040
754299200,2cyclictest0-21swapper/021:55:120
235632200,1sleep123-21ksoftirqd/122:17:021
7545991916,2cyclictest9065-21kworker/u8:221:32:033
7545991916,2cyclictest22424-21kworker/u8:122:53:043
7545991916,2cyclictest18710-21kworker/u8:223:57:043
7544991915,2cyclictest0-21swapper/223:40:112
7544991911,2cyclictest0-21swapper/222:34:342
7542991916,2cyclictest9198-21kworker/u8:123:12:040
7542991916,2cyclictest25855-21kworker/u8:121:17:040
754299190,2cyclictest0-21swapper/023:20:120
82212180,0sleep30-21swapper/322:00:573
7545991815,2cyclictest9065-21kworker/u8:221:41:043
7545991815,2cyclictest5149-21kworker/u8:222:32:043
7545991815,2cyclictest25855-21kworker/u8:121:18:043
7545991815,2cyclictest25723-21kworker/u8:122:29:043
7545991815,2cyclictest25723-21kworker/u8:122:21:043
7545991815,2cyclictest23674-21kworker/u8:000:09:053
7545991815,2cyclictest2289-21kworker/u8:223:09:043
7545991815,2cyclictest15715-21kworker/u8:023:16:053
754599180,2cyclictest0-21swapper/322:56:043
754499182,7cyclictest0-21swapper/223:26:022
754499182,6cyclictest0-21swapper/223:59:592
7545991714,2cyclictest8452-21kworker/u8:023:44:043
7545991714,2cyclictest25605-21kworker/u8:120:19:043
7545991714,2cyclictest16915-21kworker/u8:100:02:043
7545991714,2cyclictest15715-21kworker/u8:022:44:043
754499171,13cyclictest0-21swapper/222:35:182
754499170,6cyclictest982-21ssh23:01:012
7543991713,2cyclictest0-21swapper/121:25:121
754399171,14cyclictest21438-21iostat00:30:131
7542991714,2cyclictest5247-21kworker/u8:122:07:040
7542991714,2cyclictest16915-21kworker/u8:123:53:030
272412170,1sleep20-21swapper/220:00:092
7545991613,2cyclictest4632-21kworker/u8:020:24:043
7545991613,2cyclictest22424-21kworker/u8:123:02:043
7545991613,2cyclictest10793-21kworker/u8:200:28:043
754599160,2cyclictest0-21swapper/322:06:013
754599160,14cyclictest19204-21fschecks_time23:20:153
754599160,10cyclictest0-21swapper/300:22:043
754499162,6cyclictest14904-21copy20:50:002
754499161,13cyclictest28949-21iostat23:30:172
7542991613,2cyclictest2959-21kworker/u8:100:14:040
7542991613,2cyclictest23674-21kworker/u8:000:23:050
7542991613,2cyclictest18710-21kworker/u8:223:26:030
7542991613,2cyclictest15715-21kworker/u8:022:57:040
7542991613,2cyclictest15049-21kworker/u8:121:37:040
754599151,2cyclictest0-21swapper/320:56:043
7545991512,2cyclictest25605-21kworker/u8:120:38:043
7545991512,2cyclictest25605-21kworker/u8:119:58:043
7545991512,2cyclictest23631-21kworker/u8:021:54:043
7545991512,2cyclictest18710-21kworker/u8:223:38:043
7545991512,2cyclictest15970-21kworker/u8:219:47:043
7545991512,2cyclictest15970-21kworker/u8:219:34:043
754599150,2cyclictest0-21swapper/323:11:043
754599150,2cyclictest0-21swapper/322:37:043
754499151,3cyclictest26641-21sendmail-mta21:14:332
754499151,12cyclictest16591-21ssh22:44:052
754499150,13cyclictest23691-21ssh21:44:162
754399150,13cyclictest0-21swapper/122:05:121
7542991512,2cyclictest706-21kworker/u8:021:23:040
7542991512,2cyclictest2959-21kworker/u8:100:17:050
7542991512,2cyclictest18710-21kworker/u8:223:47:040
7542991510,3cyclictest19807-21iostat_ios21:00:160
754299150,13cyclictest0-21swapper/020:20:170
754299150,12cyclictest0-21swapper/000:35:030
754599149,3cyclictest12958-21cat20:44:593
7545991411,2cyclictest7222-21kworker/u8:019:22:043
7545991411,2cyclictest4632-21kworker/u8:020:25:043
7545991411,2cyclictest25855-21kworker/u8:121:20:053
7545991411,2cyclictest15970-21kworker/u8:220:14:043
7545991411,2cyclictest15970-21kworker/u8:219:52:013
754599140,12cyclictest0-21swapper/322:11:573
754499142,7cyclictest0-21swapper/219:20:002
7544991411,2cyclictest15606-21ssh21:35:142
7544991411,2cyclictest0-21swapper/223:50:182
7544991411,2cyclictest0-21swapper/222:24:232
754499140,12cyclictest32067-21ssh21:52:162
754499140,12cyclictest0-21swapper/222:05:172
754399149,3cyclictest0-21swapper/122:50:051
754399148,4cyclictest0-21swapper/123:55:401
754399141,3cyclictest28224-21cut20:00:161
754399141,2cyclictest236032sleep121:44:071
754399140,2cyclictest0-21swapper/123:17:591
754399140,12cyclictest0-21swapper/123:10:111
754399140,12cyclictest0-21swapper/122:14:221
754299149,3cyclictest0-21swapper/022:34:050
7542991411,2cyclictest5149-21kworker/u8:222:48:010
7542991411,2cyclictest15197-21kworker/u8:021:11:040
7542991411,2cyclictest0-21swapper/022:40:160
754299141,11cyclictest24055-21perl19:50:140
754299140,3cyclictest0-21swapper/023:57:530
754299140,2cyclictest18152-21kworker/0:120:56:040
754299140,2cyclictest0-21swapper/022:10:030
7545991310,2cyclictest25605-21kworker/u8:120:47:043
7545991310,2cyclictest19475-21kworker/u8:019:42:013
7545991310,2cyclictest0-21swapper/323:45:183
754599130,2cyclictest0-21swapper/323:33:283
754599130,2cyclictest0-21swapper/320:31:013
754599130,12cyclictest0-21swapper/323:51:533
754599130,11cyclictest4088-21ssh00:12:083
754599130,11cyclictest0-21swapper/320:53:043
754499132,9cyclictest5347-21ssh00:13:592
7544991310,2cyclictest0-21swapper/223:59:242
7544991310,2cyclictest0-21swapper/221:59:382
7544991310,2cyclictest0-21swapper/221:26:242
7544991310,2cyclictest0-21swapper/221:15:252
7544991310,2cyclictest0-21swapper/219:10:152
7544991310,2cyclictest0-21swapper/200:15:442
754499130,2cyclictest0-21swapper/221:31:342
754499130,2cyclictest0-21swapper/200:35:142
754499130,12cyclictest0-21swapper/223:15:142
754499130,12cyclictest0-21swapper/223:07:442
754499130,12cyclictest0-21swapper/222:12:232
754499130,12cyclictest0-21swapper/219:26:052
754399138,3cyclictest0-21swapper/122:47:031
754399132,6cyclictest0-21swapper/122:30:011
754399132,6cyclictest0-21swapper/121:00:001
754399132,6cyclictest0-21swapper/120:40:001
754399132,6cyclictest0-21swapper/120:20:001
754399132,6cyclictest0-21swapper/119:15:011
754399131,9cyclictest0-21swapper/123:20:051
754399131,11cyclictest274-21jbd2/sda1-823:05:161
754399131,10cyclictest0-21swapper/123:35:141
754399131,10cyclictest0-21swapper/121:52:311
7543991310,2cyclictest0-21swapper/123:34:401
7543991310,2cyclictest0-21swapper/121:33:191
7543991310,2cyclictest0-21swapper/100:25:111
754399130,2cyclictest0-21swapper/123:40:111
754399130,2cyclictest0-21swapper/121:58:281
754399130,12cyclictest0-21swapper/122:55:131
754399130,12cyclictest0-21swapper/120:25:181
754399130,11cyclictest0-21swapper/122:35:221
754399130,11cyclictest0-21swapper/100:06:161
7542991310,2cyclictest5247-21kworker/u8:122:01:040
7542991310,2cyclictest25723-21kworker/u8:122:20:040
7542991310,2cyclictest19475-21kworker/u8:019:44:040
7542991310,2cyclictest15970-21kworker/u8:219:35:040
7542991310,2cyclictest10793-21kworker/u8:200:26:000
7542991310,2cyclictest0-21swapper/023:36:040
7542991310,2cyclictest0-21swapper/022:35:230
7542991310,2cyclictest0-21swapper/021:45:290
7542991310,2cyclictest0-21swapper/021:41:360
7542991310,2cyclictest0-21swapper/021:26:020
754299130,8cyclictest0-21swapper/020:32:040
754299130,2cyclictest0-21swapper/021:53:040
754299130,2cyclictest0-21swapper/021:33:160
754299130,12cyclictest0-21swapper/023:01:250
754299130,12cyclictest0-21swapper/020:15:170
754299130,11cyclictest0-21swapper/023:31:040
305582130,0sleep00-21swapper/000:05:560
754599129,2cyclictest0-21swapper/300:15:133
754599120,2cyclictest0-21swapper/321:46:053
754599120,2cyclictest0-21swapper/319:37:043
754599120,11cyclictest0-21swapper/320:06:023
754599120,11cyclictest0-21swapper/319:25:133
754499129,2cyclictest0-21swapper/223:37:142
754499129,2cyclictest0-21swapper/222:45:052
754499129,2cyclictest0-21swapper/221:20:162
754499129,2cyclictest0-21swapper/200:25:212
754499127,3cyclictest9993-21tr23:10:152
754499123,6cyclictest0-21swapper/220:16:012
754499122,6cyclictest0-21swapper/220:25:002
754499121,3cyclictest0-21swapper/200:31:012
754499120,6cyclictest0-21swapper/219:39:022
754499120,2cyclictest0-21swapper/220:55:172
754499120,11cyclictest0-21swapper/221:45:102
754499120,11cyclictest0-21swapper/220:35:172
754499120,11cyclictest0-21swapper/220:30:152
754399129,2cyclictest0-21swapper/123:54:551
754399129,2cyclictest0-21swapper/121:19:191
754399129,2cyclictest0-21swapper/120:40:131
754399129,2cyclictest0-21swapper/119:30:151
754399129,2cyclictest0-21swapper/100:21:101
754399129,2cyclictest0-21swapper/100:10:131
754399122,6cyclictest0-21swapper/122:40:011
754399121,9cyclictest14853-21apt-get20:50:061
754399121,9cyclictest0-21swapper/119:50:131
754399121,6cyclictest0-21swapper/122:20:011
754399121,3cyclictest29238-21munin-node1
754399121,3cyclictest11244-21latency_hist22:05:001
754399120,2cyclictest0-21swapper/123:26:201
754399120,2cyclictest0-21swapper/122:32:111
754399120,2cyclictest0-21swapper/121:20:151
754399120,1cyclictest0-21swapper/120:30:161
754399120,11cyclictest0-21swapper/123:45:151
754399120,11cyclictest0-21swapper/123:04:231
754399120,11cyclictest0-21swapper/121:10:291
754399120,11cyclictest0-21swapper/119:25:191
754399120,11cyclictest0-21swapper/119:20:161
754399120,11cyclictest0-21swapper/100:35:051
754399120,11cyclictest0-21swapper/100:15:021
754399120,10cyclictest0-21swapper/120:56:031
754299129,2cyclictest25605-21kworker/u8:120:40:010
754299129,2cyclictest23674-21kworker/u8:000:01:050
754299129,2cyclictest15970-21kworker/u8:219:49:040
754299129,2cyclictest15970-21kworker/u8:219:33:030
754299129,2cyclictest11932-21kworker/u8:119:29:040
754299129,2cyclictest0-21swapper/020:36:040
754299129,2cyclictest0-21swapper/020:10:120
754299129,2cyclictest0-21swapper/019:15:030
754299120,2cyclictest0-21swapper/019:55:030
754299120,11cyclictest0-21swapper/023:05:270
145382120,2sleep00-21swapper/020:46:030
754599118,2cyclictest0-21swapper/321:01:013
754499118,2cyclictest0-21swapper/219:46:082
754499112,6cyclictest0-21swapper/221:01:592
754499112,6cyclictest0-21swapper/219:44:582
754499111,8cyclictest0-21swapper/219:59:562
754399118,2cyclictest0-21swapper/121:05:201
754399111,8cyclictest31241-21munin-node1
754399111,3cyclictest24377-21aten2.4-expect00:00:111
754399110,9cyclictest0-21swapper/119:55:131
754399110,10cyclictest0-21swapper/121:35:471
754299110,2cyclictest0-21swapper/019:13:040
754499102,7cyclictest0-21swapper/219:33:022
754499100,9cyclictest0-21swapper/219:24:152
754399107,2cyclictest0-21swapper/120:20:001
754399107,2cyclictest0-21swapper/119:15:021
754399105,3cyclictest18078-21tr19:35:121
754399100,9cyclictest0-21swapper/120:45:041
754399100,3cyclictest19872-21munin-node1
754299107,2cyclictest15970-21kworker/u8:220:05:040
754299107,2cyclictest15970-21kworker/u8:220:03:040
754299100,2cyclictest0-21swapper/019:23:040
221902100,2sleep00-21swapper/021:05:430
75459994,3cyclictest0-21swapper/319:15:123
75449994,3cyclictest29393-21aten2.4-expect20:05:132
75449994,3cyclictest22263-21mailstats21:06:022
75449994,3cyclictest1-21init20:40:282
75439994,3cyclictest274-21jbd2/sda1-819:45:061
75429994,3cyclictest4645-21sendmail-mta20:25:050
75429991,7cyclictest0-21swapper/020:51:590
75459983,3cyclictest7845-21aten2.4-expect19:10:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional