You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-27 - 07:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Sat Jun 27, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20501211694,16sleep30-21swapper/319:09:393
19604211486,20sleep20-21swapper/219:05:172
20509211189,16sleep10-21swapper/119:09:451
20488210786,16sleep00-21swapper/019:09:280
151832740,0sleep10-21swapper/123:43:271
327092730,0sleep10-21swapper/121:40:131
276292660,1sleep10-21swapper/122:10:141
2055699360,34cyclictest0-21swapper/022:55:100
2055999221,2cyclictest1125-21hwlatdetect21:00:143
2055999220,2cyclictest0-21swapper/321:25:153
2055999210,12cyclictest0-21swapper/320:00:143
2055799211,3cyclictest0-21swapper/123:52:201
2055799210,3cyclictest29946-21ssh23:24:071
2055799210,3cyclictest26369-21hwlatdetect23:55:151
2055799210,3cyclictest0-21swapper/123:35:571
2055799210,3cyclictest0-21swapper/122:40:151
2055799210,2cyclictest0-21swapper/121:52:071
2055799210,2cyclictest0-21swapper/121:05:131
2055799210,2cyclictest0-21swapper/100:28:221
20559992010,8cyclictest31048-21aten2.4_r3power20:55:123
2055999200,3cyclictest9188-21basename21:50:113
2055999200,3cyclictest8667-21munin-node3
2055999200,3cyclictest15497-21rm00:19:153
2055999200,3cyclictest0-21swapper/323:56:033
2055999200,3cyclictest0-21swapper/322:06:073
2055999200,3cyclictest0-21swapper/300:25:143
2055999200,3cyclictest0-21swapper/300:20:153
2055999200,2cyclictest0-21swapper/322:00:113
2055999200,18cyclictest0-21swapper/323:48:103
2055999200,18cyclictest0-21swapper/323:40:063
2055999200,18cyclictest0-21swapper/323:29:513
2055999200,12cyclictest0-21swapper/322:20:063
2055799201,3cyclictest0-21swapper/119:55:141
2055799200,3cyclictest7713-21ssh22:23:591
2055799200,3cyclictest5545-21ntp_states21:45:181
2055799200,3cyclictest3728-21runrttasks23:29:341
2055799200,3cyclictest3728-21runrttasks23:05:231
2055799200,3cyclictest3449-21sh22:19:511
2055799200,3cyclictest30646-21iostat00:35:151
2055799200,3cyclictest23176-21munin-node1
2055799200,3cyclictest18120-21ssh00:21:031
2055799200,3cyclictest15356-21smartctl20:15:151
2055799200,3cyclictest12368-21sh23:04:501
2055799200,3cyclictest0-21swapper/123:34:231
2055799200,3cyclictest0-21swapper/122:46:191
2055799200,3cyclictest0-21swapper/122:01:551
2055799200,2cyclictest0-21swapper/120:20:171
2055799200,18cyclictest29948-21cut20:50:171
171332200,0sleep00-21swapper/021:58:400
2055999190,3cyclictest8683-21rm23:35:543
2055999190,3cyclictest5128-21sh00:06:593
2055999190,3cyclictest450-21munin-node3
2055999190,3cyclictest2751-21ssh22:18:473
2055999190,3cyclictest26694-21apt-get20:45:063
2055999190,3cyclictest26504-21rm00:30:273
2055999190,3cyclictest23805-21ssh23:52:213
2055999190,3cyclictest16293-21ssh23:08:433
2055999190,3cyclictest13801-21ssh22:30:153
2055999190,3cyclictest1361-21ssh22:51:193
2055999190,3cyclictest12073-21ssh21:17:273
2055999190,3cyclictest0-21swapper/323:31:593
2055999190,3cyclictest0-21swapper/322:47:103
2055999190,3cyclictest0-21swapper/321:49:433
2055999190,3cyclictest0-21swapper/321:40:153
2055999190,3cyclictest0-21swapper/321:35:073
2055999190,3cyclictest0-21swapper/319:35:113
2055999190,2cyclictest20617-21apt-get20:30:073
2055999190,2cyclictest0-21swapper/323:10:103
2055999190,2cyclictest0-21swapper/322:40:113
2055999190,2cyclictest0-21swapper/321:20:113
2055999190,2cyclictest0-21swapper/300:10:103
2055999190,1cyclictest0-21swapper/323:15:573
2055999190,1cyclictest0-21swapper/322:36:273
2055999190,17cyclictest0-21swapper/322:12:143
2055799191,3cyclictest20958-21head20:30:131
2055799191,3cyclictest0-21swapper/122:31:001
2055799191,3cyclictest0-21swapper/120:11:031
2055799191,2cyclictest0-21swapper/119:10:151
2055799191,16cyclictest30956-21munin-node1
2055799191,16cyclictest0-21swapper/122:55:591
2055799190,3cyclictest6647-21sed21:11:031
2055799190,3cyclictest6647-21sed21:11:031
2055799190,3cyclictest32243-21users00:01:021
2055799190,3cyclictest0-21swapper/123:16:231
2055799190,3cyclictest0-21swapper/122:35:121
2055799190,3cyclictest0-21swapper/121:20:061
2055799190,3cyclictest0-21swapper/119:45:151
2055799190,3cyclictest0-21swapper/119:41:011
2055799190,2cyclictest32368-21if_err_eth022:50:151
2055799190,2cyclictest17386-21apt-get23:10:111
2055799190,2cyclictest0-21swapper/123:47:271
2055799190,2cyclictest0-21swapper/122:26:271
2055799190,2cyclictest0-21swapper/121:03:221
2055799190,17cyclictest0-21swapper/120:40:511
2055699190,2cyclictest0-21swapper/022:50:100
2055999180,3cyclictest0-21swapper/321:55:543
2055999180,3cyclictest0-21swapper/300:35:303
2055999180,2cyclictest17752-21ps20:20:173
2055999180,2cyclictest0-21swapper/322:55:353
2055999180,2cyclictest0-21swapper/321:30:103
2055999180,2cyclictest0-21swapper/320:50:103
2055999180,2cyclictest0-21swapper/300:01:063
2055999180,1cyclictest0-21swapper/321:10:183
2055999180,1cyclictest0-21swapper/321:10:173
20558991815,2cyclictest31809-21kworker/u8:123:01:042
20558991815,2cyclictest16702-21kworker/u8:021:38:022
2055799189,7cyclictest4481-21diskmemload21:58:461
2055799181,3cyclictest0-21swapper/121:25:151
2055799181,3cyclictest0-21swapper/120:01:031
2055799180,3cyclictest25390-21chrt22:07:471
2055799180,3cyclictest23725-21ps19:15:191
2055799180,3cyclictest0-21swapper/121:35:171
2055799180,3cyclictest0-21swapper/100:09:111
2055799180,2cyclictest0-21swapper/120:45:071
2055799180,2cyclictest0-21swapper/100:30:111
2055799180,2cyclictest0-21swapper/100:12:351
2055799180,16cyclictest0-21swapper/121:16:231
2055799180,16cyclictest0-21swapper/120:36:011
2055999170,2cyclictest0-21swapper/323:01:233
2055999170,2cyclictest0-21swapper/320:35:143
20558991714,2cyclictest1410-21kworker/u8:121:41:052
20558991714,2cyclictest13867-21kworker/u8:122:09:052
20558991714,2cyclictest10660-21kworker/u8:121:16:062
20558991714,2cyclictest10122-21kworker/u8:123:40:052
2055799171,3cyclictest24804-21munin-node1
2055799171,3cyclictest0-21swapper/119:25:151
2055799171,3cyclictest0-21swapper/100:18:451
2055799170,2cyclictest0-21swapper/120:05:051
2055799170,2cyclictest0-21swapper/119:50:151
2055699170,16cyclictest0-21swapper/023:58:050
277452160,0sleep20-21swapper/220:45:162
2055999166,8cyclictest27737-21ssh23:20:273
2055999161,13cyclictest4415-21apt-get19:50:063
2055899163,2cyclictest0-21swapper/222:57:442
20558991613,2cyclictest4703-21kworker/u8:022:41:052
20558991613,2cyclictest32683-21kworker/u8:200:04:052
20558991613,2cyclictest28576-21kworker/u8:119:30:012
20558991613,2cyclictest24966-21kworker/u8:019:46:032
20558991613,2cyclictest24936-21kworker/u8:221:05:052
20558991613,2cyclictest24936-21kworker/u8:220:55:052
20558991613,2cyclictest21617-21kworker/u8:123:20:052
20558991613,2cyclictest2129-21kworker/u8:220:00:052
20558991613,2cyclictest19128-21kworker/u8:300:27:042
20558991613,2cyclictest16702-21kworker/u8:021:30:022
20558991613,2cyclictest15926-21kworker/u8:222:35:042
20558991613,2cyclictest10780-21kworker/u8:122:28:052
2055899161,13cyclictest24270-21ssh23:16:412
2055799160,14cyclictest0-21swapper/120:25:111
2055799160,14cyclictest0-21swapper/119:31:021
2055999154,9cyclictest0-21swapper/319:13:423
2055999151,12cyclictest16639-21cat20:20:003
2055999150,13cyclictest0-21swapper/319:23:563
20558991512,2cyclictest5437-21kworker/u8:219:24:002
20558991512,2cyclictest4703-21kworker/u8:023:12:052
20558991512,2cyclictest4703-21kworker/u8:022:22:012
20558991512,2cyclictest32683-21kworker/u8:200:16:052
20558991512,2cyclictest25114-21kworker/u8:022:13:042
20558991512,2cyclictest24936-21kworker/u8:221:21:042
20558991512,2cyclictest22495-21kworker/u8:120:34:052
20558991512,2cyclictest2129-21kworker/u8:220:06:062
20558991512,2cyclictest20815-21kworker/u8:123:57:052
20558991512,2cyclictest20815-21kworker/u8:123:50:022
20558991512,2cyclictest13867-21kworker/u8:122:03:052
20558991512,2cyclictest10122-21kworker/u8:123:39:042
2055899150,13cyclictest0-21swapper/200:30:122
2055799151,3cyclictest31537-21munin-node1
20556991512,2cyclictest20365-21kworker/u8:020:30:050
53602140,1sleep0101ktimersoftd/021:10:140
53602140,1sleep0101ktimersoftd/021:10:130
2055999143,9cyclictest27627-21missed_timers19:25:183
2055999143,9cyclictest13504-21latency20:10:153
2055999142,2cyclictest0-21swapper/319:45:133
2055999141,3cyclictest7262-21tr19:55:163
2055999141,3cyclictest3728-21runrttasks20:05:063
2055999141,3cyclictest3728-21runrttasks19:15:133
2055999141,3cyclictest28937-21aten2.4_r3power19:30:123
2055999141,3cyclictest18848-21aten2.4_r3power20:25:123
2055999140,3cyclictest2914-21df_abs21:05:133
2055999140,3cyclictest25038-21cut20:40:133
20558991411,2cyclictest8236-21kworker/u8:021:52:022
20558991411,2cyclictest5437-21kworker/u8:219:27:052
20558991411,2cyclictest5437-21kworker/u8:219:13:042
20558991411,2cyclictest32683-21kworker/u8:200:24:052
20558991411,2cyclictest31026-21kworker/u8:021:00:052
20558991411,2cyclictest22495-21kworker/u8:120:40:052
20558991411,2cyclictest21617-21kworker/u8:123:29:052
20558991411,2cyclictest21594-21kworker/u8:221:47:042
20558991411,2cyclictest2129-21kworker/u8:220:18:022
20558991411,2cyclictest2129-21kworker/u8:219:54:052
20558991411,2cyclictest20868-21kworker/u8:119:18:042
20558991411,2cyclictest20365-21kworker/u8:020:27:052
20558991411,2cyclictest18305-21kworker/u8:120:22:052
20558991411,2cyclictest15671-21kworker/u8:223:46:052
20558991411,2cyclictest15671-21kworker/u8:223:31:052
20558991411,2cyclictest13867-21kworker/u8:122:16:052
20558991411,2cyclictest10922-21kworker/u8:020:10:042
20558991411,2cyclictest0-21swapper/222:31:412
20558991410,3cyclictest6914-21apt-get00:10:052
2055899140,2cyclictest4481-21diskmemload00:06:112
20556991411,2cyclictest12779-21apt-get23:05:110
20556991410,2cyclictest25114-21kworker/u8:022:12:040
2055699140,13cyclictest0-21swapper/022:20:160
2055699140,13cyclictest0-21swapper/022:00:150
20558991310,2cyclictest4845-21kworker/u8:119:57:052
20558991310,2cyclictest4703-21kworker/u8:022:52:052
20558991310,2cyclictest29081-21kworker/u8:100:36:052
20558991310,2cyclictest24966-21kworker/u8:019:35:052
20558991310,2cyclictest24936-21kworker/u8:221:13:052
20558991310,2cyclictest24936-21kworker/u8:221:13:052
20558991310,2cyclictest24936-21kworker/u8:220:54:052
2055899130,12cyclictest453-21apt-get19:40:122
2055899130,12cyclictest18561-21apt-get21:25:132
2055899130,12cyclictest0-21swapper/223:06:042
2055899130,12cyclictest0-21swapper/222:46:342
2055899130,12cyclictest0-21swapper/221:56:102
2055699131,2cyclictest0-21swapper/023:46:000
20556991310,2cyclictest3790-21ssh00:05:370
20556991310,2cyclictest0-21swapper/022:42:170
20556991310,2cyclictest0-21swapper/022:15:140
20556991310,2cyclictest0-21swapper/021:35:140
20556991310,2cyclictest0-21swapper/019:50:080
20556991310,2cyclictest0-21swapper/019:34:220
20556991310,2cyclictest0-21swapper/000:28:110
20556991310,2cyclictest0-21swapper/000:17:590
2055699130,2cyclictest0-21swapper/022:05:140
2055699130,2cyclictest0-21swapper/020:25:180
2055699130,2cyclictest0-21swapper/019:55:140
2055699130,2cyclictest0-21swapper/000:35:510
2055699130,12cyclictest0-21swapper/023:01:050
2055699130,12cyclictest0-21swapper/022:35:150
2055699130,12cyclictest0-21swapper/021:41:360
2055699130,12cyclictest0-21swapper/020:05:170
2055699130,12cyclictest0-21swapper/000:20:390
2055699130,11cyclictest0-21swapper/023:19:510
2055699130,11cyclictest0-21swapper/021:17:190
2055699129,2cyclictest15671-21kworker/u8:223:25:040
2055699129,2cyclictest0-21swapper/023:50:010
2055699129,2cyclictest0-21swapper/023:41:370
2055699129,2cyclictest0-21swapper/023:30:310
2055699129,2cyclictest0-21swapper/021:27:380
2055699129,2cyclictest0-21swapper/021:20:260
2055699129,2cyclictest0-21swapper/021:05:140
2055699129,2cyclictest0-21swapper/020:55:190
2055699129,2cyclictest0-21swapper/020:35:390
2055699129,2cyclictest0-21swapper/020:10:120
2055699129,2cyclictest0-21swapper/000:01:380
2055699120,2cyclictest0-21swapper/023:35:510
2055699120,2cyclictest0-21swapper/023:22:080
2055699120,2cyclictest0-21swapper/022:31:180
2055699120,2cyclictest0-21swapper/022:25:290
2055699120,2cyclictest0-21swapper/021:45:160
2055699120,2cyclictest0-21swapper/021:30:120
2055699120,11cyclictest0-21swapper/023:11:300
2055699120,11cyclictest0-21swapper/022:45:530
2055699120,11cyclictest0-21swapper/021:50:090
2055699120,11cyclictest0-21swapper/020:20:140
2055699120,11cyclictest0-21swapper/019:15:400
2055699120,11cyclictest0-21swapper/000:30:150
2055699120,11cyclictest0-21swapper/000:11:530
269292110,1sleep00-21swapper/020:45:070
2055899110,2cyclictest0-21swapper/220:38:012
2055699118,2cyclictest0-21swapper/019:35:130
2055699110,9cyclictest0-21swapper/019:40:070
2055699107,2cyclictest0-21swapper/021:00:110
2055699107,2cyclictest0-21swapper/020:15:160
2055699107,2cyclictest0-21swapper/020:00:140
2055699107,2cyclictest0-21swapper/019:25:140
2055699100,9cyclictest24966-21kworker/u8:019:47:050
2055699100,9cyclictest24936-21kworker/u8:220:52:040
205569996,2cyclictest0-21swapper/019:11:000
25953280,2sleep00-21swapper/020:40:460
205569984,2cyclictest25172-21df19:20:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional