You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 01:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Mon Nov 24, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9751211897,15sleep10-21swapper/107:09:251
9512211693,17sleep00-21swapper/007:06:180
9463211595,15sleep30-21swapper/307:05:423
9487211494,15sleep20-21swapper/207:06:012
265812690,1sleep10-21swapper/107:50:131
234662690,0sleep10-21swapper/112:00:101
63592630,6sleep3983099cyclictest10:31:133
277192560,0sleep20-21swapper/210:20:142
190002240,1sleep119007-21unixbench_multi09:35:281
983099222,2cyclictest0-21swapper/310:46:053
9827992219,2cyclictest13769-21kworker/u8:008:58:010
9830992118,2cyclictest3712-21kworker/u8:110:02:053
9830992118,2cyclictest31488-21kworker/u8:008:09:053
9830992118,2cyclictest25688-21kworker/u8:011:32:043
9830992118,2cyclictest23286-21kworker/u8:209:41:043
9830992118,2cyclictest23090-21kworker/u8:011:17:043
9830992118,2cyclictest17324-21kworker/u8:211:55:053
9830992118,2cyclictest15563-21kworker/u8:307:47:043
982999210,16cyclictest0-21swapper/208:32:052
9828992118,2cyclictest6842-21kworker/u8:110:32:041
9828992118,2cyclictest6546-21kworker/u8:109:28:051
982799213,2cyclictest0-21swapper/010:37:040
982799212,2cyclictest0-21swapper/010:46:040
9827992118,2cyclictest8321-21kworker/u8:208:29:050
9827992118,2cyclictest31241-21kworker/u8:209:27:050
9827992118,2cyclictest15345-21kworker/u8:211:20:010
206382210,1sleep3381ktimersoftd/310:12:183
9830992017,2cyclictest8321-21kworker/u8:208:50:043
9830992017,2cyclictest8321-21kworker/u8:208:28:043
9830992017,2cyclictest4066-21kworker/u8:011:50:043
9830992017,2cyclictest4066-21kworker/u8:011:50:043
9830992017,2cyclictest30535-21kworker/u8:012:07:053
9830992017,2cyclictest25788-21kworker/u8:007:12:043
9830992017,2cyclictest23090-21kworker/u8:011:08:043
9830992017,2cyclictest21853-21kworker/u8:108:04:043
9830992017,2cyclictest20453-21kworker/u8:111:23:043
9830992017,2cyclictest17633-21kworker/u8:109:49:053
9830992017,2cyclictest17399-21kworker/u8:110:57:043
9830992017,2cyclictest15858-21kworker/u8:010:18:043
9830992017,2cyclictest15563-21kworker/u8:307:30:053
9830992017,2cyclictest13769-21kworker/u8:008:55:053
9830992017,2cyclictest11555-21kworker/u8:009:31:053
9830992017,2cyclictest10077-21kworker/u8:107:16:053
983099201,2cyclictest0-21swapper/307:56:023
982999200,18cyclictest0-21swapper/210:33:042
9828992017,2cyclictest31335-21kworker/u8:111:38:041
9828992017,2cyclictest31335-21kworker/u8:111:34:041
9828992017,2cyclictest20453-21kworker/u8:111:26:061
9828992017,2cyclictest17399-21kworker/u8:111:02:051
982799203,2cyclictest0-21swapper/012:02:050
9827992017,2cyclictest8321-21kworker/u8:208:47:050
9827992017,2cyclictest31488-21kworker/u8:008:02:050
9827992017,2cyclictest26558-21kworker/u8:109:15:040
9827992017,2cyclictest25688-21kworker/u8:011:30:040
9827992017,2cyclictest23090-21kworker/u8:011:18:050
9827992017,2cyclictest21931-21kworker/u8:311:58:010
9827992017,2cyclictest21853-21kworker/u8:107:42:040
9827992017,2cyclictest16518-21kworker/u8:112:37:050
9827992017,2cyclictest15858-21kworker/u8:010:16:020
9827992017,2cyclictest15563-21kworker/u8:307:50:040
9827992017,2cyclictest15563-21kworker/u8:307:24:050
9827992017,2cyclictest15345-21kworker/u8:211:26:020
9827992017,2cyclictest13769-21kworker/u8:008:54:040
9827992017,2cyclictest11976-21kworker/u8:010:43:040
982799201,2cyclictest0-21swapper/010:21:040
982799201,2cyclictest0-21swapper/007:56:020
982799200,18cyclictest0-21swapper/012:26:050
982799200,18cyclictest0-21swapper/011:11:040
983099192,2cyclictest0-21swapper/310:37:053
9830991916,2cyclictest8321-21kworker/u8:208:30:053
9830991916,2cyclictest31335-21kworker/u8:111:46:053
9830991916,2cyclictest23286-21kworker/u8:209:51:043
9830991916,2cyclictest23090-21kworker/u8:011:10:053
9830991916,2cyclictest21853-21kworker/u8:108:20:053
9830991916,2cyclictest11485-21kworker/u8:012:22:063
983099191,2cyclictest0-21swapper/308:35:043
983099190,2cyclictest0-21swapper/312:18:043
983099190,2cyclictest0-21swapper/310:54:053
983099190,2cyclictest0-21swapper/310:21:053
983099190,2cyclictest0-21swapper/309:28:053
9829991916,2cyclictest31335-21kworker/u8:112:10:052
982999190,2cyclictest0-21swapper/212:36:052
982999190,2cyclictest0-21swapper/212:17:042
982999190,2cyclictest0-21swapper/211:40:122
982999190,2cyclictest0-21swapper/211:25:052
982999190,2cyclictest0-21swapper/209:47:052
982999190,18cyclictest0-21swapper/210:28:052
982999190,18cyclictest0-21swapper/210:16:052
982999190,18cyclictest0-21swapper/208:07:052
982999190,13cyclictest0-21swapper/208:53:042
9828991916,2cyclictest21934-21kworker/u8:210:47:041
9828991916,2cyclictest17399-21kworker/u8:110:52:061
9828991916,2cyclictest15563-21kworker/u8:307:21:051
9827991916,2cyclictest10077-21kworker/u8:107:19:040
982799191,2cyclictest0-21swapper/011:03:050
982799191,2cyclictest0-21swapper/010:32:040
982799190,2cyclictest0-21swapper/010:54:060
982799190,2cyclictest0-21swapper/009:30:040
982799190,2cyclictest0-21swapper/008:35:050
982799190,17cyclictest0-21swapper/009:22:050
9830991815,2cyclictest8321-21kworker/u8:208:46:053
9830991815,2cyclictest3770-21kworker/u8:310:05:043
983099180,2cyclictest0-21swapper/311:35:053
983099180,2cyclictest0-21swapper/311:02:053
983099180,2cyclictest0-21swapper/309:24:053
983099180,2cyclictest0-21swapper/309:17:043
983099180,2cyclictest0-21swapper/309:10:043
983099180,2cyclictest0-21swapper/308:15:043
9829991815,2cyclictest23286-21kworker/u8:209:57:042
9829991815,2cyclictest20453-21kworker/u8:111:24:042
982999180,8cyclictest0-21swapper/211:53:052
982999180,8cyclictest0-21swapper/211:53:042
982999180,12cyclictest0-21swapper/211:58:062
9828991815,2cyclictest31488-21kworker/u8:008:13:051
9828991815,2cyclictest31335-21kworker/u8:112:09:041
9828991815,2cyclictest23286-21kworker/u8:209:43:041
9828991815,2cyclictest19606-21kworker/u8:007:34:051
9828991815,2cyclictest15563-21kworker/u8:307:25:041
9827991815,2cyclictest8321-21kworker/u8:208:44:040
9827991815,2cyclictest19606-21kworker/u8:007:37:050
982799181,1cyclictest0-21swapper/009:10:050
982799180,2cyclictest0-21swapper/012:18:040
982799180,2cyclictest0-21swapper/011:35:040
982799180,2cyclictest0-21swapper/008:15:040
982799180,2cyclictest0-21swapper/008:06:010
982799180,16cyclictest0-21swapper/010:10:040
983099170,2cyclictest0-21swapper/311:29:043
983099170,2cyclictest0-21swapper/310:27:043
983099170,2cyclictest0-21swapper/309:35:043
983099170,2cyclictest0-21swapper/308:13:043
9829991714,2cyclictest21934-21kworker/u8:210:46:052
982999170,16cyclictest0-21swapper/209:04:052
982999170,10cyclictest0-21swapper/210:40:012
9828991714,2cyclictest3712-21kworker/u8:110:11:051
9828991714,2cyclictest25788-21kworker/u8:007:13:041
9828991714,2cyclictest23286-21kworker/u8:209:52:051
9828991714,2cyclictest17399-21kworker/u8:110:56:041
9828991714,2cyclictest17399-21kworker/u8:110:44:041
9828991714,2cyclictest13769-21kworker/u8:009:06:011
982899170,2cyclictest0-21swapper/110:37:051
9827991714,2cyclictest15563-21kworker/u8:307:48:050
982799170,2cyclictest0-21swapper/012:08:050
982799170,2cyclictest0-21swapper/010:27:050
982799170,2cyclictest0-21swapper/009:35:050
982799170,16cyclictest0-21swapper/008:33:040
983099160,2cyclictest0-21swapper/312:35:043
983099160,2cyclictest0-21swapper/311:42:043
983099160,2cyclictest0-21swapper/310:41:043
9829991613,2cyclictest6842-21kworker/u8:110:37:052
9829991613,2cyclictest3770-21kworker/u8:310:03:052
9829991613,2cyclictest31335-21kworker/u8:111:36:022
9829991613,2cyclictest31241-21kworker/u8:209:30:042
9829991613,2cyclictest21853-21kworker/u8:107:56:022
9829991613,2cyclictest13769-21kworker/u8:009:16:052
9828991613,2cyclictest3577-21kworker/u8:211:05:041
9828991613,2cyclictest31335-21kworker/u8:111:52:051
9828991613,2cyclictest31335-21kworker/u8:111:52:041
9828991613,2cyclictest27418-21kworker/u8:110:25:051
9828991613,2cyclictest21853-21kworker/u8:107:43:041
9828991613,2cyclictest19606-21kworker/u8:007:35:041
9828991613,2cyclictest13769-21kworker/u8:009:18:041
9828991613,2cyclictest13769-21kworker/u8:008:52:041
9828991613,2cyclictest11485-21kworker/u8:012:21:051
982899161,13cyclictest25076-21tr07:45:171
9828991610,4cyclictest0-21swapper/112:35:171
982799160,2cyclictest0-21swapper/011:41:050
982799160,2cyclictest0-21swapper/010:59:040
982799160,2cyclictest0-21swapper/010:09:040
982799160,2cyclictest0-21swapper/008:13:050
983099150,14cyclictest0-21swapper/307:43:053
9829991512,2cyclictest9433-21kworker/u8:111:14:052
9829991512,2cyclictest21931-21kworker/u8:312:02:042
9829991512,2cyclictest21853-21kworker/u8:108:35:042
9829991512,2cyclictest21853-21kworker/u8:108:03:042
9829991512,2cyclictest17399-21kworker/u8:110:54:052
9829991510,3cyclictest0-21swapper/208:40:142
9828991512,2cyclictest8321-21kworker/u8:208:36:021
9828991512,2cyclictest0-21swapper/112:12:491
982899150,13cyclictest26262-21diskmemload11:46:091
982899150,13cyclictest25106-21diskmemload10:16:591
982899150,13cyclictest19303-21hwlatdetect11:20:151
982899150,13cyclictest0-21swapper/111:42:191
982799151,12cyclictest26262-21diskmemload10:04:070
982799150,2cyclictest0-21swapper/012:24:040
982799150,14cyclictest0-21swapper/012:14:050
982799150,14cyclictest0-21swapper/009:09:040
983099141,3cyclictest3837-21ssh12:13:353
983099141,2cyclictest24225-21apt-get09:05:063
983099141,12cyclictest22168-21apt-get09:00:043
983099140,2cyclictest0-21swapper/309:56:053
982999149,3cyclictest20522-21timerandwakeup12:30:252
9829991411,2cyclictest17399-21kworker/u8:111:03:052
9829991411,2cyclictest11485-21kworker/u8:012:26:042
9829991411,2cyclictest10077-21kworker/u8:107:18:052
9829991411,2cyclictest0-21swapper/210:59:542
9829991411,2cyclictest0-21swapper/208:20:152
982999140,2cyclictest0-21swapper/212:23:052
982999140,2cyclictest0-21swapper/209:52:542
982999140,12cyclictest0-21swapper/211:30:232
9828991411,2cyclictest26262-21diskmemload09:14:401
9828991411,2cyclictest23286-21kworker/u8:209:56:041
982899140,2cyclictest0-21swapper/110:24:591
982899140,2cyclictest0-21swapper/110:02:501
982899140,13cyclictest0-21swapper/111:16:401
982899140,13cyclictest0-21swapper/110:08:591
982899140,12cyclictest0-21swapper/112:31:331
982799141,11cyclictest31209-21apt-get09:50:060
982799140,2cyclictest0-21swapper/009:48:040
982799140,2cyclictest0-21swapper/009:03:050
982799140,2cyclictest0-21swapper/008:23:050
982799140,12cyclictest0-21swapper/011:50:130
982799140,12cyclictest0-21swapper/011:50:120
982799140,12cyclictest0-21swapper/011:45:100
45162140,2sleep20-21swapper/209:20:232
273442140,3sleep30-21swapper/307:50:243
983099130,2cyclictest0-21swapper/308:41:043
983099130,12cyclictest0-21swapper/312:25:143
983099130,11cyclictest0-21swapper/312:33:363
9829991310,2cyclictest31488-21kworker/u8:008:15:042
9829991310,2cyclictest31335-21kworker/u8:111:45:042
9829991310,2cyclictest31241-21kworker/u8:209:25:042
9829991310,2cyclictest15563-21kworker/u8:307:23:052
9829991310,2cyclictest13769-21kworker/u8:009:10:052
9829991310,2cyclictest0-21swapper/212:06:342
982999130,12cyclictest0-21swapper/211:18:242
9828991310,2cyclictest4411-21ssh09:20:191
9828991310,2cyclictest22498-21kworker/u8:209:04:021
9828991310,2cyclictest0-21swapper/109:46:531
9828991310,2cyclictest0-21swapper/109:30:221
9828991310,2cyclictest0-21swapper/108:15:151
9828991310,2cyclictest0-21swapper/107:15:111
982899130,2cyclictest0-21swapper/111:55:051
982899130,2cyclictest0-21swapper/111:11:231
982899130,2cyclictest0-21swapper/108:05:141
982899130,2cyclictest0-21swapper/107:55:151
982899130,12cyclictest0-21swapper/112:26:101
982899130,12cyclictest0-21swapper/112:15:531
982799139,2cyclictest0-21swapper/012:30:110
982799130,2cyclictest0-21swapper/009:56:040
982799130,2cyclictest0-21swapper/009:41:030
66462130,2sleep00-21swapper/011:06:060
203992130,1sleep30-21swapper/307:35:133
983099120,2cyclictest0-21swapper/312:00:383
982999129,2cyclictest31241-21kworker/u8:209:35:052
982999129,2cyclictest15858-21kworker/u8:010:10:052
982999129,2cyclictest15563-21kworker/u8:307:46:052
982999120,2cyclictest0-21swapper/208:25:122
982999120,11cyclictest0-21swapper/207:10:252
982899129,2cyclictest0-21swapper/108:55:241
982899120,2cyclictest0-21swapper/108:04:041
982899120,11cyclictest0-21swapper/108:28:041
982899120,11cyclictest0-21swapper/108:20:141
983099110,2cyclictest0-21swapper/307:25:043
982999118,2cyclictest23090-21kworker/u8:011:07:042
982999118,2cyclictest15563-21kworker/u8:307:26:042
982999110,2cyclictest0-21swapper/209:44:012
982899118,2cyclictest0-21swapper/108:40:091
982899110,10cyclictest0-21swapper/108:30:041
982799118,2cyclictest0-21swapper/007:32:210
982799110,2cyclictest0-21swapper/007:25:040
150832110,1sleep20-21swapper/210:05:522
982999107,2cyclictest31488-21kworker/u8:008:11:042
982999107,2cyclictest19606-21kworker/u8:007:31:052
982999107,2cyclictest13769-21kworker/u8:009:08:042
982999107,2cyclictest13769-21kworker/u8:008:45:052
982999105,3cyclictest27233-21cut07:50:192
982899100,9cyclictest0-21swapper/108:45:241
98309994,3cyclictest14398-21df07:20:113
98299996,2cyclictest20405-21telnet08:55:132
98299995,3cyclictest21206-21pzem_voltage07:35:222
98299990,2cyclictest0-21swapper/207:40:142
98279994,3cyclictest11510-21chrt07:10:550
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional