You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-02 - 11:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Thu Jul 02, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28598211493,13sleep20-21swapper/219:05:052
30262210796,6sleep00-21swapper/019:08:150
30236210689,12sleep10-21swapper/119:07:561
30116210695,6sleep30-21swapper/319:06:233
142312870,0sleep1221ktimersoftd/122:54:291
133122820,0sleep00-21swapper/023:27:500
287322730,0sleep10-21swapper/122:00:101
240732710,0sleep20-21swapper/221:20:112
131592710,0sleep30-21swapper/322:52:423
166642700,1sleep10-21swapper/121:46:031
99632680,0sleep30-21swapper/300:00:013
5582670,0sleep10-21swapper/123:50:011
3042299270,25cyclictest0-21swapper/023:45:110
129962250,1sleep20-21swapper/219:45:142
3042299240,22cyclictest0-21swapper/022:40:120
3042299210,3cyclictest14270-21diskmemload00:15:100
30424992017,2cyclictest3230-21kworker/u8:122:08:042
3042499200,4cyclictest0-21swapper/222:35:052
16342190,1sleep00-21swapper/023:50:150
30425991815,2cyclictest22042-21kworker/u8:021:18:043
30424991815,2cyclictest8507-21kworker/u8:123:31:052
30424991815,2cyclictest8285-21kworker/u8:022:52:022
30424991815,2cyclictest3701-21kworker/u8:222:25:052
30424991815,2cyclictest3093-21kworker/u8:222:47:052
30424991815,2cyclictest3093-21kworker/u8:222:42:042
30424991815,2cyclictest30830-21kworker/u8:123:50:042
30424991815,2cyclictest22173-21kworker/u8:220:36:052
30424991815,2cyclictest10505-21kworker/u8:221:14:052
30424991815,2cyclictest10505-21kworker/u8:221:04:012
3042499180,2cyclictest0-21swapper/223:28:042
30425991714,2cyclictest3701-21kworker/u8:221:49:053
30425991714,2cyclictest3701-21kworker/u8:221:42:043
3042599170,2cyclictest0-21swapper/322:35:053
30424991714,2cyclictest7493-21kworker/u8:019:20:052
30424991714,2cyclictest7481-21kworker/u8:219:34:042
30424991714,2cyclictest24197-21kworker/u8:120:14:042
30424991714,2cyclictest21482-21kworker/u8:200:25:042
30424991714,2cyclictest21482-21kworker/u8:200:13:052
30424991714,2cyclictest13538-21kworker/u8:323:03:052
30424991714,2cyclictest10505-21kworker/u8:221:15:042
3042499171,2cyclictest0-21swapper/223:24:022
3042499171,2cyclictest0-21swapper/200:18:042
3042499170,12cyclictest0-21swapper/220:22:052
3042499170,12cyclictest0-21swapper/219:50:042
30423991711,2cyclictest0-21swapper/122:09:001
30425991613,2cyclictest16573-21kworker/u8:321:12:053
30424991613,2cyclictest28474-21kworker/u8:121:30:052
30424991613,2cyclictest24197-21kworker/u8:120:02:012
30424991613,2cyclictest24197-21kworker/u8:119:58:052
30424991613,2cyclictest22173-21kworker/u8:220:31:052
30424991613,2cyclictest18537-21kworker/u8:223:47:052
30424991613,2cyclictest18537-21kworker/u8:223:42:042
30424991613,2cyclictest12506-21kworker/u8:100:38:052
3042499160,2cyclictest0-21swapper/223:18:052
3042499160,2cyclictest0-21swapper/200:07:052
30423991611,3cyclictest23581-21sendmail21:19:591
3042299161,13cyclictest0-21swapper/022:35:160
30425991512,2cyclictest7481-21kworker/u8:219:32:053
30425991512,2cyclictest3701-21kworker/u8:222:31:043
30425991512,2cyclictest3701-21kworker/u8:222:27:043
30425991512,2cyclictest22042-21kworker/u8:021:20:063
30425991512,2cyclictest13395-21kworker/u8:023:38:043
30425991510,4cyclictest8720-21ssh21:38:083
3042599150,2cyclictest0-21swapper/300:18:043
3042599150,13cyclictest0-21swapper/322:05:103
3042599150,10cyclictest0-21swapper/321:59:053
30424991512,2cyclictest3639-21kworker/u8:000:04:042
30424991512,2cyclictest28604-21kworker/u8:020:29:042
30424991512,2cyclictest24197-21kworker/u8:119:28:052
30424991512,2cyclictest21482-21kworker/u8:200:31:052
30424991512,2cyclictest21482-21kworker/u8:200:20:022
30424991512,2cyclictest20773-21kworker/u8:121:54:042
30424991512,2cyclictest13538-21kworker/u8:322:59:042
30424991512,2cyclictest13395-21kworker/u8:023:39:042
30424991510,3cyclictest0-21swapper/221:36:012
3042499150,4cyclictest14270-21diskmemload23:08:042
3042499150,3cyclictest0-21swapper/219:35:052
3042499150,3cyclictest0-21swapper/219:16:012
3042499150,13cyclictest0-21swapper/223:11:412
3042499150,13cyclictest0-21swapper/223:11:402
3042499150,13cyclictest0-21swapper/222:19:212
30423991512,2cyclictest0-21swapper/123:04:501
3042399150,13cyclictest0-21swapper/123:55:401
3042399150,13cyclictest0-21swapper/122:36:501
3042399150,13cyclictest0-21swapper/119:20:151
3042399150,13cyclictest0-21swapper/100:19:021
3042299151,12cyclictest18268-21ssh22:58:260
30422991510,3cyclictest0-21swapper/000:35:540
30422991510,3cyclictest0-21swapper/000:11:280
3042299150,13cyclictest0-21swapper/000:34:350
30425991411,2cyclictest8491-21kworker/u8:022:23:053
30425991411,2cyclictest3639-21kworker/u8:000:05:053
30425991411,2cyclictest30830-21kworker/u8:123:48:023
30425991411,2cyclictest28604-21kworker/u8:020:28:043
30425991411,2cyclictest24197-21kworker/u8:119:16:053
30425991411,2cyclictest21482-21kworker/u8:200:30:023
30425991411,2cyclictest14270-21diskmemload23:23:183
30425991411,2cyclictest13538-21kworker/u8:323:10:053
30425991411,2cyclictest13538-21kworker/u8:323:10:043
30425991411,2cyclictest0-21swapper/321:31:483
3042599140,9cyclictest0-21swapper/319:12:053
3042599140,13cyclictest0-21swapper/323:16:583
3042599140,13cyclictest0-21swapper/322:15:173
3042599140,13cyclictest0-21swapper/321:53:473
3042599140,12cyclictest0-21swapper/323:05:273
3042599140,10cyclictest0-21swapper/320:21:053
30424991411,2cyclictest18537-21kworker/u8:223:56:022
30424991411,2cyclictest0-21swapper/222:21:012
30424991410,2cyclictest0-21swapper/221:27:332
3042499140,12cyclictest12787-21ssh21:42:042
30423991411,2cyclictest13913-21ssh00:04:101
30423991411,2cyclictest0-21swapper/100:35:001
30423991411,2cyclictest0-21swapper/100:21:401
30423991410,2cyclictest943-21apt-get23:15:091
3042399140,2cyclictest0-21swapper/123:09:591
3042399140,13cyclictest0-21swapper/123:51:471
3042399140,13cyclictest0-21swapper/123:35:401
3042399140,13cyclictest0-21swapper/120:25:291
3042399140,12cyclictest25003-21fschecks_count20:15:151
3042399140,12cyclictest14270-21diskmemload21:37:321
3042399140,12cyclictest0-21swapper/122:46:441
3042299149,3cyclictest32647-21munin-node0
3042299149,3cyclictest19198-21munin-run21:50:000
3042299142,6cyclictest0-21swapper/019:25:000
30422991411,2cyclictest0-21swapper/022:16:360
30422991411,2cyclictest0-21swapper/021:44:150
30422991410,2cyclictest0-21swapper/023:41:000
3042299140,2cyclictest0-21swapper/022:46:450
3042299140,12cyclictest0-21swapper/022:05:570
30425991310,2cyclictest3887-21kworker/u8:020:51:043
30425991310,2cyclictest3701-21kworker/u8:222:02:043
30425991310,2cyclictest30796-21kworker/u8:120:57:053
30425991310,2cyclictest28715-21kworker/u8:100:27:043
30425991310,2cyclictest21482-21kworker/u8:200:36:043
30425991310,2cyclictest21482-21kworker/u8:200:23:053
30425991310,2cyclictest13538-21kworker/u8:322:56:063
30425991310,2cyclictest0-21swapper/321:26:273
30425991310,2cyclictest0-21swapper/320:05:183
30425991310,2cyclictest0-21swapper/319:35:203
30425991310,2cyclictest0-21swapper/300:03:593
3042599130,2cyclictest14270-21diskmemload23:00:203
3042599130,2cyclictest0-21swapper/322:42:273
3042599130,2cyclictest0-21swapper/321:02:093
3042599130,12cyclictest0-21swapper/322:10:183
30424991310,2cyclictest0-21swapper/222:00:112
30424991310,2cyclictest0-21swapper/221:45:122
3042499130,2cyclictest0-21swapper/220:56:062
3042499130,2cyclictest0-21swapper/220:41:032
3042499130,2cyclictest0-21swapper/219:43:052
3042499130,2cyclictest0-21swapper/219:43:042
3042499130,12cyclictest0-21swapper/222:33:042
3042499130,12cyclictest0-21swapper/221:09:052
3042499130,12cyclictest0-21swapper/220:45:402
3042499130,12cyclictest0-21swapper/220:15:182
3042499130,11cyclictest0-21swapper/219:10:122
3042399139,2cyclictest24616-21diskstats22:30:121
30423991310,2cyclictest14270-21diskmemload21:51:031
30423991310,2cyclictest0-21swapper/123:40:311
30423991310,2cyclictest0-21swapper/123:25:171
30423991310,2cyclictest0-21swapper/122:25:401
30423991310,2cyclictest0-21swapper/122:20:151
30423991310,2cyclictest0-21swapper/120:45:121
3042399130,2cyclictest14270-21diskmemload21:10:341
3042399130,2cyclictest0-21swapper/123:23:531
3042399130,2cyclictest0-21swapper/122:12:201
3042399130,2cyclictest0-21swapper/121:28:511
3042399130,2cyclictest0-21swapper/120:00:011
3042399130,2cyclictest0-21swapper/100:11:371
3042399130,12cyclictest0-21swapper/123:12:111
3042399130,12cyclictest0-21swapper/123:12:111
3042399130,12cyclictest0-21swapper/122:55:151
3042399130,12cyclictest0-21swapper/122:41:041
3042399130,12cyclictest0-21swapper/122:19:191
3042399130,12cyclictest0-21swapper/121:55:011
3042399130,12cyclictest0-21swapper/121:40:291
3042399130,12cyclictest0-21swapper/121:30:521
3042399130,12cyclictest0-21swapper/120:51:011
3042399130,11cyclictest0-21swapper/123:30:031
3042399130,11cyclictest0-21swapper/120:05:391
3042399130,11cyclictest0-21swapper/100:06:021
3042299139,2cyclictest4720-21ssh21:34:100
3042299138,3cyclictest26866-21ssh22:32:160
30422991310,2cyclictest4384-21apt-get19:25:120
30422991310,2cyclictest0-21swapper/023:55:590
30422991310,2cyclictest0-21swapper/023:08:150
30422991310,2cyclictest0-21swapper/022:10:260
30422991310,2cyclictest0-21swapper/020:36:010
3042299130,2cyclictest0-21swapper/000:00:350
3042299130,11cyclictest19145-21sh22:24:510
3042299130,11cyclictest0-21swapper/023:15:090
168682130,2sleep30-21swapper/323:31:123
3042599129,2cyclictest24197-21kworker/u8:120:04:043
3042599129,2cyclictest24197-21kworker/u8:119:51:053
3042599129,2cyclictest24197-21kworker/u8:119:40:053
3042599129,2cyclictest24197-21kworker/u8:119:40:043
3042599129,2cyclictest0-21swapper/323:52:383
3042599129,2cyclictest0-21swapper/300:14:383
3042599120,7cyclictest0-21swapper/321:07:053
3042599120,2cyclictest30489-21copy20:30:053
3042599120,2cyclictest14270-21diskmemload22:45:493
3042599120,11cyclictest0-21swapper/323:42:183
3042599120,10cyclictest0-21swapper/319:56:063
3042499129,2cyclictest20565-21apt-get20:05:102
3042499122,6cyclictest0-21swapper/220:54:592
3042499120,2cyclictest0-21swapper/221:55:052
3042499120,11cyclictest0-21swapper/222:11:142
3042399129,2cyclictest0-21swapper/120:11:031
3042399129,2cyclictest0-21swapper/100:30:031
3042399127,3cyclictest0-21swapper/120:35:141
3042399127,3cyclictest0-21swapper/120:30:151
3042399122,7cyclictest0-21swapper/121:07:581
3042399120,2cyclictest0-21swapper/121:20:571
3042399120,11cyclictest0-21swapper/100:25:041
3042299129,2cyclictest19743-21ssh21:15:140
3042299129,2cyclictest0-21swapper/023:23:300
3042299129,2cyclictest0-21swapper/022:01:030
3042299129,2cyclictest0-21swapper/021:57:330
3042299129,2cyclictest0-21swapper/021:50:290
3042299129,2cyclictest0-21swapper/020:31:020
3042299121,3cyclictest0-21swapper/023:30:130
3042299120,2cyclictest14270-21diskmemload00:20:200
3042299120,2cyclictest11464-21ssh22:50:240
3042299120,2cyclictest0-21swapper/023:35:170
3042299120,11cyclictest0-21swapper/021:35:060
3042299120,11cyclictest0-21swapper/021:20:460
3042299120,11cyclictest0-21swapper/020:15:010
3042299120,11cyclictest0-21swapper/000:25:200
3042299120,11cyclictest0-21swapper/000:05:080
3042299120,10cyclictest14270-21diskmemload22:25:500
3042299120,10cyclictest0-21swapper/021:29:350
210152120,2sleep00-21swapper/023:00:590
167032120,1sleep00-21swapper/021:11:200
3042599118,2cyclictest3887-21kworker/u8:020:47:053
3042599118,2cyclictest22173-21kworker/u8:220:19:053
3042599118,2cyclictest10465-21kworker/u8:019:46:043
3042399118,2cyclictest0-21swapper/120:40:091
3042399112,6cyclictest0-21swapper/119:53:011
3042399111,7cyclictest4562-21gdm-simple-gree19:43:591
3042399111,7cyclictest4562-21gdm-simple-gree19:43:581
3042399110,9cyclictest0-21swapper/120:00:161
3042399110,9cyclictest0-21swapper/119:45:181
3042399110,9cyclictest0-21swapper/119:11:011
3042399110,3cyclictest8440-21munin-node1
3042399110,2cyclictest0-21swapper/119:26:031
3042299112,6cyclictest8200-21apt-get19:35:060
3042299110,10cyclictest0-21swapper/023:12:220
3042299110,10cyclictest0-21swapper/023:12:210
3042299110,10cyclictest0-21swapper/020:00:110
3042599107,2cyclictest13395-21kworker/u8:023:29:043
3042599105,3cyclictest4389-21aten2.4_r3power19:25:113
3042599100,8cyclictest1376-21python20:36:003
3042599100,2cyclictest0-21swapper/319:20:093
3042399107,2cyclictest32650-21apt-get19:15:111
3042399107,2cyclictest0-21swapper/119:30:101
3042399100,8cyclictest0-21swapper/121:00:171
3042399100,8cyclictest0-21swapper/120:20:141
3042399100,7cyclictest0-21swapper/119:39:591
3042299105,3cyclictest28778-21aten2.4_r3power20:25:120
3042299104,4cyclictest32431-21turbostat19:15:010
3042299101,7cyclictest18315-21cron20:00:010
3042299101,7cyclictest16276-21cron19:55:000
3042299100,8cyclictest13121-21modprobe21:05:140
304259996,2cyclictest0-21swapper/320:10:103
304259994,3cyclictest2616-21df_abs20:40:143
304229996,2cyclictest0-21swapper/019:40:120
304229996,2cyclictest0-21swapper/019:40:110
304229994,3cyclictest9-21ksoftirqd/021:03:160
304229994,3cyclictest8472-21head20:55:120
304229994,3cyclictest6824-21fschecks_count19:30:120
304229994,3cyclictest59412sleep020:46:310
304229994,3cyclictest28035-21grep20:21:020
304229994,3cyclictest25450-21ntp_kernel_err20:15:180
304229994,3cyclictest20974-21taskset20:05:120
304229994,3cyclictest13349-21ntp_kernel_err19:45:180
304229984,2cyclictest6602-21cpu20:50:120
304229983,3cyclictest2466-21wc20:40:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional