You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-28 - 09:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Tue Jul 28, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12247211696,15sleep20-21swapper/219:09:592
12030210897,6sleep30-21swapper/319:07:113
12032210685,15sleep00-21swapper/019:07:110
11473210090,6sleep10-21swapper/119:05:251
104572700,0sleep20-21swapper/223:37:392
170432550,1sleep337-21rcuc/300:18:173
202152260,5sleep337-21rcuc/323:15:043
293892220,0sleep30-21swapper/322:50:193
1228099210,3cyclictest574-21ssh21:48:023
1228099210,3cyclictest31278-21ssh00:00:033
1228099210,3cyclictest30943-21sh21:12:033
1228099210,3cyclictest27589-21ssh22:15:183
1228099210,3cyclictest16702sleep321:15:183
1228099210,3cyclictest15185-21modprobe19:15:473
1228099210,3cyclictest12591-21runrttasks22:33:343
1228099210,3cyclictest0-21swapper/323:55:153
1228099210,3cyclictest0-21swapper/319:25:143
1228099210,2cyclictest0-21swapper/322:04:113
1228099210,13cyclictest0-21swapper/323:10:143
1228099201,2cyclictest17147-21ssh22:38:063
1228099201,2cyclictest0-21swapper/300:11:013
1228099200,3cyclictest7962-21ssh00:09:153
1228099200,3cyclictest4703-21ssh00:39:023
1228099200,3cyclictest29166-21open_files00:30:183
1228099200,3cyclictest25977-21ssh22:46:433
1228099200,3cyclictest22793-21ssh00:24:383
1228099200,3cyclictest20338-21ssh22:08:143
1228099200,3cyclictest16168-21dpkg20:40:103
1228099200,3cyclictest0-21swapper/320:30:193
1228099200,2cyclictest0-21swapper/323:50:143
1228099200,2cyclictest0-21swapper/323:35:153
1228099200,2cyclictest0-21swapper/323:30:143
1228099200,2cyclictest0-21swapper/323:01:553
1228099200,2cyclictest0-21swapper/322:14:473
1228099200,2cyclictest0-21swapper/321:33:253
1228099200,18cyclictest0-21swapper/323:22:123
1228099200,18cyclictest0-21swapper/321:54:453
1228099200,13cyclictest2051-21ssh23:29:563
1228099190,3cyclictest32306-21munin-node3
1228099190,3cyclictest217622sleep320:52:223
1228099190,3cyclictest19165-21ssh23:46:383
1228099190,3cyclictest0-21swapper/323:09:303
1228099190,3cyclictest0-21swapper/322:26:193
1228099190,3cyclictest0-21swapper/320:20:153
1228099190,2cyclictest15553-21sendmail-mta23:43:033
1228099190,2cyclictest0-21swapper/322:57:343
1228099190,2cyclictest0-21swapper/321:55:213
1228099190,2cyclictest0-21swapper/321:38:323
1228099190,2cyclictest0-21swapper/321:26:303
1228099190,2cyclictest0-21swapper/321:23:393
1228099190,2cyclictest0-21swapper/319:46:033
1228099190,11cyclictest0-21swapper/322:23:563
12279991916,2cyclictest16039-21kworker/u8:100:22:042
12278991916,2cyclictest8773-21kworker/u8:023:07:051
124032180,1sleep00-21swapper/023:06:030
1228099180,2cyclictest0-21swapper/322:44:543
1228099180,2cyclictest0-21swapper/321:41:103
1228099180,2cyclictest0-21swapper/320:55:153
1228099180,2cyclictest0-21swapper/320:25:133
1228099180,2cyclictest0-21swapper/320:13:273
1228099180,2cyclictest0-21swapper/319:56:033
1228099180,2cyclictest0-21swapper/319:40:193
1228099180,2cyclictest0-21swapper/319:35:183
1228099180,2cyclictest0-21swapper/300:25:153
12279991815,2cyclictest26617-21kworker/u8:200:10:052
12278991815,2cyclictest887-21kworker/u8:100:01:041
12278991815,2cyclictest7564-21kworker/u8:120:18:041
12278991815,2cyclictest3591-21kworker/u8:221:30:041
12278991815,2cyclictest25005-21kworker/u8:022:21:041
12278991815,2cyclictest12181-21kworker/u8:022:01:051
12278991813,4cyclictest3591-21kworker/u8:221:20:011
1227899181,2cyclictest0-21swapper/121:44:041
1227899180,2cyclictest28021-21diskmemload00:15:051
12277991815,2cyclictest23629-21kworker/u8:221:44:050
1228099170,2cyclictest21003-21fschecks_count19:30:153
1228099170,2cyclictest16294-21apt-get19:20:073
1228099170,2cyclictest0-21swapper/321:05:183
1228099170,2cyclictest0-21swapper/320:35:193
1228099170,2cyclictest0-21swapper/320:15:183
1228099170,2cyclictest0-21swapper/320:05:153
1228099170,2cyclictest0-21swapper/319:10:183
1228099170,1cyclictest0-21swapper/321:00:193
12279991714,2cyclictest6317-21kworker/u8:121:58:012
12279991714,2cyclictest25005-21kworker/u8:022:13:052
12279991714,2cyclictest15554-21kworker/u8:021:31:042
12279991713,3cyclictest25140-21kworker/u8:123:44:062
1227999170,2cyclictest0-21swapper/221:44:042
12278991714,2cyclictest6433-21kworker/u8:122:28:051
12278991714,2cyclictest6317-21kworker/u8:122:05:041
12278991714,2cyclictest3600-21kworker/u8:323:00:061
12278991714,2cyclictest28705-21kworker/u8:021:50:051
12278991714,2cyclictest28705-21kworker/u8:021:47:051
12278991714,2cyclictest26617-21kworker/u8:200:07:051
12278991714,2cyclictest25948-21kworker/u8:019:47:051
12278991714,2cyclictest25140-21kworker/u8:123:42:061
12278991714,2cyclictest25140-21kworker/u8:123:39:041
12278991714,2cyclictest25005-21kworker/u8:022:17:051
12278991714,2cyclictest23467-21kworker/u8:200:30:061
12278991714,2cyclictest19692-21kworker/u8:023:27:051
12278991714,2cyclictest18067-21kworker/u8:222:10:051
12278991714,2cyclictest15554-21kworker/u8:021:35:051
12278991714,2cyclictest14272-21kworker/u8:121:10:061
12278991714,2cyclictest12298-21kworker/u8:222:44:051
1228099160,2cyclictest0-21swapper/320:45:153
1228099160,2cyclictest0-21swapper/319:50:143
12279991613,2cyclictest887-21kworker/u8:100:04:022
12279991613,2cyclictest7985-21kworker/u8:019:20:052
12279991613,2cyclictest31609-21kworker/u8:222:24:042
12279991613,2cyclictest19692-21kworker/u8:023:24:042
12279991613,2cyclictest12181-21kworker/u8:022:02:052
1227999160,2cyclictest0-21swapper/200:15:052
12278991613,2cyclictest9875-21kworker/u8:121:27:051
12278991613,2cyclictest8938-21kworker/u8:000:20:051
12278991613,2cyclictest7564-21kworker/u8:120:25:051
12278991613,2cyclictest6433-21kworker/u8:122:37:051
12278991613,2cyclictest31677-21kworker/u8:222:54:061
12278991613,2cyclictest28306-21kworker/u8:219:59:051
12278991613,2cyclictest26617-21kworker/u8:200:14:051
12278991613,2cyclictest23709-21kworker/u8:120:09:041
12278991613,2cyclictest23709-21kworker/u8:119:40:041
12278991613,2cyclictest23467-21kworker/u8:200:26:011
12278991613,2cyclictest19902-21kworker/u8:023:58:051
12278991613,2cyclictest16071-21kworker/u8:119:24:021
12278991613,2cyclictest12298-21kworker/u8:222:34:041
12279991512,2cyclictest9875-21kworker/u8:121:25:052
12279991512,2cyclictest8773-21kworker/u8:023:08:012
12279991512,2cyclictest26453-21kworker/u8:022:49:042
12279991512,2cyclictest18067-21kworker/u8:222:07:042
12279991512,2cyclictest15554-21kworker/u8:021:37:052
12279991510,3cyclictest20884-21fschecks_time23:15:152
12279991510,3cyclictest15543-21unixbench_multi20:36:042
1227999150,2cyclictest0-21swapper/200:35:172
12278991512,2cyclictest5535-21kworker/u8:220:42:011
12278991512,2cyclictest5535-21kworker/u8:220:12:051
12278991512,2cyclictest3600-21kworker/u8:323:20:041
12278991512,2cyclictest3591-21kworker/u8:221:19:051
12278991512,2cyclictest2463-21kworker/u8:223:32:051
12278991512,2cyclictest23926-21kworker/u8:021:02:051
12278991512,2cyclictest19692-21kworker/u8:023:15:051
12278991512,2cyclictest14272-21kworker/u8:121:09:041
12278991512,2cyclictest14272-21kworker/u8:120:38:051
1227899150,13cyclictest0-21swapper/122:55:141
1227799150,13cyclictest10620-21fschecks_time20:25:160
1227799150,13cyclictest0-21swapper/021:39:250
12279991411,2cyclictest301ktimersoftd/222:41:052
12279991411,2cyclictest29846-21kworker/u8:021:12:052
12279991411,2cyclictest25005-21kworker/u8:022:25:052
12279991411,2cyclictest23709-21kworker/u8:119:53:042
12279991411,2cyclictest23629-21kworker/u8:221:46:052
12279991411,2cyclictest14369-21kworker/u8:123:14:012
12279991411,2cyclictest0-21swapper/223:56:072
12279991410,2cyclictest31317-21ssh22:52:302
1227999140,4cyclictest0-21swapper/222:19:052
1227999140,2cyclictest7203-21sensors_temp20:16:012
1227999140,2cyclictest0-21swapper/223:33:272
1227999140,12cyclictest0-21swapper/222:39:482
12278991411,2cyclictest6317-21kworker/u8:121:58:051
12278991411,2cyclictest23709-21kworker/u8:119:51:041
12278991411,2cyclictest23709-21kworker/u8:119:37:051
12278991411,2cyclictest19902-21kworker/u8:023:48:041
12278991411,2cyclictest16071-21kworker/u8:119:29:041
12278991411,2cyclictest14272-21kworker/u8:120:45:051
12278991411,2cyclictest12101-21kworker/u8:219:12:051
12277991411,2cyclictest25005-21kworker/u8:022:19:050
1227799141,11cyclictest15261-21ssh23:42:350
1227799140,2cyclictest0-21swapper/022:05:010
1227799140,13cyclictest0-21swapper/000:06:050
1227799140,12cyclictest12809-21iostat_ios20:30:160
7712130,2sleep00-21swapper/022:55:090
12279991310,2cyclictest8773-21kworker/u8:023:04:052
12279991310,2cyclictest7985-21kworker/u8:019:19:042
12279991310,2cyclictest5535-21kworker/u8:220:41:042
12279991310,2cyclictest28306-21kworker/u8:219:58:052
12279991310,2cyclictest23709-21kworker/u8:119:44:012
12279991310,2cyclictest0-21swapper/223:45:482
12279991310,2cyclictest0-21swapper/222:56:172
12279991310,2cyclictest0-21swapper/221:53:032
12279991310,2cyclictest0-21swapper/221:17:112
12279991310,2cyclictest0-21swapper/221:00:152
12279991310,2cyclictest0-21swapper/220:00:132
12279991310,2cyclictest0-21swapper/200:33:082
12279991310,2cyclictest0-21swapper/200:26:422
12279991310,2cyclictest0-21swapper/200:05:182
1227999130,2cyclictest0-21swapper/221:22:332
1227999130,2cyclictest0-21swapper/219:10:312
1227999130,12cyclictest0-21swapper/223:50:292
1227999130,12cyclictest0-21swapper/222:30:272
1227999130,12cyclictest0-21swapper/219:35:172
1227999130,11cyclictest0-21swapper/223:25:532
12278991310,2cyclictest7985-21kworker/u8:019:15:041
12278991310,2cyclictest25140-21kworker/u8:123:50:051
12278991310,2cyclictest19872-21kworker/u8:220:50:051
12278991310,2cyclictest14272-21kworker/u8:120:55:041
12278991310,2cyclictest0-21swapper/122:46:031
1227899130,2cyclictest28021-21diskmemload00:35:061
1227899130,12cyclictest0-21swapper/120:30:121
1227799131,10cyclictest3728-21runrttasks21:16:220
12277991310,2cyclictest19902-21kworker/u8:023:54:050
12277991310,2cyclictest0-21swapper/023:59:050
12277991310,2cyclictest0-21swapper/023:49:170
12277991310,2cyclictest0-21swapper/022:30:080
12277991310,2cyclictest0-21swapper/022:23:010
12277991310,2cyclictest0-21swapper/021:50:180
12277991310,2cyclictest0-21swapper/021:22:030
12277991310,2cyclictest0-21swapper/000:19:010
1227799130,2cyclictest0-21swapper/021:49:320
1227799130,2cyclictest0-21swapper/000:23:250
1227799130,12cyclictest0-21swapper/023:28:450
1227799130,12cyclictest0-21swapper/019:20:150
1227799130,11cyclictest1726-21ssh00:02:220
1227799130,11cyclictest0-21swapper/022:52:390
305282120,2sleep028021-21diskmemload00:31:380
1227999129,2cyclictest25948-21kworker/u8:019:46:022
1227999129,2cyclictest23926-21kworker/u8:021:05:042
1227999129,2cyclictest14272-21kworker/u8:120:54:042
1227999120,11cyclictest0-21swapper/220:20:162
1227999120,11cyclictest0-21swapper/220:10:192
1227899129,2cyclictest7564-21kworker/u8:120:23:051
1227899120,11cyclictest0-21swapper/123:10:231
1227899120,11cyclictest0-21swapper/120:00:411
1227799129,2cyclictest18736-21apt-get22:40:120
1227799129,2cyclictest0-21swapper/023:23:160
1227799129,2cyclictest0-21swapper/022:49:570
1227799129,2cyclictest0-21swapper/022:26:200
1227799129,2cyclictest0-21swapper/021:58:500
1227799129,2cyclictest0-21swapper/019:45:400
1227799129,2cyclictest0-21swapper/000:25:170
1227799120,2cyclictest19562-21ssh22:07:030
1227799120,2cyclictest0-21swapper/022:13:220
1227799120,2cyclictest0-21swapper/020:55:160
1227799120,1cyclictest6049-21apt-get20:15:110
1227799120,11cyclictest0-21swapper/023:11:390
1227799120,11cyclictest0-21swapper/023:01:530
1227799120,11cyclictest0-21swapper/021:11:020
1227799120,11cyclictest0-21swapper/020:05:110
1227799120,11cyclictest0-21swapper/000:35:060
1227799120,11cyclictest0-21swapper/000:10:020
1227799120,10cyclictest28021-21diskmemload23:15:260
107972120,2sleep00-21swapper/021:25:150
102162120,2sleep010226-21ssh23:37:170
1227999118,2cyclictest28306-21kworker/u8:220:05:052
1227999118,2cyclictest14272-21kworker/u8:120:58:052
1227999110,9cyclictest9917-21copy20:25:012
1227999110,2cyclictest0-21swapper/220:45:192
1227899118,2cyclictest21610-21kworker/u8:019:31:051
1227799118,2cyclictest28306-21kworker/u8:220:01:050
1227799118,2cyclictest0-21swapper/023:30:190
1227799118,2cyclictest0-21swapper/022:35:350
1227799118,2cyclictest0-21swapper/021:30:240
1227799118,2cyclictest0-21swapper/019:40:180
141632100,2sleep00-21swapper/019:13:370
1227999107,2cyclictest21610-21kworker/u8:019:32:052
1227999107,2cyclictest11668-21kworker/u8:020:33:052
1227799107,2cyclictest0-21swapper/020:50:120
1227799107,2cyclictest0-21swapper/020:10:200
1227799107,2cyclictest0-21swapper/019:30:110
1227799107,2cyclictest0-21swapper/019:25:130
122799994,3cyclictest19467-21open_inodes19:25:172
122779994,3cyclictest8195-21hostname20:20:130
122779994,3cyclictest30486-21cpu19:55:140
122779994,3cyclictest27385-21sensors_temp21:06:020
122779994,3cyclictest25452-21switchtime21:01:040
122779990,2cyclictest0-21swapper/020:45:030
122779985,2cyclictest14648-21aten2.4_r3power19:15:430
122779983,3cyclictest28299-21aten2.4-expect19:50:120
122779983,3cyclictest22610-21sh19:35:130
122779983,3cyclictest16172-21aten2.4_r3power20:40:110
122779983,3cyclictest14433-21cut20:35:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional