You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 06:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Fri Apr 10, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28249211187,18sleep00-21swapper/019:06:000
28249211187,18sleep00-21swapper/019:05:590
28176210998,6sleep20-21swapper/219:05:222
28176210998,6sleep20-21swapper/219:05:222
28203210897,6sleep10-21swapper/119:05:371
28203210897,6sleep10-21swapper/119:05:371
28830210584,16sleep30-21swapper/319:08:233
28830210584,16sleep30-21swapper/319:08:223
59472790,1sleep212764-21diskmemload22:10:132
312072790,0sleep30-21swapper/322:36:033
293042750,0sleep10-21swapper/120:30:131
163882700,1sleep10-21swapper/121:46:231
163532690,0sleep00-21swapper/000:36:540
62652670,13sleep12898499cyclictest23:52:121
28984993716,19cyclictest0-21swapper/119:45:121
272672260,1sleep30-21swapper/323:06:023
50702240,0sleep20-21swapper/222:42:592
2898499210,19cyclictest0-21swapper/122:20:121
263412210,0sleep20-21swapper/200:13:582
2898499209,9cyclictest20458-21fschecks_time22:25:151
2898499202,3cyclictest14632-21wc00:01:001
2898499201,2cyclictest3157-21lldpd21:25:191
2898499200,3cyclictest0-21swapper/121:00:111
2898499200,18cyclictest0-21swapper/121:21:531
2898499200,12cyclictest0-21swapper/121:57:581
2898499190,3cyclictest0-21swapper/119:15:151
2898499190,13cyclictest0-21swapper/100:32:131
2898499190,12cyclictest0-21swapper/100:26:041
134362190,1sleep00-21swapper/000:34:360
2898499186,3cyclictest0-21swapper/123:28:111
2898499181,8cyclictest17901-21munin-node1
2898499181,3cyclictest25335-21modprobe22:30:161
2898499181,15cyclictest0-21swapper/121:05:151
2898499180,2cyclictest0-21swapper/122:46:351
2898499180,2cyclictest0-21swapper/122:46:341
2898499180,11cyclictest0-21swapper/100:06:261
2898699171,13cyclictest0-21swapper/321:45:053
28985991714,2cyclictest8772-21kworker/u8:223:00:042
28985991714,2cyclictest8772-21kworker/u8:222:53:052
28985991714,2cyclictest26601-21kworker/u8:222:33:052
2898499179,7cyclictest0-21swapper/122:56:411
2898499176,3cyclictest2792-21munin-node1
2898499175,3cyclictest8863-21cat19:40:001
2898499174,3cyclictest0-21swapper/100:11:051
2898499171,7cyclictest0-21swapper/122:51:031
2898499171,6cyclictest0-21swapper/121:12:201
2898499171,6cyclictest0-21swapper/100:15:131
2898499171,3cyclictest0-21swapper/123:41:531
2898499171,3cyclictest0-21swapper/123:34:201
2898499171,2cyclictest0-21swapper/121:37:501
2898499171,14cyclictest0-21swapper/122:35:161
2898499171,14cyclictest0-21swapper/122:05:131
2898499171,13cyclictest27464-21grep20:25:141
2898499170,5cyclictest0-21swapper/123:11:021
2898499170,2cyclictest0-21swapper/123:19:021
2898499170,1cyclictest0-21swapper/121:51:061
2898499170,16cyclictest0-21swapper/100:22:531
2898499170,15cyclictest23291-21timerandwakeup23:36:031
2898499170,15cyclictest0-21swapper/123:57:521
2898699161,13cyclictest0-21swapper/322:20:133
2898499167,2cyclictest0-21swapper/120:05:591
2898499164,2cyclictest0-21swapper/123:20:151
2898499163,3cyclictest5293-21df20:50:131
2898499163,3cyclictest21730-21missed_timers23:00:161
2898499163,3cyclictest1599-21ntp_kernel_err20:40:161
2898499163,3cyclictest0-21swapper/121:40:041
2898499163,3cyclictest0-21swapper/120:00:121
2898499161,6cyclictest0-21swapper/122:15:011
2898499161,5cyclictest0-21swapper/121:30:161
2898499161,3cyclictest0-21swapper/123:46:241
2898499161,2cyclictest0-21swapper/122:02:181
28984991610,5cyclictest0-21swapper/123:06:011
2898499160,7cyclictest0-21swapper/122:11:031
2898499160,3cyclictest29195-21munin-node1
2898499160,3cyclictest0-21swapper/120:45:171
2898499160,3cyclictest0-21swapper/120:20:001
2898499160,14cyclictest0-21swapper/119:20:111
28986991510,3cyclictest0-21swapper/321:36:003
2898699150,13cyclictest0-21swapper/323:55:333
2898599151,3cyclictest0-21swapper/200:05:132
2898599151,2cyclictest0-21swapper/200:25:162
2898599150,13cyclictest619-21uname21:30:192
2898499156,2cyclictest0-21swapper/120:10:161
2898499154,3cyclictest31484-21df_abs20:35:131
2898499154,3cyclictest25546-21fschecks_count20:20:141
2898499153,3cyclictest9163-21aten2.4_r3power19:40:121
2898499153,3cyclictest3703-21sshd19:32:061
2898499153,3cyclictest2001-21tr22:40:121
2898499151,5cyclictest13974-21munin-node1
2898499151,3cyclictest0-21swapper/119:55:151
2898499150,5cyclictest0-21swapper/120:55:121
2898399150,13cyclictest26604-21open_files23:05:180
82572140,3sleep08267-21ssh21:38:420
2898699140,3cyclictest2549-21sed22:06:043
2898699140,12cyclictest3649-21snmpd23:16:333
2898699140,12cyclictest29527-21ssh23:43:013
2898699140,12cyclictest22127-21ssh23:00:343
2898699140,12cyclictest12764-21diskmemload22:18:233
2898699140,12cyclictest0-21swapper/319:50:003
28985991411,2cyclictest8772-21kworker/u8:222:59:052
28985991411,2cyclictest12988-21kworker/u8:021:18:062
2898599140,2cyclictest0-21swapper/221:40:122
2898599140,2cyclictest0-21swapper/220:25:142
2898599140,12cyclictest18416-21smartctl23:31:012
2898499140,4cyclictest14927-21cat19:55:011
28983991411,2cyclictest0-21swapper/023:15:170
28983991411,2cyclictest0-21swapper/020:00:100
2898399140,12cyclictest9244-21sh22:13:430
2898399140,12cyclictest851-21ssh21:30:260
2898399140,12cyclictest7009-21telnet19:35:110
2898399140,12cyclictest0-21swapper/023:56:570
2898399140,12cyclictest0-21swapper/000:12:380
2898399140,12cyclictest0-21swapper/000:08:260
2898399140,12cyclictest0-21swapper/000:01:520
211982140,3sleep20-21swapper/222:25:402
316392130,2sleep20-21swapper/222:03:082
2898699138,3cyclictest732-21diskmemload23:12:263
2898699132,6cyclictest15897-21ssh22:55:013
28986991310,2cyclictest0-21swapper/322:46:233
28986991310,2cyclictest0-21swapper/322:46:223
28986991310,2cyclictest0-21swapper/322:25:213
28986991310,2cyclictest0-21swapper/321:53:003
28986991310,2cyclictest0-21swapper/321:26:093
28986991310,2cyclictest0-21swapper/321:15:173
28986991310,2cyclictest0-21swapper/319:55:013
28986991310,2cyclictest0-21swapper/300:26:013
2898699130,2cyclictest0-21swapper/321:40:123
2898699130,2cyclictest0-21swapper/321:20:403
2898699130,2cyclictest0-21swapper/321:11:413
2898699130,12cyclictest20165-21ssh00:06:413
2898699130,12cyclictest0-21swapper/323:45:113
2898699130,12cyclictest0-21swapper/322:02:193
2898699130,12cyclictest0-21swapper/321:59:103
2898699130,12cyclictest0-21swapper/321:34:243
2898699130,12cyclictest0-21swapper/300:16:043
2898699130,12cyclictest0-21swapper/300:00:203
2898699130,11cyclictest27322-21ssh22:32:133
2898699130,11cyclictest0-21swapper/323:50:443
2898699130,11cyclictest0-21swapper/322:40:163
2898699130,11cyclictest0-21swapper/300:30:013
28985991310,2cyclictest14675-21sh21:11:022
28985991310,2cyclictest1420-21kworker/u8:122:48:052
28985991310,2cyclictest1420-21kworker/u8:122:48:042
2898599130,2cyclictest0-21swapper/223:20:142
2898599130,12cyclictest0-21swapper/221:55:382
28983991310,2cyclictest21283-21ssh21:51:370
28983991310,2cyclictest12764-21diskmemload22:21:360
28983991310,2cyclictest0-21swapper/023:31:380
28983991310,2cyclictest0-21swapper/023:14:340
28983991310,2cyclictest0-21swapper/023:00:110
28983991310,2cyclictest0-21swapper/022:59:080
28983991310,2cyclictest0-21swapper/022:51:160
28983991310,2cyclictest0-21swapper/019:21:030
28983991310,2cyclictest0-21swapper/000:20:170
2898399130,2cyclictest3087-21apt-get23:50:050
2898399130,2cyclictest0-21swapper/022:00:280
2898399130,2cyclictest0-21swapper/000:15:180
2898399130,12cyclictest0-21swapper/023:44:590
2898399130,12cyclictest0-21swapper/022:38:270
2898399130,12cyclictest0-21swapper/022:15:130
2898399130,12cyclictest0-21swapper/021:40:130
2898399130,12cyclictest0-21swapper/020:06:010
2898399130,11cyclictest8947-21ssh23:20:430
2898399130,11cyclictest12764-21diskmemload21:10:050
22122130,2sleep20-21swapper/222:06:012
2898699129,2cyclictest0-21swapper/322:55:563
2898699129,2cyclictest0-21swapper/320:40:123
2898699129,2cyclictest0-21swapper/320:20:593
2898699129,2cyclictest0-21swapper/300:36:283
2898699129,2cyclictest0-21swapper/300:20:183
2898699127,3cyclictest6381-21grep19:31:033
2898699120,11cyclictest8809-21ssh23:20:303
2898699120,11cyclictest0-21swapper/323:33:193
2898699120,11cyclictest0-21swapper/323:25:313
2898699120,11cyclictest0-21swapper/322:10:223
2898699120,11cyclictest0-21swapper/320:45:393
2898699120,11cyclictest0-21swapper/319:40:193
2898699120,11cyclictest0-21swapper/319:36:013
2898699120,11cyclictest0-21swapper/300:11:033
2898599129,2cyclictest8030-21kworker/u8:019:40:022
2898599129,2cyclictest3127-21nscd22:15:122
2898599129,2cyclictest19782-21kworker/u8:223:38:012
2898599129,2cyclictest19319-21kworker/u8:000:17:042
2898599129,2cyclictest11038-21kworker/u8:220:12:042
2898599129,2cyclictest0-21swapper/223:25:172
2898599129,2cyclictest0-21swapper/223:09:382
2898599127,3cyclictest32740-21ssh23:11:422
2898599127,3cyclictest29417-21rm22:35:122
2898599120,2cyclictest11811-21ssh23:58:322
2898599120,2cyclictest0-21swapper/221:20:572
2898599120,2cyclictest0-21swapper/220:45:132
2898599120,11cyclictest0-21swapper/223:47:272
2898599120,11cyclictest0-21swapper/221:50:112
2898599120,11cyclictest0-21swapper/221:05:122
2898399129,2cyclictest0-21swapper/023:46:020
2898399129,2cyclictest0-21swapper/023:35:050
2898399129,2cyclictest0-21swapper/023:26:050
2898399129,2cyclictest0-21swapper/022:30:050
2898399129,2cyclictest0-21swapper/022:25:060
2898399129,2cyclictest0-21swapper/021:55:260
2898399129,2cyclictest0-21swapper/021:26:450
2898399129,2cyclictest0-21swapper/021:21:340
2898399129,2cyclictest0-21swapper/020:15:180
2898399129,2cyclictest0-21swapper/000:25:060
2898399120,2cyclictest0-21swapper/022:42:050
2898399120,2cyclictest0-21swapper/022:05:130
2898399120,2cyclictest0-21swapper/019:26:020
2898399120,11cyclictest14180-21ssh21:45:060
2898399120,11cyclictest0-21swapper/022:47:130
2898399120,11cyclictest0-21swapper/022:47:130
2898399120,11cyclictest0-21swapper/021:15:440
2898399120,11cyclictest0-21swapper/020:31:040
2898399120,11cyclictest0-21swapper/019:10:130
222512120,2sleep312764-21diskmemload23:35:163
2898699118,2cyclictest24267-21smartctl20:16:023
2898699112,5cyclictest0-21swapper/319:20:013
2898699110,10cyclictest0-21swapper/320:05:153
2898599118,2cyclictest11038-21kworker/u8:220:30:052
2898599118,2cyclictest0-21swapper/223:50:572
2898599118,2cyclictest0-21swapper/223:40:172
2898599118,2cyclictest0-21swapper/221:45:062
2898599118,2cyclictest0-21swapper/200:20:332
2898599117,2cyclictest0-21swapper/200:30:122
2898599110,9cyclictest0-21swapper/223:15:322
2898599110,10cyclictest0-21swapper/220:55:122
2898599110,10cyclictest0-21swapper/219:26:012
2898399118,2cyclictest0-21swapper/020:35:150
2898399118,2cyclictest0-21swapper/020:10:150
2898399118,2cyclictest0-21swapper/019:50:140
2898399118,2cyclictest0-21swapper/019:15:400
2898399110,10cyclictest0-21swapper/021:06:000
153292110,2sleep20-21swapper/200:01:322
2898699107,2cyclictest0-21swapper/319:56:033
2898699102,6cyclictest0-21swapper/321:07:113
2898599107,2cyclictest27214-21kworker/u8:121:03:042
2898599105,3cyclictest3127-21nscd00:35:092
2898599105,3cyclictest17866-21grep20:00:172
2898599104,4cyclictest429-21chrt19:18:472
2898599100,9cyclictest0-21swapper/222:24:012
2898599100,9cyclictest0-21swapper/221:27:052
2898599100,8cyclictest9103-21turbostat21:39:592
2898399107,2cyclictest0-21swapper/019:30:070
289869997,1cyclictest0-21swapper/321:00:163
289869995,2cyclictest503-21sendmail20:39:593
289869994,3cyclictest8244-21grep20:56:033
289869994,3cyclictest2837-21basename19:25:123
289869990,8cyclictest0-21swapper/319:10:023
289869990,7cyclictest1063-21grep19:20:123
289859996,2cyclictest0-21swapper/220:15:172
289859996,2cyclictest0-21swapper/219:31:072
289859994,3cyclictest7503-21grep19:35:142
289859994,3cyclictest3728-21runrttasks20:50:182
289859994,3cyclictest3728-21runrttasks20:44:242
289859994,3cyclictest31622-21cut20:35:142
289859994,3cyclictest25871-21latency20:20:152
289859994,3cyclictest15237-21cpu19:55:122
289859994,3cyclictest11936-21grep19:45:182
289859993,4cyclictest30140-21wc19:10:172
289859993,4cyclictest19605-21cut20:05:122
289859991,3cyclictest0-21swapper/219:20:132
289859990,1cyclictest0-21swapper/219:50:182
289869983,3cyclictest5059-21aten2.4_r3power20:50:133
289869983,3cyclictest29306-21basename20:30:133
289869983,3cyclictest2850-21rsyslogd20:25:133
289869983,3cyclictest21126-21aten2.4-expect20:10:093
289869982,2cyclictest0-21swapper/320:00:053
289839985,2cyclictest101ktimersoftd/019:40:110
289839985,2cyclictest0-21swapper/020:45:150
289839985,2cyclictest0-21swapper/020:27:140
289839985,2cyclictest0-21swapper/019:56:030
289839985,2cyclictest0-21swapper/019:45:110
289839983,3cyclictest990-21cut20:40:120
289839981,6cyclictest3728-21runrttasks20:59:030
289839980,2cyclictest0-21swapper/020:20:550
289839974,2cyclictest0-21swapper/021:00:200
289839972,3cyclictest5507-21smartctl20:50:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional