You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-11 - 02:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed Mar 11, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17798211897,16sleep00-21swapper/019:07:070
17719211795,16sleep30-21swapper/319:06:073
17939210898,6sleep10-21swapper/119:08:561
17925210594,6sleep20-21swapper/219:08:462
1804999350,33cyclictest0-21swapper/121:30:101
18050993414,18cyclictest0-21swapper/220:35:112
1805099278,2cyclictest0-21swapper/200:35:122
76022260,0sleep10-21swapper/121:48:031
1805099260,8cyclictest0-21swapper/200:05:132
166672250,0sleep00-21swapper/000:37:370
242042230,1sleep30-21swapper/323:40:403
18051992319,2cyclictest0-21swapper/322:30:103
1804999230,21cyclictest0-21swapper/123:10:101
1804999221,19cyclictest0-21swapper/100:30:121
252272210,0sleep00-21swapper/021:33:180
1805199210,19cyclictest3649-21snmpd23:10:113
1805199200,2cyclictest0-21swapper/300:35:123
1805099200,2cyclictest0-21swapper/221:35:122
1805099200,18cyclictest10744-21ssh00:00:122
1804999200,2cyclictest0-21swapper/100:35:131
1804899200,18cyclictest0-21swapper/020:30:130
18051991916,2cyclictest1574-21ssh21:10:043
1805099190,2cyclictest0-21swapper/221:00:092
1805099190,17cyclictest0-21swapper/220:30:132
1804899183,13cyclictest18237-21df_abs23:35:130
1804999171,3cyclictest20679-21iostat_ios23:05:171
1804999171,3cyclictest20679-21iostat_ios23:05:161
1804999171,3cyclictest16850-21ssh22:30:061
1805199161,13cyclictest15501-21sed20:21:043
18051991611,3cyclictest0-21swapper/320:15:173
18050991611,3cyclictest28753-21missed_timers20:55:182
18050991611,3cyclictest10308-21munin-node2
1804999161,3cyclictest26057-21ssh22:39:081
1804999161,13cyclictest0-21swapper/123:30:001
18049991611,3cyclictest0-21swapper/122:25:181
1804899161,13cyclictest22891-21ssh23:40:110
1805199151,12cyclictest4336-21munin-node3
1805199150,13cyclictest0-21swapper/320:55:123
1805199150,13cyclictest0-21swapper/300:30:113
1805099151,7cyclictest0-21swapper/222:25:012
18050991510,3cyclictest0-21swapper/222:30:112
1805099150,13cyclictest0-21swapper/222:35:152
1805099150,13cyclictest0-21swapper/222:26:382
18049991510,3cyclictest0-21swapper/123:50:491
1804999150,3cyclictest0-21swapper/122:16:421
1804999150,2cyclictest0-21swapper/119:20:171
1804899150,2cyclictest0-21swapper/020:20:170
1804899150,13cyclictest1826-21rm00:23:070
1804899150,13cyclictest0-21swapper/022:21:010
292282140,2sleep029297-21processes19:35:190
208292140,11sleep20-21swapper/219:15:152
208292140,11sleep20-21swapper/219:15:142
201642140,0sleep30-21swapper/321:28:163
1805199149,3cyclictest22998-21ssh21:30:393
18051991411,2cyclictest0-21swapper/321:51:183
18051991411,2cyclictest0-21swapper/321:48:393
1805199140,2cyclictest0-21swapper/323:34:493
1805199140,12cyclictest0-21swapper/322:05:113
1805099142,7cyclictest0-21swapper/220:00:012
18050991411,2cyclictest0-21swapper/222:09:572
1805099141,11cyclictest5363-21ssh23:21:552
1805099140,2cyclictest0-21swapper/223:59:482
1805099140,12cyclictest0-21swapper/221:51:072
1805099140,12cyclictest0-21swapper/221:10:122
1805099140,12cyclictest0-21swapper/200:28:572
1804999149,3cyclictest15095-21pzem_energy21:55:281
1804999142,7cyclictest0-21swapper/120:40:001
1804999142,6cyclictest0-21swapper/121:25:001
1804999142,6cyclictest0-21swapper/121:04:591
1804999141,3cyclictest27315-21cut19:30:181
1804999141,11cyclictest0-21swapper/120:50:111
18049991410,2cyclictest0-21swapper/119:25:171
1804999140,2cyclictest0-21swapper/122:24:261
1804999140,12cyclictest3728-21runrttasks23:01:541
1804999140,12cyclictest3728-21runrttasks23:01:541
1804999140,12cyclictest0-21swapper/121:50:181
1804999140,12cyclictest0-21swapper/121:11:061
1804899149,3cyclictest31714-21munin-run22:45:010
1804899149,3cyclictest1615-21ssh21:10:060
1804899140,3cyclictest24317-21munin-node0
1804899140,3cyclictest12338-21sendmail_mailst00:01:010
1804899140,2cyclictest0-21swapper/023:20:120
1804899140,12cyclictest27316-21ssh22:07:570
1804899140,12cyclictest0-21swapper/023:00:110
1804899140,12cyclictest0-21swapper/023:00:100
18051991310,2cyclictest0-21swapper/323:47:543
18051991310,2cyclictest0-21swapper/322:50:533
18051991310,2cyclictest0-21swapper/322:45:033
18051991310,2cyclictest0-21swapper/322:26:193
18051991310,2cyclictest0-21swapper/322:10:173
18051991310,2cyclictest0-21swapper/319:30:123
18051991310,2cyclictest0-21swapper/300:07:103
1805199130,2cyclictest0-21swapper/323:50:193
1805199130,2cyclictest0-21swapper/323:15:113
1805199130,2cyclictest0-21swapper/322:40:133
1805199130,2cyclictest0-21swapper/321:56:593
1805199130,12cyclictest0-21swapper/322:58:043
1805199130,12cyclictest0-21swapper/322:35:163
1805199130,12cyclictest0-21swapper/322:20:393
1805199130,11cyclictest0-21swapper/323:28:343
1805199130,11cyclictest0-21swapper/300:20:153
1805099138,3cyclictest25999-21munin-node2
1805099138,3cyclictest2320-21munin-node2
1805099138,3cyclictest0-21swapper/222:00:092
1805099132,6cyclictest1323-21diskmemload23:25:002
1805099132,6cyclictest0-21swapper/221:20:002
1805099132,6cyclictest0-21swapper/220:10:012
18050991310,2cyclictest7969-21ssh22:52:442
18050991310,2cyclictest31104-21ssh22:44:082
18050991310,2cyclictest0-21swapper/223:38:472
18050991310,2cyclictest0-21swapper/221:25:112
18050991310,2cyclictest0-21swapper/200:20:182
1805099130,2cyclictest32156-21aten2.4_r3power22:45:102
1805099130,2cyclictest0-21swapper/223:46:272
1805099130,2cyclictest0-21swapper/223:41:082
1805099130,2cyclictest0-21swapper/223:05:182
1805099130,2cyclictest0-21swapper/223:05:172
1805099130,1cyclictest0-21swapper/219:50:182
1804999138,3cyclictest0-21swapper/100:20:171
1804999132,7cyclictest0-21swapper/119:55:001
1804999132,6cyclictest0-21swapper/123:35:011
1804999131,3cyclictest0-21swapper/120:05:201
18049991310,2cyclictest0-21swapper/123:35:121
18049991310,2cyclictest0-21swapper/122:57:291
18049991310,2cyclictest0-21swapper/122:50:021
18049991310,2cyclictest0-21swapper/122:44:301
18049991310,2cyclictest0-21swapper/121:16:071
18049991310,2cyclictest0-21swapper/121:00:281
18049991310,2cyclictest0-21swapper/120:45:111
18049991310,2cyclictest0-21swapper/100:13:081
18049991310,2cyclictest0-21swapper/100:06:591
1804999130,2cyclictest0-21swapper/123:55:041
1804999130,2cyclictest0-21swapper/123:47:191
1804999130,12cyclictest0-21swapper/123:44:551
1804999130,11cyclictest0-21swapper/123:15:271
1804899132,6cyclictest0-21swapper/021:14:590
1804899132,6cyclictest0-21swapper/000:14:590
18048991310,2cyclictest0-21swapper/023:55:210
18048991310,2cyclictest0-21swapper/023:06:180
18048991310,2cyclictest0-21swapper/023:06:170
18048991310,2cyclictest0-21swapper/022:51:370
18048991310,2cyclictest0-21swapper/022:30:160
18048991310,2cyclictest0-21swapper/022:16:570
18048991310,2cyclictest0-21swapper/019:55:160
18048991310,2cyclictest0-21swapper/019:20:180
1804899130,2cyclictest19090-21ssh00:08:000
1804899130,2cyclictest0-21swapper/019:30:150
1804899130,11cyclictest0-21swapper/020:50:580
1804899130,11cyclictest0-21swapper/020:00:150
314322120,1sleep00-21swapper/019:41:010
1805199129,2cyclictest0-21swapper/323:55:233
1805199129,2cyclictest0-21swapper/323:22:503
1805199129,2cyclictest0-21swapper/323:05:433
1805199129,2cyclictest0-21swapper/323:05:433
1805199129,2cyclictest0-21swapper/323:01:043
1805199129,2cyclictest0-21swapper/323:01:033
1805199129,2cyclictest0-21swapper/322:15:133
1805199129,2cyclictest0-21swapper/322:00:503
1805199129,2cyclictest0-21swapper/321:36:293
1805199129,2cyclictest0-21swapper/321:15:033
1805199129,2cyclictest0-21swapper/319:10:183
1805199129,2cyclictest0-21swapper/300:16:043
1805199129,2cyclictest0-21swapper/300:11:373
1805199122,6cyclictest0-21swapper/320:11:003
1805199120,2cyclictest0-21swapper/320:45:143
1805199120,11cyclictest12004-21ssh00:00:353
1805199120,11cyclictest0-21swapper/323:35:403
1805199120,11cyclictest0-21swapper/321:23:213
1805199120,11cyclictest0-21swapper/320:40:143
1805199120,11cyclictest0-21swapper/319:50:143
1805099129,2cyclictest0-21swapper/221:46:422
1805099129,2cyclictest0-21swapper/221:17:142
1805099129,2cyclictest0-21swapper/220:40:182
1805099129,2cyclictest0-21swapper/200:16:192
1805099129,2cyclictest0-21swapper/200:10:532
1805099120,2cyclictest1323-21diskmemload23:15:142
1805099120,2cyclictest0-21swapper/223:30:062
1805099120,2cyclictest0-21swapper/221:40:462
1805099120,2cyclictest0-21swapper/219:26:032
1805099120,2cyclictest0-21swapper/200:30:512
1805099120,11cyclictest25073-21ssh21:33:052
1805099120,11cyclictest0-21swapper/222:16:122
1805099120,11cyclictest0-21swapper/222:12:212
1805099120,11cyclictest0-21swapper/220:15:172
1805099120,11cyclictest0-21swapper/219:45:162
1805099120,11cyclictest0-21swapper/219:41:012
1805099120,11cyclictest0-21swapper/219:35:172
1804999129,2cyclictest0-21swapper/121:40:151
1804999129,2cyclictest0-21swapper/120:01:171
1804999129,2cyclictest0-21swapper/119:45:191
1804999127,3cyclictest16761-21aten2.4_r3power21:25:121
1804999127,3cyclictest10350-21apt-get00:00:061
1804999122,7cyclictest0-21swapper/120:58:591
1804999122,7cyclictest0-21swapper/119:15:021
1804999122,7cyclictest0-21swapper/119:15:011
1804999121,9cyclictest23998-21munin-node1
1804999121,9cyclictest0-21swapper/119:40:131
1804999121,3cyclictest2573-21munin-node1
1804999121,3cyclictest10128-21munin-node1
1804999121,3cyclictest0-21swapper/122:00:501
1804999120,2cyclictest0-21swapper/122:45:031
1804999120,2cyclictest0-21swapper/120:20:401
1804999120,11cyclictest0-21swapper/122:10:451
1804999120,11cyclictest0-21swapper/121:37:431
1804999120,11cyclictest0-21swapper/100:25:021
1804999120,11cyclictest0-21swapper/100:15:061
1804999120,10cyclictest0-21swapper/120:15:161
1804899129,2cyclictest0-21swapper/023:18:170
1804899129,2cyclictest0-21swapper/022:48:270
1804899129,2cyclictest0-21swapper/022:35:570
1804899129,2cyclictest0-21swapper/021:52:080
1804899129,2cyclictest0-21swapper/021:20:110
1804899129,2cyclictest0-21swapper/021:00:130
1804899129,2cyclictest0-21swapper/000:30:080
1804899129,2cyclictest0-21swapper/000:10:500
1804899127,3cyclictest29191-21aten2.4_r3power22:10:120
1804899122,7cyclictest0-21swapper/020:06:580
1804899122,7cyclictest0-21swapper/019:11:590
1804899120,2cyclictest0-21swapper/023:53:570
1804899120,2cyclictest0-21swapper/023:45:270
1804899120,2cyclictest0-21swapper/023:32:230
1804899120,2cyclictest0-21swapper/023:12:470
1804899120,2cyclictest0-21swapper/022:00:070
1804899120,2cyclictest0-21swapper/021:45:140
1804899120,2cyclictest0-21swapper/021:41:370
1804899120,2cyclictest0-21swapper/021:27:310
1804899120,2cyclictest0-21swapper/000:26:250
1804899120,11cyclictest0-21swapper/023:25:160
1804899120,11cyclictest0-21swapper/022:55:220
1804899120,11cyclictest0-21swapper/022:27:570
1804899120,11cyclictest0-21swapper/021:56:100
1804899120,11cyclictest0-21swapper/021:05:180
1804899120,11cyclictest0-21swapper/020:56:020
160212120,2sleep20-21swapper/223:00:242
160212120,2sleep20-21swapper/223:00:232
1805199118,2cyclictest0-21swapper/321:01:013
1805199117,2cyclictest5352-21cat19:56:023
1805199113,7cyclictest0-21swapper/320:01:583
1805199112,6cyclictest0-21swapper/320:29:013
1805199112,6cyclictest0-21swapper/319:26:593
1805199112,6cyclictest0-21swapper/319:21:583
1805199111,5cyclictest0-21swapper/320:35:003
1805199110,10cyclictest0-21swapper/321:40:423
1805099112,5cyclictest0-21swapper/219:25:002
1805099111,6cyclictest0-21swapper/220:46:002
1805099111,6cyclictest0-21swapper/220:25:582
1805099110,10cyclictest0-21swapper/221:55:072
1804999111,8cyclictest0-21swapper/120:40:181
1804999110,9cyclictest0-21swapper/120:25:121
1804999110,3cyclictest0-21swapper/119:35:141
1804999110,2cyclictest0-21swapper/120:30:051
1804899110,10cyclictest0-21swapper/021:35:020
273742100,2sleep20-21swapper/219:30:492
1805199102,6cyclictest0-21swapper/319:16:013
1805199102,6cyclictest0-21swapper/319:16:003
1805199102,5cyclictest0-21swapper/319:41:593
1805199100,7cyclictest25757-21copy20:50:013
1805199100,7cyclictest0-21swapper/320:36:583
1805099107,2cyclictest0-21swapper/220:20:182
1804999105,3cyclictest4618-21sort19:55:141
1804999100,2cyclictest0-21swapper/119:10:141
1804899105,3cyclictest3728-21runrttasks19:45:110
1804899105,3cyclictest21680-21sendmail20:40:000
180519992,6cyclictest0-21swapper/321:06:013
180519991,6cyclictest8975-21sed20:05:183
180519991,6cyclictest0-21swapper/319:46:003
180509996,2cyclictest15931-21kworker/u8:119:12:052
180509996,2cyclictest0-21swapper/220:50:032
180509994,3cyclictest10796-21interrupts20:10:152
180509991,6cyclictest32440-21cut21:05:132
180489996,2cyclictest0-21swapper/020:25:090
180489994,3cyclictest24440-21aten2.4_r3power19:25:110
180489994,3cyclictest23209-21timerwakeupswit20:40:540
180489994,3cyclictest1938-21head19:50:110
180489994,3cyclictest12170-21aten2.4-expect20:15:120
180489993,4cyclictest21113-21tr19:15:170
180489993,4cyclictest21113-21tr19:15:160
180519983,3cyclictest28108-21sh19:35:003
180509983,3cyclictest7855-21chrt20:04:252
180489983,3cyclictest10366-21cpuspeed_turbos20:10:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional