You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 06:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Mon Dec 15, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
225812116105,6sleep10-21swapper/119:07:421
22665210998,6sleep30-21swapper/319:08:473
22450210796,6sleep20-21swapper/219:06:012
22401210276,20sleep00-21swapper/019:05:240
302512730,0sleep0101ktimersoftd/019:25:250
22789994323,2cyclictest29-21rcuc/220:05:142
2278999360,18cyclictest0-21swapper/223:05:122
2278999350,2cyclictest0-21swapper/220:00:112
77052320,1sleep011-21rcuc/000:09:440
2279099300,18cyclictest0-21swapper/323:05:123
2278799220,14cyclictest0-21swapper/021:30:110
2278799210,16cyclictest0-21swapper/021:40:110
22789992017,2cyclictest6596-21diskmemload22:30:132
2278799200,2cyclictest0-21swapper/020:05:130
2278899180,1cyclictest0-21swapper/120:05:141
2278899180,17cyclictest0-21swapper/123:05:111
2278799171,14cyclictest4724-21munin-node0
2278799171,14cyclictest0-21swapper/019:15:120
2279099160,2cyclictest0-21swapper/320:05:143
2279099160,14cyclictest0-21swapper/321:17:183
2278999160,14cyclictest0-21swapper/223:35:132
2278799161,14cyclictest22786-21cyclictest22:47:230
2278799160,14cyclictest18366-21ssh23:45:160
2279099150,3cyclictest7458-21runrttasks23:45:143
2279099150,13cyclictest0-21swapper/323:38:083
2279099150,13cyclictest0-21swapper/321:25:143
2278999150,13cyclictest0-21swapper/200:26:332
2278999150,13cyclictest0-21swapper/200:21:042
2278899151,12cyclictest27651-21ssh22:43:551
2278899151,12cyclictest10387-21tune2fs23:00:151
2278899150,4cyclictest0-21swapper/123:30:271
2278899150,3cyclictest0-21swapper/121:00:241
2278799151,12cyclictest6596-21diskmemload21:35:110
2278799151,12cyclictest13374-21ssh23:03:540
22787991510,3cyclictest2739-21munin-node0
22787991510,3cyclictest12059-21ssh23:38:010
2278799150,14cyclictest0-21swapper/022:19:530
2278799150,13cyclictest6596-21diskmemload00:38:440
2278799150,13cyclictest12912-21latency_hist20:05:000
2278799150,13cyclictest0-21swapper/021:49:540
2279099141,2cyclictest6568-21apt-get21:45:153
22790991411,2cyclictest6596-21diskmemload22:22:513
22790991411,2cyclictest6596-21diskmemload00:14:113
2279099141,12cyclictest381ktimersoftd/300:26:013
22790991411,2cyclictest0-21swapper/323:22:513
22790991411,2cyclictest0-21swapper/322:04:313
22790991411,2cyclictest0-21swapper/322:04:313
22790991411,2cyclictest0-21swapper/300:35:213
22790991411,2cyclictest0-21swapper/300:30:493
22790991410,2cyclictest0-21swapper/322:36:143
2279099140,13cyclictest0-21swapper/321:37:283
2279099140,12cyclictest0-21swapper/323:14:083
2279099140,12cyclictest0-21swapper/322:16:443
2279099140,12cyclictest0-21swapper/322:09:193
2279099140,12cyclictest0-21swapper/321:55:133
2279099140,12cyclictest0-21swapper/320:50:193
22789991411,2cyclictest764-21kworker/u8:219:47:042
22789991411,2cyclictest6596-21diskmemload23:17:132
22789991411,2cyclictest30099-21kworker/u8:221:54:042
22789991411,2cyclictest0-21swapper/222:28:332
22789991411,2cyclictest0-21swapper/222:12:032
22789991411,2cyclictest0-21swapper/221:23:242
22789991411,2cyclictest0-21swapper/220:30:042
22789991410,2cyclictest0-21swapper/221:44:502
2278999140,2cyclictest0-21swapper/222:44:442
2278999140,2cyclictest0-21swapper/222:01:032
2278999140,2cyclictest0-21swapper/222:01:032
2278999140,13cyclictest0-21swapper/223:55:142
2278999140,13cyclictest0-21swapper/222:53:432
2278999140,13cyclictest0-21swapper/222:39:132
2278999140,12cyclictest6596-21diskmemload23:46:082
2278999140,12cyclictest6596-21diskmemload22:16:332
2278999140,12cyclictest6596-21diskmemload00:01:162
2278999140,12cyclictest0-21swapper/221:57:202
2278999140,12cyclictest0-21swapper/221:11:252
2278999140,12cyclictest0-21swapper/200:05:202
22788991411,2cyclictest6596-21diskmemload00:05:471
2278899140,2cyclictest6596-21diskmemload21:22:191
2278899140,2cyclictest328750irq/24-eth123:35:571
2278899140,2cyclictest0-21swapper/122:12:231
2278899140,13cyclictest6596-21diskmemload00:12:251
2278899140,13cyclictest0-21swapper/123:45:581
2278899140,13cyclictest0-21swapper/122:55:121
2278899140,13cyclictest0-21swapper/121:41:181
2278899140,13cyclictest0-21swapper/121:16:581
2278899140,12cyclictest0-21swapper/120:30:051
2278799149,3cyclictest0-21swapper/021:20:110
2278799142,6cyclictest0-21swapper/023:40:000
2278799141,2cyclictest15650-21irqstats20:10:170
22787991411,2cyclictest0-21swapper/021:58:230
2278799140,2cyclictest0-21swapper/023:05:330
2278799140,2cyclictest0-21swapper/022:11:430
2278799140,13cyclictest0-21swapper/021:29:030
2278799140,12cyclictest6596-21diskmemload23:50:330
2278799140,12cyclictest6596-21diskmemload23:12:240
2278799140,12cyclictest0-21swapper/023:23:060
2278799140,12cyclictest0-21swapper/022:35:170
2278799140,12cyclictest0-21swapper/022:30:280
2278799140,12cyclictest0-21swapper/022:00:570
2278799140,12cyclictest0-21swapper/022:00:560
2278799140,12cyclictest0-21swapper/000:11:510
78682130,2sleep10-21swapper/122:20:551
22790991310,2cyclictest0-21swapper/323:55:093
22790991310,2cyclictest0-21swapper/323:52:023
22790991310,2cyclictest0-21swapper/323:41:593
22790991310,2cyclictest0-21swapper/323:31:033
22790991310,2cyclictest0-21swapper/323:25:103
22790991310,2cyclictest0-21swapper/323:04:493
22790991310,2cyclictest0-21swapper/322:47:123
22790991310,2cyclictest0-21swapper/322:40:113
22790991310,2cyclictest0-21swapper/322:11:593
22790991310,2cyclictest0-21swapper/321:44:523
22790991310,2cyclictest0-21swapper/321:05:143
22790991310,2cyclictest0-21swapper/320:45:103
22790991310,2cyclictest0-21swapper/319:35:213
22790991310,2cyclictest0-21swapper/300:21:013
22790991310,2cyclictest0-21swapper/300:00:023
2279099130,2cyclictest0-21swapper/323:15:143
2279099130,2cyclictest0-21swapper/322:56:223
2279099130,2cyclictest0-21swapper/321:53:283
2279099130,2cyclictest0-21swapper/319:15:233
2279099130,2cyclictest0-21swapper/300:15:303
2279099130,2cyclictest0-21swapper/300:05:143
2279099130,12cyclictest0-21swapper/322:52:233
2279099130,12cyclictest0-21swapper/322:25:103
2279099130,12cyclictest0-21swapper/319:10:013
2278999138,3cyclictest29960-21munin-node2
22789991310,2cyclictest28722-21kworker/u8:219:25:042
22789991310,2cyclictest12201-21kworker/u8:222:46:042
22789991310,2cyclictest0-21swapper/223:28:332
22789991310,2cyclictest0-21swapper/223:11:072
22789991310,2cyclictest0-21swapper/222:55:152
22789991310,2cyclictest0-21swapper/221:00:122
22789991310,2cyclictest0-21swapper/200:12:032
2278999130,2cyclictest0-21swapper/222:09:442
2278999130,2cyclictest0-21swapper/219:55:242
2278999130,12cyclictest0-21swapper/221:47:242
2278999130,12cyclictest0-21swapper/221:15:092
2278999130,12cyclictest0-21swapper/200:35:132
2278999130,11cyclictest13005-21kworker/u8:120:10:042
2278999130,11cyclictest0-21swapper/223:40:512
2278999130,11cyclictest0-21swapper/221:30:372
2278899132,9cyclictest12-21rcu_preempt21:10:161
2278899131,3cyclictest20116-21fschecks_time22:35:151
22788991310,2cyclictest764-21kworker/u8:220:01:041
22788991310,2cyclictest6596-21diskmemload21:51:191
22788991310,2cyclictest6596-21diskmemload00:17:431
22788991310,2cyclictest22611-21kworker/u8:023:26:041
22788991310,2cyclictest0-21swapper/123:50:211
22788991310,2cyclictest0-21swapper/122:53:161
22788991310,2cyclictest0-21swapper/122:25:581
22788991310,2cyclictest0-21swapper/122:07:151
22788991310,2cyclictest0-21swapper/121:45:271
22788991310,2cyclictest0-21swapper/120:35:241
22788991310,2cyclictest0-21swapper/119:40:121
22788991310,2cyclictest0-21swapper/100:20:551
22788991310,2cyclictest0-21swapper/100:03:321
2278899130,3cyclictest0-21swapper/120:20:211
2278899130,2cyclictest0-21swapper/123:55:211
2278899130,2cyclictest0-21swapper/123:15:071
2278899130,2cyclictest0-21swapper/123:10:321
2278899130,2cyclictest0-21swapper/122:47:221
2278899130,2cyclictest0-21swapper/122:01:011
2278899130,2cyclictest0-21swapper/122:01:011
2278899130,2cyclictest0-21swapper/100:36:561
2278899130,2cyclictest0-21swapper/100:34:071
2278899130,2cyclictest0-21swapper/100:26:001
2278899130,12cyclictest6596-21diskmemload22:15:551
2278899130,12cyclictest0-21swapper/123:43:181
2278899130,12cyclictest0-21swapper/121:55:071
2278899130,12cyclictest0-21swapper/121:32:061
2278899130,11cyclictest0-21swapper/122:30:291
2278899130,11cyclictest0-21swapper/121:37:261
2278899130,11cyclictest0-21swapper/120:55:231
2278899130,11cyclictest0-21swapper/120:50:211
2278799133,6cyclictest0-21swapper/019:55:250
22787991310,2cyclictest6596-21diskmemload23:31:570
22787991310,2cyclictest6596-21diskmemload21:19:270
22787991310,2cyclictest0-21swapper/022:56:590
22787991310,2cyclictest0-21swapper/022:23:240
22787991310,2cyclictest0-21swapper/022:05:130
22787991310,2cyclictest0-21swapper/000:17:240
2278799130,2cyclictest0-21swapper/022:40:430
2278799130,2cyclictest0-21swapper/000:25:540
2278799130,12cyclictest14343-21ssh21:53:130
2278799130,12cyclictest0-21swapper/023:18:170
2278799130,11cyclictest6596-21diskmemload23:28:580
2278799130,11cyclictest0-21swapper/022:25:020
78502120,2sleep26596-21diskmemload23:33:322
2279099129,2cyclictest10933-21aten2.4_r3power20:00:113
2279099129,2cyclictest0-21swapper/322:30:103
2279099129,2cyclictest0-21swapper/320:25:153
2279099120,2cyclictest0-21swapper/321:20:303
2279099120,11cyclictest0-21swapper/321:31:223
2279099120,11cyclictest0-21swapper/321:11:573
2278999129,2cyclictest20719-21kworker/u8:020:46:042
2278999129,2cyclictest0-21swapper/200:17:552
2278999123,7cyclictest27359-21sensors00:30:242
2278999122,6cyclictest0-21swapper/220:57:232
2278999120,2cyclictest0-21swapper/223:22:562
2278999120,2cyclictest0-21swapper/223:00:432
2278999120,2cyclictest0-21swapper/222:23:372
2278999120,11cyclictest0-21swapper/223:50:162
2278999120,11cyclictest0-21swapper/221:26:062
2278999120,11cyclictest0-21swapper/220:25:182
2278999120,11cyclictest0-21swapper/219:35:182
2278999120,11cyclictest0-21swapper/219:30:182
2278899129,2cyclictest764-21kworker/u8:220:16:041
2278899129,2cyclictest27114-21kworker/u8:221:07:041
2278899129,2cyclictest0-21swapper/120:40:121
2278899129,2cyclictest0-21swapper/119:25:121
2278899122,8cyclictest0-21swapper/119:20:271
2278899121,9cyclictest0-21swapper/119:55:061
2278899121,3cyclictest22996-21munin-node1
2278899121,3cyclictest0-21swapper/119:45:261
2278899120,11cyclictest0-21swapper/123:20:161
2278899120,11cyclictest0-21swapper/121:25:521
2278799129,2cyclictest0-21swapper/019:30:150
2278799129,2cyclictest0-21swapper/000:01:180
2278799121,6cyclictest0-21swapper/000:30:000
2278799120,2cyclictest0-21swapper/023:55:230
2278799120,2cyclictest0-21swapper/020:30:060
2278799120,11cyclictest0-21swapper/022:51:370
2278799120,11cyclictest0-21swapper/021:10:370
2278799120,11cyclictest0-21swapper/000:20:200
2279099118,2cyclictest0-21swapper/320:55:263
2279099118,2cyclictest0-21swapper/319:30:253
2279099117,3cyclictest3644-21ntp_states21:00:183
2279099110,10cyclictest0-21swapper/320:42:343
2279099110,10cyclictest0-21swapper/319:45:143
2279099110,10cyclictest0-21swapper/319:25:173
2278999118,2cyclictest0-21swapper/220:35:022
2278999118,2cyclictest0-21swapper/219:20:142
2278999116,3cyclictest27806-21uname20:40:172
2278899118,2cyclictest0-21swapper/119:30:141
2278899110,9cyclictest378-21apt-get19:35:051
2278899110,10cyclictest0-21swapper/119:15:191
2278799116,3cyclictest277-21jbd2/sda1-820:45:250
2278799111,7cyclictest0-21swapper/020:25:580
2278799111,6cyclictest0-21swapper/019:40:110
2279099107,2cyclictest15369-21diskstats20:10:153
2278999107,2cyclictest25168-21kworker/u8:119:18:052
2278999107,2cyclictest0-21swapper/220:20:172
2278999107,2cyclictest0-21swapper/220:15:252
2278999107,2cyclictest0-21swapper/219:10:152
2278999102,6cyclictest0-21swapper/219:52:092
2278999100,8cyclictest0-21swapper/220:50:122
2278899107,2cyclictest764-21kworker/u8:220:25:041
2278899105,3cyclictest6737-21apt-get19:50:121
2278899101,7cyclictest14947-21packagekitd20:10:041
2278899101,3cyclictest0-21swapper/120:45:171
2278799107,2cyclictest0-21swapper/019:20:190
2278799102,7cyclictest0-21swapper/020:58:580
2278799102,6cyclictest0-21swapper/020:42:190
2278799100,8cyclictest0-21swapper/019:35:060
227909994,3cyclictest7394-21grep19:50:163
227909994,3cyclictest25226-21head20:35:183
227909994,3cyclictest23873-21grep20:30:173
227909991,6cyclictest1750-21kworker/3:020:15:263
227899994,3cyclictest4911-21head21:05:132
227899991,3cyclictest0-21swapper/219:40:272
227879996,2cyclictest0-21swapper/020:50:140
227879994,3cyclictest6119-21NetworkManager21:05:050
227879994,3cyclictest25345-21cpuspeed_turbos20:35:190
227879994,3cyclictest23414-21fschecks_count19:10:110
227879994,3cyclictest19855-21needreboot20:20:190
227879994,3cyclictest17298-21df_abs20:15:130
227879991,3cyclictest8123-21timerwakeupswit19:50:250
227909984,3cyclictest6431-21nscd19:55:073
227909983,3cyclictest27484-21fschecks_count19:20:163
227909983,3cyclictest13005-21kworker/u8:120:20:133
227909980,6cyclictest2933-21tr19:40:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional