You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-05 - 05:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Fri Dec 05, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19813212197,17sleep00-21swapper/019:05:110
215652115104,6sleep20-21swapper/219:09:332
21276211396,12sleep10-21swapper/119:05:521
21303210482,17sleep30-21swapper/319:06:143
109192530,0sleep10-21swapper/121:15:161
2162999370,2cyclictest0-21swapper/022:30:150
325882280,1sleep1221ktimersoftd/100:30:291
2163099288,18cyclictest332250irq/24-eth121:50:111
2163299270,3cyclictest10659-21rm21:50:113
262102240,2sleep226215-21cpuspeed_turbos20:40:152
289572230,2sleep011-21rcuc/023:53:000
2163099221,19cyclictest0-21swapper/119:30:111
2162999221,19cyclictest0-21swapper/022:55:140
2163299210,19cyclictest0-21swapper/322:05:143
7502200,0sleep30-21swapper/300:31:313
21632992017,2cyclictest10431-21kworker/u8:023:16:043
2163299200,3cyclictest5390-21diskmemload00:04:043
2163299181,14cyclictest15394-21date22:30:013
2162999181,3cyclictest0-21swapper/023:15:270
171152180,0sleep10-21swapper/121:55:521
14752180,1sleep20-21swapper/200:32:432
274892170,0sleep20-21swapper/222:41:552
21632991714,2cyclictest17636-21kworker/u8:221:34:043
2163299170,12cyclictest0-21swapper/323:08:043
21631991712,3cyclictest0-21swapper/222:30:292
2163099171,14cyclictest5010-21snmpd19:20:111
21632991613,2cyclictest26240-21kworker/u8:321:37:043
2163299161,13cyclictest23636-21apt-get19:15:063
21632991611,3cyclictest0-21swapper/322:50:133
2163299161,13cyclictest0-21swapper/321:05:203
2163299160,14cyclictest0-21swapper/321:41:573
21630991611,3cyclictest5390-21diskmemload22:30:061
21630991611,3cyclictest0-21swapper/123:55:171
21630991611,3cyclictest0-21swapper/122:35:231
2162999161,13cyclictest0-21swapper/000:35:180
2163299152,7cyclictest0-21swapper/323:05:003
21632991512,2cyclictest4421-21kworker/u8:122:57:043
21632991512,2cyclictest3209-21kworker/u8:221:15:043
21632991512,2cyclictest22110-21kworker/u8:022:48:043
21632991512,2cyclictest22110-21kworker/u8:022:41:043
21632991512,2cyclictest20910-21kworker/u8:123:21:043
21632991512,2cyclictest17045-21kworker/u8:100:21:043
21632991512,2cyclictest17045-21kworker/u8:100:18:043
21632991512,2cyclictest13670-21kworker/u8:300:29:043
21632991512,2cyclictest0-21swapper/322:03:073
21632991511,2cyclictest27168-21kworker/u8:022:14:043
21632991510,3cyclictest17961-21runrttasks21:22:363
2163299150,2cyclictest0-21swapper/323:34:363
2163299150,13cyclictest5390-21diskmemload23:54:463
2163299150,10cyclictest0-21swapper/319:22:043
2163199151,3cyclictest19094-21ssh21:24:302
21631991512,2cyclictest0-21swapper/221:28:492
2163199150,14cyclictest0-21swapper/223:00:122
2163199150,13cyclictest0-21swapper/221:43:032
2163199150,13cyclictest0-21swapper/221:31:542
2163099152,8cyclictest0-21swapper/122:00:011
2163099151,3cyclictest3164-21ntp_states23:25:191
2163099151,12cyclictest6391-21apt-get22:20:121
21629991512,2cyclictest4375-21kworker/u8:122:02:040
21629991510,3cyclictest18281-21ssh23:06:340
2162999150,2cyclictest0-21swapper/022:22:370
2162999150,13cyclictest0-21swapper/021:05:290
53372140,2sleep00-21swapper/021:44:340
2163299149,3cyclictest1167-21apt-get22:15:053
2163299142,7cyclictest0-21swapper/319:50:013
21632991411,2cyclictest2765-21kworker/u8:100:06:013
21632991411,2cyclictest15193-21kworker/u8:021:55:043
21632991411,2cyclictest13670-21kworker/u8:300:12:043
2163299140,2cyclictest5390-21diskmemload22:33:043
2163299140,2cyclictest0-21swapper/321:25:573
2163299140,12cyclictest5390-21diskmemload22:35:213
2163299140,12cyclictest0-21swapper/323:25:563
2163299140,12cyclictest0-21swapper/321:48:023
21631991411,2cyclictest5390-21diskmemload23:46:082
21631991411,2cyclictest0-21swapper/223:57:582
21631991411,2cyclictest0-21swapper/222:03:132
21631991411,2cyclictest0-21swapper/221:19:392
21631991411,2cyclictest0-21swapper/221:13:292
2163199141,11cyclictest0-21swapper/222:57:302
21631991410,2cyclictest515-21ssh21:39:262
2163199140,2cyclictest0-21swapper/223:29:152
2163199140,2cyclictest0-21swapper/222:52:382
2163199140,2cyclictest0-21swapper/221:57:492
2163199140,2cyclictest0-21swapper/221:46:492
2163199140,2cyclictest0-21swapper/200:10:482
2163199140,13cyclictest0-21swapper/222:19:592
2163199140,13cyclictest0-21swapper/220:50:292
2163199140,13cyclictest0-21swapper/200:17:282
2163199140,12cyclictest5390-21diskmemload00:07:032
2163199140,12cyclictest18662-21ssh23:07:122
2163199140,12cyclictest0-21swapper/223:42:162
2163199140,12cyclictest0-21swapper/223:18:212
2163199140,12cyclictest0-21swapper/222:07:002
21630991411,2cyclictest5390-21diskmemload22:25:141
2163099140,12cyclictest5390-21diskmemload21:22:521
2163099140,12cyclictest332250irq/24-eth122:06:041
2163099140,12cyclictest0-21swapper/123:20:431
2163099140,12cyclictest0-21swapper/123:18:481
2163099140,12cyclictest0-21swapper/123:05:201
2163099140,12cyclictest0-21swapper/120:35:131
2163099140,12cyclictest0-21swapper/119:15:161
2163099140,12cyclictest0-21swapper/100:20:371
2162999149,3cyclictest0-21swapper/021:18:150
2162999143,8cyclictest5906-21metacity22:36:590
2162999142,7cyclictest0-21swapper/022:45:010
2162999142,7cyclictest0-21swapper/000:35:010
2162999142,6cyclictest0-21swapper/019:40:010
21629991411,2cyclictest4375-21kworker/u8:121:46:020
21629991411,2cyclictest26240-21kworker/u8:321:35:040
21629991411,2cyclictest0-21swapper/023:34:170
21629991411,2cyclictest0-21swapper/020:20:170
2162999140,12cyclictest5390-21diskmemload22:40:180
2162999140,12cyclictest30954-21ssh22:10:400
2162999140,12cyclictest0-21swapper/023:57:570
2162999140,12cyclictest0-21swapper/023:47:370
2162999140,12cyclictest0-21swapper/023:27:380
2162999140,12cyclictest0-21swapper/022:16:000
215212140,2sleep00-21swapper/000:20:030
182042140,2sleep00-21swapper/023:40:470
21632991310,2cyclictest6738-21kworker/u8:119:54:043
21632991310,2cyclictest29401-21kworker/u8:019:26:043
21632991310,2cyclictest17916-21kworker/u8:020:23:043
21632991310,2cyclictest17793-21kworker/u8:219:33:043
21632991310,2cyclictest15305-21kworker/u8:120:12:043
21632991310,2cyclictest0-21swapper/300:36:413
2163299130,2cyclictest9517-21apt-get20:00:053
2163299130,2cyclictest0-21swapper/323:46:013
2163299130,2cyclictest0-21swapper/323:10:163
2163299130,2cyclictest0-21swapper/322:21:073
2163299130,2cyclictest0-21swapper/320:55:173
2163299130,12cyclictest8080-21ssh21:11:373
21631991310,2cyclictest5390-21diskmemload22:39:402
21631991310,2cyclictest0-21swapper/223:10:082
21631991310,2cyclictest0-21swapper/222:11:202
21631991310,2cyclictest0-21swapper/221:50:092
21631991310,2cyclictest0-21swapper/200:01:122
2163199130,2cyclictest0-21swapper/223:36:212
2163199130,2cyclictest0-21swapper/222:48:112
2163199130,2cyclictest0-21swapper/222:25:142
2163199130,12cyclictest0-21swapper/223:53:082
2163199130,12cyclictest0-21swapper/200:28:582
2163199130,11cyclictest5390-21diskmemload22:21:112
2163199130,11cyclictest5390-21diskmemload00:36:422
2163199130,11cyclictest0-21swapper/200:21:202
2163099132,6cyclictest0-21swapper/122:55:001
2163099132,6cyclictest0-21swapper/119:55:001
2163099132,6cyclictest0-21swapper/119:40:011
2163099131,7cyclictest0-21swapper/123:40:001
21630991310,2cyclictest5390-21diskmemload21:42:171
21630991310,2cyclictest5390-21diskmemload21:38:091
21630991310,2cyclictest0-21swapper/123:50:151
21630991310,2cyclictest0-21swapper/123:41:071
21630991310,2cyclictest0-21swapper/122:56:181
21630991310,2cyclictest0-21swapper/121:10:241
2163099130,2cyclictest5390-21diskmemload22:42:471
2163099130,2cyclictest0-21swapper/121:45:191
2163099130,2cyclictest0-21swapper/121:34:491
2163099130,2cyclictest0-21swapper/120:45:271
2163099130,2cyclictest0-21swapper/120:05:151
2163099130,2cyclictest0-21swapper/100:18:011
2163099130,12cyclictest23602-21ssh23:46:571
2163099130,12cyclictest0-21swapper/123:14:471
2163099130,12cyclictest0-21swapper/123:00:371
2163099130,12cyclictest0-21swapper/119:25:011
2163099130,11cyclictest5390-21diskmemload00:36:221
2163099130,11cyclictest0-21swapper/121:27:021
2162999139,2cyclictest0-21swapper/021:20:270
2162999132,6cyclictest0-21swapper/020:30:000
2162999132,6cyclictest0-21swapper/019:35:010
2162999132,6cyclictest0-21swapper/019:30:010
21629991310,2cyclictest6738-21kworker/u8:120:00:040
21629991310,2cyclictest0-21swapper/023:39:590
21629991310,2cyclictest0-21swapper/023:22:590
21629991310,2cyclictest0-21swapper/023:10:230
21629991310,2cyclictest0-21swapper/022:53:190
21629991310,2cyclictest0-21swapper/021:10:140
2162999130,2cyclictest5390-21diskmemload21:55:010
2162999130,2cyclictest0-21swapper/022:07:470
2162999130,2cyclictest0-21swapper/021:34:070
2162999130,2cyclictest0-21swapper/000:13:300
2162999130,12cyclictest0-21swapper/000:25:220
2162999130,11cyclictest0-21swapper/000:15:490
46152120,2sleep00-21swapper/000:00:550
2163299129,2cyclictest15305-21kworker/u8:120:44:043
2163299129,2cyclictest0-21swapper/323:35:173
2163299129,2cyclictest0-21swapper/320:51:273
2163299129,2cyclictest0-21swapper/320:15:153
2163299121,5cyclictest0-21swapper/320:40:003
2163299120,11cyclictest0-21swapper/323:55:203
2163299120,11cyclictest0-21swapper/323:41:093
2163299120,11cyclictest0-21swapper/320:05:153
2163199129,2cyclictest0-21swapper/223:30:112
2163199129,2cyclictest0-21swapper/221:00:292
2163199129,2cyclictest0-21swapper/219:30:122
2163199127,3cyclictest18624-21memory20:20:182
2163199120,2cyclictest0-21swapper/223:21:022
2163199120,11cyclictest0-21swapper/220:35:152
2163199120,11cyclictest0-21swapper/219:40:242
2163199120,11cyclictest0-21swapper/219:35:242
2163099129,2cyclictest5390-21diskmemload00:00:301
2163099129,2cyclictest0-21swapper/123:30:211
2163099129,2cyclictest0-21swapper/122:49:121
2163099129,2cyclictest0-21swapper/122:11:401
2163099129,2cyclictest0-21swapper/120:30:181
2163099121,9cyclictest0-21swapper/122:15:241
2163099120,3cyclictest0-21swapper/121:00:171
2163099120,2cyclictest0-21swapper/100:10:401
2163099120,11cyclictest0-21swapper/121:05:151
2163099120,11cyclictest0-21swapper/120:50:191
2163099120,11cyclictest0-21swapper/120:15:181
2163099120,11cyclictest0-21swapper/119:40:121
2163099120,11cyclictest0-21swapper/100:25:201
2163099120,11cyclictest0-21swapper/100:07:141
2162999129,2cyclictest0-21swapper/022:27:000
2162999129,2cyclictest0-21swapper/000:07:480
2162999123,6cyclictest0-21swapper/020:15:240
2162999122,7cyclictest0-21swapper/019:36:580
2162999122,6cyclictest0-21swapper/020:45:280
2162999122,6cyclictest0-21swapper/019:20:000
2162999120,2cyclictest0-21swapper/020:55:220
2162999120,11cyclictest5390-21diskmemload21:26:440
2162999120,11cyclictest0-21swapper/023:00:180
2162999120,11cyclictest0-21swapper/021:50:470
2162999120,11cyclictest0-21swapper/020:35:180
2162999120,11cyclictest0-21swapper/019:45:150
2163299118,2cyclictest17916-21kworker/u8:020:25:043
2163299118,2cyclictest15305-21kworker/u8:120:48:043
2163299118,2cyclictest0-21swapper/321:00:173
2163299113,6cyclictest0-21swapper/320:30:303
2163199118,2cyclictest0-21swapper/220:55:132
2163199118,2cyclictest0-21swapper/220:30:182
2163199118,2cyclictest0-21swapper/219:26:252
2163199112,5cyclictest0-21swapper/219:20:012
2163199110,1cyclictest0-21swapper/219:50:242
2163199110,10cyclictest0-21swapper/221:09:592
2163199110,10cyclictest0-21swapper/220:00:042
2163099111,8cyclictest7724-21munin-node1
2163099110,9cyclictest9768-21kworker/1:020:00:041
2163099110,9cyclictest0-21swapper/119:45:191
2163099110,2cyclictest0-21swapper/120:55:231
2162999118,2cyclictest0-21swapper/020:50:290
2162999118,2cyclictest0-21swapper/020:10:240
2162999116,3cyclictest20704-21needreboot20:25:180
2162999111,5cyclictest0-21swapper/021:00:000
2163299107,2cyclictest0-21swapper/319:35:163
2163299106,2cyclictest0-21swapper/319:40:133
2163299100,2cyclictest0-21swapper/319:56:043
2163199105,3cyclictest21188-21grep20:25:262
2163199101,5cyclictest0-21swapper/220:20:002
2163099104,4cyclictest19734-21sort20:25:001
2163099102,6cyclictest0-21swapper/120:10:211
2163099101,2cyclictest0-21swapper/120:25:261
2163099100,3cyclictest0-21swapper/119:10:181
2162999105,3cyclictest19750irq/25-ahci[00020:00:000
2162999101,6cyclictest0-21swapper/019:20:230
216329994,3cyclictest22159-21sed19:10:143
216319994,3cyclictest22709-21tr19:10:172
216319990,8cyclictest0-21swapper/220:13:292
216319990,2cyclictest0-21swapper/219:46:242
216309994,3cyclictest26015-21sh20:40:141
216299994,3cyclictest6756-21fgrep19:50:230
216299994,3cyclictest26654-21latency20:40:180
216299994,3cyclictest21859-21cut19:10:120
216299994,3cyclictest11803-21aten2.4_r3power20:05:130
216319985,2cyclictest0-21swapper/219:20:122
216319983,3cyclictest8008-21grep19:55:152
216319983,3cyclictest28778-21sed20:45:182
216319983,3cyclictest11954-21sh20:05:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional