You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-28 - 15:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Tue Apr 28, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8962116105,6sleep10-21swapper/107:06:241
10092116105,6sleep00-21swapper/007:07:510
1057210890,13sleep30-21swapper/307:08:303
1051210695,6sleep20-21swapper/207:08:252
269572730,0sleep00-21swapper/012:13:290
316742690,0sleep2301ktimersoftd/209:24:562
260852680,0sleep30-21swapper/309:18:193
120799240,2cyclictest0-21swapper/108:25:111
127522230,2sleep011-21rcuc/011:22:380
120899221,19cyclictest28004-21ssh10:30:112
120799210,19cyclictest0-21swapper/111:45:121
120699210,2cyclictest0-21swapper/007:25:130
121099200,2cyclictest0-21swapper/312:20:123
1208991815,2cyclictest0-21swapper/207:40:112
1208991810,5cyclictest10979-21ssh11:55:252
1206991815,2cyclictest12953-21kworker/u8:110:20:040
121099173,8cyclictest17753-21ssh09:09:593
121099171,14cyclictest3820-21ssh11:13:273
121099171,14cyclictest3820-21ssh11:13:263
121099171,14cyclictest0-21swapper/308:45:163
1207991712,3cyclictest0-21swapper/110:23:381
1206991714,2cyclictest17644-21kworker/u8:010:54:020
1210991611,3cyclictest0-21swapper/309:58:353
1208991612,2cyclictest0-21swapper/210:41:002
136592150,2sleep00-21swapper/009:40:050
121099154,8cyclictest4562-21gdm-simple-gree10:24:583
121099151,12cyclictest31351-21ssh11:42:483
121099151,12cyclictest27300-21munin-run09:55:003
121099151,12cyclictest11855-21ssh11:21:083
1210991510,3cyclictest13038-21sh10:13:593
121099150,13cyclictest25480-21ssh10:26:263
120899151,3cyclictest32058-21date08:25:012
1208991510,3cyclictest18681-21expr09:45:132
1207991512,2cyclictest0-21swapper/110:15:181
1207991512,2cyclictest0-21swapper/108:10:171
120799151,12cyclictest2657-21sh11:11:341
120799151,12cyclictest2657-21sh11:11:341
120799151,12cyclictest23139-21apt-get11:00:051
120799151,12cyclictest23139-21apt-get11:00:051
1207991510,3cyclictest0-21swapper/111:55:191
1206991512,2cyclictest15349-21kworker/u8:010:12:040
120699151,12cyclictest0-21swapper/010:16:030
313812140,2sleep00-21swapper/011:08:080
313812140,2sleep00-21swapper/011:08:070
121099149,3cyclictest20545-21ssh09:11:533
121099142,7cyclictest0-21swapper/311:40:003
121099142,6cyclictest0-21swapper/308:05:003
121099142,6cyclictest0-21swapper/308:05:003
121099141,7cyclictest0-21swapper/308:25:003
121099141,3cyclictest0-21swapper/310:43:083
1210991411,2cyclictest0-21swapper/310:47:063
1210991411,2cyclictest0-21swapper/308:55:173
1210991411,2cyclictest0-21swapper/308:30:173
121099140,3cyclictest2652-21ssh10:02:293
121099140,2cyclictest3187-21ntpd08:25:183
121099140,2cyclictest0-21swapper/311:29:323
121099140,13cyclictest0-21swapper/310:55:173
121099140,13cyclictest0-21swapper/310:55:163
121099140,12cyclictest0-21swapper/310:15:203
121099140,12cyclictest0-21swapper/308:10:103
120899149,3cyclictest0-21swapper/208:36:002
120899141,7cyclictest0-21swapper/211:10:002
120899141,7cyclictest0-21swapper/211:10:002
120899140,12cyclictest19127-21smartctl07:51:032
120799149,3cyclictest0-21swapper/110:37:181
1207991411,2cyclictest17737-21diskmemload12:23:491
1207991411,2cyclictest0-21swapper/109:30:181
1207991410,2cyclictest0-21swapper/112:38:111
120799140,2cyclictest0-21swapper/108:15:171
120799140,13cyclictest0-21swapper/110:57:281
120799140,13cyclictest0-21swapper/110:57:281
120799140,13cyclictest0-21swapper/109:11:091
120799140,12cyclictest0-21swapper/109:56:321
1206991411,2cyclictest17949-21kworker/u8:011:34:040
1206991411,2cyclictest17644-21kworker/u8:010:34:010
1206991411,2cyclictest0-21swapper/011:14:170
1206991411,2cyclictest0-21swapper/011:14:170
1206991411,2cyclictest0-21swapper/009:11:370
1206991410,2cyclictest5794-21kworker/u8:311:27:040
120699140,3cyclictest0-21swapper/008:26:040
120699140,2cyclictest0-21swapper/009:17:560
120699140,12cyclictest0-21swapper/008:10:110
27672130,2sleep00-21swapper/010:02:430
121099138,3cyclictest4122-21diskstats08:35:133
121099138,3cyclictest10497-21munin-node3
121099132,6cyclictest0-21swapper/309:45:003
121099132,6cyclictest0-21swapper/307:20:003
121099131,7cyclictest0-21swapper/307:25:013
1210991310,2cyclictest17737-21diskmemload09:20:073
1210991310,2cyclictest0-21swapper/312:25:003
1210991310,2cyclictest0-21swapper/312:18:083
1210991310,2cyclictest0-21swapper/312:14:483
1210991310,2cyclictest0-21swapper/311:50:173
1210991310,2cyclictest0-21swapper/311:32:263
1210991310,2cyclictest0-21swapper/311:05:063
1210991310,2cyclictest0-21swapper/311:05:063
1210991310,2cyclictest0-21swapper/310:54:193
1210991310,2cyclictest0-21swapper/310:09:113
1210991310,2cyclictest0-21swapper/309:45:583
1210991310,2cyclictest0-21swapper/309:35:183
1210991310,2cyclictest0-21swapper/308:51:023
121099130,2cyclictest0-21swapper/312:33:433
121099130,2cyclictest0-21swapper/310:34:563
121099130,2cyclictest0-21swapper/309:31:343
121099130,12cyclictest0-21swapper/312:05:163
121099130,12cyclictest0-21swapper/310:35:143
121099130,11cyclictest17737-21diskmemload11:45:103
121099130,11cyclictest0-21swapper/309:25:113
120899138,3cyclictest15392-21switchtime09:41:042
120899132,8cyclictest0-21swapper/207:29:582
120899132,6cyclictest0-21swapper/210:05:012
120899132,6cyclictest0-21swapper/209:19:592
120899131,6cyclictest17737-21diskmemload12:30:002
120899131,2cyclictest12892-21ssh10:13:452
1208991310,2cyclictest0-21swapper/212:15:122
1208991310,2cyclictest0-21swapper/209:38:572
120899130,2cyclictest15867-21pzem_voltage12:00:512
120899130,11cyclictest0-21swapper/210:09:562
1207991310,2cyclictest17737-21diskmemload09:28:081
1207991310,2cyclictest0-21swapper/112:15:161
1207991310,2cyclictest0-21swapper/111:09:171
1207991310,2cyclictest0-21swapper/111:09:161
1207991310,2cyclictest0-21swapper/110:50:271
1207991310,2cyclictest0-21swapper/109:37:091
1207991310,2cyclictest0-21swapper/108:40:101
1207991310,2cyclictest0-21swapper/108:35:111
1207991310,2cyclictest0-21swapper/107:25:151
120799130,2cyclictest17737-21diskmemload12:09:111
120799130,2cyclictest0-21swapper/111:52:581
120799130,2cyclictest0-21swapper/109:41:041
120799130,2cyclictest0-21swapper/109:23:381
120799130,2cyclictest0-21swapper/108:00:131
120799130,2cyclictest0-21swapper/108:00:121
120799130,12cyclictest0-21swapper/112:00:081
120799130,12cyclictest0-21swapper/111:37:491
120799130,12cyclictest0-21swapper/111:30:151
120799130,12cyclictest0-21swapper/111:20:421
120799130,12cyclictest0-21swapper/110:49:181
120799130,12cyclictest0-21swapper/110:11:081
120799130,11cyclictest0-21swapper/112:11:051
120799130,11cyclictest0-21swapper/110:01:471
120699139,2cyclictest0-21swapper/010:06:210
120699138,3cyclictest0-21swapper/009:30:170
120699132,6cyclictest0-21swapper/011:45:010
120699131,6cyclictest0-21swapper/007:20:000
1206991310,2cyclictest24889-21sensors10:26:010
1206991310,2cyclictest17949-21kworker/u8:011:37:040
1206991310,2cyclictest0-21swapper/012:25:020
1206991310,2cyclictest0-21swapper/010:40:500
1206991310,2cyclictest0-21swapper/008:15:120
120699130,12cyclictest0-21swapper/011:51:020
120699130,12cyclictest0-21swapper/011:15:190
120699130,12cyclictest0-21swapper/009:21:160
120699130,11cyclictest3636-21ssh09:29:260
120699130,11cyclictest29694-21pzem_power11:40:510
120699130,11cyclictest15736-21ssh12:00:400
120699130,11cyclictest0-21swapper/010:55:200
120699130,11cyclictest0-21swapper/010:55:200
298372120,2sleep00-21swapper/009:56:320
121099129,2cyclictest0-21swapper/312:35:153
121099129,2cyclictest0-21swapper/311:00:273
121099129,2cyclictest0-21swapper/311:00:273
121099129,2cyclictest0-21swapper/307:55:073
121099129,2cyclictest0-21swapper/307:50:413
121099127,3cyclictest6450-21rm11:15:373
121099122,7cyclictest0-21swapper/308:20:003
121099120,2cyclictest0-21swapper/312:00:573
120899129,2cyclictest0-21swapper/212:39:072
120899129,2cyclictest0-21swapper/210:38:372
120899129,2cyclictest0-21swapper/209:00:142
120899122,7cyclictest0-21swapper/208:00:002
120899122,6cyclictest0-21swapper/211:05:002
120899122,6cyclictest0-21swapper/211:05:002
120899122,6cyclictest0-21swapper/207:20:012
120899122,5cyclictest0-21swapper/211:00:012
120899122,5cyclictest0-21swapper/211:00:002
120899120,2cyclictest0-21swapper/211:20:122
120899120,11cyclictest0-21swapper/210:20:142
120899120,11cyclictest0-21swapper/208:00:152
120899120,11cyclictest0-21swapper/208:00:142
120799129,2cyclictest0-21swapper/110:40:181
120799129,2cyclictest0-21swapper/110:26:231
120799128,2cyclictest0-21swapper/110:30:481
120799128,2cyclictest0-21swapper/109:50:131
120799127,3cyclictest18362-21munin-node1
120799122,7cyclictest4562-21gdm-simple-gree07:14:591
120799122,7cyclictest0-21swapper/108:21:591
120799122,7cyclictest0-21swapper/107:31:011
120799122,7cyclictest0-21swapper/107:21:011
120799120,2cyclictest0-21swapper/111:41:331
120799120,2cyclictest0-21swapper/108:55:401
120799120,11cyclictest0-21swapper/112:30:251
120799120,11cyclictest0-21swapper/111:25:451
120799120,11cyclictest0-21swapper/111:15:121
120799120,11cyclictest0-21swapper/110:05:151
120799120,11cyclictest0-21swapper/109:19:321
120799120,11cyclictest0-21swapper/107:15:161
120799120,10cyclictest0-21swapper/112:26:111
120799120,10cyclictest0-21swapper/108:45:201
120799120,10cyclictest0-21swapper/107:50:411
120799120,10cyclictest0-21swapper/107:45:501
120699129,2cyclictest9048-21kworker/u8:112:35:050
120699129,2cyclictest17937-21kworker/u8:111:02:050
120699129,2cyclictest17937-21kworker/u8:111:02:040
120699129,2cyclictest0-21swapper/012:30:160
120699129,2cyclictest0-21swapper/012:22:160
120699129,2cyclictest0-21swapper/011:55:140
120699121,6cyclictest0-21swapper/012:15:000
120699120,2cyclictest0-21swapper/012:06:020
120699120,2cyclictest0-21swapper/010:36:070
120699120,2cyclictest0-21swapper/009:53:000
120699120,11cyclictest17737-21diskmemload09:46:510
120699120,11cyclictest0-21swapper/009:36:010
120699120,11cyclictest0-21swapper/009:00:130
120699120,11cyclictest0-21swapper/008:45:160
120699120,11cyclictest0-21swapper/008:30:460
120699120,11cyclictest0-21swapper/008:00:410
120699120,11cyclictest0-21swapper/008:00:400
120699120,10cyclictest0-21swapper/007:10:010
121099118,2cyclictest0-21swapper/309:01:003
121099118,2cyclictest0-21swapper/307:30:003
120899118,2cyclictest0-21swapper/211:54:372
120899118,2cyclictest0-21swapper/211:13:062
120899118,2cyclictest0-21swapper/211:13:052
120899118,2cyclictest0-21swapper/210:26:172
120899118,2cyclictest0-21swapper/209:54:292
120899118,2cyclictest0-21swapper/209:10:152
120899118,2cyclictest0-21swapper/207:35:152
120899116,3cyclictest7043-21grep11:16:042
120899116,3cyclictest0-21swapper/211:42:222
120899111,6cyclictest0-21swapper/208:51:022
120899110,9cyclictest17737-21diskmemload10:52:402
120899110,2cyclictest25647-21ssh12:11:172
120899110,10cyclictest0-21swapper/212:05:132
120799112,6cyclictest4562-21gdm-simple-gree07:59:581
120799111,8cyclictest15948-21apt-get09:05:121
120799110,9cyclictest0-21swapper/108:50:151
120799110,2cyclictest0-21swapper/109:01:471
120699118,2cyclictest12187-21ssh10:47:110
120699111,5cyclictest0-21swapper/007:30:000
120699110,6cyclictest0-21swapper/008:40:010
260472100,1sleep20-21swapper/208:10:112
121099107,2cyclictest0-21swapper/308:43:473
121099105,3cyclictest13733-21cat07:40:003
121099102,7cyclictest0-21swapper/308:08:593
121099102,5cyclictest0-21swapper/307:48:593
120899107,2cyclictest0-21swapper/211:49:252
120899107,2cyclictest0-21swapper/211:35:122
120899107,2cyclictest0-21swapper/210:45:262
120899107,2cyclictest0-21swapper/209:30:062
120899107,2cyclictest0-21swapper/209:29:062
120899107,2cyclictest0-21swapper/208:55:202
120899106,2cyclictest1724-21cut07:10:162
120899105,3cyclictest19272-21telnet11:30:132
120899102,5cyclictest0-21swapper/211:26:012
120899100,7cyclictest0-21swapper/212:31:012
120899100,2cyclictest0-21swapper/212:23:412
120899100,2cyclictest0-21swapper/210:15:292
120899100,2cyclictest0-21swapper/208:41:002
120799100,8cyclictest1643-21munin-node1
120799100,2cyclictest0-21swapper/108:05:401
120799100,2cyclictest0-21swapper/107:35:141
120699107,2cyclictest0-21swapper/008:09:110
120699105,3cyclictest21800-21turbostat08:00:000
120699105,3cyclictest16587-21awk09:05:160
12109994,3cyclictest3728-21runrttasks07:40:173
12109994,3cyclictest3728-21runrttasks07:26:433
12109994,3cyclictest274-21jbd2/sda1-807:10:133
12089996,2cyclictest0-21swapper/207:45:142
12089994,3cyclictest8268-21entropy08:45:152
12089994,3cyclictest3728-21runrttasks07:15:002
12089994,3cyclictest28560-21fschecks_time08:15:132
12089994,3cyclictest25268-21cat08:06:042
12089994,3cyclictest0-21swapper/207:31:042
12089992,6cyclictest0-21swapper/209:06:022
12089992,4cyclictest0-21swapper/208:33:022
12089990,8cyclictest0-21swapper/209:55:092
12079990,2cyclictest0-21swapper/107:40:111
12069996,2cyclictest3825-21kworker/u8:208:41:040
12069994,3cyclictest17333-21tail07:46:030
12069994,3cyclictest13906-21aten2.4-expect07:40:110
12069994,3cyclictest10128-21cpuspeed_turbos08:50:140
12069991,6cyclictest30367-21cut08:20:140
12069990,8cyclictest0-21swapper/007:35:120
12089983,3cyclictest32252-21cpu08:25:132
12069983,3cyclictest6080-21sort07:20:140
12069983,3cyclictest18036-21cut07:50:150
12069983,3cyclictest12360-21grep08:55:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional