You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 15:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Tue Dec 02, 2025 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22888211997,17sleep00-21swapper/007:05:470
23151211392,16sleep30-21swapper/307:09:113
23092211294,12sleep20-21swapper/207:08:252
2141729887,6sleep10-21swapper/107:05:041
243762660,0sleep00-21swapper/009:27:180
265022360,0sleep10-21swapper/112:22:561
246482290,5sleep22324699cyclictest09:27:442
2324499251,2cyclictest7334-21diskmemload11:45:120
2324499250,2cyclictest0-21swapper/011:00:130
2324699221,19cyclictest0-21swapper/208:45:142
2324599220,3cyclictest0-21swapper/110:29:551
2324499220,2cyclictest0-21swapper/011:20:110
23245992111,2cyclictest0-21swapper/110:57:191
23245992110,2cyclictest0-21swapper/111:50:191
2324499211,6cyclictest0-21swapper/012:15:000
247512200,1sleep10-21swapper/110:36:411
23247992017,2cyclictest24474-21kworker/u8:009:28:053
23247992017,2cyclictest1539-21kworker/u8:011:23:043
23247992017,2cyclictest1178-21kworker/u8:112:32:043
23247992016,3cyclictest7281-21kworker/u8:012:38:053
2324799201,2cyclictest0-21swapper/311:50:053
2324799200,2cyclictest7334-21diskmemload09:12:013
2324699200,2cyclictest0-21swapper/211:20:112
2324599208,3cyclictest22028-21df08:25:131
23245992010,3cyclictest0-21swapper/111:06:451
2324599200,2cyclictest0-21swapper/112:05:191
2324599200,2cyclictest0-21swapper/109:50:121
2324599200,10cyclictest0-21swapper/109:31:361
23247991916,2cyclictest30713-21kworker/u8:111:48:043
23247991916,2cyclictest30449-21kworker/u8:010:32:013
23247991916,2cyclictest15255-21kworker/u8:210:27:043
2324599199,2cyclictest0-21swapper/108:20:201
2324599198,3cyclictest28169-21telnet12:25:131
23245991910,2cyclictest0-21swapper/110:20:181
2324599190,11cyclictest0-21swapper/111:25:011
2324499190,11cyclictest0-21swapper/010:25:130
23247991815,2cyclictest30713-21kworker/u8:111:44:053
23247991815,2cyclictest2096-21kworker/u8:012:04:043
23247991815,2cyclictest19436-21kworker/u8:109:23:043
2324799180,2cyclictest6815-21kworker/u8:211:29:043
2324599184,7cyclictest5911-21gdm-simple-gree11:56:581
2324599181,7cyclictest0-21swapper/111:45:021
2324599180,2cyclictest7334-21diskmemload11:20:491
2324599180,2cyclictest0-21swapper/112:32:081
2324599180,12cyclictest0-21swapper/112:10:201
2324599180,11cyclictest7334-21diskmemload12:36:071
2324799172,13cyclictest0-21swapper/309:09:013
23247991714,2cyclictest31753-21kworker/u8:210:55:043
23247991714,2cyclictest20366-21kworker/u8:110:04:053
2324699171,14cyclictest1109-21sensors11:55:252
306362160,1sleep20-21swapper/210:09:172
23247991613,2cyclictest9078-21kworker/u8:208:12:013
23247991613,2cyclictest9078-21kworker/u8:208:07:043
23247991613,2cyclictest8124-21kworker/u8:309:44:043
23247991613,2cyclictest30713-21kworker/u8:111:01:043
23247991613,2cyclictest30449-21kworker/u8:010:11:043
23247991613,2cyclictest20810-21kworker/u8:110:36:013
23247991613,2cyclictest20366-21kworker/u8:110:06:043
23247991613,2cyclictest15880-21kworker/u8:310:47:043
23247991612,2cyclictest15880-21kworker/u8:310:41:043
2324799160,14cyclictest0-21swapper/309:40:003
2324699161,3cyclictest0-21swapper/208:15:132
2324599162,6cyclictest0-21swapper/108:13:011
23247991512,2cyclictest9078-21kworker/u8:208:21:043
23247991512,2cyclictest9078-21kworker/u8:208:16:043
23247991512,2cyclictest9078-21kworker/u8:208:03:043
23247991512,2cyclictest326-21kworker/u8:009:45:043
23247991512,2cyclictest31765-21kworker/u8:008:51:043
23247991512,2cyclictest25760-21kworker/u8:208:39:043
23247991512,2cyclictest2096-21kworker/u8:012:21:043
23247991512,2cyclictest17704-21kworker/u8:212:17:043
23247991512,2cyclictest15040-21kworker/u8:209:59:043
23247991512,2cyclictest12984-21kworker/u8:112:09:043
23247991512,2cyclictest11534-21kworker/u8:011:36:053
2324699151,12cyclictest6813-21ssh10:17:512
2324699151,12cyclictest26367-21iostat_ios08:35:172
2324699151,12cyclictest26043-21apt-get09:30:072
2324699150,13cyclictest0-21swapper/212:01:502
2324699150,13cyclictest0-21swapper/209:54:372
2324699150,13cyclictest0-21swapper/209:42:452
23245991510,3cyclictest18518-21ntp_states08:15:161
23245991510,3cyclictest0-21swapper/112:19:511
2324599150,13cyclictest0-21swapper/109:10:201
2324499158,5cyclictest0-21swapper/009:00:120
2324499150,13cyclictest0-21swapper/012:00:160
2324499150,13cyclictest0-21swapper/011:45:000
2324499150,13cyclictest0-21swapper/010:20:260
2324799149,3cyclictest0-21swapper/307:50:203
23247991411,2cyclictest9078-21kworker/u8:207:57:043
23247991411,2cyclictest30449-21kworker/u8:010:23:043
23247991411,2cyclictest25441-21kworker/u8:209:32:013
23247991411,2cyclictest23118-21kworker/u8:107:12:053
23247991411,2cyclictest20366-21kworker/u8:110:15:043
23247991411,2cyclictest1270-21kworker/u8:207:36:013
2324799140,3cyclictest3440-21munin-node3
2324799140,2cyclictest0-21swapper/311:10:193
2324799140,2cyclictest0-21swapper/309:53:043
2324799140,13cyclictest0-21swapper/311:05:103
2324799140,12cyclictest0-21swapper/311:58:043
2324799140,10cyclictest0-21swapper/308:41:043
23246991411,2cyclictest7334-21diskmemload10:55:352
23246991411,2cyclictest0-21swapper/212:23:052
23246991411,2cyclictest0-21swapper/211:53:152
23246991411,2cyclictest0-21swapper/210:38:152
2324699140,12cyclictest0-21swapper/212:25:162
2324699140,12cyclictest0-21swapper/211:18:472
2324699140,12cyclictest0-21swapper/210:30:202
2324599149,3cyclictest0-21swapper/110:49:491
2324599142,6cyclictest0-21swapper/110:20:001
2324599142,6cyclictest0-21swapper/107:50:001
2324599141,7cyclictest0-21swapper/108:55:001
23245991411,2cyclictest0-21swapper/111:40:191
2324599141,11cyclictest5129-21runrttasks09:20:521
2324599140,3cyclictest0-21swapper/108:50:221
2324599140,12cyclictest7957-21sed09:45:011
2324599140,12cyclictest7334-21diskmemload11:10:491
2324599140,12cyclictest7334-21diskmemload10:43:571
2324599140,12cyclictest0-21swapper/110:10:181
2324499149,3cyclictest22623-21aten2.4-expect10:35:140
2324499149,3cyclictest19597-21ssh10:30:530
2324499149,3cyclictest0-21swapper/012:17:410
23244991411,2cyclictest0-21swapper/011:53:040
23244991411,2cyclictest0-21swapper/011:12:340
23244991411,2cyclictest0-21swapper/010:05:550
2324499140,3cyclictest0-21swapper/009:40:400
2324499140,2cyclictest0-21swapper/012:34:040
2324499140,2cyclictest0-21swapper/010:42:540
2324499140,13cyclictest0-21swapper/010:15:240
2324499140,12cyclictest7334-21diskmemload09:50:080
2324499140,12cyclictest25561-21ssh10:03:340
2324499140,12cyclictest0-21swapper/011:56:160
2324499140,12cyclictest0-21swapper/011:32:120
2324499140,12cyclictest0-21swapper/009:35:180
2324499140,12cyclictest0-21swapper/007:50:220
23247991310,2cyclictest31765-21kworker/u8:008:56:043
23247991310,2cyclictest29537-21kworker/u8:107:26:043
23247991310,2cyclictest21698-21kworker/u8:008:30:043
23247991310,2cyclictest21698-21kworker/u8:008:29:043
23247991310,2cyclictest15324-21ssh09:17:493
23247991310,2cyclictest0-21swapper/312:10:283
23247991310,2cyclictest0-21swapper/311:15:193
23247991310,2cyclictest0-21swapper/310:53:203
23247991310,2cyclictest0-21swapper/307:20:243
2324799130,2cyclictest0-21swapper/312:26:243
2324699131,10cyclictest7334-21diskmemload11:30:302
23246991310,2cyclictest7334-21diskmemload10:23:162
23246991310,2cyclictest0-21swapper/212:16:372
23246991310,2cyclictest0-21swapper/212:14:352
23246991310,2cyclictest0-21swapper/211:00:502
23246991310,2cyclictest0-21swapper/210:47:452
23246991310,2cyclictest0-21swapper/209:12:452
2324699130,2cyclictest7334-21diskmemload09:38:552
2324699130,2cyclictest0-21swapper/210:29:152
2324699130,2cyclictest0-21swapper/209:58:502
2324699130,2cyclictest0-21swapper/209:46:352
2324699130,2cyclictest0-21swapper/209:20:112
2324699130,12cyclictest0-21swapper/211:45:352
2324699130,12cyclictest0-21swapper/211:28:452
2324699130,12cyclictest0-21swapper/211:11:092
2324699130,12cyclictest0-21swapper/211:06:552
2324699130,12cyclictest0-21swapper/210:54:152
2324699130,12cyclictest0-21swapper/210:42:052
2324699130,11cyclictest0-21swapper/212:30:202
2324699130,11cyclictest0-21swapper/207:20:042
2324599138,3cyclictest5129-21runrttasks11:38:251
2324599131,3cyclictest5147-21latency_hist07:45:001
23245991310,2cyclictest7334-21diskmemload09:48:281
23245991310,2cyclictest0-21swapper/111:01:391
2324599130,2cyclictest0-21swapper/110:04:291
2324599130,12cyclictest0-21swapper/110:30:181
2324599130,11cyclictest0-21swapper/110:54:071
2324599130,11cyclictest0-21swapper/109:55:521
2324499136,4cyclictest8308-21ssh09:45:130
23244991310,2cyclictest7334-21diskmemload09:16:500
23244991310,2cyclictest7334-21diskmemload09:13:140
23244991310,2cyclictest0-21swapper/012:05:340
23244991310,2cyclictest0-21swapper/011:38:250
23244991310,2cyclictest0-21swapper/009:55:080
23244991310,2cyclictest0-21swapper/008:30:140
2324499130,2cyclictest0-21swapper/012:23:170
2324499130,12cyclictest0-21swapper/012:35:240
2324499130,12cyclictest0-21swapper/011:28:440
2324499130,12cyclictest0-21swapper/010:59:180
2324499130,12cyclictest0-21swapper/009:21:480
2324499130,12cyclictest0-21swapper/007:55:230
2324499130,11cyclictest7334-21diskmemload11:19:440
2324799129,2cyclictest0-21swapper/307:30:243
2324799120,11cyclictest0-21swapper/311:31:463
2324799120,11cyclictest0-21swapper/308:45:253
2324699129,2cyclictest11899-21df08:00:132
2324699129,2cyclictest0-21swapper/212:06:052
2324699129,2cyclictest0-21swapper/210:11:092
2324699129,2cyclictest0-21swapper/210:00:112
2324699129,2cyclictest0-21swapper/209:15:302
2324699129,2cyclictest0-21swapper/208:55:172
2324699129,2cyclictest0-21swapper/208:20:192
2324699122,6cyclictest0-21swapper/208:35:002
2324699120,2cyclictest0-21swapper/211:40:022
2324699120,2cyclictest0-21swapper/211:35:072
2324699120,2cyclictest0-21swapper/209:00:132
2324699120,10cyclictest1178-21kworker/u8:112:35:042
2324599129,2cyclictest0-21swapper/111:30:321
2324599129,2cyclictest0-21swapper/111:17:261
2324599129,2cyclictest0-21swapper/109:18:011
2324599129,2cyclictest0-21swapper/109:05:191
2324599129,2cyclictest0-21swapper/107:10:191
2324599127,3cyclictest29762-21munin-node1
2324599127,3cyclictest0-21swapper/109:00:141
2324599127,3cyclictest0-21swapper/107:25:251
2324599122,6cyclictest0-21swapper/108:10:001
2324599121,9cyclictest9415-21munin-node1
2324599120,2cyclictest0-21swapper/110:05:581
2324599120,2cyclictest0-21swapper/109:35:091
2324599120,2cyclictest0-21swapper/109:28:341
2324599120,11cyclictest0-21swapper/112:02:501
2324599120,11cyclictest0-21swapper/107:50:191
2324599120,11cyclictest0-21swapper/107:30:221
2324599120,10cyclictest0-21swapper/108:00:181
2324499129,2cyclictest7334-21diskmemload10:45:140
2324499129,2cyclictest0-21swapper/012:25:080
2324499129,2cyclictest0-21swapper/010:51:420
2324499129,2cyclictest0-21swapper/010:10:320
2324499129,2cyclictest0-21swapper/008:45:180
2324499129,2cyclictest0-21swapper/007:35:190
2324499129,2cyclictest0-21swapper/007:25:130
2324499122,8cyclictest0-21swapper/008:01:580
2324499122,7cyclictest0-21swapper/007:23:010
2324499122,6cyclictest0-21swapper/008:25:000
2324499122,6cyclictest0-21swapper/008:05:000
2324499120,2cyclictest0-21swapper/007:15:120
2324499120,11cyclictest0-21swapper/009:32:460
2324499120,11cyclictest0-21swapper/008:35:130
2324499120,11cyclictest0-21swapper/008:25:130
2324499120,11cyclictest0-21swapper/008:15:200
52782110,2sleep20-21swapper/207:45:112
2324799118,2cyclictest1270-21kworker/u8:207:40:043
2324699112,6cyclictest0-21swapper/209:09:292
2324699112,6cyclictest0-21swapper/208:09:582
2324699112,5cyclictest0-21swapper/208:55:002
2324699110,10cyclictest0-21swapper/207:40:242
2324699110,10cyclictest0-21swapper/207:25:132
2324599110,9cyclictest0-21swapper/108:30:121
2324599110,9cyclictest0-21swapper/107:35:151
2324599110,9cyclictest0-21swapper/107:20:261
2324599110,9cyclictest0-21swapper/107:15:111
2324599110,10cyclictest0-21swapper/108:40:201
2324599110,10cyclictest0-21swapper/108:35:231
2324499118,2cyclictest0-21swapper/011:07:100
2324499112,7cyclictest0-21swapper/008:10:250
2324499111,7cyclictest0-21swapper/007:43:580
2324499110,3cyclictest7183-21munin-run07:50:000
281142100,2sleep20-21swapper/208:40:162
2324799102,7cyclictest0-21swapper/307:16:583
2324799101,6cyclictest0-21swapper/307:45:233
2324699107,2cyclictest0-21swapper/208:25:262
2324699107,2cyclictest0-21swapper/207:14:192
2324699102,6cyclictest0-21swapper/207:19:082
2324499105,3cyclictest32580-21cat08:50:180
2324499102,6cyclictest0-21swapper/007:34:100
2324499101,7cyclictest2273-21ps08:55:210
232469994,3cyclictest5129-21runrttasks07:59:012
232469994,3cyclictest1164-21sshd07:35:102
232469990,2cyclictest0-21swapper/208:13:252
232449996,2cyclictest0-21swapper/009:05:170
232449994,3cyclictest23602-21aten2.4_r3power07:10:120
232449990,3cyclictest0-21swapper/008:40:050
232469983,3cyclictest8083-21uname07:50:142
232469981,5cyclictest31644-21aten2.4-expect07:30:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional