You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 21:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Thu Nov 27, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
968211695,16sleep00-21swapper/007:08:560
955211695,16sleep20-21swapper/207:08:462
924211194,12sleep10-21swapper/107:08:211
956210384,6sleep30-21swapper/307:08:483
160052840,0sleep20-21swapper/211:25:212
25532830,2sleep317613-21diskmemload11:45:263
188662810,1sleep337-21rcuc/312:03:503
263722710,0sleep00-21swapper/011:36:210
1085992911,17cyclictest0-21swapper/211:20:132
177882240,1sleep30-21swapper/310:18:523
108599243,16cyclictest0-21swapper/212:01:042
108599230,5cyclictest0-21swapper/210:57:052
25852220,1sleep0101ktimersoftd/012:20:230
108699221,19cyclictest1541-21chrt08:30:123
108599224,2cyclictest0-21swapper/209:41:042
16122210,0sleep00-21swapper/011:10:170
108599213,2cyclictest0-21swapper/211:13:042
108599211,2cyclictest0-21swapper/209:00:102
108599210,17cyclictest0-21swapper/209:31:042
108599210,16cyclictest0-21swapper/208:08:042
1083992116,3cyclictest27691-21rm09:55:110
288372200,1sleep00-21swapper/008:15:170
108599202,17cyclictest0-21swapper/209:24:052
1085992017,2cyclictest31964-21kworker/u8:008:51:042
108599200,2cyclictest0-21swapper/210:20:112
108599200,18cyclictest0-21swapper/207:40:132
108499200,2cyclictest0-21swapper/108:05:111
108599192,2cyclictest0-21swapper/211:54:052
108599191,7cyclictest0-21swapper/209:29:042
108599191,2cyclictest0-21swapper/210:06:042
108599190,2cyclictest0-21swapper/210:25:042
108599190,2cyclictest0-21swapper/209:39:042
108599190,2cyclictest0-21swapper/208:57:042
108599190,18cyclictest0-21swapper/208:13:042
108399190,17cyclictest0-21swapper/009:50:110
108599181,2cyclictest0-21swapper/212:09:042
108599181,2cyclictest0-21swapper/209:16:042
108599181,16cyclictest0-21swapper/210:53:042
108599180,2cyclictest0-21swapper/208:27:042
108599180,2cyclictest0-21swapper/207:49:042
108599180,17cyclictest0-21swapper/208:04:042
108599180,14cyclictest0-21swapper/208:46:062
108599171,15cyclictest0-21swapper/210:34:052
108599170,4cyclictest0-21swapper/209:05:042
108599170,2cyclictest0-21swapper/210:16:042
108599170,2cyclictest0-21swapper/210:01:042
108599170,2cyclictest0-21swapper/208:39:042
108599170,2cyclictest0-21swapper/207:55:052
108599170,2cyclictest0-21swapper/207:33:052
108599170,1cyclictest0-21swapper/209:51:042
1084991712,3cyclictest0-21swapper/109:28:001
108399171,14cyclictest0-21swapper/010:30:240
108599161,2cyclictest0-21swapper/207:17:042
108599160,2cyclictest0-21swapper/211:06:012
108399161,3cyclictest0-21swapper/009:12:220
108399161,13cyclictest0-21swapper/011:05:000
108699151,3cyclictest25493-21taskset09:51:543
108699151,3cyclictest17134-21apt-get07:45:473
108699151,12cyclictest24378-21cut11:35:123
108699151,12cyclictest11177-21ssh11:55:153
108699151,12cyclictest0-21swapper/308:50:163
1086991510,3cyclictest8862-21ssh10:43:473
1086991510,3cyclictest16843-21ssh12:35:263
108699150,13cyclictest30471-21cat12:15:263
108699150,13cyclictest17613-21diskmemload11:18:383
108599151,2cyclictest29-21rcuc/212:34:042
108599150,4cyclictest0-21swapper/210:39:042
1084991512,2cyclictest9022-21taskset09:35:101
1084991511,2cyclictest17613-21diskmemload10:25:131
108499150,13cyclictest0-21swapper/112:33:331
108399151,3cyclictest25032-21python08:05:230
108399151,12cyclictest5129-21runrttasks11:41:220
108399151,12cyclictest4563-21sh10:39:400
108399150,3cyclictest0-21swapper/011:45:190
108399150,13cyclictest0-21swapper/012:35:150
108399150,13cyclictest0-21swapper/010:01:240
89012140,1sleep00-21swapper/010:43:510
108699149,3cyclictest0-21swapper/309:30:163
108699142,7cyclictest0-21swapper/309:00:013
108699142,6cyclictest0-21swapper/308:25:013
108699141,11cyclictest17613-21diskmemload10:31:313
108699140,12cyclictest9984-21diskmemload11:54:323
108699140,12cyclictest8504-21ssh10:08:573
108699140,12cyclictest17613-21diskmemload10:45:323
108699140,12cyclictest0-21swapper/311:20:173
108699140,12cyclictest0-21swapper/310:57:573
108599149,3cyclictest0-21swapper/207:40:002
108599141,2cyclictest0-21swapper/211:47:042
108599140,2cyclictest0-21swapper/207:50:042
108599140,13cyclictest0-21swapper/210:10:322
108599140,13cyclictest0-21swapper/210:10:312
108599140,12cyclictest0-21swapper/212:20:122
108599140,12cyclictest0-21swapper/208:40:122
108599140,11cyclictest0-21swapper/212:16:042
1084991411,2cyclictest0-21swapper/110:49:191
1084991411,2cyclictest0-21swapper/109:56:501
1084991411,2cyclictest0-21swapper/109:45:241
1084991410,2cyclictest23155-21perl09:15:141
108499140,2cyclictest0-21swapper/111:55:391
108499140,2cyclictest0-21swapper/109:51:201
108499140,13cyclictest0-21swapper/112:10:191
108499140,13cyclictest0-21swapper/110:40:591
108499140,12cyclictest0-21swapper/108:55:141
108399142,6cyclictest0-21swapper/012:35:010
1083991411,2cyclictest0-21swapper/012:01:190
1083991410,2cyclictest13247-21ssh11:22:410
108399140,2cyclictest0-21swapper/007:30:250
108399140,12cyclictest17613-21diskmemload10:47:050
108399140,12cyclictest17613-21diskmemload09:21:490
108399140,12cyclictest0-21swapper/010:56:130
108399140,12cyclictest0-21swapper/010:17:080
108399140,12cyclictest0-21swapper/010:06:440
108399140,12cyclictest0-21swapper/009:38:480
108399140,12cyclictest0-21swapper/009:26:350
108399140,12cyclictest0-21swapper/009:16:490
108399140,12cyclictest0-21swapper/008:25:160
223742130,2sleep30-21swapper/311:32:293
108699131,10cyclictest30902-21ssh11:06:393
1086991310,2cyclictest0-21swapper/311:25:463
1086991310,2cyclictest0-21swapper/310:53:473
1086991310,2cyclictest0-21swapper/310:26:483
1086991310,2cyclictest0-21swapper/310:03:573
1086991310,2cyclictest0-21swapper/309:45:443
1086991310,2cyclictest0-21swapper/309:17:273
1086991310,2cyclictest0-21swapper/308:15:243
108699130,2cyclictest8699-21apt-get09:35:043
108699130,2cyclictest17613-21diskmemload12:25:263
108699130,2cyclictest0-21swapper/310:35:583
108699130,2cyclictest0-21swapper/310:20:073
108699130,2cyclictest0-21swapper/309:20:183
108699130,12cyclictest29368-21ssh09:55:383
108699130,12cyclictest1640-21ssh09:26:253
108699130,12cyclictest0-21swapper/312:05:143
108699130,12cyclictest0-21swapper/311:40:123
108699130,12cyclictest0-21swapper/311:00:263
108699130,12cyclictest0-21swapper/307:25:243
108699130,11cyclictest0-21swapper/312:31:153
108599131,10cyclictest19187-21ssh12:38:562
1085991310,2cyclictest0-21swapper/207:25:252
108599130,2cyclictest0-21swapper/211:31:112
108599130,11cyclictest0-21swapper/211:39:012
108499139,2cyclictest0-21swapper/112:21:531
108499132,8cyclictest0-21swapper/109:20:011
1084991310,2cyclictest17613-21diskmemload10:55:121
1084991310,2cyclictest0-21swapper/111:41:191
1084991310,2cyclictest0-21swapper/110:22:111
1084991310,2cyclictest0-21swapper/109:40:121
1084991310,2cyclictest0-21swapper/109:00:241
1084991310,2cyclictest0-21swapper/108:15:201
108499130,2cyclictest0-21swapper/110:30:121
108499130,2cyclictest0-21swapper/108:30:141
108499130,12cyclictest17613-21diskmemload11:34:291
108499130,12cyclictest0-21swapper/111:38:421
108499130,12cyclictest0-21swapper/110:54:091
108499130,11cyclictest17613-21diskmemload09:10:061
108499130,11cyclictest0-21swapper/112:08:431
108499130,11cyclictest0-21swapper/112:00:181
108499130,11cyclictest0-21swapper/111:18:131
108399139,2cyclictest0-21swapper/012:29:570
1083991310,2cyclictest17613-21diskmemload11:30:040
1083991310,2cyclictest0-21swapper/012:17:030
1083991310,2cyclictest0-21swapper/011:25:490
1083991310,2cyclictest0-21swapper/011:05:070
1083991310,2cyclictest0-21swapper/010:12:040
1083991310,2cyclictest0-21swapper/010:12:040
1083991310,2cyclictest0-21swapper/008:50:210
1083991310,2cyclictest0-21swapper/008:45:190
1083991310,2cyclictest0-21swapper/007:10:250
108399130,2cyclictest25892-21ssh10:26:500
108399130,2cyclictest0-21swapper/012:14:290
108399130,2cyclictest0-21swapper/011:59:190
108399130,2cyclictest0-21swapper/010:53:280
108399130,12cyclictest0-21swapper/012:05:310
108399130,12cyclictest0-21swapper/009:47:320
108399130,12cyclictest0-21swapper/009:00:130
108399130,11cyclictest0-21swapper/009:30:550
271602120,2sleep20-21swapper/212:12:122
223002120,1sleep00-21swapper/008:00:120
108699127,2cyclictest19604-21ssh09:10:333
108699122,7cyclictest0-21swapper/308:44:583
108699121,7cyclictest0-21swapper/307:41:583
108699121,6cyclictest0-21swapper/307:25:003
108699120,2cyclictest17613-21diskmemload12:21:403
108699120,2cyclictest0-21swapper/312:10:113
108699120,2cyclictest0-21swapper/310:10:033
108699120,2cyclictest0-21swapper/310:10:023
108699120,2cyclictest0-21swapper/309:05:163
108699120,2cyclictest0-21swapper/309:00:173
108699120,11cyclictest0-21swapper/311:10:153
108699120,11cyclictest0-21swapper/309:41:263
108699120,11cyclictest0-21swapper/307:35:153
108699120,11cyclictest0-21swapper/307:10:193
108599129,2cyclictest0-21swapper/211:40:432
108599120,2cyclictest17613-21diskmemload11:04:172
108599120,2cyclictest0-21swapper/212:25:222
108599120,11cyclictest0-21swapper/211:15:072
108599120,11cyclictest0-21swapper/209:45:152
108599120,10cyclictest0-21swapper/210:40:382
108499129,2cyclictest0-21swapper/111:46:111
108499129,2cyclictest0-21swapper/111:29:001
108499129,2cyclictest0-21swapper/111:06:291
108499129,2cyclictest0-21swapper/111:00:111
108499129,2cyclictest0-21swapper/110:37:521
108499129,2cyclictest0-21swapper/110:02:411
108499129,2cyclictest0-21swapper/109:30:181
108499129,2cyclictest0-21swapper/109:05:101
108499127,3cyclictest17613-21diskmemload11:10:251
108499123,6cyclictest0-21swapper/107:17:551
108499122,7cyclictest0-21swapper/107:46:591
108499121,9cyclictest17613-21diskmemload12:25:061
108499120,2cyclictest0-21swapper/112:15:091
108499120,2cyclictest0-21swapper/110:12:531
108499120,2cyclictest0-21swapper/110:12:531
108499120,2cyclictest0-21swapper/107:35:011
108499120,11cyclictest0-21swapper/112:39:331
108499120,11cyclictest0-21swapper/111:50:331
108499120,11cyclictest0-21swapper/111:22:341
108499120,11cyclictest0-21swapper/110:17:241
108399129,2cyclictest0-21swapper/008:20:150
108399129,2cyclictest0-21swapper/007:50:210
108399129,2cyclictest0-21swapper/007:15:150
108399123,3cyclictest278-21jbd2/sda1-808:35:000
108399120,2cyclictest0-21swapper/010:20:050
108399120,2cyclictest0-21swapper/007:35:140
108399120,2cyclictest0-21swapper/007:20:240
108399120,11cyclictest0-21swapper/011:52:100
108399120,11cyclictest0-21swapper/011:15:120
108399120,11cyclictest0-21swapper/009:40:310
108399120,11cyclictest0-21swapper/009:05:160
108399120,11cyclictest0-21swapper/007:45:240
108399120,11cyclictest0-21swapper/007:40:130
298182110,2sleep20-21swapper/209:56:232
108699118,2cyclictest0-21swapper/307:50:183
108699118,2cyclictest0-21swapper/307:15:193
108699111,7cyclictest0-21swapper/307:31:593
108699111,5cyclictest0-21swapper/308:40:003
108699110,10cyclictest0-21swapper/307:55:123
108599118,2cyclictest0-21swapper/209:10:312
108599118,2cyclictest0-21swapper/208:20:172
108599111,7cyclictest17613-21diskmemload11:55:252
108499118,2cyclictest0-21swapper/108:00:161
108499118,2cyclictest0-21swapper/107:55:121
108499116,3cyclictest8613-21grep08:45:211
108499112,6cyclictest0-21swapper/108:24:021
108499112,6cyclictest0-21swapper/107:25:581
108499112,6cyclictest0-21swapper/107:20:021
108499110,9cyclictest0-21swapper/108:50:261
108499110,9cyclictest0-21swapper/107:40:181
108499110,9cyclictest0-21swapper/107:10:121
108499110,10cyclictest17613-21diskmemload10:05:441
108399118,2cyclictest0-21swapper/008:55:150
108399116,3cyclictest0-21swapper/008:40:140
108699107,2cyclictest0-21swapper/308:00:163
108699105,3cyclictest365-21tr08:25:153
108599100,2cyclictest0-21swapper/208:31:042
108599100,1cyclictest17613-21diskmemload10:47:572
108499101,8cyclictest5728-21apt-get08:40:101
108499100,8cyclictest19808-21latency_hist07:55:001
108499100,8cyclictest0-21swapper/108:35:091
108499100,8cyclictest0-21swapper/108:10:111
108499100,8cyclictest0-21swapper/107:30:121
108399102,6cyclictest0-21swapper/007:25:220
108399102,5cyclictest0-21swapper/007:55:010
108399100,6cyclictest0-21swapper/008:13:460
10869994,3cyclictest7773-21aten2.4_r3power08:45:153
10869994,3cyclictest26536-21hwlatdetect08:10:143
10869994,3cyclictest23932-21aten2.4_r3power08:05:113
10859996,2cyclictest0-21swapper/207:20:162
10849990,8cyclictest0-21swapper/108:25:241
10859983,3cyclictest1452-21aten2.4_r3power07:10:132
10859981,3cyclictest0-21swapper/208:15:132
10839984,3cyclictest1-21init08:35:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional