You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 19:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot8s.osadl.org (updated Mon Nov 24, 2025 12:46:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
114091620,5ptp4l0-21swapper/207:06:302
926326151,6sleep30-21swapper/307:07:563
270442590,0sleep70-21swapper/711:10:137
918525848,6sleep70-21swapper/707:06:567
114091570,5ptp4l0-21swapper/607:08:056
2120915532,7phc2sys0-21swapper/007:07:400
913524736,7sleep10-21swapper/107:06:181
939724635,7sleep40-21swapper/407:09:414
914824634,7sleep50-21swapper/507:06:305
114091460,0ptp4l8475-21ssh11:28:131
114091390,0ptp4l0-21swapper/512:05:115
114091390,0ptp4l0-21swapper/512:05:115
114091360,0ptp4l0-21swapper/012:35:170
114091360,0ptp4l0-21swapper/008:00:200
114091330,0ptp4l0-21swapper/512:10:385
114091320,3ptp4l0-21swapper/509:52:205
114091320,0ptp4l0-21swapper/511:02:245
114091320,0ptp4l0-21swapper/509:56:465
114091320,0ptp4l0-21swapper/509:13:525
114091320,0ptp4l0-21swapper/508:30:005
114091320,0ptp4l0-21swapper/410:10:414
114091310,0ptp4l0-21swapper/511:43:275
114091310,0ptp4l0-21swapper/510:17:255
114091310,0ptp4l0-21swapper/510:14:055
114091310,0ptp4l0-21swapper/509:38:075
114091310,0ptp4l0-21swapper/411:53:314
114091310,0ptp4l0-21swapper/410:22:134
114091310,0ptp4l0-21swapper/409:39:494
114091300,0ptp4l0-21swapper/707:40:137
114091300,0ptp4l0-21swapper/511:27:155
114091300,0ptp4l0-21swapper/511:18:595
114091300,0ptp4l0-21swapper/510:21:495
114091300,0ptp4l0-21swapper/509:22:555
114091300,0ptp4l0-21swapper/412:32:274
114091300,0ptp4l0-21swapper/412:29:104
114091300,0ptp4l0-21swapper/410:48:514
114091290,4ptp4l721ktimersoftd/712:07:547
114091290,4ptp4l721ktimersoftd/712:07:547
114091290,0ptp4l0-21swapper/511:39:235
114091290,0ptp4l0-21swapper/509:42:575
114091290,0ptp4l0-21swapper/509:34:265
114091290,0ptp4l0-21swapper/509:34:265
114091290,0ptp4l0-21swapper/412:18:584
114091290,0ptp4l0-21swapper/412:01:044
114091290,0ptp4l0-21swapper/411:06:564
114091290,0ptp4l0-21swapper/409:26:374
114091290,0ptp4l0-21swapper/110:06:451
114091290,0ptp4l0-21swapper/109:46:281
114091290,0ptp4l0-21swapper/012:25:530
114091290,0ptp4l0-21swapper/012:12:010
114091290,0ptp4l0-21swapper/011:02:550
114091290,0ptp4l0-21swapper/010:25:140
114091280,7ptp4l0-21swapper/409:24:294
114091280,1ptp4l14818-21ssh10:53:470
114091280,0ptp4l0-21swapper/610:03:376
114091280,0ptp4l0-21swapper/510:58:445
114091280,0ptp4l0-21swapper/508:23:135
114091280,0ptp4l0-21swapper/412:39:174
114091280,0ptp4l0-21swapper/411:35:254
114091280,0ptp4l0-21swapper/409:51:204
114091280,0ptp4l0-21swapper/311:06:353
114091280,0ptp4l0-21swapper/011:31:510
114091280,0ptp4l0-21swapper/010:30:030
114091280,0ptp4l0-21swapper/010:09:440
114091280,0ptp4l0-21swapper/009:39:410
114091270,3ptp4l0-21swapper/512:01:465
114091270,0ptp4l0-21swapper/511:05:505
114091270,0ptp4l0-21swapper/510:51:465
114091270,0ptp4l0-21swapper/510:07:195
114091270,0ptp4l0-21swapper/411:13:034
114091270,0ptp4l0-21swapper/409:45:314
114091270,0ptp4l0-21swapper/012:07:500
114091270,0ptp4l0-21swapper/012:07:500
114091270,0ptp4l0-21swapper/011:57:230
114091270,0ptp4l0-21swapper/011:38:410
114091270,0ptp4l0-21swapper/009:55:310
114091270,0ptp4l0-21swapper/009:27:400
114091270,0ptp4l0-21swapper/009:15:200
114091260,6ptp4l0-21swapper/408:54:314
114091260,0ptp4l0-21swapper/512:27:055
114091260,0ptp4l0-21swapper/512:23:175
114091260,0ptp4l0-21swapper/510:29:115
114091260,0ptp4l0-21swapper/411:18:184
114091260,0ptp4l0-21swapper/410:17:224
114091260,0ptp4l0-21swapper/407:24:364
114091260,0ptp4l0-21swapper/407:12:484
114091260,0ptp4l0-21swapper/312:08:563
114091260,0ptp4l0-21swapper/312:08:563
114091260,0ptp4l0-21swapper/311:05:003
114091260,0ptp4l0-21swapper/012:19:060
114091260,0ptp4l0-21swapper/011:42:410
114091260,0ptp4l0-21swapper/007:13:500
114091250,3ptp4l0-21swapper/507:10:365
114091250,1ptp4l28492-21munin-run07:50:005
114091250,1ptp4l14321-21users07:15:200
114091250,1ptp4l12505-21users12:15:195
114091250,0ptp4l0-21swapper/512:37:375
114091250,0ptp4l0-21swapper/511:59:345
114091250,0ptp4l0-21swapper/510:46:295
114091250,0ptp4l0-21swapper/510:40:405
114091250,0ptp4l0-21swapper/510:00:185
114091250,0ptp4l0-21swapper/509:49:515
114091250,0ptp4l0-21swapper/508:16:305
114091250,0ptp4l0-21swapper/412:20:594
114091250,0ptp4l0-21swapper/412:11:124
114091250,0ptp4l0-21swapper/411:58:334
114091250,0ptp4l0-21swapper/410:55:184
114091250,0ptp4l0-21swapper/110:30:171
114091250,0ptp4l0-21swapper/109:20:181
114091250,0ptp4l0-21swapper/107:45:161
114091250,0ptp4l0-21swapper/011:45:070
114091250,0ptp4l0-21swapper/011:29:410
114091250,0ptp4l0-21swapper/010:55:130
114091250,0ptp4l0-21swapper/007:25:200
114091240,3ptp4l0-21swapper/511:20:095
114091240,3ptp4l0-21swapper/011:50:580
114091240,2ptp4l0-21swapper/507:27:195
114091240,2ptp4l0-21swapper/408:18:014
114091240,1ptp4l6202-21cat09:15:201
114091240,1ptp4l3578-21expr08:05:120
114091240,1ptp4l29594-21strings09:00:161
114091240,1ptp4l29128-21df07:50:121
114091240,1ptp4l28490-21grep11:55:131
114091240,1ptp4l26685-21fw_forwarded_lo08:55:131
114091240,1ptp4l25-21ksoftirqd/110:15:171
114091240,1ptp4l12903-21smartctl09:25:155
114091240,1ptp4l11231-21/usr/sbin/munin10:05:183
114091240,1ptp4l1049-21hddtemp_smartct10:35:141
114091240,0ptp4l31902-21strings09:05:185
114091240,0ptp4l0-21swapper/711:05:127
114091240,0ptp4l0-21swapper/510:35:035
114091240,0ptp4l0-21swapper/510:33:365
114091240,0ptp4l0-21swapper/508:45:155
114091240,0ptp4l0-21swapper/508:41:305
114091240,0ptp4l0-21swapper/507:15:015
114091240,0ptp4l0-21swapper/410:44:584
114091240,0ptp4l0-21swapper/408:05:264
114091240,0ptp4l0-21swapper/408:03:164
114091240,0ptp4l0-21swapper/112:30:161
114091240,0ptp4l0-21swapper/112:20:321
114091240,0ptp4l0-21swapper/110:00:171
114091240,0ptp4l0-21swapper/010:48:280
114091240,0ptp4l0-21swapper/010:01:390
114091240,0ptp4l0-21swapper/008:43:290
114091240,0ptp4l0-21swapper/008:14:440
114091230,1ptp4l8001-21systemd-cgroups08:14:591
114091230,1ptp4l28321-21timerandwakeup11:10:225
114091230,1ptp4l25562-21latency_hist12:35:015
114091230,1ptp4l17208-21/usr/sbin/munin08:35:181
114091230,1ptp4l11245-21ssh09:22:290
114091230,0ptp4l23060-21ssh09:38:461
114091230,0ptp4l22622-21irqstats07:35:165
114091230,0ptp4l0-21swapper/710:05:137
114091230,0ptp4l0-21swapper/509:19:505
114091230,0ptp4l0-21swapper/509:00:155
114091230,0ptp4l0-21swapper/508:55:135
114091230,0ptp4l0-21swapper/508:50:145
114091230,0ptp4l0-21swapper/508:11:365
114091230,0ptp4l0-21swapper/508:05:175
114091230,0ptp4l0-21swapper/507:50:065
114091230,0ptp4l0-21swapper/507:32:545
114091230,0ptp4l0-21swapper/412:05:354
114091230,0ptp4l0-21swapper/412:05:354
114091230,0ptp4l0-21swapper/411:45:164
114091230,0ptp4l0-21swapper/411:25:214
114091230,0ptp4l0-21swapper/410:30:444
114091230,0ptp4l0-21swapper/410:05:204
114091230,0ptp4l0-21swapper/409:55:204
114091230,0ptp4l0-21swapper/409:10:154
114091230,0ptp4l0-21swapper/408:40:164
114091230,0ptp4l0-21swapper/408:31:214
114091230,0ptp4l0-21swapper/408:20:214
114091230,0ptp4l0-21swapper/408:10:124
114091230,0ptp4l0-21swapper/407:55:184
114091230,0ptp4l0-21swapper/312:33:273
114091230,0ptp4l0-21swapper/310:04:433
114091230,0ptp4l0-21swapper/112:10:221
114091230,0ptp4l0-21swapper/111:50:131
114091230,0ptp4l0-21swapper/111:30:121
114091230,0ptp4l0-21swapper/111:13:591
114091230,0ptp4l0-21swapper/111:00:211
114091230,0ptp4l0-21swapper/110:45:151
114091230,0ptp4l0-21swapper/110:25:191
114091230,0ptp4l0-21swapper/110:10:211
114091230,0ptp4l0-21swapper/109:51:241
114091230,0ptp4l0-21swapper/109:44:001
114091230,0ptp4l0-21swapper/109:30:111
114091230,0ptp4l0-21swapper/109:30:111
114091230,0ptp4l0-21swapper/109:25:141
114091230,0ptp4l0-21swapper/109:10:231
114091230,0ptp4l0-21swapper/109:09:591
114091230,0ptp4l0-21swapper/108:40:241
114091230,0ptp4l0-21swapper/108:25:141
114091230,0ptp4l0-21swapper/108:10:151
114091230,0ptp4l0-21swapper/108:05:211
114091230,0ptp4l0-21swapper/108:00:181
114091230,0ptp4l0-21swapper/107:15:181
114091230,0ptp4l0-21swapper/107:10:121
114091230,0ptp4l0-21swapper/012:20:110
114091230,0ptp4l0-21swapper/012:00:180
114091230,0ptp4l0-21swapper/011:20:160
114091230,0ptp4l0-21swapper/011:15:550
114091230,0ptp4l0-21swapper/010:40:210
114091230,0ptp4l0-21swapper/010:20:160
114091230,0ptp4l0-21swapper/008:15:160
114091230,0ptp4l0-21swapper/007:55:160
114091230,0ptp4l0-21swapper/007:53:070
114091230,0ptp4l0-21swapper/007:21:320
114091220,1ptp4l15694-21memory08:30:161
114091220,1ptp4l13658-21ssh10:50:441
114091220,0ptp4l469-21diskmemload12:38:471
114091220,0ptp4l0-21swapper/710:49:137
114091220,0ptp4l0-21swapper/710:04:557
114091220,0ptp4l0-21swapper/707:30:177
114091220,0ptp4l0-21swapper/610:57:036
114091220,0ptp4l0-21swapper/610:17:286
114091220,0ptp4l0-21swapper/511:50:035
114091220,0ptp4l0-21swapper/511:48:595
114091220,0ptp4l0-21swapper/511:30:155
114091220,0ptp4l0-21swapper/508:35:135
114091220,0ptp4l0-21swapper/508:25:115
114091220,0ptp4l0-21swapper/508:00:165
114091220,0ptp4l0-21swapper/507:44:325
114091220,0ptp4l0-21swapper/507:20:115
114091220,0ptp4l0-21swapper/411:44:024
114091220,0ptp4l0-21swapper/411:22:264
114091220,0ptp4l0-21swapper/411:04:474
114091220,0ptp4l0-21swapper/410:25:154
114091220,0ptp4l0-21swapper/409:40:214
114091220,0ptp4l0-21swapper/407:25:164
114091220,0ptp4l0-21swapper/407:15:214
114091220,0ptp4l0-21swapper/307:40:163
114091220,0ptp4l0-21swapper/307:31:223
114091220,0ptp4l0-21swapper/210:49:192
114091220,0ptp4l0-21swapper/210:11:402
114091220,0ptp4l0-21swapper/209:30:182
114091220,0ptp4l0-21swapper/209:30:182
114091220,0ptp4l0-21swapper/209:28:552
114091220,0ptp4l0-21swapper/207:30:112
114091220,0ptp4l0-21swapper/112:15:121
114091220,0ptp4l0-21swapper/112:05:131
114091220,0ptp4l0-21swapper/112:05:131
114091220,0ptp4l0-21swapper/112:00:101
114091220,0ptp4l0-21swapper/111:45:011
114091220,0ptp4l0-21swapper/111:40:191
114091220,0ptp4l0-21swapper/111:37:281
114091220,0ptp4l0-21swapper/111:20:121
114091220,0ptp4l0-21swapper/111:16:571
114091220,0ptp4l0-21swapper/111:05:571
114091220,0ptp4l0-21swapper/110:58:411
114091220,0ptp4l0-21swapper/110:41:151
114091220,0ptp4l0-21swapper/110:22:181
114091220,0ptp4l0-21swapper/109:55:061
114091220,0ptp4l0-21swapper/108:50:111
114091220,0ptp4l0-21swapper/108:45:131
114091220,0ptp4l0-21swapper/107:35:121
114091220,0ptp4l0-21swapper/107:25:141
114091220,0ptp4l0-21swapper/107:20:121
114091220,0ptp4l0-21swapper/012:31:490
114091220,0ptp4l0-21swapper/011:11:470
114091220,0ptp4l0-21swapper/011:07:170
114091220,0ptp4l0-21swapper/010:17:530
114091220,0ptp4l0-21swapper/009:50:150
114091220,0ptp4l0-21swapper/009:40:160
114091220,0ptp4l0-21swapper/009:30:030
114091220,0ptp4l0-21swapper/009:30:020
114091220,0ptp4l0-21swapper/009:10:130
114091220,0ptp4l0-21swapper/008:55:200
114091220,0ptp4l0-21swapper/008:49:320
114091220,0ptp4l0-21swapper/008:29:540
114091220,0ptp4l0-21swapper/007:45:010
114091210,0ptp4l0-21swapper/410:38:144
114091210,0ptp4l0-21swapper/410:00:134
114091210,0ptp4l0-21swapper/409:31:034
114091210,0ptp4l0-21swapper/409:31:034
114091210,0ptp4l0-21swapper/409:15:054
114091210,0ptp4l0-21swapper/407:41:204
114091210,0ptp4l0-21swapper/407:37:524
114091210,0ptp4l0-21swapper/212:24:072
114091210,0ptp4l0-21swapper/209:19:222
114091210,0ptp4l0-21swapper/208:50:162
114091210,0ptp4l0-21swapper/208:45:002
114091210,0ptp4l0-21swapper/112:25:011
114091210,0ptp4l0-21swapper/108:20:171
114091210,0ptp4l0-21swapper/107:30:141
114091210,0ptp4l0-21swapper/010:38:090
114091210,0ptp4l0-21swapper/010:14:460
114091210,0ptp4l0-21swapper/009:48:180
114091210,0ptp4l0-21swapper/008:50:170
114091210,0ptp4l0-21swapper/008:31:100
114091210,0ptp4l0-21swapper/007:32:440
114091200,0ptp4l0-21swapper/712:33:057
114091200,0ptp4l0-21swapper/711:36:047
114091200,0ptp4l0-21swapper/612:24:056
114091200,0ptp4l0-21swapper/610:49:206
114091200,0ptp4l0-21swapper/411:30:284
114091200,0ptp4l0-21swapper/410:54:034
114091200,0ptp4l0-21swapper/409:08:444
114091200,0ptp4l0-21swapper/310:49:153
114091200,0ptp4l0-21swapper/211:58:552
114091200,0ptp4l0-21swapper/211:21:172
114091200,0ptp4l0-21swapper/210:22:272
114091200,0ptp4l0-21swapper/209:50:462
114091200,0ptp4l0-21swapper/107:42:531
114091200,0ptp4l0-21swapper/009:03:230
114091190,0ptp4l0-21swapper/711:45:237
114091190,0ptp4l0-21swapper/507:55:445
114091190,0ptp4l0-21swapper/210:17:272
114091190,0ptp4l0-21swapper/209:49:202
114091190,0ptp4l0-21swapper/107:56:201
114091180,0ptp4l0-21swapper/209:44:442
114091170,1ptp4l469-21diskmemload11:07:232
114091170,0ptp4l0-21swapper/711:04:537
114091170,0ptp4l0-21swapper/708:13:257
114091170,0ptp4l0-21swapper/609:19:226
114091170,0ptp4l0-21swapper/311:36:043
114091170,0ptp4l0-21swapper/210:57:062
114091170,0ptp4l0-21swapper/209:22:442
114091160,1ptp4l41-21ksoftirqd/311:45:243
114091160,0ptp4l0-21swapper/611:21:166
114091160,0ptp4l0-21swapper/610:11:416
114091160,0ptp4l0-21swapper/609:30:186
114091160,0ptp4l0-21swapper/609:30:186
114091160,0ptp4l0-21swapper/609:22:396
114091160,0ptp4l0-21swapper/408:29:554
114091160,0ptp4l0-21swapper/407:54:424
114091160,0ptp4l0-21swapper/211:10:252
114091160,0ptp4l0-21swapper/008:20:190
114091150,0ptp4l0-21swapper/611:52:146
114091150,0ptp4l0-21swapper/609:50:476
114091150,0ptp4l0-21swapper/609:42:586
114091150,0ptp4l0-21swapper/607:48:456
114091150,0ptp4l0-21swapper/607:40:416
114091150,0ptp4l0-21swapper/607:10:036
114091150,0ptp4l0-21swapper/409:02:124
114091150,0ptp4l0-21swapper/408:55:274
114091150,0ptp4l0-21swapper/408:46:554
114091150,0ptp4l0-21swapper/408:36:174
114091150,0ptp4l0-21swapper/407:45:274
114091150,0ptp4l0-21swapper/407:32:254
114091150,0ptp4l0-21swapper/308:12:553
114091150,0ptp4l0-21swapper/210:01:232
114091150,0ptp4l0-21swapper/207:14:132
114091150,0ptp4l0-21swapper/009:07:530
114091150,0ptp4l0-21swapper/007:40:430
114091150,0ptp4l0-21swapper/007:35:460
114091140,0ptp4l0-21swapper/708:40:517
114091140,0ptp4l0-21swapper/707:10:067
114091140,0ptp4l0-21swapper/611:58:546
114091140,0ptp4l0-21swapper/609:00:456
114091140,0ptp4l0-21swapper/608:45:406
114091140,0ptp4l0-21swapper/608:44:596
114091140,0ptp4l0-21swapper/608:14:016
114091140,0ptp4l0-21swapper/607:53:236
114091140,0ptp4l0-21swapper/607:39:386
114091140,0ptp4l0-21swapper/607:28:126
114091140,0ptp4l0-21swapper/308:40:503
114091140,0ptp4l0-21swapper/212:27:212
114091140,0ptp4l0-21swapper/212:10:382
114091140,0ptp4l0-21swapper/211:52:142
114091140,0ptp4l0-21swapper/211:41:032
114091140,0ptp4l0-21swapper/209:00:462
114091140,0ptp4l0-21swapper/208:43:142
114091140,0ptp4l0-21swapper/208:30:422
114091140,0ptp4l0-21swapper/208:17:582
114091140,0ptp4l0-21swapper/208:13:592
114091140,0ptp4l0-21swapper/207:53:222
114091140,0ptp4l0-21swapper/207:48:452
114091140,0ptp4l0-21swapper/207:40:412
114091140,0ptp4l0-21swapper/207:39:362
114091140,0ptp4l0-21swapper/207:28:132
114091140,0ptp4l0-21swapper/008:36:160
9738991311,1cyclictest1084-21snmpd10:26:046
973899130,12cyclictest0-21swapper/610:07:076
971099120,0cyclictest0-21swapper/210:26:042
974599110,1cyclictest25952-21ssh09:41:197
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional