You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-16 - 09:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot8s.osadl.org (updated Thu Apr 16, 2026 00:46:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1373421100,3sleep341-21ksoftirqd/319:05:143
291022640,0sleep40-21swapper/422:25:174
111391630,6ptp4l0-21swapper/019:07:590
111391600,6ptp4l0-21swapper/119:09:401
1508325949,6sleep20-21swapper/219:07:232
1501125949,6sleep40-21swapper/419:06:284
1338725735,6sleep70-21swapper/719:05:117
253482560,0sleep00-21swapper/022:20:160
1338625533,7sleep60-21swapper/619:05:106
53182540,0sleep10-21swapper/122:38:431
1497424736,7sleep50-21swapper/519:05:585
111391360,0ptp4l0-21swapper/000:00:110
111391330,0ptp4l30142-21diskstats20:50:110
111391310,0ptp4l0-21swapper/422:11:184
111391310,0ptp4l0-21swapper/019:35:220
111391300,0ptp4l0-21swapper/520:30:185
111391300,0ptp4l0-21swapper/519:50:135
111391300,0ptp4l0-21swapper/023:05:390
111391300,0ptp4l0-21swapper/021:42:560
111391290,0ptp4l0-21swapper/523:26:265
111391290,0ptp4l0-21swapper/522:35:205
111391290,0ptp4l0-21swapper/521:11:565
111391290,0ptp4l0-21swapper/500:27:345
111391290,0ptp4l0-21swapper/419:15:134
111391290,0ptp4l0-21swapper/023:58:330
111391290,0ptp4l0-21swapper/023:13:360
111391280,2ptp4l0-21swapper/421:54:234
111391280,1ptp4l2516-21/usr/sbin/munin21:00:140
111391280,1ptp4l1028-21sh00:04:285
111391280,0ptp4l6318-21diskmemload23:18:220
111391280,0ptp4l0-21swapper/521:16:215
111391280,0ptp4l0-21swapper/022:57:320
111391280,0ptp4l0-21swapper/022:49:540
111391280,0ptp4l0-21swapper/022:40:020
111391280,0ptp4l0-21swapper/022:36:230
111391280,0ptp4l0-21swapper/022:09:520
111391280,0ptp4l0-21swapper/021:58:460
111391280,0ptp4l0-21swapper/019:25:110
111391270,4ptp4l0-21swapper/023:27:570
111391270,2ptp4l0-21swapper/023:33:240
111391270,0ptp4l0-21swapper/500:30:165
111391270,0ptp4l0-21swapper/423:57:014
111391270,0ptp4l0-21swapper/423:51:224
111391270,0ptp4l0-21swapper/423:42:074
111391270,0ptp4l0-21swapper/423:36:354
111391270,0ptp4l0-21swapper/422:48:224
111391270,0ptp4l0-21swapper/422:21:214
111391270,0ptp4l0-21swapper/421:16:294
111391270,0ptp4l0-21swapper/400:25:034
111391270,0ptp4l0-21swapper/400:19:154
111391270,0ptp4l0-21swapper/123:45:471
111391270,0ptp4l0-21swapper/123:01:371
111391270,0ptp4l0-21swapper/121:47:301
111391270,0ptp4l0-21swapper/023:24:130
111391270,0ptp4l0-21swapper/021:39:060
111391270,0ptp4l0-21swapper/021:17:580
111391270,0ptp4l0-21swapper/000:24:360
111391260,0ptp4l0-21swapper/523:45:505
111391260,0ptp4l0-21swapper/523:12:235
111391260,0ptp4l0-21swapper/522:29:135
111391260,0ptp4l0-21swapper/521:28:525
111391260,0ptp4l0-21swapper/422:57:134
111391260,0ptp4l0-21swapper/422:43:024
111391260,0ptp4l0-21swapper/422:36:174
111391260,0ptp4l0-21swapper/422:01:554
111391260,0ptp4l0-21swapper/421:46:364
111391260,0ptp4l0-21swapper/421:35:124
111391260,0ptp4l0-21swapper/400:34:134
111391260,0ptp4l0-21swapper/023:52:000
111391260,0ptp4l0-21swapper/022:02:030
111391260,0ptp4l0-21swapper/021:10:150
111391260,0ptp4l0-21swapper/020:45:170
111391250,2ptp4l0-21swapper/523:34:285
111391250,1ptp4l2580-21expr19:50:101
111391250,1ptp4l21486-21diskstats21:30:134
111391250,1ptp4l16632-21latency_hist22:55:015
111391250,1ptp4l16632-21latency_hist22:55:015
111391250,1ptp4l0-21swapper/421:20:284
111391250,0ptp4l0-21swapper/523:50:175
111391250,0ptp4l0-21swapper/522:31:455
111391250,0ptp4l0-21swapper/520:35:205
111391250,0ptp4l0-21swapper/423:25:024
111391250,0ptp4l0-21swapper/423:08:394
111391250,0ptp4l0-21swapper/420:10:194
111391250,0ptp4l0-21swapper/420:10:184
111391250,0ptp4l0-21swapper/123:54:471
111391250,0ptp4l0-21swapper/123:09:231
111391250,0ptp4l0-21swapper/122:00:141
111391250,0ptp4l0-21swapper/023:40:480
111391250,0ptp4l0-21swapper/022:27:000
111391250,0ptp4l0-21swapper/022:11:180
111391250,0ptp4l0-21swapper/021:00:000
111391250,0ptp4l0-21swapper/000:08:460
111391240,2ptp4l0-21swapper/023:03:120
111391240,1ptp4l31243-21diskstats23:15:124
111391240,1ptp4l25416-21ps22:20:175
111391240,0ptp4l0-21swapper/523:57:365
111391240,0ptp4l0-21swapper/523:00:145
111391240,0ptp4l0-21swapper/521:53:045
111391240,0ptp4l0-21swapper/521:43:395
111391240,0ptp4l0-21swapper/520:25:005
111391240,0ptp4l0-21swapper/423:31:264
111391240,0ptp4l0-21swapper/423:20:144
111391240,0ptp4l0-21swapper/422:18:584
111391240,0ptp4l0-21swapper/421:58:344
111391240,0ptp4l0-21swapper/421:26:244
111391240,0ptp4l0-21swapper/421:14:254
111391240,0ptp4l0-21swapper/421:00:004
111391240,0ptp4l0-21swapper/420:40:134
111391240,0ptp4l0-21swapper/400:38:314
111391240,0ptp4l0-21swapper/400:06:424
111391240,0ptp4l0-21swapper/223:49:292
111391240,0ptp4l0-21swapper/123:58:131
111391240,0ptp4l0-21swapper/122:52:211
111391240,0ptp4l0-21swapper/122:52:211
111391240,0ptp4l0-21swapper/100:37:131
111391240,0ptp4l0-21swapper/022:30:200
111391240,0ptp4l0-21swapper/022:17:290
111391240,0ptp4l0-21swapper/021:46:090
111391240,0ptp4l0-21swapper/021:20:440
111391240,0ptp4l0-21swapper/020:40:150
111391240,0ptp4l0-21swapper/020:25:110
111391240,0ptp4l0-21swapper/019:55:140
111391240,0ptp4l0-21swapper/019:18:130
111391230,1ptp4l17172-21sed19:10:194
111391230,0ptp4l14806-21ssh22:05:153
111391230,0ptp4l0-21swapper/523:36:235
111391230,0ptp4l0-21swapper/522:55:165
111391230,0ptp4l0-21swapper/522:46:245
111391230,0ptp4l0-21swapper/522:40:445
111391230,0ptp4l0-21swapper/522:10:155
111391230,0ptp4l0-21swapper/520:00:125
111391230,0ptp4l0-21swapper/519:40:125
111391230,0ptp4l0-21swapper/519:39:435
111391230,0ptp4l0-21swapper/519:20:125
111391230,0ptp4l0-21swapper/519:20:005
111391230,0ptp4l0-21swapper/500:15:415
111391230,0ptp4l0-21swapper/500:11:465
111391230,0ptp4l0-21swapper/423:45:174
111391230,0ptp4l0-21swapper/423:13:374
111391230,0ptp4l0-21swapper/422:50:184
111391230,0ptp4l0-21swapper/422:50:184
111391230,0ptp4l0-21swapper/422:30:154
111391230,0ptp4l0-21swapper/421:00:024
111391230,0ptp4l0-21swapper/420:54:494
111391230,0ptp4l0-21swapper/420:20:144
111391230,0ptp4l0-21swapper/419:55:124
111391230,0ptp4l0-21swapper/419:45:154
111391230,0ptp4l0-21swapper/419:45:004
111391230,0ptp4l0-21swapper/400:20:214
111391230,0ptp4l0-21swapper/400:00:114
111391230,0ptp4l0-21swapper/322:03:353
111391230,0ptp4l0-21swapper/300:10:123
111391230,0ptp4l0-21swapper/123:39:321
111391230,0ptp4l0-21swapper/123:30:191
111391230,0ptp4l0-21swapper/122:55:121
111391230,0ptp4l0-21swapper/122:25:101
111391230,0ptp4l0-21swapper/122:20:131
111391230,0ptp4l0-21swapper/122:10:131
111391230,0ptp4l0-21swapper/121:29:141
111391230,0ptp4l0-21swapper/121:17:151
111391230,0ptp4l0-21swapper/120:35:201
111391230,0ptp4l0-21swapper/120:25:541
111391230,0ptp4l0-21swapper/120:10:211
111391230,0ptp4l0-21swapper/120:10:201
111391230,0ptp4l0-21swapper/119:40:121
111391230,0ptp4l0-21swapper/119:20:191
111391230,0ptp4l0-21swapper/100:30:201
111391230,0ptp4l0-21swapper/023:45:180
111391230,0ptp4l0-21swapper/022:50:170
111391230,0ptp4l0-21swapper/022:50:170
111391230,0ptp4l0-21swapper/021:50:110
111391230,0ptp4l0-21swapper/021:30:120
111391230,0ptp4l0-21swapper/020:35:120
111391230,0ptp4l0-21swapper/020:20:110
111391230,0ptp4l0-21swapper/020:10:200
111391230,0ptp4l0-21swapper/020:10:190
111391230,0ptp4l0-21swapper/019:20:140
111391230,0ptp4l0-21swapper/000:30:210
111391230,0ptp4l0-21swapper/000:12:170
111391220,0ptp4l6318-21diskmemload21:21:351
111391220,0ptp4l0-21swapper/723:10:107
111391220,0ptp4l0-21swapper/722:05:187
111391220,0ptp4l0-21swapper/722:04:437
111391220,0ptp4l0-21swapper/700:10:137
111391220,0ptp4l0-21swapper/523:41:385
111391220,0ptp4l0-21swapper/523:24:325
111391220,0ptp4l0-21swapper/523:05:145
111391220,0ptp4l0-21swapper/522:00:155
111391220,0ptp4l0-21swapper/521:37:585
111391220,0ptp4l0-21swapper/521:05:135
111391220,0ptp4l0-21swapper/520:25:205
111391220,0ptp4l0-21swapper/519:25:155
111391220,0ptp4l0-21swapper/500:35:445
111391220,0ptp4l0-21swapper/500:22:055
111391220,0ptp4l0-21swapper/500:06:275
111391220,0ptp4l0-21swapper/423:00:444
111391220,0ptp4l0-21swapper/422:07:034
111391220,0ptp4l0-21swapper/421:40:154
111391220,0ptp4l0-21swapper/420:35:134
111391220,0ptp4l0-21swapper/420:05:114
111391220,0ptp4l0-21swapper/419:35:134
111391220,0ptp4l0-21swapper/419:30:134
111391220,0ptp4l0-21swapper/419:25:214
111391220,0ptp4l0-21swapper/323:10:133
111391220,0ptp4l0-21swapper/321:34:283
111391220,0ptp4l0-21swapper/123:44:531
111391220,0ptp4l0-21swapper/123:18:551
111391220,0ptp4l0-21swapper/123:12:181
111391220,0ptp4l0-21swapper/122:41:081
111391220,0ptp4l0-21swapper/122:34:541
111391220,0ptp4l0-21swapper/121:57:541
111391220,0ptp4l0-21swapper/121:41:391
111391220,0ptp4l0-21swapper/121:36:001
111391220,0ptp4l0-21swapper/120:30:141
111391220,0ptp4l0-21swapper/120:00:201
111391220,0ptp4l0-21swapper/100:21:591
111391220,0ptp4l0-21swapper/100:15:091
111391220,0ptp4l0-21swapper/100:02:421
111391220,0ptp4l0-21swapper/023:35:170
111391220,0ptp4l0-21swapper/021:29:550
111391220,0ptp4l0-21swapper/020:18:370
111391220,0ptp4l0-21swapper/020:18:360
111391220,0ptp4l0-21swapper/020:05:140
111391220,0ptp4l0-21swapper/019:45:160
111391220,0ptp4l0-21swapper/019:30:190
111391220,0ptp4l0-21swapper/019:10:120
111391220,0ptp4l0-21swapper/000:35:070
111391220,0ptp4l0-21swapper/000:25:120
111391220,0ptp4l0-21swapper/000:15:140
111391210,1ptp4l57-21ksoftirqd/521:46:185
111391210,0ptp4l0-21swapper/523:16:055
111391210,0ptp4l0-21swapper/522:07:505
111391210,0ptp4l0-21swapper/521:56:425
111391210,0ptp4l0-21swapper/521:03:105
111391210,0ptp4l0-21swapper/520:51:015
111391210,0ptp4l0-21swapper/520:15:135
111391210,0ptp4l0-21swapper/520:15:125
111391210,0ptp4l0-21swapper/520:14:565
111391210,0ptp4l0-21swapper/520:14:565
111391210,0ptp4l0-21swapper/420:45:134
111391210,0ptp4l0-21swapper/420:17:144
111391210,0ptp4l0-21swapper/420:17:134
111391210,0ptp4l0-21swapper/419:21:144
111391210,0ptp4l0-21swapper/400:12:304
111391210,0ptp4l0-21swapper/223:35:122
111391210,0ptp4l0-21swapper/222:38:582
111391210,0ptp4l0-21swapper/221:50:542
111391210,0ptp4l0-21swapper/200:29:312
111391210,0ptp4l0-21swapper/123:28:131
111391210,0ptp4l0-21swapper/123:23:081
111391210,0ptp4l0-21swapper/122:46:341
111391210,0ptp4l0-21swapper/122:07:451
111391210,0ptp4l0-21swapper/121:52:461
111391210,0ptp4l0-21swapper/121:10:041
111391210,0ptp4l0-21swapper/121:05:151
111391210,0ptp4l0-21swapper/119:25:161
111391210,0ptp4l0-21swapper/100:26:571
111391210,0ptp4l0-21swapper/100:11:131
111391210,0ptp4l0-21swapper/100:06:101
111391210,0ptp4l0-21swapper/020:32:140
1560599200,19cyclictest4484-1kworker/u17:022:42:117
111391200,0ptp4l0-21swapper/721:34:287
111391200,0ptp4l0-21swapper/700:09:507
111391200,0ptp4l0-21swapper/623:45:096
111391200,0ptp4l0-21swapper/521:21:365
111391200,0ptp4l0-21swapper/520:46:455
111391200,0ptp4l0-21swapper/519:31:495
111391200,0ptp4l0-21swapper/421:08:444
111391200,0ptp4l0-21swapper/420:31:444
111391200,0ptp4l0-21swapper/420:28:274
111391200,0ptp4l0-21swapper/420:04:564
111391200,0ptp4l0-21swapper/320:01:133
111391200,0ptp4l0-21swapper/221:24:192
111391200,0ptp4l0-21swapper/122:16:401
111391200,0ptp4l0-21swapper/121:30:331
111391200,0ptp4l0-21swapper/121:02:591
111391200,0ptp4l0-21swapper/119:59:571
111391200,0ptp4l0-21swapper/119:49:431
111391200,0ptp4l0-21swapper/119:39:131
111391200,0ptp4l0-21swapper/019:53:430
111391190,0ptp4l0-21swapper/623:24:556
111391190,0ptp4l0-21swapper/621:50:546
111391190,0ptp4l0-21swapper/519:59:445
111391190,0ptp4l0-21swapper/322:44:253
111391190,0ptp4l0-21swapper/300:09:573
111391190,0ptp4l0-21swapper/221:41:582
111391190,0ptp4l0-21swapper/120:51:311
111391190,0ptp4l0-21swapper/120:49:441
111391190,0ptp4l0-21swapper/021:07:140
111391190,0ptp4l0-21swapper/020:04:300
111391180,0ptp4l0-21swapper/223:19:562
111391180,0ptp4l0-21swapper/120:17:571
111391180,0ptp4l0-21swapper/120:17:571
111391170,2ptp4l0-21swapper/722:35:477
111391170,0ptp4l0-21swapper/521:33:395
111391170,0ptp4l0-21swapper/520:41:575
111391170,0ptp4l0-21swapper/520:07:135
111391170,0ptp4l0-21swapper/322:35:503
111391170,0ptp4l0-21swapper/320:50:243
111391170,0ptp4l0-21swapper/222:30:082
111391170,0ptp4l0-21swapper/120:55:251
111391170,0ptp4l0-21swapper/119:31:211
111391170,0ptp4l0-21swapper/119:16:551
111391160,0ptp4l0-21swapper/621:31:496
111391160,0ptp4l0-21swapper/621:09:236
111391160,0ptp4l0-21swapper/600:09:196
111391160,0ptp4l0-21swapper/519:11:385
111391160,0ptp4l0-21swapper/120:44:111
111391160,0ptp4l0-21swapper/120:06:311
111391160,0ptp4l0-21swapper/119:11:371
15605991513,1cyclictest0-21swapper/700:35:167
111391150,1ptp4l6318-21diskmemload23:24:532
111391150,0ptp4l0-21swapper/720:50:277
111391150,0ptp4l0-21swapper/720:01:067
111391150,0ptp4l0-21swapper/719:52:287
111391150,0ptp4l0-21swapper/620:37:046
111391150,0ptp4l0-21swapper/522:18:195
111391150,0ptp4l0-21swapper/520:55:265
111391150,0ptp4l0-21swapper/519:49:445
111391150,0ptp4l0-21swapper/419:53:454
111391150,0ptp4l0-21swapper/319:52:133
111391150,0ptp4l0-21swapper/223:32:302
111391150,0ptp4l0-21swapper/221:06:282
111391150,0ptp4l0-21swapper/200:09:192
111391150,0ptp4l0-21swapper/120:22:071
111391150,0ptp4l0-21swapper/019:40:460
111391140,0ptp4l0-21swapper/620:21:416
111391140,0ptp4l0-21swapper/222:56:162
111391140,0ptp4l0-21swapper/222:01:422
111391140,0ptp4l0-21swapper/221:31:472
111391140,0ptp4l0-21swapper/220:56:082
111391140,0ptp4l0-21swapper/220:37:032
111391140,0ptp4l0-21swapper/220:21:422
111391140,0ptp4l0-21swapper/220:12:072
111391140,0ptp4l0-21swapper/220:12:072
111391140,0ptp4l0-21swapper/219:34:072
111391140,0ptp4l0-21swapper/219:29:162
1557699129,2cyclictest0-21swapper/322:14:483
1560599110,10cyclictest0-21swapper/720:15:167
1560599110,10cyclictest0-21swapper/720:15:157
1559899110,10cyclictest0-21swapper/622:28:256
1557699118,2cyclictest0-21swapper/323:06:013
188191100,5phc2sys0-21swapper/700:22:137
1559899109,0cyclictest0-21swapper/623:26:356
1559899109,0cyclictest0-21swapper/623:03:376
1559899109,0cyclictest0-21swapper/622:45:156
1559899109,0cyclictest0-21swapper/622:13:126
1559899109,0cyclictest0-21swapper/619:30:226
1559899109,0cyclictest0-21swapper/600:03:216
1559899100,0cyclictest0-21swapper/621:45:046
1557699109,0cyclictest0-21swapper/321:35:013
1557699107,2cyclictest0-21swapper/322:47:383
1557699104,5cyclictest6318-21diskmemload00:21:593
1557699104,5cyclictest30143-21latency_hist23:59:593
1557699104,5cyclictest22544-21netstat00:35:173
1557699103,6cyclictest25285-21/usr/sbin/munin20:40:143
1557699103,2cyclictest2156-21latency_hist22:35:003
1557699103,1cyclictest1068-21runrttasks22:25:313
1557699103,1cyclictest1068-21runrttasks20:15:303
1557699103,1cyclictest1068-21runrttasks20:15:303
1557699101,1cyclictest0-21swapper/320:55:153
1557699100,9cyclictest0-21swapper/323:31:383
156059998,0cyclictest0-21swapper/719:10:127
156059997,1cyclictest0-21swapper/723:32:177
155989998,0cyclictest0-21swapper/621:44:536
155769998,0cyclictest0-21swapper/321:46:023
155769994,4cyclictest5940-21if_enp0s2523:25:123
155769994,4cyclictest21215-21sh19:20:103
155769994,4cyclictest18031-21latency_hist20:25:003
155769993,5cyclictest3751-21sh23:20:373
155769993,5cyclictest32222-21sh00:01:113
155769993,5cyclictest2942-21missed_timers21:00:163
155769993,1cyclictest6318-21diskmemload23:42:173
155769993,1cyclictest6318-21diskmemload21:29:133
155769993,1cyclictest4496-21timerandwakeup21:50:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional