You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-02 - 13:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot8s.osadl.org (updated Thu Apr 02, 2026 00:46:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
267962640,0sleep10-21swapper/122:20:401
111391620,5ptp4l0-21swapper/219:06:352
111391620,31ptp4l0-21swapper/019:09:260
1881916138,6phc2sys0-21swapper/419:06:224
65632600,2sleep21579099cyclictest21:10:002
1548626039,6sleep10-21swapper/119:09:381
182832590,0sleep70-21swapper/722:55:157
111391590,5ptp4l0-21swapper/619:09:106
1360225240,7sleep70-21swapper/719:05:037
1526924735,7sleep30-21swapper/319:06:523
1543524635,7sleep50-21swapper/519:09:025
111391320,1ptp4l4173-21if_enp1s021:50:130
111391320,0ptp4l0-21swapper/419:15:114
111391300,2ptp4l0-21swapper/421:10:164
111391300,0ptp4l0-21swapper/422:35:114
111391300,0ptp4l0-21swapper/422:33:124
111391290,2ptp4l0-21swapper/420:35:134
111391290,1ptp4l6545-21diskmemload21:10:004
111391290,0ptp4l0-21swapper/519:30:155
111391290,0ptp4l0-21swapper/423:41:544
111391290,0ptp4l0-21swapper/423:34:554
111391290,0ptp4l0-21swapper/422:52:234
111391290,0ptp4l0-21swapper/221:59:522
111391290,0ptp4l0-21swapper/023:09:490
111391290,0ptp4l0-21swapper/022:41:450
111391290,0ptp4l0-21swapper/022:04:580
111391280,4ptp4l0-21swapper/123:03:391
111391280,2ptp4l0-21swapper/423:35:464
111391280,2ptp4l0-21swapper/423:27:594
111391280,0ptp4l0-21swapper/423:23:134
111391280,0ptp4l0-21swapper/421:40:024
111391280,0ptp4l0-21swapper/421:40:024
111391280,0ptp4l0-21swapper/400:39:204
111391280,0ptp4l0-21swapper/022:52:310
111391280,0ptp4l0-21swapper/022:12:350
111391280,0ptp4l0-21swapper/019:32:240
111391270,4ptp4l0-21swapper/400:00:144
111391270,0ptp4l0-21swapper/421:20:174
111391270,0ptp4l0-21swapper/421:18:554
111391270,0ptp4l0-21swapper/419:50:184
111391270,0ptp4l0-21swapper/023:24:350
111391270,0ptp4l0-21swapper/022:29:370
111391270,0ptp4l0-21swapper/021:41:090
111391270,0ptp4l0-21swapper/021:41:090
111391270,0ptp4l0-21swapper/021:34:110
111391270,0ptp4l0-21swapper/021:15:060
111391260,1ptp4l30477-21tr19:40:105
111391260,0ptp4l0-21swapper/521:34:305
111391260,0ptp4l0-21swapper/520:20:195
111391260,0ptp4l0-21swapper/423:55:124
111391260,0ptp4l0-21swapper/423:54:344
111391260,0ptp4l0-21swapper/422:48:494
111391260,0ptp4l0-21swapper/422:27:114
111391260,0ptp4l0-21swapper/422:17:274
111391260,0ptp4l0-21swapper/421:56:214
111391260,0ptp4l0-21swapper/421:38:504
111391260,0ptp4l0-21swapper/400:25:304
111391260,0ptp4l0-21swapper/400:24:144
111391260,0ptp4l0-21swapper/400:24:144
111391260,0ptp4l0-21swapper/323:03:143
111391260,0ptp4l0-21swapper/023:27:510
111391260,0ptp4l0-21swapper/021:24:530
111391260,0ptp4l0-21swapper/020:20:150
111391260,0ptp4l0-21swapper/020:00:200
111391260,0ptp4l0-21swapper/000:05:580
111391250,2ptp4l28364-21latency_hist22:25:017
111391250,1ptp4l15367-21/usr/sbin/munin20:15:194
111391250,0ptp4l0-21swapper/523:53:315
111391250,0ptp4l0-21swapper/523:32:525
111391250,0ptp4l0-21swapper/500:05:205
111391250,0ptp4l0-21swapper/423:14:474
111391250,0ptp4l0-21swapper/423:05:044
111391250,0ptp4l0-21swapper/422:55:204
111391250,0ptp4l0-21swapper/422:05:184
111391250,0ptp4l0-21swapper/421:53:364
111391250,0ptp4l0-21swapper/421:34:094
111391250,0ptp4l0-21swapper/400:31:574
111391250,0ptp4l0-21swapper/400:18:474
111391250,0ptp4l0-21swapper/400:18:474
111391250,0ptp4l0-21swapper/123:53:361
111391250,0ptp4l0-21swapper/121:40:341
111391250,0ptp4l0-21swapper/121:40:331
111391250,0ptp4l0-21swapper/119:20:171
111391250,0ptp4l0-21swapper/100:10:221
111391250,0ptp4l0-21swapper/022:39:370
111391250,0ptp4l0-21swapper/022:30:450
111391250,0ptp4l0-21swapper/021:28:550
112792240,0sleep30-21swapper/300:18:503
112792240,0sleep30-21swapper/300:18:503
111391240,2ptp4l0-21swapper/523:57:065
111391240,1ptp4l7935-21/usr/sbin/munin22:40:164
111391240,1ptp4l15897-21df_inode00:25:090
111391240,1ptp4l12417-21if_err_eno100:20:130
111391240,1ptp4l12417-21if_err_eno100:20:120
111391240,1ptp4l0-21swapper/119:41:241
111391240,0ptp4l0-21swapper/722:25:157
111391240,0ptp4l0-21swapper/519:30:015
111391240,0ptp4l0-21swapper/500:27:085
111391240,0ptp4l0-21swapper/423:48:294
111391240,0ptp4l0-21swapper/422:01:414
111391240,0ptp4l0-21swapper/421:45:344
111391240,0ptp4l0-21swapper/421:00:134
111391240,0ptp4l0-21swapper/123:45:391
111391240,0ptp4l0-21swapper/121:51:471
111391240,0ptp4l0-21swapper/120:45:111
111391240,0ptp4l0-21swapper/120:30:111
111391240,0ptp4l0-21swapper/120:25:221
111391240,0ptp4l0-21swapper/100:27:031
111391240,0ptp4l0-21swapper/100:20:141
111391240,0ptp4l0-21swapper/100:20:141
111391240,0ptp4l0-21swapper/023:35:150
111391240,0ptp4l0-21swapper/022:58:590
111391240,0ptp4l0-21swapper/022:22:410
111391240,0ptp4l0-21swapper/022:15:160
111391240,0ptp4l0-21swapper/020:55:120
111391240,0ptp4l0-21swapper/020:50:180
111391240,0ptp4l0-21swapper/020:10:100
111391240,0ptp4l0-21swapper/020:05:170
111391240,0ptp4l0-21swapper/019:40:150
111391240,0ptp4l0-21swapper/000:35:120
111391240,0ptp4l0-21swapper/000:10:170
111391240,0ptp4l0-21swapper/000:01:550
111391230,2ptp4l0-21swapper/121:27:581
111391230,1ptp4l33-21ksoftirqd/200:37:232
111391230,1ptp4l29966-21ssh23:10:231
111391230,1ptp4l24744-21users20:35:200
111391230,1ptp4l0-21swapper/422:20:034
111391230,0ptp4l6545-21diskmemload23:00:127
111391230,0ptp4l0-21swapper/523:37:145
111391230,0ptp4l0-21swapper/522:19:045
111391230,0ptp4l0-21swapper/522:10:145
111391230,0ptp4l0-21swapper/521:40:135
111391230,0ptp4l0-21swapper/521:40:135
111391230,0ptp4l0-21swapper/521:35:125
111391230,0ptp4l0-21swapper/521:19:225
111391230,0ptp4l0-21swapper/520:50:145
111391230,0ptp4l0-21swapper/423:15:164
111391230,0ptp4l0-21swapper/422:11:194
111391230,0ptp4l0-21swapper/421:27:094
111391230,0ptp4l0-21swapper/420:25:134
111391230,0ptp4l0-21swapper/420:05:154
111391230,0ptp4l0-21swapper/420:00:134
111391230,0ptp4l0-21swapper/419:48:254
111391230,0ptp4l0-21swapper/400:10:144
111391230,0ptp4l0-21swapper/400:05:114
111391230,0ptp4l0-21swapper/121:35:091
111391230,0ptp4l0-21swapper/121:20:031
111391230,0ptp4l0-21swapper/120:50:111
111391230,0ptp4l0-21swapper/119:35:161
111391230,0ptp4l0-21swapper/119:30:121
111391230,0ptp4l0-21swapper/100:16:521
111391230,0ptp4l0-21swapper/100:16:511
111391230,0ptp4l0-21swapper/100:03:251
111391230,0ptp4l0-21swapper/023:55:200
111391230,0ptp4l0-21swapper/023:51:170
111391230,0ptp4l0-21swapper/023:45:150
111391230,0ptp4l0-21swapper/023:40:100
111391230,0ptp4l0-21swapper/023:10:150
111391230,0ptp4l0-21swapper/022:45:110
111391230,0ptp4l0-21swapper/022:05:270
111391230,0ptp4l0-21swapper/021:55:150
111391230,0ptp4l0-21swapper/021:49:250
111391230,0ptp4l0-21swapper/021:35:190
111391230,0ptp4l0-21swapper/021:13:110
111391230,0ptp4l0-21swapper/020:45:180
111391230,0ptp4l0-21swapper/020:45:000
111391230,0ptp4l0-21swapper/020:25:150
111391230,0ptp4l0-21swapper/020:15:150
111391230,0ptp4l0-21swapper/019:55:120
111391230,0ptp4l0-21swapper/019:45:140
111391230,0ptp4l0-21swapper/019:25:110
111391230,0ptp4l0-21swapper/019:20:120
111391230,0ptp4l0-21swapper/000:30:150
111391220,1ptp4l33-21ksoftirqd/223:31:192
111391220,1ptp4l24378-21ssh23:04:490
111391220,0ptp4l5772-21strings19:55:164
111391220,0ptp4l25-21ksoftirqd/122:10:121
111391220,0ptp4l0-21swapper/722:12:317
111391220,0ptp4l0-21swapper/523:42:315
111391220,0ptp4l0-21swapper/523:25:185
111391220,0ptp4l0-21swapper/523:17:325
111391220,0ptp4l0-21swapper/522:29:015
111391220,0ptp4l0-21swapper/522:20:205
111391220,0ptp4l0-21swapper/522:02:395
111391220,0ptp4l0-21swapper/521:48:435
111391220,0ptp4l0-21swapper/520:55:015
111391220,0ptp4l0-21swapper/520:45:115
111391220,0ptp4l0-21swapper/520:35:225
111391220,0ptp4l0-21swapper/520:15:135
111391220,0ptp4l0-21swapper/519:35:115
111391220,0ptp4l0-21swapper/500:01:255
111391220,0ptp4l0-21swapper/423:04:154
111391220,0ptp4l0-21swapper/420:55:124
111391220,0ptp4l0-21swapper/420:50:194
111391220,0ptp4l0-21swapper/420:30:164
111391220,0ptp4l0-21swapper/420:10:104
111391220,0ptp4l0-21swapper/419:40:174
111391220,0ptp4l0-21swapper/419:25:124
111391220,0ptp4l0-21swapper/419:10:124
111391220,0ptp4l0-21swapper/322:25:143
111391220,0ptp4l0-21swapper/322:23:143
111391220,0ptp4l0-21swapper/322:12:203
111391220,0ptp4l0-21swapper/222:50:172
111391220,0ptp4l0-21swapper/221:27:152
111391220,0ptp4l0-21swapper/123:57:071
111391220,0ptp4l0-21swapper/123:37:411
111391220,0ptp4l0-21swapper/123:30:511
111391220,0ptp4l0-21swapper/123:25:161
111391220,0ptp4l0-21swapper/123:22:091
111391220,0ptp4l0-21swapper/123:08:221
111391220,0ptp4l0-21swapper/122:53:131
111391220,0ptp4l0-21swapper/122:36:051
111391220,0ptp4l0-21swapper/122:34:151
111391220,0ptp4l0-21swapper/122:19:471
111391220,0ptp4l0-21swapper/122:04:251
111391220,0ptp4l0-21swapper/121:49:091
111391220,0ptp4l0-21swapper/121:34:131
111391220,0ptp4l0-21swapper/121:14:211
111391220,0ptp4l0-21swapper/120:57:021
111391220,0ptp4l0-21swapper/120:35:211
111391220,0ptp4l0-21swapper/120:17:041
111391220,0ptp4l0-21swapper/119:53:111
111391220,0ptp4l0-21swapper/023:31:410
111391220,0ptp4l0-21swapper/023:15:120
111391220,0ptp4l0-21swapper/021:00:160
111391220,0ptp4l0-21swapper/019:16:100
111391220,0ptp4l0-21swapper/019:10:140
111391220,0ptp4l0-21swapper/000:15:120
111391220,0ptp4l0-21swapper/000:15:120
111391210,0ptp4l0-21swapper/621:59:506
111391210,0ptp4l0-21swapper/523:45:575
111391210,0ptp4l0-21swapper/523:12:145
111391210,0ptp4l0-21swapper/522:57:195
111391210,0ptp4l0-21swapper/522:53:195
111391210,0ptp4l0-21swapper/522:38:355
111391210,0ptp4l0-21swapper/521:51:525
111391210,0ptp4l0-21swapper/521:26:325
111391210,0ptp4l0-21swapper/520:30:015
111391210,0ptp4l0-21swapper/520:03:485
111391210,0ptp4l0-21swapper/519:53:405
111391210,0ptp4l0-21swapper/519:20:195
111391210,0ptp4l0-21swapper/519:18:215
111391210,0ptp4l0-21swapper/420:40:124
111391210,0ptp4l0-21swapper/420:20:124
111391210,0ptp4l0-21swapper/419:21:534
111391210,0ptp4l0-21swapper/323:31:153
111391210,0ptp4l0-21swapper/322:59:463
111391210,0ptp4l0-21swapper/322:17:113
111391210,0ptp4l0-21swapper/221:31:222
111391210,0ptp4l0-21swapper/123:42:441
111391210,0ptp4l0-21swapper/123:17:411
111391210,0ptp4l0-21swapper/122:56:221
111391210,0ptp4l0-21swapper/122:28:101
111391210,0ptp4l0-21swapper/122:05:021
111391210,0ptp4l0-21swapper/121:18:201
111391210,0ptp4l0-21swapper/120:41:171
111391210,0ptp4l0-21swapper/120:20:171
111391210,0ptp4l0-21swapper/120:11:291
111391210,0ptp4l0-21swapper/100:35:321
111391210,0ptp4l0-21swapper/100:33:551
111391210,0ptp4l0-21swapper/100:05:181
111391210,0ptp4l0-21swapper/021:05:130
111391210,0ptp4l0-21swapper/020:30:130
111391200,0ptp4l0-21swapper/723:31:167
111391200,0ptp4l0-21swapper/623:22:236
111391200,0ptp4l0-21swapper/622:33:076
111391200,0ptp4l0-21swapper/622:29:596
111391200,0ptp4l0-21swapper/600:37:266
111391200,0ptp4l0-21swapper/523:20:475
111391200,0ptp4l0-21swapper/523:06:255
111391200,0ptp4l0-21swapper/522:30:305
111391200,0ptp4l0-21swapper/522:09:195
111391200,0ptp4l0-21swapper/521:00:005
111391200,0ptp4l0-21swapper/520:10:335
111391200,0ptp4l0-21swapper/520:08:225
111391200,0ptp4l0-21swapper/500:35:585
111391200,0ptp4l0-21swapper/500:30:505
111391200,0ptp4l0-21swapper/500:20:165
111391200,0ptp4l0-21swapper/500:20:155
111391200,0ptp4l0-21swapper/500:15:195
111391200,0ptp4l0-21swapper/500:15:185
111391200,0ptp4l0-21swapper/500:11:075
111391200,0ptp4l0-21swapper/419:35:394
111391200,0ptp4l0-21swapper/320:06:253
111391200,0ptp4l0-21swapper/120:04:261
111391200,0ptp4l0-21swapper/119:28:091
111391200,0ptp4l0-21swapper/119:11:141
111391200,0ptp4l0-21swapper/019:50:100
111391190,0ptp4l6545-21diskmemload22:43:451
111391190,0ptp4l0-21swapper/722:17:097
111391190,0ptp4l0-21swapper/619:59:566
111391190,0ptp4l0-21swapper/522:43:555
111391190,0ptp4l0-21swapper/521:22:415
111391190,0ptp4l0-21swapper/521:14:195
111391190,0ptp4l0-21swapper/520:29:515
111391190,0ptp4l0-21swapper/223:22:222
111391190,0ptp4l0-21swapper/122:48:511
111391190,0ptp4l0-21swapper/119:18:411
111391190,0ptp4l0-21swapper/019:35:200
111391180,0ptp4l6545-21diskmemload23:43:286
111391180,0ptp4l0-21swapper/523:03:345
111391180,0ptp4l0-21swapper/520:42:175
111391180,0ptp4l0-21swapper/222:31:522
15826991712,1cyclictest0-21swapper/721:50:147
111391170,0ptp4l561ktimersoftd/522:48:535
111391170,0ptp4l0-21swapper/621:27:176
111391170,0ptp4l0-21swapper/600:27:366
111391170,0ptp4l0-21swapper/600:13:146
111391170,0ptp4l0-21swapper/419:31:244
111391170,0ptp4l0-21swapper/119:55:301
111391160,0ptp4l0-21swapper/700:34:357
111391160,0ptp4l0-21swapper/420:48:044
111391160,0ptp4l0-21swapper/219:59:432
111391160,0ptp4l0-21swapper/200:13:122
111391160,0ptp4l0-21swapper/121:08:511
111391160,0ptp4l0-21swapper/121:02:081
111391160,0ptp4l0-21swapper/120:05:491
111391160,0ptp4l0-21swapper/119:45:351
15826991513,1cyclictest0-21swapper/720:25:197
111391150,0ptp4l0-21swapper/720:06:227
111391150,0ptp4l0-21swapper/621:01:116
111391150,0ptp4l0-21swapper/620:34:046
111391150,0ptp4l0-21swapper/620:12:536
111391150,0ptp4l0-21swapper/619:51:556
111391150,0ptp4l0-21swapper/619:46:496
111391150,0ptp4l0-21swapper/619:15:536
111391150,0ptp4l0-21swapper/521:57:175
111391150,0ptp4l0-21swapper/521:09:455
111391150,0ptp4l0-21swapper/519:55:315
111391150,0ptp4l0-21swapper/519:45:375
111391150,0ptp4l0-21swapper/519:10:305
111391150,0ptp4l0-21swapper/320:21:563
111391150,0ptp4l0-21swapper/220:26:512
111391150,0ptp4l0-21swapper/220:22:102
111391150,0ptp4l0-21swapper/219:51:572
111391150,0ptp4l0-21swapper/121:57:201
15818991411,1cyclictest29964-21munin-run19:40:006
111391140,0ptp4l0-21swapper/720:21:577
111391140,0ptp4l0-21swapper/620:22:126
111391140,0ptp4l0-21swapper/619:12:046
111391140,0ptp4l0-21swapper/222:25:502
111391140,0ptp4l0-21swapper/221:01:102
111391140,0ptp4l0-21swapper/220:34:032
111391140,0ptp4l0-21swapper/220:12:522
111391140,0ptp4l0-21swapper/219:46:482
111391140,0ptp4l0-21swapper/219:15:532
111391140,0ptp4l0-21swapper/219:12:022
1582699119,1cyclictest0-21swapper/719:40:187
1582699100,9cyclictest0-21swapper/723:13:167
1582699100,9cyclictest0-21swapper/722:51:267
1582699100,9cyclictest0-21swapper/700:22:457
1582699100,9cyclictest0-21swapper/700:22:447
1579899108,1cyclictest0-21swapper/319:55:183
1579899100,9cyclictest125142chrt22:00:483
1579899100,9cyclictest0-21swapper/321:27:583
1579099107,2cyclictest0-21swapper/223:28:522
1579099104,1cyclictest7580-21if_virbr0-nic22:40:162
1579099104,1cyclictest6545-21diskmemload23:12:492
1579099104,1cyclictest6545-21diskmemload21:41:292
1579099104,1cyclictest6545-21diskmemload21:41:292
1579099104,1cyclictest1068-21runrttasks00:03:232
1579099103,1cyclictest6545-21diskmemload22:38:102
1579099103,1cyclictest1238-21timerandwakeup20:55:202
1579099100,0cyclictest0-21swapper/200:28:132
158269998,0cyclictest0-21swapper/723:53:407
158269996,1cyclictest105-21kswapd023:30:007
158269990,0cyclictest0-21swapper/723:43:367
158269990,0cyclictest0-21swapper/722:41:327
158269990,0cyclictest0-21swapper/721:11:107
157989990,8cyclictest0-21swapper/322:53:453
157989990,8cyclictest0-21swapper/300:23:493
157989990,8cyclictest0-21swapper/300:23:483
157989990,3cyclictest0-21swapper/323:51:213
157989990,0cyclictest0-21swapper/323:13:163
157989990,0cyclictest0-21swapper/322:35:413
157909994,1cyclictest6545-21diskmemload23:45:282
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional