You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-27 - 18:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot8s.osadl.org (updated Fri Mar 27, 2026 12:46:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
111391670,30ptp4l0-21swapper/407:05:154
111391610,5ptp4l0-21swapper/007:07:420
276852580,0sleep40-21swapper/409:25:214
123892580,0sleep00-21swapper/011:20:210
76702570,0sleep60-21swapper/607:40:226
2345725747,6sleep70-21swapper/707:06:447
111391560,5ptp4l0-21swapper/107:05:031
2362624939,6sleep20-21swapper/207:08:562
2348324737,6sleep60-21swapper/607:07:076
2180124635,7sleep30-21swapper/307:05:043
2350024535,6sleep50-21swapper/507:07:225
111391350,0ptp4l0-21swapper/011:10:160
111391340,0ptp4l0-21swapper/011:41:410
111391330,3ptp4l0-21swapper/009:21:250
111391320,0ptp4l0-21swapper/510:25:455
111391320,0ptp4l0-21swapper/510:25:455
111391320,0ptp4l0-21swapper/510:10:185
111391310,3ptp4l0-21swapper/009:43:560
111391310,0ptp4l0-21swapper/012:35:060
111391310,0ptp4l0-21swapper/011:28:400
111391300,3ptp4l0-21swapper/512:07:405
111391300,0ptp4l20283-21ssh09:15:181
111391300,0ptp4l0-21swapper/712:02:247
111391300,0ptp4l0-21swapper/012:01:580
111391300,0ptp4l0-21swapper/010:30:200
111391300,0ptp4l0-21swapper/007:10:120
111391290,0ptp4l0-21swapper/412:27:054
111391290,0ptp4l0-21swapper/012:26:110
111391290,0ptp4l0-21swapper/012:16:160
111391290,0ptp4l0-21swapper/011:46:380
111391290,0ptp4l0-21swapper/010:49:320
111391290,0ptp4l0-21swapper/009:29:300
111391280,0ptp4l0-21swapper/510:18:115
111391280,0ptp4l0-21swapper/510:06:425
111391280,0ptp4l0-21swapper/509:59:075
111391280,0ptp4l0-21swapper/509:38:075
111391280,0ptp4l0-21swapper/410:50:024
111391280,0ptp4l0-21swapper/410:30:174
111391280,0ptp4l0-21swapper/409:52:484
111391280,0ptp4l0-21swapper/108:15:111
111391280,0ptp4l0-21swapper/012:24:550
111391270,3ptp4l0-21swapper/509:23:155
111391270,0ptp4l0-21swapper/411:35:144
111391270,0ptp4l0-21swapper/411:00:144
111391270,0ptp4l0-21swapper/410:15:044
111391270,0ptp4l0-21swapper/409:30:374
111391270,0ptp4l0-21swapper/112:39:311
111391270,0ptp4l0-21swapper/111:26:151
111391270,0ptp4l0-21swapper/010:20:580
111391270,0ptp4l0-21swapper/010:13:200
111391270,0ptp4l0-21swapper/009:55:090
111391260,0ptp4l0-21swapper/511:38:345
111391260,0ptp4l0-21swapper/508:10:125
111391260,0ptp4l0-21swapper/411:06:474
111391260,0ptp4l0-21swapper/111:46:511
111391260,0ptp4l0-21swapper/110:24:141
111391260,0ptp4l0-21swapper/011:00:150
111391250,7ptp4l0-21swapper/007:48:340
111391250,7ptp4l0-21swapper/007:48:340
111391250,0ptp4l0-21swapper/512:15:375
111391250,0ptp4l0-21swapper/511:52:445
111391250,0ptp4l0-21swapper/412:39:344
111391250,0ptp4l0-21swapper/410:21:484
111391250,0ptp4l0-21swapper/409:45:174
111391250,0ptp4l0-21swapper/409:17:404
111391250,0ptp4l0-21swapper/312:02:143
111391250,0ptp4l0-21swapper/112:15:371
111391250,0ptp4l0-21swapper/111:55:261
111391250,0ptp4l0-21swapper/012:09:290
111391250,0ptp4l0-21swapper/011:30:170
111391250,0ptp4l0-21swapper/011:05:160
111391250,0ptp4l0-21swapper/010:01:290
111391240,3ptp4l0-21swapper/009:46:590
111391240,1ptp4l999-21sed11:50:184
111391240,1ptp4l29856-21diskstats10:15:121
111391240,1ptp4l2745-21munin-run11:54:591
111391240,1ptp4l2695-21timerwakeupswit08:40:194
111391240,1ptp4l26102-21latency_hist07:15:005
111391240,1ptp4l1700-21if_eno108:40:130
111391240,0ptp4l0-21swapper/612:34:576
111391240,0ptp4l0-21swapper/512:11:105
111391240,0ptp4l0-21swapper/510:35:155
111391240,0ptp4l0-21swapper/508:30:465
111391240,0ptp4l0-21swapper/508:20:175
111391240,0ptp4l0-21swapper/410:45:144
111391240,0ptp4l0-21swapper/410:28:344
111391240,0ptp4l0-21swapper/410:28:334
111391240,0ptp4l0-21swapper/409:35:014
111391240,0ptp4l0-21swapper/409:10:004
111391240,0ptp4l0-21swapper/409:08:374
111391240,0ptp4l0-21swapper/408:49:134
111391240,0ptp4l0-21swapper/408:00:114
111391240,0ptp4l0-21swapper/407:50:134
111391240,0ptp4l0-21swapper/407:40:144
111391240,0ptp4l0-21swapper/108:55:581
111391240,0ptp4l0-21swapper/108:03:411
111391240,0ptp4l0-21swapper/107:55:121
111391240,0ptp4l0-21swapper/107:45:041
111391240,0ptp4l0-21swapper/107:45:041
111391240,0ptp4l0-21swapper/011:56:250
111391240,0ptp4l0-21swapper/010:26:540
111391240,0ptp4l0-21swapper/010:26:540
111391240,0ptp4l0-21swapper/010:18:390
111391240,0ptp4l0-21swapper/010:09:110
111391240,0ptp4l0-21swapper/009:16:060
111391240,0ptp4l0-21swapper/008:35:200
111391240,0ptp4l0-21swapper/008:25:110
24028992318,4cyclictest2290-21turbostat12:40:017
111391230,0ptp4l4473-21/usr/sbin/munin10:25:191
111391230,0ptp4l4473-21/usr/sbin/munin10:25:191
111391230,0ptp4l26556-21strings10:55:175
111391230,0ptp4l0-21swapper/709:05:117
111391230,0ptp4l0-21swapper/511:15:135
111391230,0ptp4l0-21swapper/510:53:515
111391230,0ptp4l0-21swapper/510:00:185
111391230,0ptp4l0-21swapper/509:31:515
111391230,0ptp4l0-21swapper/509:00:155
111391230,0ptp4l0-21swapper/508:35:155
111391230,0ptp4l0-21swapper/508:17:305
111391230,0ptp4l0-21swapper/508:05:135
111391230,0ptp4l0-21swapper/508:02:055
111391230,0ptp4l0-21swapper/507:55:135
111391230,0ptp4l0-21swapper/507:25:155
111391230,0ptp4l0-21swapper/507:20:095
111391230,0ptp4l0-21swapper/412:30:184
111391230,0ptp4l0-21swapper/412:20:174
111391230,0ptp4l0-21swapper/412:17:194
111391230,0ptp4l0-21swapper/412:01:044
111391230,0ptp4l0-21swapper/411:57:284
111391230,0ptp4l0-21swapper/411:45:164
111391230,0ptp4l0-21swapper/411:40:154
111391230,0ptp4l0-21swapper/411:30:194
111391230,0ptp4l0-21swapper/411:20:214
111391230,0ptp4l0-21swapper/411:10:174
111391230,0ptp4l0-21swapper/410:40:174
111391230,0ptp4l0-21swapper/409:58:024
111391230,0ptp4l0-21swapper/409:20:154
111391230,0ptp4l0-21swapper/409:02:524
111391230,0ptp4l0-21swapper/408:50:194
111391230,0ptp4l0-21swapper/408:35:184
111391230,0ptp4l0-21swapper/408:25:104
111391230,0ptp4l0-21swapper/408:09:484
111391230,0ptp4l0-21swapper/407:35:054
111391230,0ptp4l0-21swapper/407:15:144
111391230,0ptp4l0-21swapper/309:05:193
111391230,0ptp4l0-21swapper/112:10:131
111391230,0ptp4l0-21swapper/112:09:591
111391230,0ptp4l0-21swapper/110:55:431
111391230,0ptp4l0-21swapper/110:53:421
111391230,0ptp4l0-21swapper/110:42:571
111391230,0ptp4l0-21swapper/110:35:121
111391230,0ptp4l0-21swapper/110:10:191
111391230,0ptp4l0-21swapper/110:06:261
111391230,0ptp4l0-21swapper/110:00:151
111391230,0ptp4l0-21swapper/109:48:181
111391230,0ptp4l0-21swapper/109:40:001
111391230,0ptp4l0-21swapper/108:38:511
111391230,0ptp4l0-21swapper/108:30:161
111391230,0ptp4l0-21swapper/108:10:131
111391230,0ptp4l0-21swapper/108:05:161
111391230,0ptp4l0-21swapper/012:30:130
111391230,0ptp4l0-21swapper/012:13:370
111391230,0ptp4l0-21swapper/011:50:180
111391230,0ptp4l0-21swapper/011:35:190
111391230,0ptp4l0-21swapper/010:54:380
111391230,0ptp4l0-21swapper/010:40:430
111391230,0ptp4l0-21swapper/009:35:190
111391230,0ptp4l0-21swapper/009:11:170
111391230,0ptp4l0-21swapper/008:15:210
111391230,0ptp4l0-21swapper/007:30:190
111391230,0ptp4l0-21swapper/007:25:160
111391230,0ptp4l0-21swapper/007:20:120
111391230,0ptp4l0-21swapper/007:15:190
111391220,0ptp4l0-21swapper/709:05:007
111391220,0ptp4l0-21swapper/612:16:106
111391220,0ptp4l0-21swapper/611:46:096
111391220,0ptp4l0-21swapper/512:25:425
111391220,0ptp4l0-21swapper/511:55:225
111391220,0ptp4l0-21swapper/511:33:155
111391220,0ptp4l0-21swapper/511:25:045
111391220,0ptp4l0-21swapper/511:24:055
111391220,0ptp4l0-21swapper/511:05:145
111391220,0ptp4l0-21swapper/510:46:315
111391220,0ptp4l0-21swapper/510:40:005
111391220,0ptp4l0-21swapper/509:51:575
111391220,0ptp4l0-21swapper/509:15:125
111391220,0ptp4l0-21swapper/508:55:125
111391220,0ptp4l0-21swapper/507:45:175
111391220,0ptp4l0-21swapper/507:45:175
111391220,0ptp4l0-21swapper/507:44:465
111391220,0ptp4l0-21swapper/412:05:144
111391220,0ptp4l0-21swapper/411:25:334
111391220,0ptp4l0-21swapper/411:16:414
111391220,0ptp4l0-21swapper/410:59:524
111391220,0ptp4l0-21swapper/410:39:134
111391220,0ptp4l0-21swapper/410:02:174
111391220,0ptp4l0-21swapper/409:40:204
111391220,0ptp4l0-21swapper/408:32:204
111391220,0ptp4l0-21swapper/408:20:104
111391220,0ptp4l0-21swapper/408:15:164
111391220,0ptp4l0-21swapper/407:30:114
111391220,0ptp4l0-21swapper/407:20:134
111391220,0ptp4l0-21swapper/407:10:204
111391220,0ptp4l0-21swapper/212:00:022
111391220,0ptp4l0-21swapper/209:13:552
111391220,0ptp4l0-21swapper/112:31:241
111391220,0ptp4l0-21swapper/111:42:251
111391220,0ptp4l0-21swapper/111:35:061
111391220,0ptp4l0-21swapper/111:20:441
111391220,0ptp4l0-21swapper/111:15:151
111391220,0ptp4l0-21swapper/111:05:121
111391220,0ptp4l0-21swapper/109:40:181
111391220,0ptp4l0-21swapper/109:33:461
111391220,0ptp4l0-21swapper/109:20:331
111391220,0ptp4l0-21swapper/109:00:121
111391220,0ptp4l0-21swapper/108:20:121
111391220,0ptp4l0-21swapper/107:43:351
111391220,0ptp4l0-21swapper/107:35:111
111391220,0ptp4l0-21swapper/107:25:131
111391220,0ptp4l0-21swapper/107:20:101
111391220,0ptp4l0-21swapper/011:15:190
111391220,0ptp4l0-21swapper/010:39:240
111391220,0ptp4l0-21swapper/009:50:190
111391220,0ptp4l0-21swapper/009:30:180
111391220,0ptp4l0-21swapper/008:58:130
111391220,0ptp4l0-21swapper/008:54:590
111391220,0ptp4l0-21swapper/008:45:120
111391220,0ptp4l0-21swapper/008:10:170
111391220,0ptp4l0-21swapper/007:50:210
111391220,0ptp4l0-21swapper/007:40:000
111391220,0ptp4l0-21swapper/007:35:010
111391210,0ptp4l0-21swapper/610:24:506
111391210,0ptp4l0-21swapper/609:42:246
111391210,0ptp4l0-21swapper/609:13:536
111391210,0ptp4l0-21swapper/512:31:305
111391210,0ptp4l0-21swapper/511:48:235
111391210,0ptp4l0-21swapper/511:44:315
111391210,0ptp4l0-21swapper/511:04:505
111391210,0ptp4l0-21swapper/509:48:195
111391210,0ptp4l0-21swapper/509:44:405
111391210,0ptp4l0-21swapper/509:11:545
111391210,0ptp4l0-21swapper/508:54:345
111391210,0ptp4l0-21swapper/412:12:104
111391210,0ptp4l0-21swapper/410:10:334
111391210,0ptp4l0-21swapper/410:08:264
111391210,0ptp4l0-21swapper/408:55:214
111391210,0ptp4l0-21swapper/408:14:504
111391210,0ptp4l0-21swapper/310:43:273
111391210,0ptp4l0-21swapper/309:27:583
111391210,0ptp4l0-21swapper/212:37:052
111391210,0ptp4l0-21swapper/212:34:462
111391210,0ptp4l0-21swapper/212:20:012
111391210,0ptp4l0-21swapper/211:43:562
111391210,0ptp4l0-21swapper/211:28:502
111391210,0ptp4l0-21swapper/211:17:252
111391210,0ptp4l0-21swapper/210:08:482
111391210,0ptp4l0-21swapper/112:25:511
111391210,0ptp4l0-21swapper/112:21:281
111391210,0ptp4l0-21swapper/111:30:591
111391210,0ptp4l0-21swapper/110:49:191
111391210,0ptp4l0-21swapper/110:33:341
111391210,0ptp4l0-21swapper/109:51:241
111391210,0ptp4l0-21swapper/109:28:261
111391210,0ptp4l0-21swapper/108:50:161
111391210,0ptp4l0-21swapper/010:56:230
111391210,0ptp4l0-21swapper/008:20:100
111391210,0ptp4l0-21swapper/008:09:500
111391210,0ptp4l0-21swapper/007:56:440
111391200,3ptp4l321ktimersoftd/208:08:382
111391200,1ptp4l14746-21diskmemload09:55:511
111391200,0ptp4l0-21swapper/709:43:097
111391200,0ptp4l0-21swapper/611:28:526
111391200,0ptp4l0-21swapper/512:21:285
111391200,0ptp4l0-21swapper/511:10:475
111391200,0ptp4l0-21swapper/510:33:375
111391200,0ptp4l0-21swapper/510:22:105
111391200,0ptp4l0-21swapper/507:35:135
111391200,0ptp4l0-21swapper/407:58:334
111391200,0ptp4l0-21swapper/407:29:034
111391200,0ptp4l0-21swapper/212:17:532
111391200,0ptp4l0-21swapper/211:46:122
111391200,0ptp4l0-21swapper/210:24:472
111391200,0ptp4l0-21swapper/209:42:182
111391200,0ptp4l0-21swapper/109:10:161
111391200,0ptp4l0-21swapper/107:34:061
111391200,0ptp4l0-21swapper/009:08:390
111391200,0ptp4l0-21swapper/009:03:040
111391200,0ptp4l0-21swapper/008:00:150
111391190,1ptp4l41-21ksoftirqd/311:07:263
111391190,0ptp4l0-21swapper/611:55:056
111391190,0ptp4l0-21swapper/611:44:006
111391190,0ptp4l0-21swapper/509:28:565
111391190,0ptp4l0-21swapper/508:42:395
111391190,0ptp4l0-21swapper/507:19:355
111391190,0ptp4l0-21swapper/309:43:153
111391190,0ptp4l0-21swapper/212:00:002
111391190,0ptp4l0-21swapper/208:11:332
111391190,0ptp4l0-21swapper/112:01:331
111391190,0ptp4l0-21swapper/111:10:481
111391190,0ptp4l0-21swapper/111:04:501
111391190,0ptp4l0-21swapper/109:09:401
111391190,0ptp4l0-21swapper/107:19:551
111391190,0ptp4l0-21swapper/107:12:291
111391180,0ptp4l0-21swapper/711:07:287
111391180,0ptp4l0-21swapper/710:43:247
111391180,0ptp4l0-21swapper/612:20:026
111391180,0ptp4l0-21swapper/608:26:386
111391180,0ptp4l0-21swapper/512:37:445
111391180,0ptp4l0-21swapper/211:23:072
111391180,0ptp4l0-21swapper/207:49:552
111391180,0ptp4l0-21swapper/207:49:552
111391180,0ptp4l0-21swapper/107:54:381
111391170,0ptp4l0-21swapper/609:30:336
111391170,0ptp4l0-21swapper/210:35:032
111391170,0ptp4l0-21swapper/209:30:342
111391160,0ptp4l0-21swapper/612:00:006
111391160,0ptp4l0-21swapper/610:08:456
111391160,0ptp4l0-21swapper/608:40:416
111391160,0ptp4l0-21swapper/607:57:086
111391160,0ptp4l0-21swapper/508:45:005
111391160,0ptp4l0-21swapper/407:47:004
111391160,0ptp4l0-21swapper/407:47:004
111391160,0ptp4l0-21swapper/212:13:292
111391160,0ptp4l0-21swapper/108:40:011
111391160,0ptp4l0-21swapper/108:28:401
24021991513,1cyclictest0-21swapper/608:15:106
2402199151,1cyclictest0-21swapper/610:55:146
23999991513,1cyclictest0-21swapper/307:40:133
111391150,0ptp4l0-21swapper/612:37:076
111391150,0ptp4l0-21swapper/611:17:256
111391150,0ptp4l0-21swapper/609:04:326
111391150,0ptp4l0-21swapper/608:22:556
111391150,0ptp4l0-21swapper/608:11:316
111391150,0ptp4l0-21swapper/608:08:426
111391150,0ptp4l0-21swapper/607:49:546
111391150,0ptp4l0-21swapper/607:49:546
111391150,0ptp4l0-21swapper/607:27:096
111391150,0ptp4l0-21swapper/509:09:145
111391150,0ptp4l0-21swapper/508:28:225
111391150,0ptp4l0-21swapper/507:54:125
111391150,0ptp4l0-21swapper/507:31:265
111391150,0ptp4l0-21swapper/208:26:412
111391150,0ptp4l0-21swapper/207:27:112
111391150,0ptp4l0-21swapper/207:23:492
111391150,0ptp4l0-21swapper/108:45:011
111391150,0ptp4l0-21swapper/008:32:130
24028991410,3cyclictest27547-21munin-run12:30:017
111391140,0ptp4l0-21swapper/708:37:587
111391140,0ptp4l0-21swapper/607:23:506
111391140,0ptp4l0-21swapper/308:38:003
111391140,0ptp4l0-21swapper/210:16:502
111391140,0ptp4l0-21swapper/210:00:022
111391140,0ptp4l0-21swapper/209:04:312
111391140,0ptp4l0-21swapper/208:52:292
111391140,0ptp4l0-21swapper/208:40:382
111391140,0ptp4l0-21swapper/208:22:542
111391140,0ptp4l0-21swapper/207:57:002
2399999128,3cyclictest28750-21turbostat08:30:003
2402899109,0cyclictest14746-21diskmemload12:17:267
2402199109,0cyclictest0-21swapper/610:15:206
240289998,0cyclictest0-21swapper/711:58:447
240289990,8cyclictest0-21swapper/711:20:057
240289990,8cyclictest0-21swapper/709:21:177
240289990,1cyclictest0-21swapper/711:45:137
240139998,0cyclictest0-21swapper/512:00:015
239999990,8cyclictest7712-21/usr/sbin/munin11:15:113
239999990,1cyclictest0-21swapper/311:20:213
18819190,0phc2sys0-21swapper/211:03:442
240289987,0cyclictest0-21swapper/711:43:297
240289987,0cyclictest0-21swapper/711:28:057
240289987,0cyclictest0-21swapper/710:34:027
240289987,0cyclictest0-21swapper/709:33:037
240289986,1cyclictest21613-21turbostat10:50:007
240289986,1cyclictest0-21swapper/707:40:137
240289983,4cyclictest0-21swapper/708:00:127
240289980,7cyclictest0-21swapper/712:08:107
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional