You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 15:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sat Nov 22, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
461221070,4sleep04615-21cut08:54:040
1386999914,29cyclictest0-21swapper/108:09:171
1387099684,57cyclictest0-21swapper/211:44:082
1386699624,22cyclictest0-21swapper/008:43:560
1387099605,13cyclictest0-21swapper/208:24:322
1387099605,13cyclictest0-21swapper/208:24:322
124802600,6sleep212484-21unixbench-2d11:24:112
13871995942,11cyclictest15658-21needreboot10:24:073
13866995940,11cyclictest9015-21grep10:09:140
171462582,9sleep30-21swapper/308:10:383
243799570,6rtkit-daemon0-21swapper/010:58:131
106772574,10sleep10-21swapper/109:08:451
106772574,10sleep10-21swapper/109:08:451
203022563,45sleep20-21swapper/207:09:232
161962563,46sleep00-21swapper/011:34:020
1387199563,7cyclictest27374-21hwlatdetect08:34:063
248622553,44sleep30-21swapper/309:37:003
208902553,9sleep00-21swapper/007:12:230
1387099553,43cyclictest0-21swapper/210:49:002
13870995515,31cyclictest2468-21upowerd07:52:582
1386699553,32cyclictest0-21swapper/009:34:100
86292543,44sleep00-21swapper/009:04:000
86292543,44sleep00-21swapper/009:04:000
300052543,9sleep10-21swapper/109:48:511
300052543,9sleep10-21swapper/109:48:511
19182543,9sleep00-21swapper/009:55:310
1386999544,35cyclictest0-21swapper/107:01:341
1386999544,35cyclictest0-21swapper/107:01:341
13866995437,11cyclictest22185-21unixbench_multi09:29:170
13866995421,13cyclictest0-21swapper/010:53:570
129112543,9sleep00-21swapper/009:11:500
129112543,9sleep00-21swapper/009:11:500
81842533,9sleep00-21swapper/009:02:270
7182534,9sleep10-21swapper/111:01:471
68782532,43sleep20-21swapper/212:22:282
298712533,43sleep00-21swapper/008:39:090
274852533,44sleep00-21swapper/008:34:090
261162532,9sleep20-21swapper/210:48:212
218352533,9sleep00-21swapper/008:19:340
209532533,9sleep10-21swapper/107:13:131
196662532,10sleep20-21swapper/208:17:272
13871995337,10cyclictest23278-21gltestperf08:24:083
13871995337,10cyclictest23278-21gltestperf08:24:083
1387099533,43cyclictest0-21swapper/212:24:092
1386999535,29cyclictest0-21swapper/110:13:511
1386999534,26cyclictest0-21swapper/110:29:231
13869995321,20cyclictest14444-21netstat11:29:051
13866995320,13cyclictest0-21swapper/007:34:170
122542533,44sleep30-21swapper/311:24:093
102492533,43sleep00-21swapper/010:13:570
51572523,9sleep20-21swapper/207:45:222
51572523,9sleep20-21swapper/207:45:222
318392523,9sleep00-21swapper/012:05:210
253312523,11sleep00-21swapper/008:29:140
243799520,5rtkit-daemon2436-21rtkit-daemon07:04:223
236202523,9sleep10-21swapper/110:41:561
235152523,9sleep00-21swapper/008:24:380
235152523,9sleep00-21swapper/008:24:380
13871995234,12cyclictest9489-21kernelversion11:19:023
13871995234,12cyclictest9489-21kernelversion11:19:023
1387099523,42cyclictest0-21swapper/211:58:512
1387099523,42cyclictest0-21swapper/211:58:512
1386999524,25cyclictest0-21swapper/109:53:551
1386699525,28cyclictest0-21swapper/011:14:090
13866995224,11cyclictest0-21swapper/008:13:010
13866995212,26cyclictest0-21swapper/009:53:020
13866995212,26cyclictest0-21swapper/009:53:020
77782513,12sleep00-21swapper/007:53:060
56272513,42sleep00-21swapper/011:11:170
290682512,6sleep129103-21switchtime09:44:161
213592512,9sleep20-21swapper/210:38:342
213592512,9sleep20-21swapper/210:38:342
20402514,9sleep10-21swapper/112:13:081
198512513,9sleep00-21swapper/011:39:540
198042513,8sleep219805-21sshd11:39:202
162022512,9sleep20-21swapper/207:03:272
162022512,9sleep20-21swapper/207:03:272
160632513,41sleep00-21swapper/007:01:350
160632513,41sleep00-21swapper/007:01:350
13871995135,9cyclictest29647-21cut10:54:013
1387099515,27cyclictest0-21swapper/208:51:522
1387099514,41cyclictest281ktimersoftd/208:54:062
1387099513,42cyclictest0-21swapper/209:39:182
13870995114,30cyclictest15456-21latency_hist09:18:452
1386999515,27cyclictest0-21swapper/107:43:481
1386999514,29cyclictest0-21swapper/108:14:031
1386999514,28cyclictest0-21swapper/109:03:441
1386699515,27cyclictest0-21swapper/010:34:030
1386699515,27cyclictest0-21swapper/010:34:030
1386699515,27cyclictest0-21swapper/008:14:010
1386699514,29cyclictest0-21swapper/009:59:060
1386699514,28cyclictest0-21swapper/012:23:580
1386699514,28cyclictest0-21swapper/012:09:050
1386699514,28cyclictest0-21swapper/011:48:500
13866995135,9cyclictest10810-21grep07:59:020
13866995120,13cyclictest0-21swapper/009:19:100
92402502,42sleep10-21swapper/112:27:111
259352503,9sleep00-21swapper/010:45:580
258842503,9sleep10-21swapper/110:45:181
248402502,9sleep30-21swapper/311:52:263
243799500,5rtkit-daemon2436-21rtkit-daemon07:07:142
182802504,9sleep10-21swapper/107:04:261
141672502,9sleep10-21swapper/110:23:051
13871995033,10cyclictest19574-21cpuspeed_turbos10:33:573
13871995033,10cyclictest19574-21cpuspeed_turbos10:33:573
1387099508,37cyclictest0-21swapper/210:53:412
1387099504,39cyclictest0-21swapper/209:24:182
1387099504,38cyclictest11932-21iostat_ios09:09:062
1387099504,38cyclictest11932-21iostat_ios09:09:062
1387099503,42cyclictest0-21swapper/207:59:162
1386999506,27cyclictest0-21swapper/109:28:591
1386999504,41cyclictest0-21swapper/111:24:101
1386999504,30cyclictest0-21swapper/107:49:171
1386999504,28cyclictest0-21swapper/107:18:481
1386999503,27cyclictest0-21swapper/111:48:191
13869995011,9cyclictest0-21swapper/109:09:261
13869995011,9cyclictest0-21swapper/109:09:261
1386699505,27cyclictest0-21swapper/007:56:430
1386699504,29cyclictest0-21swapper/010:38:590
1386699504,28cyclictest0-21swapper/007:44:060
1386699504,28cyclictest0-21swapper/007:44:060
1386699504,27cyclictest0-21swapper/011:54:080
1386699504,27cyclictest0-21swapper/010:49:120
1386699504,27cyclictest0-21swapper/008:49:160
1386699504,27cyclictest0-21swapper/007:28:480
13866995019,13cyclictest0-21swapper/009:39:080
128572502,9sleep30-21swapper/309:11:083
128572502,9sleep30-21swapper/309:11:083
105102503,40sleep00-21swapper/011:22:410
105102503,40sleep00-21swapper/011:22:410
58712492,41sleep10-21swapper/108:58:331
230532493,40sleep00-21swapper/007:14:290
187282492,9sleep20-21swapper/210:30:202
175522492,9sleep20-21swapper/211:36:052
152432493,9sleep00-21swapper/011:32:040
13871994934,10cyclictest21380-21hwlatdetect09:29:053
13871994933,10cyclictest10226-21sed09:04:203
13871994933,10cyclictest10226-21sed09:04:203
1387199493,38cyclictest0-21swapper/312:09:033
13871994922,21cyclictest0-21swapper/312:13:573
1386999499,26cyclictest0-21swapper/110:28:401
1386999494,28cyclictest0-21swapper/111:54:071
1386999494,28cyclictest0-21swapper/111:39:151
1386999494,28cyclictest0-21swapper/111:34:091
1386999494,28cyclictest0-21swapper/110:48:511
1386999494,28cyclictest0-21swapper/110:04:161
1386999494,28cyclictest0-21swapper/109:39:121
1386999494,28cyclictest0-21swapper/109:38:421
1386999494,28cyclictest0-21swapper/107:29:131
1386999494,28cyclictest0-21swapper/107:24:061
1386999494,23cyclictest0-21swapper/111:03:541
13869994920,12cyclictest0-21swapper/110:09:141
13869994920,12cyclictest0-21swapper/107:19:021
13869994920,12cyclictest0-21swapper/106:58:501
13869994919,12cyclictest0-21swapper/108:34:061
13869994919,11cyclictest0-21swapper/109:59:091
1386699494,28cyclictest0-21swapper/012:19:060
1386699494,28cyclictest0-21swapper/009:14:140
1386699494,27cyclictest0-21swapper/012:14:050
1386699494,27cyclictest0-21swapper/010:28:540
1386699494,26cyclictest0-21swapper/011:48:380
13866994931,11cyclictest28370-21tune2fs09:44:030
1386699493,22cyclictest0-21swapper/007:21:380
13866994918,13cyclictest0-21swapper/011:04:090
68162483,39sleep00-21swapper/010:05:390
32722483,9sleep30-21swapper/311:06:403
305162483,9sleep00-21swapper/007:33:230
25072482,9sleep20-21swapper/209:58:482
13871994815,26cyclictest11437-21if_eth007:59:093
1387099484,38cyclictest0-21swapper/207:54:202
1387099484,28cyclictest0-21swapper/208:39:182
1387099484,27cyclictest0-21swapper/210:24:112
1387099484,27cyclictest0-21swapper/210:18:422
13870994819,11cyclictest0-21swapper/211:52:212
1386999485,27cyclictest0-21swapper/109:19:341
1386999484,28cyclictest0-21swapper/112:14:071
1386999484,27cyclictest0-21swapper/112:19:051
1386999484,27cyclictest0-21swapper/109:16:571
1386999484,27cyclictest0-21swapper/108:46:521
1386999484,27cyclictest0-21swapper/108:26:491
1386999484,27cyclictest0-21swapper/108:26:491
1386999484,27cyclictest0-21swapper/107:44:161
1386999484,27cyclictest0-21swapper/107:44:161
13869994820,12cyclictest0-21swapper/112:04:021
13869994820,12cyclictest0-21swapper/108:29:201
13869994817,13cyclictest0-21swapper/109:24:161
1386699484,24cyclictest0-21swapper/007:39:040
13866994832,10cyclictest27868-21grep11:58:530
13866994832,10cyclictest27868-21grep11:58:530
13866994830,10cyclictest15319-21tail10:24:020
105572482,9sleep20-21swapper/211:23:202
105572482,9sleep20-21swapper/211:23:202
304592472,9sleep30-21swapper/307:32:383
296042472,39sleep31243-21snmpd09:46:353
295122472,9sleep10-21swapper/112:01:071
295122472,9sleep10-21swapper/112:01:071
149712473,9sleep00-21swapper/008:08:260
139092473,37sleep00-21swapper/010:19:420
13871994733,9cyclictest31061-21kernelversion09:49:073
13871994733,9cyclictest31061-21kernelversion09:49:073
1387199473,37cyclictest0-21swapper/311:53:503
1387199473,37cyclictest0-21swapper/309:28:433
1387199473,22cyclictest0-21swapper/309:58:433
13871994727,9cyclictest0-21swapper/306:59:073
13871994727,9cyclictest0-21swapper/306:59:073
1387099474,29cyclictest0-21swapper/210:19:042
1387099474,28cyclictest0-21swapper/211:53:522
1387099474,28cyclictest0-21swapper/210:39:022
1387099474,27cyclictest0-21swapper/212:09:072
1387099473,38cyclictest281ktimersoftd/211:14:122
1387099473,27cyclictest0-21swapper/208:19:032
1386999474,27cyclictest0-21swapper/108:49:221
1386999474,27cyclictest0-21swapper/108:18:581
129242473,38sleep00-21swapper/011:28:050
125612472,39sleep10-21swapper/108:03:151
57632463,9sleep30-21swapper/308:57:103
56822462,9sleep30-21swapper/311:12:003
326362462,38sleep30-21swapper/307:34:553
31002463,9sleep20-21swapper/211:04:252
249352462,38sleep124979-21sed11:53:371
232842462,9sleep30-21swapper/307:17:303
176622462,10sleep30-21swapper/309:21:283
171552462,9sleep20-21swapper/208:10:452
1387199464,38cyclictest0-21swapper/308:45:453
1387199464,37cyclictest0-21swapper/310:18:233
1387199463,37cyclictest4948-21telnet12:18:513
1387199463,27cyclictest0-21swapper/310:03:423
13871994629,11cyclictest17717-21gltestperf10:29:013
13871994620,12cyclictest0-21swapper/309:02:363
1387099464,36cyclictest0-21swapper/210:08:432
1387099464,25cyclictest0-21swapper/207:17:352
13870994630,9cyclictest27269-21gltestperf08:34:052
13870994630,10cyclictest26834-21grep07:24:082
1386999465,26cyclictest0-21swapper/111:18:521
1386999465,26cyclictest0-21swapper/111:18:521
1386999463,27cyclictest0-21swapper/111:14:061
1386999463,27cyclictest0-21swapper/107:54:001
1386699465,17cyclictest0-21swapper/009:27:240
1386699464,36cyclictest0-21swapper/007:04:290
1386699464,23cyclictest0-21swapper/010:58:530
135962464,6sleep20-21swapper/206:55:462
128642462,38sleep10-21swapper/108:03:591
69632452,9sleep30-21swapper/310:07:353
37322452,10sleep20-21swapper/212:14:062
296032452,38sleep20-21swapper/209:46:342
254952452,9sleep30-21swapper/307:20:083
218932453,9sleep30-21swapper/308:20:223
1387199454,36cyclictest0-21swapper/309:14:273
1387199454,34cyclictest0-21swapper/312:03:383
1387199454,34cyclictest0-21swapper/312:03:383
13871994531,9cyclictest12871-21head10:19:033
1387199453,36cyclictest0-21swapper/311:28:513
1387199453,36cyclictest0-21swapper/310:43:533
1387199453,36cyclictest0-21swapper/307:43:483
1387199453,35cyclictest0-21swapper/311:48:383
13871994526,12cyclictest19609-21grep07:09:113
1387099454,35cyclictest0-21swapper/208:28:582
1387099453,37cyclictest0-21swapper/210:09:092
1387099453,33cyclictest10218-21sed09:04:202
1387099453,33cyclictest10218-21sed09:04:202
13870994529,10cyclictest7853-21grep08:59:162
1387099452,37cyclictest0-21swapper/208:44:112
1386999454,26cyclictest0-21swapper/111:08:571
13869994528,10cyclictest31719-21hwlatdetect07:34:131
52622442,36sleep30-21swapper/307:46:443
52622442,36sleep30-21swapper/307:46:443
309152442,9sleep30-21swapper/308:42:473
308982442,36sleep10-21swapper/108:42:331
305032442,36sleep20-21swapper/207:33:132
248762442,37sleep20-21swapper/209:37:112
236422442,9sleep30-21swapper/310:42:143
1387199444,33cyclictest0-21swapper/310:59:093
1387199443,35cyclictest0-21swapper/310:53:053
13871994426,13cyclictest0-21swapper/311:14:093
13871994423,10cyclictest0-21swapper/308:50:383
13871994422,16cyclictest0-21swapper/310:13:423
13871994421,7cyclictest10348-21cat07:58:483
1387099445,33cyclictest0-21swapper/212:03:542
1387099444,34cyclictest0-21swapper/207:39:032
1387099444,24cyclictest0-21swapper/207:35:192
1387099444,12cyclictest0-21swapper/211:29:322
1387099443,25cyclictest0-21swapper/208:04:062
13870994424,14cyclictest0-21swapper/210:58:572
1387099442,37cyclictest0-21swapper/207:19:242
13870994417,11cyclictest0-21swapper/209:29:142
91872432,35sleep30-21swapper/312:26:283
317832433,9sleep30-21swapper/312:04:403
280392432,9sleep30-21swapper/307:27:133
1387199433,35cyclictest0-21swapper/309:39:093
13871994328,10cyclictest17851-21sort08:14:003
13871994327,9cyclictest13282-21grep08:04:023
1387099434,34cyclictest0-21swapper/211:08:512
1387099433,34cyclictest0-21swapper/209:18:572
1386999435,14cyclictest0-21swapper/110:34:081
1386999435,14cyclictest0-21swapper/110:34:081
137932434,6sleep00-21swapper/006:58:210
319462422,9sleep20-21swapper/209:50:462
319462422,9sleep20-21swapper/209:50:462
1387199423,30cyclictest0-21swapper/311:43:383
1387099424,21cyclictest1431-21mailstats09:54:132
135502424,6sleep30-21swapper/306:55:103
260072412,9sleep30-21swapper/308:30:583
13871994127,10cyclictest0-21swapper/307:49:183
13871994118,10cyclictest0-21swapper/311:33:553
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional