You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-17 - 17:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Fri Oct 17, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3229899994,70cyclictest0-21swapper/208:00:442
3229899994,70cyclictest0-21swapper/208:00:442
32295999720,13cyclictest0-21swapper/007:05:510
3229899944,66cyclictest0-21swapper/207:30:352
32295999117,12cyclictest0-21swapper/004:55:460
3229899904,62cyclictest0-21swapper/207:25:362
3229599903,80cyclictest0-21swapper/008:10:550
3229599894,79cyclictest0-21swapper/006:30:500
3229599894,29cyclictest0-21swapper/006:05:420
32295998936,46cyclictest25647-21grep06:55:390
32295998934,48cyclictest3064-21grep08:20:540
3229599893,9cyclictest31604-21grep06:00:400
32295998836,44cyclictest25733-21grep10:15:510
32295998819,10cyclictest11658-21tune2fs08:40:420
32298998730,51cyclictest0-21swapper/206:30:342
3229899864,67cyclictest0-21swapper/207:35:352
3229599854,28cyclictest0-21swapper/008:00:550
3229599854,28cyclictest0-21swapper/008:00:550
3229599854,26cyclictest0-21swapper/010:20:310
32295998532,46cyclictest9009-21grep07:25:570
3229599853,9cyclictest17691-21grep07:45:410
32295998522,11cyclictest19642-21grep07:50:370
32295998514,11cyclictest0-21swapper/005:45:280
3229899844,73cyclictest0-21swapper/208:30:422
3229899844,63cyclictest0-21swapper/209:15:352
3229899843,61cyclictest9552-21munin-run05:15:282
3229899843,61cyclictest9552-21munin-run05:15:282
32298998425,51cyclictest2246-21metacity06:44:232
3229599849,9cyclictest106250irq/46-eth005:45:460
3229599844,28cyclictest0-21swapper/005:05:540
3229599844,27cyclictest0-21swapper/005:50:590
3229599844,27cyclictest0-21swapper/005:50:590
3229599844,13cyclictest0-21swapper/009:15:190
3229599844,13cyclictest0-21swapper/006:15:380
3229599843,28cyclictest21321-21sshd06:45:480
3229599843,26cyclictest12369-21tr09:50:320
3229899834,71cyclictest0-21swapper/204:55:322
3229899833,71cyclictest0-21swapper/206:55:412
32298998329,47cyclictest16313-21unixbench_singl05:26:012
3229599834,30cyclictest0-21swapper/008:15:500
3229599834,28cyclictest0-21swapper/006:20:520
3229599834,27cyclictest0-21swapper/007:35:390
3229899828,65cyclictest0-21swapper/207:55:232
3229899824,71cyclictest0-21swapper/209:20:212
3229899824,70cyclictest0-21swapper/208:25:462
3229899824,61cyclictest0-21swapper/209:11:432
3229599825,13cyclictest0-21swapper/008:45:350
3229599825,13cyclictest0-21swapper/008:45:350
3229599824,30cyclictest0-21swapper/005:15:280
3229599824,30cyclictest0-21swapper/005:15:280
3229599824,28cyclictest0-21swapper/006:35:490
3229599824,28cyclictest0-21swapper/006:35:490
3229599824,23cyclictest0-21swapper/008:55:340
3229599824,15cyclictest0-21swapper/009:45:500
3229599823,29cyclictest0-21swapper/010:00:370
32295998225,9cyclictest27223-21tune2fs08:05:400
32295998216,12cyclictest0-21swapper/007:15:020
3229899815,15cyclictest0-21swapper/206:15:252
3229899814,70cyclictest0-21swapper/207:15:582
3229599814,28cyclictest0-21swapper/009:15:490
3229599814,25cyclictest0-21swapper/007:02:270
3229599814,24cyclictest0-21swapper/007:15:360
3229599814,14cyclictest0-21swapper/006:40:530
3229599814,14cyclictest0-21swapper/005:55:400
3229899804,69cyclictest0-21swapper/209:35:382
3229899804,68cyclictest0-21swapper/206:07:502
3229899804,68cyclictest0-21swapper/205:05:552
3229899804,67cyclictest30053-21munin-node07:05:462
3229899804,58cyclictest0-21swapper/208:50:172
3229899804,58cyclictest0-21swapper/208:50:172
32298998026,47cyclictest1265-21runrttasks10:15:362
32298998017,12cyclictest0-21swapper/208:25:122
3229599804,22cyclictest0-21swapper/009:40:480
3229599804,12cyclictest0-21swapper/005:15:410
3229599803,25cyclictest0-21swapper/008:25:450
3229599803,21cyclictest0-21swapper/005:39:460
32295998028,8cyclictest21848-21find09:00:500
32295998025,49cyclictest0-21swapper/010:10:510
32295998025,49cyclictest0-21swapper/010:10:510
32295998016,12cyclictest0-21swapper/009:35:320
3229899797,18cyclictest0-21swapper/207:20:442
3229899797,18cyclictest0-21swapper/207:20:442
3229899795,13cyclictest1265-21runrttasks05:35:472
3229899794,68cyclictest0-21swapper/205:16:022
3229899794,67cyclictest0-21swapper/207:45:442
3229899794,57cyclictest0-21swapper/210:20:352
32298997939,33cyclictest20837-21grep06:45:432
32298997924,48cyclictest2246-21metacity05:02:272
3229599794,27cyclictest0-21swapper/005:30:470
3229599794,15cyclictest0-21swapper/007:25:040
3229599794,15cyclictest0-21swapper/007:25:040
3229599794,14cyclictest0-21swapper/007:40:400
3229599793,14cyclictest0-21swapper/010:05:350
32295997925,47cyclictest0-21swapper/006:27:490
32295997922,12cyclictest0-21swapper/009:30:500
3229899785,14cyclictest0-21swapper/208:17:462
3229899784,67cyclictest0-21swapper/205:20:572
3229899784,15cyclictest0-21swapper/207:01:082
3229899783,67cyclictest0-21swapper/208:41:492
32298997817,10cyclictest0-21swapper/207:45:062
3229599784,27cyclictest0-21swapper/006:50:450
3229599784,23cyclictest0-21swapper/008:31:450
3229899775,16cyclictest0-21swapper/206:50:562
3229899775,14cyclictest0-21swapper/209:55:382
3229899773,20cyclictest0-21swapper/205:30:372
32298997724,47cyclictest0-21swapper/206:00:422
3229599774,23cyclictest0-21swapper/005:20:520
3229899765,13cyclictest1265-21runrttasks08:59:142
3229899765,12cyclictest1265-21runrttasks09:28:472
3229899765,12cyclictest1265-21runrttasks09:28:472
3229899765,11cyclictest1265-21runrttasks09:44:352
3229899764,65cyclictest0-21swapper/208:55:212
3229899764,15cyclictest0-21swapper/207:14:222
3229899763,66cyclictest0-21swapper/209:50:292
32298997624,46cyclictest0-21swapper/208:10:402
3229599764,30cyclictest0-21swapper/009:55:400
3229599764,12cyclictest0-21swapper/009:05:320
3229599763,13cyclictest0-21swapper/006:10:350
32295997613,12cyclictest0-21swapper/005:01:040
32295997611,13cyclictest0-21swapper/008:50:350
3229899754,23cyclictest0-21swapper/210:05:452
3229899754,14cyclictest0-21swapper/209:01:432
3229899753,21cyclictest23369-21unixbench_multi07:55:542
32298997522,46cyclictest7071-21hwlatdetect06:15:472
32298997522,46cyclictest0-21swapper/209:05:442
32298997517,8cyclictest0-21swapper/210:02:262
3229599754,13cyclictest0-21swapper/007:30:350
3229599753,29cyclictest32686-21cpuspeed_turbos09:25:320
3229599753,29cyclictest32686-21cpuspeed_turbos09:25:320
3229899746,13cyclictest1265-21runrttasks05:51:392
3229899746,13cyclictest1265-21runrttasks05:51:392
3229899745,61cyclictest0-21swapper/209:45:372
3229899745,15cyclictest0-21swapper/205:59:122
3229899745,12cyclictest1265-21runrttasks08:36:252
3229899744,14cyclictest0-21swapper/205:41:072
3229599744,27cyclictest0-21swapper/005:29:450
3229599743,22cyclictest0-21swapper/008:35:340
3229599742,22cyclictest0-21swapper/009:25:200
3229899735,60cyclictest0-21swapper/206:25:572
3229899735,13cyclictest0-21swapper/208:07:222
32298997319,47cyclictest4591-21nscd10:15:172
32298997319,47cyclictest4591-21nscd10:15:172
32295997315,8cyclictest21661-21munin-node07:55:510
311262736,14sleep331162-21latency04:50:473
32298997223,43cyclictest24782-21cut05:45:462
240442720,4sleep324089-21cut08:00:343
240442720,4sleep324089-21cut08:00:343
3229899714,15cyclictest0-21swapper/206:20:592
3229899714,11cyclictest1265-21runrttasks06:36:452
3229899714,11cyclictest1265-21runrttasks06:36:452
32298997123,41cyclictest3235-21tune2fs09:30:372
223099670,7rtkit-daemon0-21swapper/304:58:093
223099670,6rtkit-daemon0-21swapper/305:42:443
223099670,4rtkit-daemon2229-21rtkit-daemon05:45:071
3229899665,21cyclictest0-21swapper/204:55:292
223099660,6rtkit-daemon0-21swapper/305:31:453
223099660,6rtkit-daemon0-21swapper/305:28:453
223099660,6rtkit-daemon0-21swapper/305:22:383
223099660,6rtkit-daemon0-21swapper/305:19:303
223099660,6rtkit-daemon0-21swapper/305:13:533
223099660,6rtkit-daemon0-21swapper/305:13:533
223099660,5rtkit-daemon0-21swapper/305:04:313
223099650,8rtkit-daemon0-21swapper/109:58:191
223099650,6rtkit-daemon0-21swapper/305:35:303
223099650,6rtkit-daemon0-21swapper/305:05:313
223099650,4rtkit-daemon2229-21rtkit-daemon09:40:351
223099650,4rtkit-daemon2229-21rtkit-daemon08:05:091
223099650,4rtkit-daemon2229-21rtkit-daemon08:05:091
223099650,4rtkit-daemon2229-21rtkit-daemon06:36:421
223099650,4rtkit-daemon2229-21rtkit-daemon06:36:421
223099640,9rtkit-daemon0-21swapper/109:00:291
223099640,7rtkit-daemon0-21swapper/106:31:501
223099640,3rtkit-daemon18-21rcuc/108:50:451
223099630,9rtkit-daemon0-21swapper/110:16:411
223099630,9rtkit-daemon0-21swapper/107:11:031
223099630,8rtkit-daemon0-21swapper/110:06:121
223099630,8rtkit-daemon0-21swapper/109:53:501
223099630,8rtkit-daemon0-21swapper/108:55:591
223099630,8rtkit-daemon0-21swapper/107:40:551
223099630,8rtkit-daemon0-21swapper/107:16:411
223099630,8rtkit-daemon0-21swapper/107:02:111
223099630,8rtkit-daemon0-21swapper/106:19:431
223099630,8rtkit-daemon0-21swapper/106:12:361
223099630,8rtkit-daemon0-21swapper/105:59:291
223099630,7rtkit-daemon0-21swapper/110:21:411
223099630,7rtkit-daemon0-21swapper/109:49:051
223099630,7rtkit-daemon0-21swapper/109:34:131
223099630,7rtkit-daemon0-21swapper/109:23:211
223099630,7rtkit-daemon0-21swapper/109:07:441
223099630,7rtkit-daemon0-21swapper/108:47:221
223099630,7rtkit-daemon0-21swapper/108:47:221
223099630,7rtkit-daemon0-21swapper/108:38:151
223099630,7rtkit-daemon0-21swapper/108:32:231
223099630,7rtkit-daemon0-21swapper/108:24:381
223099630,7rtkit-daemon0-21swapper/107:34:181
223099630,7rtkit-daemon0-21swapper/107:22:181
223099630,7rtkit-daemon0-21swapper/107:22:181
223099630,7rtkit-daemon0-21swapper/107:08:261
223099630,7rtkit-daemon0-21swapper/106:42:351
223099630,7rtkit-daemon0-21swapper/106:23:431
223099630,6rtkit-daemon0-21swapper/108:42:151
223099630,6rtkit-daemon0-21swapper/107:58:321
223099630,6rtkit-daemon0-21swapper/107:29:331
223099630,6rtkit-daemon0-21swapper/106:01:141
223099630,6rtkit-daemon0-21swapper/105:49:071
223099630,10rtkit-daemon0-21swapper/108:06:241
223099620,9rtkit-daemon0-21swapper/108:26:151
223099620,8rtkit-daemon0-21swapper/110:02:041
223099620,8rtkit-daemon0-21swapper/108:16:161
223099620,7rtkit-daemon0-21swapper/109:27:361
223099620,7rtkit-daemon0-21swapper/109:27:361
223099620,7rtkit-daemon0-21swapper/109:18:431
223099620,7rtkit-daemon0-21swapper/107:53:541
223099620,7rtkit-daemon0-21swapper/106:57:411
223099620,7rtkit-daemon0-21swapper/106:53:041
223099620,7rtkit-daemon0-21swapper/106:27:431
223099620,7rtkit-daemon0-21swapper/106:06:431
223099620,6rtkit-daemon0-21swapper/109:36:501
223099620,4rtkit-daemon0-21swapper/107:46:171
223099620,3rtkit-daemon0-21swapper/109:10:211
223099610,8rtkit-daemon0-21swapper/108:10:241
223099610,7rtkit-daemon0-21swapper/105:51:071
223099610,7rtkit-daemon0-21swapper/105:51:071
223099610,4rtkit-daemon0-21swapper/107:35:321
223099610,3rtkit-daemon12-21rcu_preempt06:45:491
223099610,2rtkit-daemon0-21swapper/110:14:411
223099610,2rtkit-daemon0-21swapper/110:14:411
178142582,10sleep30-21swapper/306:39:573
178142582,10sleep30-21swapper/306:39:573
127182573,46sleep312826-21grep09:50:373
32299995639,11cyclictest27308-21gltestperf08:05:413
272572554,10sleep30-21swapper/309:14:093
32299995436,11cyclictest28219-21unixbench_multi05:51:013
32299995436,11cyclictest28219-21unixbench_multi05:51:013
3229799548,37cyclictest0-21swapper/105:20:421
154642544,43sleep315474-21sleep06:35:253
32299995336,11cyclictest2087-21head08:20:403
163952532,11sleep30-21swapper/307:42:203
95262523,11sleep10-21swapper/105:15:181
95262523,11sleep10-21swapper/105:15:181
67632524,10sleep30-21swapper/309:37:113
300522522,10sleep30-21swapper/307:05:363
105662523,10sleep30-21swapper/308:39:353
46122513,42sleep10-21swapper/105:03:291
3229799515,28cyclictest0-21swapper/105:05:591
296182513,41sleep30-21swapper/307:02:543
213142513,10sleep30-21swapper/307:54:013
142362512,12sleep30-21swapper/307:40:183
106812513,42sleep30-21swapper/306:25:173
3229999504,27cyclictest0-21swapper/308:54:073
32299995033,11cyclictest26113-21grep06:55:443
3229799504,28cyclictest0-21swapper/105:25:461
3229799504,28cyclictest0-21swapper/104:55:301
236352502,10sleep30-21swapper/310:14:073
236352502,10sleep30-21swapper/310:14:073
234862503,40sleep30-21swapper/307:56:103
225312503,41sleep30-21swapper/309:04:463
116752503,41sleep10-21swapper/105:17:111
72352492,10sleep30-21swapper/309:40:253
34352492,40sleep30-21swapper/306:09:133
3229999494,27cyclictest0-21swapper/307:45:423
32299994934,9cyclictest17688-21head10:00:383
3229999484,27cyclictest0-21swapper/309:20:583
3229999484,26cyclictest0-21swapper/308:20:223
32299994831,10cyclictest11432-21tail07:30:563
3229999483,27cyclictest0-21swapper/308:25:503
32299994810,12cyclictest0-21swapper/307:10:393
295042483,11sleep30-21swapper/309:17:203
260892482,40sleep30-21swapper/305:48:173
241632483,38sleep324209-21proc_pri06:50:533
19612482,10sleep30-21swapper/309:28:203
19612482,10sleep30-21swapper/309:28:203
180842482,11sleep30-21swapper/306:40:333
164672482,10sleep30-21swapper/309:58:553
57092472,9sleep30-21swapper/306:12:443
3229999475,25cyclictest0-21swapper/308:45:373
3229999475,25cyclictest0-21swapper/308:45:373
32299994733,9cyclictest11209-21cpuspeed_turbos06:25:403
3229999473,26cyclictest0-21swapper/308:45:213
32299994729,11cyclictest10558-21hwlatdetect09:45:393
32299994717,12cyclictest0-21swapper/308:10:483
260962473,39sleep30-21swapper/310:20:033
24542473,37sleep30-21swapper/309:30:223
7952463,37sleep30-21swapper/306:03:083
3229999464,34cyclictest0-21swapper/307:25:413
3229999464,34cyclictest0-21swapper/306:15:463
32299994629,11cyclictest7768-21taskset08:30:573
213102462,12sleep30-21swapper/310:09:513
3229999454,35cyclictest1265-21runrttasks08:57:073
3229999454,33cyclictest0-21swapper/310:20:363
3229999454,25cyclictest0-21swapper/307:20:343
3229999454,25cyclictest0-21swapper/307:20:343
32299994528,10cyclictest20504-21aten_r1power_cu06:45:403
321372454,34sleep00-21swapper/004:53:530
248912453,36sleep30-21swapper/309:09:263
3229999444,33cyclictest0-21swapper/307:15:523
3229999444,32cyclictest0-21swapper/305:55:383
3229799444,24cyclictest0-21swapper/105:30:491
3229799434,21cyclictest0-21swapper/104:55:411
32297994326,10cyclictest19935-21fschecks_count05:35:471
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional