You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-13 - 15:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Tue May 13, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2922021250,6sleep11676899cyclictest05:11:411
1129121150,6sleep311289-21entropy10:11:363
1129121150,6sleep311289-21entropy10:11:363
227799980,4rtkit-daemon4987-21strings05:26:530
227799950,8rtkit-daemon0-21swapper/206:26:502
16768999413,32cyclictest0-21swapper/105:07:001
16768999413,32cyclictest0-21swapper/105:07:001
1676899904,41cyclictest0-21swapper/104:56:441
16768998737,10cyclictest17065-21cpuspeed_turbos09:16:311
1677099863,76cyclictest3406-21chrt06:31:432
1677099863,50cyclictest21812-21aten_r1power_en04:56:392
1677099844,73cyclictest0-21swapper/209:31:292
1677099844,72cyclictest1086-21lldpd07:46:432
1676899844,27cyclictest0-21swapper/109:01:181
1677099825,60cyclictest0-21swapper/206:16:362
1677099825,60cyclictest0-21swapper/205:01:592
1677099824,70cyclictest0-21swapper/207:41:422
1677099823,70cyclictest0-21swapper/206:21:412
1677099814,71cyclictest0-21swapper/207:21:432
1677099814,61cyclictest0-21swapper/208:16:202
1677099813,72cyclictest0-21swapper/209:21:322
16768998118,20cyclictest0-21swapper/109:46:361
1677099805,68cyclictest0-21swapper/207:36:492
1677099804,69cyclictest0-21swapper/206:06:372
1677099803,70cyclictest7202-21basename08:56:292
1677099803,70cyclictest0-21swapper/205:31:242
1677099803,63cyclictest21118-21runrttasks07:07:492
1677099794,59cyclictest0-21swapper/210:06:272
1677099794,57cyclictest0-21swapper/205:36:382
1677099794,43cyclictest0-21swapper/206:36:362
1677099794,43cyclictest0-21swapper/206:36:362
1677099793,68cyclictest8093-21idleruntime-cro10:06:142
1677099793,64cyclictest0-21swapper/208:36:302
16770997923,40cyclictest1-21systemd08:11:142
1677099784,62cyclictest0-21swapper/205:56:422
1677099784,57cyclictest0-21swapper/208:16:412
1677099783,68cyclictest0-21swapper/206:12:042
1677099783,67cyclictest0-21swapper/204:51:412
1677099783,64cyclictest0-21swapper/207:26:472
1677099775,51cyclictest0-21swapper/205:31:392
1677099774,66cyclictest0-21swapper/205:46:442
1677099774,61cyclictest0-21swapper/206:46:442
1677099774,61cyclictest0-21swapper/205:21:452
1677099774,60cyclictest0-21swapper/208:21:342
1677099773,66cyclictest9444-21crond06:46:222
1677099773,66cyclictest17015-21telnet07:01:342
1677099773,54cyclictest0-21swapper/206:01:592
1677099766,58cyclictest20133-1kworker/2:2H08:46:172
1677099765,59cyclictest0-21swapper/208:04:002
1677099765,59cyclictest0-21swapper/208:04:002
1677099764,65cyclictest0-21swapper/209:51:152
1677099764,65cyclictest0-21swapper/209:41:372
1677099764,57cyclictest1263-21runrttasks05:17:002
1677099764,53cyclictest10109-21sed09:01:332
1677099755,47cyclictest0-21swapper/204:46:562
1677099754,64cyclictest0-21swapper/209:11:452
1677099754,63cyclictest0-21swapper/207:31:542
1677099754,60cyclictest0-21swapper/207:56:332
1677099754,60cyclictest0-21swapper/205:46:052
1677099753,65cyclictest27905-21cpuspeed_turbos08:31:342
1677099744,63cyclictest0-21swapper/206:56:562
1677099743,8cyclictest1263-21runrttasks06:56:042
1677099734,63cyclictest0-21swapper/205:51:512
1677099734,63cyclictest0-21swapper/205:51:512
1677099734,62cyclictest0-21swapper/209:56:302
1677099733,63cyclictest0-21swapper/207:16:362
1677099733,63cyclictest0-21swapper/207:16:362
1677099733,46cyclictest108850irq/46-eth008:51:502
1677099723,63cyclictest0-21swapper/207:11:402
1676899724,27cyclictest0-21swapper/108:21:381
1677099714,50cyclictest0-21swapper/205:06:382
1677099714,50cyclictest0-21swapper/205:06:382
1677099713,61cyclictest2606-21python09:51:482
1677099713,60cyclictest0-21swapper/208:27:372
1677099713,57cyclictest10603-21awk07:56:192
1677099706,42cyclictest7150irq/45-ahci08:46:492
1677099706,42cyclictest7150irq/45-ahci08:46:492
1677099703,60cyclictest23074-21cat09:26:512
1677099703,60cyclictest23074-21cat09:26:512
1677099703,60cyclictest18623-21taskset09:17:532
1677099694,58cyclictest0-21swapper/209:06:502
1677099694,58cyclictest0-21swapper/205:11:422
1677099693,59cyclictest11907-21tail10:11:442
1677099693,59cyclictest11907-21tail10:11:442
16770996919,36cyclictest0-21swapper/209:36:492
1677099673,57cyclictest16943-21runrttasks04:46:272
233982650,4sleep123396-21head07:11:571
187382643,54sleep00-21swapper/007:02:540
227799630,7rtkit-daemon0-21swapper/208:16:463
227799620,5rtkit-daemon0-21swapper/207:51:473
127772622,54sleep10-21swapper/107:58:421
227799610,5rtkit-daemon0-21swapper/206:11:513
227799600,4rtkit-daemon0-21swapper/205:56:513
1677199606,12cyclictest0-21swapper/308:36:453
1676599604,46cyclictest0-21swapper/010:11:330
1676599604,46cyclictest0-21swapper/010:11:330
1676599594,45cyclictest0-21swapper/006:46:370
282072583,10sleep00-21swapper/007:22:010
227799580,5rtkit-daemon0-21swapper/207:02:493
16771995839,12cyclictest9399-21sed05:36:453
16768995840,11cyclictest0-21swapper/106:16:481
21392573,46sleep31138-21snmpd06:30:083
1676899574,37cyclictest0-21swapper/105:37:051
227799560,4rtkit-daemon2276-21rtkit-daemon09:01:440
16771995623,13cyclictest0-21swapper/305:26:583
16768995639,10cyclictest18686-21unixbench_multi04:47:011
301182553,44sleep00-21swapper/009:41:480
254182552,45sleep10-21swapper/108:26:351
230572552,11sleep30-21swapper/304:56:563
227799550,6rtkit-daemon0-21swapper/005:31:221
227799550,5rtkit-daemon2276-21rtkit-daemon08:56:520
1677199555,29cyclictest0-21swapper/309:51:473
1677199555,29cyclictest0-21swapper/305:16:463
16768995510,26cyclictest26300-21aten2.4-expect09:36:271
1676599555,42cyclictest0-21swapper/005:51:370
1676599555,42cyclictest0-21swapper/005:51:370
16765995537,11cyclictest8643-21cpuspeed_turbos10:06:290
16765995535,11cyclictest17917-21grep04:46:490
212572543,10sleep00-21swapper/007:09:390
1677199546,28cyclictest0-21swapper/306:21:533
1677199545,29cyclictest0-21swapper/309:56:343
1677199545,28cyclictest0-21swapper/306:36:413
1677199545,28cyclictest0-21swapper/306:36:413
1676599544,31cyclictest0-21swapper/009:36:150
16765995436,11cyclictest27893-21tr08:31:340
8432533,42sleep00-21swapper/005:19:310
4392533,42sleep3574-21cut08:41:373
319252533,9sleep00-21swapper/006:23:080
1677199535,29cyclictest0-21swapper/306:01:513
1677199535,28cyclictest0-21swapper/307:16:453
1677199535,28cyclictest0-21swapper/307:16:453
1677199534,25cyclictest28998-21aten2.4-expect05:11:393
1676599533,44cyclictest0-21swapper/005:01:400
16765995322,13cyclictest0-21swapper/006:16:590
154202533,10sleep00-21swapper/005:50:430
132462532,11sleep30-21swapper/309:06:483
313612523,42sleep00-21swapper/008:36:500
310492523,10sleep30-21swapper/309:46:183
200442523,10sleep00-21swapper/008:15:010
186072523,10sleep00-21swapper/009:17:410
1677199525,28cyclictest0-21swapper/309:31:373
1677199524,28cyclictest0-21swapper/308:51:183
1677199524,28cyclictest0-21swapper/308:51:183
1677199524,28cyclictest0-21swapper/307:21:343
1677199524,28cyclictest0-21swapper/307:11:593
1677199524,28cyclictest0-21swapper/307:01:213
1677199524,27cyclictest0-21swapper/306:51:353
16768995237,9cyclictest25860-21sed05:02:021
1676599525,29cyclictest0-21swapper/008:51:370
1676599524,29cyclictest0-21swapper/009:06:490
16765995233,12cyclictest27013-21unixbench_singl06:11:570
152742522,9sleep30-21swapper/305:48:483
150272523,43sleep00-21swapper/008:01:590
150272523,43sleep00-21swapper/008:01:590
72932514,9sleep00-21swapper/006:41:300
59282513,40sleep10-21swapper/108:51:421
32312513,9sleep00-21swapper/007:38:450
1677199515,27cyclictest0-21swapper/304:51:403
1677199514,36cyclictest16932-21strings05:51:523
1677199514,36cyclictest16932-21strings05:51:523
1677199514,28cyclictest0-21swapper/304:46:473
1677199514,28cyclictest0-21swapper/304:46:273
1677199514,26cyclictest0-21swapper/307:08:013
1677199514,25cyclictest0-21swapper/308:51:283
16771995134,10cyclictest15147-21tail09:11:363
16771995132,12cyclictest26572-21cpuspeed_turbos09:36:303
16771995121,12cyclictest0-21swapper/307:46:193
16771995119,14cyclictest0-21swapper/310:06:323
16771995119,13cyclictest0-21swapper/305:06:443
16771995119,13cyclictest0-21swapper/305:06:443
1676899514,28cyclictest0-21swapper/107:41:451
1676899514,28cyclictest0-21swapper/106:51:231
1676899514,24cyclictest0-21swapper/106:01:381
1676599515,28cyclictest0-21swapper/007:31:550
1676599515,27cyclictest0-21swapper/006:51:350
1676599515,27cyclictest0-21swapper/006:11:240
16765995132,12cyclictest3715-21grep06:31:480
16765995122,22cyclictest0-21swapper/007:46:440
16765995120,13cyclictest0-21swapper/006:36:530
16765995120,13cyclictest0-21swapper/006:36:530
16765995118,25cyclictest21724-21tail07:11:350
82122502,10sleep30-21swapper/305:35:143
29922503,10sleep00-21swapper/009:52:110
296572502,10sleep30-21swapper/306:19:403
28092504,39sleep00-21swapper/008:46:330
28092504,39sleep00-21swapper/008:46:330
272472503,10sleep00-21swapper/008:30:410
211382502,11sleep30-21swapper/309:24:383
1677199505,36cyclictest0-21swapper/305:21:563
1677199505,26cyclictest0-21swapper/310:01:273
1677199504,39cyclictest0-21swapper/307:32:503
1676899505,27cyclictest0-21swapper/105:41:441
1676899504,27cyclictest0-21swapper/109:31:161
1676899504,27cyclictest0-21swapper/109:31:161
16768995035,10cyclictest0-21swapper/105:51:561
16768995035,10cyclictest0-21swapper/105:51:561
16768995030,12cyclictest0-21swapper/109:06:391
1676899503,40cyclictest12128-21sendmail_mailqu10:11:491
1676899503,40cyclictest12128-21sendmail_mailqu10:11:491
16768995029,14cyclictest0-21swapper/106:36:511
16768995029,14cyclictest0-21swapper/106:36:511
1676599505,28cyclictest0-21swapper/008:06:370
1676599505,27cyclictest0-21swapper/010:01:330
1676599505,27cyclictest0-21swapper/009:11:530
1676599505,27cyclictest0-21swapper/004:56:570
16765995033,10cyclictest12718-21grep05:41:590
146252503,42sleep00-21swapper/006:56:370
90752492,40sleep30-21swapper/308:57:573
82862493,10sleep00-21swapper/005:36:120
70692493,39sleep37075-21irqstats07:46:423
271782492,10sleep30-21swapper/308:29:473
233542492,41sleep30-21swapper/309:27:243
233542492,41sleep30-21swapper/309:27:243
227799490,4rtkit-daemon2276-21rtkit-daemon05:21:380
222912493,41sleep00-21swapper/008:18:120
1677199495,26cyclictest0-21swapper/306:36:033
1677199493,26cyclictest23460-21diskstats06:06:423
1676899494,28cyclictest0-21swapper/108:41:431
16768994933,10cyclictest6409-21cpuspeed_turbos07:46:341
16768994932,10cyclictest19617-21cut07:06:361
16768994930,12cyclictest0-21swapper/110:01:481
16765994932,10cyclictest22194-21grep06:01:580
16765994930,11cyclictest28243-21grep05:07:000
16765994930,11cyclictest28243-21grep05:07:000
144712493,39sleep313216-21munin-node08:01:463
144712493,39sleep313216-21munin-node08:01:463
327442482,39sleep10-21swapper/105:16:581
306412482,10sleep10-21swapper/107:27:381
260942483,10sleep00-21swapper/007:20:320
260942483,10sleep00-21swapper/007:20:320
214022483,9sleep00-21swapper/004:55:000
212652482,40sleep10-21swapper/104:53:111
197072483,38sleep019841-21sed05:57:000
1677199486,25cyclictest0-21swapper/309:41:283
1677199484,27cyclictest0-21swapper/308:31:453
1677199484,26cyclictest0-21swapper/309:16:423
1677199484,26cyclictest0-21swapper/306:46:333
1676899484,27cyclictest0-21swapper/108:06:191
1676899484,27cyclictest0-21swapper/108:06:191
1676899484,26cyclictest0-21swapper/109:21:391
16768994835,8cyclictest15421-21runrttasks06:56:441
16768994833,11cyclictest0-21swapper/107:36:561
16768994832,11cyclictest0-21swapper/108:46:431
16768994832,11cyclictest0-21swapper/108:46:431
16768994832,11cyclictest0-21swapper/107:01:461
1676899483,24cyclictest0-21swapper/106:11:361
1676599484,26cyclictest0-21swapper/007:56:420
16765994832,10cyclictest10152-21grep07:51:540
16765994828,13cyclictest0-21swapper/007:41:510
16765994814,19cyclictest0-21swapper/009:46:450
93752473,10sleep30-21swapper/306:45:323
61602472,38sleep10-21swapper/105:31:371
305782472,11sleep10-21swapper/109:43:061
201152472,40sleep10-21swapper/108:15:591
19002473,10sleep00-21swapper/006:27:590
1677199474,26cyclictest0-21swapper/305:41:533
1677199474,24cyclictest24141-21munin-node05:01:513
1677199474,24cyclictest0-21swapper/308:11:323
1677199474,14cyclictest0-21swapper/307:56:503
1677199473,28cyclictest0-21swapper/307:26:403
1676899476,33cyclictest0-21swapper/107:31:341
1676899474,36cyclictest0-21swapper/106:31:351
16768994731,11cyclictest0-21swapper/105:22:011
16768994730,11cyclictest0-21swapper/109:56:471
1676899473,36cyclictest0-21swapper/106:41:361
16768994723,17cyclictest24455-21sort06:06:581
16768994718,24cyclictest30031-21munin-node06:21:571
1676599475,36cyclictest0-21swapper/008:41:390
1676599474,36cyclictest21841-21grep09:26:320
1676599474,36cyclictest21841-21grep09:26:320
1676599474,26cyclictest0-21swapper/005:11:440
105732472,39sleep10-21swapper/107:56:081
248052463,37sleep00-21swapper/008:24:570
1677199464,12cyclictest0-21swapper/307:41:203
1676899464,28cyclictest0-21swapper/109:31:331
1676899463,24cyclictest1256-21taskset06:26:521
16768994629,10cyclictest24316-21cpuspeed_turbos07:16:361
16768994629,10cyclictest24316-21cpuspeed_turbos07:16:361
16768994614,26cyclictest10174-21sort09:01:351
1676599464,25cyclictest0-21swapper/009:56:400
1676599463,18cyclictest0-21swapper/009:36:340
81012452,36sleep10-21swapper/110:06:151
245842452,10sleep30-21swapper/308:22:013
175922452,10sleep30-21swapper/308:09:123
1677199454,31cyclictest0-21swapper/309:06:183
1676899455,34cyclictest0-21swapper/108:16:511
1676899454,33cyclictest0-21swapper/105:56:391
1676899454,33cyclictest0-21swapper/105:46:371
1676899453,37cyclictest0-21swapper/108:09:371
16768994528,11cyclictest12678-21fschecks_count06:51:421
16768994527,11cyclictest2911-21unixbench_singl09:51:511
1676599455,33cyclictest0-21swapper/009:21:470
1676599453,38cyclictest0-21swapper/005:39:330
145822454,6sleep00-21swapper/004:41:350
1676899444,33cyclictest0-21swapper/109:11:281
16768994428,9cyclictest27559-21aten_r1power_cu08:31:311
1676899433,34cyclictest0-21swapper/107:26:201
16768994316,22cyclictest30512-21forks08:36:361
227799420,5rtkit-daemon2276-21rtkit-daemon04:41:471
16765994224,11cyclictest29616-21gltestperf07:26:410
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional