You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 13:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Tue Nov 25, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20167999734,13cyclictest21889-21cpuspeed_turbos08:06:130
243799960,6rtkit-daemon0-21swapper/012:01:330
2016799964,28cyclictest0-21swapper/008:16:130
2016799964,28cyclictest0-21swapper/008:16:130
2016799944,28cyclictest0-21swapper/011:01:120
2016799935,34cyclictest0-21swapper/007:40:590
20167999321,13cyclictest0-21swapper/010:36:200
2016799925,27cyclictest0-21swapper/010:21:190
2016799915,26cyclictest0-21swapper/009:25:580
20167999132,11cyclictest13470-21cpuspeed_turbos08:56:100
20167998828,11cyclictest27710-21tr11:41:040
2016799844,26cyclictest0-21swapper/008:45:510
2016799844,12cyclictest0-21swapper/007:15:380
243799820,6rtkit-daemon0-21swapper/011:16:500
2016799824,26cyclictest0-21swapper/008:26:260
243799810,8rtkit-daemon0-21swapper/011:30:490
243799800,9rtkit-daemon0-21swapper/109:21:241
243799790,8rtkit-daemon0-21swapper/210:53:430
243799790,8rtkit-daemon0-21swapper/009:20:540
243799770,6rtkit-daemon0-21swapper/111:50:481
2016999772,67cyclictest0-21swapper/111:31:211
243799750,5rtkit-daemon18-21rcuc/112:06:101
243799740,5rtkit-daemon16931-21ls11:16:201
92822720,4sleep334-21rcuc/308:46:183
173252720,6sleep117328-21fschecks_count10:11:091
243799700,4rtkit-daemon2436-21rtkit-daemon08:06:123
192552698,51sleep00-21swapper/006:51:250
243799680,5rtkit-daemon2436-21rtkit-daemon12:25:403
243799680,5rtkit-daemon2436-21rtkit-daemon08:36:113
243799680,4rtkit-daemon2436-21rtkit-daemon08:27:563
243799680,4rtkit-daemon2436-21rtkit-daemon07:43:513
243799670,5rtkit-daemon2436-21rtkit-daemon10:06:083
243799670,4rtkit-daemon2436-21rtkit-daemon09:57:453
20171996738,9cyclictest10458-21awk11:05:503
243799650,4rtkit-daemon2436-21rtkit-daemon10:22:143
2017099654,49cyclictest0-21swapper/209:01:262
2017099654,49cyclictest0-21swapper/209:01:262
2016999658,49cyclictest1369-21runrttasks11:36:021
243799640,4rtkit-daemon2436-21rtkit-daemon10:30:443
243799640,4rtkit-daemon2436-21rtkit-daemon10:30:443
2016999644,52cyclictest0-21swapper/111:51:171
2016999644,52cyclictest0-21swapper/111:51:171
243799630,4rtkit-daemon22471-21idleruntime-cro09:15:551
243799620,5rtkit-daemon3235-21yum-updatesd-he10:50:213
20169996213,42cyclictest13103-21sort08:55:561
20169996212,31cyclictest6391-21unixbench_multi12:01:221
20169996211,43cyclictest0-21swapper/107:51:291
20171996139,14cyclictest0-21swapper/312:16:093
20169996116,13cyclictest14521-21runrttasks11:11:221
20169996116,13cyclictest14521-21runrttasks11:11:221
20169996114,30cyclictest1015-21crond07:44:571
20169996113,41cyclictest16471-21chrt12:25:471
20171996039,13cyclictest0-21swapper/311:40:493
2016999607,43cyclictest0-21swapper/108:00:571
243799590,6rtkit-daemon0-21swapper/008:50:261
243799590,13rtkit-daemon2436-21rtkit-daemon07:36:133
20171995938,13cyclictest0-21swapper/312:00:483
2016999598,42cyclictest0-21swapper/107:16:221
2016999597,44cyclictest0-21swapper/108:12:491
20169995916,35cyclictest1243-21snmpd10:06:041
20169995914,38cyclictest3350-21munin-plugin-st08:35:561
20169995910,41cyclictest0-21swapper/109:55:541
2016999583,37cyclictest0-21swapper/107:06:181
20169995811,41cyclictest26369-21tail10:31:041
20169995810,40cyclictest0-21swapper/111:21:221
243799570,6rtkit-daemon2436-21rtkit-daemon09:51:162
243799570,5rtkit-daemon2436-21rtkit-daemon07:35:582
243799570,5rtkit-daemon2436-21rtkit-daemon07:35:582
20171995740,11cyclictest18781-21cut09:06:153
2017199573,45cyclictest0-21swapper/308:41:133
2016999578,32cyclictest0-21swapper/111:00:201
2016999577,42cyclictest0-21swapper/110:01:181
2016999574,27cyclictest0-21swapper/109:36:271
20169995719,32cyclictest19200-21aten2.4-expect10:16:061
20169995717,33cyclictest28153-21fschecks_time11:41:081
20169995714,36cyclictest23631-21awk10:25:511
20169995714,35cyclictest15967-21df_abs09:01:101
20169995714,35cyclictest15967-21df_abs09:01:101
20169995712,35cyclictest11129-21munin-node12:11:221
292402563,11sleep20-21swapper/210:36:102
2017099564,33cyclictest0-21swapper/208:16:192
2017099564,33cyclictest0-21swapper/208:16:192
2016999569,40cyclictest0-21swapper/111:09:281
2016999569,39cyclictest0-21swapper/110:26:061
2016999569,39cyclictest0-21swapper/110:26:061
2016999566,44cyclictest0-21swapper/108:16:181
2016999566,44cyclictest0-21swapper/108:16:181
2016999565,43cyclictest0-21swapper/107:36:321
2016999562,46cyclictest0-21swapper/107:01:261
20169995612,37cyclictest1369-21runrttasks08:23:221
20169995610,30cyclictest0-21swapper/109:46:061
20169995610,30cyclictest0-21swapper/109:46:061
2016799564,13cyclictest0-21swapper/009:31:270
34922554,42sleep20-21swapper/211:56:152
243799550,7rtkit-daemon2436-21rtkit-daemon07:55:353
243799550,5rtkit-daemon2436-21rtkit-daemon08:35:562
243799550,5rtkit-daemon2436-21rtkit-daemon08:20:573
243799550,5rtkit-daemon2436-21rtkit-daemon08:20:573
243799550,5rtkit-daemon2436-21rtkit-daemon07:16:142
243799550,5rtkit-daemon2436-21rtkit-daemon07:11:222
2017199559,27cyclictest0-21swapper/311:11:143
2017199559,27cyclictest0-21swapper/311:11:143
20171995510,28cyclictest0-21swapper/309:11:073
2016999558,40cyclictest29937-21open_inodes10:36:191
2016999558,40cyclictest0-21swapper/106:56:141
2016999558,39cyclictest0-21swapper/110:41:051
20169995538,10cyclictest1639-21unixbench_multi07:21:331
20169995518,30cyclictest4263-21fschecks_time08:36:131
20169995513,35cyclictest9537-21munin-node09:56:171
20169995513,35cyclictest0-21swapper/109:07:171
138332552,44sleep00-21swapper/012:18:540
243799540,6rtkit-daemon2436-21rtkit-daemon10:06:152
243799540,5rtkit-daemon2436-21rtkit-daemon10:20:522
243799540,5rtkit-daemon2436-21rtkit-daemon09:26:172
243799540,5rtkit-daemon2436-21rtkit-daemon08:26:112
243799540,5rtkit-daemon2436-21rtkit-daemon08:21:192
243799540,5rtkit-daemon2436-21rtkit-daemon07:21:223
243799540,5rtkit-daemon2436-21rtkit-daemon07:20:593
243799540,4rtkit-daemon2436-21rtkit-daemon09:50:233
243799540,4rtkit-daemon2436-21rtkit-daemon09:50:233
243799540,4rtkit-daemon2436-21rtkit-daemon06:56:082
2017199546,40cyclictest31593-21diskstats10:41:093
20170995436,10cyclictest23037-21grep09:16:082
2016999549,38cyclictest0-21swapper/108:41:271
2016999547,41cyclictest0-21swapper/108:26:111
2016999547,39cyclictest0-21swapper/110:46:091
20169995436,12cyclictest9507-21needreboot11:01:161
20169995422,13cyclictest0-21swapper/109:45:531
20169995415,32cyclictest1369-21runrttasks08:02:481
197022543,9sleep00-21swapper/011:22:070
243799530,6rtkit-daemon2436-21rtkit-daemon10:21:142
243799530,6rtkit-daemon2436-21rtkit-daemon09:31:162
243799530,5rtkit-daemon2436-21rtkit-daemon10:28:222
243799530,5rtkit-daemon2436-21rtkit-daemon10:28:222
243799530,5rtkit-daemon2436-21rtkit-daemon10:05:532
243799530,5rtkit-daemon2436-21rtkit-daemon09:55:533
243799530,5rtkit-daemon2436-21rtkit-daemon09:50:382
243799530,5rtkit-daemon2436-21rtkit-daemon09:50:382
243799530,5rtkit-daemon2436-21rtkit-daemon08:07:352
243799530,4rtkit-daemon2436-21rtkit-daemon10:16:073
2017199536,40cyclictest0-21swapper/309:40:543
2017199535,29cyclictest0-21swapper/307:46:133
2017199534,30cyclictest0-21swapper/308:21:203
20171995334,12cyclictest0-21swapper/311:45:313
2017199533,42cyclictest6839-21munin-run12:05:483
2017099539,26cyclictest0-21swapper/207:51:112
20170995336,10cyclictest610-21grep09:36:142
2016999537,39cyclictest0-21swapper/110:51:241
2016999537,38cyclictest0-21swapper/109:20:541
20169995312,28cyclictest0-21swapper/111:30:341
20169995310,36cyclictest3305-21interrupts11:56:101
2016799534,30cyclictest0-21swapper/010:00:530
2016799534,23cyclictest0-21swapper/008:25:340
20167995335,11cyclictest3160-21grep11:56:080
20167995322,12cyclictest0-21swapper/012:10:480
243799520,5rtkit-daemon2436-21rtkit-daemon10:41:212
243799520,5rtkit-daemon2436-21rtkit-daemon10:11:072
243799520,5rtkit-daemon2436-21rtkit-daemon07:36:282
243799520,5rtkit-daemon2436-21rtkit-daemon07:26:142
243799520,4rtkit-daemon2436-21rtkit-daemon10:36:213
243799520,4rtkit-daemon2436-21rtkit-daemon10:31:143
243799520,4rtkit-daemon2436-21rtkit-daemon09:56:452
243799520,4rtkit-daemon2436-21rtkit-daemon08:36:412
243799520,4rtkit-daemon2436-21rtkit-daemon07:24:592
203812522,43sleep00-21swapper/006:56:080
2017199525,29cyclictest0-21swapper/307:26:293
2017199524,41cyclictest0-21swapper/308:56:073
2017199524,40cyclictest0-21swapper/307:06:103
2017199524,39cyclictest0-21swapper/307:01:003
2017199524,28cyclictest0-21swapper/309:21:063
20171995234,11cyclictest17536-21gltestperf10:11:113
20171995234,10cyclictest18661-21gltestperf11:21:083
20171995231,14cyclictest0-21swapper/307:11:263
2017199523,42cyclictest0-21swapper/308:13:263
2017099524,41cyclictest0-21swapper/207:41:142
2016999525,40cyclictest21747-21munin-node07:46:121
20167995221,13cyclictest0-21swapper/009:46:070
20167995221,13cyclictest0-21swapper/009:46:070
243799510,5rtkit-daemon2436-21rtkit-daemon07:56:283
2017199515,27cyclictest0-21swapper/311:16:013
2017199515,27cyclictest0-21swapper/310:56:113
20171995132,12cyclictest23511-21head09:16:143
2017199513,42cyclictest0-21swapper/309:41:003
20171995128,11cyclictest0-21swapper/307:33:333
20171995128,11cyclictest0-21swapper/307:33:333
20171995118,14cyclictest0-21swapper/312:11:003
2017099514,39cyclictest0-21swapper/211:36:002
2017099514,26cyclictest0-21swapper/211:46:032
2017099513,42cyclictest0-21swapper/208:51:172
20170995120,13cyclictest0-21swapper/212:06:242
2016999514,30cyclictest0-21swapper/109:26:171
2016999513,27cyclictest0-21swapper/108:10:571
20169995115,28cyclictest1369-21runrttasks07:12:401
2016799515,28cyclictest0-21swapper/012:11:060
2016799515,28cyclictest0-21swapper/009:06:260
2016799515,28cyclictest0-21swapper/008:46:260
2016799514,29cyclictest0-21swapper/011:35:480
20167995129,14cyclictest0-21swapper/007:01:300
20167995121,13cyclictest0-21swapper/007:46:180
258972503,41sleep025095-21munin-node09:21:150
2017199504,38cyclictest0-21swapper/310:51:253
2017199504,29cyclictest0-21swapper/308:51:183
20171995031,11cyclictest32344-21aten_r1power_vo11:51:003
20171995031,11cyclictest32344-21aten_r1power_vo11:51:003
20171995029,13cyclictest16462-21grep09:01:153
20171995029,13cyclictest16462-21grep09:01:153
20171995020,14cyclictest0-21swapper/309:30:583
2017099504,37cyclictest0-21swapper/210:56:122
2017099504,28cyclictest0-21swapper/211:31:102
20170995036,9cyclictest10454-21sh11:05:502
20170995035,9cyclictest12176-21grep12:16:022
20170995033,11cyclictest27704-21cpuspeed_turbos11:41:042
20170995033,10cyclictest19956-21grep08:01:162
2017099503,20cyclictest0-21swapper/212:23:472
20170995019,13cyclictest0-21swapper/209:11:102
2016999506,29cyclictest0-21swapper/112:16:081
2016999503,34cyclictest0-21swapper/108:56:071
2016999503,29cyclictest4107-21unixbench-2d07:26:331
2016799505,28cyclictest0-21swapper/007:21:290
2016799505,27cyclictest0-21swapper/007:06:320
2016799504,28cyclictest0-21swapper/012:21:170
133672503,12sleep20-21swapper/208:56:102
96672492,40sleep20-21swapper/208:46:262
312062493,37sleep031232-21python11:46:210
2017199495,27cyclictest0-21swapper/311:46:173
2017199495,27cyclictest0-21swapper/308:35:503
20171994929,12cyclictest27574-21aten_r1power_fr09:26:063
20171994918,13cyclictest0-21swapper/307:01:353
2017099494,28cyclictest0-21swapper/212:11:072
20170994919,12cyclictest0-21swapper/210:51:192
20170994918,12cyclictest0-21swapper/207:06:282
2016999494,28cyclictest0-21swapper/106:56:011
20169994923,20cyclictest5136-21cpuspeed_turbos07:31:111
20169994923,20cyclictest5136-21cpuspeed_turbos07:31:111
20169994918,24cyclictest30203-21tr09:31:091
2016799494,28cyclictest0-21swapper/009:11:250
2016799494,28cyclictest0-21swapper/007:31:210
2016799494,28cyclictest0-21swapper/007:31:210
2016799494,27cyclictest0-21swapper/010:56:140
2016799494,27cyclictest0-21swapper/008:01:210
20167994920,12cyclictest0-21swapper/010:26:210
20167994920,12cyclictest0-21swapper/010:26:210
20167994918,13cyclictest0-21swapper/011:06:040
200082493,9sleep20-21swapper/209:10:082
43752482,40sleep00-21swapper/009:44:160
2017199485,36cyclictest0-21swapper/311:06:193
2017199484,36cyclictest0-21swapper/312:06:033
20171994834,8cyclictest20234-21munin-node11:26:003
2017099484,37cyclictest0-21swapper/211:20:492
2017099484,27cyclictest0-21swapper/211:06:072
2017099484,27cyclictest0-21swapper/207:46:362
2017099484,27cyclictest0-21swapper/207:01:152
2017099484,26cyclictest0-21swapper/209:20:572
2017099483,27cyclictest0-21swapper/211:21:182
20170994825,16cyclictest0-21swapper/211:26:162
2016799484,37cyclictest0-21swapper/007:56:230
2016799484,27cyclictest0-21swapper/010:41:090
2016799484,27cyclictest0-21swapper/010:31:180
2016799484,27cyclictest0-21swapper/008:31:220
2016799484,26cyclictest0-21swapper/007:41:250
2016799484,12cyclictest0-21swapper/010:50:510
2016799483,25cyclictest0-21swapper/007:28:340
20167994817,11cyclictest25109-21taskset11:36:000
176062483,9sleep00-21swapper/009:04:540
176062483,9sleep00-21swapper/009:04:540
16722482,40sleep00-21swapper/009:36:430
243799470,4rtkit-daemon2436-21rtkit-daemon09:41:162
20171994726,14cyclictest0-21swapper/311:31:113
2017099474,26cyclictest0-21swapper/211:51:112
2017099474,26cyclictest0-21swapper/211:51:112
2017099474,25cyclictest0-21swapper/211:11:142
2017099474,25cyclictest0-21swapper/211:11:142
2016799474,25cyclictest0-21swapper/008:55:240
20167994717,13cyclictest0-21swapper/008:11:210
197852473,6sleep20-21swapper/206:51:312
2017199467,32cyclictest12660-21fschecks_time10:01:123
2017199465,33cyclictest0-21swapper/306:56:013
20171994616,12cyclictest0-21swapper/308:01:333
2017099465,25cyclictest0-21swapper/212:01:012
2017099463,38cyclictest6831-21gltestperf08:41:152
2017099463,37cyclictest0-21swapper/210:46:072
2017099463,26cyclictest0-21swapper/207:56:202
2016799464,34cyclictest0-21swapper/007:16:250
2016799464,33cyclictest0-21swapper/010:05:520
2016799464,27cyclictest0-21swapper/009:51:060
2016799464,25cyclictest0-21swapper/008:36:070
20167994623,12cyclictest0-21swapper/011:11:100
20167994623,12cyclictest0-21swapper/011:11:100
20167994616,13cyclictest0-21swapper/010:11:190
2017099453,36cyclictest0-21swapper/208:11:292
20170994524,14cyclictest0-21swapper/210:31:022
2016799454,35cyclictest0-21swapper/007:51:160
2016799454,14cyclictest0-21swapper/010:16:050
2016799453,29cyclictest0-21swapper/010:06:460
19112452,36sleep00-21swapper/011:55:320
19112452,36sleep00-21swapper/011:55:320
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional