You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 10:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Wed Dec 31, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
208532960,3sleep1201ktimersoftd/122:33:071
1249799914,12cyclictest0-21swapper/218:58:362
1249799893,12cyclictest0-21swapper/222:03:182
1249799873,12cyclictest0-21swapper/219:18:472
1249799863,12cyclictest0-21swapper/221:58:272
1249799863,12cyclictest0-21swapper/221:58:272
248599850,4rtkit-daemon2484-21rtkit-daemon23:13:340
1249799854,64cyclictest0-21swapper/219:03:302
1249799844,13cyclictest0-21swapper/220:58:262
1249799844,12cyclictest0-21swapper/221:58:082
1249799843,13cyclictest0-21swapper/222:13:202
1249799843,11cyclictest0-21swapper/222:24:382
1249799834,61cyclictest0-21swapper/222:28:212
1249799834,57cyclictest0-21swapper/219:38:282
1249799834,56cyclictest0-21swapper/223:08:242
1249799834,12cyclictest0-21swapper/223:38:342
1249799834,12cyclictest0-21swapper/219:58:472
1249799833,64cyclictest0-21swapper/222:48:382
1249799824,55cyclictest0-21swapper/219:46:462
1249799823,9cyclictest28196-21munin-node20:33:412
1249799823,9cyclictest28196-21munin-node20:33:412
1249799823,13cyclictest0-21swapper/221:28:092
1249799823,12cyclictest0-21swapper/222:33:182
1249799823,10cyclictest1419-21runrttasks19:48:292
12497998217,49cyclictest24743-21telnet21:33:212
1249799814,60cyclictest0-21swapper/220:48:222
1249799814,12cyclictest0-21swapper/218:53:462
1249799814,11cyclictest0-21swapper/221:03:232
1249799813,61cyclictest0-21swapper/223:28:372
1249799813,61cyclictest0-21swapper/223:28:372
1249799813,12cyclictest0-21swapper/219:33:392
1249799804,13cyclictest0-21swapper/223:43:332
1249799803,70cyclictest0-21swapper/223:48:252
1249799803,61cyclictest0-21swapper/220:28:252
12497998018,47cyclictest1287-21snmpd20:14:362
1249799794,67cyclictest0-21swapper/220:23:322
1249799794,12cyclictest0-21swapper/222:58:222
1249799793,60cyclictest0-21swapper/222:43:182
1249799793,60cyclictest0-21swapper/222:43:182
1249799793,59cyclictest0-21swapper/220:43:222
1249799793,59cyclictest0-21swapper/220:23:122
1249799793,12cyclictest0-21swapper/200:18:032
1249799793,12cyclictest0-21swapper/200:18:032
1249799784,15cyclictest0-21swapper/223:58:272
1249799783,12cyclictest0-21swapper/223:33:182
1249799783,12cyclictest0-21swapper/220:53:122
1249799774,11cyclictest0-21swapper/220:03:322
1249799773,65cyclictest0-21swapper/222:53:292
1249799773,54cyclictest9937-21wc22:08:282
1249799773,11cyclictest19571-21crond21:23:092
1249799764,12cyclictest0-21swapper/223:13:302
1249799763,11cyclictest0-21swapper/221:08:402
12497997617,47cyclictest0-21swapper/222:38:192
12497997613,46cyclictest121850irq/46-eth000:18:212
1249799755,9cyclictest14281-21unixbench_multi23:23:382
1249799753,12cyclictest0-21swapper/219:53:312
1249799753,12cyclictest0-21swapper/219:53:312
1249799753,12cyclictest0-21swapper/219:15:272
1249799753,12cyclictest0-21swapper/219:15:272
12497997520,48cyclictest1663-21munin-node00:08:222
1249799744,11cyclictest0-21swapper/221:43:432
1249799743,64cyclictest0-21swapper/219:28:452
1249799743,12cyclictest0-21swapper/220:08:342
1249799743,11cyclictest0-21swapper/223:03:232
12497997413,52cyclictest0-21swapper/222:18:302
12497997412,9cyclictest24780-21kworker/2:219:23:282
12497997410,41cyclictest0-21swapper/200:07:212
248599730,7rtkit-daemon12486-21cyclictest22:32:580
248599730,6rtkit-daemon0-21swapper/123:30:330
248599730,6rtkit-daemon0-21swapper/123:30:330
248599730,6rtkit-daemon0-21swapper/121:51:220
1249799733,13cyclictest0-21swapper/219:08:372
248599720,8rtkit-daemon0-21swapper/119:02:360
1249799724,12cyclictest0-21swapper/223:18:382
1249799724,12cyclictest0-21swapper/221:13:322
1249799723,11cyclictest0-21swapper/221:28:242
12497997223,42cyclictest1419-21runrttasks20:41:292
248599710,8rtkit-daemon0-21swapper/100:20:310
248599710,7rtkit-daemon0-21swapper/119:38:270
248599710,6rtkit-daemon2513-21udisks-daemon00:02:540
1249799714,59cyclictest27254-21tr23:53:182
1249799714,11cyclictest0-21swapper/221:40:092
248599700,8rtkit-daemon22433-21cpu19:13:280
248599700,8rtkit-daemon22433-21cpu19:13:280
248599700,7rtkit-daemon0-21swapper/121:40:450
248599700,7rtkit-daemon0-21swapper/119:29:270
248599700,6rtkit-daemon0-21swapper/123:18:110
248599700,6rtkit-daemon0-21swapper/122:33:130
248599700,6rtkit-daemon0-21swapper/121:53:370
248599700,6rtkit-daemon0-21swapper/121:29:380
248599700,6rtkit-daemon0-21swapper/119:58:410
248599700,6rtkit-daemon0-21swapper/119:50:410
248599700,6rtkit-daemon0-21swapper/119:34:270
248599700,6rtkit-daemon0-21swapper/119:25:420
248599700,6rtkit-daemon0-21swapper/118:55:510
1249799703,13cyclictest0-21swapper/221:48:402
248599690,7rtkit-daemon0-21swapper/121:43:300
248599690,6rtkit-daemon12-21rcu_preempt19:43:270
248599690,6rtkit-daemon0-21swapper/123:26:260
248599690,6rtkit-daemon0-21swapper/121:58:290
248599690,6rtkit-daemon0-21swapper/121:58:290
248599690,6rtkit-daemon0-21swapper/120:16:030
248599690,6rtkit-daemon0-21swapper/119:11:210
248599690,6rtkit-daemon0-21swapper/100:12:240
248599690,6rtkit-daemon0-21swapper/100:05:160
248599690,11rtkit-daemon15085-21aten_r1power_vo23:28:181
248599690,11rtkit-daemon15085-21aten_r1power_vo23:28:181
248599680,7rtkit-daemon0-21swapper/119:19:280
248599680,6rtkit-daemon0-21swapper/122:40:270
248599680,6rtkit-daemon0-21swapper/122:24:580
248599680,6rtkit-daemon0-21swapper/122:16:510
248599680,6rtkit-daemon0-21swapper/121:34:150
248599680,6rtkit-daemon0-21swapper/120:10:480
248599680,6rtkit-daemon0-21swapper/119:55:110
248599680,6rtkit-daemon0-21swapper/119:55:110
248599680,6rtkit-daemon0-21swapper/100:13:240
248599680,6rtkit-daemon0-21swapper/100:13:240
248599680,5rtkit-daemon25903-21egrep22:43:200
248599680,5rtkit-daemon25903-21egrep22:43:200
248599680,5rtkit-daemon2484-21rtkit-daemon21:28:153
248599680,5rtkit-daemon14815-21iostat_ios22:18:280
248599670,7rtkit-daemon0-21swapper/020:10:181
248599670,6rtkit-daemon0-21swapper/119:03:210
1249799665,14cyclictest0-21swapper/218:53:152
248599650,6rtkit-daemon0-21swapper/120:18:180
248599650,6rtkit-daemon0-21swapper/021:33:221
248599650,6rtkit-daemon0-21swapper/019:38:341
248599650,5rtkit-daemon12-21rcu_preempt21:48:291
248599640,4rtkit-daemon2484-21rtkit-daemon20:09:413
248599640,17rtkit-daemon41ktimersoftd/019:32:271
248599630,6rtkit-daemon0-21swapper/022:23:581
12492996311,46cyclictest0-21swapper/022:58:150
12496996127,12cyclictest1419-21runrttasks19:49:471
1249899604,50cyclictest32454-21yum-updatesd-he19:33:413
248599590,8rtkit-daemon0-21swapper/021:58:211
248599590,8rtkit-daemon0-21swapper/021:58:211
248599570,4rtkit-daemon2484-21rtkit-daemon19:08:363
1249899575,31cyclictest0-21swapper/320:23:113
12498995722,13cyclictest0-21swapper/323:18:053
290952564,14sleep10-21swapper/120:33:341
290952564,14sleep10-21swapper/120:33:341
248599560,4rtkit-daemon2484-21rtkit-daemon22:38:203
1249899564,28cyclictest0-21swapper/320:33:413
1249899564,28cyclictest0-21swapper/320:33:413
12498995624,13cyclictest0-21swapper/319:18:383
12498995621,13cyclictest0-21swapper/319:58:133
12498995621,13cyclictest0-21swapper/319:58:133
12498995620,14cyclictest0-21swapper/323:33:293
12498995620,12cyclictest0-21swapper/322:58:263
12498995619,13cyclictest0-21swapper/318:58:283
1249699565,13cyclictest0-21swapper/119:55:531
1249699565,13cyclictest0-21swapper/119:55:531
12496995641,10cyclictest26116-21tr20:28:281
248599550,6rtkit-daemon0-21swapper/019:01:581
1249899556,28cyclictest0-21swapper/323:43:353
1249899555,28cyclictest0-21swapper/319:28:283
1249899555,26cyclictest0-21swapper/320:14:523
1249899554,29cyclictest0-21swapper/319:53:113
1249899554,29cyclictest0-21swapper/318:58:153
1249899554,28cyclictest0-21swapper/323:48:163
1249899554,28cyclictest0-21swapper/322:08:423
1249899554,28cyclictest0-21swapper/320:43:113
1249899554,27cyclictest0-21swapper/322:48:063
1249899554,27cyclictest0-21swapper/322:48:063
1249899554,27cyclictest0-21swapper/321:58:083
1249899554,27cyclictest0-21swapper/321:33:293
1249899554,27cyclictest0-21swapper/319:03:273
1249899554,26cyclictest0-21swapper/323:28:253
1249899554,26cyclictest0-21swapper/323:28:253
1249899554,26cyclictest0-21swapper/322:23:073
12498995520,12cyclictest0-21swapper/300:23:033
1249299558,41cyclictest0-21swapper/020:53:430
273002543,44sleep327398-21df21:38:253
27262543,46sleep00-21swapper/020:46:390
248599540,8rtkit-daemon0-21swapper/019:43:341
248599540,8rtkit-daemon0-21swapper/019:03:431
248599540,6rtkit-daemon12322-21cut19:58:341
1249899546,26cyclictest21649-21yum-updatesd-he22:33:343
1249899545,28cyclictest0-21swapper/322:53:253
1249899545,27cyclictest0-21swapper/321:23:263
1249899545,25cyclictest0-21swapper/320:29:543
1249899544,29cyclictest0-21swapper/320:43:233
1249899544,28cyclictest0-21swapper/322:30:133
1249899544,28cyclictest0-21swapper/321:13:473
1249899544,27cyclictest0-21swapper/323:53:253
1249899544,26cyclictest0-21swapper/319:59:493
1249899544,24cyclictest1419-21runrttasks23:05:183
12498995425,12cyclictest0-21swapper/300:14:163
12498995425,12cyclictest0-21swapper/300:14:163
12498995410,20cyclictest0-21swapper/321:43:233
12496995440,8cyclictest28180-21needreboot21:38:351
1249699544,12cyclictest4668-21munin-node23:03:371
1249699544,12cyclictest0-21swapper/100:03:261
12496995417,30cyclictest0-21swapper/122:13:071
1249299544,33cyclictest0-21swapper/021:03:210
12492995431,17cyclictest1419-21runrttasks23:33:230
248599530,7rtkit-daemon0-21swapper/018:53:441
1249899535,29cyclictest0-21swapper/323:18:323
1249899535,29cyclictest0-21swapper/321:48:443
1249899535,25cyclictest0-21swapper/323:25:223
1249899534,28cyclictest0-21swapper/320:23:423
1249899534,28cyclictest0-21swapper/320:03:293
1249899534,27cyclictest0-21swapper/321:13:103
1249699534,26cyclictest23181-21crond20:23:111
12492995335,10cyclictest14745-21cut20:03:310
12492995320,24cyclictest8527-21fschecks_count20:58:280
5932523,10sleep10-21swapper/122:58:191
312222523,10sleep10-21swapper/100:00:051
305712522,10sleep00-21swapper/020:38:170
248599520,5rtkit-daemon2484-21rtkit-daemon18:48:363
248599520,5rtkit-daemon0-21swapper/000:08:391
138632523,10sleep10-21swapper/120:03:191
1249899525,27cyclictest0-21swapper/321:58:203
1249899525,27cyclictest0-21swapper/321:58:203
1249899524,27cyclictest0-21swapper/322:03:393
1249699525,27cyclictest1419-21runrttasks22:53:381
12496995220,14cyclictest0-21swapper/122:35:141
12496995220,13cyclictest0-21swapper/123:48:291
12496995217,13cyclictest0-21swapper/119:33:431
89882513,41sleep30-21swapper/320:58:353
311722512,10sleep30-21swapper/323:59:273
1249899515,26cyclictest0-21swapper/322:24:503
1249899515,25cyclictest0-21swapper/322:50:163
1249699515,27cyclictest0-21swapper/123:33:261
1249699514,27cyclictest0-21swapper/121:13:101
1249699514,26cyclictest0-21swapper/121:13:251
12496995132,11cyclictest23951-21unixbench_singl21:28:451
12496995120,13cyclictest0-21swapper/123:08:261
50072503,41sleep00-21swapper/020:50:180
248599500,6rtkit-daemon5791-21sort00:13:391
248599500,6rtkit-daemon5791-21sort00:13:391
1249699505,27cyclictest0-21swapper/122:38:371
1249699505,27cyclictest0-21swapper/120:43:341
1249699505,27cyclictest0-21swapper/119:13:411
1249699505,27cyclictest0-21swapper/119:13:411
1249699505,27cyclictest0-21swapper/100:18:241
1249699505,26cyclictest0-21swapper/119:09:381
1249699504,28cyclictest0-21swapper/120:13:321
1249699504,27cyclictest0-21swapper/123:43:291
1249699504,27cyclictest0-21swapper/123:38:301
1249699504,27cyclictest0-21swapper/121:53:401
1249699504,27cyclictest0-21swapper/120:23:421
1249699504,26cyclictest0-21swapper/122:17:391
12496995020,12cyclictest0-21swapper/121:00:001
1249299504,28cyclictest0-21swapper/021:08:310
12492995028,9cyclictest17423-21munin-node21:18:270
12492995021,13cyclictest0-21swapper/022:48:290
40962493,8sleep14104-21iostat_ios20:48:331
1249699495,26cyclictest0-21swapper/121:20:021
1249699495,25cyclictest0-21swapper/122:50:161
1249699494,27cyclictest0-21swapper/122:43:301
1249699494,27cyclictest0-21swapper/122:43:301
1249699494,26cyclictest0-21swapper/121:05:001
12496994918,12cyclictest13139-21diskstats23:23:221
12496994917,14cyclictest0-21swapper/122:20:111
12492994921,13cyclictest0-21swapper/021:13:270
12492994921,12cyclictest0-21swapper/020:33:400
12492994921,12cyclictest0-21swapper/020:33:400
12492994919,13cyclictest0-21swapper/023:08:050
85852483,38sleep00-21swapper/022:05:380
54772483,39sleep10-21swapper/120:53:211
12498994831,10cyclictest31817-21aten_r1power_po00:03:173
1249899482,41cyclictest0-21swapper/320:48:263
12498994818,9cyclictest19572-21crond21:23:093
1249699485,27cyclictest0-21swapper/123:18:171
1249699484,26cyclictest6723-21aten2.4-expect22:03:191
1249699484,26cyclictest0-21swapper/121:43:241
1249699483,26cyclictest0-21swapper/121:23:391
12496994816,13cyclictest0-21swapper/123:13:291
12492994831,11cyclictest27248-21cpuspeed_turbos23:53:180
12492994827,9cyclictest30529-21munin-node22:53:270
12492994826,9cyclictest19745-21munin-node23:38:190
324352473,39sleep10-21swapper/120:39:261
265382473,38sleep10-21swapper/119:19:501
248262472,38sleep00-21swapper/023:48:190
247402472,39sleep00-21swapper/020:23:410
239902472,39sleep00-21swapper/023:44:040
133312472,9sleep30-21swapper/322:15:123
1249899475,26cyclictest0-21swapper/323:10:193
1249899474,26cyclictest0-21swapper/320:53:393
12498994718,12cyclictest0-21swapper/319:23:393
1249699474,25cyclictest0-21swapper/119:23:361
12496994734,8cyclictest27744-21grep23:53:231
12492994734,9cyclictest27525-21unixbench_multi20:28:470
1249899469,10cyclictest0-21swapper/323:38:303
1249899465,25cyclictest0-21swapper/319:39:453
1249899464,25cyclictest0-21swapper/300:10:293
12498994626,13cyclictest23323-21latency19:13:383
12498994626,13cyclictest23323-21latency19:13:383
1249299463,37cyclictest0-21swapper/022:09:410
12492994622,10cyclictest0-21swapper/023:08:390
216202452,37sleep00-21swapper/021:23:470
12498994515,13cyclictest0-21swapper/319:44:463
1249899434,21cyclictest0-21swapper/321:03:223
1249299434,31cyclictest0-21swapper/018:53:160
124172414,32sleep10-21swapper/118:52:421
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional