You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-28 - 08:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Tue Apr 28, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1580899964,73cyclictest31221ssh20:27:402
1580899964,73cyclictest16461-21ssh20:47:402
15808999616,9cyclictest26279-21ssh21:02:352
15808999611,13cyclictest0-21swapper/220:02:462
1580899944,66cyclictest0-21swapper/221:23:072
1580899944,24cyclictest7280-21yum-updatesd-he19:47:322
248599920,4rtkit-daemon2484-21rtkit-daemon22:12:373
1580899929,63cyclictest15061-21taskset22:22:272
1580899925,70cyclictest0-21swapper/219:18:262
1580899925,68cyclictest0-21swapper/220:27:192
1580899925,68cyclictest0-21swapper/220:27:192
1580899924,69cyclictest0-21swapper/221:38:132
1580899924,65cyclictest0-21swapper/219:53:222
1580899924,63cyclictest0-21swapper/221:42:472
1580899924,19cyclictest25673-21kworker/2:122:22:052
1580899915,67cyclictest0-21swapper/217:12:372
1580899914,66cyclictest0-21swapper/220:07:542
1580899914,62cyclictest0-21swapper/217:48:502
15808999118,48cyclictest0-21swapper/219:38:062
1580899907,61cyclictest0-21swapper/220:54:202
1580899905,61cyclictest0-21swapper/221:56:032
1580899905,61cyclictest0-21swapper/221:56:032
1580899904,69cyclictest0-21swapper/219:27:562
1580899904,63cyclictest0-21swapper/222:09:542
1580899904,62cyclictest0-21swapper/221:48:462
1580899904,62cyclictest0-21swapper/219:13:272
1580899904,13cyclictest14198-21munin-node21:32:342
1580899903,66cyclictest0-21swapper/221:07:402
1580899899,12cyclictest0-21swapper/221:57:462
1580899895,59cyclictest0-21swapper/222:13:552
1580899894,61cyclictest0-21swapper/219:42:312
1580899894,61cyclictest0-21swapper/219:42:312
1580899893,24cyclictest13324-21grep20:42:442
15808998914,10cyclictest0-21swapper/221:27:192
1580899885,60cyclictest0-21swapper/219:35:042
1580899884,68cyclictest0-21swapper/220:57:512
1580899884,61cyclictest0-21swapper/221:12:552
1580899884,58cyclictest0-21swapper/218:52:432
1580899884,58cyclictest0-21swapper/218:32:372
1580899884,22cyclictest0-21swapper/220:14:582
1580899874,67cyclictest0-21swapper/220:37:432
1580899874,63cyclictest0-21swapper/217:38:482
1580899874,63cyclictest0-21swapper/217:38:482
1580899874,59cyclictest0-21swapper/217:07:532
15808998719,48cyclictest0-21swapper/217:57:582
15808998713,12cyclictest0-21swapper/219:57:542
15808998712,9cyclictest19998-21unixbench_multi22:27:482
1580899869,60cyclictest0-21swapper/221:17:412
1580899864,63cyclictest0-21swapper/217:28:462
1580899864,62cyclictest0-21swapper/218:07:562
1580899864,60cyclictest0-21swapper/219:11:272
1580899864,60cyclictest0-21swapper/219:06:252
1580899864,58cyclictest0-21swapper/219:24:442
15808998620,48cyclictest1492-21yum-updatesd-he18:47:402
15808998616,54cyclictest0-21swapper/222:06:252
15808998613,11cyclictest0-21swapper/220:34:402
15803998629,37cyclictest0-21swapper/019:42:530
15803998629,37cyclictest0-21swapper/019:42:530
1580899854,62cyclictest0-21swapper/218:57:432
1580899854,22cyclictest17534-21kworker/2:020:17:372
15803998528,48cyclictest0-21swapper/022:22:360
1580899845,56cyclictest0-21swapper/218:22:552
1580899845,56cyclictest0-21swapper/218:22:552
15803998433,30cyclictest0-21swapper/021:44:200
15803998432,43cyclictest0-21swapper/020:47:310
15803998334,41cyclictest0-21swapper/019:37:500
15803998333,31cyclictest5815-21ssh21:20:010
15803998235,39cyclictest12163-21cut22:17:330
15803998233,19cyclictest0-21swapper/019:25:050
15803998231,32cyclictest8704-21ssh19:47:510
1580899814,60cyclictest0-21swapper/218:17:402
1580899814,60cyclictest0-21swapper/218:17:402
1580899814,22cyclictest0-21swapper/217:18:452
1580899814,16cyclictest0-21swapper/217:22:422
15808998126,48cyclictest32133-21fschecks_count18:42:392
15803998136,36cyclictest1419-21runrttasks21:33:170
15803998134,39cyclictest26214-21aten2.4-expect19:27:320
15803998131,43cyclictest0-21swapper/020:02:510
15803998130,31cyclictest27493-21munin-node20:17:500
15803998129,45cyclictest0-21swapper/020:12:190
15803998129,44cyclictest0-21swapper/019:32:360
15803998125,48cyclictest0-21swapper/021:47:370
1580899804,58cyclictest0-21swapper/217:07:272
15803998031,42cyclictest0-21swapper/022:07:290
15803998030,42cyclictest0-21swapper/022:02:500
15803998025,47cyclictest0-21swapper/021:32:070
15803997930,42cyclictest15928-21rm19:57:550
15803997930,42cyclictest0-21swapper/021:22:420
15803997930,42cyclictest0-21swapper/018:42:360
15803997929,42cyclictest0-21swapper/017:47:360
15803997928,43cyclictest16315-21ssh19:12:370
15803997927,44cyclictest0-21swapper/022:12:350
15803997927,34cyclictest0-21swapper/022:31:090
15803997926,46cyclictest0-21swapper/020:35:500
15803997926,32cyclictest0-21swapper/019:52:370
15803997924,46cyclictest0-21swapper/020:17:140
1580899784,67cyclictest0-21swapper/218:37:472
1580899784,13cyclictest0-21swapper/217:02:272
1580899784,13cyclictest0-21swapper/217:02:272
15803997857,14cyclictest27202-21cpuspeed_turbos21:52:300
15803997857,14cyclictest27202-21cpuspeed_turbos21:52:300
15803997830,32cyclictest0-21swapper/018:47:350
15803997829,40cyclictest25102-21ssh21:01:340
15803997825,45cyclictest0-21swapper/021:16:420
15803997824,48cyclictest0-21swapper/021:41:220
15803997823,47cyclictest0-21swapper/021:07:500
248599770,4rtkit-daemon2484-21rtkit-daemon20:33:481
1580899774,65cyclictest0-21swapper/218:12:482
1580899774,55cyclictest0-21swapper/217:43:492
15803997734,35cyclictest15164-21crond20:47:170
15803997733,26cyclictest10266-21python19:02:530
15803997730,26cyclictest1527-21netstat17:37:520
15803997730,26cyclictest1527-21netstat17:37:520
15803997728,30cyclictest0-21swapper/018:12:520
15803997727,32cyclictest0-21swapper/020:37:330
15803997631,38cyclictest32392-21mailstats20:22:490
15803997631,38cyclictest32392-21mailstats20:22:490
15803997631,37cyclictest13451-21munin-node19:07:480
15803997631,37cyclictest0-21swapper/020:27:280
15803997629,40cyclictest0-21swapper/021:57:330
1580899754,22cyclictest0-21swapper/218:27:362
15808997515,12cyclictest0-21swapper/217:52:382
15803997534,25cyclictest19558-21cpuspeed_turbos19:17:340
15803997532,35cyclictest20261-21tune2fs18:17:420
15803997532,35cyclictest20261-21tune2fs18:17:420
15803997531,25cyclictest0-21swapper/018:27:350
15803997525,32cyclictest0-21swapper/018:06:470
15803997525,30cyclictest0-21swapper/017:17:260
15803997427,39cyclictest0-21swapper/021:02:340
15803997427,31cyclictest0-21swapper/020:55:570
15803997427,28cyclictest0-21swapper/018:57:360
1580899724,16cyclictest0-21swapper/218:07:062
15803997228,28cyclictest0-21swapper/018:37:470
15803997225,41cyclictest0-21swapper/017:27:250
15803997223,42cyclictest0-21swapper/018:07:430
1580899715,12cyclictest0-21swapper/217:32:462
15803997127,28cyclictest0-21swapper/017:04:090
15803997125,40cyclictest28258-21tr17:27:390
15803997048,15cyclictest15804-21awk17:02:260
15803997048,15cyclictest15804-21awk17:02:260
15803997025,37cyclictest0-21swapper/017:57:440
15803996930,32cyclictest27627-21wget18:32:440
15803996927,35cyclictest2828-21munin-node17:42:470
15803996923,30cyclictest0-21swapper/018:52:520
15803996718,40cyclictest0-21swapper/017:52:380
15803996627,32cyclictest1419-21runrttasks18:23:220
15803996627,32cyclictest1419-21runrttasks18:23:220
15803996528,21cyclictest0-21swapper/017:10:090
15803996524,34cyclictest0-21swapper/017:32:420
15803996517,42cyclictest0-21swapper/017:19:460
248599640,5rtkit-daemon2484-21rtkit-daemon22:08:073
248599610,7rtkit-daemon0-21swapper/119:12:143
1580999604,49cyclictest0-21swapper/320:33:113
1580799593,50cyclictest0-21swapper/120:38:281
248599580,5rtkit-daemon20805-21runrttasks22:30:213
15809995839,11cyclictest19258-21gltestperf17:07:483
1580999582,42cyclictest0-21swapper/319:55:123
15809995816,23cyclictest34-21rcuc/319:32:323
100292583,48sleep10-21swapper/119:51:051
319942563,11sleep30-21swapper/320:22:443
319942563,11sleep30-21swapper/320:22:443
1580799563,45cyclictest1625-21missed_timers19:37:471
302222552,45sleep130246-21ssh21:07:451
15809995516,17cyclictest21979-21missed_timers20:07:453
15807995513,24cyclictest23706-21telnet21:47:271
248599540,5rtkit-daemon2484-21rtkit-daemon21:17:171
1580999548,40cyclictest0-21swapper/321:32:153
1580999547,28cyclictest0-21swapper/321:52:473
1580999547,28cyclictest0-21swapper/321:52:473
1580799545,30cyclictest0-21swapper/121:57:151
1580799545,30cyclictest0-21swapper/121:57:151
1580799544,43cyclictest0-21swapper/120:47:391
15807995438,10cyclictest11326-21grep21:27:421
15807995436,11cyclictest11797-21cpuspeed_turbos22:17:291
134112542,9sleep30-21swapper/320:42:473
51872533,44sleep33977-21munin-node18:52:463
248599530,4rtkit-daemon2484-21rtkit-daemon17:42:481
1580999534,30cyclictest0-21swapper/321:47:393
1580999534,27cyclictest7314-21ssh19:47:323
15809995317,29cyclictest14066-21unixbench-2d18:02:583
15807995321,13cyclictest0-21swapper/119:22:531
73132522,10sleep30-21swapper/317:51:513
1580999524,29cyclictest0-21swapper/320:47:423
1580999524,29cyclictest0-21swapper/318:47:393
15809995234,10cyclictest2134-21head22:02:353
1580799525,13cyclictest0-21swapper/119:08:121
1580799524,29cyclictest19102-21gltestperf22:27:341
1580799524,15cyclictest0-21swapper/121:24:491
15807995212,23cyclictest8279-21cpu22:12:281
140232523,42sleep114078-21aten_r1power_en19:57:301
275822513,9sleep10-21swapper/117:25:411
25812513,12sleep30-21swapper/319:38:253
223882513,40sleep10-21swapper/121:44:051
190732512,10sleep30-21swapper/318:14:133
1580999515,14cyclictest0-21swapper/320:16:103
1580999514,41cyclictest0-21swapper/320:17:413
1580999514,32cyclictest0-21swapper/320:41:203
1580999513,32cyclictest0-21swapper/321:12:573
15809995121,13cyclictest0-21swapper/319:22:473
1580799514,26cyclictest19567-21perl20:52:361
1580799514,14cyclictest0-21swapper/120:15:281
1580799514,12cyclictest0-21swapper/121:37:361
15807995121,13cyclictest0-21swapper/118:08:001
1580999504,29cyclictest0-21swapper/322:18:383
1580999504,28cyclictest0-21swapper/321:22:293
1580999504,28cyclictest0-21swapper/317:27:533
1580999504,13cyclictest0-21swapper/321:39:383
15809995033,11cyclictest30623-21tr21:57:303
15809995020,13cyclictest0-21swapper/319:28:103
15809995020,13cyclictest0-21swapper/317:32:483
15809995019,13cyclictest0-21swapper/318:07:443
15809995015,13cyclictest0-21swapper/319:02:583
15809995011,32cyclictest34-21rcuc/319:12:513
1580799505,27cyclictest0-21swapper/121:58:071
1580799504,39cyclictest0-21swapper/119:27:341
1580799504,30cyclictest0-21swapper/120:02:371
1580799504,11cyclictest1419-21runrttasks20:57:371
1580799504,11cyclictest10240-21sendmail_mailqu19:02:521
1580799503,31cyclictest0-21swapper/118:17:441
1580799503,31cyclictest0-21swapper/118:17:441
1580799503,21cyclictest0-21swapper/121:37:101
15807995029,13cyclictest0-21swapper/122:02:301
178762492,9sleep10-21swapper/117:03:361
1580999494,28cyclictest0-21swapper/321:17:283
1580999494,27cyclictest0-21swapper/321:02:283
1580999494,27cyclictest0-21swapper/320:57:423
1580999494,27cyclictest0-21swapper/319:42:543
1580999494,27cyclictest0-21swapper/319:42:543
1580999494,27cyclictest0-21swapper/318:17:403
1580999494,27cyclictest0-21swapper/318:17:403
1580999494,27cyclictest0-21swapper/317:52:423
1580999494,27cyclictest0-21swapper/317:42:453
1580999494,27cyclictest0-21swapper/317:37:583
1580999494,27cyclictest0-21swapper/317:37:583
1580999494,25cyclictest0-21swapper/319:17:363
1580999493,39cyclictest0-21swapper/317:17:503
1580999493,28cyclictest0-21swapper/320:27:283
1580999493,21cyclictest0-21swapper/321:09:363
15809994919,13cyclictest0-21swapper/320:52:403
1580799499,32cyclictest0-21swapper/117:07:411
1580799495,27cyclictest0-21swapper/119:12:271
1580799494,38cyclictest0-21swapper/119:17:501
1580799494,37cyclictest6981-21uniq18:57:401
1580799494,27cyclictest0-21swapper/118:27:481
1580799494,26cyclictest0-21swapper/122:07:531
1580799494,25cyclictest16583-21sed22:22:481
15807994920,13cyclictest0-21swapper/119:34:291
15807994920,12cyclictest0-21swapper/120:43:301
275962482,38sleep10-21swapper/121:03:261
1580999486,11cyclictest0-21swapper/322:22:223
1580999484,27cyclictest0-21swapper/321:33:023
1580999484,27cyclictest0-21swapper/318:32:473
1580999484,27cyclictest0-21swapper/317:12:363
1580999484,27cyclictest0-21swapper/317:02:393
1580999484,26cyclictest0-21swapper/318:22:593
1580999484,26cyclictest0-21swapper/318:22:593
1580999484,25cyclictest0-21swapper/320:03:313
1580999483,18cyclictest0-21swapper/321:44:393
1580799484,37cyclictest0-21swapper/120:17:371
1580799484,36cyclictest0-21swapper/120:07:341
1580799484,27cyclictest0-21swapper/120:26:521
1580799484,27cyclictest0-21swapper/120:26:521
1580799484,26cyclictest0-21swapper/119:52:371
1580799484,24cyclictest0-21swapper/117:47:471
15807994831,11cyclictest31193-21gltestperf17:32:451
15807994820,12cyclictest0-21swapper/121:17:351
15807994820,12cyclictest0-21swapper/119:42:421
15807994820,12cyclictest0-21swapper/119:42:421
119452483,38sleep30-21swapper/317:59:503
275442472,10sleep30-21swapper/317:25:113
1580999474,27cyclictest0-21swapper/319:57:453
1580999474,26cyclictest0-21swapper/318:59:113
1580999474,26cyclictest0-21swapper/317:02:273
1580999474,26cyclictest0-21swapper/317:02:273
15809994723,9cyclictest34-21rcuc/318:37:383
1580799474,12cyclictest0-21swapper/120:27:421
1580799474,11cyclictest0-21swapper/117:12:551
15807994730,11cyclictest11755-21unixbench_singl17:57:591
1580799473,20cyclictest0-21swapper/118:47:461
1580799464,35cyclictest0-21swapper/118:12:451
1580799464,26cyclictest0-21swapper/117:57:251
1580799464,25cyclictest0-21swapper/118:39:081
1580999454,25cyclictest0-21swapper/318:29:043
1580799454,33cyclictest0-21swapper/117:02:281
1580799454,33cyclictest0-21swapper/117:02:281
1580799454,27cyclictest0-21swapper/118:32:411
1580799453,37cyclictest0-21swapper/118:53:351
15807994515,13cyclictest0-21swapper/118:22:551
15807994515,13cyclictest0-21swapper/118:22:551
24262442,35sleep10-21swapper/117:40:491
24262442,35sleep10-21swapper/117:40:491
1580999446,12cyclictest0-21swapper/318:42:503
1580799444,34cyclictest0-21swapper/118:42:471
15807994213,24cyclictest28191-21cat17:27:391
1580799417,21cyclictest0-21swapper/117:22:261
15807994023,10cyclictest12446-21aten_r1power_en18:02:361
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional