You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-20 - 03:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Wed May 20, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25070991035,29cyclictest8228-21munin-node20:01:502
2507099894,37cyclictest0-21swapper/219:59:222
248599880,4rtkit-daemon2484-21rtkit-daemon19:38:373
25071998525,52cyclictest0-21swapper/321:26:363
266012800,6sleep041ktimersoftd/019:41:050
25071998023,36cyclictest0-21swapper/319:49:143
248599790,4rtkit-daemon11886-21ssh20:53:340
25071997821,38cyclictest0-21swapper/319:02:143
25071997627,16cyclictest0-21swapper/319:07:133
25071997529,28cyclictest10423-21munin-node19:16:563
25071997430,37cyclictest10579-21gltestperf17:17:043
25071997430,37cyclictest10579-21gltestperf17:17:043
2507199739,48cyclictest0-21swapper/318:49:333
25071997329,37cyclictest22703-21runrttasks19:34:113
25071997328,28cyclictest11101-21aten_r1power_en21:41:473
25071997326,31cyclictest9637-21munin-node20:52:093
25071997325,29cyclictest0-21swapper/318:42:003
25071997322,36cyclictest0-21swapper/316:57:013
25071997321,45cyclictest17280-21cstates19:26:543
25071997321,31cyclictest0-21swapper/322:10:163
25071997321,31cyclictest0-21swapper/322:10:163
25071997227,28cyclictest3336-21ssh19:52:143
25071997225,40cyclictest0-21swapper/316:52:073
25071997224,28cyclictest25256-21kworker/3:121:16:473
25071997223,32cyclictest8969-21perl20:01:563
25071997223,27cyclictest5205-21cpuspeed_turbos19:56:523
248599720,7rtkit-daemon0-21swapper/218:37:393
248599720,7rtkit-daemon0-21swapper/218:37:393
25071997125,40cyclictest18077-21cpuspeed_turbos21:51:503
25071997124,39cyclictest0-21swapper/319:22:053
25071997124,39cyclictest0-21swapper/319:22:053
25071997124,32cyclictest0-21swapper/320:38:183
25071997123,29cyclictest15994-21cat21:47:053
25071997122,32cyclictest21762-21ssh20:21:503
25071997122,30cyclictest0-21swapper/319:11:503
25071997121,40cyclictest0-21swapper/320:07:113
25071997119,21cyclictest0-21swapper/320:31:373
25071997118,34cyclictest0-21swapper/321:29:523
25071997116,40cyclictest0-21swapper/318:58:223
25071997027,35cyclictest4814-21df_abs21:31:523
25071997027,34cyclictest25252-21fschecks_count22:01:533
25071997027,26cyclictest1419-21runrttasks20:58:353
25071997025,30cyclictest0-21swapper/320:42:073
25071997025,29cyclictest24581-21sendmail_mailtr21:12:053
25071997025,19cyclictest26307-21memory18:52:063
25071996930,32cyclictest25177-21memory17:47:083
25071996928,34cyclictest23775-21runrttasks21:59:463
25071996923,39cyclictest0-21swapper/318:27:083
25071996921,31cyclictest29014-21ssh20:31:533
25071996920,34cyclictest0-21swapper/321:01:423
25071996918,32cyclictest8774-21kernelversion21:37:043
132352693,59sleep213029-21kworker/2:219:21:412
25071996846,16cyclictest0-21swapper/317:46:453
25071996825,27cyclictest19272-21munin-node17:37:083
25071996822,31cyclictest0-21swapper/321:07:473
25071996822,26cyclictest28108-21kernelversion19:42:023
25071996821,30cyclictest0-21swapper/320:16:083
25071996818,30cyclictest0-21swapper/320:19:113
25071996817,31cyclictest0-21swapper/317:57:123
25071996817,31cyclictest0-21swapper/317:57:123
25071996813,38cyclictest0-21swapper/317:28:043
25071996811,39cyclictest0-21swapper/320:47:153
25071996811,39cyclictest0-21swapper/320:47:153
2506899685,58cyclictest0-21swapper/118:56:421
25071996715,42cyclictest0-21swapper/316:46:593
2506899677,54cyclictest0-21swapper/119:04:191
25071996631,27cyclictest1419-21runrttasks18:15:433
25071996620,26cyclictest0-21swapper/317:51:563
2506899664,55cyclictest0-21swapper/119:47:071
25071996543,16cyclictest0-21swapper/318:24:023
25071996525,25cyclictest1160-21munin-node18:06:573
2506599656,52cyclictest19183-21sed20:16:570
248599650,7rtkit-daemon0-21swapper/217:22:123
25071996417,29cyclictest0-21swapper/318:02:193
2507099644,27cyclictest0-21swapper/220:37:062
2506899646,52cyclictest0-21swapper/121:37:041
25071996328,23cyclictest15417-21crond18:36:423
25071996321,26cyclictest25690-21expr16:42:043
25071996313,42cyclictest0-21swapper/317:11:453
2507099634,28cyclictest0-21swapper/220:59:012
25071996222,34cyclictest0-21swapper/317:16:453
2506899629,47cyclictest0-21swapper/120:30:231
248599620,4rtkit-daemon2484-21rtkit-daemon21:38:022
25071996118,35cyclictest0-21swapper/317:02:153
2506899619,44cyclictest225791rm19:33:451
2506899616,49cyclictest3313-21expr20:41:501
2506899615,50cyclictest0-21swapper/119:41:561
2506899613,51cyclictest0-21swapper/120:32:081
25065996142,13cyclictest0-21swapper/021:28:440
25071996013,39cyclictest0-21swapper/318:21:433
2506899607,47cyclictest0-21swapper/122:01:551
2506899607,47cyclictest0-21swapper/121:49:461
2506899607,47cyclictest0-21swapper/121:11:521
2506899606,48cyclictest0-21swapper/120:11:581
2506899602,52cyclictest0-21swapper/118:27:091
25068996016,38cyclictest19394-21runrttasks21:06:281
25068996013,40cyclictest14745-21munin-node20:57:091
25068996010,24cyclictest0-21swapper/119:57:001
163462603,49sleep20-21swapper/220:12:072
25071995930,23cyclictest1419-21runrttasks17:32:023
2507099594,38cyclictest0-21swapper/221:26:502
2506899597,46cyclictest0-21swapper/118:20:391
25068995944,11cyclictest0-21swapper/121:31:511
25068995944,10cyclictest0-21swapper/119:39:161
25068995943,11cyclictest0-21swapper/121:58:091
25068995943,11cyclictest0-21swapper/121:53:101
25068995942,13cyclictest0-21swapper/118:57:021
25068995941,13cyclictest0-21swapper/118:49:281
25068995940,14cyclictest0-21swapper/119:20:491
25068995916,38cyclictest1419-21runrttasks21:28:431
25068995910,43cyclictest16530-21gltestperf18:37:011
25068995910,43cyclictest16530-21gltestperf18:37:011
313082589,8sleep20-21swapper/216:52:122
2506899586,45cyclictest0-21swapper/120:02:061
2506899585,47cyclictest0-21swapper/120:37:281
2506899585,47cyclictest0-21swapper/119:08:491
25068995844,10cyclictest0-21swapper/120:08:441
25068995840,13cyclictest0-21swapper/118:42:311
25068995839,13cyclictest0-21swapper/119:51:571
2507099574,36cyclictest0-21swapper/220:49:552
2507099574,36cyclictest0-21swapper/220:49:552
2506899579,43cyclictest0-21swapper/122:11:041
2506899579,43cyclictest0-21swapper/122:11:041
2506899577,44cyclictest0-21swapper/121:42:171
2506899577,44cyclictest0-21swapper/120:16:461
25068995740,13cyclictest0-21swapper/119:13:211
2506899574,47cyclictest0-21swapper/121:24:211
2506899574,47cyclictest0-21swapper/120:51:211
2506899574,47cyclictest0-21swapper/120:51:211
25068995738,14cyclictest0-21swapper/119:22:591
25068995738,14cyclictest0-21swapper/119:22:591
25068995738,13cyclictest0-21swapper/119:29:261
2506899572,49cyclictest22560-21gltestperf20:22:001
25068995713,38cyclictest19810-21taskset21:06:481
192882572,21sleep00-21swapper/019:29:080
2812925610,39sleep20-21swapper/220:31:342
2507099565,30cyclictest0-21swapper/221:16:522
2507099565,29cyclictest0-21swapper/218:58:522
2507099564,34cyclictest0-21swapper/218:51:552
2507099564,29cyclictest31811-21ps19:47:092
25070995611,26cyclictest0-21swapper/220:32:072
2506899564,46cyclictest11743-21sh20:53:011
25068995611,38cyclictest27506-21iostat21:16:581
2506599565,45cyclictest0-21swapper/021:37:060
25065995637,13cyclictest0-21swapper/019:12:130
25065995631,11cyclictest0-21swapper/020:32:120
199132563,46sleep20-21swapper/218:42:192
25070995537,11cyclictest1521-21cpuspeed_turbos18:06:562
25070995535,12cyclictest32062-21grep18:02:032
2506899559,40cyclictest25814-21unixbench_singl17:47:181
2506899553,46cyclictest0-21swapper/117:58:101
2506899553,46cyclictest0-21swapper/117:58:101
2506899553,27cyclictest20819-21sed17:37:171
25068995516,32cyclictest26594-21munin-node16:42:181
2506599554,43cyclictest0-21swapper/022:02:080
25065995512,36cyclictest1419-21runrttasks18:26:540
127072557,41sleep20-21swapper/220:56:372
2507099548,18cyclictest0-21swapper/221:52:042
25070995422,14cyclictest0-21swapper/220:10:192
25070995411,25cyclictest0-21swapper/219:42:002
2506899545,43cyclictest0-21swapper/117:16:561
2506899545,43cyclictest0-21swapper/117:16:561
25065995437,11cyclictest0-21swapper/019:52:010
25065995434,13cyclictest0-21swapper/019:04:250
2506599543,44cyclictest18670-21sed21:51:560
25065995421,27cyclictest0-21swapper/019:09:030
59962538,7sleep20-21swapper/221:32:122
271272533,10sleep00-21swapper/020:27:530
2507099539,26cyclictest0-21swapper/221:03:062
2507099535,15cyclictest0-21swapper/219:07:182
25070995336,10cyclictest17189-21cpuspeed_turbos17:31:582
25070995335,11cyclictest17403-21unixbench_singl18:37:162
25070995335,11cyclictest17403-21unixbench_singl18:37:162
2506899536,41cyclictest0-21swapper/117:46:441
2506899532,19cyclictest0-21swapper/117:56:431
25065995334,13cyclictest0-21swapper/018:42:150
25065995333,13cyclictest0-21swapper/020:48:490
25065995333,13cyclictest0-21swapper/020:48:490
25065995323,12cyclictest0-21swapper/018:37:080
25065995323,12cyclictest0-21swapper/018:37:080
44702522,9sleep00-21swapper/017:03:550
2507099525,40cyclictest0-21swapper/222:01:522
2507099525,30cyclictest0-21swapper/221:21:552
2507099525,29cyclictest0-21swapper/220:41:472
2507099525,29cyclictest0-21swapper/219:31:522
2507099525,13cyclictest0-21swapper/218:48:562
2507099524,33cyclictest0-21swapper/221:41:482
2507099524,33cyclictest0-21swapper/220:19:552
2507099524,31cyclictest0-21swapper/219:51:522
25070995236,10cyclictest18727-21unixbench_singl19:27:132
25070995235,10cyclictest4029-21grep18:11:562
25070995234,11cyclictest7134-21grep19:11:552
2507099523,34cyclictest17813-21diskmemload19:06:192
25070995221,13cyclictest0-21swapper/221:06:562
25070995217,30cyclictest28367-21df_abs22:06:492
25070995217,30cyclictest28367-21df_abs22:06:492
2506899528,38cyclictest31911-21chrt16:52:591
25068995225,8cyclictest15623-21cat18:36:431
2506599526,39cyclictest13912-21munin-node19:21:550
2506599526,39cyclictest13912-21munin-node19:21:550
2506599525,41cyclictest0-21swapper/020:01:380
2506599525,12cyclictest0-21swapper/022:06:480
2506599525,12cyclictest0-21swapper/022:06:480
25065995236,11cyclictest0-21swapper/021:21:170
25065995235,11cyclictest0-21swapper/020:15:140
25065995220,8cyclictest121850irq/46-eth019:47:350
185982522,43sleep00-21swapper/021:03:320
80192512,9sleep00-21swapper/018:18:590
25071995123,21cyclictest0-21swapper/316:41:473
2507099515,13cyclictest0-21swapper/219:38:012
2507099514,30cyclictest0-21swapper/221:11:502
2507099514,29cyclictest0-21swapper/221:46:542
2507099514,29cyclictest0-21swapper/218:31:572
2507099514,28cyclictest0-21swapper/217:51:432
2507099514,25cyclictest0-21swapper/216:42:022
2507099514,24cyclictest0-21swapper/217:57:012
2507099514,24cyclictest0-21swapper/217:57:012
25070995121,12cyclictest0-21swapper/218:31:422
25070995114,24cyclictest0-21swapper/219:22:152
25070995114,24cyclictest0-21swapper/219:22:152
2506899515,40cyclictest0-21swapper/117:08:011
25068995132,14cyclictest0-21swapper/118:06:541
2506599514,41cyclictest0-21swapper/020:01:580
2506599514,40cyclictest0-21swapper/018:52:060
2506599514,39cyclictest0-21swapper/020:56:560
25065995137,9cyclictest28361-21ntp_states19:42:060
2506599513,42cyclictest31960-21rm20:36:490
2506599513,41cyclictest0-21swapper/021:21:560
2506599513,13cyclictest0-21swapper/021:56:520
25065995110,36cyclictest41ktimersoftd/019:19:370
70282502,39sleep00-21swapper/017:11:120
282622502,42sleep00-21swapper/017:52:310
2507099505,28cyclictest0-21swapper/220:23:402
2507099504,29cyclictest0-21swapper/217:42:032
2507099504,29cyclictest0-21swapper/217:12:012
2507099504,28cyclictest0-21swapper/221:56:592
2507099504,28cyclictest0-21swapper/216:57:012
25070995020,12cyclictest0-21swapper/217:17:012
25070995020,12cyclictest0-21swapper/217:17:012
25070995019,13cyclictest0-21swapper/216:47:072
2506899509,36cyclictest0-21swapper/116:47:091
2506899507,37cyclictest0-21swapper/117:27:041
2506899506,38cyclictest0-21swapper/118:11:561
2506599504,25cyclictest25063-21awk16:41:470
25065995036,9cyclictest11572-21df_abs21:41:510
25065995033,12cyclictest0-21swapper/020:25:260
25065995032,13cyclictest0-21swapper/021:11:570
25065995032,13cyclictest0-21swapper/020:43:380
25065995032,12cyclictest0-21swapper/016:51:460
25065995024,8cyclictest121850irq/46-eth016:52:050
25065995023,12cyclictest0-21swapper/021:07:000
115422502,9sleep00-21swapper/017:17:490
115422502,9sleep00-21swapper/017:17:490
2507099495,27cyclictest0-21swapper/217:02:002
2507099494,28cyclictest0-21swapper/218:17:182
2507099494,27cyclictest0-21swapper/217:27:062
2507099494,27cyclictest0-21swapper/217:07:132
2506899494,39cyclictest0-21swapper/117:02:171
2506899492,41cyclictest0-21swapper/117:16:461
2506599499,34cyclictest0-21swapper/018:59:500
2506599499,33cyclictest41ktimersoftd/017:11:560
2506599497,37cyclictest41ktimersoftd/019:31:530
25065994923,12cyclictest0-21swapper/017:35:110
25065994921,10cyclictest2263-21latency_hist17:01:460
152592492,9sleep00-21swapper/021:46:540
2507099484,27cyclictest0-21swapper/218:26:402
2507099484,27cyclictest0-21swapper/217:22:082
2506899487,36cyclictest0-21swapper/118:26:391
2506899487,35cyclictest0-21swapper/117:35:161
2506899484,38cyclictest0-21swapper/117:01:461
25068994833,11cyclictest0-21swapper/118:03:571
2506599484,39cyclictest0-21swapper/021:31:560
25065994832,10cyclictest22279-21grep18:47:010
25065994831,12cyclictest0-21swapper/016:42:050
25065994823,8cyclictest121850irq/46-eth017:30:590
25065994821,9cyclictest15420-21latency_hist18:36:430
2507099474,26cyclictest0-21swapper/217:37:062
25070994729,11cyclictest28110-21sed17:52:162
2506899477,35cyclictest12652-21sed17:22:011
25065994731,11cyclictest0-21swapper/020:06:490
25065994727,8cyclictest121850irq/46-eth017:37:080
140102472,38sleep00-21swapper/017:23:500
6892462,38sleep00-21swapper/018:04:040
260492462,37sleep00-21swapper/017:49:490
25065994530,9cyclictest8471-21munin-node18:21:550
216552442,36sleep00-21swapper/017:41:510
25068994315,18cyclictest25046-21latency_hist16:41:471
25065994324,7cyclictest121850irq/46-eth017:57:070
25065994324,7cyclictest121850irq/46-eth017:57:070
25065994323,8cyclictest121850irq/46-eth018:13:080
25065994225,12cyclictest0-21swapper/018:10:040
248362424,31sleep20-21swapper/216:39:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional