You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-18 - 19:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Thu Jun 18, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2067799885,74cyclictest0-21swapper/012:05:570
2067799874,77cyclictest23256-21gltestperf09:50:560
2067799874,77cyclictest23256-21gltestperf09:50:560
2067799874,48cyclictest0-21swapper/009:24:360
20677998412,56cyclictest16344-21crond12:05:320
2067799838,66cyclictest2942-21ls11:45:330
2067799824,59cyclictest2582-21munin-node10:55:540
2067799824,57cyclictest0-21swapper/010:46:020
2067799822,65cyclictest0-21swapper/006:56:040
20677998210,51cyclictest19034-21head09:45:480
2067799813,72cyclictest0-21swapper/010:53:240
2067799808,66cyclictest134141diskmemload10:43:570
2067799804,69cyclictest0-21swapper/011:50:500
2067799803,71cyclictest0-21swapper/009:30:550
20677998013,44cyclictest9983-21aten2.4-expect11:55:450
20677998013,44cyclictest9983-21aten2.4-expect11:55:450
2067799798,59cyclictest10973-21ssh10:20:540
2067799796,67cyclictest0-21swapper/009:11:080
2067799795,66cyclictest19086-21df_abs11:20:490
2067799794,68cyclictest8018-21taskset11:05:120
2067799794,53cyclictest0-21swapper/008:57:520
2067799793,70cyclictest32455-21gltestperf08:20:590
20677997918,41cyclictest0-21swapper/010:29:440
20677997918,41cyclictest0-21swapper/010:29:440
20677997917,56cyclictest5845-21df_abs07:25:570
2067799784,67cyclictest0-21swapper/010:03:460
2067799784,42cyclictest0-21swapper/007:00:530
2067799784,42cyclictest0-21swapper/007:00:530
2067799783,68cyclictest26323-21iostat_ios11:30:570
2067799783,68cyclictest15022-21chrt09:39:250
2067799783,57cyclictest0-21swapper/008:54:360
2067799774,66cyclictest0-21swapper/011:10:470
2067799774,66cyclictest0-21swapper/011:10:470
2067799774,66cyclictest0-21swapper/010:36:000
2067799774,53cyclictest0-21swapper/009:10:390
2067799774,53cyclictest0-21swapper/009:10:390
2067799773,68cyclictest21499-21python12:11:010
20677997718,41cyclictest0-21swapper/011:37:500
20677997715,44cyclictest0-21swapper/009:16:150
219499760,27rtkit-daemon2193-21rtkit-daemon07:01:021
219499760,27rtkit-daemon2193-21rtkit-daemon07:01:021
219499760,25rtkit-daemon0-21swapper/206:53:333
2067799768,52cyclictest0-21swapper/009:00:450
2067799764,66cyclictest0-21swapper/009:26:070
2067799764,53cyclictest0-21swapper/011:05:490
2067799763,66cyclictest4167-21diskstats10:10:510
2067799763,66cyclictest16404-21perl09:40:560
2067799763,66cyclictest1520-21processes10:06:060
2067799763,66cyclictest0-21swapper/008:06:010
2067799754,64cyclictest13414-21diskmemload10:15:590
2067799753,66cyclictest13414-21diskmemload11:45:480
2067799753,66cyclictest0-21swapper/011:25:540
2067799753,66cyclictest0-21swapper/010:30:530
2067799753,66cyclictest0-21swapper/010:30:530
2067799753,56cyclictest0-21swapper/011:17:050
2067799753,32cyclictest0-21swapper/008:35:560
20677997518,37cyclictest0-21swapper/008:40:510
2067799745,51cyclictest0-21swapper/009:57:140
20677997428,39cyclictest10217-21aten_r1power_po07:35:540
219499730,22rtkit-daemon0-21swapper/206:59:253
2067799733,64cyclictest0-21swapper/012:16:320
2067799733,35cyclictest2684-21crond07:20:430
2067799723,36cyclictest0-21swapper/007:51:010
2067799714,61cyclictest28797-21tune2fs07:06:030
2067799714,39cyclictest0-21swapper/008:34:510
2067799704,60cyclictest13430-21idleruntime-cro08:50:390
2067799703,61cyclictest0-21swapper/007:41:130
2067799703,60cyclictest22397-21ls06:51:130
20677997017,33cyclictest0-21swapper/007:56:100
2067799694,58cyclictest0-21swapper/008:30:400
2067799694,58cyclictest0-21swapper/008:30:400
2067799694,56cyclictest0-21swapper/008:15:410
2067799694,41cyclictest0-21swapper/008:00:530
161842690,6sleep316182-21grep09:40:533
2067799684,58cyclictest0-21swapper/007:10:570
2067799683,59cyclictest0-21swapper/007:21:260
2067799683,56cyclictest31353-21latency_hist08:20:410
2067799673,48cyclictest0-21swapper/007:30:540
74722660,4sleep37476-21ssh11:03:133
20681996511,30cyclictest0-21swapper/309:10:393
20681996511,30cyclictest0-21swapper/309:10:393
20677996510,36cyclictest107550irq/46-eth007:46:110
20677996510,36cyclictest107550irq/46-eth007:46:110
2068199649,35cyclictest0-21swapper/308:20:413
20681996423,24cyclictest25733-21df_abs11:30:493
49882637,48sleep20-21swapper/209:24:482
20681996325,13cyclictest12576-21cpuspeed_turbos09:35:523
20681996323,23cyclictest1227-21runrttasks08:56:363
20680996325,22cyclictest0-21swapper/211:40:512
20681996225,11cyclictest17699-21kernelversion12:05:563
2067799613,49cyclictest0-21swapper/006:50:450
219499600,6rtkit-daemon0-21swapper/207:00:473
219499600,6rtkit-daemon0-21swapper/207:00:473
2068199604,34cyclictest0-21swapper/310:17:333
20681996023,13cyclictest1124-21snmpd11:15:563
2068099603,41cyclictest0-21swapper/211:03:562
151972603,50sleep20-21swapper/208:51:112
310362597,11sleep20-21swapper/209:15:502
2068199594,37cyclictest0-21swapper/308:51:153
2068199594,36cyclictest0-21swapper/309:19:293
20681995925,14cyclictest0-21swapper/310:31:023
20681995925,14cyclictest0-21swapper/310:31:023
2068199584,38cyclictest0-21swapper/309:21:263
2068199584,36cyclictest0-21swapper/311:30:193
2068199584,36cyclictest0-21swapper/309:56:203
117612588,7sleep20-21swapper/211:10:452
117612588,7sleep20-21swapper/211:10:452
2068199575,31cyclictest0-21swapper/311:46:023
2068199574,37cyclictest0-21swapper/311:13:553
2068199574,37cyclictest0-21swapper/311:13:553
2068199574,34cyclictest0-21swapper/310:47:203
2068199574,28cyclictest0-21swapper/312:10:413
20681995723,14cyclictest0-21swapper/309:45:533
20681995723,10cyclictest2947-21ssh10:56:003
20681995721,14cyclictest0-21swapper/307:25:583
20681995721,13cyclictest0-21swapper/308:31:053
20681995719,13cyclictest0-21swapper/312:19:443
20681995718,14cyclictest0-21swapper/309:10:533
2068099573,48cyclictest0-21swapper/210:55:272
297732563,46sleep20-21swapper/210:48:452
219499560,4rtkit-daemon2193-21rtkit-daemon10:45:461
2068199564,34cyclictest0-21swapper/309:34:113
2068199564,34cyclictest0-21swapper/309:30:253
2068199564,33cyclictest0-21swapper/310:22:063
2068199564,29cyclictest0-21swapper/307:36:013
2068199563,37cyclictest1227-21runrttasks10:50:383
20681995623,8cyclictest107550irq/46-eth009:53:483
20681995623,8cyclictest107550irq/46-eth009:53:483
20681995620,13cyclictest0-21swapper/311:50:493
20681995620,13cyclictest0-21swapper/310:10:493
20681995620,13cyclictest0-21swapper/308:45:553
20681995619,13cyclictest0-21swapper/312:00:283
20681995619,13cyclictest0-21swapper/312:00:283
20681995619,13cyclictest0-21swapper/310:29:493
20681995619,13cyclictest0-21swapper/310:29:493
20681995618,14cyclictest0-21swapper/311:35:483
2068099563,44cyclictest26534-21grep07:01:022
2068099563,44cyclictest26534-21grep07:01:022
2068099563,39cyclictest0-21swapper/210:33:512
2068099563,39cyclictest0-21swapper/210:33:512
117252564,11sleep20-21swapper/209:34:442
219499550,6rtkit-daemon2193-21rtkit-daemon10:36:091
219499550,6rtkit-daemon2193-21rtkit-daemon09:31:121
219499550,5rtkit-daemon2193-21rtkit-daemon11:21:072
219499550,5rtkit-daemon2193-21rtkit-daemon10:21:021
219499550,5rtkit-daemon2193-21rtkit-daemon09:15:571
219499550,5rtkit-daemon2193-21rtkit-daemon09:00:581
2068199555,28cyclictest0-21swapper/310:06:103
2068199555,28cyclictest0-21swapper/308:21:103
2068199555,26cyclictest0-21swapper/311:25:333
2068199554,29cyclictest0-21swapper/307:41:053
2068199554,28cyclictest850-21munin-node11:40:593
2068199554,28cyclictest0-21swapper/312:00:483
2068199554,28cyclictest0-21swapper/308:40:513
2068199554,27cyclictest0-21swapper/310:36:063
2068199554,27cyclictest0-21swapper/309:01:023
2068199554,27cyclictest0-21swapper/308:29:463
2068199554,27cyclictest0-21swapper/308:29:463
2068199554,26cyclictest0-21swapper/310:41:243
2068199554,26cyclictest0-21swapper/308:40:413
20681995519,14cyclictest0-21swapper/311:09:333
20681995511,26cyclictest30000-21gltestperf10:00:553
2068099554,44cyclictest0-21swapper/210:36:102
2067999557,42cyclictest1387-21awk10:06:041
20679995523,26cyclictest19160-21fschecks_count11:20:511
20679995514,35cyclictest3811-21ssh10:57:101
20679995510,38cyclictest6326-21gltestperf09:25:551
219499540,6rtkit-daemon2193-21rtkit-daemon10:11:031
219499540,5rtkit-daemon2193-21rtkit-daemon10:29:391
219499540,5rtkit-daemon2193-21rtkit-daemon10:29:391
2068199549,26cyclictest0-21swapper/307:50:423
2068199549,26cyclictest0-21swapper/307:50:423
2068199544,28cyclictest0-21swapper/308:06:003
2068199544,27cyclictest0-21swapper/307:33:263
2068199544,27cyclictest0-21swapper/307:15:443
2068199544,26cyclictest0-21swapper/307:58:303
2068199544,26cyclictest0-21swapper/307:25:433
2068199544,26cyclictest0-21swapper/306:50:453
2068099543,44cyclictest22712-21sh09:02:072
2068099543,36cyclictest0-21swapper/207:33:272
2068099543,33cyclictest15961-21munin-node11:15:532
20680995420,20cyclictest22364-21munin-node09:51:132
20680995420,20cyclictest22364-21munin-node09:51:132
2067999543,42cyclictest23744-21ssh09:51:051
2067999543,42cyclictest23744-21ssh09:51:051
219499530,5rtkit-daemon2193-21rtkit-daemon10:16:021
219499530,4rtkit-daemon2193-21rtkit-daemon09:11:051
20681995316,19cyclictest0-21swapper/308:01:043
2068099539,29cyclictest0-21swapper/212:13:342
2068099534,42cyclictest0-21swapper/210:00:492
2068099534,13cyclictest0-21swapper/212:03:472
2068099533,36cyclictest0-21swapper/209:37:142
2067999537,39cyclictest0-21swapper/110:01:001
219499520,5rtkit-daemon2193-21rtkit-daemon09:46:111
219499520,5rtkit-daemon2193-21rtkit-daemon09:08:201
219499520,5rtkit-daemon2193-21rtkit-daemon09:08:201
219499520,5rtkit-daemon2193-21rtkit-daemon07:15:541
2068099526,30cyclictest23810-21munin-node10:40:522
2068099524,35cyclictest0-21swapper/210:17:212
2068099523,33cyclictest0-21swapper/209:43:492
2068099523,31cyclictest0-21swapper/210:09:112
2067999524,42cyclictest13757-21python09:36:081
2067999524,40cyclictest0-21swapper/111:40:531
2067999523,41cyclictest14129-21cut12:00:501
219499510,5rtkit-daemon2193-21rtkit-daemon11:07:152
219499510,5rtkit-daemon2193-21rtkit-daemon10:51:011
2068099514,31cyclictest0-21swapper/211:26:572
2068099513,42cyclictest0-21swapper/211:49:522
2068099513,36cyclictest9853-21munin-node11:56:042
2068099513,36cyclictest9853-21munin-node11:56:042
20680995117,20cyclictest5489-21munin-node09:26:062
20680995112,23cyclictest0-21swapper/211:34:572
2067999519,36cyclictest1227-21runrttasks11:08:081
2067999518,9cyclictest201ktimersoftd/108:58:551
2067999516,39cyclictest4972-21vmstat11:46:081
2067999516,38cyclictest17173-21tail10:30:471
2067999516,38cyclictest17173-21tail10:30:471
2067999514,40cyclictest12075-21cpuspeed_turbos11:10:481
2067999514,40cyclictest12075-21cpuspeed_turbos11:10:481
2067999514,12cyclictest0-21swapper/112:05:521
20679995133,13cyclictest0-21swapper/108:10:541
2068099505,7cyclictest16962-21ssh08:55:402
2068099504,9cyclictest0-21swapper/210:30:362
2068099504,9cyclictest0-21swapper/210:30:362
2068099504,32cyclictest0-21swapper/212:16:022
2068099504,28cyclictest0-21swapper/210:11:092
2068099502,43cyclictest0-21swapper/207:18:352
20680995013,23cyclictest107550irq/46-eth010:25:372
2067999505,38cyclictest0-21swapper/111:33:011
2067999504,39cyclictest23827-21basename10:40:451
20679995033,11cyclictest9129-21cpuspeed_turbos08:40:511
20679995024,12cyclictest0-21swapper/111:36:031
219499490,5rtkit-daemon2193-21rtkit-daemon11:00:531
2068099493,40cyclictest0-21swapper/210:58:552
2068099493,26cyclictest0-21swapper/209:57:562
2068099492,34cyclictest0-21swapper/208:01:382
2067999496,37cyclictest201ktimersoftd/109:56:011
20679994933,10cyclictest21777-21gltestperf06:51:021
20679994933,10cyclictest14548-21sed08:50:581
263412482,40sleep20-21swapper/208:07:382
2068099484,26cyclictest0-21swapper/207:41:022
2068099483,28cyclictest0-21swapper/211:50:532
2068099483,27cyclictest0-21swapper/212:06:242
2068099483,27cyclictest0-21swapper/211:35:512
2068099483,23cyclictest0-21swapper/209:13:572
2067999484,37cyclictest0-21swapper/112:10:431
2067999483,38cyclictest0-21swapper/111:55:451
2067999483,38cyclictest0-21swapper/111:55:451
2067999483,24cyclictest0-21swapper/107:20:551
299272472,9sleep20-21swapper/207:07:132
2068199474,12cyclictest0-21swapper/308:11:083
20681994730,11cyclictest18194-21sed07:51:013
20681994729,12cyclictest28853-21gltestperf07:06:043
2068099474,27cyclictest0-21swapper/208:45:592
2068099473,39cyclictest0-21swapper/209:08:452
2068099473,39cyclictest0-21swapper/209:08:452
2068099473,27cyclictest0-21swapper/207:46:002
2068099473,27cyclictest0-21swapper/207:46:002
2068099473,27cyclictest0-21swapper/207:10:592
2067999478,32cyclictest25342-21hwlatdetect08:06:011
2067999474,37cyclictest0-21swapper/111:50:571
2067999474,36cyclictest0-21swapper/107:30:421
20679994731,10cyclictest24134-21sed06:56:031
2067999473,38cyclictest24536-21sort12:15:531
20679994729,12cyclictest0-21swapper/109:42:071
20679994711,10cyclictest3927-21unixbench_singl09:21:111
190972472,9sleep10-21swapper/107:51:331
143172472,9sleep10-21swapper/107:41:421
20681994631,10cyclictest1212-21head07:16:023
2068099464,27cyclictest0-21swapper/209:45:552
2068099463,27cyclictest0-21swapper/208:25:512
2068099463,27cyclictest0-21swapper/208:25:512
2068099463,26cyclictest0-21swapper/208:33:362
2068099463,25cyclictest0-21swapper/208:20:542
20680994624,8cyclictest27414-21fschecks_count08:10:562
2067999467,33cyclictest201ktimersoftd/107:11:011
2067999464,36cyclictest23114-21ssh11:25:581
2067999464,36cyclictest16265-21latency11:15:581
20679994630,10cyclictest32457-21gltestperf08:20:591
219499450,5rtkit-daemon2193-21rtkit-daemon08:16:221
2068099454,26cyclictest0-21swapper/206:56:492
20680994531,9cyclictest7219-21fschecks_time08:35:582
2068099453,26cyclictest0-21swapper/207:20:572
20679994528,10cyclictest4407-21cpuspeed_turbos08:30:531
219499440,4rtkit-daemon2193-21rtkit-daemon08:27:521
219499440,4rtkit-daemon2193-21rtkit-daemon08:27:521
219499440,4rtkit-daemon2193-21rtkit-daemon07:06:101
2068099443,26cyclictest0-21swapper/206:51:092
2068099443,25cyclictest0-21swapper/207:25:542
131312442,10sleep10-21swapper/108:47:031
238852432,34sleep10-21swapper/108:01:411
2068099433,33cyclictest0-21swapper/208:15:512
2068099433,22cyclictest0-21swapper/208:40:502
2068099432,35cyclictest0-21swapper/207:35:562
20679994330,8cyclictest15177-21cpuspeed_turbos07:45:551
20679994330,8cyclictest15177-21cpuspeed_turbos07:45:551
20679994327,10cyclictest7345-21gltestperf08:36:001
194132432,9sleep20-21swapper/207:55:412
219499420,4rtkit-daemon2193-21rtkit-daemon07:30:461
2068099423,19cyclictest0-21swapper/207:56:042
2067999407,28cyclictest201ktimersoftd/107:55:511
2067999394,30cyclictest0-21swapper/107:36:171
2068099354,25cyclictest20667-21cyclictest06:50:442
2067999333,26cyclictest20713-21date06:50:441
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional