You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-14 - 17:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sun Dec 14, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3117399955,32cyclictest0-21swapper/007:53:440
3117799933,9cyclictest18198-21runrttasks11:09:011
3117799884,13cyclictest0-21swapper/110:14:061
3117799884,12cyclictest0-21swapper/109:58:481
3117799884,12cyclictest0-21swapper/108:13:441
31177998814,65cyclictest0-21swapper/111:23:471
3117799864,12cyclictest0-21swapper/109:04:101
3117799864,11cyclictest0-21swapper/112:12:441
3117799844,13cyclictest0-21swapper/112:33:521
3117799843,9cyclictest20544-21needreboot08:59:041
31177998420,43cyclictest0-21swapper/110:05:171
3117999833,72cyclictest19341-21munin-node08:58:583
3117999833,72cyclictest0-21swapper/311:03:463
3117799834,64cyclictest0-21swapper/108:02:031
3117799834,64cyclictest0-21swapper/108:02:031
286072830,3sleep041ktimersoftd/011:33:350
3117999824,71cyclictest0-21swapper/307:33:543
3117799824,12cyclictest0-21swapper/110:52:311
3117799824,12cyclictest0-21swapper/108:53:431
3117799823,12cyclictest0-21swapper/109:13:561
3117799823,11cyclictest0-21swapper/112:29:021
31177998212,61cyclictest0-21swapper/107:08:561
31177998212,61cyclictest0-21swapper/107:08:561
3117999814,69cyclictest0-21swapper/311:52:023
3117999814,61cyclictest0-21swapper/308:17:053
3117999813,71cyclictest3817-21head09:33:493
3117999813,70cyclictest24504-21cut09:08:533
3117999813,63cyclictest18726-21fschecks_count10:03:543
3117799814,61cyclictest0-21swapper/112:23:471
3117799814,61cyclictest0-21swapper/112:23:471
3117799813,13cyclictest0-21swapper/108:33:581
3117799813,12cyclictest0-21swapper/109:47:321
248599810,4rtkit-daemon2484-21rtkit-daemon11:09:353
3117799804,59cyclictest0-21swapper/111:13:541
3117799804,12cyclictest0-21swapper/107:54:091
3117799804,12cyclictest0-21swapper/107:54:091
3117799803,59cyclictest2274-21taskset08:22:371
31177998018,43cyclictest14206-21sshd08:47:091
31177998010,8cyclictest14496-21munin-node11:04:001
248599800,5rtkit-daemon2484-21rtkit-daemon10:54:363
248599800,5rtkit-daemon2484-21rtkit-daemon10:54:363
37722790,6sleep226-21rcuc/207:18:462
37722790,6sleep226-21rcuc/207:18:462
3117999794,68cyclictest0-21swapper/311:28:553
3117999794,68cyclictest0-21swapper/308:54:003
3117999794,67cyclictest0-21swapper/312:01:103
3117999794,67cyclictest0-21swapper/311:23:523
3117999793,69cyclictest604-21grep10:33:523
3117999793,68cyclictest0-21swapper/312:18:343
3117999793,68cyclictest0-21swapper/307:53:533
3117999793,68cyclictest0-21swapper/307:53:533
3117799793,58cyclictest5584-21unixbench_multi07:19:171
3117799793,12cyclictest0-21swapper/107:28:461
3117799793,10cyclictest9225-21diskstats07:28:591
3117999784,66cyclictest0-21swapper/308:09:143
3117999784,66cyclictest0-21swapper/307:19:163
3117999783,68cyclictest8162-21seq07:25:293
3117999783,68cyclictest3103-21unixbench_multi09:29:113
3117799789,8cyclictest121850irq/46-eth008:23:561
3117799789,12cyclictest0-21swapper/111:44:031
3117799784,12cyclictest0-21swapper/107:43:441
3117799783,60cyclictest20512-21munin-node10:08:571
3117799783,60cyclictest20512-21munin-node10:08:571
31177997822,49cyclictest5779-21gltestperf10:43:561
31177997817,55cyclictest24983-21gltestperf09:08:581
31177997813,8cyclictest27668-21munin-node10:24:041
248599780,4rtkit-daemon2484-21rtkit-daemon12:35:473
248599780,4rtkit-daemon2484-21rtkit-daemon12:29:473
248599780,4rtkit-daemon2484-21rtkit-daemon10:59:363
248599780,10rtkit-daemon0-21swapper/210:27:370
3117999774,66cyclictest0-21swapper/308:38:533
3117999773,67cyclictest4082-21python08:24:103
3117999773,67cyclictest20028-21fschecks_time11:13:523
3117999773,67cyclictest15365-21chrt09:57:063
3117999773,67cyclictest1287-21snmpd11:57:433
3117999773,66cyclictest0-21swapper/311:38:453
3117999773,66cyclictest0-21swapper/311:38:453
3117999773,59cyclictest0-21swapper/309:47:203
3117799776,11cyclictest0-21swapper/109:33:551
3117799774,53cyclictest0-21swapper/110:37:061
3117799774,12cyclictest0-21swapper/111:33:561
3117799774,12cyclictest0-21swapper/110:58:501
3117799773,58cyclictest18830-21sshd08:55:081
3117799773,52cyclictest0-21swapper/111:18:541
3117799773,19cyclictest0-21swapper/107:49:141
3117799773,12cyclictest0-21swapper/111:38:461
3117799773,12cyclictest0-21swapper/111:38:461
31177997719,51cyclictest1052-21rsyslogd12:18:331
31177997719,50cyclictest14258-21hwlatdetect09:53:571
248599770,5rtkit-daemon2484-21rtkit-daemon12:27:553
248599770,5rtkit-daemon2484-21rtkit-daemon12:27:553
3117999764,65cyclictest22674-21iostat_ios11:18:563
3117999763,66cyclictest1800-21fschecks_count11:43:493
3117999763,65cyclictest28807-21munin-node11:33:433
3117799769,59cyclictest0-21swapper/112:19:021
3117799763,57cyclictest0-21swapper/111:56:021
3117799763,57cyclictest0-21swapper/107:44:011
3117799763,53cyclictest0-21swapper/110:28:471
3117799763,12cyclictest0-21swapper/109:19:081
3117999754,63cyclictest0-21swapper/308:29:023
3117999753,65cyclictest14177-21seq08:46:463
3117999753,64cyclictest16303-21diskstats09:58:533
3117799754,13cyclictest0-21swapper/111:48:441
3117799753,17cyclictest0-21swapper/108:32:081
31177997527,42cyclictest12162-21cut09:49:011
31177997521,48cyclictest26385-21cat10:19:001
31177997510,7cyclictest121850irq/46-eth010:54:021
31177997510,7cyclictest121850irq/46-eth010:54:021
3117999744,59cyclictest0-21swapper/307:58:523
3117999744,59cyclictest0-21swapper/307:58:523
3117999744,42cyclictest0-21swapper/308:03:523
3117999744,39cyclictest0-21swapper/310:49:083
3117999743,64cyclictest6385-21swap10:44:083
3117999743,64cyclictest14274-21sed07:39:013
3117999743,64cyclictest12409-21swap09:49:073
3117999743,63cyclictest2817-21munin-node10:38:473
3117799743,65cyclictest0-21swapper/111:28:551
3117799743,64cyclictest26199-21gltestperf08:03:591
3117799743,13cyclictest0-21swapper/109:32:181
31177997422,45cyclictest7945-21unixbench_singl09:39:101
31177997419,49cyclictest11104-21open_inodes08:39:071
31177997418,50cyclictest30989-21gltestperf08:14:001
31177997410,12cyclictest0-21swapper/112:03:561
3117999734,62cyclictest0-21swapper/310:24:073
3117999734,62cyclictest0-21swapper/307:09:093
3117999734,62cyclictest0-21swapper/307:09:093
3117999733,62cyclictest0-21swapper/309:16:213
31177997318,49cyclictest2578-21aten_r1power_cu10:38:441
31177997318,47cyclictest0-21swapper/111:59:051
3117999724,61cyclictest0-21swapper/307:48:443
31179997230,35cyclictest32153-21gltestperf09:23:573
31179997230,35cyclictest32153-21gltestperf09:23:573
3117999723,62cyclictest8422-21munin-node08:34:023
3117999723,62cyclictest31907-21seq10:29:403
3117999723,62cyclictest31209-21cat09:23:413
3117999723,62cyclictest0-21swapper/307:32:123
3117999723,61cyclictest12165-21nscd09:08:413
3117999723,54cyclictest18209-21munin-node07:48:523
31177997217,49cyclictest2282-21gltestperf07:14:021
31177997217,49cyclictest2282-21gltestperf07:14:021
31177997210,54cyclictest0-21swapper/109:23:561
31177997210,54cyclictest0-21swapper/109:23:561
3117999713,62cyclictest0-21swapper/312:18:423
3117999713,45cyclictest0-21swapper/312:11:183
31177997118,46cyclictest11639-21fschecks_count07:34:001
3117999703,61cyclictest835-21fschecks_time08:19:003
3117999702,63cyclictest0-21swapper/310:16:113
31179997011,39cyclictest0-21swapper/307:18:153
31179997011,39cyclictest0-21swapper/307:18:153
3117999695,54cyclictest20669-21telnet10:08:483
3117999695,54cyclictest20669-21telnet10:08:483
3117999692,61cyclictest0-21swapper/310:20:143
3117999684,50cyclictest0-21swapper/312:07:443
3117999684,43cyclictest0-21swapper/308:53:423
3117999674,56cyclictest0-21swapper/309:39:003
3117799663,12cyclictest0-21swapper/107:08:461
79832655,52sleep00-21swapper/008:33:580
3117399633,41cyclictest0-21swapper/011:52:420
248599630,8rtkit-daemon0-21swapper/110:41:440
248599630,5rtkit-daemon2484-21rtkit-daemon07:26:070
31173996139,15cyclictest0-21swapper/011:58:350
248599610,8rtkit-daemon0-21swapper/110:49:140
3117999603,50cyclictest0-21swapper/307:08:463
31178995913,28cyclictest0-21swapper/208:24:162
3117399595,30cyclictest0-21swapper/009:54:170
248599590,6rtkit-daemon5955-21grep10:43:590
248599590,5rtkit-daemon18498-21timerwakeupswit11:09:052
248599590,4rtkit-daemon2484-21rtkit-daemon10:28:590
3117399585,28cyclictest0-21swapper/007:58:440
3117399585,28cyclictest0-21swapper/007:58:440
3117399584,29cyclictest0-21swapper/007:19:040
31173995822,12cyclictest0-21swapper/008:22:100
31173995821,13cyclictest0-21swapper/007:39:120
248599580,4rtkit-daemon2484-21rtkit-daemon07:28:590
83242573,7sleep28335-21munin-run09:43:402
31178995737,12cyclictest22560-21crond12:28:332
31178995737,12cyclictest22560-21crond12:28:332
31178995723,27cyclictest11035-21munin-node07:33:562
3117399579,27cyclictest0-21swapper/009:43:400
3117399574,29cyclictest0-21swapper/011:38:490
3117399574,29cyclictest0-21swapper/011:38:490
3117399574,27cyclictest0-21swapper/010:58:380
3117399574,27cyclictest0-21swapper/010:58:380
31173995722,13cyclictest0-21swapper/010:09:080
31173995722,13cyclictest0-21swapper/010:09:080
284162573,47sleep00-21swapper/009:15:210
3117899564,43cyclictest0-21swapper/208:58:552
3117399566,28cyclictest1419-21runrttasks12:13:460
3117399565,28cyclictest0-21swapper/011:03:550
3117399565,28cyclictest0-21swapper/009:19:070
3117399564,29cyclictest0-21swapper/012:33:470
3117399564,29cyclictest0-21swapper/010:03:590
3117399564,29cyclictest0-21swapper/007:14:140
3117399564,29cyclictest0-21swapper/007:14:140
3117399564,28cyclictest0-21swapper/011:23:500
3117399564,28cyclictest0-21swapper/009:43:540
3117399564,28cyclictest0-21swapper/009:34:090
3117399564,28cyclictest0-21swapper/008:04:030
3117399564,27cyclictest0-21swapper/008:46:090
3117399563,37cyclictest0-21swapper/011:17:040
31173995622,13cyclictest0-21swapper/009:49:000
291132563,12sleep20-21swapper/210:24:062
31178995537,11cyclictest32402-21grep11:38:582
31178995537,11cyclictest32402-21grep11:38:582
31178995536,11cyclictest9525-21cut07:29:022
31178995535,13cyclictest30967-21gltestperf08:13:592
3117399556,28cyclictest0-21swapper/010:34:040
3117399555,27cyclictest0-21swapper/012:03:470
3117399554,28cyclictest0-21swapper/012:28:340
3117399554,28cyclictest0-21swapper/012:28:340
3117399554,28cyclictest0-21swapper/011:48:350
3117399554,28cyclictest0-21swapper/011:34:000
3117399554,28cyclictest0-21swapper/010:14:060
3117399554,28cyclictest0-21swapper/008:28:570
3117399554,28cyclictest0-21swapper/008:09:050
3117399554,27cyclictest0-21swapper/011:19:070
31173995526,10cyclictest25286-21munin-node10:18:540
248599550,5rtkit-daemon2484-21rtkit-daemon11:59:032
151272552,10sleep00-21swapper/012:10:000
3117399544,27cyclictest0-21swapper/008:13:580
31173995434,12cyclictest0-21swapper/009:24:100
31173995434,12cyclictest0-21swapper/009:24:100
31173995423,13cyclictest0-21swapper/009:13:410
129542544,43sleep00-21swapper/007:35:460
92772532,9sleep20-21swapper/208:35:092
3117899534,30cyclictest0-21swapper/212:18:452
3117899534,30cyclictest0-21swapper/208:38:582
3117899534,24cyclictest0-21swapper/209:23:492
3117899534,24cyclictest0-21swapper/209:23:492
31178995336,10cyclictest5655-21unixbench_singl07:19:172
3117899533,35cyclictest16954-21munin-node08:54:122
3117399534,28cyclictest0-21swapper/008:24:140
3117399534,27cyclictest0-21swapper/011:58:550
248599530,5rtkit-daemon2484-21rtkit-daemon12:30:022
248599530,4rtkit-daemon2484-21rtkit-daemon12:34:472
179312533,10sleep00-21swapper/007:48:230
3117899524,29cyclictest0-21swapper/211:29:072
3117899524,28cyclictest0-21swapper/208:44:012
31178995234,11cyclictest16556-21grep07:43:592
31173995233,12cyclictest1685-21nscd09:08:400
248599520,4rtkit-daemon2484-21rtkit-daemon11:04:512
248599520,4rtkit-daemon2484-21rtkit-daemon10:59:132
248599520,4rtkit-daemon2484-21rtkit-daemon10:54:212
248599520,4rtkit-daemon2484-21rtkit-daemon10:54:212
212252523,43sleep00-21swapper/009:00:020
117052523,43sleep00-21swapper/008:40:390
7502513,11sleep00-21swapper/007:09:260
7502513,11sleep00-21swapper/007:09:260
32782514,39sleep00-21swapper/009:30:040
3117899515,37cyclictest0-21swapper/210:09:052
3117899515,37cyclictest0-21swapper/210:09:052
3117899514,29cyclictest0-21swapper/209:54:062
3117899514,28cyclictest0-21swapper/211:48:562
3117899514,28cyclictest0-21swapper/208:19:122
3117899514,27cyclictest0-21swapper/207:43:452
3117899514,27cyclictest0-21swapper/207:08:472
31178995130,14cyclictest0-21swapper/211:34:032
3117899513,29cyclictest0-21swapper/212:08:542
31178995121,13cyclictest0-21swapper/209:28:592
185232512,11sleep00-21swapper/012:18:460
3117899507,28cyclictest14128-1kworker/2:2H11:54:032
3117899504,28cyclictest0-21swapper/212:03:572
3117899504,28cyclictest0-21swapper/211:18:472
3117899504,28cyclictest0-21swapper/210:43:532
3117899504,28cyclictest0-21swapper/210:03:572
3117899504,28cyclictest0-21swapper/209:58:532
3117899504,28cyclictest0-21swapper/208:28:512
3117899504,27cyclictest0-21swapper/210:43:382
3117899503,27cyclictest9035-21unixbench_multi10:49:082
31178995021,12cyclictest0-21swapper/208:08:582
31178995020,12cyclictest0-21swapper/209:49:092
31178995020,12cyclictest0-21swapper/209:03:552
3117399504,23cyclictest0-21swapper/009:58:480
31173995020,13cyclictest0-21swapper/008:49:130
31173995020,13cyclictest0-21swapper/007:58:530
31173995020,13cyclictest0-21swapper/007:58:530
188372503,39sleep00-21swapper/008:55:140
176082502,10sleep20-21swapper/212:16:142
3117899495,27cyclictest0-21swapper/207:59:082
3117899495,27cyclictest0-21swapper/207:59:082
3117899494,27cyclictest0-21swapper/211:43:442
3117899494,12cyclictest0-21swapper/210:14:092
31178994930,11cyclictest8869-21grep09:43:522
285052492,40sleep20-21swapper/209:16:322
189232493,10sleep00-21swapper/011:12:120
152062493,9sleep20-21swapper/208:48:592
37902483,37sleep20-21swapper/209:33:492
3117899484,37cyclictest0-21swapper/209:09:072
3117899484,37cyclictest0-21swapper/207:13:452
3117899484,37cyclictest0-21swapper/207:13:452
3117899484,27cyclictest0-21swapper/210:37:062
3117899484,26cyclictest0-21swapper/207:48:532
3117899482,39cyclictest0-21swapper/210:18:582
3117399484,27cyclictest0-21swapper/012:29:020
259432483,38sleep225963-21fschecks_count08:03:572
120872483,10sleep00-21swapper/010:58:420
3117899474,26cyclictest0-21swapper/207:57:032
3117899474,26cyclictest0-21swapper/207:57:032
3117899474,25cyclictest0-21swapper/207:23:572
3117899473,26cyclictest0-21swapper/209:19:012
31178994716,13cyclictest0-21swapper/211:23:522
309662474,36sleep00-21swapper/007:06:290
3117899464,25cyclictest0-21swapper/210:28:472
3117899455,25cyclictest0-21swapper/211:17:362
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional