You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 23:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Wed Jul 22, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991230,8rtkit-daemon0-21swapper/009:03:500
2194991230,6rtkit-daemon2193-21rtkit-daemon10:21:322
2194991090,5rtkit-daemon107550irq/46-eth010:54:011
66709910321,14cyclictest0-21swapper/209:03:562
6667991004,90cyclictest0-21swapper/008:39:070
2194991000,4rtkit-daemon2193-21rtkit-daemon11:22:451
6670999911,23cyclictest0-21swapper/208:59:092
666799994,86cyclictest0-21swapper/010:48:470
666799984,87cyclictest0-21swapper/009:58:550
666799984,73cyclictest0-21swapper/011:47:100
667099974,26cyclictest0-21swapper/210:00:032
6670999722,10cyclictest3566-21cpuspeed_turbos07:18:582
6670999719,11cyclictest21788-21sshd09:39:102
666799974,83cyclictest0-21swapper/011:26:300
667099965,26cyclictest0-21swapper/209:19:132
667099964,27cyclictest0-21swapper/210:17:072
667099964,27cyclictest0-21swapper/208:34:082
667099964,25cyclictest10914-21diskstats09:23:562
667099964,25cyclictest0-21swapper/209:13:272
667099964,25cyclictest0-21swapper/209:13:272
666799963,85cyclictest0-21swapper/009:24:110
667099957,26cyclictest0-21swapper/209:29:102
667099954,28cyclictest0-21swapper/211:34:032
667099954,27cyclictest3594-21taskset11:39:012
6670999522,10cyclictest25279-21ssh11:23:512
666799955,82cyclictest0-21swapper/011:16:370
666799955,82cyclictest0-21swapper/010:59:380
666799954,84cyclictest0-21swapper/011:34:040
666799954,84cyclictest0-21swapper/010:16:380
666799954,67cyclictest0-21swapper/009:54:050
667099945,30cyclictest0-21swapper/207:37:072
667099945,30cyclictest0-21swapper/206:43:572
667099944,35cyclictest18690-21ssh11:13:522
667099944,26cyclictest0-21swapper/208:24:102
667099944,26cyclictest0-21swapper/208:23:152
667099944,25cyclictest12734-21kworker/2:009:14:012
666799945,82cyclictest0-21swapper/009:17:290
666799945,68cyclictest0-21swapper/009:09:170
666799945,68cyclictest0-21swapper/009:09:170
666799943,10cyclictest0-21swapper/010:38:380
6667999425,51cyclictest28007-21strings09:49:050
6667999425,51cyclictest28007-21strings09:49:050
667099934,24cyclictest20665-21ssh08:49:022
667099933,26cyclictest0-21swapper/210:24:312
667099927,25cyclictest0-21swapper/211:18:582
667099924,46cyclictest0-21swapper/208:43:532
667099924,30cyclictest0-21swapper/210:13:362
667099924,26cyclictest0-21swapper/206:58:452
666799924,81cyclictest0-21swapper/008:08:000
666799924,80cyclictest0-21swapper/008:24:020
666799924,78cyclictest0-21swapper/011:08:470
666799924,78cyclictest0-21swapper/011:08:470
666799924,78cyclictest0-21swapper/007:53:460
6667999212,57cyclictest0-21swapper/009:29:080
667099916,21cyclictest107550irq/46-eth010:44:052
667099914,29cyclictest0-21swapper/208:53:562
667099914,26cyclictest5399-21ssh10:04:012
667099914,26cyclictest0-21swapper/210:38:482
6670999128,14cyclictest2399-21grep10:48:532
666799914,80cyclictest0-21swapper/009:03:400
666799913,81cyclictest0-21swapper/010:20:340
666799913,79cyclictest0-21swapper/006:53:000
667199903,80cyclictest0-21swapper/310:48:583
667199903,13cyclictest0-21swapper/311:23:513
667199903,11cyclictest0-21swapper/308:33:363
667199903,11cyclictest0-21swapper/308:33:363
667199902,12cyclictest0-21swapper/311:18:453
667099904,27cyclictest0-21swapper/211:10:482
667099904,27cyclictest0-21swapper/211:10:482
667099904,27cyclictest0-21swapper/207:48:582
667099904,27cyclictest0-21swapper/207:48:582
6670999020,15cyclictest0-21swapper/206:28:562
666799905,76cyclictest0-21swapper/008:29:010
666799905,76cyclictest0-21swapper/008:29:010
666799904,78cyclictest0-21swapper/009:44:260
666799904,77cyclictest0-21swapper/011:30:410
666799903,10cyclictest3666-21proc_pri11:39:020
667199895,64cyclictest0-21swapper/309:08:403
667199895,62cyclictest0-21swapper/310:53:553
667199894,78cyclictest0-21swapper/311:03:573
667099894,38cyclictest0-21swapper/211:44:072
667099894,26cyclictest0-21swapper/211:00:442
667099894,26cyclictest0-21swapper/210:28:472
6670998926,21cyclictest23707-21processes07:59:082
6670998919,12cyclictest0-21swapper/211:04:092
666799894,78cyclictest0-21swapper/010:08:340
666799894,77cyclictest0-21swapper/010:29:070
666799894,76cyclictest0-21swapper/006:38:590
666799894,76cyclictest0-21swapper/006:38:460
666799894,75cyclictest0-21swapper/011:18:530
666799893,79cyclictest0-21swapper/008:34:040
667199883,8cyclictest19752-21cut08:48:513
667199883,78cyclictest0-21swapper/308:38:583
667199883,77cyclictest0-21swapper/309:59:083
667099884,26cyclictest0-21swapper/209:45:492
667099884,26cyclictest0-21swapper/209:34:172
6670998833,10cyclictest9790-21grep07:29:172
666799884,76cyclictest0-21swapper/011:04:180
666799884,76cyclictest0-21swapper/010:33:510
666799884,76cyclictest0-21swapper/009:18:490
666799884,75cyclictest0-21swapper/009:39:350
666799884,55cyclictest0-21swapper/010:45:170
667199874,75cyclictest0-21swapper/309:32:143
667199874,61cyclictest0-21swapper/311:48:163
667199874,13cyclictest0-21swapper/311:39:053
667099876,26cyclictest0-21swapper/210:55:312
667099875,26cyclictest26785-21aten2.4-expect09:48:502
667099875,26cyclictest26785-21aten2.4-expect09:48:502
667099874,42cyclictest25874-21unixbench_multi10:34:102
667099874,36cyclictest0-21swapper/207:09:432
667099874,29cyclictest0-21swapper/209:54:102
667099874,27cyclictest0-21swapper/208:04:152
667099874,26cyclictest0-21swapper/211:29:012
666799875,73cyclictest0-21swapper/007:38:430
666799875,53cyclictest0-21swapper/008:23:050
666799874,76cyclictest0-21swapper/007:04:060
666799874,76cyclictest0-21swapper/007:04:060
666799874,53cyclictest0-21swapper/010:08:540
667199864,74cyclictest0-21swapper/310:31:523
667199864,51cyclictest100291kworker/3:110:22:053
667199863,10cyclictest27327-21load08:59:033
667099864,27cyclictest0-21swapper/206:18:472
667099864,26cyclictest0-21swapper/208:29:132
667099864,26cyclictest0-21swapper/208:29:132
667099863,27cyclictest14559-21switchtime08:39:132
6670998624,14cyclictest0-21swapper/206:19:022
6670998624,14cyclictest0-21swapper/206:19:022
666799864,74cyclictest0-21swapper/008:49:450
666799864,74cyclictest0-21swapper/008:45:370
666799864,55cyclictest0-21swapper/010:58:220
667199855,72cyclictest0-21swapper/311:34:063
667199854,9cyclictest18266-21tail11:13:483
667199854,9cyclictest11813-21munin-node09:24:093
667199854,73cyclictest0-21swapper/310:12:263
667199854,73cyclictest0-21swapper/309:39:103
667199854,54cyclictest0-21swapper/309:09:543
667199854,54cyclictest0-21swapper/309:09:543
666799854,74cyclictest0-21swapper/010:24:130
666799854,74cyclictest0-21swapper/007:17:130
666799854,73cyclictest0-21swapper/007:44:000
666799854,73cyclictest0-21swapper/007:44:000
666799853,6cyclictest19242-21ssh09:36:010
667199844,66cyclictest0-21swapper/308:22:243
667199844,58cyclictest0-21swapper/310:27:283
6671998417,47cyclictest1124-21snmpd10:08:023
667099844,27cyclictest0-21swapper/207:08:442
667099844,27cyclictest0-21swapper/207:08:442
666799844,72cyclictest0-21swapper/007:19:050
667199834,54cyclictest0-21swapper/310:34:533
667199833,8cyclictest4473-21timerandwakeup08:24:153
667199833,8cyclictest3908-21aten_r1power_vo09:13:523
667099835,30cyclictest0-21swapper/206:24:032
666799834,72cyclictest0-21swapper/006:32:560
666799834,54cyclictest0-21swapper/007:09:090
666799834,49cyclictest0-21swapper/006:54:140
666799833,10cyclictest0-21swapper/008:55:470
6667998317,46cyclictest6884-21munin-node06:19:110
6667998317,46cyclictest6884-21munin-node06:19:110
667199827,54cyclictest0-21swapper/310:39:433
667199824,8cyclictest16762-21ssh08:43:573
667199824,55cyclictest0-21swapper/307:23:433
666799824,61cyclictest12813-21munin-node07:39:150
6667998216,47cyclictest5642-21munin-node07:24:030
667199814,71cyclictest0-21swapper/311:30:003
667199814,7cyclictest12726-21munin-plugin-st08:38:413
667199814,69cyclictest0-21swapper/310:14:523
667199809,48cyclictest107550irq/46-eth009:43:593
667199805,8cyclictest107550irq/46-eth011:12:043
667199805,8cyclictest107550irq/46-eth011:12:043
667199804,63cyclictest28231-21latency08:09:073
667199804,60cyclictest0-21swapper/309:20:173
667199804,56cyclictest0-21swapper/308:55:423
667199804,13cyclictest0-21swapper/311:02:343
6671998014,47cyclictest28089-21ntp_states09:49:073
6671998014,47cyclictest28089-21ntp_states09:49:073
666799805,57cyclictest0-21swapper/006:43:560
667199795,61cyclictest0-21swapper/310:47:033
667199794,67cyclictest0-21swapper/306:39:013
667199793,9cyclictest1966-21needreboot07:14:103
667199793,69cyclictest0-21swapper/307:57:163
667199793,13cyclictest0-21swapper/307:38:433
667199793,12cyclictest0-21swapper/309:54:023
6667997918,44cyclictest10187-21crond07:33:430
666799784,67cyclictest0-21swapper/006:59:160
666799784,64cyclictest1227-21runrttasks07:48:580
666799784,64cyclictest1227-21runrttasks07:48:580
666799784,31cyclictest30667-21wc08:14:080
667199774,66cyclictest0-21swapper/307:39:063
667199774,11cyclictest0-21swapper/309:34:403
666799774,66cyclictest0-21swapper/008:09:130
667199764,10cyclictest21780-21diskstats06:49:023
667199764,10cyclictest0-21swapper/307:04:003
667199764,10cyclictest0-21swapper/307:04:003
667199763,66cyclictest0-21swapper/307:29:073
666799764,64cyclictest0-21swapper/007:58:540
667199754,61cyclictest0-21swapper/308:16:143
667199754,55cyclictest17584-21munin-node07:49:153
667199754,55cyclictest17584-21munin-node07:49:153
667199753,9cyclictest32511-21unixbench_singl07:09:193
6671997517,43cyclictest1124-21snmpd06:58:093
6671997517,41cyclictest22357-21munin-node07:59:063
666799753,11cyclictest0-21swapper/006:23:580
667199749,44cyclictest107550irq/46-eth006:58:583
667199744,9cyclictest9232-21sed06:23:473
667199744,9cyclictest9232-21sed06:23:473
667199744,62cyclictest0-21swapper/306:18:473
667199743,9cyclictest10421-21sed06:24:113
667199743,48cyclictest11659-21munin-node06:29:053
666799745,50cyclictest0-21swapper/006:18:470
667199732,54cyclictest0-21swapper/308:03:563
6671997319,47cyclictest15729-21df_abs07:43:593
6671997319,47cyclictest15729-21df_abs07:43:593
667199724,53cyclictest0-21swapper/306:38:463
667199714,59cyclictest0-21swapper/307:24:163
667199714,59cyclictest0-21swapper/306:44:033
6668996622,10cyclictest24615-21unixbench-2d08:54:131
219499590,6rtkit-daemon0-21swapper/011:08:531
219499590,6rtkit-daemon0-21swapper/011:08:531
6670995820,12cyclictest0-21swapper/206:58:572
6670995720,13cyclictest0-21swapper/207:23:552
667099564,28cyclictest0-21swapper/208:18:422
667099564,28cyclictest0-21swapper/207:38:572
667099564,27cyclictest0-21swapper/207:48:092
667099564,27cyclictest0-21swapper/207:48:092
6670995636,11cyclictest20323-21cut07:53:572
666899569,9cyclictest9791-21switchtime10:59:091
6668995622,28cyclictest18-21rcuc/109:49:121
6668995622,28cyclictest18-21rcuc/109:49:121
39492564,44sleep13953-21ssh10:03:111
191062563,44sleep10-21swapper/108:47:481
667099554,28cyclictest0-21swapper/206:49:062
667099554,27cyclictest0-21swapper/206:34:072
667099552,38cyclictest0-21swapper/208:08:542
666899554,44cyclictest0-21swapper/108:31:131
666899554,44cyclictest0-21swapper/108:31:131
6668995515,8cyclictest18-21rcuc/109:28:551
157832552,13sleep10-21swapper/108:42:401
139882552,13sleep10-21swapper/111:06:281
667099545,27cyclictest0-21swapper/206:39:042
667099544,25cyclictest2277-21find07:14:142
666899547,40cyclictest0-21swapper/109:09:001
666899547,40cyclictest0-21swapper/109:09:001
666899544,43cyclictest0-21swapper/111:13:551
310762542,11sleep10-21swapper/109:54:001
281122544,42sleep10-21swapper/107:03:371
221192543,9sleep122126-21latency_hist07:58:431
666899535,41cyclictest0-21swapper/111:28:591
666899535,27cyclictest19934-21munin-run09:38:381
666899534,24cyclictest6240-21fschecks_count11:43:511
6668995325,23cyclictest0-21swapper/108:26:161
6668995313,32cyclictest0-21swapper/109:43:531
666899515,13cyclictest0-21swapper/110:18:341
6668995135,10cyclictest29192-21grep07:04:061
6668995135,10cyclictest29192-21grep07:04:061
6668995115,30cyclictest9347-21timerwakeupswit10:09:111
39192515,40sleep10-21swapper/110:50:391
295222513,39sleep10-21swapper/108:13:461
293122512,14sleep10-21swapper/110:39:231
666899505,38cyclictest0-21swapper/111:23:591
666899505,28cyclictest0-21swapper/109:19:081
666899505,28cyclictest0-21swapper/107:18:581
666899504,39cyclictest0-21swapper/108:58:521
666899504,12cyclictest0-21swapper/109:06:141
6668995033,10cyclictest5557-21sh09:14:131
6668995020,13cyclictest0-21swapper/110:06:071
236322504,39sleep10-21swapper/110:32:501
201622503,40sleep10-21swapper/109:38:441
181222502,11sleep10-21swapper/110:23:551
160842502,12sleep10-21swapper/106:37:211
146732502,13sleep10-21swapper/107:40:011
666899496,37cyclictest0-21swapper/110:35:281
666899494,37cyclictest14927-21grep10:18:551
666899494,28cyclictest0-21swapper/108:49:021
326012493,38sleep10-21swapper/110:44:271
292822493,40sleep10-21swapper/108:13:341
27542492,11sleep10-21swapper/107:15:261
206532492,12sleep10-21swapper/106:44:431
170532493,40sleep10-21swapper/107:44:561
170532493,40sleep10-21swapper/107:44:561
134842492,14sleep10-21swapper/106:29:351
90372482,39sleep10-21swapper/106:23:471
90372482,39sleep10-21swapper/106:23:471
666899484,28cyclictest0-21swapper/109:24:011
666899484,27cyclictest0-21swapper/111:33:351
666899484,27cyclictest0-21swapper/107:38:431
666899483,27cyclictest0-21swapper/106:41:171
6668994819,12cyclictest0-21swapper/111:42:081
56882483,37sleep10-21swapper/107:23:571
317752483,38sleep10-21swapper/107:09:091
267852483,40sleep10-21swapper/108:07:211
666899474,26cyclictest0-21swapper/108:22:411
666899474,12cyclictest0-21swapper/106:54:151
666899464,34cyclictest0-21swapper/107:28:551
666899464,27cyclictest0-21swapper/108:03:121
6668994630,10cyclictest10075-21gltestperf06:24:061
6668994620,10cyclictest9896-21cpuspeed_turbos08:33:571
232822463,37sleep10-21swapper/106:52:531
195852453,12sleep10-21swapper/107:51:501
195852453,12sleep10-21swapper/107:51:501
56752424,30sleep10-21swapper/106:14:091
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional