You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-03 - 00:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Thu Jul 02, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991040,6rtkit-daemon0-21swapper/308:52:423
2194991040,6rtkit-daemon0-21swapper/308:52:423
19660991034,91cyclictest0-21swapper/010:37:200
19660991023,12cyclictest0-21swapper/008:42:450
196649910128,9cyclictest0-21swapper/109:36:371
196649910128,9cyclictest0-21swapper/109:36:371
19660991013,91cyclictest0-21swapper/010:00:050
19660991013,49cyclictest0-21swapper/008:57:300
19660991013,49cyclictest0-21swapper/008:57:300
19666991003,29cyclictest0-21swapper/308:42:473
19660991005,88cyclictest0-21swapper/010:42:460
1966099994,88cyclictest0-21swapper/011:08:060
1966099994,45cyclictest0-21swapper/011:59:480
1966099994,29cyclictest0-21swapper/008:49:150
1966099985,86cyclictest0-21swapper/010:17:450
1966099984,87cyclictest0-21swapper/009:17:180
19660999818,32cyclictest8712-21if_err_eth009:17:470
1966099975,84cyclictest0-21swapper/009:42:440
1966099974,45cyclictest0-21swapper/011:45:550
1966699964,24cyclictest0-21swapper/308:49:123
19666999612,17cyclictest0-21swapper/311:12:363
19666999611,9cyclictest32145-21fschecks_time09:52:463
1966099965,85cyclictest0-21swapper/011:32:470
1966099964,37cyclictest0-21swapper/011:23:120
1966099963,45cyclictest0-21swapper/008:41:140
19660999611,36cyclictest0-21swapper/011:52:340
1966699954,25cyclictest0-21swapper/309:37:403
1966099955,47cyclictest0-21swapper/011:47:540
1966099955,40cyclictest0-21swapper/010:09:230
1966099955,30cyclictest0-21swapper/009:02:560
1966099955,28cyclictest0-21swapper/009:40:470
1966099954,44cyclictest0-21swapper/011:37:530
1966099953,49cyclictest8098-21grep10:52:420
1966099953,47cyclictest0-21swapper/010:41:380
1966099953,46cyclictest0-21swapper/009:52:310
1966699944,31cyclictest0-21swapper/310:29:033
1966099945,40cyclictest0-21swapper/010:16:010
1966099945,40cyclictest0-21swapper/010:16:010
1966099945,27cyclictest0-21swapper/006:37:550
1966099944,47cyclictest0-21swapper/009:32:240
1966099943,45cyclictest0-21swapper/011:28:310
1966099943,45cyclictest0-21swapper/011:28:310
1966099943,45cyclictest0-21swapper/010:27:140
1966099943,45cyclictest0-21swapper/009:33:280
1966099943,45cyclictest0-21swapper/009:33:280
1966699936,20cyclictest0-21swapper/311:32:233
1966699936,20cyclictest0-21swapper/311:32:233
1966099936,39cyclictest0-21swapper/009:12:120
1966099936,38cyclictest0-21swapper/009:47:510
1966099935,37cyclictest0-21swapper/008:58:570
1966099934,30cyclictest0-21swapper/010:29:400
1966699924,30cyclictest0-21swapper/308:32:403
1966699924,29cyclictest0-21swapper/309:57:473
1966699924,25cyclictest0-21swapper/309:05:063
19666999220,13cyclictest0-21swapper/307:14:113
1966099926,78cyclictest0-21swapper/006:52:460
1966099926,78cyclictest0-21swapper/006:52:460
1966099926,39cyclictest0-21swapper/010:06:050
1966099925,38cyclictest0-21swapper/009:26:210
1966099924,42cyclictest0-21swapper/010:57:510
1966099923,11cyclictest0-21swapper/011:03:530
1966099923,11cyclictest0-21swapper/010:52:090
1966099923,11cyclictest0-21swapper/010:52:090
1966699919,30cyclictest18803-21hwlatdetect09:32:483
1966699919,30cyclictest18803-21hwlatdetect09:32:483
1966699915,27cyclictest0-21swapper/310:57:353
1966699914,20cyclictest15412-21hwlatdetect09:27:463
19664999141,43cyclictest3174-21rm11:32:481
19664999137,49cyclictest0-21swapper/108:41:391
1966099913,11cyclictest0-21swapper/012:06:400
1966699904,30cyclictest0-21swapper/308:37:513
1966699904,27cyclictest0-21swapper/308:17:313
1966699904,25cyclictest0-21swapper/310:45:073
1966699903,24cyclictest31614-21sshd10:39:083
19666999023,13cyclictest0-21swapper/307:52:453
19666999018,13cyclictest0-21swapper/308:57:443
19666999016,13cyclictest0-21swapper/309:42:503
1966499905,12cyclictest0-21swapper/109:52:581
1966099904,41cyclictest0-21swapper/008:17:510
1966099904,41cyclictest0-21swapper/008:17:510
1966099903,48cyclictest0-21swapper/007:27:530
1966699895,23cyclictest0-21swapper/311:47:523
1966699895,11cyclictest4914-21iostat10:47:463
1966699895,11cyclictest4914-21iostat10:47:463
1966699894,35cyclictest0-21swapper/310:12:413
1966699894,35cyclictest0-21swapper/310:12:413
1966699894,27cyclictest0-21swapper/307:00:213
1966699894,11cyclictest0-21swapper/307:29:063
19666998931,10cyclictest6202-21unixbench_singl09:13:043
19666998924,13cyclictest0-21swapper/311:32:413
19666998920,9cyclictest28309-21cpuspeed_turbos09:47:403
19666998919,15cyclictest0-21swapper/307:38:053
1966499893,8cyclictest1915-21iostat_ios09:07:511
1966099894,42cyclictest0-21swapper/007:03:060
1966699885,23cyclictest0-21swapper/311:21:573
1966699885,11cyclictest1124-21snmpd11:06:353
1966699884,37cyclictest0-21swapper/309:17:463
1966699884,26cyclictest16024-21diskstats11:52:383
1966699884,25cyclictest0-21swapper/311:41:573
1966699884,25cyclictest0-21swapper/311:26:513
1966699884,24cyclictest0-21swapper/310:21:013
1966699884,23cyclictest0-21swapper/310:05:513
1966699884,10cyclictest1227-21runrttasks11:10:063
19666998812,15cyclictest0-21swapper/310:10:553
1966499883,78cyclictest0-21swapper/108:51:191
1966499883,33cyclictest22401-21ssh10:27:251
19664998828,10cyclictest0-21swapper/109:52:271
19664998821,60cyclictest1227-21runrttasks08:56:321
19664998821,60cyclictest1227-21runrttasks08:56:321
1966099884,28cyclictest0-21swapper/008:22:510
1966099883,46cyclictest0-21swapper/011:12:550
1966699874,29cyclictest0-21swapper/307:17:473
1966699874,25cyclictest0-21swapper/312:05:073
1966699874,25cyclictest0-21swapper/310:36:083
1966699874,25cyclictest0-21swapper/310:24:523
1966499874,8cyclictest13347-21perl10:12:451
1966499874,8cyclictest13347-21perl10:12:451
1966499873,78cyclictest0-21swapper/112:07:041
1966499873,77cyclictest0-21swapper/111:28:111
1966499873,77cyclictest0-21swapper/111:28:111
19664998724,12cyclictest0-21swapper/109:03:031
1966699864,29cyclictest0-21swapper/308:30:353
1966699864,24cyclictest0-21swapper/310:55:313
1966699864,23cyclictest0-21swapper/311:59:193
1966699863,26cyclictest0-21swapper/306:55:203
1966699863,26cyclictest0-21swapper/306:55:203
19666998622,15cyclictest0-21swapper/306:45:183
1966499863,33cyclictest1227-21runrttasks10:54:431
1966099863,42cyclictest24114-21munin-node11:17:400
1966699854,26cyclictest0-21swapper/311:43:023
1966699854,24cyclictest11541-21df09:22:443
1966699854,13cyclictest0-21swapper/307:47:563
19666998534,10cyclictest30880-21tr08:07:453
1966499855,34cyclictest0-21swapper/111:07:371
1966499854,33cyclictest0-21swapper/110:32:551
19664998532,47cyclictest14812-21tr09:27:391
1966499853,75cyclictest0-21swapper/109:18:301
1966499853,36cyclictest6518-21missed_timers11:37:471
1966499853,33cyclictest23001-21cpuspeed_turbos10:27:381
1966499853,33cyclictest14692-21grep11:02:421
1966499853,30cyclictest0-21swapper/108:42:481
19664998529,9cyclictest14731-21gltestperf07:32:501
19664998529,9cyclictest14731-21gltestperf07:32:501
1966099854,39cyclictest0-21swapper/008:33:020
1966699844,31cyclictest0-21swapper/307:37:323
1966699844,31cyclictest0-21swapper/307:37:323
1966699844,29cyclictest0-21swapper/309:08:053
1966499844,73cyclictest0-21swapper/110:49:271
1966499844,73cyclictest0-21swapper/110:49:271
1966499843,36cyclictest0-21swapper/109:41:531
1966499843,31cyclictest12378-21hwlatdetect07:27:541
1966499843,31cyclictest0-21swapper/110:37:391
1966699834,26cyclictest0-21swapper/308:05:313
1966699834,23cyclictest0-21swapper/307:42:443
19666998316,13cyclictest0-21swapper/308:17:533
19666998316,13cyclictest0-21swapper/308:17:533
1966499833,35cyclictest0-21swapper/110:58:221
1966499833,34cyclictest0-21swapper/111:13:271
1966499833,33cyclictest24415-21sh06:47:331
1966499833,30cyclictest12387-21grep11:47:361
1966499833,11cyclictest0-21swapper/111:22:251
1966499824,32cyclictest0-21swapper/111:52:481
1966499824,30cyclictest0-21swapper/109:12:571
1966499823,73cyclictest0-21swapper/109:23:201
1966499823,72cyclictest0-21swapper/111:45:411
1966499823,33cyclictest11016-21head10:07:591
19664998227,10cyclictest0-21swapper/110:44:351
1966499814,30cyclictest33712tr08:17:441
1966499814,30cyclictest33712tr08:17:441
19664998131,8cyclictest20611-21unixbench_multi11:57:551
1966499813,71cyclictest0-21swapper/111:20:041
1966499813,35cyclictest0-21swapper/107:17:441
1966499813,33cyclictest27281-21rm09:45:581
19664998128,9cyclictest1227-21runrttasks07:12:121
19664998125,10cyclictest26721-21cut08:57:421
1966699802,44cyclictest0-21swapper/306:47:533
1966499803,69cyclictest0-21swapper/110:21:021
1966499803,36cyclictest0-21swapper/108:08:021
19664998013,27cyclictest0-21swapper/107:42:431
1966699794,13cyclictest0-21swapper/308:22:513
19666997919,13cyclictest0-21swapper/307:07:583
1966499794,30cyclictest0-21swapper/110:02:561
1966499792,70cyclictest0-21swapper/110:00:381
1966499785,8cyclictest30341-21munin-run08:07:301
1966499783,12cyclictest0-21swapper/108:15:331
19664997826,9cyclictest24964-21cpuspeed_turbos06:47:471
19664997726,8cyclictest20044-21cpu06:37:461
1966699754,22cyclictest0-21swapper/306:37:453
1966499753,31cyclictest0-21swapper/108:37:311
1966699743,27cyclictest0-21swapper/307:58:053
1966499733,35cyclictest0-21swapper/108:27:421
19664997324,10cyclictest4526-21cpuspeed07:12:451
1966499722,32cyclictest0-21swapper/107:07:341
1966499704,33cyclictest0-21swapper/108:25:581
1966499704,32cyclictest0-21swapper/107:24:161
1966499703,34cyclictest0-21swapper/106:52:441
1966499703,34cyclictest0-21swapper/106:52:441
1966499643,13cyclictest0-21swapper/107:53:151
89052624,24sleep20-21swapper/210:07:252
1966099624,51cyclictest1856-21aten2.4-expect07:07:450
1966099623,52cyclictest0-21swapper/008:03:010
1966599614,45cyclictest0-21swapper/211:27:332
1966599614,45cyclictest0-21swapper/211:27:332
1966699604,50cyclictest0-21swapper/307:05:223
1966099603,51cyclictest0-21swapper/006:57:590
1966099594,48cyclictest0-21swapper/008:07:420
1966099583,49cyclictest0-21swapper/007:57:580
19665995719,21cyclictest107550irq/46-eth009:17:422
1966099573,48cyclictest0-21swapper/008:27:570
1966599563,44cyclictest19772-21sed11:57:412
19665995622,10cyclictest4572-21nscd12:02:352
19665995617,23cyclictest1547-21nscd11:42:222
19665995612,27cyclictest0-21swapper/211:18:072
1966099563,47cyclictest0-21swapper/007:52:430
1966099563,47cyclictest0-21swapper/007:47:500
1966099563,47cyclictest0-21swapper/007:37:420
1966099563,47cyclictest0-21swapper/007:17:240
1966099563,45cyclictest0-21swapper/006:42:460
19665995512,25cyclictest0-21swapper/210:17:102
19665995512,25cyclictest0-21swapper/210:17:102
19665995511,26cyclictest0-21swapper/208:37:462
19665995510,26cyclictest0-21swapper/208:43:052
1966099553,44cyclictest0-21swapper/008:13:040
220542542,10sleep20-21swapper/209:37:462
1966599547,26cyclictest28262-21grep08:58:022
1966599546,41cyclictest0-21swapper/211:22:562
1966599546,26cyclictest0-21swapper/210:48:192
1966599546,26cyclictest0-21swapper/210:48:192
1966599544,31cyclictest0-21swapper/210:57:532
1966599544,30cyclictest0-21swapper/209:17:272
19665995411,35cyclictest10352-21crond10:57:242
1966099543,45cyclictest18729-21telnet07:42:430
1966099543,44cyclictest0-21swapper/007:22:440
1966099543,44cyclictest0-21swapper/007:17:470
1966599538,27cyclictest0-21swapper/211:42:302
1966599537,27cyclictest0-21swapper/211:07:552
1966599537,26cyclictest0-21swapper/211:47:462
1966599537,26cyclictest0-21swapper/211:15:552
1966599534,27cyclictest0-21swapper/211:02:362
19665995333,13cyclictest12942-21grep09:23:032
19665995320,13cyclictest0-21swapper/209:57:442
19665995318,21cyclictest24894-21cpuspeed_turbos09:42:402
19665995315,22cyclictest28771-21perl09:47:452
19665995310,26cyclictest0-21swapper/210:32:482
314082523,11sleep20-21swapper/207:00:252
1966699524,26cyclictest0-21swapper/307:24:083
1966599525,32cyclictest29-21ksoftirqd/207:50:232
1966599524,29cyclictest0-21swapper/207:12:332
1966599524,28cyclictest32500-21crond10:42:242
1966599524,28cyclictest0-21swapper/210:12:272
19665995231,14cyclictest0-21swapper/208:50:022
19665995223,11cyclictest7225-21grep08:23:042
19665995221,13cyclictest0-21swapper/208:18:042
19665995221,13cyclictest0-21swapper/208:18:042
19665995214,22cyclictest19849-21ssh10:22:422
1966499523,43cyclictest0-21swapper/107:47:441
1966099523,43cyclictest0-21swapper/007:36:390
1966099523,43cyclictest0-21swapper/007:36:390
63032512,9sleep20-21swapper/207:15:412
319822513,11sleep20-21swapper/209:03:522
230382513,8sleep223131-21cpuspeed08:52:432
230382513,8sleep223131-21cpuspeed08:52:432
1966599519,25cyclictest0-21swapper/209:32:482
1966599519,25cyclictest0-21swapper/209:32:482
1966599515,27cyclictest0-21swapper/210:27:352
1966599514,36cyclictest0-21swapper/209:32:282
1966599514,12cyclictest0-21swapper/211:36:522
19665995121,13cyclictest0-21swapper/211:52:472
19665995121,13cyclictest0-21swapper/210:42:592
243672503,10sleep20-21swapper/206:47:032
1966599505,27cyclictest0-21swapper/209:07:442
1966599505,13cyclictest0-21swapper/210:19:182
1966599504,28cyclictest0-21swapper/208:03:002
1966599504,28cyclictest0-21swapper/207:52:552
1966599504,28cyclictest0-21swapper/207:22:472
1966599504,27cyclictest0-21swapper/206:47:442
19665995018,14cyclictest0-21swapper/208:32:482
19665995014,21cyclictest32404-21iostat09:52:492
1966599494,29cyclictest0-21swapper/207:42:512
1966599494,27cyclictest0-21swapper/207:57:552
1966599494,27cyclictest0-21swapper/207:18:032
1966599494,26cyclictest13986-21aten_r1power_po07:32:432
1966599494,26cyclictest13986-21aten_r1power_po07:32:432
19665994911,30cyclictest0-21swapper/207:07:332
1966499494,38cyclictest0-21swapper/106:37:351
1966599484,28cyclictest0-21swapper/207:27:452
1966599484,27cyclictest0-21swapper/208:28:022
1966599484,27cyclictest0-21swapper/208:12:462
1966599484,27cyclictest0-21swapper/208:07:512
1966599483,27cyclictest0-21swapper/206:38:092
19665994819,12cyclictest0-21swapper/207:38:012
19664994834,10cyclictest0-21swapper/107:38:011
1966099484,24cyclictest0-21swapper/006:47:570
19665994723,11cyclictest0-21swapper/206:52:452
19665994723,11cyclictest0-21swapper/206:52:452
1966499474,36cyclictest0-21swapper/108:02:311
1966499464,36cyclictest0-21swapper/107:00:341
194072444,34sleep20-21swapper/206:34:422
1966099424,32cyclictest0-21swapper/006:37:340
1966699362,29cyclictest0-21swapper/306:37:343
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional