You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-07 - 21:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sun Dec 07, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
68202940,5sleep041ktimersoftd/010:34:350
68202940,5sleep041ktimersoftd/010:34:350
25924998333,12cyclictest0-21swapper/308:00:133
25924997832,8cyclictest19883-21latency_hist07:39:423
25924997635,11cyclictest0-21swapper/309:24:363
25918997320,33cyclictest1185-21sshd09:29:500
25918997130,12cyclictest1369-21runrttasks09:14:490
25918996920,42cyclictest0-21swapper/006:55:030
25918996918,43cyclictest0-21swapper/007:29:540
25918996820,31cyclictest0-21swapper/008:54:560
25918996817,43cyclictest0-21swapper/011:04:330
25918996810,50cyclictest0-21swapper/010:40:030
2592399673,58cyclictest0-21swapper/208:04:532
25918996719,15cyclictest0-21swapper/007:45:140
25918996713,47cyclictest0-21swapper/010:55:080
25918996620,25cyclictest0-21swapper/008:20:130
25918996618,41cyclictest0-21swapper/009:00:040
25918996617,33cyclictest0-21swapper/011:39:430
243799660,8rtkit-daemon0-21swapper/011:48:482
25918996516,42cyclictest0-21swapper/007:53:140
25918996516,33cyclictest0-21swapper/011:14:530
25918996516,33cyclictest0-21swapper/011:14:530
25918996515,30cyclictest0-21swapper/011:04:480
25918996419,39cyclictest0-21swapper/006:44:560
25918996419,29cyclictest0-21swapper/009:35:050
25918996418,30cyclictest0-21swapper/012:04:560
25918996414,31cyclictest0-21swapper/011:10:070
25918996414,31cyclictest0-21swapper/011:10:070
25918996318,29cyclictest0-21swapper/009:08:520
25918996318,29cyclictest0-21swapper/009:08:520
25918996316,40cyclictest0-21swapper/007:59:410
25918996315,41cyclictest0-21swapper/008:25:130
25918996315,41cyclictest0-21swapper/008:25:130
25918996315,29cyclictest1369-21runrttasks11:29:430
25918996217,38cyclictest0-21swapper/008:35:050
25918996217,38cyclictest0-21swapper/008:10:040
25918996217,28cyclictest0-21swapper/007:24:550
25918996216,27cyclictest0-21swapper/008:04:400
25918996215,40cyclictest0-21swapper/008:04:530
25918996215,39cyclictest17115-21taskset12:01:380
25918996213,42cyclictest0-21swapper/009:58:590
25918996117,37cyclictest1243-21snmpd08:50:240
25918996114,40cyclictest0-21swapper/007:34:570
25918996113,41cyclictest0-21swapper/011:54:430
25918996113,41cyclictest0-21swapper/011:54:430
25918996113,32cyclictest0-21swapper/011:39:160
25918996113,32cyclictest0-21swapper/010:20:090
152832613,50sleep10-21swapper/109:44:481
152832613,50sleep10-21swapper/109:44:481
25918996027,17cyclictest0-21swapper/008:14:560
25918996020,25cyclictest15470-21mailstats10:50:050
25918996017,36cyclictest0-21swapper/008:39:510
25918996016,28cyclictest0-21swapper/007:15:150
25918996014,29cyclictest0-21swapper/010:39:060
25918996013,31cyclictest0-21swapper/007:43:380
25918996013,31cyclictest0-21swapper/007:43:380
25918996012,36cyclictest0-21swapper/011:24:030
2592399594,48cyclictest0-21swapper/207:59:592
25918995920,18cyclictest19195-21grep08:44:530
25918995915,37cyclictest0-21swapper/011:49:450
25918995915,29cyclictest0-21swapper/010:00:120
25918995913,39cyclictest0-21swapper/008:32:330
49742588,7sleep20-21swapper/208:14:572
25924995838,13cyclictest0-21swapper/311:55:013
25924995838,13cyclictest0-21swapper/311:55:013
25923995815,36cyclictest9078-21crond08:24:392
25918995815,30cyclictest0-21swapper/011:29:140
25918995814,35cyclictest0-21swapper/010:18:140
25918995813,39cyclictest0-21swapper/009:23:540
25918995813,39cyclictest0-21swapper/006:49:570
25918995811,39cyclictest0-21swapper/010:25:050
243799580,7rtkit-daemon0-21swapper/010:45:211
243799580,6rtkit-daemon0-21swapper/010:52:351
2592399575,45cyclictest0-21swapper/210:04:512
2592399574,46cyclictest0-21swapper/209:19:392
2592199574,46cyclictest2217-21rt-features11:30:011
2591899579,41cyclictest0-21swapper/010:44:470
25918995721,12cyclictest1369-21runrttasks07:19:590
25918995720,21cyclictest1243-21snmpd11:44:430
25918995717,25cyclictest5782-21munin-node07:10:070
25918995715,28cyclictest0-21swapper/009:25:000
25921995636,12cyclictest31264-21cpuspeed_turbos06:54:591
2592199563,46cyclictest25741-21turbostat11:14:331
2592199563,46cyclictest25741-21turbostat11:14:331
25918995627,23cyclictest1369-21runrttasks12:12:580
25918995616,25cyclictest864-21aten2.4-expect06:59:540
25918995616,25cyclictest864-21aten2.4-expect06:59:540
25918995612,30cyclictest0-21swapper/007:05:400
296672553,43sleep20-21swapper/209:05:072
296672553,43sleep20-21swapper/209:05:072
25924995539,10cyclictest0-21swapper/308:14:593
2592399553,46cyclictest0-21swapper/211:49:452
2592199554,30cyclictest0-21swapper/109:24:371
2592199554,30cyclictest0-21swapper/108:14:401
2591899558,30cyclictest0-21swapper/009:40:020
25918995514,35cyclictest0-21swapper/009:53:590
25918995514,29cyclictest0-21swapper/009:44:480
25918995514,29cyclictest0-21swapper/009:44:480
28362542,44sleep10-21swapper/109:16:231
2592499545,12cyclictest0-21swapper/310:54:453
2592399545,44cyclictest0-21swapper/209:35:072
2592399544,43cyclictest0-21swapper/211:30:002
2592199545,30cyclictest0-21swapper/109:53:591
2592199545,30cyclictest0-21swapper/106:49:431
2592199545,28cyclictest0-21swapper/111:55:161
2592199545,28cyclictest0-21swapper/111:55:161
2592199544,44cyclictest9814-21tail09:30:111
2592199544,30cyclictest0-21swapper/107:50:141
25921995435,12cyclictest19108-21cpuspeed_turbos10:59:491
25921995422,13cyclictest0-21swapper/112:05:041
25918995411,28cyclictest0-21swapper/009:09:500
25924995340,8cyclictest23679-21hostname08:54:523
25924995328,11cyclictest0-21swapper/307:09:573
2592399535,40cyclictest0-21swapper/207:14:542
2592399534,44cyclictest0-21swapper/209:44:572
2592399534,44cyclictest0-21swapper/209:44:572
2592399534,12cyclictest15508-21find08:35:082
2592399533,45cyclictest0-21swapper/208:29:532
2592399533,44cyclictest0-21swapper/210:49:342
2592399533,44cyclictest0-21swapper/210:20:072
2592399533,44cyclictest0-21swapper/209:09:492
2592399533,44cyclictest0-21swapper/207:30:102
2592399532,46cyclictest0-21swapper/206:49:562
2592399532,45cyclictest0-21swapper/207:34:592
2592399532,44cyclictest0-21swapper/210:10:072
2592199534,41cyclictest3557-21cpuspeed_turbos11:34:481
2592199534,30cyclictest0-21swapper/109:25:011
2592199534,30cyclictest0-21swapper/108:30:051
2592199534,29cyclictest0-21swapper/111:05:021
2592199534,29cyclictest0-21swapper/110:44:351
25921995319,16cyclictest0-21swapper/110:34:061
25921995319,16cyclictest0-21swapper/110:34:061
25921995319,15cyclictest0-21swapper/111:50:031
25918995332,14cyclictest25920-21basename06:44:430
25918995312,27cyclictest0-21swapper/010:04:460
112812532,43sleep10-21swapper/108:27:181
112812532,43sleep10-21swapper/108:27:181
2592499525,40cyclictest0-21swapper/312:09:483
25924995234,12cyclictest0-21swapper/309:49:363
25924995234,12cyclictest0-21swapper/309:49:363
2592399523,44cyclictest0-21swapper/211:14:452
2592399523,44cyclictest0-21swapper/211:14:452
2592399523,43cyclictest0-21swapper/207:45:022
2592399522,44cyclictest0-21swapper/211:59:542
2592199525,28cyclictest0-21swapper/108:44:591
2592199524,32cyclictest0-21swapper/107:20:051
2592199524,31cyclictest0-21swapper/110:55:021
2592199524,29cyclictest0-21swapper/110:19:581
2592199524,29cyclictest0-21swapper/108:49:501
2592199524,29cyclictest0-21swapper/107:30:161
2592199524,28cyclictest0-21swapper/108:34:501
2592199524,28cyclictest0-21swapper/107:00:111
2592199524,28cyclictest0-21swapper/107:00:111
2592199524,28cyclictest0-21swapper/106:44:441
25921995235,10cyclictest17346-21gltestperf08:39:581
25921995233,11cyclictest25700-21gltestperf10:04:541
25921995219,14cyclictest0-21swapper/107:45:161
25921995216,17cyclictest0-21swapper/109:09:531
2591899529,37cyclictest0-21swapper/010:10:020
128782522,9sleep10-21swapper/109:39:441
2592499513,41cyclictest13091-21processes08:30:083
2592399514,41cyclictest0-21swapper/207:10:122
2592399514,34cyclictest28172tune2fs10:25:012
2592399513,42cyclictest25035-21mailstats11:10:102
2592399513,42cyclictest25035-21mailstats11:10:102
2592399513,42cyclictest0-21swapper/209:30:062
2592399513,42cyclictest0-21swapper/207:55:122
2592399513,30cyclictest0-21swapper/211:04:332
2592399512,43cyclictest0-21swapper/207:50:032
2592399512,43cyclictest0-21swapper/206:55:132
2592199515,27cyclictest0-21swapper/107:08:331
2592199514,31cyclictest0-21swapper/107:39:581
2592199514,31cyclictest0-21swapper/107:39:581
2592199514,29cyclictest0-21swapper/107:55:051
2592199514,28cyclictest0-21swapper/108:55:091
2592199514,28cyclictest0-21swapper/107:19:421
2592199514,28cyclictest0-21swapper/107:14:431
25921995133,11cyclictest28972-21unixbench_singl10:10:111
25921995132,12cyclictest13256-21cpuspeed_turbos07:24:561
25924995033,13cyclictest0-21swapper/311:14:513
25924995033,13cyclictest0-21swapper/311:14:513
25924995025,7cyclictest16192-21latency_hist10:54:343
25924995010,33cyclictest0-21swapper/310:34:523
2592399504,42cyclictest0-21swapper/211:54:432
2592399504,42cyclictest0-21swapper/211:54:432
2592399504,41cyclictest0-21swapper/208:55:062
2592399504,40cyclictest0-21swapper/212:04:522
2592399504,40cyclictest0-21swapper/209:50:092
2592399504,39cyclictest0-21swapper/206:59:552
2592399504,39cyclictest0-21swapper/206:59:552
2592399504,37cyclictest0-21swapper/209:59:512
2592399504,30cyclictest0-21swapper/207:26:552
2592399504,29cyclictest0-21swapper/209:23:542
2592399504,26cyclictest0-21swapper/211:04:462
2592399504,16cyclictest0-21swapper/207:19:552
2592399502,43cyclictest0-21swapper/208:44:562
2592399502,42cyclictest0-21swapper/206:44:562
2592399502,41cyclictest0-21swapper/210:14:472
25923995018,25cyclictest0-21swapper/211:24:502
25923995017,12cyclictest18650-21latency_hist08:44:392
2592199505,27cyclictest0-21swapper/109:38:561
2592199504,29cyclictest0-21swapper/111:59:521
2592199504,29cyclictest0-21swapper/111:24:551
2592199504,28cyclictest0-21swapper/111:44:421
2592199504,28cyclictest0-21swapper/109:03:511
2592199504,26cyclictest0-21swapper/109:54:501
2592499494,40cyclictest0-21swapper/309:10:103
2592499494,38cyclictest3585-21sendmail_mailqu08:10:103
2592499494,38cyclictest0-21swapper/308:39:403
25924994936,8cyclictest32186-21cpu10:19:483
25924994934,11cyclictest0-21swapper/307:05:083
25924994934,10cyclictest0-21swapper/309:03:513
25924994927,10cyclictest0-21swapper/309:51:413
25924994920,11cyclictest17513-21cat07:34:423
2592399496,36cyclictest0-21swapper/212:09:432
2592399496,28cyclictest0-21swapper/211:35:442
2592399494,40cyclictest0-21swapper/209:40:072
2592399494,30cyclictest0-21swapper/207:40:042
2592399494,30cyclictest0-21swapper/207:40:042
2592399494,28cyclictest0-21swapper/208:13:432
25923994929,15cyclictest0-21swapper/211:24:332
25923994923,8cyclictest7800-21latency_hist11:44:322
2592399492,42cyclictest0-21swapper/210:54:522
2592399492,42cyclictest0-21swapper/209:25:092
2592199495,9cyclictest0-21swapper/108:18:371
2592199495,28cyclictest0-21swapper/111:17:461
2592199495,28cyclictest0-21swapper/111:17:461
2592199494,28cyclictest0-21swapper/112:14:201
2592199494,14cyclictest0-21swapper/110:35:041
87652482,38sleep10-21swapper/108:20:371
2592499485,37cyclictest2400-21sendmail_mailqu07:00:123
2592499485,37cyclictest2400-21sendmail_mailqu07:00:123
2592499483,40cyclictest0-21swapper/309:05:093
2592499483,40cyclictest0-21swapper/309:05:093
2592499483,40cyclictest0-21swapper/308:44:383
2592399484,38cyclictest0-21swapper/210:35:032
2592399484,38cyclictest0-21swapper/210:29:552
2592399484,38cyclictest0-21swapper/210:29:552
2592399484,28cyclictest0-21swapper/208:50:142
2592399482,40cyclictest0-21swapper/209:00:102
2592199484,28cyclictest0-21swapper/107:38:381
2592199484,23cyclictest0-21swapper/109:59:511
2592199483,40cyclictest0-21swapper/110:25:061
2592199483,38cyclictest29789-21sendmail_mailqu11:20:021
125242482,9sleep30-21swapper/307:22:303
2592499475,7cyclictest11840-21fgrep11:50:023
2592499475,35cyclictest0-21swapper/311:04:463
2592499475,35cyclictest0-21swapper/308:49:513
2592499474,37cyclictest0-21swapper/307:55:023
25924994733,10cyclictest0-21swapper/308:44:593
2592499473,39cyclictest0-21swapper/308:25:143
2592499473,39cyclictest0-21swapper/308:25:143
2592399475,37cyclictest0-21swapper/209:54:482
2592399474,37cyclictest0-21swapper/210:39:472
2592399474,37cyclictest0-21swapper/208:24:522
2592399474,37cyclictest0-21swapper/208:24:522
2592399474,36cyclictest4273-21grep07:05:022
2592399473,39cyclictest0-21swapper/210:50:082
2592199474,27cyclictest0-21swapper/110:19:031
2592199474,27cyclictest0-21swapper/108:06:531
2592199474,26cyclictest0-21swapper/111:40:081
25921994729,11cyclictest29328-21gltestperf09:05:001
25921994729,11cyclictest29328-21gltestperf09:05:001
25921994717,14cyclictest0-21swapper/106:49:581
3462464,9sleep30-21swapper/311:28:283
268322462,39sleep30-21swapper/310:07:473
25924994631,9cyclictest9300-21tail09:30:033
25924994630,10cyclictest21098-21munin-node09:55:013
25924994629,12cyclictest0-21swapper/310:44:543
2592499462,39cyclictest0-21swapper/312:00:023
25921994627,13cyclictest0-21swapper/107:59:591
208712462,38sleep30-21swapper/311:03:293
29182452,9sleep30-21swapper/311:33:323
2592499454,34cyclictest0-21swapper/310:14:513
2592499454,34cyclictest0-21swapper/308:05:093
25924994531,9cyclictest32574-21grep06:55:173
25924994530,10cyclictest0-21swapper/307:45:153
2592499452,37cyclictest30521-21sadc11:24:333
2592499452,37cyclictest12947-21aten2.4-expect09:39:513
243322452,36sleep30-21swapper/310:01:223
25924994430,9cyclictest23926-21cpuspeed_turbos11:09:473
25924994430,9cyclictest23926-21cpuspeed_turbos11:09:473
2592499443,35cyclictest9573-21rt-features07:15:113
2592499443,35cyclictest0-21swapper/306:54:443
25924994429,11cyclictest0-21swapper/311:39:483
25924994429,11cyclictest0-21swapper/310:44:073
25924994429,11cyclictest0-21swapper/306:44:573
2592499442,37cyclictest0-21swapper/310:29:493
2592499442,37cyclictest0-21swapper/310:29:493
257142444,33sleep20-21swapper/206:42:322
100522442,9sleep30-21swapper/311:47:553
42232432,35sleep30-21swapper/310:29:283
25924994331,8cyclictest6356-21fschecks_count09:24:563
2592499433,36cyclictest0-21swapper/312:04:563
2592499433,34cyclictest25474-21chrt07:49:583
2592499433,25cyclictest0-21swapper/311:38:383
25924994328,11cyclictest0-21swapper/309:18:193
25924994323,9cyclictest0-21swapper/307:29:153
222212432,35sleep30-21swapper/307:44:153
222212432,35sleep30-21swapper/307:44:153
125652432,35sleep30-21swapper/309:38:373
90732422,34sleep30-21swapper/308:24:383
2592499422,26cyclictest0-21swapper/310:14:353
25924994122,14cyclictest0-21swapper/306:44:443
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional