You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-16 - 13:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Wed Jul 16, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2230991280,3rtkit-daemon0-21swapper/311:03:133
223099930,4rtkit-daemon2229-21rtkit-daemon10:42:593
2176799904,78cyclictest0-21swapper/210:53:012
2176799885,76cyclictest0-21swapper/208:38:162
2176799884,68cyclictest0-21swapper/207:43:072
2176799884,62cyclictest0-21swapper/210:32:332
2176799884,62cyclictest0-21swapper/210:32:332
2176799884,62cyclictest0-21swapper/208:17:522
2176799864,75cyclictest0-21swapper/209:28:002
2176799864,75cyclictest0-21swapper/207:37:522
2176799854,72cyclictest0-21swapper/206:53:042
2176799854,49cyclictest0-21swapper/209:58:092
2176799852,48cyclictest0-21swapper/207:57:002
2176799844,72cyclictest0-21swapper/211:32:422
2176799844,49cyclictest0-21swapper/206:58:152
2176799834,70cyclictest0-21swapper/209:11:062
2176799834,70cyclictest0-21swapper/209:11:062
2176799834,49cyclictest0-21swapper/209:48:012
2176799834,49cyclictest0-21swapper/209:48:012
2176799833,48cyclictest0-21swapper/210:18:092
2176799833,47cyclictest0-21swapper/210:48:142
2176799824,60cyclictest0-21swapper/207:38:202
2176799823,50cyclictest0-21swapper/209:13:202
21767998212,47cyclictest1160-21snmpd06:51:582
2176799814,70cyclictest0-21swapper/208:37:072
2176799813,63cyclictest31154-21idleruntime-cro11:12:422
223099800,5rtkit-daemon2229-21rtkit-daemon06:35:313
2176799805,53cyclictest1587-21nscd06:47:522
2176799804,68cyclictest0-21swapper/208:24:272
2176799803,63cyclictest0-21swapper/211:22:562
2176799803,62cyclictest0-21swapper/211:18:002
2176799794,68cyclictest0-21swapper/208:58:132
2176799794,63cyclictest0-21swapper/209:23:082
2176799794,60cyclictest0-21swapper/210:08:002
2176799794,58cyclictest0-21swapper/207:13:152
2176799794,52cyclictest0-21swapper/211:46:592
2176799784,66cyclictest0-21swapper/211:37:592
2176799784,63cyclictest0-21swapper/206:41:562
2176799784,62cyclictest0-21swapper/210:38:072
2176799784,58cyclictest0-21swapper/207:08:222
2176799784,58cyclictest0-21swapper/207:08:222
2176799784,50cyclictest0-21swapper/206:28:172
2176799783,60cyclictest0-21swapper/209:47:252
2176799783,52cyclictest15821-21munin-node11:48:062
2176799783,48cyclictest0-21swapper/207:03:102
2176799774,66cyclictest0-21swapper/207:18:112
2176799774,52cyclictest0-21swapper/209:07:202
2176799773,50cyclictest18361-21munin-node07:23:242
2176799766,62cyclictest26718-21telnet08:48:012
2176799764,65cyclictest0-21swapper/210:23:052
2176799764,61cyclictest0-21swapper/208:05:202
2176799764,56cyclictest0-21swapper/208:43:052
2176799764,46cyclictest0-21swapper/207:48:072
2176799764,46cyclictest0-21swapper/207:48:072
2176799763,66cyclictest0-21swapper/207:28:252
2176799763,50cyclictest0-21swapper/206:33:172
21767997611,41cyclictest2781-21munin-node07:58:072
2176799754,57cyclictest0-21swapper/209:22:172
2176799754,56cyclictest20434-21crond09:42:462
2176799754,48cyclictest0-21swapper/211:12:592
2176799753,49cyclictest21983-21munin-node06:23:192
2176799753,49cyclictest21983-21munin-node06:23:192
2176799744,63cyclictest0-21swapper/209:33:182
2176799744,53cyclictest0-21swapper/210:58:032
2176799744,49cyclictest0-21swapper/208:27:592
2176799744,49cyclictest0-21swapper/208:27:592
2176799743,65cyclictest0-21swapper/210:13:212
2176799743,63cyclictest12287-21munin-node10:32:562
2176799743,63cyclictest12287-21munin-node10:32:562
2176799743,63cyclictest0-21swapper/210:03:032
2176799738,43cyclictest106250irq/46-eth008:08:132
2176799734,63cyclictest0-21swapper/208:17:442
2176799734,62cyclictest17407-21grep10:42:592
2176799734,62cyclictest0-21swapper/209:53:052
2176799734,62cyclictest0-21swapper/208:53:122
2176799718,47cyclictest106250irq/46-eth011:02:552
2176799704,44cyclictest0-21swapper/211:32:432
2176799684,59cyclictest0-21swapper/206:22:542
287112640,3sleep128807-21munin-node07:43:141
223099630,4rtkit-daemon2229-21rtkit-daemon09:18:243
284952593,9sleep328579-21grep07:43:123
21766995944,10cyclictest0-21swapper/107:55:201
21766995843,10cyclictest0-21swapper/109:13:141
2176899574,28cyclictest0-21swapper/309:33:013
2176899565,32cyclictest0-21swapper/310:17:453
21768995639,10cyclictest10008-21needreboot07:03:183
21766995638,13cyclictest0-21swapper/108:22:501
21768995536,11cyclictest20862-21fgrep10:48:143
21768995522,14cyclictest0-21swapper/307:48:133
21768995522,14cyclictest0-21swapper/307:48:133
21768995520,14cyclictest0-21swapper/311:23:183
21766995537,14cyclictest0-21swapper/109:43:151
21766995534,15cyclictest0-21swapper/109:52:591
223099540,5rtkit-daemon2229-21rtkit-daemon06:22:543
2176899544,30cyclictest0-21swapper/309:53:183
2176899544,30cyclictest0-21swapper/309:02:593
21768995436,11cyclictest14055-21unixbench_multi08:18:243
21768995421,14cyclictest0-21swapper/306:23:103
21768995421,14cyclictest0-21swapper/306:23:103
21766995435,14cyclictest0-21swapper/110:08:151
2176699543,44cyclictest17058-21munin-node10:42:591
94712533,43sleep10-21swapper/110:25:161
69852533,43sleep10-21swapper/110:19:031
309082533,44sleep10-21swapper/108:53:431
249982533,44sleep10-21swapper/107:34:071
2176899535,29cyclictest0-21swapper/307:08:143
2176899535,29cyclictest0-21swapper/307:08:143
2176899535,28cyclictest0-21swapper/308:13:143
2176899534,30cyclictest0-21swapper/309:48:123
2176899534,30cyclictest0-21swapper/309:48:123
2176899534,30cyclictest0-21swapper/306:42:533
2176899534,28cyclictest0-21swapper/308:38:093
2176899533,26cyclictest0-21swapper/309:47:463
21768995322,13cyclictest46962cut09:08:093
21768995322,13cyclictest46962cut09:08:093
182792533,43sleep10-21swapper/109:37:521
116432532,11sleep30-21swapper/311:38:013
85292523,44sleep10-21swapper/107:02:301
35822522,44sleep00-21swapper/011:21:580
313722523,42sleep10-21swapper/111:12:521
298612522,10sleep00-21swapper/007:45:180
223099520,4rtkit-daemon2229-21rtkit-daemon06:53:233
2176899525,28cyclictest0-21swapper/307:28:093
2176899524,29cyclictest0-21swapper/311:33:103
2176899524,29cyclictest0-21swapper/308:43:163
2176899524,29cyclictest0-21swapper/308:08:023
2176899524,29cyclictest0-21swapper/307:58:153
2176899524,28cyclictest0-21swapper/309:32:473
2176899524,28cyclictest0-21swapper/309:17:473
2176899524,28cyclictest0-21swapper/307:18:133
21768995234,10cyclictest12889-21cut10:33:023
21768995234,10cyclictest12889-21cut10:33:023
2176899523,28cyclictest0-21swapper/307:38:053
2176699524,41cyclictest0-21swapper/111:27:421
21766995235,13cyclictest0-21swapper/107:28:161
21766995233,14cyclictest0-21swapper/111:27:571
21766995233,14cyclictest0-21swapper/107:23:041
2176399524,43cyclictest0-21swapper/011:33:110
2176399524,41cyclictest0-21swapper/008:43:030
21763995236,9cyclictest29111-21aten2.4-expect11:07:550
21763995229,11cyclictest0-21swapper/008:53:220
203222523,10sleep31160-21snmpd07:25:303
178082522,11sleep30-21swapper/311:50:423
33492512,41sleep30-21swapper/311:18:543
2176899515,28cyclictest0-21swapper/310:08:083
2176899515,27cyclictest0-21swapper/308:04:043
2176899514,30cyclictest0-21swapper/308:58:263
2176899514,29cyclictest0-21swapper/310:23:123
2176899514,28cyclictest0-21swapper/307:57:073
2176899514,28cyclictest0-21swapper/306:58:283
2176899514,22cyclictest27898-21aten2.4-expect09:57:583
2176899513,30cyclictest0-21swapper/310:03:033
21768995121,12cyclictest0-21swapper/311:17:423
21768995118,14cyclictest0-21swapper/310:38:093
21766995135,12cyclictest0-21swapper/110:07:461
21766995134,11cyclictest0-21swapper/106:53:131
2176699513,28cyclictest398-21sshd08:58:181
21763995136,10cyclictest0-21swapper/009:32:230
21763995132,13cyclictest0-21swapper/007:28:200
21763995129,11cyclictest0-21swapper/011:03:120
21763995129,10cyclictest0-21swapper/008:08:020
21763995124,9cyclictest7276-21latency_hist10:22:450
177142513,40sleep10-21swapper/111:49:271
153362513,9sleep10-21swapper/111:44:321
83482502,40sleep30-21swapper/311:31:483
62322500,5sleep06234-21cat08:03:150
36562503,41sleep30-21swapper/306:51:203
218352502,41sleep10-21swapper/110:52:571
2176899504,28cyclictest0-21swapper/311:43:063
2176899504,27cyclictest0-21swapper/308:23:273
2176899504,26cyclictest0-21swapper/310:32:453
2176899504,26cyclictest0-21swapper/310:32:453
2176699504,39cyclictest0-21swapper/110:17:461
21766995032,14cyclictest0-21swapper/111:32:571
21766995032,13cyclictest0-21swapper/111:03:181
21766995032,12cyclictest0-21swapper/106:43:101
21766995031,13cyclictest0-21swapper/107:13:041
21766995030,15cyclictest0-21swapper/108:08:101
21763995035,10cyclictest0-21swapper/009:23:170
21763995033,10cyclictest10009-21strings07:03:180
21763995028,11cyclictest0-21swapper/006:33:220
21763995021,9cyclictest25220-21latency_hist09:52:460
21763995021,9cyclictest25220-21latency_hist09:52:460
288152493,40sleep10-21swapper/108:52:341
2176899497,25cyclictest0-21swapper/309:42:463
2176899494,29cyclictest0-21swapper/306:32:313
2176899494,27cyclictest0-21swapper/309:27:223
2176899493,38cyclictest0-21swapper/310:58:093
2176899493,29cyclictest0-21swapper/310:57:373
2176699494,37cyclictest19499-21aten2.4-expect10:47:561
21766994933,11cyclictest0-21swapper/109:48:181
21766994933,11cyclictest0-21swapper/109:48:181
21766994931,12cyclictest0-21swapper/108:13:011
21766994930,14cyclictest0-21swapper/106:33:061
21766994930,13cyclictest0-21swapper/108:23:191
2176699493,39cyclictest0-21swapper/109:03:151
2176699493,38cyclictest0-21swapper/107:48:221
2176699493,38cyclictest0-21swapper/107:48:221
21766994912,31cyclictest3965-21aten_r1power_cu09:08:011
21766994912,31cyclictest3965-21aten_r1power_cu09:08:011
21763994930,14cyclictest0-21swapper/010:13:050
21763994930,13cyclictest0-21swapper/008:18:190
21763994928,10cyclictest0-21swapper/010:38:170
21763994928,10cyclictest0-21swapper/010:33:010
21763994928,10cyclictest0-21swapper/010:33:010
21763994928,10cyclictest0-21swapper/009:08:250
21763994928,10cyclictest0-21swapper/009:08:250
21763994927,11cyclictest0-21swapper/009:13:080
21763994926,12cyclictest0-21swapper/010:48:140
47572482,40sleep10-21swapper/108:00:351
239962483,39sleep10-21swapper/108:42:021
238282482,10sleep00-21swapper/006:23:560
238282482,10sleep00-21swapper/006:23:560
2176899484,38cyclictest0-21swapper/307:34:073
2176899484,28cyclictest0-21swapper/308:48:013
2176899484,27cyclictest0-21swapper/306:46:383
21768994833,9cyclictest18886-21sed08:28:223
21768994833,9cyclictest18886-21sed08:28:223
2176699484,37cyclictest0-21swapper/109:23:161
21766994832,12cyclictest0-21swapper/106:28:301
21766994831,13cyclictest0-21swapper/106:22:561
21766994831,13cyclictest0-21swapper/106:22:561
21766994830,12cyclictest0-21swapper/111:07:541
2176699483,38cyclictest26383-21munin-run11:02:431
2176699483,38cyclictest0-21swapper/109:33:071
21766994828,15cyclictest0-21swapper/107:18:091
21766994828,14cyclictest0-21swapper/107:07:531
21766994827,14cyclictest0-21swapper/109:57:581
2176399484,38cyclictest0-21swapper/007:08:220
2176399484,38cyclictest0-21swapper/007:08:220
2176399483,39cyclictest0-21swapper/011:28:120
2176399483,39cyclictest0-21swapper/009:02:470
2176399483,38cyclictest0-21swapper/008:28:010
2176399483,38cyclictest0-21swapper/008:28:010
21763994827,10cyclictest0-21swapper/010:58:070
21763994827,10cyclictest0-21swapper/006:43:260
21763994826,11cyclictest0-21swapper/011:12:580
21763994826,11cyclictest0-21swapper/010:28:080
21763994826,11cyclictest0-21swapper/010:28:080
213842482,10sleep30-21swapper/308:34:103
203722482,10sleep00-21swapper/009:42:020
131692483,39sleep10-21swapper/107:10:491
131692483,39sleep10-21swapper/107:10:491
108232482,10sleep00-21swapper/009:21:550
85332472,10sleep00-21swapper/007:02:340
48482472,10sleep00-21swapper/008:01:470
2176899474,26cyclictest0-21swapper/310:22:223
21768994720,13cyclictest0-21swapper/311:11:133
2176699474,37cyclictest0-21swapper/109:18:071
21766994723,12cyclictest0-21swapper/110:28:151
21766994723,12cyclictest0-21swapper/110:28:151
21763994732,10cyclictest17420-21mailstats07:18:260
21763994729,14cyclictest0-21swapper/009:58:150
21763994729,13cyclictest0-21swapper/008:48:010
215902474,36sleep00-21swapper/006:21:070
209702473,10sleep10-21swapper/108:33:241
156452472,10sleep30-21swapper/307:16:433
69892463,38sleep10-21swapper/108:03:331
310832463,37sleep00-21swapper/006:40:120
274962462,10sleep00-21swapper/009:56:250
21768994626,14cyclictest0-21swapper/308:53:093
21763994630,10cyclictest24014-21grep07:33:110
2176399463,38cyclictest0-21swapper/009:43:090
21763994629,12cyclictest0-21swapper/007:23:030
21763994627,13cyclictest0-21swapper/009:36:160
21763994625,10cyclictest0-21swapper/010:03:060
21763994624,10cyclictest0-21swapper/010:22:590
189672462,39sleep00-21swapper/010:44:420
117732463,37sleep00-21swapper/008:13:400
261822453,10sleep10-21swapper/108:44:201
21902452,38sleep00-21swapper/007:53:450
2176699456,33cyclictest0-21swapper/111:18:081
21766994528,11cyclictest0-21swapper/106:48:161
21766994525,14cyclictest0-21swapper/106:38:071
21766994519,11cyclictest0-21swapper/110:33:101
21766994519,11cyclictest0-21swapper/110:33:101
21763994531,9cyclictest480-21grep10:08:000
21763994531,9cyclictest32454-21munin-plugin-st07:52:500
21763994531,9cyclictest32454-21munin-plugin-st07:52:500
21763994531,10cyclictest0-21swapper/010:53:190
21763994530,11cyclictest0-21swapper/006:53:130
2176399453,38cyclictest0-21swapper/006:28:160
21763994528,12cyclictest0-21swapper/011:47:560
21763994524,14cyclictest0-21swapper/011:47:040
21763994523,11cyclictest0-21swapper/008:23:040
155842453,11sleep10-21swapper/109:31:481
60052442,36sleep00-21swapper/011:27:220
274452442,36sleep00-21swapper/007:39:540
238102442,36sleep00-21swapper/008:39:350
2176699443,35cyclictest0-21swapper/108:28:021
2176699443,35cyclictest0-21swapper/108:28:021
2176699443,19cyclictest0-21swapper/107:38:251
21763994430,9cyclictest15290-21grep07:13:260
21763994429,9cyclictest19617-21aten2.4-expect08:33:050
21763994428,12cyclictest0-21swapper/011:38:130
215412444,33sleep10-21swapper/106:20:271
130932443,10sleep10-21swapper/111:41:251
2176399432,37cyclictest0-21swapper/009:03:130
21766994224,14cyclictest0-21swapper/110:37:491
21763994227,11cyclictest0-21swapper/006:48:270
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional