You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-01 - 02:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Mon Jun 01, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14990999624,10cyclictest1227-21runrttasks23:07:483
1499099954,25cyclictest0-21swapper/323:47:013
14990999519,16cyclictest19805-21open_inodes21:22:333
1499099944,29cyclictest0-21swapper/300:17:313
1499099944,29cyclictest0-21swapper/300:17:313
1499099925,76cyclictest0-21swapper/323:47:363
14990999210,24cyclictest0-21swapper/300:07:093
1499099905,77cyclictest0-21swapper/323:53:183
1499099905,29cyclictest0-21swapper/319:52:083
1499099903,13cyclictest17572-21ssh00:32:323
1499099894,75cyclictest0-21swapper/319:27:403
1499099894,75cyclictest0-21swapper/319:27:403
219499880,5rtkit-daemon2193-21rtkit-daemon22:57:193
219499880,5rtkit-daemon2193-21rtkit-daemon22:57:193
1499099889,11cyclictest656-21latency21:42:293
1499099886,28cyclictest0-21swapper/323:38:103
1499099886,28cyclictest0-21swapper/323:38:103
1499099879,11cyclictest9412-21cpuspeed_turbos00:22:133
14990998725,54cyclictest0-21swapper/319:32:233
14990998714,64cyclictest0-21swapper/322:12:363
14990998714,12cyclictest0-21swapper/321:48:463
1499099864,30cyclictest0-21swapper/322:42:173
1499099864,29cyclictest0-21swapper/320:07:343
1499099864,27cyclictest0-21swapper/322:07:303
14990998636,43cyclictest4744-21cpuspeed_turbos19:52:223
1499099863,25cyclictest0-21swapper/323:22:273
14990998628,50cyclictest11186-21unixbench_singl23:32:343
14990998625,52cyclictest18675-21latency19:12:363
14990998623,13cyclictest0-21swapper/319:57:433
14990998615,24cyclictest0-21swapper/321:56:293
14990998613,10cyclictest28003-21ssh22:22:303
167412850,3sleep3361ktimersoftd/319:07:403
1499099856,25cyclictest0-21swapper/300:03:203
1499099855,25cyclictest0-21swapper/322:27:063
1499099854,73cyclictest0-21swapper/321:27:223
14990998531,46cyclictest5318-21crond21:02:063
14990998521,56cyclictest28831-21cpu21:37:183
14990998521,56cyclictest28831-21cpu21:37:183
219499840,4rtkit-daemon2193-21rtkit-daemon19:39:573
1499099847,10cyclictest107550irq/46-eth000:12:163
1499099845,28cyclictest0-21swapper/320:22:213
1499099844,72cyclictest0-21swapper/321:59:363
1499099844,31cyclictest28877-21fschecks_time23:12:193
1499099844,15cyclictest0-21swapper/321:02:363
14990998426,11cyclictest29977-21unixbench_multi20:42:413
14990998417,10cyclictest23799-21df_abs22:17:183
14990998417,10cyclictest23799-21df_abs22:17:183
14989998431,45cyclictest773-21taskset00:08:012
1499099836,10cyclictest107550irq/46-eth022:37:043
1499099834,20cyclictest24506-21ssh23:07:013
1499099834,20cyclictest0-21swapper/323:57:113
14990998318,11cyclictest6442-21df_abs23:27:153
14989998337,29cyclictest29719-21ssh21:37:282
14989998337,29cyclictest29719-21ssh21:37:282
195052824,12sleep00-21swapper/021:22:290
1499099827,12cyclictest0-21swapper/319:42:213
1499099825,12cyclictest12181-21cut22:47:233
1499099824,24cyclictest0-21swapper/321:33:573
1499099824,24cyclictest0-21swapper/321:33:573
1499099824,12cyclictest32132-21rm23:17:183
1499099824,11cyclictest10103-21ssh21:08:393
14990998222,12cyclictest0-21swapper/322:39:203
1499099814,26cyclictest0-21swapper/300:29:273
1499099814,12cyclictest0-21swapper/321:14:453
14990998123,11cyclictest24711-21needreboot20:32:323
14990998111,11cyclictest14954-21munin-node21:17:393
1499099807,21cyclictest0-21swapper/320:17:093
1499099804,31cyclictest0-21swapper/319:17:393
1499099804,14cyclictest0-21swapper/322:53:483
14990998020,11cyclictest17189-21gltestperf20:17:303
14989998035,38cyclictest14609-21ssh22:52:042
1499099794,10cyclictest107550irq/46-eth020:27:243
14990997924,11cyclictest27610-21unixbench_multi20:37:413
14990997922,10cyclictest13694-21df_abs22:02:203
14990997920,10cyclictest10391-21needreboot20:02:363
14989997937,26cyclictest2977-21cpuspeed_turbos23:22:152
14989997832,39cyclictest0-21swapper/222:57:212
14989997832,39cyclictest0-21swapper/222:57:212
14989997832,38cyclictest0-21swapper/221:24:332
14989997830,32cyclictest0-21swapper/221:33:042
14989997830,32cyclictest0-21swapper/221:33:042
1499099776,16cyclictest0-21swapper/320:57:073
1499099776,16cyclictest0-21swapper/320:57:073
14989997735,35cyclictest32466-21df21:42:202
14989997733,36cyclictest0-21swapper/222:30:502
14989997732,40cyclictest0-21swapper/222:39:492
14989997731,37cyclictest0-21swapper/200:33:062
14989997729,40cyclictest0-21swapper/221:09:172
1499099764,28cyclictest17410-21kworker/u8:220:47:363
14990997617,13cyclictest0-21swapper/319:22:303
14990997617,13cyclictest0-21swapper/319:22:303
14989997634,35cyclictest0-21swapper/223:18:322
14989997632,35cyclictest0-21swapper/223:14:532
14989997531,38cyclictest0-21swapper/223:38:512
14989997531,38cyclictest0-21swapper/223:38:512
14989997436,14cyclictest19372-21ssh23:47:012
14989997433,35cyclictest28927-21ssh22:23:542
14989997432,11cyclictest14383-21turbostat.cron22:52:022
14989997430,29cyclictest0-21swapper/221:16:172
14989997426,42cyclictest0-21swapper/200:29:162
14989997328,31cyclictest0-21swapper/200:16:482
14989997326,40cyclictest0-21swapper/222:07:562
14989997227,39cyclictest7709-21diskmemload22:20:112
14989997227,39cyclictest7709-21diskmemload22:20:112
14989997226,38cyclictest0-21swapper/223:09:582
14989997135,31cyclictest27453-21timerandwakeup20:37:402
14989997133,31cyclictest11324-21sendmail_mailqu21:57:372
14989997126,31cyclictest0-21swapper/222:36:432
14989997026,38cyclictest0-21swapper/221:27:062
14989996939,24cyclictest21558-21sed20:27:232
14989996932,16cyclictest10465-21ssh00:22:282
219499680,6rtkit-daemon0-21swapper/123:28:330
14989996829,32cyclictest1124-21snmpd21:48:042
219499670,7rtkit-daemon0-21swapper/122:38:420
14989996737,23cyclictest15512-21tr19:07:222
14989996736,14cyclictest29976-21ssh00:03:272
14989996731,22cyclictest7728-21kworker/2:022:07:042
14989996730,12cyclictest0-21swapper/223:51:342
14989996729,33cyclictest0-21swapper/221:19:132
14989996727,20cyclictest0-21swapper/200:01:412
14989996724,36cyclictest0-21swapper/200:20:532
14989996724,36cyclictest0-21swapper/200:20:532
219499660,6rtkit-daemon0-21swapper/122:27:500
14989996635,24cyclictest11629-21aten2.4-expect20:07:222
14989996633,26cyclictest6310-21tr23:27:142
14989996627,22cyclictest0-21swapper/223:32:512
14989996618,35cyclictest0-21swapper/222:44:282
14989996541,18cyclictest29180-21taskset19:35:532
14989996525,35cyclictest0-21swapper/219:22:232
14989996525,35cyclictest0-21swapper/219:22:232
219499640,6rtkit-daemon21592-21ls22:12:360
14989996441,17cyclictest7016-21sh21:52:202
14989996430,28cyclictest7709-21diskmemload23:04:312
14989996424,27cyclictest22902-21ssh22:16:312
1498499645,51cyclictest0-21swapper/000:17:170
1498499645,51cyclictest0-21swapper/000:17:170
219499630,7rtkit-daemon27863-21memory22:22:280
219499630,4rtkit-daemon10423-21ssh22:44:570
180882634,51sleep00-21swapper/022:07:360
14989996345,12cyclictest19049-21tr20:22:222
14989996344,13cyclictest1186-21grep19:42:432
14989996334,23cyclictest32574-21runrttasks20:49:002
1498899633,52cyclictest0-21swapper/100:33:521
284312624,11sleep00-21swapper/023:58:370
219499620,7rtkit-daemon0-21swapper/122:48:570
219499620,6rtkit-daemon1648-21diskstats22:32:200
219499620,5rtkit-daemon23287-21ssh22:17:060
219499620,5rtkit-daemon23287-21ssh22:17:060
14989996245,11cyclictest7382-21grep19:57:282
14989996245,11cyclictest3459-21grep20:57:202
14989996244,13cyclictest9540-21grep20:02:252
14989996243,13cyclictest25195-21grep20:32:402
14989996237,18cyclictest21607-21cat19:17:442
14989996235,20cyclictest19193-21timerwakeupswit19:12:442
14989996218,30cyclictest0-21swapper/223:52:452
14989996217,40cyclictest0-21swapper/220:20:362
1498499628,36cyclictest0-21swapper/000:22:170
1498499625,48cyclictest0-21swapper/000:12:250
14989996144,12cyclictest30379-21grep19:37:292
14989996144,12cyclictest28620-21grep20:42:222
14989996144,11cyclictest5894-21tr21:02:222
14989996139,16cyclictest1901-21chrt19:47:212
14984996117,30cyclictest0-21swapper/020:03:030
67452604,12sleep00-21swapper/021:02:340
14989996042,12cyclictest1279-21cut20:52:242
14989996042,12cyclictest1279-21cut20:52:242
1498499604,48cyclictest0-21swapper/023:37:240
1498499604,48cyclictest0-21swapper/023:37:240
1498499604,38cyclictest0-21swapper/023:51:120
219499590,7rtkit-daemon0-21swapper/122:52:040
219499590,6rtkit-daemon0-21swapper/123:32:030
14989995943,11cyclictest4761-21grep19:52:222
14989995942,11cyclictest25081-21grep19:27:242
14989995942,11cyclictest25081-21grep19:27:242
1498899593,50cyclictest0-21swapper/120:02:431
14984995920,23cyclictest0-21swapper/019:48:580
14989995841,11cyclictest14012-21aten_r1power_en20:12:202
1498899584,28cyclictest0-21swapper/123:47:011
1498899583,20cyclictest15092-21ssh22:52:171
46392573,47sleep10-21swapper/123:23:071
1498899574,36cyclictest0-21swapper/122:46:341
1498499574,29cyclictest0-21swapper/023:45:390
191552563,47sleep00-21swapper/022:57:260
191552563,47sleep00-21swapper/022:57:260
173672564,14sleep00-21swapper/021:19:270
14988995638,10cyclictest22237-21cut21:27:191
1498499564,36cyclictest0-21swapper/000:09:580
240232553,10sleep00-21swapper/021:28:340
14989995534,15cyclictest14996-21grep19:07:112
1498899556,30cyclictest0-21swapper/123:52:301
1498899554,37cyclictest0-21swapper/121:16:201
34582543,8sleep13482-21grep19:47:421
262242544,13sleep00-21swapper/020:37:220
168842543,10sleep00-21swapper/019:07:420
1498899544,34cyclictest0-21swapper/123:17:321
1498899544,34cyclictest0-21swapper/100:28:271
14988995430,19cyclictest26820-21hwlatdetect20:37:281
1498899543,37cyclictest30888-21ssh00:06:441
1498899543,32cyclictest0-21swapper/122:51:501
1498499545,43cyclictest0-21swapper/023:25:470
1498499544,44cyclictest0-21swapper/021:15:560
14984995417,12cyclictest0-21swapper/021:47:210
108142543,43sleep10-21swapper/121:57:291
264202533,43sleep126425-21latency_hist22:22:041
264202533,43sleep126425-21latency_hist22:22:041
205922533,42sleep10-21swapper/120:23:251
1498899538,30cyclictest1080-21lldpd23:11:331
1498899534,32cyclictest8386-21ssh23:29:261
1498899534,29cyclictest0-21swapper/121:37:381
1498899534,29cyclictest0-21swapper/121:37:381
1498499539,27cyclictest0-21swapper/022:05:080
1498499534,43cyclictest0-21swapper/021:57:220
1498499534,42cyclictest0-21swapper/023:07:230
1498499534,42cyclictest0-21swapper/021:52:350
14984995333,12cyclictest29000-21gltestperf23:12:200
1498499533,34cyclictest0-21swapper/021:37:240
1498499533,34cyclictest0-21swapper/021:37:240
14984995318,22cyclictest0-21swapper/021:43:150
121672533,7sleep112320-21perl20:07:291
251322524,41sleep00-21swapper/019:27:250
251322524,41sleep00-21swapper/019:27:250
1498899523,43cyclictest0-21swapper/122:25:401
1498899523,42cyclictest0-21swapper/121:42:211
1498499524,27cyclictest2922-21sh20:57:060
1498499524,27cyclictest2922-21sh20:57:060
1498499523,43cyclictest12442sleep023:18:290
14984995223,13cyclictest0-21swapper/023:03:390
14984995222,13cyclictest0-21swapper/021:10:070
145472523,10sleep00-21swapper/000:28:280
9822513,10sleep10-21swapper/100:08:421
77402513,42sleep00-21swapper/019:57:320
225242512,42sleep10-21swapper/122:15:101
224172513,10sleep10-21swapper/123:51:211
190272512,43sleep10-21swapper/121:22:221
1498899517,24cyclictest0-21swapper/123:06:021
1498899514,41cyclictest0-21swapper/100:21:231
1498899514,41cyclictest0-21swapper/100:21:231
1498899514,40cyclictest0-21swapper/122:02:281
14988995133,11cyclictest16660-21cut20:17:241
1498499515,28cyclictest0-21swapper/019:37:360
1498499514,23cyclictest0-21swapper/000:32:340
14984995135,10cyclictest19312-21unixbench_multi19:12:450
1498499513,42cyclictest0-21swapper/020:32:230
14984995121,13cyclictest0-21swapper/021:32:290
14984995121,13cyclictest0-21swapper/021:32:290
124872513,42sleep012580-21interrupts20:07:320
262012503,40sleep126207-21sh23:57:011
182322502,40sleep10-21swapper/119:12:311
1498899507,28cyclictest107550irq/46-eth022:38:241
1498899504,28cyclictest0-21swapper/121:32:241
1498899504,28cyclictest0-21swapper/121:32:241
1498899504,28cyclictest0-21swapper/120:32:191
1498899504,25cyclictest0-21swapper/123:40:121
1498899504,25cyclictest0-21swapper/123:40:121
14988995034,10cyclictest4012-21gltestperf20:57:261
14988995030,13cyclictest0-21swapper/121:47:241
1498899503,29cyclictest0-21swapper/122:57:571
1498899503,29cyclictest0-21swapper/122:57:571
1498899503,29cyclictest0-21swapper/119:17:441
14988995015,20cyclictest0-21swapper/122:11:041
1498499507,34cyclictest0-21swapper/020:45:380
1498499507,27cyclictest0-21swapper/000:06:580
1498499505,28cyclictest0-21swapper/019:32:240
1498499504,28cyclictest0-21swapper/020:47:260
1498499503,23cyclictest23321-21ssh23:52:150
120452503,40sleep10-21swapper/123:35:281
266472492,10sleep10-21swapper/119:28:551
266472492,10sleep10-21swapper/119:28:551
1498899495,26cyclictest0-21swapper/119:33:551
1498899495,13cyclictest0-21swapper/100:12:391
1498899494,28cyclictest0-21swapper/121:02:301
1498899494,27cyclictest0-21swapper/122:27:371
1498899494,27cyclictest0-21swapper/120:27:391
1498899494,27cyclictest0-21swapper/119:22:281
1498899494,27cyclictest0-21swapper/119:22:281
1498899494,22cyclictest0-21swapper/121:53:301
1498899493,41cyclictest0-21swapper/121:20:391
1498899493,40cyclictest0-21swapper/120:12:241
1498899493,39cyclictest0-21swapper/123:12:151
1498499495,27cyclictest0-21swapper/019:42:220
1498499495,27cyclictest0-21swapper/019:22:340
1498499495,27cyclictest0-21swapper/019:22:340
1498499494,29cyclictest0-21swapper/020:12:300
1498499494,27cyclictest0-21swapper/020:17:270
14642492,10sleep10-21swapper/119:44:551
110032493,39sleep10-21swapper/100:22:491
103232492,9sleep10-21swapper/121:09:201
1498899484,27cyclictest0-21swapper/122:36:241
1498899484,27cyclictest0-21swapper/120:47:351
1498899483,28cyclictest0-21swapper/120:42:271
14988994819,12cyclictest0-21swapper/120:52:321
14988994819,12cyclictest0-21swapper/120:52:321
1498499485,36cyclictest0-21swapper/020:29:050
199682473,38sleep00-21swapper/019:17:130
1498899474,27cyclictest0-21swapper/119:57:321
1498499474,33cyclictest0-21swapper/021:02:070
1498499474,26cyclictest0-21swapper/020:24:040
147092474,37sleep00-21swapper/019:04:000
1498899464,25cyclictest0-21swapper/119:37:361
62632452,10sleep10-21swapper/119:53:341
1498899453,36cyclictest0-21swapper/119:08:441
1498499454,36cyclictest0-21swapper/019:53:590
14990994211,13cyclictest0-21swapper/319:07:113
148642424,31sleep10-21swapper/119:06:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional