You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-11 - 03:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Tue Aug 11, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
190179910936,27cyclictest4593-21grep23:05:360
112302870,2sleep041ktimersoftd/021:36:440
112302870,2sleep041ktimersoftd/021:36:440
19022997824,47cyclictest5545-21ssh20:40:342
19022997516,52cyclictest0-21swapper/220:05:272
19022997325,32cyclictest8336-21ssh23:10:452
19022997323,42cyclictest1227-21runrttasks21:11:042
19022997322,33cyclictest15137-21munin-node20:55:492
19022997322,33cyclictest15137-21munin-node20:55:492
19022997321,34cyclictest0-21swapper/223:20:472
19022997319,46cyclictest0-21swapper/220:04:012
19022997226,30cyclictest16948-21cut22:35:352
19022997216,34cyclictest0-21swapper/223:25:262
1901799723,61cyclictest3805-21grep20:35:550
19022997121,33cyclictest0-21swapper/221:45:372
19022997119,45cyclictest0-21swapper/222:54:562
19022997118,46cyclictest0-21swapper/220:25:542
19022997021,42cyclictest0-21swapper/222:29:192
19022997020,44cyclictest0-21swapper/223:00:312
19022997013,49cyclictest0-21swapper/222:50:122
219499690,5rtkit-daemon2193-21rtkit-daemon18:30:452
19022996920,42cyclictest14258-21seq20:52:582
19022996920,42cyclictest0-21swapper/222:40:262
19022996920,31cyclictest0-21swapper/219:25:012
19022996919,43cyclictest0-21swapper/220:00:222
19022996918,43cyclictest0-21swapper/219:54:512
19022996917,45cyclictest0-21swapper/220:12:182
19022996916,45cyclictest0-21swapper/221:38:552
19022996916,45cyclictest0-21swapper/221:38:552
1901799694,57cyclictest0-21swapper/022:05:440
19022996822,30cyclictest7208-21grep22:20:352
19022996820,43cyclictest0-21swapper/221:41:512
19022996820,41cyclictest0-21swapper/220:35:382
19022996818,44cyclictest0-21swapper/223:18:502
19022996818,43cyclictest0-21swapper/221:54:582
19022996814,46cyclictest0-21swapper/220:24:022
19022996812,50cyclictest0-21swapper/221:59:202
1901799684,56cyclictest0-21swapper/022:10:350
1901799684,56cyclictest0-21swapper/021:55:440
1901799684,55cyclictest0-21swapper/020:25:460
1901799683,58cyclictest0-21swapper/020:45:440
1901799683,57cyclictest0-21swapper/022:50:360
19022996725,26cyclictest28581-21cpuspeed_turbos21:15:332
19022996722,29cyclictest32374-21ssh22:10:312
19022996716,44cyclictest0-21swapper/220:30:352
19022996716,32cyclictest0-21swapper/222:15:302
19022996716,32cyclictest0-21swapper/222:15:302
19022996714,31cyclictest0-21swapper/222:55:322
19022996710,37cyclictest0-21swapper/221:10:202
1902199674,44cyclictest0-21swapper/121:55:161
219499660,6rtkit-daemon0-21swapper/119:01:290
19022996620,39cyclictest10523-21sh20:46:212
19022996620,28cyclictest29904-21ssh22:05:412
19022996617,43cyclictest0-21swapper/218:40:572
19022996617,42cyclictest0-21swapper/221:00:442
19022996615,44cyclictest0-21swapper/222:02:572
19022996613,46cyclictest0-21swapper/221:28:582
1901799663,55cyclictest0-21swapper/022:20:520
219499650,7rtkit-daemon0-21swapper/119:02:142
19022996520,28cyclictest6773-21ssh21:30:392
19022996520,25cyclictest21804-21ssh20:15:402
19022996520,25cyclictest21804-21ssh20:15:402
19022996516,41cyclictest0-21swapper/218:47:082
19022996514,34cyclictest0-21swapper/221:20:482
19022996513,32cyclictest0-21swapper/222:32:142
1901799654,53cyclictest0-21swapper/020:00:490
1901799653,56cyclictest0-21swapper/022:55:520
19022996419,26cyclictest26355-21munin-node19:25:502
1901799643,55cyclictest0-21swapper/022:42:040
1901799643,53cyclictest0-21swapper/021:01:040
1901799643,52cyclictest0-21swapper/020:10:440
19023996335,12cyclictest0-21swapper/320:56:533
19023996335,12cyclictest0-21swapper/320:56:533
19022996320,36cyclictest0-21swapper/219:35:532
19022996317,30cyclictest0-21swapper/219:42:012
19022996314,42cyclictest0-21swapper/218:53:222
19022996314,42cyclictest0-21swapper/218:53:222
19022996314,33cyclictest0-21swapper/223:05:472
1901799634,51cyclictest0-21swapper/022:30:400
1901799634,51cyclictest0-21swapper/020:30:530
1901799633,53cyclictest0-21swapper/023:27:550
1901799633,53cyclictest0-21swapper/021:27:320
1901799633,52cyclictest17149-21grep22:35:370
1901799633,52cyclictest0-21swapper/023:00:420
219499620,6rtkit-daemon0-21swapper/118:56:222
19022996221,35cyclictest27946-21cpuspeed_turbos18:20:412
1901799623,53cyclictest0-21swapper/020:58:120
1901799623,53cyclictest0-21swapper/020:58:120
1901799623,52cyclictest0-21swapper/022:45:300
1901799623,52cyclictest0-21swapper/020:09:190
1901799623,51cyclictest0-21swapper/020:15:470
1901799623,51cyclictest0-21swapper/020:15:470
184152620,11sleep01901799cyclictest21:49:060
219499610,6rtkit-daemon0-21swapper/119:05:512
19023996130,14cyclictest0-21swapper/321:45:503
19022996117,38cyclictest0-21swapper/218:40:242
19022996115,39cyclictest0-21swapper/218:11:002
1901799615,49cyclictest0-21swapper/021:10:530
1901799613,51cyclictest22787-21kernelversion21:05:430
1901799613,51cyclictest0-21swapper/021:41:480
1901799613,51cyclictest0-21swapper/021:16:210
19017996121,27cyclictest0-21swapper/021:24:180
1902299609,35cyclictest0-21swapper/218:00:262
19022996016,29cyclictest0-21swapper/218:06:452
19022996016,29cyclictest0-21swapper/218:06:452
19022996015,39cyclictest0-21swapper/219:30:392
19022996015,39cyclictest0-21swapper/219:30:392
1902199603,13cyclictest0-21swapper/120:55:381
1902199603,13cyclictest0-21swapper/120:55:381
1901799603,52cyclictest0-21swapper/023:20:450
19023995931,12cyclictest0-21swapper/322:40:483
19022995919,34cyclictest20877-21unixbench-2d19:10:572
1902199594,14cyclictest0-21swapper/121:15:401
19021995921,11cyclictest18797-21cpuspeed_turbos21:00:321
1901799593,48cyclictest0-21swapper/021:50:410
19017995917,34cyclictest10617-21gltestperf22:25:350
259712583,8sleep026028-21ssh22:00:320
19023995837,7cyclictest10568-21diskmemload22:00:483
19023995830,13cyclictest0-21swapper/320:25:453
19023995828,13cyclictest0-21swapper/322:18:153
19023995828,13cyclictest0-21swapper/322:18:153
19023995826,16cyclictest0-21swapper/321:35:323
19023995826,16cyclictest0-21swapper/321:35:323
19022995815,26cyclictest32127-21crond18:30:242
19022995810,42cyclictest0-21swapper/219:15:342
1902199584,13cyclictest0-21swapper/122:49:041
1902199584,13cyclictest0-21swapper/122:40:421
1902199584,12cyclictest0-21swapper/123:10:411
19021995827,12cyclictest0-21swapper/119:00:241
1901799583,49cyclictest0-21swapper/020:50:420
1901799583,49cyclictest0-21swapper/020:20:560
1901799583,47cyclictest0-21swapper/018:20:550
60122573,47sleep10-21swapper/122:19:401
60122573,47sleep10-21swapper/122:19:401
219499570,17rtkit-daemon2193-21rtkit-daemon22:05:521
19023995735,10cyclictest0-21swapper/318:35:373
19023995729,13cyclictest0-21swapper/322:27:443
19023995728,13cyclictest0-21swapper/322:50:403
19023995728,13cyclictest0-21swapper/320:12:443
19023995718,32cyclictest20866-21munin-node20:15:303
19023995718,32cyclictest20866-21munin-node20:15:303
1902199574,13cyclictest0-21swapper/121:48:281
1902199574,13cyclictest0-21swapper/121:10:321
1902199574,13cyclictest0-21swapper/120:26:171
1902199574,12cyclictest0-21swapper/120:38:221
1901799573,49cyclictest0-21swapper/022:18:260
1901799573,49cyclictest0-21swapper/022:18:260
53732563,45sleep00-21swapper/020:40:330
1902399564,32cyclictest0-21swapper/318:30:503
19023995628,13cyclictest0-21swapper/323:10:303
19023995627,13cyclictest0-21swapper/322:35:343
19023995627,11cyclictest22306-21munin-node21:55:453
1902399562,48cyclictest0-21swapper/321:15:513
19022995624,27cyclictest0-21swapper/218:17:322
19022995619,31cyclictest0-21swapper/219:45:482
1902199565,28cyclictest0-21swapper/118:20:261
1902199564,14cyclictest0-21swapper/122:36:071
1902199564,13cyclictest0-21swapper/122:33:471
1902199564,12cyclictest0-21swapper/120:41:341
19021995625,13cyclictest0-21swapper/123:00:291
19021995611,12cyclictest0-21swapper/122:26:451
1901799563,49cyclictest0-21swapper/023:18:460
1901799563,47cyclictest0-21swapper/021:31:500
305712554,12sleep00-21swapper/018:25:410
257942553,46sleep30-21swapper/322:49:583
1902399554,43cyclictest0-21swapper/320:40:403
19023995533,10cyclictest0-21swapper/320:46:153
1902399553,45cyclictest0-21swapper/323:27:373
19023995528,13cyclictest0-21swapper/322:58:583
19023995528,10cyclictest20461-21ssh21:50:473
19023995527,12cyclictest0-21swapper/321:11:583
19023995525,12cyclictest0-21swapper/321:26:403
1902199554,33cyclictest0-21swapper/121:26:031
1902199554,12cyclictest0-21swapper/122:23:251
1902199554,12cyclictest0-21swapper/118:50:251
1901799553,46cyclictest0-21swapper/019:20:400
264532543,45sleep10-21swapper/120:22:001
19023995436,11cyclictest7338-21cut22:20:363
19023995436,11cyclictest2811-21gltestperf20:35:413
19023995433,8cyclictest25093-21munin-node20:20:443
19023995431,11cyclictest0-21swapper/321:02:243
19023995429,10cyclictest31414-21df20:30:353
19023995427,13cyclictest0-21swapper/322:32:063
19023995426,10cyclictest11972-21ssh20:00:463
1902199545,32cyclictest0-21swapper/120:10:521
1902199544,13cyclictest0-21swapper/121:30:461
19021995437,11cyclictest27632-21wc22:50:471
1902199543,33cyclictest0-21swapper/120:16:201
1902199543,33cyclictest0-21swapper/120:16:201
19021995422,11cyclictest11569-21latency_hist20:50:201
1901799548,38cyclictest0-21swapper/018:35:380
19017995426,10cyclictest9990-21cpuspeed_turbos18:50:380
19017995426,10cyclictest9990-21cpuspeed_turbos18:50:380
190452533,44sleep10-21swapper/123:27:011
1902399535,39cyclictest0-21swapper/319:22:083
1902399534,29cyclictest0-21swapper/321:35:193
19023995332,10cyclictest0-21swapper/322:10:523
19023995332,10cyclictest0-21swapper/321:43:293
19023995332,10cyclictest0-21swapper/321:20:443
19023995326,13cyclictest0-21swapper/323:17:183
19023995325,14cyclictest0-21swapper/320:09:223
19023995325,13cyclictest0-21swapper/320:54:123
19023995325,12cyclictest0-21swapper/323:05:443
19023995324,13cyclictest0-21swapper/323:00:263
19023995324,13cyclictest0-21swapper/321:05:323
19023995323,13cyclictest0-21swapper/319:50:233
19023995321,14cyclictest0-21swapper/318:15:403
1902399532,46cyclictest0-21swapper/319:01:083
1902299537,31cyclictest0-21swapper/218:00:432
1902199536,26cyclictest0-21swapper/120:52:011
1902199535,13cyclictest0-21swapper/123:05:331
1902199534,29cyclictest0-21swapper/119:35:451
1902199534,11cyclictest0-21swapper/120:30:321
19021995322,13cyclictest0-21swapper/121:40:511
1901799534,42cyclictest0-21swapper/018:05:450
1901799534,42cyclictest0-21swapper/018:05:450
19017995336,10cyclictest8758-21cpuspeed_turbos19:55:370
1901799533,45cyclictest0-21swapper/023:10:410
1901799533,44cyclictest0-21swapper/019:45:380
1901799533,44cyclictest0-21swapper/019:25:370
19023995235,10cyclictest30317-21cut18:25:373
19023995226,12cyclictest0-21swapper/323:22:493
19023995225,11cyclictest30083-21missed_timers22:05:443
1902199525,41cyclictest0-21swapper/118:40:241
1902199525,28cyclictest0-21swapper/122:00:221
1902199525,28cyclictest0-21swapper/121:25:191
1902199524,28cyclictest0-21swapper/123:17:551
1902199524,28cyclictest0-21swapper/118:50:491
1902199524,28cyclictest0-21swapper/118:50:491
1902199524,28cyclictest0-21swapper/118:11:461
19021995223,15cyclictest0-21swapper/121:05:461
19021995223,12cyclictest0-21swapper/121:37:471
19021995223,12cyclictest0-21swapper/121:37:471
19021995221,13cyclictest0-21swapper/122:10:501
1901799525,40cyclictest0-21swapper/019:35:510
1901799524,40cyclictest0-21swapper/019:20:240
19017995235,10cyclictest5219-21tr18:40:390
266542513,41sleep00-21swapper/018:15:580
1902399514,29cyclictest0-21swapper/319:40:543
1902399514,29cyclictest0-21swapper/318:55:393
1902399514,29cyclictest0-21swapper/318:40:443
1902399514,29cyclictest0-21swapper/318:20:523
1902399514,29cyclictest0-21swapper/318:06:043
1902399514,29cyclictest0-21swapper/318:06:043
1902399514,28cyclictest0-21swapper/319:35:423
1902399514,28cyclictest0-21swapper/319:10:563
1902199515,28cyclictest0-21swapper/123:20:351
1902199515,28cyclictest0-21swapper/122:58:181
1902199515,28cyclictest0-21swapper/119:26:591
1902199515,27cyclictest0-21swapper/120:03:561
1902199514,29cyclictest0-21swapper/121:56:531
19021995122,11cyclictest0-21swapper/118:25:251
19021995121,13cyclictest0-21swapper/119:47:021
1901799513,43cyclictest0-21swapper/019:30:490
1901799513,43cyclictest0-21swapper/019:30:490
1901799513,42cyclictest0-21swapper/018:30:490
19023995028,9cyclictest0-21swapper/319:30:533
19023995028,9cyclictest0-21swapper/319:30:533
1902199505,28cyclictest0-21swapper/120:05:411
1902199505,27cyclictest0-21swapper/119:41:381
1902199504,29cyclictest0-21swapper/119:06:551
1902199504,28cyclictest0-21swapper/119:52:031
1902199504,28cyclictest0-21swapper/119:30:581
1902199504,28cyclictest0-21swapper/119:30:581
19021995021,13cyclictest0-21swapper/119:00:461
19021995021,10cyclictest26325-21cat19:25:241
19021995018,13cyclictest0-21swapper/118:10:111
19021995018,13cyclictest0-21swapper/118:10:111
19017995032,11cyclictest16865-21aten2.4-expect19:05:370
1901799503,41cyclictest0-21swapper/018:45:360
19017995022,13cyclictest0-21swapper/018:10:480
31112492,41sleep00-21swapper/019:41:520
1902399494,28cyclictest0-21swapper/318:00:433
1902399494,27cyclictest0-21swapper/319:55:343
19023994918,13cyclictest0-21swapper/318:11:033
1902199495,37cyclictest0-21swapper/119:20:231
1901799494,39cyclictest0-21swapper/019:50:550
1901799493,40cyclictest0-21swapper/018:01:450
1902399484,27cyclictest0-21swapper/318:51:533
1902399484,27cyclictest0-21swapper/318:51:533
1902199485,26cyclictest0-21swapper/119:10:351
1902199484,28cyclictest0-21swapper/118:40:461
19021994817,13cyclictest0-21swapper/119:57:041
1901799484,37cyclictest0-21swapper/018:55:530
1901799483,40cyclictest0-21swapper/019:10:470
318902473,38sleep10-21swapper/118:27:241
1902399474,27cyclictest0-21swapper/319:30:243
1902399473,38cyclictest0-21swapper/318:45:513
19023994718,13cyclictest0-21swapper/319:50:513
198902463,9sleep10-21swapper/118:01:281
1902399464,35cyclictest0-21swapper/319:20:233
187872453,36sleep00-21swapper/017:57:530
173832452,9sleep30-21swapper/319:05:433
20442443,35sleep10-21swapper/118:33:401
1902199403,27cyclictest18996-21latency_hist18:00:271
1902399368,20cyclictest0-21swapper/318:00:263
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional