You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-16 - 02:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Wed Sep 16, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
892421210,5sleep08928-21tr21:51:410
2194991090,5rtkit-daemon2193-21rtkit-daemon21:39:460
168819910843,10cyclictest11012-21crond21:06:280
168819910742,9cyclictest13132-21fschecks_count22:46:440
168819910742,9cyclictest13132-21fschecks_count22:46:440
16888999935,12cyclictest0-21swapper/221:09:122
16881999843,11cyclictest0-21swapper/020:26:540
16881999841,12cyclictest0-21swapper/022:16:480
16881999841,11cyclictest0-21swapper/022:09:180
16888999625,10cyclictest29777-21fgrep22:21:542
16886999631,12cyclictest0-21swapper/120:21:541
16888999535,13cyclictest0-21swapper/219:44:362
16888999528,8cyclictest9630-21munin-run19:26:312
16886999531,12cyclictest0-21swapper/121:50:471
16886999437,12cyclictest0-21swapper/121:21:411
16888999224,13cyclictest0-21swapper/221:14:502
16881999240,11cyclictest0-21swapper/021:26:540
16888999133,11cyclictest0-21swapper/220:00:582
1688699915,13cyclictest0-21swapper/119:37:571
16886999031,13cyclictest0-21swapper/121:11:361
16886998931,12cyclictest0-21swapper/120:29:141
16888998733,10cyclictest0-21swapper/221:31:312
16886998730,10cyclictest0-21swapper/122:51:451
16888998632,10cyclictest0-21swapper/221:03:512
16888998515,15cyclictest0-21swapper/219:11:552
16886998531,12cyclictest0-21swapper/120:36:581
1688899833,46cyclictest0-21swapper/221:56:422
16888998235,8cyclictest2719-21ssh22:31:362
16888998120,15cyclictest0-21swapper/222:13:302
188372770,12sleep21688899cyclictest18:36:522
16888997731,10cyclictest0-21swapper/218:56:502
99662760,5sleep310016-21proc_pri18:17:033
16888997618,15cyclictest0-21swapper/219:29:012
16888997618,15cyclictest0-21swapper/219:29:012
16888997615,14cyclictest0-21swapper/220:26:582
16881997244,9cyclictest24610-21cpuspeed_turbos17:41:510
16881997243,13cyclictest0-21swapper/020:36:420
1688199717,56cyclictest0-21swapper/019:52:030
16889996920,27cyclictest3820-21unixbench_singl21:42:013
1688899695,46cyclictest0-21swapper/222:55:492
16881996949,13cyclictest0-21swapper/019:58:050
1688199694,26cyclictest0-21swapper/021:13:150
16881996849,13cyclictest0-21swapper/020:01:510
16881996743,12cyclictest0-21swapper/020:16:480
16881996642,10cyclictest0-21swapper/022:51:420
16881996641,12cyclictest0-21swapper/022:31:450
16881996640,11cyclictest0-21swapper/020:51:430
219499650,5rtkit-daemon2193-21rtkit-daemon17:32:042
16888996535,13cyclictest0-21swapper/221:26:492
1688199656,52cyclictest0-21swapper/019:41:160
1688999644,36cyclictest0-21swapper/322:22:093
16881996442,8cyclictest22174-21cat20:32:020
16881996441,11cyclictest0-21swapper/022:26:490
16881996441,11cyclictest0-21swapper/021:17:540
16881996441,11cyclictest0-21swapper/017:56:350
16881996440,12cyclictest0-21swapper/022:15:380
16881996440,12cyclictest0-21swapper/021:46:420
219499630,5rtkit-daemon2193-21rtkit-daemon20:34:413
16886996335,13cyclictest0-21swapper/119:26:311
16881996343,9cyclictest1227-21runrttasks21:09:260
16881996343,14cyclictest0-21swapper/021:46:260
16881996340,8cyclictest13544-21timerwakeupswit21:56:570
16881996340,12cyclictest0-21swapper/020:49:420
16881996340,11cyclictest0-21swapper/022:41:560
16881996340,11cyclictest0-21swapper/020:24:360
16881996340,11cyclictest0-21swapper/018:46:570
16881996339,11cyclictest0-21swapper/020:56:300
16881996339,11cyclictest0-21swapper/017:46:490
56042620,5sleep15605-21expr20:56:471
1688899624,51cyclictest2427-21cat22:31:242
16886996226,22cyclictest31478-21sort19:57:031
16881996240,12cyclictest0-21swapper/019:26:460
16881996240,12cyclictest0-21swapper/019:26:460
16881996240,11cyclictest0-21swapper/022:24:290
16881996238,12cyclictest0-21swapper/018:01:350
285492613,12sleep30-21swapper/319:52:443
219499610,4rtkit-daemon2193-21rtkit-daemon17:38:483
16888996138,10cyclictest0-21swapper/220:06:522
16888996134,12cyclictest0-21swapper/222:46:272
16888996134,12cyclictest0-21swapper/222:46:272
16886996132,12cyclictest0-21swapper/121:02:011
16881996148,9cyclictest0-21swapper/018:02:020
1688199614,50cyclictest0-21swapper/021:21:400
1688199614,48cyclictest27253-21ssh20:41:400
16881996139,12cyclictest0-21swapper/019:46:510
16881996138,13cyclictest0-21swapper/019:41:490
219499600,4rtkit-daemon2193-21rtkit-daemon18:45:083
16888996035,9cyclictest20913-21ssh22:09:202
16886996033,13cyclictest0-21swapper/122:27:121
16881996047,7cyclictest6545-21ssh20:09:200
16881996044,11cyclictest0-21swapper/022:39:080
16881996042,8cyclictest30776-21latency_hist21:36:270
16881996035,12cyclictest0-21swapper/022:05:540
1688999597,34cyclictest0-21swapper/320:09:163
1688999594,40cyclictest0-21swapper/322:44:083
16888995936,7cyclictest9619-21diskmemload19:47:042
16888995935,9cyclictest9917-21ssh21:51:542
16886995933,10cyclictest27065-21df_abs19:51:491
1688199594,48cyclictest0-21swapper/018:22:050
1688199593,49cyclictest0-21swapper/019:19:040
219499580,4rtkit-daemon2193-21rtkit-daemon17:36:033
1688899584,47cyclictest0-21swapper/220:31:562
1688699584,48cyclictest0-21swapper/119:46:551
16886995834,11cyclictest0-21swapper/119:31:551
16886995833,12cyclictest0-21swapper/120:43:521
1688899573,47cyclictest0-21swapper/222:01:572
16886995733,10cyclictest0-21swapper/122:31:521
16886995730,13cyclictest0-21swapper/120:13:441
16886995730,13cyclictest0-21swapper/120:13:441
16886995730,12cyclictest0-21swapper/122:02:561
16886995729,13cyclictest0-21swapper/122:41:411
16886995729,13cyclictest0-21swapper/120:32:401
1688199575,29cyclictest0-21swapper/018:56:540
1688199574,36cyclictest0-21swapper/019:31:460
219499560,5rtkit-daemon2193-21rtkit-daemon19:31:593
219499560,5rtkit-daemon2193-21rtkit-daemon19:26:443
219499560,5rtkit-daemon2193-21rtkit-daemon19:26:443
196402562,10sleep30-21swapper/319:41:323
16889995639,12cyclictest25325-21cpuspeed_turbos22:16:403
16889995639,10cyclictest3234-21unixbench_multi18:02:083
1688899564,47cyclictest0-21swapper/219:31:422
16888995634,10cyclictest0-21swapper/222:45:052
16881995621,12cyclictest0-21swapper/020:15:100
16881995621,12cyclictest0-21swapper/020:15:100
38802553,44sleep00-21swapper/019:11:580
219499550,5rtkit-daemon2193-21rtkit-daemon18:27:093
16889995536,12cyclictest20463-21sed19:41:483
16888995535,8cyclictest1227-21runrttasks18:07:032
16888995535,8cyclictest1227-21runrttasks18:07:032
16888995533,11cyclictest0-21swapper/219:37:502
16888995532,10cyclictest0-21swapper/218:16:462
16888995516,23cyclictest0-21swapper/220:41:492
1688699555,44cyclictest0-21swapper/121:16:561
16886995533,9cyclictest2181-21gltestperf20:51:461
1688699553,20cyclictest0-21swapper/122:09:181
16886995529,13cyclictest0-21swapper/119:43:401
16886995529,12cyclictest0-21swapper/122:21:441
16886995529,12cyclictest0-21swapper/121:51:291
304742543,44sleep230564-21aten2.4-expect20:46:412
219499540,6rtkit-daemon2193-21rtkit-daemon19:46:513
219499540,5rtkit-daemon2193-21rtkit-daemon22:26:523
219499540,5rtkit-daemon2193-21rtkit-daemon17:21:492
16889995437,10cyclictest30509-21cpuspeed_turbos19:01:473
1688899545,43cyclictest24250-21ssh20:36:422
16888995434,8cyclictest4877-21ssh21:45:512
16888995434,7cyclictest18032-21basename18:36:332
16888995433,11cyclictest0-21swapper/220:12:442
16888995433,11cyclictest0-21swapper/220:12:442
16888995426,11cyclictest1365-21munin-node20:51:382
16888995419,28cyclictest0-21swapper/220:04:212
16888995411,20cyclictest0-21swapper/220:20:192
16886995432,10cyclictest0-21swapper/122:11:451
16886995432,10cyclictest0-21swapper/121:41:401
1688699543,45cyclictest31648-21grep21:36:431
16886995426,13cyclictest0-21swapper/120:07:001
16881995433,13cyclictest0-21swapper/018:37:030
108412543,9sleep110968-21tr20:16:451
286932535,9sleep10-21swapper/117:50:161
219499530,5rtkit-daemon2193-21rtkit-daemon18:47:533
219499530,5rtkit-daemon2193-21rtkit-daemon18:06:473
219499530,5rtkit-daemon2193-21rtkit-daemon18:06:473
16889995337,9cyclictest5415-21tr19:16:493
1688899535,40cyclictest0-21swapper/222:16:482
16888995334,7cyclictest20085-21ssh21:18:172
16888995333,9cyclictest0-21swapper/220:56:582
16888995333,10cyclictest0-21swapper/219:54:122
16888995330,10cyclictest0-21swapper/222:36:282
1688899533,44cyclictest0-21swapper/221:39:582
1688899533,42cyclictest7227-21crond19:21:312
16888995323,13cyclictest0-21swapper/220:21:562
16888995323,13cyclictest0-21swapper/218:46:462
1688699534,44cyclictest0-21swapper/118:02:001
1688699534,42cyclictest0-21swapper/122:00:071
1688699534,42cyclictest0-21swapper/120:47:021
16886995331,11cyclictest0-21swapper/122:18:041
16886995330,11cyclictest0-21swapper/121:06:481
1688699532,45cyclictest21874-21munin-node17:37:101
219499520,5rtkit-daemon2193-21rtkit-daemon20:21:493
219499520,5rtkit-daemon2193-21rtkit-daemon18:21:543
1688999525,40cyclictest0-21swapper/322:11:093
16889995216,26cyclictest15034-21df_abs21:11:463
1688899526,28cyclictest0-21swapper/217:26:582
1688899525,40cyclictest0-21swapper/219:09:302
1688899525,29cyclictest0-21swapper/218:52:042
16888995231,10cyclictest0-21swapper/218:24:552
16888995230,11cyclictest0-21swapper/221:49:242
16888995230,10cyclictest0-21swapper/221:24:322
16886995230,11cyclictest0-21swapper/117:41:511
16886995230,10cyclictest0-21swapper/121:31:501
16886995226,15cyclictest0-21swapper/118:12:111
16886995226,12cyclictest0-21swapper/120:02:321
16886995223,11cyclictest0-21swapper/118:27:061
16886995223,10cyclictest27737-21cat18:56:341
68782512,9sleep30-21swapper/320:58:153
219499510,5rtkit-daemon2193-21rtkit-daemon21:17:403
219499510,5rtkit-daemon2193-21rtkit-daemon20:48:563
219499510,5rtkit-daemon2193-21rtkit-daemon20:18:423
219499510,5rtkit-daemon2193-21rtkit-daemon18:37:013
219499510,5rtkit-daemon2193-21rtkit-daemon18:11:473
1688999514,14cyclictest0-21swapper/321:22:483
16889995135,10cyclictest24990-21sed21:26:423
16889995132,11cyclictest24596-21cpuspeed_turbos17:41:513
1688899515,28cyclictest0-21swapper/217:46:522
1688699514,42cyclictest0-21swapper/117:57:091
16886995137,10cyclictest0-21swapper/121:28:161
16886995130,10cyclictest0-21swapper/118:37:521
1688699513,43cyclictest0-21swapper/119:26:421
1688699513,43cyclictest0-21swapper/119:26:421
1688199513,12cyclictest0-21swapper/018:06:470
1688199513,12cyclictest0-21swapper/018:06:470
1688199513,11cyclictest0-21swapper/019:01:450
154522512,9sleep20-21swapper/218:29:232
95572502,9sleep30-21swapper/319:25:523
237452503,9sleep20-21swapper/217:38:002
1688999506,37cyclictest3048-21df_abs22:31:393
1688999504,12cyclictest17380-21aten_r1power_po20:26:423
16889995033,9cyclictest950-21cpuspeed_turbos20:01:443
16889995033,9cyclictest12102-21grep21:06:463
1688999503,39cyclictest0-21swapper/320:37:303
16889995018,23cyclictest1195-21kernelversion19:06:553
16888995029,10cyclictest0-21swapper/218:13:552
1688899502,43cyclictest0-21swapper/219:02:422
1688699504,42cyclictest0-21swapper/122:48:451
1688699504,42cyclictest0-21swapper/122:48:451
16886995026,13cyclictest0-21swapper/122:37:031
1688199505,38cyclictest0-21swapper/018:51:440
1688199504,28cyclictest0-21swapper/017:37:420
16881995021,13cyclictest0-21swapper/018:26:490
131932502,10sleep30-21swapper/321:56:533
129132502,42sleep10-21swapper/118:22:251
107932506,9sleep10-21swapper/118:20:521
5762494,38sleep30-21swapper/321:37:383
325662493,9sleep00-21swapper/019:06:420
219499490,4rtkit-daemon2193-21rtkit-daemon22:49:293
219499490,4rtkit-daemon2193-21rtkit-daemon22:49:293
1688999498,31cyclictest0-21swapper/319:56:413
1688999495,13cyclictest0-21swapper/321:46:563
1688999495,13cyclictest0-21swapper/321:06:123
1688999495,13cyclictest0-21swapper/318:56:513
1688999494,13cyclictest0-21swapper/322:36:543
1688999494,12cyclictest0-21swapper/322:02:253
1688999494,10cyclictest18015-21sh18:36:333
16889994931,11cyclictest1651-21tr20:51:413
1688999493,9cyclictest9619-21diskmemload22:13:193
16888994919,24cyclictest1227-21runrttasks17:45:052
1688699495,37cyclictest0-21swapper/118:11:351
1688699495,37cyclictest0-21swapper/118:11:351
16886994925,12cyclictest0-21swapper/117:53:081
1688199494,38cyclictest0-21swapper/018:16:460
16881994932,11cyclictest8343-21grep19:21:500
16881994930,13cyclictest0-21swapper/018:31:540
16881994920,11cyclictest0-21swapper/018:41:500
1688999484,38cyclictest0-21swapper/321:31:573
1688999482,23cyclictest0-21swapper/320:11:433
1688999482,23cyclictest0-21swapper/320:11:433
16889994815,24cyclictest0-21swapper/320:44:113
1688899485,27cyclictest0-21swapper/218:01:562
1688699484,37cyclictest0-21swapper/117:36:371
16881994835,8cyclictest19261-21munin-run17:31:360
16881994832,11cyclictest0-21swapper/018:11:470
253952472,38sleep30-21swapper/318:51:373
177272473,38sleep317730-21ssh22:52:283
1688999475,35cyclictest0-21swapper/321:51:393
16889994720,22cyclictest1227-21runrttasks19:14:463
16888994713,12cyclictest0-21swapper/217:56:472
1688699475,35cyclictest0-21swapper/119:16:461
1688699474,27cyclictest0-21swapper/119:01:331
1688699473,39cyclictest0-21swapper/119:16:041
1688699473,37cyclictest1124-21snmpd17:27:391
1688999466,28cyclictest0-21swapper/317:57:113
1688999463,34cyclictest0-21swapper/317:56:353
1688899464,36cyclictest0-21swapper/217:56:352
1688899464,28cyclictest0-21swapper/218:42:062
1688699463,38cyclictest0-21swapper/119:06:571
1688199464,35cyclictest0-21swapper/017:26:370
16881994629,13cyclictest0-21swapper/017:31:540
16889994527,11cyclictest18798-21unixbench_multi17:27:093
16889994519,18cyclictest27350-21fschecks_time17:46:543
1688699454,34cyclictest0-21swapper/117:26:371
1688699453,36cyclictest0-21swapper/118:46:451
1688699445,12cyclictest0-21swapper/118:31:361
1688699444,35cyclictest0-21swapper/118:42:531
16886994428,10cyclictest31050-21gltestperf19:01:531
1688999424,28cyclictest0-21swapper/317:26:373
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional