You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-19 - 10:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sat Sep 19, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19440999527,60cyclictest0-21swapper/020:48:380
1944099914,11cyclictest0-21swapper/021:58:470
1944099903,35cyclictest0-21swapper/022:26:310
1944099903,23cyclictest20168-21tr20:23:550
1944099903,23cyclictest20168-21tr20:23:550
19440999016,9cyclictest1048-21ssh19:54:050
1944099894,34cyclictest19438-21awk17:23:460
1944099894,33cyclictest0-21swapper/022:34:040
1944099894,33cyclictest0-21swapper/022:34:040
1944099894,12cyclictest0-21swapper/021:53:590
69612880,3sleep3361ktimersoftd/320:53:383
1944099884,77cyclictest0-21swapper/021:45:490
1944099884,30cyclictest0-21swapper/020:05:530
1944099884,24cyclictest0-21swapper/019:29:160
1944099884,21cyclictest0-21swapper/021:52:480
1944099884,21cyclictest0-21swapper/021:52:480
19440998832,50cyclictest0-21swapper/018:06:490
19440998817,7cyclictest13848-21ssh20:13:580
19440998811,8cyclictest0-21swapper/019:43:420
1944099874,12cyclictest0-21swapper/022:17:360
1944099873,30cyclictest6356-21crond20:03:410
1944099864,32cyclictest0-21swapper/019:49:060
1944099864,32cyclictest0-21swapper/019:49:060
1944099864,32cyclictest0-21swapper/017:28:580
1944099864,12cyclictest0-21swapper/022:08:570
1944099863,75cyclictest0-21swapper/021:04:330
1944099863,27cyclictest0-21swapper/020:12:380
1944099863,25cyclictest0-21swapper/021:13:490
1944099863,25cyclictest0-21swapper/021:03:120
1944099863,20cyclictest12172-21diskmemload19:33:590
19440998623,14cyclictest0-21swapper/022:06:300
1944099859,19cyclictest0-21swapper/021:31:100
1944099854,31cyclictest0-21swapper/022:38:490
1944099854,31cyclictest0-21swapper/020:50:040
1944099854,31cyclictest0-21swapper/020:20:260
1944099854,23cyclictest0-21swapper/020:43:120
1944099853,35cyclictest0-21swapper/020:33:360
1944099853,35cyclictest0-21swapper/020:33:360
1944099853,30cyclictest0-21swapper/022:19:020
1944099853,13cyclictest0-21swapper/022:31:260
1944099853,12cyclictest0-21swapper/017:45:290
1944099846,31cyclictest0-21swapper/021:12:430
1944099844,14cyclictest0-21swapper/020:54:080
1944099844,12cyclictest0-21swapper/019:09:070
1944099844,12cyclictest0-21swapper/019:09:070
1944099843,30cyclictest0-21swapper/018:13:570
1944099843,24cyclictest0-21swapper/017:39:350
1944099843,13cyclictest0-21swapper/022:52:490
1944099843,12cyclictest0-21swapper/021:38:480
1944099843,12cyclictest0-21swapper/020:36:590
1944099834,13cyclictest0-21swapper/021:24:010
1944099833,21cyclictest12172-21diskmemload21:33:580
19440998326,9cyclictest12744-21grep19:23:550
19440998315,11cyclictest0-21swapper/021:18:560
19440998314,13cyclictest0-21swapper/018:53:590
1944099824,27cyclictest0-21swapper/018:09:100
19440998229,9cyclictest13734-21head18:18:560
1944099814,30cyclictest0-21swapper/019:14:010
1944099814,23cyclictest0-21swapper/022:48:090
90102800,4sleep39011-21expr21:44:013
1944099804,32cyclictest0-21swapper/018:48:560
1944099804,27cyclictest0-21swapper/018:44:060
1944099804,23cyclictest0-21swapper/019:46:230
1944099804,12cyclictest0-21swapper/019:03:550
1944099803,23cyclictest0-21swapper/017:24:190
1944099793,27cyclictest0-21swapper/017:54:060
1944099793,24cyclictest0-21swapper/017:59:250
1944099793,23cyclictest0-21swapper/018:39:030
19440997927,9cyclictest17737-21unixbench_multi18:24:180
19440997924,12cyclictest0-21swapper/017:48:590
19440997924,12cyclictest0-21swapper/017:48:590
19440997911,7cyclictest0-21swapper/018:58:550
1944099784,22cyclictest0-21swapper/017:33:570
1944099783,24cyclictest0-21swapper/018:29:070
1944099783,24cyclictest0-21swapper/018:29:070
19440997816,9cyclictest20866-21telnet18:33:550
81712733,63sleep20-21swapper/222:33:362
19442996942,10cyclictest1174-21needreboot19:54:061
19442996839,13cyclictest0-21swapper/117:58:571
19442996835,12cyclictest0-21swapper/121:13:421
19442996740,12cyclictest0-21swapper/118:03:551
19442996739,11cyclictest13336-21aten_r1power_po20:13:521
19442996724,25cyclictest1227-21runrttasks20:09:151
173412673,55sleep20-21swapper/222:45:572
1944399663,55cyclictest0-21swapper/220:04:102
1944399654,54cyclictest0-21swapper/220:49:072
1944399653,54cyclictest0-21swapper/220:33:532
1944399644,8cyclictest9931-21head20:08:512
1944399643,53cyclictest0-21swapper/219:28:532
19442996423,10cyclictest19699-21latency_hist20:23:411
1944399634,51cyclictest0-21swapper/222:03:512
1944399633,53cyclictest14916-21latency21:04:022
1944399633,53cyclictest0-21swapper/222:53:342
19443996311,45cyclictest0-21swapper/220:38:502
19442996331,9cyclictest18631-21expr22:48:501
19442996331,12cyclictest25679-21aten_r1power_cu19:43:511
19442996323,12cyclictest0-21swapper/121:04:091
219499620,24rtkit-daemon2193-21rtkit-daemon21:09:022
1944399624,49cyclictest0-21swapper/221:18:572
1944399623,52cyclictest0-21swapper/222:24:052
1944399623,51cyclictest0-21swapper/220:54:532
19442996245,11cyclictest21653-21gltestperf18:34:031
19442996234,12cyclictest0-21swapper/121:39:541
1944299623,21cyclictest0-21swapper/119:39:111
19442996222,13cyclictest29144-21awk22:14:071
1944499614,14cyclictest0-21swapper/321:59:083
19444996126,29cyclictest1227-21runrttasks17:43:573
1944499612,53cyclictest0-21swapper/322:22:003
1944399614,49cyclictest0-21swapper/222:09:032
1944399614,49cyclictest0-21swapper/220:43:532
1944399613,50cyclictest0-21swapper/222:13:552
1944399613,50cyclictest0-21swapper/219:13:542
1944399612,51cyclictest0-21swapper/219:44:022
19442996140,13cyclictest0-21swapper/119:50:461
19442996140,13cyclictest0-21swapper/119:50:461
19442996130,10cyclictest0-21swapper/121:55:471
19442996119,14cyclictest0-21swapper/120:04:061
1944499606,47cyclictest12060-21cpuspeed_turbos22:38:493
1944499605,48cyclictest12853-21df19:23:563
1944499605,46cyclictest21695-21yum20:24:163
1944499605,46cyclictest21695-21yum20:24:163
1944499604,49cyclictest23470-21ssh22:06:343
1944399604,48cyclictest0-21swapper/221:46:102
1944399604,48cyclictest0-21swapper/220:14:032
1944399603,50cyclictest0-21swapper/219:59:152
1944399603,49cyclictest0-21swapper/221:38:512
1944399603,49cyclictest0-21swapper/220:58:512
1944399603,49cyclictest0-21swapper/220:19:052
1944399603,49cyclictest0-21swapper/219:34:002
1944399602,52cyclictest0-21swapper/219:38:572
1944399602,12cyclictest0-21swapper/221:23:542
19442996042,12cyclictest0-21swapper/120:43:231
19442996030,10cyclictest0-21swapper/122:23:311
19442996027,10cyclictest0-21swapper/121:37:381
19442996026,10cyclictest0-21swapper/122:03:591
114462603,12sleep20-21swapper/222:38:352
114462603,12sleep20-21swapper/222:38:352
219499590,6rtkit-daemon2193-21rtkit-daemon18:29:012
219499590,6rtkit-daemon2193-21rtkit-daemon18:29:012
219499590,4rtkit-daemon2193-21rtkit-daemon21:14:402
1944499595,48cyclictest0-21swapper/319:29:013
1944399593,48cyclictest0-21swapper/221:48:522
1944399593,48cyclictest0-21swapper/221:48:522
1944399592,10cyclictest0-21swapper/220:29:092
1944399592,10cyclictest0-21swapper/220:29:092
19442995940,13cyclictest0-21swapper/120:51:011
19442995928,10cyclictest0-21swapper/121:08:481
19442995927,11cyclictest0-21swapper/120:02:111
19442995920,13cyclictest0-21swapper/122:09:091
87332584,9sleep18755-21swap20:54:141
252472583,13sleep30-21swapper/319:43:093
1944499586,14cyclictest0-21swapper/321:33:373
1944499583,13cyclictest0-21swapper/320:04:163
1944399583,47cyclictest15648-21ssh19:28:422
19442995843,8cyclictest19158-21rm19:33:551
19442995838,14cyclictest0-21swapper/120:59:171
19442995828,10cyclictest0-21swapper/122:27:541
19442995820,12cyclictest12168-21iostat21:49:001
19442995820,12cyclictest12168-21iostat21:49:001
1944499574,46cyclictest0-21swapper/320:13:473
1944499574,13cyclictest0-21swapper/320:59:053
1944499574,13cyclictest0-21swapper/318:29:033
1944499574,13cyclictest0-21swapper/318:29:033
19444995721,29cyclictest2553-21head17:54:043
19444995714,27cyclictest16350-21open_files22:44:023
1944399573,47cyclictest0-21swapper/222:39:502
1944299576,44cyclictest0-21swapper/120:34:041
1944299575,28cyclictest0-21swapper/120:28:321
1944299575,28cyclictest0-21swapper/120:28:321
19442995736,15cyclictest0-21swapper/122:02:231
19442995729,13cyclictest0-21swapper/117:54:021
19442995726,13cyclictest0-21swapper/121:18:551
19442995726,12cyclictest0-21swapper/122:42:231
19442995722,12cyclictest0-21swapper/117:30:281
19442995721,14cyclictest0-21swapper/121:25:041
19442995721,12cyclictest0-21swapper/122:32:321
19442995719,14cyclictest0-21swapper/119:24:581
219499560,6rtkit-daemon2193-21rtkit-daemon19:04:002
1992925613,36sleep319990-21missed_timers19:34:063
1944499565,9cyclictest27079-21fschecks_count20:33:563
1944499564,14cyclictest0-21swapper/321:06:443
1944499564,13cyclictest0-21swapper/321:18:133
1944399567,42cyclictest0-21swapper/217:49:192
1944399567,42cyclictest0-21swapper/217:49:192
1944399564,11cyclictest0-21swapper/221:53:502
19443995633,9cyclictest32090-21kworker/2:021:34:392
1944399563,47cyclictest0-21swapper/221:58:522
1944399563,46cyclictest0-21swapper/222:18:482
1944299566,29cyclictest0-21swapper/119:30:251
1944299565,28cyclictest0-21swapper/118:44:001
1944299564,28cyclictest0-21swapper/118:23:451
19442995632,11cyclictest0-21swapper/118:24:021
19442995627,12cyclictest0-21swapper/121:43:591
19442995626,13cyclictest0-21swapper/119:09:161
19442995626,13cyclictest0-21swapper/119:09:161
326662553,45sleep30-21swapper/320:43:393
219499550,6rtkit-daemon2193-21rtkit-daemon17:54:022
219499550,5rtkit-daemon2193-21rtkit-daemon19:19:142
1944499555,13cyclictest0-21swapper/320:21:293
1944499554,44cyclictest0-21swapper/321:50:543
1944499554,44cyclictest0-21swapper/321:50:543
1944499554,35cyclictest0-21swapper/322:10:183
1944499554,14cyclictest0-21swapper/320:45:393
1944499554,13cyclictest0-21swapper/322:36:123
1944499554,13cyclictest0-21swapper/322:36:123
1944499554,13cyclictest0-21swapper/318:10:323
19444995521,12cyclictest0-21swapper/317:53:463
19444995521,12cyclictest0-21swapper/317:53:463
1944399556,43cyclictest0-21swapper/220:26:172
1944399556,43cyclictest0-21swapper/220:26:172
19443995533,8cyclictest12172-21diskmemload21:31:072
1944299556,27cyclictest0-21swapper/120:31:471
1944299556,27cyclictest0-21swapper/120:31:471
1944299555,28cyclictest0-21swapper/119:19:181
1944299555,27cyclictest0-21swapper/118:30:381
1944299555,27cyclictest0-21swapper/118:30:381
1944299554,29cyclictest0-21swapper/122:33:561
1944299554,29cyclictest0-21swapper/122:33:561
1944299554,28cyclictest0-21swapper/121:28:511
1944299554,28cyclictest0-21swapper/119:14:151
1944299554,28cyclictest0-21swapper/117:44:021
1944299554,27cyclictest0-21swapper/122:45:201
1944299553,29cyclictest0-21swapper/118:14:041
19442995522,13cyclictest0-21swapper/120:44:061
19442995522,13cyclictest0-21swapper/118:39:051
19442995521,14cyclictest0-21swapper/119:03:561
95482542,10sleep30-21swapper/319:15:403
219499540,6rtkit-daemon2193-21rtkit-daemon18:49:082
219499540,5rtkit-daemon2193-21rtkit-daemon18:24:012
219499540,5rtkit-daemon2193-21rtkit-daemon17:44:032
219499540,5rtkit-daemon2193-21rtkit-daemon17:39:182
219499540,5rtkit-daemon2193-21rtkit-daemon17:34:182
1944499546,14cyclictest0-21swapper/319:49:233
1944499546,14cyclictest0-21swapper/319:49:233
1944499544,14cyclictest0-21swapper/319:19:073
1944499544,13cyclictest14993-21diskstats21:53:533
1944499544,13cyclictest0-21swapper/322:23:483
1944499544,10cyclictest9922-21aten_r1power_cu20:08:503
19444995438,11cyclictest7347-21gltestperf18:04:033
1944499543,13cyclictest0-21swapper/319:06:353
1944399543,44cyclictest493-21fschecks_count19:53:592
1944399543,44cyclictest29643-21ssh19:48:592
1944399543,44cyclictest29643-21ssh19:48:592
1944299545,30cyclictest0-21swapper/117:34:201
1944299544,27cyclictest0-21swapper/118:55:421
1944299544,26cyclictest0-21swapper/117:40:301
1944499535,28cyclictest0-21swapper/321:18:393
1944499534,11cyclictest0-21swapper/321:37:373
19444995337,11cyclictest27152-21tr17:39:013
1944399533,43cyclictest32496-21latency_hist18:58:442
1944399533,43cyclictest1227-21runrttasks18:19:012
19442995318,13cyclictest0-21swapper/117:48:591
19442995318,13cyclictest0-21swapper/117:48:591
19442995312,19cyclictest0-21swapper/118:58:571
226172523,10sleep30-21swapper/318:34:243
219499520,6rtkit-daemon2193-21rtkit-daemon19:09:072
219499520,6rtkit-daemon2193-21rtkit-daemon19:09:072
219499520,5rtkit-daemon2193-21rtkit-daemon19:00:002
219499520,5rtkit-daemon2193-21rtkit-daemon18:34:012
219499520,5rtkit-daemon2193-21rtkit-daemon18:04:022
1944499524,41cyclictest0-21swapper/320:53:553
1944499524,29cyclictest0-21swapper/321:09:003
1944499524,29cyclictest0-21swapper/317:38:473
19444995217,30cyclictest27721-21cpu22:13:483
1944399523,29cyclictest0-21swapper/218:38:562
19443995229,9cyclictest8882-21telnet18:08:562
1944399522,44cyclictest0-21swapper/218:44:172
219499510,5rtkit-daemon2193-21rtkit-daemon18:14:022
219499510,5rtkit-daemon2193-21rtkit-daemon17:59:022
1944499515,29cyclictest0-21swapper/320:30:503
1944499515,29cyclictest0-21swapper/320:30:503
1944499515,29cyclictest0-21swapper/319:57:033
1944399512,43cyclictest0-21swapper/217:29:122
54042502,10sleep30-21swapper/320:00:023
218042502,10sleep20-21swapper/217:28:462
1944499505,29cyclictest0-21swapper/321:24:163
1944499505,27cyclictest0-21swapper/322:48:483
1944499505,26cyclictest0-21swapper/321:38:383
1944499504,29cyclictest0-21swapper/319:09:053
1944499504,29cyclictest0-21swapper/319:09:053
1944499504,27cyclictest0-21swapper/319:45:503
216242493,40sleep10-21swapper/117:26:271
1944499495,27cyclictest0-21swapper/318:45:403
1944499495,27cyclictest0-21swapper/318:39:023
1944499495,27cyclictest0-21swapper/318:20:363
1944499494,27cyclictest0-21swapper/318:53:443
1944499494,26cyclictest0-21swapper/322:28:523
19444994935,8cyclictest22642-21fschecks_count17:29:033
19442994930,12cyclictest9668-21gltestperf18:09:041
19444994820,11cyclictest0-21swapper/318:59:203
1944299484,24cyclictest30115-21munin-run18:53:431
1944099484,27cyclictest0-21swapper/019:20:460
1944499474,25cyclictest0-21swapper/318:18:453
19444994733,9cyclictest16880-21gltestperf18:24:043
49642462,37sleep30-21swapper/317:59:063
19444994618,13cyclictest0-21swapper/317:23:593
19444994416,9cyclictest19597-21cat17:23:473
1944499434,22cyclictest0-21swapper/318:53:543
19442994216,10cyclictest0-21swapper/117:23:471
1944399412,32cyclictest19416-21latency_hist17:23:472
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional