You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 13:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Mon Jul 20, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
285742960,5sleep028572-21mailstats09:21:010
2677199954,83cyclictest29424-21idleruntime-cro08:35:330
2677199923,23cyclictest24380-21munin-node09:15:480
2677199916,20cyclictest11878-21ssh09:45:490
2677199914,23cyclictest0-21swapper/008:58:530
2677199904,79cyclictest0-21swapper/010:35:560
2677199904,26cyclictest0-21swapper/011:18:160
26771999020,54cyclictest0-21swapper/008:15:470
2677199894,78cyclictest0-21swapper/008:44:060
2677199894,61cyclictest0-21swapper/011:20:390
2677199894,25cyclictest0-21swapper/007:21:050
2677199894,25cyclictest0-21swapper/007:21:050
2677199893,26cyclictest0-21swapper/008:50:100
2677199893,26cyclictest0-21swapper/008:50:100
2677199893,24cyclictest23630-21ssh08:25:530
2677199893,24cyclictest19336-21rm10:45:490
26771998918,9cyclictest14690-21kworker/0:011:41:020
26771998918,14cyclictest0-21swapper/010:02:050
26771998916,9cyclictest21814-21telnet10:50:400
26771998916,9cyclictest21814-21telnet10:50:400
26771998914,12cyclictest0-21swapper/009:30:430
26771998914,12cyclictest0-21swapper/009:30:430
2677199885,24cyclictest0-21swapper/010:27:380
2677199884,67cyclictest0-21swapper/010:20:300
2677199884,66cyclictest0-21swapper/011:32:060
2677199884,23cyclictest0-21swapper/010:00:300
2677199883,25cyclictest29254-21yum-updatesd-he11:00:530
2677199883,23cyclictest0-21swapper/009:41:340
2677199883,22cyclictest20491-21basename09:10:430
26771998818,12cyclictest0-21swapper/011:48:040
26771998815,12cyclictest0-21swapper/011:35:560
26771998813,11cyclictest0-21swapper/009:38:160
2677199874,76cyclictest0-21swapper/010:09:430
2677199874,28cyclictest0-21swapper/011:05:510
2677199874,22cyclictest0-21swapper/009:52:240
26771998718,9cyclictest0-21swapper/010:22:210
2677199864,65cyclictest0-21swapper/007:56:000
2677199864,65cyclictest0-21swapper/006:21:010
2677199864,24cyclictest0-21swapper/010:11:310
2677199864,24cyclictest0-21swapper/010:11:310
2677199864,21cyclictest0-21swapper/009:08:160
2677199863,25cyclictest0-21swapper/011:11:020
2677199863,23cyclictest0-21swapper/010:40:550
2677199863,22cyclictest0-21swapper/008:51:320
212312860,6sleep1201ktimersoftd/109:10:501
2677199854,65cyclictest0-21swapper/007:50:490
2677199854,25cyclictest0-21swapper/010:30:390
2677199854,24cyclictest0-21swapper/008:23:020
2677199845,70cyclictest0-21swapper/009:25:560
2677199843,25cyclictest0-21swapper/010:59:140
26771998417,7cyclictest14372-21ssh11:26:120
26771998416,12cyclictest0-21swapper/009:01:030
26771998414,11cyclictest0-21swapper/007:00:590
2677199824,12cyclictest0-21swapper/008:35:480
2677199823,71cyclictest32256-21tail07:36:110
2677199804,69cyclictest0-21swapper/007:31:010
26771998020,53cyclictest0-21swapper/006:31:090
2677199794,24cyclictest0-21swapper/006:35:470
2677199793,24cyclictest0-21swapper/006:41:120
2677199793,24cyclictest0-21swapper/006:41:120
26771997925,47cyclictest11053-21sed08:00:540
2677199784,67cyclictest0-21swapper/008:10:490
26771997824,45cyclictest19454-21sed07:10:570
26771997810,8cyclictest8812-21awk06:50:380
2677199764,10cyclictest12631-21tail08:05:460
2677199764,10cyclictest12631-21tail08:05:460
2677199763,11cyclictest0-21swapper/006:55:380
26771997618,50cyclictest0-21swapper/007:15:470
26771997615,12cyclictest0-21swapper/007:10:370
2677199754,22cyclictest0-21swapper/007:48:330
2677199754,12cyclictest0-21swapper/006:28:530
2677199753,22cyclictest0-21swapper/007:25:510
2677199753,22cyclictest0-21swapper/007:25:510
2677199748,13cyclictest0-21swapper/007:40:550
2677199713,11cyclictest0-21swapper/006:55:490
2677199704,22cyclictest0-21swapper/006:20:380
2677599644,7cyclictest18198-21cpuspeed_turbos09:55:453
26774996221,22cyclictest0-21swapper/207:35:532
26773996222,11cyclictest8975-21if_eth009:40:521
219499620,4rtkit-daemon2193-21rtkit-daemon08:14:522
2677599619,44cyclictest361ktimersoftd/310:01:003
2677499615,50cyclictest0-21swapper/209:00:452
246162614,49sleep20-21swapper/211:42:392
230032612,9sleep30-21swapper/307:19:033
219499610,5rtkit-daemon2193-21rtkit-daemon07:27:542
219499610,5rtkit-daemon2193-21rtkit-daemon07:27:542
161292613,11sleep30-21swapper/309:02:313
2677599603,12cyclictest0-21swapper/309:45:453
2677399604,40cyclictest0-21swapper/108:57:111
219499600,4rtkit-daemon2193-21rtkit-daemon08:16:142
147482604,13sleep20-21swapper/210:40:062
2677599594,12cyclictest0-21swapper/309:35:013
2677599594,12cyclictest0-21swapper/309:35:013
2677499594,32cyclictest0-21swapper/208:35:332
2677499594,28cyclictest0-21swapper/210:00:382
26774995937,14cyclictest0-21swapper/211:45:542
2677599583,36cyclictest0-21swapper/310:06:443
2677599583,11cyclictest0-21swapper/309:16:193
2677499586,33cyclictest0-21swapper/211:15:522
2677499584,48cyclictest0-21swapper/210:10:482
2677499584,48cyclictest0-21swapper/210:10:482
2677499584,36cyclictest0-21swapper/209:22:382
26774995821,22cyclictest19190-21open_inodes09:55:592
26774995818,25cyclictest0-21swapper/208:24:332
2677399584,39cyclictest0-21swapper/110:55:581
189852583,9sleep219037-21sh10:45:462
284922572,48sleep30-21swapper/311:49:533
2677499578,31cyclictest0-21swapper/211:12:212
2677499574,34cyclictest0-21swapper/211:21:342
2677499574,29cyclictest0-21swapper/210:55:512
26774995721,15cyclictest0-21swapper/209:15:432
26774995711,27cyclictest0-21swapper/209:30:582
26774995711,27cyclictest0-21swapper/209:30:582
2677399573,29cyclictest0-21swapper/108:36:021
14362574,46sleep30-21swapper/306:34:583
13942574,46sleep20-21swapper/210:19:462
2677599564,35cyclictest0-21swapper/310:31:383
2677599564,11cyclictest0-21swapper/306:26:103
2677599563,12cyclictest0-21swapper/310:45:443
26774995610,27cyclictest0-21swapper/211:01:022
2677399565,42cyclictest0-21swapper/109:01:061
2677399564,30cyclictest0-21swapper/110:51:221
2677399564,30cyclictest0-21swapper/110:51:221
219499560,5rtkit-daemon2193-21rtkit-daemon08:29:442
219499560,5rtkit-daemon2193-21rtkit-daemon08:01:073
89232550,3sleep1201ktimersoftd/106:50:391
2677599553,12cyclictest0-21swapper/310:50:503
2677599553,12cyclictest0-21swapper/310:50:503
2677599553,11cyclictest0-21swapper/311:11:523
2677499555,29cyclictest12340-21ssh08:56:072
2677499554,34cyclictest0-21swapper/211:39:022
2677499553,33cyclictest0-21swapper/210:30:572
26774995522,13cyclictest0-21swapper/208:35:592
26773995536,13cyclictest0-21swapper/108:28:261
26773995529,19cyclictest23526-21rm10:03:101
219499550,5rtkit-daemon2193-21rtkit-daemon10:20:472
195142553,46sleep10-21swapper/109:07:531
44602544,9sleep34511-21switchtime07:46:083
41772543,10sleep10-21swapper/110:22:191
2677599543,11cyclictest2806-21runrttasks08:41:503
2677599543,11cyclictest0-21swapper/311:27:193
2677599543,11cyclictest0-21swapper/309:06:103
2677599543,11cyclictest0-21swapper/308:55:563
2677599543,11cyclictest0-21swapper/308:25:533
26775995421,15cyclictest0-21swapper/307:01:123
26775995415,21cyclictest1227-21runrttasks10:21:283
2677499545,28cyclictest0-21swapper/208:06:012
2677499545,28cyclictest0-21swapper/208:06:012
26774995421,14cyclictest0-21swapper/209:40:492
26774995421,11cyclictest0-21swapper/209:06:072
26774995415,22cyclictest0-21swapper/210:25:582
26774995410,36cyclictest0-21swapper/208:43:092
2677399545,27cyclictest0-21swapper/111:10:381
2677399544,45cyclictest0-21swapper/110:17:151
2677399544,23cyclictest1227-21runrttasks10:42:471
233422543,45sleep20-21swapper/209:14:522
219499540,5rtkit-daemon2193-21rtkit-daemon07:40:532
219499540,5rtkit-daemon2193-21rtkit-daemon07:06:102
219499540,5rtkit-daemon2193-21rtkit-daemon06:50:552
219499540,5rtkit-daemon2193-21rtkit-daemon06:26:042
73122532,10sleep20-21swapper/209:39:062
2677599534,10cyclictest0-21swapper/308:30:453
2677499537,28cyclictest0-21swapper/211:30:372
2677499537,27cyclictest0-21swapper/209:28:452
2677499535,41cyclictest0-21swapper/210:41:022
2677499535,31cyclictest0-21swapper/211:25:532
2677499535,28cyclictest0-21swapper/206:45:582
2677499535,27cyclictest14866-21cpuspeed_turbos09:50:452
2677499535,27cyclictest0-21swapper/208:50:332
2677499535,27cyclictest0-21swapper/208:50:332
2677499535,26cyclictest0-21swapper/210:05:382
2677499534,30cyclictest0-21swapper/209:46:022
2677499534,29cyclictest0-21swapper/207:31:122
26774995335,9cyclictest500-21head06:31:032
26774995323,25cyclictest8594-21netstat08:50:592
26774995321,13cyclictest0-21swapper/207:01:002
26774995312,22cyclictest0-21swapper/211:05:482
2677399534,22cyclictest17331-21timerandwakeup11:30:591
26773995330,14cyclictest29578-21ntpdc11:00:551
26773995325,10cyclictest19511-21diskmemload11:25:451
26773995324,12cyclictest29520-21unixbench_singl10:11:041
26773995324,12cyclictest29520-21unixbench_singl10:11:041
219499530,6rtkit-daemon2193-21rtkit-daemon09:54:033
219499530,5rtkit-daemon2193-21rtkit-daemon07:11:022
137842533,11sleep10-21swapper/108:06:011
137842533,11sleep10-21swapper/108:06:011
114272533,43sleep311417-21munin-node06:55:503
87692523,43sleep10-21swapper/111:20:001
28672523,11sleep10-21swapper/108:42:051
2677599524,28cyclictest0-21swapper/310:10:483
2677599524,28cyclictest0-21swapper/310:10:483
2677599523,29cyclictest0-21swapper/311:07:293
2677599523,12cyclictest0-21swapper/311:42:533
2677599523,12cyclictest0-21swapper/310:40:103
26775995219,26cyclictest361ktimersoftd/309:11:033
2677499525,28cyclictest0-21swapper/207:56:052
2677499525,28cyclictest0-21swapper/206:21:032
2677499525,26cyclictest0-21swapper/210:53:012
2677499525,26cyclictest0-21swapper/210:53:012
2677499524,42cyclictest0-21swapper/206:41:012
2677499524,42cyclictest0-21swapper/206:41:012
2677499524,39cyclictest0-21swapper/206:55:572
26774995221,12cyclictest0-21swapper/208:00:502
26774995220,13cyclictest0-21swapper/206:36:032
2677399529,34cyclictest0-21swapper/109:30:441
2677399529,34cyclictest0-21swapper/109:30:441
2677399525,14cyclictest0-21swapper/109:35:531
2677399524,31cyclictest0-21swapper/108:54:581
26773995238,9cyclictest0-21swapper/109:49:591
26773995219,14cyclictest0-21swapper/109:21:051
219499520,5rtkit-daemon2193-21rtkit-daemon07:20:542
219499520,5rtkit-daemon2193-21rtkit-daemon07:20:542
219499520,4rtkit-daemon2193-21rtkit-daemon11:01:083
212062523,43sleep10-21swapper/110:49:401
127592523,11sleep10-21swapper/110:35:501
98852512,10sleep30-21swapper/307:59:513
54012513,12sleep10-21swapper/107:50:421
313422512,43sleep10-21swapper/106:28:231
296152512,10sleep30-21swapper/309:23:393
2677599513,41cyclictest20840-21ssh08:20:583
2677599513,11cyclictest0-21swapper/310:45:183
26774995133,10cyclictest21581-21sort07:15:542
2677399515,27cyclictest0-21swapper/108:01:021
2677399514,28cyclictest0-21swapper/111:45:481
2677399514,28cyclictest0-21swapper/110:26:221
2677399514,28cyclictest0-21swapper/107:06:111
2677399514,27cyclictest0-21swapper/109:25:471
26773995136,10cyclictest0-21swapper/111:24:401
253722513,42sleep10-21swapper/107:23:491
253722513,42sleep10-21swapper/107:23:491
222322513,41sleep10-21swapper/107:16:031
218432513,11sleep10-21swapper/108:22:301
213252513,10sleep10-21swapper/111:37:381
200832513,12sleep10-21swapper/109:57:321
64032503,41sleep10-21swapper/106:45:361
64032503,41sleep10-21swapper/106:45:361
323522503,40sleep10-21swapper/107:36:271
2677599509,23cyclictest0-21swapper/306:46:003
26775995035,9cyclictest19108-21sed08:16:083
2677599503,12cyclictest0-21swapper/308:50:223
2677599503,12cyclictest0-21swapper/308:50:223
26775995013,9cyclictest361ktimersoftd/311:20:453
26774995015,13cyclictest0-21swapper/207:45:492
26774995014,12cyclictest0-21swapper/207:55:352
2677399507,26cyclictest0-21swapper/111:05:531
2677399504,21cyclictest23037-21tune2fs11:40:461
26773995029,14cyclictest0-21swapper/107:45:591
26773995016,29cyclictest26817-21df_abs08:30:491
138572502,10sleep30-21swapper/308:06:033
138572502,10sleep30-21swapper/308:06:033
132732503,11sleep10-21swapper/106:56:521
77712492,10sleep30-21swapper/311:16:073
73002492,39sleep30-21swapper/307:52:173
278312493,41sleep10-21swapper/107:29:421
278312493,41sleep10-21swapper/107:29:421
2677599493,25cyclictest0-21swapper/309:28:243
26775994919,13cyclictest0-21swapper/307:12:323
2677399495,27cyclictest0-21swapper/108:46:261
2677399495,27cyclictest0-21swapper/108:46:261
2677399494,38cyclictest0-21swapper/110:33:021
2677399494,27cyclictest0-21swapper/110:05:521
2677399494,27cyclictest0-21swapper/109:19:321
26773994918,13cyclictest0-21swapper/109:54:211
219499490,4rtkit-daemon2193-21rtkit-daemon09:36:043
11852494,39sleep10-21swapper/106:31:411
100462492,9sleep30-21swapper/309:41:543
2677599484,13cyclictest0-21swapper/311:35:503
26775994832,10cyclictest5423-21cat06:41:033
26775994832,10cyclictest5423-21cat06:41:033
26775994832,10cyclictest24013-21cut07:20:553
26775994832,10cyclictest24013-21cut07:20:553
2677599483,26cyclictest0-21swapper/308:38:443
26775994819,14cyclictest5312-21ssh10:25:433
2677399484,28cyclictest0-21swapper/107:01:141
205162483,11sleep10-21swapper/107:12:401
168472483,38sleep10-21swapper/108:12:021
285192473,38sleep30-21swapper/306:21:113
2677599474,22cyclictest0-21swapper/310:58:453
2677599474,13cyclictest0-21swapper/308:10:473
2677399474,26cyclictest0-21swapper/106:53:321
2677399473,37cyclictest0-21swapper/106:21:381
2677599464,37cyclictest0-21swapper/311:35:273
2677599463,26cyclictest0-21swapper/310:18:163
2677399465,33cyclictest0-21swapper/107:55:491
2677399463,26cyclictest0-21swapper/107:45:361
26773994623,15cyclictest0-21swapper/107:31:001
219499460,5rtkit-daemon2193-21rtkit-daemon06:16:342
27452452,9sleep30-21swapper/307:45:153
26775994529,10cyclictest28472-21tr07:30:503
26775994514,18cyclictest9375-21ssh08:51:503
2677399454,12cyclictest0-21swapper/106:35:541
26773994525,13cyclictest0-21swapper/108:20:341
2677599443,36cyclictest0-21swapper/307:30:243
2677599443,36cyclictest0-21swapper/307:30:243
2677599443,12cyclictest0-21swapper/306:50:523
26775994428,10cyclictest30899-21tr07:35:513
2677399444,33cyclictest0-21swapper/106:20:391
36752433,9sleep30-21swapper/306:36:193
2677599423,22cyclictest26847-21taskset06:20:393
2677599403,23cyclictest0-21swapper/307:05:523
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional