You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 01:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Wed Aug 05, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1944699954,36cyclictest0-21swapper/008:14:390
1944699953,85cyclictest0-21swapper/008:20:020
1944999942,22cyclictest1450-21diskmemload09:09:101
1944699935,12cyclictest7545-21iostat_ios11:00:480
19446999217,12cyclictest0-21swapper/009:45:590
1944999904,35cyclictest10680-21gltestperf11:05:441
1944699904,31cyclictest0-21swapper/008:37:070
1944699904,13cyclictest0-21swapper/010:54:020
19446999027,12cyclictest0-21swapper/009:14:400
1944699902,81cyclictest26733-21ssh09:03:220
1944999895,33cyclictest0-21swapper/108:44:461
1944999894,33cyclictest0-21swapper/110:46:261
1944999886,31cyclictest1227-21runrttasks11:10:471
1944999885,26cyclictest0-21swapper/107:34:141
1944999883,37cyclictest23111-21swap09:46:011
1944699884,33cyclictest0-21swapper/008:08:180
1944699883,39cyclictest0-21swapper/009:40:350
1944699883,22cyclictest109011ssh09:28:240
19446998825,15cyclictest0-21swapper/011:10:430
1944999876,32cyclictest6646-21aten2.4-expect11:00:381
1944999874,24cyclictest21012-21runrttasks06:17:431
1944699875,33cyclictest0-21swapper/010:05:450
1944699874,10cyclictest16781-21cstates11:15:380
1944699873,25cyclictest0-21swapper/008:59:340
1944699873,25cyclictest0-21swapper/008:21:160
1944699873,13cyclictest0-21swapper/011:33:590
1944699873,12cyclictest0-21swapper/008:45:530
1944699873,11cyclictest0-21swapper/010:44:590
1944699872,22cyclictest1450-21diskmemload08:53:220
1944999864,10cyclictest7457-21munin-node10:11:031
1944999863,36cyclictest0-21swapper/110:00:441
1944699869,33cyclictest0-21swapper/010:04:210
1944699863,40cyclictest0-21swapper/009:30:560
1944699863,34cyclictest0-21swapper/011:25:240
1944699863,25cyclictest0-21swapper/011:10:090
1944699863,25cyclictest0-21swapper/010:40:030
1944699862,11cyclictest0-21swapper/010:10:430
1944999854,35cyclictest0-21swapper/108:12:351
1944999853,23cyclictest12563-21ssh08:40:221
19449998519,13cyclictest0-21swapper/107:29:131
1944699854,37cyclictest0-21swapper/009:55:460
1944699853,34cyclictest0-21swapper/010:15:560
1944999844,39cyclictest30325-21chrt09:57:061
1944999844,33cyclictest0-21swapper/110:19:081
1944999844,31cyclictest19266-21cpuspeed_turbos10:30:411
1944999844,31cyclictest19266-21cpuspeed_turbos10:30:411
1944999844,10cyclictest1227-21runrttasks11:24:331
1944699845,72cyclictest0-21swapper/008:05:330
1944699844,14cyclictest0-21swapper/010:35:070
1944699844,14cyclictest0-21swapper/010:35:070
1944699843,38cyclictest0-21swapper/009:52:140
1944699843,38cyclictest0-21swapper/009:52:140
1944699843,36cyclictest0-21swapper/008:45:060
1944999834,22cyclictest0-21swapper/109:30:281
1944999833,36cyclictest0-21swapper/109:16:371
1944699834,36cyclictest0-21swapper/009:07:320
1944699833,39cyclictest0-21swapper/008:35:050
1944699833,37cyclictest25148-21ssh11:27:170
19446998317,12cyclictest0-21swapper/009:21:030
1944999826,31cyclictest0-21swapper/111:25:541
1944999824,34cyclictest0-21swapper/110:25:461
1944999824,10cyclictest23260-21iostat_ios10:35:481
19449998210,31cyclictest0-21swapper/109:01:381
1944699824,33cyclictest0-21swapper/010:20:400
1944699824,32cyclictest20641-21munin-run06:15:360
1944699823,32cyclictest0-21swapper/006:40:360
1944699823,32cyclictest0-21swapper/006:25:360
1944699822,40cyclictest0-21swapper/010:25:510
1944999815,36cyclictest0-21swapper/109:50:501
1944999815,36cyclictest0-21swapper/109:50:501
1944999814,10cyclictest3516-21iostat10:05:491
1944999813,13cyclictest0-21swapper/108:07:221
1944999813,12cyclictest0-21swapper/108:20:111
19449998112,30cyclictest0-21swapper/109:30:591
1944699814,9cyclictest18025-21munin-run09:40:280
1944699814,12cyclictest0-21swapper/008:25:420
1944699814,12cyclictest0-21swapper/008:25:420
1944999804,11cyclictest15538-21memory08:45:501
1944699803,12cyclictest0-21swapper/010:59:140
1944999794,35cyclictest0-21swapper/109:42:501
19449997931,9cyclictest22720-21sed08:56:041
1944999793,35cyclictest27844-21crond07:15:341
1944999784,24cyclictest0-21swapper/109:23:371
1944699783,36cyclictest0-21swapper/009:19:580
1944699783,12cyclictest0-21swapper/010:45:490
1944999777,30cyclictest21836-21awk06:25:351
1944999773,33cyclictest0-21swapper/108:28:451
1944999773,33cyclictest0-21swapper/108:28:451
19446997728,8cyclictest26657-21awk07:05:340
19450997621,48cyclictest0-21swapper/208:50:592
1944699753,33cyclictest0-21swapper/007:35:320
19450997424,33cyclictest1124-21snmpd10:11:022
1944999743,40cyclictest28564-21rm10:45:231
19450997324,42cyclictest19992-21ls09:41:012
19450997324,42cyclictest14501diskmemload10:50:592
19450997323,42cyclictest15944-21kworker/2:110:15:392
1944999735,32cyclictest0-21swapper/111:15:551
1944999735,31cyclictest0-21swapper/108:54:401
19450997222,33cyclictest0-21swapper/209:25:422
19450997118,46cyclictest0-21swapper/210:30:312
19450997118,46cyclictest0-21swapper/210:30:312
19450997118,45cyclictest0-21swapper/209:10:432
19450997116,17cyclictest0-21swapper/211:00:562
1944999714,31cyclictest0-21swapper/106:55:351
19450997022,32cyclictest0-21swapper/209:36:042
19450997020,33cyclictest0-21swapper/209:55:512
19450997018,44cyclictest0-21swapper/209:32:232
19450997018,33cyclictest0-21swapper/211:30:582
1944999703,38cyclictest0-21swapper/109:12:061
19450996919,33cyclictest0-21swapper/208:34:052
19450996917,45cyclictest0-21swapper/210:05:282
19450996917,44cyclictest0-21swapper/209:22:532
19450996915,27cyclictest1898-21ssh08:06:492
19450996914,47cyclictest0-21swapper/208:22:332
19450996824,37cyclictest15929-21cat08:45:582
19450996820,39cyclictest1227-21runrttasks06:42:312
19450996818,33cyclictest0-21swapper/208:20:322
19450996818,28cyclictest0-21swapper/211:27:322
19450996817,44cyclictest28107-21df09:05:442
19450996720,39cyclictest0-21swapper/209:48:302
19450996719,42cyclictest0-21swapper/211:06:102
19450996719,31cyclictest0-21swapper/210:06:452
19450996718,42cyclictest0-21swapper/209:20:222
19450996718,34cyclictest0-21swapper/209:04:292
19450996717,33cyclictest0-21swapper/211:24:512
19450996717,33cyclictest0-21swapper/208:55:532
19450996716,35cyclictest0-21swapper/209:54:512
19450996716,35cyclictest0-21swapper/209:54:512
19450996714,31cyclictest0-21swapper/210:55:422
1944999674,31cyclictest27275-21iostat11:30:471
19450996622,37cyclictest26808-21strings10:40:522
19450996622,27cyclictest16521-21gltestperf10:25:462
19450996621,28cyclictest3326-21rm08:10:472
19450996619,40cyclictest1124-21snmpd11:12:102
19450996616,44cyclictest0-21swapper/211:15:452
19450996615,44cyclictest0-21swapper/208:28:432
19450996615,44cyclictest0-21swapper/208:28:432
19450996520,29cyclictest0-21swapper/210:48:362
19450996519,38cyclictest1124-21snmpd07:34:142
19450996519,29cyclictest0-21swapper/208:04:192
19450996518,40cyclictest13100-21ssh08:41:342
19450996518,30cyclictest0-21swapper/206:33:372
19450996516,33cyclictest0-21swapper/210:35:412
19450996412,36cyclictest0-21swapper/210:23:102
19450996313,42cyclictest0-21swapper/208:36:592
19450996220,34cyclictest0-21swapper/206:15:362
1945099617,37cyclictest0-21swapper/208:00:322
19450996121,34cyclictest0-21swapper/206:08:232
1945199604,24cyclictest0-21swapper/310:30:383
1945199604,24cyclictest0-21swapper/310:30:383
19450996015,30cyclictest0-21swapper/206:39:052
19450996014,30cyclictest0-21swapper/207:24:132
19450996011,30cyclictest0-21swapper/207:40:332
1944699603,12cyclictest0-21swapper/007:12:170
19451995924,10cyclictest2833-21if_err_eth009:15:513
1945099599,34cyclictest0-21swapper/206:58:252
1945199584,34cyclictest0-21swapper/309:40:233
19450995815,14cyclictest0-21swapper/207:55:332
1945099579,41cyclictest0-21swapper/207:19:102
19450995715,34cyclictest0-21swapper/207:27:212
19450995715,33cyclictest27862-21idleruntime-cro07:15:342
19450995715,14cyclictest0-21swapper/206:05:362
19450995712,29cyclictest0-21swapper/206:47:582
1945199566,18cyclictest0-21swapper/308:20:323
1945099568,33cyclictest0-21swapper/207:04:402
219499550,4rtkit-daemon2193-21rtkit-daemon10:52:151
19451995521,29cyclictest23496-21netstat10:35:513
115762553,12sleep30-21swapper/308:36:313
86622543,10sleep30-21swapper/310:15:033
219499540,4rtkit-daemon2193-21rtkit-daemon06:12:193
19450995418,13cyclictest31279-21runrttasks07:43:272
219499530,5rtkit-daemon2193-21rtkit-daemon07:46:452
1945199534,44cyclictest0-21swapper/310:42:513
1945199534,30cyclictest0-21swapper/310:10:273
1945199534,30cyclictest0-21swapper/307:30:323
1945199534,27cyclictest0-21swapper/306:08:553
19451995313,22cyclictest7154-21uniq11:00:433
277982522,9sleep30-21swapper/307:15:003
219499520,5rtkit-daemon2193-21rtkit-daemon10:55:451
219499520,5rtkit-daemon2193-21rtkit-daemon06:51:402
1945199524,27cyclictest23083-21munin-node09:46:003
1945199524,14cyclictest0-21swapper/310:58:513
19451995232,13cyclictest0-21swapper/309:25:093
19451995221,13cyclictest0-21swapper/308:50:533
19450995224,20cyclictest0-21swapper/206:21:052
19450995214,23cyclictest0-21swapper/207:09:102
19450995214,23cyclictest0-21swapper/207:09:102
105532523,7sleep310634-21ssh10:16:003
219499510,4rtkit-daemon2193-21rtkit-daemon06:28:332
219499510,4rtkit-daemon2193-21rtkit-daemon06:28:332
219499510,4rtkit-daemon2193-21rtkit-daemon06:16:042
1945199514,29cyclictest0-21swapper/309:26:013
1945199514,29cyclictest0-21swapper/308:55:533
1945199514,28cyclictest0-21swapper/310:20:523
1945199514,28cyclictest0-21swapper/309:55:463
1945199514,28cyclictest0-21swapper/309:15:293
1945199514,26cyclictest0-21swapper/311:10:313
19451995135,10cyclictest26846-21cut11:30:433
19451995121,13cyclictest0-21swapper/311:25:243
19451995114,20cyclictest1227-21runrttasks08:13:523
1945199505,27cyclictest0-21swapper/306:55:343
1945199504,29cyclictest0-21swapper/309:05:433
1945199504,28cyclictest0-21swapper/309:40:393
1945199504,27cyclictest0-21swapper/310:50:353
1945199504,27cyclictest0-21swapper/310:00:533
1945199504,27cyclictest0-21swapper/309:55:283
1945199504,27cyclictest0-21swapper/309:55:283
1945199504,27cyclictest0-21swapper/307:46:353
19451995019,13cyclictest0-21swapper/311:05:413
78352492,10sleep30-21swapper/308:25:063
318042496,35sleep10-21swapper/107:47:221
311052493,10sleep30-21swapper/307:41:083
1945199494,28cyclictest0-21swapper/309:00:523
1945199494,28cyclictest0-21swapper/308:33:533
1945199494,27cyclictest0-21swapper/311:15:523
1945199494,27cyclictest0-21swapper/310:25:513
1945199494,27cyclictest0-21swapper/309:31:033
1945199494,27cyclictest0-21swapper/307:05:343
1945199494,26cyclictest0-21swapper/310:46:003
1945199494,26cyclictest0-21swapper/308:47:153
19451994919,13cyclictest0-21swapper/308:27:243
19451994919,13cyclictest0-21swapper/308:27:243
19451994918,12cyclictest0-21swapper/311:25:443
290292485,35sleep00-21swapper/007:25:250
25262482,10sleep30-21swapper/308:08:493
1945199484,27cyclictest0-21swapper/306:30:363
1945199484,27cyclictest0-21swapper/306:30:363
1945199484,13cyclictest0-21swapper/308:40:423
1945199483,27cyclictest0-21swapper/307:54:173
1944999485,26cyclictest0-21swapper/106:44:061
1944999483,39cyclictest0-21swapper/109:37:131
1944999483,39cyclictest0-21swapper/108:20:451
19446994820,8cyclictest32049-21latency_hist07:50:330
288652473,9sleep30-21swapper/307:23:143
234512472,37sleep30-21swapper/306:38:193
1945199475,25cyclictest0-21swapper/307:19:123
1945199474,26cyclictest0-21swapper/306:42:243
19451994718,13cyclictest0-21swapper/307:59:183
19449994730,11cyclictest0-21swapper/107:58:411
19449994718,8cyclictest30940-21cat07:40:331
19449994718,12cyclictest0-21swapper/110:20:481
257552462,10sleep30-21swapper/306:56:413
217142462,35sleep30-21swapper/306:24:083
212072462,10sleep30-21swapper/306:20:213
1945199464,24cyclictest0-21swapper/307:08:293
1945199464,24cyclictest0-21swapper/307:08:293
1944999464,13cyclictest0-21swapper/108:31:451
191332464,35sleep00-21swapper/006:01:540
6782452,36sleep00-21swapper/007:58:540
304682453,35sleep30-21swapper/307:35:353
1944999453,38cyclictest0-21swapper/106:28:361
1944999453,38cyclictest0-21swapper/106:28:361
1944699453,37cyclictest0-21swapper/006:26:140
1944699453,37cyclictest0-21swapper/006:26:140
1944999446,13cyclictest0-21swapper/108:05:331
1944999443,36cyclictest0-21swapper/106:36:241
19449994427,12cyclictest0-21swapper/107:24:131
1944699446,12cyclictest1227-21runrttasks06:58:130
1945199434,33cyclictest0-21swapper/307:35:323
1945199434,24cyclictest0-21swapper/308:02:543
1944999433,23cyclictest0-21swapper/106:56:301
19449994317,11cyclictest0-21swapper/107:01:401
1944699434,35cyclictest0-21swapper/006:18:170
1944699434,12cyclictest0-21swapper/007:55:330
1944699433,24cyclictest0-21swapper/006:52:350
1944999424,31cyclictest0-21swapper/106:15:361
1944999423,34cyclictest0-21swapper/106:33:191
19449994222,15cyclictest0-21swapper/107:55:331
19449994222,14cyclictest0-21swapper/106:47:261
19449994220,17cyclictest0-21swapper/107:45:121
1944699423,32cyclictest0-21swapper/007:45:340
1944699423,32cyclictest0-21swapper/007:39:030
1944699423,24cyclictest0-21swapper/006:06:160
1944699423,12cyclictest0-21swapper/006:50:030
294382413,33sleep00-21swapper/007:27:500
1945199414,15cyclictest0-21swapper/306:34:053
1944699414,13cyclictest0-21swapper/007:10:340
1944699414,13cyclictest0-21swapper/007:10:340
1944699412,34cyclictest0-21swapper/007:19:370
1944999406,29cyclictest0-21swapper/107:09:101
1944999406,29cyclictest0-21swapper/107:09:101
1944999404,31cyclictest0-21swapper/106:08:201
1944999403,23cyclictest0-21swapper/107:16:551
19446994015,11cyclictest0-21swapper/006:30:560
1944699393,12cyclictest0-21swapper/006:41:390
1945199374,28cyclictest0-21swapper/306:47:553
1945199333,24cyclictest19435-21munin-run06:05:363
19449992917,7cyclictest19545-21latency_hist06:05:361
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional