You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-24 - 07:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Fri Jul 24, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
277229910041,12cyclictest0-21swapper/020:17:490
2772599944,28cyclictest0-21swapper/323:07:253
2772599944,28cyclictest0-21swapper/323:07:253
2772599933,74cyclictest0-21swapper/319:52:313
2772599924,28cyclictest0-21swapper/323:32:383
2772599924,26cyclictest0-21swapper/321:02:163
2772599924,26cyclictest0-21swapper/321:02:163
219499910,4rtkit-daemon20760-21needreboot22:42:352
2772599904,26cyclictest0-21swapper/320:23:553
2772599904,26cyclictest0-21swapper/320:23:553
2772599904,25cyclictest0-21swapper/321:12:263
2772599894,27cyclictest0-21swapper/320:27:453
2772599894,26cyclictest0-21swapper/319:42:333
2772599894,26cyclictest0-21swapper/319:42:333
2772599894,25cyclictest0-21swapper/323:43:593
2772599894,25cyclictest0-21swapper/323:43:593
2772599888,22cyclictest0-21swapper/321:52:143
2772599884,27cyclictest0-21swapper/322:03:113
2772599884,26cyclictest0-21swapper/321:30:523
27725998810,9cyclictest21519-21ssh20:17:383
2772599877,13cyclictest0-21swapper/321:42:273
2772599877,13cyclictest0-21swapper/321:42:273
27725998728,52cyclictest4354-21needreboot22:17:383
27725998727,54cyclictest613-21timerwakeupswit19:32:503
27725998726,53cyclictest3153-21cpuspeed_turbos18:32:363
27725998712,7cyclictest311161ssh22:57:453
2772599864,74cyclictest0-21swapper/323:02:353
2772599864,26cyclictest0-21swapper/322:39:573
2772599864,13cyclictest0-21swapper/320:02:293
2772599858,21cyclictest0-21swapper/321:19:003
2772599855,23cyclictest0-21swapper/320:48:443
2772599854,73cyclictest0-21swapper/321:56:143
2772599854,27cyclictest0-21swapper/323:23:553
2772599854,26cyclictest0-21swapper/320:58:363
2772599853,26cyclictest0-21swapper/323:17:093
2772599853,26cyclictest0-21swapper/322:44:123
2772599844,28cyclictest0-21swapper/319:37:443
2772599844,27cyclictest0-21swapper/320:41:583
2772599844,26cyclictest0-21swapper/320:53:253
2772599843,74cyclictest0-21swapper/322:54:173
27725998427,50cyclictest10586-21gltestperf22:27:323
27725998427,50cyclictest10586-21gltestperf22:27:323
27725998418,60cyclictest1227-21runrttasks22:00:383
2772599835,71cyclictest0-21swapper/323:41:273
2772599835,26cyclictest0-21swapper/322:27:123
2772599834,71cyclictest0-21swapper/322:48:483
2772599833,71cyclictest0-21swapper/320:35:223
2772599833,26cyclictest0-21swapper/320:42:353
2772599829,66cyclictest0-21swapper/322:12:413
2772599825,27cyclictest0-21swapper/319:03:103
2772599825,27cyclictest0-21swapper/319:03:103
2772599825,23cyclictest0-21swapper/321:08:323
2772599824,26cyclictest0-21swapper/321:26:253
2772599823,26cyclictest0-21swapper/321:51:263
27725998224,10cyclictest27022-21cpuspeed_turbos19:22:323
27725998216,13cyclictest0-21swapper/323:31:123
2772599818,13cyclictest0-21swapper/322:09:343
2772599814,26cyclictest0-21swapper/323:17:573
2772599813,25cyclictest0-21swapper/318:23:003
27725998127,8cyclictest13831-21gltestperf22:32:303
2772599804,25cyclictest0-21swapper/318:27:473
2772599804,13cyclictest0-21swapper/321:37:463
2772599804,12cyclictest0-21swapper/321:32:453
2772599794,26cyclictest0-21swapper/319:17:203
27725997928,44cyclictest16835-21idleruntime20:07:383
2772599783,27cyclictest0-21swapper/318:52:493
27725997821,12cyclictest0-21swapper/319:27:503
27725997817,10cyclictest20344-21gltestperf19:07:393
2772599774,12cyclictest0-21swapper/319:57:493
27725997721,10cyclictest28623-21fschecks_time18:17:393
27725997721,10cyclictest28623-21fschecks_time18:17:393
2772599765,22cyclictest0-21swapper/318:39:323
2772599764,65cyclictest0-21swapper/319:17:293
2772599764,22cyclictest0-21swapper/319:47:323
219499760,5rtkit-daemon2193-21rtkit-daemon22:36:502
2772599754,13cyclictest0-21swapper/318:42:333
2772599744,27cyclictest0-21swapper/318:48:073
27725997410,8cyclictest107550irq/46-eth020:12:473
2772599734,25cyclictest0-21swapper/318:57:323
2772499714,14cyclictest0-21swapper/223:17:282
2772499704,58cyclictest0-21swapper/220:40:362
2772499685,30cyclictest0-21swapper/218:32:212
2772399683,8cyclictest25856-21crond22:52:101
2772399674,56cyclictest25290-21ntpq20:22:461
2772399674,56cyclictest25290-21ntpq20:22:461
2772499665,53cyclictest0-21swapper/221:04:382
2772499665,53cyclictest0-21swapper/221:04:382
2772399664,56cyclictest0-21swapper/122:37:271
27722996628,30cyclictest3001-21sendmail_mailqu19:37:460
2772499656,51cyclictest0-21swapper/220:02:342
2772499655,53cyclictest0-21swapper/220:57:512
2772499655,31cyclictest0-21swapper/221:12:302
2772499654,54cyclictest0-21swapper/222:53:432
2772499654,53cyclictest0-21swapper/218:58:032
2772399654,54cyclictest0-21swapper/122:33:241
2772499645,30cyclictest0-21swapper/223:08:092
2772499645,30cyclictest0-21swapper/223:08:092
2772499644,52cyclictest0-21swapper/222:57:282
2772499644,50cyclictest20461-21diskmemload21:47:132
2772499644,50cyclictest20461-21diskmemload21:47:132
2772499644,17cyclictest23172-21ssh23:37:092
2772499643,41cyclictest0-21swapper/223:38:512
2772399645,52cyclictest0-21swapper/122:57:461
2772499635,29cyclictest0-21swapper/220:27:482
2772499634,51cyclictest0-21swapper/220:12:482
2772499634,51cyclictest0-21swapper/218:22:212
2772499634,51cyclictest0-21swapper/218:22:212
2772499633,44cyclictest0-21swapper/222:13:402
2772399634,51cyclictest23014-21open_inodes21:07:431
2772399633,53cyclictest19022-21grep21:02:331
2772399633,53cyclictest19022-21grep21:02:331
2772499624,50cyclictest0-21swapper/222:17:262
2772499624,50cyclictest0-21swapper/222:02:142
2772499624,39cyclictest0-21swapper/220:43:582
2772499624,32cyclictest0-21swapper/222:22:222
2772499615,50cyclictest0-21swapper/223:06:592
2772499615,30cyclictest0-21swapper/220:47:302
2772499614,49cyclictest0-21swapper/221:27:262
2772499614,31cyclictest0-21swapper/222:47:272
2772499614,16cyclictest0-21swapper/220:26:112
2772499614,16cyclictest0-21swapper/220:26:112
2772499614,15cyclictest0-21swapper/221:35:022
2772499614,14cyclictest0-21swapper/222:39:342
2772399614,49cyclictest0-21swapper/120:57:451
2772399613,52cyclictest201ktimersoftd/122:22:411
27722996140,14cyclictest0-21swapper/023:37:370
2772499604,49cyclictest0-21swapper/222:30:072
2772499604,49cyclictest0-21swapper/222:30:072
2772499604,48cyclictest26723-21grep22:02:392
2772499604,13cyclictest0-21swapper/222:07:262
2772499604,12cyclictest0-21swapper/221:52:302
2772399605,48cyclictest0-21swapper/122:07:271
2772399604,49cyclictest0-21swapper/123:09:541
2772399604,49cyclictest0-21swapper/123:09:541
27722996046,8cyclictest7617-21aten2.4-expect18:42:310
27722996030,23cyclictest0-21swapper/023:46:420
27722996030,23cyclictest0-21swapper/023:46:420
219499600,19rtkit-daemon2193-21rtkit-daemon19:46:492
219499600,19rtkit-daemon2193-21rtkit-daemon19:46:492
2772499594,29cyclictest0-21swapper/218:44:062
2772499593,48cyclictest26721-21munin-node23:42:272
2772499593,48cyclictest26721-21munin-node23:42:272
2772499593,12cyclictest0-21swapper/223:22:402
2772399595,47cyclictest0-21swapper/120:44:441
2772399595,47cyclictest0-21swapper/119:47:501
2772399595,47cyclictest0-21swapper/118:42:481
2772399595,46cyclictest0-21swapper/122:21:121
2772399595,46cyclictest0-21swapper/120:38:511
27723995940,12cyclictest0-21swapper/123:32:201
2772399594,48cyclictest0-21swapper/123:22:111
2772399593,51cyclictest0-21swapper/121:42:241
2772399593,51cyclictest0-21swapper/121:42:241
2772399593,50cyclictest201ktimersoftd/119:57:471
27722995945,8cyclictest30893-21yum-updatesd-he22:57:460
27722995942,11cyclictest0-21swapper/023:07:420
27722995942,11cyclictest0-21swapper/023:07:420
27722995942,10cyclictest18908-21sed21:02:310
27722995942,10cyclictest18908-21sed21:02:310
27722995932,12cyclictest0-21swapper/018:42:210
172852593,10sleep20-21swapper/221:47:482
172852593,10sleep20-21swapper/221:47:482
2772499583,48cyclictest0-21swapper/219:52:452
2772399585,46cyclictest0-21swapper/121:39:431
2772399585,46cyclictest0-21swapper/120:32:471
2772399585,44cyclictest0-21swapper/122:27:241
2772399585,44cyclictest0-21swapper/122:27:241
27723995844,8cyclictest3295-21fschecks_time21:27:331
27723995839,13cyclictest0-21swapper/123:37:561
27722995843,9cyclictest17409-21unixbench-2d21:47:480
27722995843,9cyclictest17409-21unixbench-2d21:47:480
27722995839,13cyclictest0-21swapper/021:26:420
27722995839,12cyclictest0-21swapper/021:36:290
27722995837,13cyclictest0-21swapper/020:37:400
153912582,10sleep00-21swapper/022:34:550
2772499574,13cyclictest0-21swapper/221:24:232
2772499573,25cyclictest0-21swapper/223:15:242
27724995710,23cyclictest0-21swapper/221:39:142
2772399577,43cyclictest0-21swapper/121:50:191
2772399577,43cyclictest0-21swapper/121:50:191
2772399576,43cyclictest0-21swapper/123:30:571
2772399575,45cyclictest0-21swapper/121:12:561
27723995739,12cyclictest0-21swapper/119:52:381
27723995738,13cyclictest0-21swapper/121:54:401
27723995716,11cyclictest20618-21sort19:07:441
27723995715,34cyclictest27824-21latency23:42:331
27723995715,34cyclictest27824-21latency23:42:331
27722995739,12cyclictest0-21swapper/021:08:480
27722995738,14cyclictest0-21swapper/022:53:320
27722995737,13cyclictest0-21swapper/021:57:590
27722995731,12cyclictest0-21swapper/022:21:440
27722995729,22cyclictest0-21swapper/020:57:250
20462572,48sleep00-21swapper/022:14:230
2772499564,32cyclictest0-21swapper/218:38:052
2772499564,29cyclictest0-21swapper/221:09:392
2772399566,44cyclictest0-21swapper/121:20:591
2772399565,44cyclictest0-21swapper/119:12:321
2772399564,46cyclictest0-21swapper/122:05:431
2772399564,45cyclictest0-21swapper/121:32:261
27723995638,13cyclictest0-21swapper/123:26:041
2772399563,47cyclictest0-21swapper/122:12:511
27722995641,10cyclictest0-21swapper/022:08:260
27722995641,10cyclictest0-21swapper/020:51:490
27722995640,11cyclictest0-21swapper/023:32:580
27722995638,13cyclictest0-21swapper/021:29:120
27722995636,13cyclictest0-21swapper/020:32:390
27722995628,13cyclictest0-21swapper/023:03:020
2772499554,44cyclictest0-21swapper/219:58:182
2772499554,30cyclictest0-21swapper/223:28:222
2772499554,30cyclictest0-21swapper/220:52:382
2772499554,30cyclictest0-21swapper/220:34:192
2772499554,29cyclictest0-21swapper/221:20:072
2772499554,29cyclictest0-21swapper/220:12:182
2772499554,29cyclictest0-21swapper/219:23:122
2772499554,29cyclictest0-21swapper/218:47:372
2772499554,28cyclictest0-21swapper/219:07:332
2772499553,9cyclictest22406-21munin-node20:17:512
27724995523,14cyclictest0-21swapper/219:27:402
2772399556,43cyclictest0-21swapper/120:31:211
2772399554,45cyclictest0-21swapper/123:12:441
2772399554,44cyclictest0-21swapper/120:19:521
27723995539,11cyclictest0-21swapper/121:57:331
2772399553,47cyclictest0-21swapper/123:03:031
2772299554,26cyclictest0-21swapper/022:42:260
27722995538,12cyclictest0-21swapper/023:15:500
27722995536,13cyclictest0-21swapper/023:17:500
27722995536,12cyclictest0-21swapper/022:47:420
123402552,46sleep00-21swapper/022:30:480
123402552,46sleep00-21swapper/022:30:480
2772499544,31cyclictest0-21swapper/218:52:322
27724995424,13cyclictest0-21swapper/219:17:382
27724995417,13cyclictest0-21swapper/219:37:332
27723995439,9cyclictest9155-21cut20:47:351
2772399543,46cyclictest0-21swapper/122:55:371
27722995441,7cyclictest13642-21aten_r1power_en23:22:230
27722995440,10cyclictest0-21swapper/022:26:160
27722995439,10cyclictest0-21swapper/022:41:170
27722995438,11cyclictest0-21swapper/020:30:360
27722995435,12cyclictest0-21swapper/021:37:370
27722995433,13cyclictest0-21swapper/020:22:520
27722995433,13cyclictest0-21swapper/020:22:520
2772299543,45cyclictest0-21swapper/021:52:260
219499540,5rtkit-daemon2193-21rtkit-daemon19:32:502
219499540,5rtkit-daemon2193-21rtkit-daemon19:12:512
2772399534,44cyclictest0-21swapper/121:26:311
2772399533,26cyclictest0-21swapper/120:52:461
27722995338,10cyclictest0-21swapper/021:47:110
27722995338,10cyclictest0-21swapper/021:47:110
27722995338,10cyclictest0-21swapper/021:17:460
27722995338,10cyclictest0-21swapper/021:12:580
27722995336,11cyclictest0-21swapper/018:58:080
27722995331,10cyclictest0-21swapper/019:52:500
27722995327,21cyclictest0-21swapper/022:05:210
219499530,5rtkit-daemon2193-21rtkit-daemon19:47:422
219499530,5rtkit-daemon2193-21rtkit-daemon19:02:442
219499530,5rtkit-daemon2193-21rtkit-daemon19:02:442
219499530,5rtkit-daemon2193-21rtkit-daemon18:32:372
2772399526,40cyclictest0-21swapper/118:32:341
2772399523,44cyclictest0-21swapper/122:45:061
27723995222,12cyclictest0-21swapper/119:03:101
27723995222,12cyclictest0-21swapper/119:03:101
27722995239,8cyclictest18409-21swap23:27:420
27722995234,12cyclictest0-21swapper/020:55:380
219499520,5rtkit-daemon2193-21rtkit-daemon18:22:532
219499520,5rtkit-daemon2193-21rtkit-daemon18:14:532
179732524,42sleep10-21swapper/120:11:041
71592513,42sleep10-21swapper/118:39:461
2772399513,42cyclictest0-21swapper/119:27:431
2772399513,42cyclictest0-21swapper/119:24:491
27722995136,10cyclictest0-21swapper/018:47:330
27722995134,12cyclictest0-21swapper/019:42:290
27722995134,12cyclictest0-21swapper/019:42:290
298142503,9sleep10-21swapper/118:18:501
298142503,9sleep10-21swapper/118:18:501
27723995037,8cyclictest15727-21cat20:07:171
27723995033,13cyclictest0-21swapper/118:32:221
27723995032,12cyclictest0-21swapper/119:32:431
2772399503,41cyclictest0-21swapper/118:47:421
2772299506,26cyclictest0-21swapper/020:42:350
27722995035,10cyclictest0-21swapper/020:07:380
238652502,10sleep00-21swapper/019:14:400
27723994933,11cyclictest19648-21proc_pri20:12:471
2772399493,41cyclictest0-21swapper/119:17:311
27722994934,10cyclictest0-21swapper/019:17:350
2772299493,40cyclictest0-21swapper/019:32:180
2772299493,29cyclictest0-21swapper/018:57:200
321922482,40sleep00-21swapper/018:23:450
2772399485,13cyclictest0-21swapper/119:42:291
2772399485,13cyclictest0-21swapper/119:42:291
27723994832,11cyclictest30621-21cpuspeed_turbos18:22:361
27722994834,8cyclictest0-21swapper/018:17:210
27722994831,12cyclictest0-21swapper/019:07:420
27722994821,22cyclictest0-21swapper/019:33:030
129732482,38sleep00-21swapper/019:58:170
2772399473,13cyclictest0-21swapper/118:52:501
27722994734,9cyclictest0-21swapper/019:27:180
27722994729,11cyclictest20455-21crond20:17:160
168982473,10sleep10-21swapper/119:02:191
83092462,39sleep00-21swapper/019:49:430
27722994631,11cyclictest0-21swapper/020:02:540
2772399453,34cyclictest0-21swapper/119:37:291
27722994531,9cyclictest2840-21aten_r1power_cu18:32:330
2772299453,36cyclictest29019-21sshd18:17:450
2772299453,36cyclictest29019-21sshd18:17:450
25112442,37sleep00-21swapper/018:31:310
189832442,9sleep00-21swapper/019:03:270
189832442,9sleep00-21swapper/019:03:270
2772399435,13cyclictest0-21swapper/118:17:221
2772599353,26cyclictest0-21swapper/318:17:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional