You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-17 - 17:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Fri Apr 17, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7070998927,53cyclictest9942-21ssh10:37:202
7070998926,56cyclictest13814-21ssh08:17:442
7070998722,57cyclictest0-21swapper/207:35:282
265182840,4sleep2281ktimersoftd/208:37:282
7070998319,56cyclictest0-21swapper/209:57:172
7070998229,45cyclictest1419-21runrttasks07:27:232
7070998225,49cyclictest17480-21munin-node09:47:362
7070998119,55cyclictest0-21swapper/209:37:432
7067998116,57cyclictest0-21swapper/008:21:380
7070998022,36cyclictest0-21swapper/208:47:192
7070998022,36cyclictest0-21swapper/208:47:192
7070997923,49cyclictest8559-21ssh07:22:452
7070997923,35cyclictest0-21swapper/210:02:282
7070997921,51cyclictest0-21swapper/208:55:022
7067997916,57cyclictest0-21swapper/009:24:300
7070997828,31cyclictest20973-21rm09:17:262
7070997828,31cyclictest20973-21rm09:17:262
248599780,4rtkit-daemon2484-21rtkit-daemon05:14:451
7070997727,33cyclictest0-21swapper/208:22:322
7070997724,44cyclictest23053-21tune2fs08:32:292
7067997711,57cyclictest0-21swapper/009:32:080
7070997629,31cyclictest29656-21munin-node10:17:302
7070997629,30cyclictest20912-21aten_r1power_en07:42:232
7070997616,15cyclictest121850irq/46-eth009:57:012
7067997618,52cyclictest0-21swapper/008:57:110
248599760,4rtkit-daemon2484-21rtkit-daemon05:30:151
7070997523,33cyclictest0-21swapper/205:35:592
7070997522,35cyclictest0-21swapper/208:12:282
7070997522,20cyclictest0-21swapper/208:57:412
7070997520,48cyclictest7924-21idleruntime-cro09:47:072
7070997519,49cyclictest0-21swapper/208:27:212
7070997518,49cyclictest0-21swapper/210:07:272
7067997520,49cyclictest25585-21munin-node08:37:180
7070997428,38cyclictest1419-21runrttasks08:43:312
7070997427,39cyclictest4634-21grep10:27:402
7070997422,31cyclictest6064-21ssh08:07:292
7070997419,38cyclictest0-21swapper/210:22:352
7070997416,36cyclictest0-21swapper/209:22:322
7070997330,28cyclictest8091-21ssh10:32:412
7070997330,28cyclictest8091-21ssh10:32:412
7070997325,33cyclictest26227-21missed_timers10:12:302
7070997322,19cyclictest0-21swapper/209:02:542
7070997320,46cyclictest0-21swapper/207:15:402
7070997319,35cyclictest0-21swapper/207:17:272
7070997317,49cyclictest0-21swapper/207:38:262
7067997319,18cyclictest0-21swapper/008:22:430
7067997316,51cyclictest8024-21strings08:57:340
7067997310,55cyclictest0-21swapper/006:37:350
7070997225,27cyclictest1419-21runrttasks07:57:502
7070997223,42cyclictest0-21swapper/209:32:412
7070997222,31cyclictest0-21swapper/209:07:322
7070997222,30cyclictest0-21swapper/205:27:302
7070997218,32cyclictest0-21swapper/208:05:162
7070997218,32cyclictest0-21swapper/208:05:162
7070997128,24cyclictest18373-21sendmail_mailqu09:12:382
7070997126,37cyclictest25255-21ntpdc05:47:412
7070997124,39cyclictest0-21swapper/209:27:152
7070997121,44cyclictest0-21swapper/207:55:572
7067997124,16cyclictest9530-21runrttasks07:24:540
7067997111,54cyclictest0-21swapper/007:19:190
248599710,8rtkit-daemon2245-21grep09:37:281
7070997024,39cyclictest0-21swapper/207:47:412
7070997024,37cyclictest11820-21crond05:22:182
7070997024,37cyclictest11820-21crond05:22:182
7070997022,31cyclictest0-21swapper/206:37:442
7067997018,18cyclictest0-21swapper/009:02:380
7067997016,47cyclictest0-21swapper/005:42:280
7067997012,51cyclictest0-21swapper/008:27:210
7067996925,28cyclictest4796-21cat06:12:400
7067996920,32cyclictest2024-21sshd08:48:310
7067996920,32cyclictest2024-21sshd08:48:310
7067996919,42cyclictest1419-21runrttasks09:15:380
7067996918,44cyclictest0-21swapper/010:22:320
7067996914,47cyclictest0-21swapper/007:27:470
7070996821,31cyclictest0-21swapper/205:22:282
7070996821,31cyclictest0-21swapper/205:22:282
7070996819,30cyclictest0-21swapper/206:02:372
7070996819,30cyclictest0-21swapper/206:02:372
7070996816,45cyclictest0-21swapper/206:37:152
7070996813,47cyclictest0-21swapper/205:57:132
7070996813,47cyclictest0-21swapper/205:57:132
7067996840,14cyclictest28946-21munin-node08:42:250
7067996818,32cyclictest0-21swapper/007:06:140
7067996817,45cyclictest0-21swapper/007:42:240
7067996817,34cyclictest0-21swapper/009:32:200
7067996815,36cyclictest0-21swapper/009:58:430
7067996815,30cyclictest0-21swapper/007:35:440
7067996813,48cyclictest23324-21timerandwakeup10:07:390
248599680,5rtkit-daemon2484-21rtkit-daemon08:06:540
248599680,5rtkit-daemon2484-21rtkit-daemon08:06:540
7070996745,15cyclictest0-21swapper/206:52:142
7070996745,15cyclictest0-21swapper/206:52:142
707099674,55cyclictest0-21swapper/206:57:152
7070996735,24cyclictest29972-21tail05:57:432
7070996720,39cyclictest27535-21munin-node07:02:402
7070996720,29cyclictest4603-21idleruntime06:12:372
7070996714,25cyclictest0-21swapper/205:37:292
706799678,52cyclictest0-21swapper/007:13:260
706799675,54cyclictest0-21swapper/007:40:330
7067996744,16cyclictest0-21swapper/007:57:460
7067996722,18cyclictest31725-21taskset07:07:480
7070996624,33cyclictest10381-21sshd06:24:362
7070996620,39cyclictest0-21swapper/206:07:482
706799668,52cyclictest0-21swapper/007:50:330
7067996644,14cyclictest0-21swapper/010:32:250
7067996644,14cyclictest0-21swapper/010:32:250
7067996625,32cyclictest26852-21unixbench_singl10:12:400
7067996620,38cyclictest25483-21grep06:57:290
7067996619,42cyclictest0-21swapper/009:37:280
7067996619,40cyclictest0-21swapper/009:07:190
7067996618,40cyclictest0-21swapper/008:32:340
7067996616,43cyclictest0-21swapper/009:51:130
7070996522,37cyclictest0-21swapper/206:57:472
7070996515,42cyclictest0-21swapper/206:27:362
706799656,25cyclictest0-21swapper/009:45:160
7067996518,40cyclictest0-21swapper/008:12:280
7067996514,43cyclictest0-21swapper/008:07:420
7070996424,33cyclictest0-21swapper/205:14:552
7070996414,34cyclictest0-21swapper/207:07:262
706799648,50cyclictest0-21swapper/006:52:410
706799646,52cyclictest0-21swapper/006:22:330
7067996419,38cyclictest28717-21latency07:52:350
7067996417,40cyclictest861-21crond06:07:160
7067996417,40cyclictest861-21crond06:07:160
7067996417,30cyclictest0-21swapper/010:30:430
7067996417,11cyclictest10844-21taskset10:37:310
7067996416,41cyclictest0-21swapper/009:52:190
248599640,7rtkit-daemon0-21swapper/105:51:370
706799634,54cyclictest0-21swapper/005:32:280
7067996316,41cyclictest0-21swapper/006:30:530
7067996316,30cyclictest18457-21telnet10:02:180
7067996316,29cyclictest0-21swapper/005:22:280
7067996316,29cyclictest0-21swapper/005:22:280
7067996313,30cyclictest0-21swapper/009:17:200
7067996313,30cyclictest0-21swapper/009:17:200
248599630,8rtkit-daemon0-21swapper/009:54:351
706799624,52cyclictest0-21swapper/010:20:130
7067996216,39cyclictest0-21swapper/006:01:030
707199614,48cyclictest0-21swapper/307:31:503
7070996135,19cyclictest18809-21grep06:42:332
7070996115,37cyclictest0-21swapper/205:12:192
7070996112,41cyclictest0-21swapper/205:42:382
7067996119,35cyclictest14604-21aten2.4-expect05:27:320
248599610,7rtkit-daemon0-21swapper/106:32:420
13792613,12sleep10-21swapper/110:23:071
7067996019,35cyclictest27403-21iostat_ios05:52:380
7067996019,35cyclictest27403-21iostat_ios05:52:380
7067996018,35cyclictest20401-21aten2.4-expect06:47:250
7067996018,35cyclictest20401-21aten2.4-expect06:47:250
326272603,49sleep30-21swapper/309:34:063
7070995920,34cyclictest0-21swapper/206:17:362
7067995917,36cyclictest0-21swapper/005:22:180
7067995917,36cyclictest0-21swapper/005:22:180
7067995915,37cyclictest0-21swapper/006:44:270
248599590,8rtkit-daemon0-21swapper/105:14:530
707199584,38cyclictest0-21swapper/309:07:023
7071995838,13cyclictest16704-21unixbench_multi09:57:393
7067995832,19cyclictest0-21swapper/005:12:180
7069995711,38cyclictest0-21swapper/107:57:121
7067995718,32cyclictest7499-21python06:17:460
7067995710,40cyclictest0-21swapper/006:07:480
28762573,12sleep30-21swapper/307:16:023
248599570,4rtkit-daemon2484-21rtkit-daemon08:41:071
707199564,37cyclictest0-21swapper/307:46:423
248599560,5rtkit-daemon0-21swapper/005:51:221
222842563,45sleep10-21swapper/105:42:361
706999554,44cyclictest0-21swapper/110:27:331
7069995523,11cyclictest30362-21munin-node09:32:291
7069995518,30cyclictest15851-21cpuspeed_turbos08:22:241
320382553,6sleep132043-21ssh08:47:081
244192552,9sleep10-21swapper/110:10:531
206452553,8sleep120746-21munin-node08:27:441
248599540,4rtkit-daemon2484-21rtkit-daemon07:16:181
19442544,41sleep30-21swapper/310:25:063
164182543,12sleep30-21swapper/309:11:253
12862543,8sleep31289-21ssh09:37:133
91292532,9sleep10-21swapper/107:23:301
707199535,29cyclictest0-21swapper/307:22:483
707199535,28cyclictest0-21swapper/307:17:353
707199534,42cyclictest0-21swapper/310:14:033
7071995321,12cyclictest0-21swapper/308:22:243
706999534,43cyclictest4627-21ssh08:05:191
706999534,43cyclictest4627-21ssh08:05:191
706999534,31cyclictest0-21swapper/109:42:291
7067995316,30cyclictest0-21swapper/005:42:180
63322532,44sleep10-21swapper/107:20:561
163122532,9sleep30-21swapper/305:28:353
116672532,43sleep10-21swapper/110:38:151
707199524,29cyclictest0-21swapper/309:42:353
707199524,27cyclictest0-21swapper/308:30:073
7071995233,10cyclictest278552sleep309:27:283
707199523,26cyclictest0-21swapper/308:35:173
7071995221,13cyclictest0-21swapper/307:47:363
706999525,27cyclictest0-21swapper/108:13:301
7069995234,12cyclictest10509-21cpuspeed_turbos09:02:221
7069995233,11cyclictest16666-21unixbench-2d09:57:391
35612522,43sleep10-21swapper/108:52:241
199742523,11sleep30-21swapper/307:39:573
160812523,42sleep316085-21ssh07:33:283
107652523,42sleep110771-21ssh09:50:131
707199514,28cyclictest0-21swapper/310:32:303
707199514,28cyclictest0-21swapper/310:32:303
707199514,28cyclictest0-21swapper/308:47:273
707199514,28cyclictest0-21swapper/308:47:273
707199514,28cyclictest0-21swapper/306:42:423
707199514,28cyclictest0-21swapper/306:27:273
707199514,27cyclictest0-21swapper/307:07:453
707199513,26cyclictest0-21swapper/309:15:383
707199513,23cyclictest6044-21uniq08:07:293
707199510,9cyclictest10701-21iostat_ios10:37:293
7069995131,14cyclictest0-21swapper/110:03:581
706999513,41cyclictest0-21swapper/106:17:471
7069995122,13cyclictest0-21swapper/110:17:241
247972512,9sleep30-21swapper/309:22:333
84292502,9sleep30-21swapper/306:22:213
707199507,22cyclictest0-21swapper/310:07:553
707199505,27cyclictest0-21swapper/305:22:463
707199505,27cyclictest0-21swapper/305:22:463
707199504,41cyclictest0-21swapper/308:42:263
707199504,28cyclictest0-21swapper/306:37:503
707199504,27cyclictest0-21swapper/309:47:273
707199504,27cyclictest0-21swapper/309:01:413
707199504,27cyclictest0-21swapper/308:37:303
7071995035,9cyclictest19119-21grep10:02:243
7071995033,11cyclictest17198-21cut05:32:303
707199503,28cyclictest0-21swapper/307:02:483
707199503,25cyclictest0-21swapper/308:54:173
7071995019,13cyclictest0-21swapper/307:57:073
7071995018,13cyclictest0-21swapper/310:22:063
7071995018,13cyclictest0-21swapper/308:12:223
7071995015,21cyclictest29391-21fschecks_count05:57:363
706999504,29cyclictest0-21swapper/107:32:331
706999504,28cyclictest0-21swapper/110:12:401
706999504,28cyclictest0-21swapper/109:22:421
706999504,28cyclictest0-21swapper/105:52:351
706999504,28cyclictest0-21swapper/105:52:351
706999504,13cyclictest0-21swapper/107:44:311
7069995033,10cyclictest12748-21fschecks_time05:22:351
7069995033,10cyclictest12748-21fschecks_time05:22:351
706999503,31cyclictest0-21swapper/108:47:191
706999503,31cyclictest0-21swapper/108:47:191
126382502,40sleep10-21swapper/106:27:551
707199495,25cyclictest0-21swapper/309:21:473
707199495,25cyclictest0-21swapper/309:21:473
707199494,38cyclictest0-21swapper/308:17:323
707199494,28cyclictest0-21swapper/306:17:323
707199494,27cyclictest0-21swapper/309:54:543
707199494,27cyclictest0-21swapper/306:12:353
707199494,27cyclictest0-21swapper/306:07:423
707199494,27cyclictest0-21swapper/305:52:353
707199494,27cyclictest0-21swapper/305:52:353
707199494,27cyclictest0-21swapper/305:37:323
707199494,27cyclictest0-21swapper/305:12:383
7071994932,10cyclictest34-21rcuc/306:57:163
707199493,28cyclictest0-21swapper/308:02:213
707199493,28cyclictest0-21swapper/308:02:213
7071994919,13cyclictest0-21swapper/307:57:423
7071994919,12cyclictest0-21swapper/305:42:293
706999494,39cyclictest7057-21cyclictest05:12:181
706999494,28cyclictest0-21swapper/109:12:221
706999494,28cyclictest0-21swapper/108:07:221
706999494,28cyclictest0-21swapper/106:07:491
706999494,28cyclictest0-21swapper/105:37:301
706999494,23cyclictest0-21swapper/107:40:361
706999493,41cyclictest0-21swapper/107:31:021
7069994922,13cyclictest0-21swapper/108:33:051
7069994922,12cyclictest0-21swapper/109:27:391
7069994910,23cyclictest0-21swapper/109:07:251
309002492,40sleep10-21swapper/106:02:071
266452494,38sleep30-21swapper/306:57:483
223272492,39sleep10-21swapper/109:18:241
223272492,39sleep10-21swapper/109:18:241
707199484,26cyclictest0-21swapper/306:48:383
707199484,26cyclictest0-21swapper/306:48:383
7071994830,12cyclictest10446-21cut05:17:363
7071994830,12cyclictest10446-21cut05:17:363
707199483,24cyclictest0-21swapper/306:32:273
706999485,36cyclictest0-21swapper/110:32:361
706999485,36cyclictest0-21swapper/110:32:361
706999485,36cyclictest0-21swapper/108:57:271
706999484,28cyclictest0-21swapper/107:47:231
706999484,27cyclictest0-21swapper/107:57:381
706999484,27cyclictest0-21swapper/107:02:361
706999484,27cyclictest0-21swapper/106:02:401
706999484,27cyclictest0-21swapper/106:02:401
706999484,26cyclictest0-21swapper/106:57:421
7069994822,13cyclictest0-21swapper/108:19:551
246602482,40sleep10-21swapper/106:53:591
707199474,25cyclictest0-21swapper/305:47:273
7071994718,12cyclictest0-21swapper/310:27:393
7071994717,12cyclictest0-21swapper/306:02:423
7071994717,12cyclictest0-21swapper/306:02:423
7069994730,10cyclictest17190-21tr05:32:301
320022472,9sleep10-21swapper/107:11:121
104222472,37sleep10-21swapper/106:25:091
7069994630,10cyclictest16136-21df_abs06:37:321
7069994630,10cyclictest14845-21wc06:32:481
222602462,35sleep10-21swapper/106:48:511
222602462,35sleep10-21swapper/106:48:511
706999454,33cyclictest0-21swapper/106:12:271
706999445,31cyclictest0-21swapper/105:17:311
706999445,31cyclictest0-21swapper/105:17:311
706999444,33cyclictest0-21swapper/106:47:151
7071994314,12cyclictest0-21swapper/305:12:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional