You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-31 - 23:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Fri Jul 31, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
158919910011,81cyclictest0-21swapper/010:30:270
1589199994,61cyclictest0-21swapper/008:28:220
15891999319,46cyclictest7227-21grep08:05:330
15891999312,61cyclictest29644-21tune2fs08:40:300
1589199924,8cyclictest13703-21ssh08:15:460
1589199914,8cyclictest26934-21ntp_states08:35:420
1589199906,8cyclictest265271rm10:15:090
1589199904,13cyclictest0-21swapper/010:05:210
1589199903,64cyclictest3350-21cpu08:50:250
15891999013,58cyclictest0-21swapper/010:43:270
1589199895,59cyclictest0-21swapper/006:10:350
1589199894,65cyclictest0-21swapper/009:05:460
1589199894,12cyclictest0-21swapper/009:50:220
1589199894,12cyclictest0-21swapper/007:00:160
1589199894,11cyclictest0-21swapper/009:45:320
1589199893,8cyclictest18789-21ssh10:50:340
1589199893,67cyclictest0-21swapper/011:14:190
1589199893,67cyclictest0-21swapper/008:47:350
1589199893,10cyclictest3810-21aten_r1power_en09:40:220
1589199886,10cyclictest0-21swapper/011:07:060
1589199884,12cyclictest0-21swapper/009:15:230
1589199884,12cyclictest0-21swapper/009:15:230
1589199874,66cyclictest0-21swapper/008:33:520
1589199874,63cyclictest0-21swapper/007:05:520
1589199874,12cyclictest0-21swapper/010:45:200
1589199874,12cyclictest0-21swapper/008:21:020
1589199874,11cyclictest0-21swapper/011:25:540
1589199874,11cyclictest0-21swapper/009:10:370
1589199874,11cyclictest0-21swapper/006:15:380
1589199873,8cyclictest8629-21diskmemload10:00:250
1589199873,66cyclictest0-21swapper/011:33:570
1589199873,65cyclictest0-21swapper/010:22:150
1589199873,13cyclictest0-21swapper/009:55:250
1589199873,13cyclictest0-21swapper/009:55:250
1589199873,12cyclictest0-21swapper/006:25:350
1589199873,12cyclictest0-21swapper/006:25:350
15891998714,55cyclictest0-21swapper/010:55:440
15891998711,58cyclictest0-21swapper/007:50:310
15891998711,58cyclictest0-21swapper/007:50:310
1589199865,11cyclictest0-21swapper/009:25:330
1589199864,12cyclictest0-21swapper/010:36:370
1589199864,12cyclictest0-21swapper/006:50:490
1589199864,10cyclictest0-21swapper/011:00:470
1589199863,64cyclictest8069-21cat08:55:450
1589199863,13cyclictest0-21swapper/009:24:290
1589199863,11cyclictest29831-21grep09:30:240
1589199863,10cyclictest0-21swapper/011:15:330
1589199863,10cyclictest0-21swapper/011:15:330
15891998612,55cyclictest1858-21http_loadtime10:25:290
1589199854,61cyclictest0-21swapper/007:00:310
1589199854,12cyclictest0-21swapper/011:35:360
1589199854,12cyclictest0-21swapper/011:20:350
1589199854,12cyclictest0-21swapper/006:30:500
1589199854,11cyclictest0-21swapper/007:10:430
1589199854,11cyclictest0-21swapper/007:10:430
1589199853,59cyclictest0-21swapper/010:15:440
15891998516,52cyclictest0-21swapper/009:36:410
1589199844,12cyclictest0-21swapper/009:00:380
1589199843,62cyclictest0-21swapper/006:35:300
1589199843,12cyclictest0-21swapper/008:12:200
15891998417,49cyclictest0-21swapper/007:45:280
1589199834,60cyclictest0-21swapper/007:35:330
1589199824,12cyclictest0-21swapper/007:32:290
1589199824,12cyclictest0-21swapper/007:20:170
15891998219,46cyclictest0-21swapper/007:58:530
1589199814,12cyclictest0-21swapper/006:25:190
1589199804,60cyclictest0-21swapper/008:00:280
1589199804,57cyclictest0-21swapper/007:20:380
1589199804,57cyclictest0-21swapper/006:40:420
1589199794,12cyclictest0-21swapper/006:45:370
1589199784,13cyclictest0-21swapper/007:42:570
1589199764,65cyclictest0-21swapper/007:25:350
1589199714,10cyclictest15861-21crond06:10:180
2840126520,36sleep328414-21kernelversion11:05:313
15893996524,22cyclictest12287-21open_inodes10:40:411
15894996436,11cyclictest0-21swapper/208:54:492
219499630,6rtkit-daemon29469-21diskstats08:40:281
15895996332,25cyclictest4529-21fschecks_time09:40:293
1589599623,21cyclictest0-21swapper/310:05:553
219499610,7rtkit-daemon8136-21latency09:45:331
219499600,7rtkit-daemon0-21swapper/009:08:571
1589499605,48cyclictest0-21swapper/211:30:212
1589499605,47cyclictest0-21swapper/207:00:162
219499590,7rtkit-daemon0-21swapper/009:44:551
219499590,5rtkit-daemon5723-21ssh08:53:281
15895995932,13cyclictest0-21swapper/308:58:173
127292594,47sleep20-21swapper/208:15:312
219499580,5rtkit-daemon8629-21diskmemload08:55:201
219499580,4rtkit-daemon27894-21ssh08:37:281
1589499584,47cyclictest0-21swapper/209:15:302
1589499584,47cyclictest0-21swapper/209:15:302
1589399585,26cyclictest0-21swapper/108:45:451
58112574,12sleep20-21swapper/209:41:252
219499570,6rtkit-daemon1124-21snmpd09:22:111
219499570,6rtkit-daemon0-21swapper/009:19:261
219499570,6rtkit-daemon0-21swapper/009:19:261
219499570,5rtkit-daemon2193-21rtkit-daemon10:05:103
15895995731,13cyclictest0-21swapper/309:51:333
1589499574,46cyclictest0-21swapper/209:39:252
15894995719,31cyclictest281ktimersoftd/211:00:352
15894995717,34cyclictest0-21swapper/207:05:492
1589399573,40cyclictest0-21swapper/110:15:131
30262563,12sleep20-21swapper/207:55:442
295872563,8sleep129719-21munin-node06:35:511
219499560,5rtkit-daemon2193-21rtkit-daemon10:51:003
219499560,5rtkit-daemon2193-21rtkit-daemon07:10:393
219499560,5rtkit-daemon2193-21rtkit-daemon07:10:393
1589499566,41cyclictest5967-21irqstats11:20:272
1589499564,44cyclictest0-21swapper/209:03:502
1589399565,31cyclictest0-21swapper/108:25:351
1589399564,25cyclictest0-21swapper/106:10:301
15893995625,14cyclictest0-21swapper/110:30:321
112832563,46sleep10-21swapper/109:50:311
41762554,43sleep20-21swapper/206:50:472
261912553,11sleep20-21swapper/210:13:582
219499550,6rtkit-daemon2193-21rtkit-daemon08:10:373
219499550,5rtkit-daemon2193-21rtkit-daemon09:55:253
219499550,5rtkit-daemon2193-21rtkit-daemon09:55:253
194672553,13sleep20-21swapper/208:25:312
15895995530,11cyclictest0-21swapper/310:45:093
1589499553,46cyclictest0-21swapper/209:21:352
1589499553,44cyclictest0-21swapper/209:50:262
15894995522,27cyclictest15220-21interrupts10:45:292
15894995522,27cyclictest0-21swapper/208:13:102
1589399556,29cyclictest0-21swapper/111:30:291
1589399554,31cyclictest0-21swapper/108:23:531
15893995513,27cyclictest0-21swapper/110:07:191
219499540,6rtkit-daemon2193-21rtkit-daemon11:35:063
219499540,5rtkit-daemon2193-21rtkit-daemon11:20:223
219499540,5rtkit-daemon2193-21rtkit-daemon07:00:393
18572542,10sleep10-21swapper/109:35:441
15895995416,29cyclictest10352-21cut09:00:303
1589499544,43cyclictest0-21swapper/210:35:202
1589499543,43cyclictest30891-21tail10:20:292
15894995416,34cyclictest0-21swapper/210:18:112
1589399546,28cyclictest0-21swapper/107:20:271
1589399544,27cyclictest0-21swapper/110:14:011
15893995422,14cyclictest0-21swapper/106:55:471
15893995410,25cyclictest0-21swapper/108:30:271
34422533,44sleep33466-21munin-node07:55:503
274632532,10sleep20-21swapper/206:30:562
219499530,6rtkit-daemon2193-21rtkit-daemon06:20:483
219499530,5rtkit-daemon2193-21rtkit-daemon11:17:223
219499530,5rtkit-daemon2193-21rtkit-daemon11:17:223
219499530,5rtkit-daemon2193-21rtkit-daemon10:50:083
1589499535,41cyclictest0-21swapper/209:30:282
1589499534,43cyclictest0-21swapper/210:40:482
1589499534,43cyclictest0-21swapper/209:45:412
1589499534,42cyclictest0-21swapper/208:55:352
1589499533,43cyclictest0-21swapper/210:55:212
1589499533,42cyclictest26582-21kworker/2:108:49:372
1589499533,42cyclictest15818-21ssh11:35:292
1589499533,41cyclictest0-21swapper/209:10:252
1589399536,28cyclictest0-21swapper/111:01:321
1589399535,30cyclictest0-21swapper/111:35:271
1589399535,26cyclictest0-21swapper/109:10:221
1589399535,15cyclictest0-21swapper/110:48:461
1589399535,14cyclictest0-21swapper/111:13:551
1589399534,30cyclictest0-21swapper/107:50:141
1589399534,27cyclictest31861-21ssh10:20:431
15893995335,11cyclictest27664-21gltestperf07:40:351
15893995325,9cyclictest8629-21diskmemload11:17:001
15893995325,9cyclictest8629-21diskmemload11:17:001
252242523,42sleep10-21swapper/106:27:531
252242523,42sleep10-21swapper/106:27:531
219499520,6rtkit-daemon2193-21rtkit-daemon10:31:013
219499520,5rtkit-daemon2193-21rtkit-daemon11:25:373
219499520,5rtkit-daemon2193-21rtkit-daemon10:21:323
219499520,5rtkit-daemon2193-21rtkit-daemon10:16:093
219499520,5rtkit-daemon2193-21rtkit-daemon08:25:143
219499520,5rtkit-daemon2193-21rtkit-daemon06:25:333
219499520,5rtkit-daemon2193-21rtkit-daemon06:25:333
190522522,9sleep30-21swapper/309:14:103
1589499524,42cyclictest0-21swapper/211:10:512
1589499524,41cyclictest20795-21diskstats10:05:262
1589399526,29cyclictest0-21swapper/111:26:571
1589399525,14cyclictest0-21swapper/110:27:461
1589399524,29cyclictest0-21swapper/111:20:381
1589399524,27cyclictest0-21swapper/107:55:271
15893995216,10cyclictest0-21swapper/107:50:261
15893995216,10cyclictest0-21swapper/107:50:261
140862522,10sleep30-21swapper/308:16:133
107982522,10sleep20-21swapper/211:28:322
322602513,41sleep10-21swapper/106:41:151
30422512,9sleep30-21swapper/310:26:133
301462512,9sleep20-21swapper/206:39:512
299282513,8sleep229937-21irqstats08:40:352
238692513,11sleep10-21swapper/107:31:131
227432514,40sleep10-21swapper/106:21:361
219499510,5rtkit-daemon2193-21rtkit-daemon08:26:213
164042513,41sleep10-21swapper/107:15:491
15895995126,19cyclictest0-21swapper/309:28:223
1589499515,39cyclictest0-21swapper/208:20:492
1589499515,11cyclictest0-21swapper/210:04:132
1589499514,41cyclictest0-21swapper/210:51:112
15894995134,10cyclictest22586-21grep06:20:512
1589399515,29cyclictest0-21swapper/109:00:381
1589399515,28cyclictest0-21swapper/106:50:401
1589399515,14cyclictest0-21swapper/110:53:021
1589399514,39cyclictest0-21swapper/109:34:521
1589399514,27cyclictest0-21swapper/110:00:371
1589399514,26cyclictest0-21swapper/109:27:381
1589399514,14cyclictest0-21swapper/109:56:451
1589399514,14cyclictest0-21swapper/109:56:451
15893995125,10cyclictest1227-21runrttasks11:05:281
15893995122,13cyclictest0-21swapper/108:15:471
143492513,41sleep10-21swapper/107:11:381
143492513,41sleep10-21swapper/107:11:381
107532513,42sleep10-21swapper/108:10:551
303212502,9sleep20-21swapper/211:10:022
301802502,9sleep30-21swapper/308:40:403
1589599504,39cyclictest0-21swapper/308:35:283
1589599504,37cyclictest0-21swapper/306:50:183
15895995035,9cyclictest27160-21cpuspeed_turbos07:40:293
1589599503,41cyclictest0-21swapper/306:35:363
1589599503,40cyclictest0-21swapper/309:45:213
15895995024,20cyclictest0-21swapper/311:38:453
1589499503,40cyclictest29350-21chrt07:45:282
1589499503,39cyclictest0-21swapper/209:59:222
1589499503,39cyclictest0-21swapper/209:59:222
15894995021,23cyclictest0-21swapper/210:25:122
1589399506,12cyclictest0-21swapper/110:56:461
1589399504,28cyclictest0-21swapper/108:00:451
1589399504,28cyclictest0-21swapper/107:35:491
1589399504,28cyclictest0-21swapper/107:00:481
1589399504,16cyclictest0-21swapper/110:35:241
15893995021,12cyclictest0-21swapper/106:15:521
120652502,10sleep30-21swapper/307:08:013
304192492,9sleep30-21swapper/306:40:243
26362493,9sleep10-21swapper/106:49:501
204092492,9sleep30-21swapper/306:17:193
204032492,40sleep20-21swapper/206:17:142
172812493,38sleep30-21swapper/306:10:463
1589599492,41cyclictest0-21swapper/310:12:033
1589599492,33cyclictest0-21swapper/310:37:533
15895994916,27cyclictest4091-21aten_r1power_cu08:00:263
1589499495,38cyclictest25359-21latency_hist08:35:132
1589499494,10cyclictest6172-21unixbench_singl10:30:422
1589399496,26cyclictest0-21swapper/108:08:551
9802483,39sleep30-21swapper/311:14:143
85632482,9sleep30-21swapper/308:09:323
52652482,10sleep30-21swapper/308:51:403
258852483,38sleep30-21swapper/306:30:333
240852482,10sleep30-21swapper/307:34:053
217472482,9sleep30-21swapper/307:29:423
216462483,39sleep10-21swapper/107:28:231
1589599483,40cyclictest0-21swapper/308:30:523
1589599483,39cyclictest0-21swapper/309:19:263
1589599483,39cyclictest0-21swapper/309:19:263
1589599482,38cyclictest2381-21ssh08:48:153
1589499486,37cyclictest0-21swapper/208:35:242
1589499484,39cyclictest0-21swapper/211:15:382
1589499484,39cyclictest0-21swapper/211:15:382
15894994834,9cyclictest30765-21cpuspeed_turbos06:40:322
1589499483,38cyclictest4674-21grep08:00:322
15894994812,31cyclictest0-21swapper/207:35:332
1589399484,27cyclictest0-21swapper/106:35:091
84382472,10sleep20-21swapper/208:07:542
291502472,39sleep20-21swapper/209:30:012
24582472,9sleep20-21swapper/206:47:332
1589599479,32cyclictest25131-21latency11:00:313
15895994734,8cyclictest3194-21cpuspeed_turbos06:50:333
15895994733,9cyclictest23175-21cpuspeed_turbos09:20:263
1589599473,38cyclictest32553-21if_eth007:50:363
1589599473,38cyclictest32553-21if_eth007:50:363
1589599473,37cyclictest30059-21diskstats09:30:273
1589599472,22cyclictest0-21swapper/310:59:153
15894994731,9cyclictest17602-21grep07:20:302
1589499473,39cyclictest0-21swapper/207:05:162
15894994720,9cyclictest13023-21munin-node09:05:322
1589499472,25cyclictest22035-21munin-node07:30:502
15894994719,11cyclictest0-21swapper/207:25:462
15893994730,10cyclictest10914-21gltestperf07:05:381
180892462,38sleep20-21swapper/206:13:112
1589599463,37cyclictest13403-21munin-node09:05:263
15894994630,11cyclictest27137-21cpuspeed_turbos07:40:292
15894994629,9cyclictest15504-21grep07:15:342
1589599453,37cyclictest0-21swapper/309:35:243
137612454,34sleep10-21swapper/106:05:331
1589599444,23cyclictest26574-21munin-run07:40:143
1589599442,10cyclictest0-21swapper/307:20:283
15895994413,25cyclictest17057-21latency_hist07:20:163
10982442,36sleep20-21swapper/207:52:382
10982442,36sleep20-21swapper/207:52:382
219499430,4rtkit-daemon2193-21rtkit-daemon07:45:533
219499430,4rtkit-daemon2193-21rtkit-daemon06:57:023
1589499434,11cyclictest0-21swapper/207:15:172
1589499434,11cyclictest0-21swapper/207:15:172
1589499432,36cyclictest0-21swapper/206:25:502
1589499432,36cyclictest0-21swapper/206:25:502
134972434,30sleep30-21swapper/306:05:193
1589499333,26cyclictest15868-21latency_hist06:10:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional