You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 03:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Mon Dec 15, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
677599954,27cyclictest0-21swapper/023:03:230
677599924,80cyclictest0-21swapper/022:58:250
677599914,26cyclictest0-21swapper/020:08:360
677599894,28cyclictest0-21swapper/020:38:320
6775998914,8cyclictest0-21swapper/022:33:390
677599884,27cyclictest0-21swapper/019:13:290
677599884,27cyclictest0-21swapper/019:13:290
677599883,26cyclictest25490-21runrttasks21:59:270
677599874,75cyclictest0-21swapper/021:34:070
677599874,25cyclictest0-21swapper/019:59:440
677599874,25cyclictest0-21swapper/019:59:440
6775998729,50cyclictest2697-21tune2fs23:28:230
6775998726,55cyclictest28752-21cpuspeed_turbos22:08:240
6775998726,55cyclictest28752-21cpuspeed_turbos22:08:240
220322870,5sleep20-21swapper/221:53:282
677599865,74cyclictest0-21swapper/019:53:310
677599865,19cyclictest0-21swapper/020:47:580
677599865,19cyclictest0-21swapper/020:47:580
677599864,74cyclictest0-21swapper/000:23:310
677599863,27cyclictest0-21swapper/021:53:260
677599854,74cyclictest0-21swapper/000:08:160
677599854,73cyclictest0-21swapper/020:58:370
6775998524,54cyclictest0-21swapper/022:53:200
6775998524,54cyclictest0-21swapper/022:53:200
677599845,19cyclictest0-21swapper/021:13:230
677599844,12cyclictest0-21swapper/000:33:180
677599843,22cyclictest0-21swapper/021:03:230
6775998419,12cyclictest0-21swapper/021:28:200
677599834,12cyclictest0-21swapper/023:24:470
6775998331,43cyclictest5229-21grep21:18:280
677599833,23cyclictest0-21swapper/023:56:510
677599824,71cyclictest0-21swapper/023:13:380
677599824,29cyclictest16128-21grep20:33:360
6775998231,43cyclictest7695-21grep19:08:290
677599823,26cyclictest0-21swapper/020:18:460
677599817,12cyclictest0-21swapper/022:23:260
677599815,23cyclictest0-21swapper/019:23:490
677599814,69cyclictest0-21swapper/019:33:410
677599814,27cyclictest0-21swapper/020:48:330
677599813,26cyclictest0-21swapper/022:03:330
677599813,25cyclictest0-21swapper/021:48:110
6775998124,10cyclictest16024-21grep22:48:270
6775998121,9cyclictest7409-21unixbench-2d20:13:450
677599804,13cyclictest0-21swapper/019:50:080
677599803,25cyclictest17172-21tune2fs19:28:310
6775998027,46cyclictest13277-21cpuspeed_turbos20:28:250
6775998025,8cyclictest7826-21hwlatdetect21:23:310
6775998025,8cyclictest7826-21hwlatdetect21:23:310
6775998024,10cyclictest1419-21runrttasks19:43:360
677599794,68cyclictest0-21swapper/020:08:020
677599794,13cyclictest0-21swapper/021:08:250
677599793,23cyclictest0-21swapper/000:13:360
6775997923,48cyclictest0-21swapper/019:18:460
6775997921,9cyclictest6571-21crond23:38:070
6775997919,12cyclictest0-21swapper/020:56:060
6775997919,10cyclictest5689-21head22:28:190
6775997919,10cyclictest17294-21hwlatdetect23:58:240
677599784,67cyclictest0-21swapper/021:48:360
677599784,12cyclictest0-21swapper/023:43:240
6775997811,12cyclictest0-21swapper/022:18:330
677599774,14cyclictest0-21swapper/022:38:230
677599773,26cyclictest8965-21crond23:43:070
677599764,34cyclictest0-21swapper/023:18:160
677599764,31cyclictest0-21swapper/020:23:450
677599764,14cyclictest0-21swapper/019:38:300
6775997623,12cyclictest0-21swapper/021:38:410
677599754,26cyclictest0-21swapper/000:18:240
677599754,26cyclictest0-21swapper/000:18:240
677599754,14cyclictest0-21swapper/023:08:210
677599754,12cyclictest0-21swapper/023:48:270
677599753,19cyclictest30699-21munin-node00:28:190
677599723,7cyclictest7250irq/45-ahci00:06:420
677599723,12cyclictest0-21swapper/022:13:210
677599714,13cyclictest0-21swapper/022:46:390
678099693,19cyclictest6864-21latency_hist19:08:181
6780996752,10cyclictest0-21swapper/100:03:211
678199658,50cyclictest1676-21nscd21:08:132
678299644,29cyclictest0-21swapper/321:43:423
6780996445,11cyclictest26086-21aten2.4-expect22:03:331
678099644,13cyclictest5064-21fschecks_count23:33:221
678299625,31cyclictest0-21swapper/322:38:093
678299624,12cyclictest0-21swapper/320:01:493
678299624,12cyclictest0-21swapper/320:01:493
120822623,51sleep20-21swapper/219:18:322
6782996123,13cyclictest0-21swapper/319:28:453
169382614,12sleep30-21swapper/323:58:203
678299604,48cyclictest0-21swapper/320:58:283
6780996011,37cyclictest0-21swapper/120:38:151
678299595,39cyclictest0-21swapper/319:48:053
6782995942,11cyclictest19374-21fschecks_count00:03:223
678299594,37cyclictest0-21swapper/322:26:413
6782995938,11cyclictest32409-21tail00:28:363
248599590,4rtkit-daemon2484-21rtkit-daemon21:38:583
6782995839,10cyclictest24297-21uniq00:13:223
6782995820,15cyclictest0-21swapper/319:08:303
89112573,11sleep20-21swapper/220:18:332
678299574,29cyclictest0-21swapper/321:34:043
6782995723,13cyclictest0-21swapper/319:53:473
678099575,41cyclictest0-21swapper/119:43:311
6780995737,13cyclictest0-21swapper/123:18:291
678299565,26cyclictest30846-21telnet22:13:213
678299564,10cyclictest10781-21ls20:23:263
6781995623,26cyclictest0-21swapper/200:08:192
6780995619,20cyclictest0-21swapper/120:54:161
248599560,5rtkit-daemon2484-21rtkit-daemon22:47:473
176232563,10sleep10-21swapper/123:58:301
167972564,13sleep20-21swapper/223:58:192
15572564,45sleep30-21swapper/322:18:293
678299555,29cyclictest0-21swapper/319:48:453
678299554,27cyclictest0-21swapper/321:12:433
6780995522,13cyclictest0-21swapper/123:18:071
248599550,5rtkit-daemon2484-21rtkit-daemon22:38:252
248599550,5rtkit-daemon2484-21rtkit-daemon19:18:333
161922553,44sleep10-21swapper/119:26:531
113452554,43sleep20-21swapper/223:48:032
678299545,28cyclictest0-21swapper/321:03:383
6781995436,11cyclictest24812-21needreboot21:58:332
678099545,30cyclictest0-21swapper/119:53:481
252312543,43sleep30-21swapper/321:58:423
248599540,5rtkit-daemon2484-21rtkit-daemon23:47:533
248599540,5rtkit-daemon2484-21rtkit-daemon21:28:213
248599540,5rtkit-daemon2484-21rtkit-daemon20:38:153
248599540,5rtkit-daemon2484-21rtkit-daemon20:03:162
248599540,5rtkit-daemon2484-21rtkit-daemon20:03:162
150562544,42sleep30-21swapper/319:23:363
6782995333,12cyclictest30369-21grep23:18:243
678299533,12cyclictest0-21swapper/320:22:363
6780995335,10cyclictest892-21aten2.4-expect20:03:261
678099533,44cyclictest242472chrt20:48:461
678099533,35cyclictest0-21swapper/120:26:331
27572533,11sleep10-21swapper/122:19:311
248599530,5rtkit-daemon2484-21rtkit-daemon21:08:362
678299525,28cyclictest0-21swapper/323:53:213
678299524,31cyclictest0-21swapper/300:23:053
678299524,31cyclictest0-21swapper/300:23:053
6782995234,11cyclictest19765-21hwlatdetect21:48:303
6782995232,12cyclictest10244-21head19:13:333
6782995232,12cyclictest10244-21head19:13:333
6781995234,11cyclictest20846-21gltestperf22:58:262
678199523,31cyclictest0-21swapper/200:33:232
6781995224,23cyclictest1419-21runrttasks21:00:172
6780995231,13cyclictest0-21swapper/123:33:081
248599520,5rtkit-daemon2484-21rtkit-daemon22:03:423
248599520,5rtkit-daemon2484-21rtkit-daemon20:28:303
185452523,11sleep10-21swapper/119:31:281
182962522,8sleep118392-21fw_packets22:53:251
182962522,8sleep118392-21fw_packets22:53:251
173632523,8sleep117373-21munin-run22:53:091
678299515,30cyclictest0-21swapper/321:53:293
678299514,28cyclictest0-21swapper/323:38:213
678299514,28cyclictest0-21swapper/323:33:083
678299514,28cyclictest0-21swapper/323:13:283
6781995120,12cyclictest0-21swapper/200:28:242
678099514,29cyclictest0-21swapper/119:38:371
678099514,28cyclictest0-21swapper/122:58:421
678099514,28cyclictest0-21swapper/121:48:311
678099514,27cyclictest0-21swapper/121:38:191
678099514,24cyclictest0-21swapper/122:33:191
6780995132,13cyclictest0-21swapper/123:43:241
6780995130,13cyclictest0-21swapper/122:13:381
6780995128,14cyclictest0-21swapper/121:58:241
6780995126,9cyclictest8291-21open_inodes19:08:391
6780995122,14cyclictest0-21swapper/122:28:101
6780995121,13cyclictest0-21swapper/121:53:361
6780995121,13cyclictest0-21swapper/120:08:431
67632512,9sleep20-21swapper/221:23:142
67632512,9sleep20-21swapper/221:23:142
64082514,40sleep00-21swapper/019:03:560
248599510,5rtkit-daemon2484-21rtkit-daemon23:06:243
248599510,5rtkit-daemon2484-21rtkit-daemon22:29:482
124282513,11sleep10-21swapper/122:41:041
678299505,27cyclictest0-21swapper/321:18:263
678299504,29cyclictest0-21swapper/320:43:223
678299504,29cyclictest0-21swapper/320:43:223
678299504,28cyclictest0-21swapper/323:48:183
678299504,28cyclictest0-21swapper/320:33:483
6782995030,12cyclictest1196-21cpuspeed_turbos20:03:283
6782995020,13cyclictest0-21swapper/300:09:313
6782995019,13cyclictest0-21swapper/323:13:083
678099504,29cyclictest0-21swapper/100:28:291
678099504,28cyclictest0-21swapper/123:53:191
678099504,28cyclictest0-21swapper/121:47:551
678099504,28cyclictest0-21swapper/121:23:361
678099504,28cyclictest0-21swapper/121:23:361
678099504,28cyclictest0-21swapper/121:03:281
678099504,28cyclictest0-21swapper/120:13:451
678099504,27cyclictest0-21swapper/121:13:381
6780995033,10cyclictest30017-21unixbench_multi00:23:341
248599500,5rtkit-daemon2484-21rtkit-daemon20:48:453
248599500,4rtkit-daemon2484-21rtkit-daemon23:33:313
248599500,4rtkit-daemon2484-21rtkit-daemon21:23:363
248599500,4rtkit-daemon2484-21rtkit-daemon21:23:363
148902502,9sleep20-21swapper/220:31:022
113732502,10sleep20-21swapper/219:16:182
113732502,10sleep20-21swapper/219:16:182
7962492,10sleep20-21swapper/220:03:252
678299494,28cyclictest0-21swapper/320:14:103
678299494,28cyclictest0-21swapper/300:33:223
678299494,14cyclictest0-21swapper/322:48:433
6782994931,11cyclictest29281-21gltestperf22:08:293
6782994931,11cyclictest29281-21gltestperf22:08:293
6782994916,14cyclictest0-21swapper/320:53:223
678199494,28cyclictest0-21swapper/222:18:422
678199494,26cyclictest0-21swapper/220:36:442
678199493,30cyclictest0-21swapper/222:23:232
678099494,39cyclictest0-21swapper/123:13:071
678099494,28cyclictest0-21swapper/121:28:401
678099494,28cyclictest0-21swapper/100:18:291
678099494,28cyclictest0-21swapper/100:18:291
6780994930,13cyclictest0-21swapper/123:28:071
248599490,4rtkit-daemon2484-21rtkit-daemon22:34:482
248599490,4rtkit-daemon2484-21rtkit-daemon22:29:113
209302493,40sleep10-21swapper/119:36:281
678299485,27cyclictest0-21swapper/322:59:373
678299484,27cyclictest0-21swapper/320:09:093
678299484,13cyclictest0-21swapper/322:53:333
678299484,13cyclictest0-21swapper/322:53:333
6782994831,10cyclictest22110-21grep19:38:333
6782994819,12cyclictest0-21swapper/322:39:333
678199484,27cyclictest0-21swapper/223:23:412
678199484,27cyclictest0-21swapper/220:08:302
678199484,27cyclictest0-21swapper/219:23:342
678199484,20cyclictest0-21swapper/221:33:532
678099485,35cyclictest13483-21grep21:34:151
678099484,26cyclictest0-21swapper/123:38:161
6780994831,10cyclictest23229-21gltestperf23:03:251
6780994830,11cyclictest11032-21unixbench-2d19:13:461
6780994830,11cyclictest11032-21unixbench-2d19:13:461
6780994818,12cyclictest0-21swapper/122:28:321
65242483,11sleep10-21swapper/121:21:231
303892482,9sleep30-21swapper/300:27:103
282222483,39sleep10-21swapper/119:53:091
261412482,39sleep20-21swapper/219:48:262
257222482,39sleep20-21swapper/219:46:452
245292482,39sleep20-21swapper/220:52:142
221672483,10sleep10-21swapper/120:47:381
221672483,10sleep10-21swapper/120:47:381
196602483,11sleep10-21swapper/120:41:011
137052483,12sleep10-21swapper/119:20:321
135162483,11sleep10-21swapper/123:50:161
678299476,14cyclictest0-21swapper/323:23:183
678299475,15cyclictest1419-21runrttasks21:13:233
678199474,36cyclictest26558-21grep20:53:442
678199474,36cyclictest0-21swapper/219:38:272
678199474,29cyclictest0-21swapper/222:43:182
678199474,26cyclictest0-21swapper/221:48:302
678199474,26cyclictest0-21swapper/219:53:462
678199473,37cyclictest0-21swapper/222:08:212
678199473,37cyclictest0-21swapper/222:08:212
678199472,39cyclictest0-21swapper/222:48:192
678099474,35cyclictest0-21swapper/100:33:351
678099474,27cyclictest0-21swapper/121:08:431
6780994731,11cyclictest0-21swapper/120:18:241
65012472,9sleep20-21swapper/223:37:152
279022473,10sleep20-21swapper/222:04:492
278462472,38sleep20-21swapper/200:20:082
278462472,38sleep20-21swapper/200:20:082
255302473,37sleep10-21swapper/100:16:041
230452473,11sleep10-21swapper/100:09:431
187132475,35sleep20-21swapper/220:38:362
147612473,11sleep10-21swapper/122:45:271
678299464,12cyclictest0-21swapper/319:35:113
678199464,26cyclictest0-21swapper/220:43:252
678199464,26cyclictest0-21swapper/220:43:252
678199463,36cyclictest0-21swapper/221:18:222
678199463,36cyclictest0-21swapper/220:13:322
678199463,26cyclictest0-21swapper/223:03:242
678199463,26cyclictest0-21swapper/220:23:492
678199463,24cyclictest0-21swapper/200:13:322
678099468,27cyclictest0-21swapper/121:03:141
314722462,9sleep20-21swapper/223:20:142
291412462,9sleep20-21swapper/223:15:592
268602463,10sleep20-21swapper/223:12:202
678199454,26cyclictest0-21swapper/222:53:332
678199454,26cyclictest0-21swapper/222:53:332
678199454,25cyclictest0-21swapper/219:33:452
6781994529,10cyclictest15002-21idleruntime21:38:292
6781994517,12cyclictest0-21swapper/223:28:372
6780994530,11cyclictest0-21swapper/119:58:351
6780994530,11cyclictest0-21swapper/119:58:351
303832453,11sleep10-21swapper/122:11:011
303832453,11sleep10-21swapper/122:11:011
134922452,9sleep20-21swapper/223:49:572
88482442,9sleep20-21swapper/219:09:292
678199444,25cyclictest0-21swapper/221:29:222
678199444,24cyclictest17028-21diskstats21:43:292
678099444,33cyclictest0-21swapper/120:29:121
66062443,34sleep20-21swapper/219:06:312
4142442,9sleep20-21swapper/222:17:312
159582442,9sleep20-21swapper/223:55:532
678199434,34cyclictest0-21swapper/223:38:242
678199434,24cyclictest0-21swapper/221:17:192
207642432,10sleep20-21swapper/200:06:052
678199423,33cyclictest0-21swapper/200:23:232
678199423,24cyclictest0-21swapper/219:29:022
248599370,5rtkit-daemon2484-21rtkit-daemon19:05:493
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional