You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-07 - 12:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Sun Dec 07, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1184799974,66cyclictest0-21swapper/222:00:222
1184799924,62cyclictest0-21swapper/223:15:312
1184799924,62cyclictest0-21swapper/223:15:312
1184799904,9cyclictest1243-21snmpd19:55:212
1184799893,63cyclictest1243-21snmpd19:05:462
1184799884,58cyclictest0-21swapper/222:55:132
1184799884,12cyclictest0-21swapper/223:35:292
1184799874,12cyclictest0-21swapper/222:40:172
1184799873,68cyclictest20064-21latency_hist22:25:042
1184799864,62cyclictest0-21swapper/223:02:082
1184799864,12cyclictest0-21swapper/221:20:182
1184799863,58cyclictest0-21swapper/221:10:182
1184799855,12cyclictest0-21swapper/219:50:272
1184799854,63cyclictest0-21swapper/221:40:332
1184799854,62cyclictest0-21swapper/221:35:202
1184799854,58cyclictest0-21swapper/221:30:362
1184799854,14cyclictest0-21swapper/220:45:412
1184799854,13cyclictest0-21swapper/219:25:092
1184799853,12cyclictest0-21swapper/222:45:152
11847998520,58cyclictest27537-21munin-node20:25:322
11847998520,58cyclictest27537-21munin-node20:25:322
11847998515,53cyclictest0-21swapper/221:15:402
1184799844,62cyclictest0-21swapper/222:10:142
1184799844,55cyclictest0-21swapper/200:12:202
1184799844,11cyclictest0-21swapper/221:05:342
1184799844,11cyclictest0-21swapper/221:05:342
1184799835,61cyclictest0-21swapper/219:17:532
1184799834,62cyclictest1165-21lldpd23:20:132
1184799834,61cyclictest0-21swapper/223:30:312
1184799834,54cyclictest0-21swapper/221:45:362
1184799834,53cyclictest0-21swapper/220:10:382
1184799834,12cyclictest0-21swapper/223:25:462
1184799834,12cyclictest0-21swapper/222:15:202
1184799834,12cyclictest0-21swapper/220:44:442
1184799834,12cyclictest0-21swapper/219:10:272
1184799834,12cyclictest0-21swapper/219:00:242
11847998316,44cyclictest0-21swapper/223:05:142
1184799824,61cyclictest0-21swapper/223:55:142
1184799824,61cyclictest0-21swapper/223:55:142
1184799824,54cyclictest0-21swapper/222:30:252
1184799824,12cyclictest0-21swapper/221:01:132
1184799824,12cyclictest0-21swapper/220:00:242
1184799824,12cyclictest0-21swapper/219:40:122
1184799824,12cyclictest0-21swapper/219:40:122
1184799823,10cyclictest3643-21munin-node19:35:422
11847998219,44cyclictest12894-21gltestperf18:45:312
1184799814,58cyclictest0-21swapper/220:30:212
1184799814,14cyclictest0-21swapper/218:50:272
1184799814,12cyclictest0-21swapper/222:50:192
1184799814,12cyclictest0-21swapper/218:45:122
1184799813,56cyclictest0-21swapper/200:00:142
1184799813,55cyclictest0-21swapper/218:55:302
1184799813,55cyclictest0-21swapper/218:55:302
1184799804,57cyclictest0-21swapper/222:07:002
11847998010,8cyclictest0-21swapper/223:46:442
1184799794,56cyclictest0-21swapper/220:15:262
1184799794,53cyclictest0-21swapper/221:50:182
1184799794,53cyclictest0-21swapper/221:50:182
1184799794,12cyclictest0-21swapper/220:55:062
11847997916,47cyclictest0-21swapper/223:54:132
1184799784,57cyclictest0-21swapper/223:45:002
1184799784,12cyclictest0-21swapper/221:55:222
1184799783,10cyclictest9594-21munin-node20:55:172
11847997823,49cyclictest25939-21grep22:35:222
1184799774,65cyclictest0-21swapper/219:25:402
11847997733,37cyclictest2820-21cat19:30:432
1184799773,11cyclictest0-21swapper/200:06:432
1184799768,9cyclictest114550irq/46-eth020:35:222
1184799764,17cyclictest0-21swapper/222:25:222
1184799754,18cyclictest0-21swapper/220:20:382
1184799754,14cyclictest0-21swapper/223:10:162
1184799754,14cyclictest0-21swapper/223:10:162
1184799753,56cyclictest0-21swapper/219:45:362
1184799744,14cyclictest0-21swapper/221:25:402
1184799744,13cyclictest0-21swapper/220:07:372
11840997419,47cyclictest0-21swapper/019:30:220
11840997325,42cyclictest0-21swapper/023:32:340
213672720,5sleep121371-21crond19:05:111
11840997131,33cyclictest29630-21sadc22:45:020
11840997126,38cyclictest1369-21runrttasks23:40:250
11840997018,44cyclictest0-21swapper/020:40:120
243799680,26rtkit-daemon2436-21rtkit-daemon20:05:310
11840996820,41cyclictest0-21swapper/023:00:280
11840996738,22cyclictest0-21swapper/018:45:110
11840996725,35cyclictest1243-21snmpd21:40:460
11840996723,15cyclictest0-21swapper/021:30:270
11840996722,38cyclictest0-21swapper/000:05:330
11840996624,35cyclictest5979-21munin-node21:55:310
11840996623,26cyclictest8442-21munin-node19:45:380
11840996621,38cyclictest0-21swapper/021:50:190
11840996621,38cyclictest0-21swapper/021:50:190
11840996621,38cyclictest0-21swapper/021:10:330
11840996620,39cyclictest23787-21uname20:15:340
11840996524,34cyclictest0-21swapper/022:08:340
11840996520,38cyclictest0-21swapper/000:02:180
11840996518,30cyclictest0-21swapper/022:00:210
11840996431,26cyclictest18435-21grep23:25:350
11840996423,26cyclictest14450-21munin-node18:50:400
11840996418,30cyclictest0-21swapper/019:40:100
11840996417,40cyclictest0-21swapper/023:55:000
11840996417,26cyclictest9362-21munin-run20:55:060
11840996416,42cyclictest0-21swapper/022:20:030
11840996413,34cyclictest0-21swapper/020:45:320
11840996325,16cyclictest1627-21nscd23:10:010
11840996323,34cyclictest28105-21grep19:15:460
11840996323,12cyclictest22353-21gltestperf21:20:250
11840996322,34cyclictest29686-21latency_hist20:30:090
11840996322,34cyclictest29686-21latency_hist20:30:090
11840996320,36cyclictest0-21swapper/022:55:190
11840996320,36cyclictest0-21swapper/021:45:360
11840996319,37cyclictest0-21swapper/019:10:330
11840996317,30cyclictest0-21swapper/000:10:260
11840996312,43cyclictest0-21swapper/020:00:090
11840996223,33cyclictest18235-21grep22:20:170
11840996221,34cyclictest0-21swapper/023:10:230
11840996221,34cyclictest0-21swapper/023:10:230
11840996220,36cyclictest0-21swapper/020:02:480
11840996219,37cyclictest0-21swapper/023:15:320
11840996219,37cyclictest0-21swapper/023:15:320
11848996142,11cyclictest21240-21gltestperf20:10:283
11840996125,11cyclictest29129-21munin-node21:35:220
11840996124,13cyclictest13139-21munin-node22:10:240
11840996123,31cyclictest262651munin-node23:45:340
11840996120,35cyclictest0-21swapper/019:50:230
11840996120,34cyclictest22107-21chrt22:25:420
11840996117,28cyclictest0-21swapper/021:15:420
11840996115,40cyclictest0-21swapper/023:35:130
11840996018,36cyclictest0-21swapper/020:10:380
11840996016,38cyclictest0-21swapper/019:40:300
11840996016,38cyclictest0-21swapper/019:40:300
243799590,4rtkit-daemon2436-21rtkit-daemon19:46:021
11840995937,16cyclictest0-21swapper/019:25:340
11840995936,18cyclictest1369-21runrttasks18:47:290
11840995927,25cyclictest23281-21sort22:30:200
11840995921,31cyclictest0-21swapper/021:01:470
11840995915,38cyclictest0-21swapper/022:35:140
11840995911,41cyclictest0-21swapper/021:10:070
11840995911,41cyclictest0-21swapper/021:10:070
11840995826,26cyclictest1243-21snmpd20:21:500
11840995822,31cyclictest28859-21aten_r1power_fr19:20:230
11840995814,38cyclictest0-21swapper/021:25:320
11840995812,41cyclictest0-21swapper/019:00:250
243799570,7rtkit-daemon0-21swapper/122:45:400
243799570,7rtkit-daemon0-21swapper/120:32:520
11848995738,12cyclictest21961-21tr19:05:263
11840995725,25cyclictest31849-21grep23:55:200
11840995725,25cyclictest31849-21grep23:55:200
11840995715,27cyclictest1243-21snmpd20:56:490
1184099568,42cyclictest0-21swapper/018:55:410
1184099568,42cyclictest0-21swapper/018:55:410
11840995630,18cyclictest611-21gltestperf22:50:260
11840995612,37cyclictest0-21swapper/023:20:140
11848995535,12cyclictest28353-21grep20:25:293
11848995535,12cyclictest28353-21grep20:25:293
11840995530,17cyclictest0-21swapper/020:35:230
11840995521,28cyclictest23655-21sshd19:08:530
1184899545,30cyclictest0-21swapper/319:25:293
1184899545,13cyclictest0-21swapper/322:27:043
11848995429,19cyclictest8067-21gltestperf20:50:273
11848995421,14cyclictest0-21swapper/321:00:233
11848995415,22cyclictest9594-21munin-node20:55:353
65542533,11sleep30-21swapper/321:55:233
132752533,43sleep30-21swapper/318:45:383
1184899535,28cyclictest0-21swapper/323:00:113
1184899533,43cyclictest0-21swapper/321:50:313
1184899533,43cyclictest0-21swapper/321:50:313
11848995318,21cyclictest32374-21aten_r1power_fr20:35:203
243799520,4rtkit-daemon2436-21rtkit-daemon19:26:251
187682522,9sleep10-21swapper/118:57:251
187682522,9sleep10-21swapper/118:57:251
1184899525,29cyclictest0-21swapper/319:15:463
1184899524,30cyclictest0-21swapper/322:25:033
1184899524,29cyclictest0-21swapper/323:35:303
1184899524,28cyclictest0-21swapper/322:15:313
11848995221,13cyclictest0-21swapper/319:00:383
11848995219,13cyclictest0-21swapper/321:40:183
11848995219,12cyclictest0-21swapper/322:45:353
11848995210,24cyclictest24016-21aten_r1power_fr21:25:193
1184599525,38cyclictest0-21swapper/121:35:051
11845995233,11cyclictest18064-21aten_r1power_vo22:20:161
262642512,38sleep10-21swapper/123:45:131
1184899514,29cyclictest0-21swapper/320:05:283
1184899514,28cyclictest0-21swapper/322:55:023
1184899514,28cyclictest0-21swapper/322:40:213
1184899514,28cyclictest0-21swapper/322:00:253
1184899514,28cyclictest0-21swapper/319:50:303
1184899514,28cyclictest0-21swapper/300:10:103
1184899514,26cyclictest0-21swapper/321:06:123
1184899514,26cyclictest0-21swapper/321:06:123
1184899514,26cyclictest0-21swapper/300:07:193
11848995134,10cyclictest10360-21gltestperf23:10:223
11848995134,10cyclictest10360-21gltestperf23:10:223
11848995118,13cyclictest0-21swapper/320:45:313
11848995117,13cyclictest0-21swapper/321:10:353
1184599515,12cyclictest0-21swapper/121:36:541
11845995133,11cyclictest28224-21cut20:25:281
11845995133,11cyclictest28224-21cut20:25:281
43032503,10sleep30-21swapper/322:57:303
31672502,9sleep30-21swapper/319:32:093
284572502,43sleep10-21swapper/119:19:131
275692502,9sleep10-21swapper/122:40:151
1184899505,25cyclictest0-21swapper/319:21:323
1184899504,28cyclictest0-21swapper/323:20:273
1184899504,28cyclictest0-21swapper/321:35:333
1184899504,28cyclictest0-21swapper/320:15:463
1184899504,28cyclictest0-21swapper/319:10:243
11848995034,10cyclictest26830-21unixbench_singl22:35:363
1184899503,28cyclictest0-21swapper/323:45:333
11848995019,13cyclictest0-21swapper/321:45:383
11848995017,13cyclictest0-21swapper/320:30:263
1184599505,28cyclictest0-21swapper/121:20:251
1184599505,26cyclictest0-21swapper/123:08:451
1184599504,28cyclictest0-21swapper/123:10:331
1184599504,28cyclictest0-21swapper/123:10:331
1184599504,28cyclictest0-21swapper/122:25:311
1184599504,28cyclictest0-21swapper/121:50:321
1184599504,28cyclictest0-21swapper/121:50:321
1184599504,28cyclictest0-21swapper/121:05:341
1184599504,28cyclictest0-21swapper/121:05:341
11845995035,8cyclictest0-21swapper/120:50:311
11845995020,13cyclictest0-21swapper/100:05:281
9762493,7sleep31059-21aten_r1power_fr00:00:143
79182493,9sleep10-21swapper/119:41:351
79182493,9sleep10-21swapper/119:41:351
304582492,39sleep10-21swapper/123:50:411
232252493,8sleep123257-21diskstats22:30:201
209922493,39sleep10-21swapper/121:16:111
1184899495,12cyclictest0-21swapper/323:57:173
1184899495,12cyclictest0-21swapper/323:57:173
1184899494,28cyclictest0-21swapper/322:32:053
1184899494,27cyclictest0-21swapper/319:35:413
1184899494,26cyclictest0-21swapper/323:42:153
1184899494,26cyclictest0-21swapper/323:07:093
11848994931,10cyclictest17184-21cpuspeed_turbos18:55:253
11848994931,10cyclictest17184-21cpuspeed_turbos18:55:253
11848994919,12cyclictest0-21swapper/323:30:113
11848994917,13cyclictest0-21swapper/319:55:423
11848994916,13cyclictest0-21swapper/319:50:103
1184599495,27cyclictest0-21swapper/120:35:381
11845994933,10cyclictest12662-21fschecks_count18:45:291
11845994919,13cyclictest0-21swapper/121:25:271
1184899486,26cyclictest0-21swapper/320:01:393
1184899484,26cyclictest0-21swapper/319:40:213
1184899484,26cyclictest0-21swapper/319:40:213
11848994830,10cyclictest26200-21kernelversion20:20:343
1184599484,38cyclictest0-21swapper/100:11:101
1184599484,27cyclictest0-21swapper/123:25:321
1184599484,27cyclictest0-21swapper/123:15:291
1184599484,27cyclictest0-21swapper/123:15:291
1184599484,27cyclictest0-21swapper/122:39:501
1184599484,26cyclictest0-21swapper/123:02:081
1184599484,26cyclictest0-21swapper/121:56:591
1184599484,26cyclictest0-21swapper/119:50:371
1184599484,25cyclictest23338-21chrt20:15:281
236032472,39sleep10-21swapper/123:39:401
151292473,10sleep10-21swapper/122:13:021
140662472,9sleep10-21swapper/121:04:141
1184899474,26cyclictest0-21swapper/321:16:513
1184899474,25cyclictest0-21swapper/321:31:473
1184899474,22cyclictest0-21swapper/323:15:143
1184899474,22cyclictest0-21swapper/323:15:143
1184899473,25cyclictest30397-21grep23:50:353
1184899473,25cyclictest0-21swapper/321:21:523
11848994716,12cyclictest0-21swapper/322:15:043
11848994714,13cyclictest0-21swapper/320:42:403
1184599475,34cyclictest0-21swapper/123:55:121
1184599475,34cyclictest0-21swapper/123:55:121
1184599475,26cyclictest0-21swapper/120:46:471
1184599474,26cyclictest0-21swapper/122:50:371
258272462,37sleep10-21swapper/119:11:031
1184899464,33cyclictest0-21swapper/318:50:233
1184899464,22cyclictest0-21swapper/323:25:143
1184899463,26cyclictest0-21swapper/322:05:293
1184599464,35cyclictest0-21swapper/123:40:341
1184599464,26cyclictest0-21swapper/122:05:231
1184599464,26cyclictest0-21swapper/119:20:311
11845994632,9cyclictest31656-21grep20:30:431
11845994632,9cyclictest16476-21gltestperf20:00:291
11845994629,11cyclictest5323-21unixbench-2d19:35:441
11845994629,10cyclictest18290-21cpuspeed_turbos20:05:251
11845994624,16cyclictest0-21swapper/122:00:311
11845994624,15cyclictest0-21swapper/122:45:291
116272462,10sleep10-21swapper/120:58:381
1184599454,34cyclictest0-21swapper/121:40:221
1184599454,34cyclictest0-21swapper/120:20:361
1184599454,34cyclictest0-21swapper/120:10:371
1184599454,34cyclictest0-21swapper/119:30:441
1184599444,33cyclictest0-21swapper/122:55:291
1184599444,33cyclictest0-21swapper/100:00:151
1184599443,10cyclictest3554-21memory20:40:321
11845994425,12cyclictest0-21swapper/119:05:351
11845994425,10cyclictest17959-21needreboot21:10:311
11845994424,14cyclictest0-21swapper/122:15:391
11845994424,13cyclictest0-21swapper/123:30:131
1184899434,12cyclictest0-21swapper/318:45:123
1184599435,12cyclictest0-21swapper/121:45:261
1184599434,12cyclictest0-21swapper/119:55:321
11845994315,12cyclictest0-21swapper/118:50:231
1184599424,12cyclictest0-21swapper/123:22:111
243799390,4rtkit-daemon2436-21rtkit-daemon18:40:341
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional