You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-08 - 12:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sat Nov 08, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1872399933,71cyclictest0-21swapper/021:35:270
1872399894,67cyclictest0-21swapper/019:25:300
1872399894,66cyclictest0-21swapper/020:55:240
1872399893,77cyclictest0-21swapper/021:40:560
1872399884,76cyclictest0-21swapper/018:05:220
1872399873,76cyclictest6671-21sadc18:25:100
1872399864,74cyclictest0-21swapper/021:50:260
1872399864,74cyclictest0-21swapper/021:50:260
1872399863,77cyclictest0-21swapper/016:36:160
1872399854,73cyclictest0-21swapper/021:30:030
1872399854,64cyclictest1265-21runrttasks19:07:560
1872399854,64cyclictest0-21swapper/018:50:420
1872399853,75cyclictest16981-21unixbench_singl19:50:410
1872399853,73cyclictest1160-21snmpd21:05:230
1872399853,59cyclictest13959-21taskset20:55:050
1872399844,73cyclictest0-21swapper/021:30:230
1872399844,73cyclictest0-21swapper/017:15:410
1872399844,49cyclictest0-21swapper/016:45:470
1872399844,49cyclictest0-21swapper/016:45:470
1872399843,61cyclictest0-21swapper/017:55:420
1872399834,72cyclictest0-21swapper/020:40:220
1872399834,63cyclictest0-21swapper/018:30:400
1872399834,60cyclictest0-21swapper/021:55:210
1872399834,60cyclictest0-21swapper/021:55:210
1872399833,73cyclictest12696-21latency_hist17:30:130
1872399833,73cyclictest0-21swapper/021:15:100
1872399833,71cyclictest0-21swapper/019:00:350
142282830,3sleep2281ktimersoftd/222:00:302
1872399824,69cyclictest0-21swapper/021:00:390
1872399823,73cyclictest0-21swapper/020:45:380
1872399823,65cyclictest0-21swapper/017:21:240
1872399823,61cyclictest0-21swapper/016:50:330
1872399823,58cyclictest20144-21basename17:45:230
1872399823,58cyclictest1766-21taskset17:05:360
1872399814,70cyclictest0-21swapper/021:20:180
1872399814,69cyclictest0-21swapper/022:00:300
1872399814,62cyclictest0-21swapper/018:14:470
1872399814,61cyclictest0-21swapper/018:37:260
1872399813,71cyclictest0-21swapper/018:25:220
1872399813,65cyclictest0-21swapper/020:16:520
1872399813,58cyclictest0-21swapper/020:10:250
1872399804,64cyclictest0-21swapper/016:40:390
1872399804,61cyclictest0-21swapper/019:55:370
1872399803,70cyclictest1160-21snmpd19:31:440
1872399803,70cyclictest0-21swapper/019:23:440
1872399803,69cyclictest0-21swapper/021:45:350
1872399794,58cyclictest0-21swapper/017:50:240
1872399794,52cyclictest0-21swapper/020:25:320
1872399794,52cyclictest0-21swapper/020:25:320
1872399793,61cyclictest0-21swapper/018:15:210
1872399793,61cyclictest0-21swapper/018:15:210
1872399784,67cyclictest0-21swapper/021:10:230
1872399784,67cyclictest0-21swapper/021:10:230
1872399784,67cyclictest0-21swapper/019:45:310
1872399784,60cyclictest0-21swapper/017:36:300
1872399783,69cyclictest0-21swapper/020:21:530
1872399783,68cyclictest22449-21needreboot18:55:340
1872399783,67cyclictest64932chrt20:38:310
1872399783,58cyclictest0-21swapper/019:15:210
1872399783,58cyclictest0-21swapper/017:40:260
1872399774,65cyclictest0-21swapper/020:34:500
1872399774,65cyclictest0-21swapper/017:00:440
1872399773,67cyclictest29167-21fschecks_time19:10:250
1872399773,67cyclictest0-21swapper/016:56:160
1872399763,66cyclictest0-21swapper/018:40:330
1872399763,58cyclictest0-21swapper/017:10:460
1872399763,55cyclictest0-21swapper/018:00:450
1872399754,62cyclictest0-21swapper/016:35:140
1872399754,61cyclictest0-21swapper/019:36:460
1872399754,57cyclictest0-21swapper/020:05:210
1872399753,65cyclictest0-21swapper/020:00:390
18726997416,51cyclictest7064-21runrttasks18:25:232
1872399743,64cyclictest0-21swapper/018:45:300
1872399743,61cyclictest0-21swapper/019:40:250
1872399733,64cyclictest0-21swapper/017:34:380
1872399733,64cyclictest0-21swapper/017:34:380
223099700,25rtkit-daemon2229-21rtkit-daemon20:15:193
1872699693,59cyclictest0-21swapper/220:00:322
1872699663,57cyclictest0-21swapper/220:58:212
18726996511,45cyclictest0-21swapper/217:35:122
18726996511,45cyclictest0-21swapper/217:35:122
246222640,3sleep2281ktimersoftd/221:15:282
223099630,5rtkit-daemon2229-21rtkit-daemon21:25:313
223099630,5rtkit-daemon2229-21rtkit-daemon16:35:283
1872699615,49cyclictest0-21swapper/220:05:312
1872699613,51cyclictest0-21swapper/218:47:472
1872599613,51cyclictest0-21swapper/118:35:421
1872599612,53cyclictest0-21swapper/117:55:261
114232612,10sleep20-21swapper/218:34:442
1872799593,50cyclictest0-21swapper/317:46:283
1872699594,13cyclictest0-21swapper/218:35:462
1872599594,49cyclictest0-21swapper/119:45:421
18725995935,10cyclictest0-21swapper/119:05:091
1872599593,49cyclictest0-21swapper/119:55:251
276122582,46sleep127749-21df_abs20:15:231
223099580,6rtkit-daemon2229-21rtkit-daemon21:05:323
18727995839,11cyclictest1265-21runrttasks20:27:423
18727995839,11cyclictest1265-21runrttasks20:27:423
1872799583,48cyclictest0-21swapper/317:00:243
18725995839,10cyclictest20270-21processes18:50:381
18725995829,13cyclictest0-21swapper/119:15:211
69192576,7sleep10-21swapper/121:45:311
236952572,48sleep10-21swapper/120:05:361
18726995725,11cyclictest1296-21kworker/u8:019:45:342
18725995728,14cyclictest0-21swapper/118:45:371
18725995728,13cyclictest0-21swapper/119:25:071
18725995727,13cyclictest0-21swapper/121:15:041
18725995727,13cyclictest0-21swapper/121:15:041
223099560,5rtkit-daemon2229-21rtkit-daemon18:34:533
1872799563,46cyclictest0-21swapper/317:35:413
18725995633,10cyclictest0-21swapper/116:45:451
18725995633,10cyclictest0-21swapper/116:45:451
18725995629,12cyclictest0-21swapper/121:36:461
73102550,6sleep27313-21timerwakeupswit19:30:422
223099550,6rtkit-daemon2229-21rtkit-daemon19:55:273
223099550,6rtkit-daemon2229-21rtkit-daemon18:35:463
223099550,5rtkit-daemon2229-21rtkit-daemon21:34:533
18727995531,9cyclictest28486-21munin-node16:55:303
18727995523,14cyclictest0-21swapper/318:00:113
1872699554,13cyclictest0-21swapper/221:50:172
1872699554,13cyclictest0-21swapper/221:50:172
18726995537,11cyclictest27868-21grep16:50:472
18726995513,22cyclictest0-21swapper/219:10:192
18725995533,10cyclictest0-21swapper/120:35:181
1872599553,46cyclictest0-21swapper/121:25:241
18725995523,14cyclictest0-21swapper/117:35:241
262682543,43sleep20-21swapper/219:05:232
223099540,5rtkit-daemon2229-21rtkit-daemon19:34:433
223099540,5rtkit-daemon2229-21rtkit-daemon18:00:323
1872799543,45cyclictest0-21swapper/318:15:293
1872799543,45cyclictest0-21swapper/318:15:293
1872699544,12cyclictest0-21swapper/217:20:162
18726995428,10cyclictest106250irq/46-eth021:20:202
1872599546,29cyclictest0-21swapper/121:40:291
1872599545,30cyclictest0-21swapper/117:15:371
1872599545,29cyclictest0-21swapper/121:15:361
1872599544,31cyclictest0-21swapper/122:00:231
18725995431,7cyclictest4184-21yum-updatesd-he20:34:421
1872599543,45cyclictest0-21swapper/117:25:291
223099530,5rtkit-daemon2229-21rtkit-daemon20:50:183
223099530,5rtkit-daemon2229-21rtkit-daemon19:50:203
223099530,5rtkit-daemon2229-21rtkit-daemon17:30:413
223099530,5rtkit-daemon2229-21rtkit-daemon17:30:413
223099530,5rtkit-daemon2229-21rtkit-daemon16:34:132
1872699534,13cyclictest0-21swapper/217:45:122
1872699533,12cyclictest0-21swapper/221:34:402
1872699533,11cyclictest0-21swapper/219:50:382
18726995322,12cyclictest0-21swapper/219:00:292
18726995318,21cyclictest0-21swapper/217:07:052
18726995317,21cyclictest6915-21telnet20:40:182
1872599535,28cyclictest0-21swapper/121:20:251
1872599534,28cyclictest0-21swapper/119:10:091
18725995331,10cyclictest0-21swapper/120:55:391
1872599533,44cyclictest1296-21kworker/u8:016:50:251
41262523,12sleep20-21swapper/221:40:242
223099520,5rtkit-daemon2229-21rtkit-daemon19:00:453
219762522,11sleep10-21swapper/120:02:381
1872799523,44cyclictest0-21swapper/318:20:213
1872799523,43cyclictest0-21swapper/319:35:203
1872799523,43cyclictest0-21swapper/318:50:453
1872799523,43cyclictest0-21swapper/318:05:243
1872799523,42cyclictest0-21swapper/316:45:273
1872799523,42cyclictest0-21swapper/316:45:273
1872699525,29cyclictest0-21swapper/220:15:312
1872699525,29cyclictest0-21swapper/219:15:362
1872699525,29cyclictest0-21swapper/218:21:332
1872699525,28cyclictest0-21swapper/217:45:242
1872699524,28cyclictest0-21swapper/221:55:172
1872699524,28cyclictest0-21swapper/221:55:172
18726995223,10cyclictest1296-21kworker/u8:019:35:312
18726995221,10cyclictest4246-21awk20:35:052
1872699522,17cyclictest0-21swapper/217:13:352
1872599525,29cyclictest0-21swapper/118:15:241
1872599525,29cyclictest0-21swapper/118:15:241
1872599524,30cyclictest0-21swapper/120:40:301
18725995234,10cyclictest25631-21grep20:10:301
18725995230,10cyclictest0-21swapper/118:55:311
1872599523,28cyclictest22203-21gltestperf16:40:351
18725995221,13cyclictest0-21swapper/119:35:321
18725995220,14cyclictest0-21swapper/118:05:121
244942512,9sleep10-21swapper/117:53:281
223099510,5rtkit-daemon2229-21rtkit-daemon20:00:353
223099510,5rtkit-daemon2229-21rtkit-daemon19:26:443
1872799513,42cyclictest0-21swapper/318:25:223
18727995122,13cyclictest0-21swapper/319:45:393
1872699515,27cyclictest0-21swapper/221:05:332
1872699515,27cyclictest0-21swapper/219:55:342
1872699514,27cyclictest0-21swapper/220:36:562
18726995127,18cyclictest0-21swapper/216:40:482
1872699512,19cyclictest0-21swapper/219:25:002
1872599514,30cyclictest0-21swapper/117:10:131
1872599514,28cyclictest0-21swapper/118:10:471
18725995126,10cyclictest0-21swapper/116:35:461
18725995121,13cyclictest0-21swapper/117:20:291
18725995119,11cyclictest0-21swapper/119:40:331
114502513,41sleep10-21swapper/118:35:031
305482502,40sleep20-21swapper/216:59:072
302672502,9sleep10-21swapper/119:11:191
233432502,9sleep30-21swapper/318:59:243
223099500,5rtkit-daemon2229-21rtkit-daemon20:43:413
223099500,5rtkit-daemon2229-21rtkit-daemon20:35:263
223099500,5rtkit-daemon2229-21rtkit-daemon19:40:283
223099500,5rtkit-daemon2229-21rtkit-daemon19:10:373
223099500,5rtkit-daemon2229-21rtkit-daemon18:45:303
1872799504,40cyclictest0-21swapper/321:15:263
1872799503,42cyclictest0-21swapper/320:20:303
1872799503,42cyclictest0-21swapper/318:10:353
1872799503,41cyclictest0-21swapper/319:20:093
1872799503,41cyclictest0-21swapper/317:05:443
18727995023,12cyclictest0-21swapper/320:05:433
1872799502,42cyclictest0-21swapper/320:55:183
1872699505,27cyclictest0-21swapper/217:55:322
1872699505,27cyclictest0-21swapper/217:15:322
1872699505,27cyclictest0-21swapper/216:36:162
1872699504,29cyclictest0-21swapper/218:05:222
1872699504,27cyclictest0-21swapper/218:45:102
1872699504,27cyclictest0-21swapper/217:51:282
18726995020,12cyclictest0-21swapper/220:10:382
1872599504,29cyclictest0-21swapper/118:05:421
1872599504,28cyclictest0-21swapper/121:05:391
1872599504,28cyclictest0-21swapper/118:25:361
1872599503,40cyclictest0-21swapper/121:50:161
1872599503,40cyclictest0-21swapper/121:50:161
18725995028,10cyclictest0-21swapper/121:30:201
172922502,43sleep10-21swapper/119:53:511
327452492,10sleep20-21swapper/220:25:242
327452492,10sleep20-21swapper/220:25:242
223099490,4rtkit-daemon2229-21rtkit-daemon19:20:513
198402492,42sleep10-21swapper/117:45:011
1872799493,42cyclictest0-21swapper/316:50:253
1872799493,40cyclictest0-21swapper/321:40:543
1872799493,40cyclictest0-21swapper/321:10:133
1872799493,40cyclictest0-21swapper/321:10:133
1872799493,40cyclictest0-21swapper/321:00:153
1872799493,40cyclictest0-21swapper/320:45:173
1872799493,40cyclictest0-21swapper/317:15:323
1872799493,39cyclictest0-21swapper/316:40:363
18727994921,13cyclictest0-21swapper/321:50:163
18727994921,13cyclictest0-21swapper/321:50:163
1872799492,41cyclictest0-21swapper/320:30:233
1872699494,28cyclictest0-21swapper/220:45:292
1872699494,28cyclictest0-21swapper/218:50:322
1872699494,28cyclictest0-21swapper/218:00:392
1872699494,28cyclictest0-21swapper/216:46:172
1872699494,28cyclictest0-21swapper/216:46:172
1872699494,27cyclictest0-21swapper/221:35:182
1872699494,27cyclictest0-21swapper/219:42:302
1872699494,27cyclictest0-21swapper/218:10:162
18726994918,14cyclictest0-21swapper/221:11:172
18726994918,14cyclictest0-21swapper/221:11:172
18726994917,13cyclictest0-21swapper/220:20:262
1872599495,29cyclictest0-21swapper/117:00:141
1872599494,38cyclictest0-21swapper/117:05:131
1872599494,30cyclictest0-21swapper/120:45:231
1872599494,29cyclictest0-21swapper/120:20:351
1872599494,28cyclictest0-21swapper/117:12:501
18725994919,14cyclictest0-21swapper/119:30:281
148312492,41sleep30-21swapper/322:03:353
65032482,40sleep10-21swapper/118:23:061
1872799483,39cyclictest0-21swapper/321:45:153
1872799483,39cyclictest0-21swapper/321:20:173
1872799483,39cyclictest0-21swapper/319:05:213
1872799483,39cyclictest0-21swapper/318:40:293
1872799483,38cyclictest0-21swapper/321:55:153
1872799483,38cyclictest0-21swapper/321:55:153
1872699485,27cyclictest0-21swapper/217:35:272
1872699484,27cyclictest0-21swapper/221:04:472
1872699484,26cyclictest0-21swapper/220:50:172
1872599484,28cyclictest0-21swapper/121:00:221
1872599484,28cyclictest0-21swapper/117:30:251
1872599484,28cyclictest0-21swapper/117:30:251
18725994820,12cyclictest0-21swapper/117:45:411
1872799473,39cyclictest0-21swapper/317:10:353
18726994733,10cyclictest22083-21gltestperf18:55:292
18725994726,10cyclictest0-21swapper/121:57:571
18725994726,10cyclictest0-21swapper/121:57:571
18725994720,10cyclictest0-21swapper/119:25:371
14162472,40sleep10-21swapper/120:26:231
14162472,40sleep10-21swapper/120:26:231
18727994632,9cyclictest1572-21gltestperf21:35:243
1872799463,34cyclictest0-21swapper/320:10:223
1872799462,39cyclictest0-21swapper/317:21:233
1872699464,35cyclictest0-21swapper/219:25:202
1872699464,26cyclictest0-21swapper/218:15:222
1872699464,26cyclictest0-21swapper/218:15:222
1872699464,26cyclictest0-21swapper/217:25:252
18726994628,12cyclictest28679-21grep21:25:172
1872599464,23cyclictest0-21swapper/118:40:381
18725994619,11cyclictest0-21swapper/120:50:181
1872799452,38cyclictest0-21swapper/317:40:253
18726994525,13cyclictest0-21swapper/221:48:552
18726994517,10cyclictest0-21swapper/217:00:252
1872799442,37cyclictest0-21swapper/317:27:253
1872799432,36cyclictest0-21swapper/317:50:303
1872599354,14cyclictest0-21swapper/116:35:151
186902347,15sleep318705-21munin-run16:35:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional