You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-29 - 21:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Mon Jun 29, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991320,6rtkit-daemon2193-21rtkit-daemon07:30:542
2194991300,6rtkit-daemon2193-21rtkit-daemon09:09:202
2194991210,4rtkit-daemon2193-21rtkit-daemon09:25:272
14504991016,29cyclictest0-21swapper/210:55:352
1450499995,29cyclictest25998-21tr11:30:252
1450499995,28cyclictest1227-21runrttasks09:55:432
14504999810,26cyclictest0-21swapper/210:05:402
219499960,4rtkit-daemon2193-21rtkit-daemon08:43:430
219499950,7rtkit-daemon0-21swapper/209:39:492
1450499955,26cyclictest1227-21runrttasks09:13:222
14504999522,10cyclictest13883-21ssh11:10:462
14504999312,13cyclictest0-21swapper/210:15:362
1450499924,26cyclictest107550irq/46-eth008:45:392
1450499924,26cyclictest0-21swapper/210:38:342
1450499918,13cyclictest0-21swapper/210:25:272
1450499915,35cyclictest1227-21runrttasks08:42:512
1450499915,28cyclictest0-21swapper/208:05:372
1450499914,24cyclictest23217-21hwlatdetect11:25:332
1450499914,24cyclictest23217-21hwlatdetect11:25:332
14504999118,11cyclictest0-21swapper/209:23:542
14504999118,11cyclictest0-21swapper/209:23:542
316482900,2sleep3361ktimersoftd/310:02:033
1450499905,26cyclictest0-21swapper/211:19:452
1450499904,26cyclictest22844-21wc09:00:522
1450499904,26cyclictest0-21swapper/211:40:282
1450499904,26cyclictest0-21swapper/211:05:262
1450499904,14cyclictest31636-21ssh10:50:322
1450499904,13cyclictest0-21swapper/211:45:572
14504999020,13cyclictest4326-21df10:10:312
14504999018,13cyclictest0-21swapper/210:30:392
1450499895,24cyclictest0-21swapper/208:54:362
1450499895,22cyclictest1227-21runrttasks09:31:242
1450499895,13cyclictest7236-21diskmemload12:05:392
1450499895,13cyclictest7236-21diskmemload12:05:392
1450499895,13cyclictest2431-21crond08:30:192
1450499894,34cyclictest31908-21entropy09:15:342
1450499894,28cyclictest0-21swapper/210:00:272
1450499894,27cyclictest0-21swapper/209:40:412
1450499894,13cyclictest0-21swapper/209:47:142
1450599883,63cyclictest20251-21runrttasks08:58:133
1450499885,31cyclictest10972-21chrt11:55:292
1450499885,27cyclictest0-21swapper/210:20:472
1450499885,10cyclictest19113-21ssh11:20:252
1450499884,33cyclictest0-21swapper/208:10:302
14504998819,10cyclictest0-21swapper/211:50:162
14504998817,12cyclictest0-21swapper/209:50:302
14504998815,13cyclictest0-21swapper/212:00:252
14504998811,10cyclictest0-21swapper/211:35:302
1450599873,77cyclictest31667-21fschecks_time10:50:323
14504998719,13cyclictest0-21swapper/207:45:322
1450599863,75cyclictest49451ssh09:23:173
1450599863,75cyclictest49451ssh09:23:173
1450499864,29cyclictest0-21swapper/208:30:382
1450499864,12cyclictest0-21swapper/207:50:472
14504998620,10cyclictest0-21swapper/208:59:002
14504998614,13cyclictest0-21swapper/207:59:362
14504998612,13cyclictest0-21swapper/210:40:302
1450599854,73cyclictest29562-21taskset10:46:173
1450599854,73cyclictest29562-21taskset10:46:173
1450599852,76cyclictest25835-21ssh09:55:163
1450499854,25cyclictest0-21swapper/211:01:162
1450499854,12cyclictest1511-21aten2.4-expect07:20:332
14504998521,13cyclictest0-21swapper/210:45:312
14504998521,13cyclictest0-21swapper/210:45:312
1450599844,53cyclictest7585-21unixbench_singl09:25:513
1450599843,74cyclictest7236-21diskmemload08:48:203
1450599843,74cyclictest29641-21fschecks_count11:35:293
1450599843,74cyclictest0-21swapper/312:05:513
1450599843,74cyclictest0-21swapper/312:05:513
1450599843,74cyclictest0-21swapper/310:26:473
1450599843,73cyclictest2122-21kworker/3:111:01:113
1450599843,73cyclictest17554-21egrep10:30:253
1450599843,73cyclictest12918-21cpuspeed_turbos09:35:323
1450599843,72cyclictest0-21swapper/309:45:303
1450499844,30cyclictest9971-21awk07:35:482
1450599834,71cyclictest4393-21smartctl11:45:323
1450599834,70cyclictest1761-21Xorg11:43:103
1450599833,64cyclictest0-21swapper/310:40:343
14504998315,13cyclictest0-21swapper/206:40:392
219499820,4rtkit-daemon2193-21rtkit-daemon08:49:130
1450599824,71cyclictest0-21swapper/310:15:353
1450599823,72cyclictest0-21swapper/308:41:103
1450499825,32cyclictest0-21swapper/208:25:192
1450499824,26cyclictest0-21swapper/207:25:352
1450599815,69cyclictest0-21swapper/309:05:173
1450599814,69cyclictest15396-21cat08:50:433
1450599814,69cyclictest15298-21diskstats06:40:403
1450599814,61cyclictest0-21swapper/309:05:353
1450599814,46cyclictest22722-21runrttasks10:36:023
1450599813,71cyclictest9147-21munin-node09:30:473
1450599813,71cyclictest4142-21cpuspeed10:10:303
1450599813,71cyclictest0-21swapper/311:58:383
1450599813,50cyclictest0-21swapper/309:16:443
1450599813,47cyclictest0-21swapper/310:21:263
1450499819,20cyclictest0-21swapper/208:19:572
1450499814,26cyclictest0-21swapper/207:10:582
1450499811,28cyclictest0-21swapper/207:00:512
1450599804,68cyclictest1329-21cat07:20:233
1450599804,68cyclictest1329-21cat07:20:233
1450599804,68cyclictest0-21swapper/311:05:343
1450599804,59cyclictest16308-21ssh11:15:323
1450599803,70cyclictest2417-21taskset10:05:523
1450599803,70cyclictest0-21swapper/309:57:233
1450599803,69cyclictest1886-21munin-node10:55:223
1450599803,67cyclictest0-21swapper/309:44:193
1450499808,20cyclictest0-21swapper/206:45:272
14504998022,13cyclictest0-21swapper/208:00:522
14504998022,13cyclictest0-21swapper/208:00:522
1450599794,68cyclictest23208-21http_loadtime11:25:333
1450599794,68cyclictest23208-21http_loadtime11:25:333
1450599794,66cyclictest0-21swapper/311:30:463
1450599793,70cyclictest2122-21kworker/3:111:23:113
1450599793,69cyclictest3693-21iostat_ios08:30:403
1450599793,69cyclictest15457-21ssh12:00:433
1450499794,11cyclictest7450-21cat08:40:202
14504997922,10cyclictest1227-21runrttasks06:55:422
1450599784,66cyclictest0-21swapper/309:11:523
1450599784,58cyclictest22707-21gltestperf06:55:403
1450599783,68cyclictest14441-21ssh11:12:193
1450599783,68cyclictest0-21swapper/307:45:213
1450599783,67cyclictest8375-21python11:50:433
1450599773,67cyclictest0-21swapper/308:05:513
1450499774,32cyclictest0-21swapper/207:20:222
1450499774,32cyclictest0-21swapper/207:20:222
1450599764,53cyclictest0-21swapper/307:55:343
1450599763,66cyclictest18926-21taskset06:46:113
1450599763,66cyclictest1084-21lldpd08:35:513
1450599763,65cyclictest6921-21fschecks_count07:30:393
1450599763,64cyclictest10284-21timerandwakeup07:35:543
1450499765,13cyclictest0-21swapper/206:50:352
1450599754,63cyclictest0-21swapper/307:05:563
1450599753,66cyclictest3931-21aten2.4-expect07:25:333
1450599753,64cyclictest0-21swapper/308:30:193
1450599753,64cyclictest0-21swapper/307:52:093
1450599753,62cyclictest28696-21http_loadtime08:15:403
1450599752,66cyclictest0-21swapper/307:00:403
1450499754,21cyclictest11216-21telnet07:40:352
1450599744,62cyclictest0-21swapper/306:50:513
1450599743,63cyclictest27191-21users08:10:513
14504997419,8cyclictest28592-21sshd07:07:482
219499720,7rtkit-daemon22682-21python09:00:501
219499720,6rtkit-daemon0-21swapper/008:44:061
1450599723,55cyclictest22467-21taskset08:01:113
1450599723,55cyclictest22467-21taskset08:01:113
219499710,6rtkit-daemon0-21swapper/008:51:431
219499710,6rtkit-daemon0-21swapper/008:45:581
1450599713,63cyclictest0-21swapper/307:23:583
1450599713,61cyclictest31652-21switchtime08:20:493
219499700,7rtkit-daemon0-21swapper/009:13:271
219499700,7rtkit-daemon0-21swapper/009:06:421
1450599703,45cyclictest13474-21munin-node07:45:553
219499690,6rtkit-daemon0-21swapper/108:55:430
219499690,6rtkit-daemon0-21swapper/008:55:281
1450599683,49cyclictest29035-21munin-node07:10:373
219499670,7rtkit-daemon0-21swapper/109:05:350
219499660,6rtkit-daemon0-21swapper/108:50:430
219499640,8rtkit-daemon0-21swapper/109:03:050
1450599633,55cyclictest0-21swapper/306:40:243
1450599633,55cyclictest0-21swapper/306:40:243
207042620,4sleep120773-21vmstat11:20:461
77792610,4sleep1201ktimersoftd/111:50:321
48432612,51sleep10-21swapper/108:35:191
214132613,12sleep10-21swapper/109:46:421
14501995819,31cyclictest13985-21processes09:35:471
14498995824,28cyclictest41ktimersoftd/008:15:460
303732573,9sleep00-21swapper/010:49:130
303732573,9sleep00-21swapper/010:49:130
202842573,47sleep10-21swapper/107:58:521
1449899577,28cyclictest0-21swapper/011:45:440
1449899573,48cyclictest0-21swapper/011:50:440
1449899573,48cyclictest0-21swapper/009:28:310
75192562,47sleep10-21swapper/111:01:431
40042563,46sleep00-21swapper/010:56:140
301932562,47sleep10-21swapper/110:48:331
301932562,47sleep10-21swapper/110:48:331
236842562,47sleep10-21swapper/110:39:301
19012563,7sleep11908-21ssh11:40:541
14501995619,23cyclictest2810-21ntpq07:20:481
1449899564,31cyclictest0-21swapper/008:10:210
219499550,5rtkit-daemon2193-21rtkit-daemon11:30:290
1450199553,44cyclictest0-21swapper/110:12:311
1449899555,30cyclictest0-21swapper/011:40:430
1449899554,46cyclictest0-21swapper/010:06:520
14498995523,14cyclictest0-21swapper/012:00:310
14498995514,35cyclictest41ktimersoftd/009:33:250
100032553,44sleep00-21swapper/007:35:500
83212543,11sleep00-21swapper/007:33:280
219499540,5rtkit-daemon2193-21rtkit-daemon11:05:380
1450199544,42cyclictest0-21swapper/111:45:301
14501995421,9cyclictest29716-21ssh10:00:291
1449899545,28cyclictest0-21swapper/010:15:420
1449899544,31cyclictest25835-21ssh09:55:160
1449899544,13cyclictest0-21swapper/006:45:520
14498995434,14cyclictest0-21swapper/009:40:280
14498995421,14cyclictest0-21swapper/008:10:410
14498995415,24cyclictest0-21swapper/011:59:280
14498995412,25cyclictest0-21swapper/010:35:290
11102544,13sleep00-21swapper/007:19:580
11102544,13sleep00-21swapper/007:19:580
262872533,10sleep10-21swapper/110:41:401
226542533,43sleep10-21swapper/108:03:401
226542533,43sleep10-21swapper/108:03:401
219499530,6rtkit-daemon2193-21rtkit-daemon11:20:300
200432533,10sleep00-21swapper/010:33:330
15592533,44sleep00-21swapper/009:18:430
1450199534,41cyclictest0-21swapper/109:55:161
1449899539,26cyclictest0-21swapper/009:55:320
1449899535,30cyclictest0-21swapper/010:00:380
1449899534,45cyclictest0-21swapper/012:05:390
1449899534,45cyclictest0-21swapper/012:05:390
1449899533,44cyclictest0-21swapper/011:01:590
14498995325,9cyclictest15265-21needreboot10:25:420
14498995324,13cyclictest0-21swapper/009:14:450
14498995321,14cyclictest0-21swapper/009:20:450
14498995321,14cyclictest0-21swapper/009:20:450
14498995312,22cyclictest19998-21grep09:45:350
135782533,10sleep00-21swapper/009:35:400
130622533,43sleep00-21swapper/011:10:330
322472523,43sleep10-21swapper/108:24:151
219499520,6rtkit-daemon2193-21rtkit-daemon11:25:440
219499520,6rtkit-daemon2193-21rtkit-daemon11:25:440
219499520,5rtkit-daemon2193-21rtkit-daemon11:31:291
1450199524,41cyclictest0-21swapper/110:54:231
14501995235,10cyclictest14437-21grep12:00:281
1450199523,7cyclictest20421-21kworker/1:010:29:011
1450199523,36cyclictest0-21swapper/109:58:031
14501995223,13cyclictest0-21swapper/109:30:451
1449899525,42cyclictest0-21swapper/011:40:120
1449899525,30cyclictest0-21swapper/010:42:480
1449899525,28cyclictest0-21swapper/008:00:410
1449899525,28cyclictest0-21swapper/008:00:410
1449899525,27cyclictest0-21swapper/006:59:260
1449899524,41cyclictest0-21swapper/007:10:340
14498995222,13cyclictest0-21swapper/010:12:270
110802523,42sleep00-21swapper/007:40:260
324502512,9sleep10-21swapper/107:15:441
324502512,9sleep10-21swapper/107:15:441
214312513,42sleep00-21swapper/006:52:460
203602513,42sleep00-21swapper/007:59:520
14501995124,12cyclictest0-21swapper/111:20:121
14501995123,13cyclictest0-21swapper/109:20:491
14501995123,13cyclictest0-21swapper/109:20:491
1449899515,29cyclictest0-21swapper/008:30:440
1449899515,28cyclictest0-21swapper/008:35:420
1449899515,27cyclictest0-21swapper/010:51:090
1449899515,27cyclictest0-21swapper/008:29:400
1449899514,29cyclictest16394-21grep11:15:330
14498995138,8cyclictest4219-21grep07:25:350
132012512,43sleep10-21swapper/110:23:181
165852503,11sleep00-21swapper/006:41:460
1450199504,40cyclictest0-21swapper/107:15:221
14501995029,13cyclictest0-21swapper/112:05:301
14501995029,13cyclictest0-21swapper/112:05:301
1449899505,27cyclictest0-21swapper/010:21:460
14498995022,10cyclictest13534-21tail07:45:320
14498995020,13cyclictest0-21swapper/007:21:280
117012502,42sleep10-21swapper/111:55:411
100572503,40sleep10-21swapper/107:35:511
189962493,38sleep10-21swapper/106:47:071
180022493,40sleep00-21swapper/007:55:130
1450199493,40cyclictest0-21swapper/111:07:361
14501994922,12cyclictest0-21swapper/109:40:331
1449899494,27cyclictest0-21swapper/008:20:410
129192494,37sleep20-21swapper/206:35:402
129192494,37sleep20-21swapper/206:35:402
284702482,10sleep10-21swapper/107:06:131
1450199484,39cyclictest0-21swapper/110:09:201
1450199484,27cyclictest0-21swapper/106:50:381
1450199483,39cyclictest0-21swapper/111:15:031
1450199483,38cyclictest0-21swapper/110:55:431
1449899483,28cyclictest0-21swapper/007:00:440
129952482,9sleep10-21swapper/107:42:121
1450199477,12cyclictest0-21swapper/108:05:501
1450199474,38cyclictest0-21swapper/111:25:281
1450199474,38cyclictest0-21swapper/111:25:281
1450199473,38cyclictest0-21swapper/111:37:371
1450199473,38cyclictest0-21swapper/108:35:321
14501994722,10cyclictest6670-21gltestperf09:25:361
1449899474,26cyclictest0-21swapper/007:05:470
83742462,37sleep10-21swapper/107:34:101
21022462,10sleep10-21swapper/108:26:371
14501994619,12cyclictest0-21swapper/109:15:331
14501994617,12cyclictest0-21swapper/108:10:351
1450199454,35cyclictest0-21swapper/108:19:391
1450199454,34cyclictest0-21swapper/110:15:381
142492454,35sleep00-21swapper/006:37:350
142492454,35sleep00-21swapper/006:37:350
14501994425,13cyclictest0-21swapper/110:31:351
177672433,33sleep10-21swapper/107:52:071
168292432,10sleep10-21swapper/106:44:571
1450199434,33cyclictest0-21swapper/107:00:481
14501994327,10cyclictest6062-21crond07:30:221
14501994319,11cyclictest0-21swapper/106:55:321
14501994125,10cyclictest13596-21aten_r1power_po07:45:321
1450199353,26cyclictest14664-21cat06:40:251
1450199353,26cyclictest14664-21cat06:40:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional