You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-27 - 20:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sat Dec 27, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1075499994,87cyclictest0-21swapper/012:16:390
1075499933,83cyclictest58142sleep012:21:410
1075499933,83cyclictest58142sleep012:21:410
1075499896,76cyclictest26170-21awk10:51:230
1075499893,80cyclictest0-21swapper/011:36:340
1075499893,79cyclictest20375-21munin-node10:36:490
1075499885,76cyclictest7484-21aten_r1power_vo07:56:440
1075499883,79cyclictest0-21swapper/009:11:430
1075499883,77cyclictest22874-21tail08:26:530
1075499883,77cyclictest0-21swapper/011:41:450
248599860,5rtkit-daemon2484-21rtkit-daemon10:01:482
1075499863,77cyclictest0-21swapper/010:01:580
1075499844,73cyclictest0-21swapper/012:15:120
1075499844,63cyclictest0-21swapper/010:41:360
1075999834,71cyclictest0-21swapper/307:26:313
1075999834,71cyclictest0-21swapper/307:26:313
1075999824,70cyclictest0-21swapper/307:11:493
1075999814,59cyclictest0-21swapper/310:36:473
1075499814,71cyclictest0-21swapper/007:16:430
1075499814,70cyclictest0-21swapper/009:42:210
1075499813,73cyclictest0-21swapper/007:16:320
1075499813,72cyclictest0-21swapper/008:06:410
1075499813,72cyclictest0-21swapper/008:06:410
1075499813,72cyclictest0-21swapper/007:21:560
1075499813,72cyclictest0-21swapper/007:21:560
1075999803,70cyclictest18015-21sh11:41:323
1075999803,68cyclictest21674-21munin-node08:27:023
1075499804,69cyclictest0-21swapper/008:21:440
1075499804,69cyclictest0-21swapper/007:47:590
1075499803,71cyclictest0-21swapper/007:09:410
1075499803,69cyclictest30165-21aten_r1power_vo09:51:400
1075499803,62cyclictest9683-21telnet10:16:360
1075499803,62cyclictest9683-21telnet10:16:360
1075999794,39cyclictest22883-21aten_r1power_en09:36:373
1075999793,69cyclictest22698-21latency10:41:483
1075999793,58cyclictest16905-21munin-node08:17:043
10754997933,38cyclictest17696-21tune2fs08:16:490
1075499793,71cyclictest0-21swapper/011:31:360
1075499793,70cyclictest1419-21runrttasks08:44:030
1075499793,70cyclictest0-21swapper/011:16:110
1075499793,70cyclictest0-21swapper/010:21:560
1075499793,70cyclictest0-21swapper/010:00:340
1075499793,70cyclictest0-21swapper/009:01:400
1075499793,69cyclictest251591munin-node11:56:500
248599780,4rtkit-daemon2484-21rtkit-daemon09:48:483
248599780,4rtkit-daemon2484-21rtkit-daemon09:27:272
1075999784,66cyclictest0-21swapper/309:31:453
1075999784,66cyclictest0-21swapper/309:31:453
1075999783,68cyclictest4991-21munin-node11:11:533
1075999783,67cyclictest14509-21munin-node08:11:593
1075499784,67cyclictest0-21swapper/009:34:470
1075499784,67cyclictest0-21swapper/009:34:470
1075499784,67cyclictest0-21swapper/007:41:480
1075499784,67cyclictest0-21swapper/006:57:010
1075499783,69cyclictest26446-21munin-node08:36:480
1075499783,69cyclictest0-21swapper/011:02:480
1075499783,69cyclictest0-21swapper/010:31:350
1075499783,68cyclictest15933-21find08:11:580
1075499783,67cyclictest0-21swapper/012:01:490
1075499783,61cyclictest10813-21munin-node11:26:520
248599770,5rtkit-daemon2484-21rtkit-daemon08:58:433
248599770,4rtkit-daemon2484-21rtkit-daemon07:58:083
1075999774,65cyclictest3681-21ntp_offset12:16:453
1075999774,65cyclictest0-21swapper/307:31:523
1075999774,53cyclictest0-21swapper/308:01:533
1075999773,58cyclictest11387-21diskstats11:26:373
1075999773,57cyclictest14313-21idleruntime07:01:553
1075999773,56cyclictest6396-21sensors_temp07:52:013
1075499774,66cyclictest0-21swapper/009:27:000
1075499774,66cyclictest0-21swapper/008:36:280
1075499774,66cyclictest0-21swapper/007:27:030
1075499773,69cyclictest0-21swapper/008:01:420
1075499773,68cyclictest0-21swapper/011:26:210
1075499773,68cyclictest0-21swapper/008:56:570
1075499773,68cyclictest0-21swapper/007:01:460
1075499773,67cyclictest28312-21fschecks_count07:31:500
1075499773,67cyclictest13650-21cpuspeed_turbos09:16:410
1075499773,49cyclictest15856-21sendmail_mailqu10:26:530
248599760,4rtkit-daemon2484-21rtkit-daemon10:12:103
248599760,4rtkit-daemon2484-21rtkit-daemon09:02:133
1075999764,65cyclictest15606-21yum-updatesd-he11:36:333
1075999764,65cyclictest0-21swapper/310:21:523
1075999764,65cyclictest0-21swapper/306:56:333
1075999764,64cyclictest0-21swapper/310:31:253
1075999764,55cyclictest0-21swapper/309:56:573
1075999763,63cyclictest26671-21cpuspeed_turbos10:51:363
1075499764,64cyclictest0-21swapper/011:16:390
1075499763,66cyclictest0-21swapper/012:08:280
1075499763,65cyclictest0-21swapper/007:36:490
1075499763,60cyclictest0-21swapper/009:21:430
1075499763,59cyclictest0-21swapper/009:48:300
1075499763,56cyclictest0-21swapper/007:51:440
1075499763,52cyclictest0-21swapper/010:51:390
1075499763,47cyclictest0-21swapper/009:39:480
248599750,4rtkit-daemon2484-21rtkit-daemon11:54:063
248599750,4rtkit-daemon2484-21rtkit-daemon10:47:543
248599750,4rtkit-daemon2484-21rtkit-daemon10:19:253
248599750,4rtkit-daemon2484-21rtkit-daemon10:19:253
248599750,4rtkit-daemon2484-21rtkit-daemon08:38:293
1075999754,63cyclictest0-21swapper/311:16:393
1075999754,63cyclictest0-21swapper/307:06:453
1075999753,65cyclictest17412-21munin-node10:31:413
1075999753,64cyclictest22268-21sed07:17:053
1075999753,57cyclictest29695-21crond12:06:193
1075999753,47cyclictest2075-21gltestperf08:51:473
1075999753,46cyclictest1287-21snmpd08:41:473
1075499753,65cyclictest24033-21ntp_kernel_err11:51:480
1075499753,65cyclictest1419-21runrttasks10:59:420
1075499753,65cyclictest1419-21runrttasks10:59:420
1075499753,60cyclictest0-21swapper/011:49:490
10754997519,41cyclictest0-21swapper/008:56:280
1075999744,63cyclictest0-21swapper/311:21:423
1075999744,63cyclictest0-21swapper/309:29:463
1075999744,63cyclictest0-21swapper/307:36:483
1075999743,65cyclictest0-21swapper/310:56:373
1075999743,65cyclictest0-21swapper/310:56:373
1075499743,65cyclictest0-21swapper/010:11:460
1075499743,59cyclictest0-21swapper/010:07:020
1075999734,62cyclictest0-21swapper/312:01:203
1075999734,62cyclictest0-21swapper/310:06:543
10759997334,32cyclictest3696-21head10:01:513
1075999733,63cyclictest15116-21sshd09:17:203
1075499734,60cyclictest0-21swapper/006:56:330
1075499733,63cyclictest0-21swapper/011:06:550
1075499733,53cyclictest0-21swapper/009:06:400
1075999724,53cyclictest0-21swapper/309:11:383
1075999723,62cyclictest1287-21snmpd06:57:513
1075999723,55cyclictest1335-21open_inodes07:41:583
1075999723,52cyclictest0-21swapper/308:31:403
1075999722,64cyclictest0-21swapper/309:24:353
1075999714,60cyclictest0-21swapper/309:54:503
1075999714,59cyclictest0-21swapper/311:01:503
1075999713,61cyclictest20423-21missed_timers08:21:523
1075999713,61cyclictest13225-21aten2.4-expect11:31:363
1075499713,62cyclictest0-21swapper/008:46:400
1075999703,49cyclictest2550-21munin-node07:46:443
1075999703,36cyclictest32342-21memory08:46:523
10759997016,31cyclictest32312-21munin-node12:11:403
1075999694,58cyclictest1419-21runrttasks08:10:303
1075999694,58cyclictest1419-21runrttasks08:10:303
1075999693,59cyclictest25617-21cpuspeed_turbos07:26:453
10759996928,34cyclictest31505-21ls12:06:553
1075999683,58cyclictest0-21swapper/309:43:183
248599670,4rtkit-daemon2484-21rtkit-daemon09:48:412
1075999673,57cyclictest1133-21aten_r1power_cu11:06:353
1075999664,54cyclictest0-21swapper/312:21:433
1075999664,54cyclictest0-21swapper/312:21:433
205652653,12sleep20-21swapper/208:21:552
1075999654,56cyclictest0-21swapper/309:09:003
1075999653,45cyclictest0-21swapper/311:46:423
164382623,50sleep10-21swapper/111:36:411
10758995821,15cyclictest0-21swapper/207:37:012
169892573,46sleep20-21swapper/210:31:372
114712573,45sleep10-21swapper/109:11:441
1075899574,36cyclictest0-21swapper/210:36:352
10758995738,12cyclictest10268-21unixbench_singl09:07:012
10758995738,11cyclictest11328-21grep06:56:462
1075899563,36cyclictest0-21swapper/210:41:352
248599550,4rtkit-daemon2484-21rtkit-daemon09:24:422
10758995535,13cyclictest0-21swapper/208:56:282
10758995513,22cyclictest0-21swapper/207:21:432
10758995513,22cyclictest0-21swapper/207:21:432
91692542,10sleep10-21swapper/107:57:191
57832542,10sleep20-21swapper/209:00:162
311192543,44sleep131197-21memory07:36:561
273562542,11sleep10-21swapper/107:30:271
248599540,7rtkit-daemon2484-21rtkit-daemon12:21:502
248599540,7rtkit-daemon2484-21rtkit-daemon12:21:502
248599540,5rtkit-daemon2484-21rtkit-daemon11:40:592
248599540,5rtkit-daemon2484-21rtkit-daemon10:26:022
134182543,13sleep20-21swapper/211:31:392
10758995435,12cyclictest7682-21grep07:56:452
248599530,5rtkit-daemon2484-21rtkit-daemon11:53:062
248599530,5rtkit-daemon2484-21rtkit-daemon08:02:082
248599530,4rtkit-daemon2484-21rtkit-daemon12:03:432
248599530,4rtkit-daemon2484-21rtkit-daemon11:03:082
248599530,4rtkit-daemon2484-21rtkit-daemon10:20:402
248599530,4rtkit-daemon2484-21rtkit-daemon10:20:402
10758995336,10cyclictest20708-21grep11:46:352
10758995333,12cyclictest27013-21grep07:27:042
1075799534,26cyclictest0-21swapper/108:56:401
10757995336,10cyclictest721-21gltestperf12:11:381
45672523,42sleep14656-21interrupts11:11:471
303742523,13sleep20-21swapper/210:56:572
303742523,13sleep20-21swapper/210:56:572
248599520,4rtkit-daemon2484-21rtkit-daemon10:53:382
248599520,4rtkit-daemon2484-21rtkit-daemon10:49:092
248599520,4rtkit-daemon2484-21rtkit-daemon10:27:092
248599520,4rtkit-daemon2484-21rtkit-daemon09:42:112
248599520,4rtkit-daemon2484-21rtkit-daemon09:34:042
248599520,4rtkit-daemon2484-21rtkit-daemon09:34:042
248599520,4rtkit-daemon2484-21rtkit-daemon07:32:542
166462522,9sleep10-21swapper/108:16:181
1075799525,29cyclictest0-21swapper/109:36:551
1075799524,26cyclictest28484-21munin-node12:01:421
10757995232,13cyclictest0-21swapper/108:36:411
10757995231,14cyclictest0-21swapper/111:21:561
42482512,10sleep20-21swapper/212:17:172
318642512,41sleep10-21swapper/109:52:391
273052512,43sleep127344-21cat12:01:201
248599510,4rtkit-daemon2484-21rtkit-daemon09:57:182
248599510,4rtkit-daemon2484-21rtkit-daemon08:37:292
150582512,41sleep10-21swapper/111:32:381
121192512,9sleep10-21swapper/108:06:381
121192512,9sleep10-21swapper/108:06:381
118092513,42sleep111834-21wc10:21:251
118092513,42sleep111834-21wc10:21:251
1075899515,27cyclictest0-21swapper/211:21:472
1075899514,40cyclictest0-21swapper/208:26:422
10758995120,13cyclictest0-21swapper/209:51:442
1075799515,28cyclictest0-21swapper/110:56:481
1075799515,28cyclictest0-21swapper/110:56:481
1075799514,30cyclictest0-21swapper/109:41:531
1075799514,29cyclictest0-21swapper/111:06:551
10757995129,15cyclictest0-21swapper/109:46:591
10757995120,24cyclictest19379-21tail08:21:391
92042502,41sleep10-21swapper/110:13:431
248599500,4rtkit-daemon2484-21rtkit-daemon06:51:551
211682502,41sleep10-21swapper/111:46:411
176242502,9sleep20-21swapper/207:07:552
159402503,40sleep215962-21python08:12:002
1075899505,28cyclictest0-21swapper/211:11:402
1075899504,40cyclictest0-21swapper/211:28:442
1075899504,40cyclictest0-21swapper/208:41:562
1075899504,28cyclictest25608-21timerandwakeup08:32:002
1075899504,28cyclictest0-21swapper/207:11:512
1075899504,27cyclictest0-21swapper/211:46:222
10758995032,11cyclictest31645-21unixbench_multi12:06:562
10758995020,12cyclictest0-21swapper/207:41:462
1075799505,27cyclictest0-21swapper/110:26:551
1075799504,28cyclictest0-21swapper/112:06:471
1075799504,28cyclictest0-21swapper/109:26:581
10757995032,12cyclictest0-21swapper/107:21:511
10757995032,12cyclictest0-21swapper/107:21:511
10757995029,13cyclictest0-21swapper/110:31:351
10757995019,13cyclictest0-21swapper/110:36:481
10757995012,20cyclictest0-21swapper/110:51:341
104262502,10sleep10-21swapper/109:08:341
43922492,10sleep10-21swapper/110:03:111
199662492,40sleep10-21swapper/107:12:211
1075899494,27cyclictest0-21swapper/209:01:542
1075899494,27cyclictest0-21swapper/208:46:522
1075899494,27cyclictest0-21swapper/208:16:572
1075899494,27cyclictest0-21swapper/207:51:512
1075899494,26cyclictest0-21swapper/210:14:542
10758994918,11cyclictest22832-21yum-updatesd-he09:36:512
1075799494,28cyclictest0-21swapper/111:16:451
1075799494,27cyclictest0-21swapper/111:41:501
10757994920,12cyclictest0-21swapper/107:02:021
69602482,11sleep10-21swapper/110:10:321
44282482,41sleep10-21swapper/112:19:381
272372482,9sleep20-21swapper/212:00:282
175212482,39sleep10-21swapper/109:22:321
1075899484,27cyclictest0-21swapper/208:11:112
1075899484,27cyclictest0-21swapper/208:11:112
1075899484,26cyclictest0-21swapper/212:11:412
1075899484,26cyclictest0-21swapper/211:06:552
1075799484,36cyclictest0-21swapper/107:46:301
1075799484,25cyclictest24934-21munin-run11:56:211
10757994818,12cyclictest0-21swapper/110:21:471
18502472,10sleep10-21swapper/109:57:431
1075899474,27cyclictest0-21swapper/209:18:452
1075899474,26cyclictest0-21swapper/207:46:482
1075899474,26cyclictest0-21swapper/207:01:582
1075899473,27cyclictest0-21swapper/207:16:452
10758994718,12cyclictest0-21swapper/209:13:452
1075799476,34cyclictest0-21swapper/108:46:521
1075799475,25cyclictest0-21swapper/108:29:361
1075799474,26cyclictest0-21swapper/112:21:431
1075799474,26cyclictest0-21swapper/112:21:431
1075799474,26cyclictest0-21swapper/111:01:401
1075799474,26cyclictest0-21swapper/110:46:231
1075799474,26cyclictest0-21swapper/107:31:521
1075799474,26cyclictest0-21swapper/107:16:431
10757994719,12cyclictest0-21swapper/109:01:551
10757994717,13cyclictest0-21swapper/111:31:221
259122462,39sleep10-21swapper/110:48:171
1075899464,25cyclictest0-21swapper/211:16:512
10758994617,13cyclictest0-21swapper/210:10:442
1075799465,33cyclictest0-21swapper/108:01:561
1075799464,26cyclictest0-21swapper/108:51:581
1075799463,26cyclictest0-21swapper/108:32:001
10757994625,14cyclictest0-21swapper/109:16:441
177722452,10sleep10-21swapper/107:09:511
1075799455,33cyclictest0-21swapper/107:46:541
1075799455,13cyclictest0-21swapper/106:57:091
1075799444,22cyclictest0-21swapper/108:41:421
224902432,35sleep10-21swapper/109:35:101
224902432,35sleep10-21swapper/109:35:101
1075799434,33cyclictest0-21swapper/108:19:261
1075799424,31cyclictest0-21swapper/107:51:431
10758993719,12cyclictest0-21swapper/206:56:332
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional