You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 13:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Fri Dec 12, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2136921350,36sleep021370-21cat20:55:400
2084499983,35cyclictest0-21swapper/020:43:100
2084499924,80cyclictest0-21swapper/019:30:410
2084499906,75cyclictest0-21swapper/023:10:370
2084499906,75cyclictest0-21swapper/023:10:370
20844998914,23cyclictest1901-21Xorg20:17:240
2084499883,32cyclictest7071-21unixbench_multi23:45:540
2084499875,13cyclictest0-21swapper/022:03:250
2084499874,28cyclictest0-21swapper/022:35:530
20844998727,53cyclictest0-21swapper/019:48:130
2084499854,34cyclictest0-21swapper/022:20:450
2084499854,27cyclictest0-21swapper/023:50:320
2084499854,27cyclictest0-21swapper/020:21:040
2084499854,27cyclictest0-21swapper/020:21:040
2084499853,9cyclictest30238-21munin-run23:30:190
2084499844,33cyclictest0-21swapper/022:25:510
2084499844,33cyclictest0-21swapper/022:25:510
2084499844,29cyclictest8326-21sed22:40:560
20844998431,45cyclictest4086-21wc21:25:510
20844998429,9cyclictest5501-21aten2.4-expect21:30:360
20844998413,12cyclictest0-21swapper/023:37:560
243799830,33rtkit-daemon0-21swapper/022:44:541
2084499835,33cyclictest0-21swapper/018:50:590
2084499835,26cyclictest0-21swapper/019:52:200
2084499834,34cyclictest0-21swapper/022:45:340
2084499834,26cyclictest0-21swapper/019:15:520
243799820,34rtkit-daemon0-21swapper/020:09:531
2084499825,27cyclictest0-21swapper/021:20:250
2084499825,27cyclictest0-21swapper/021:00:490
2084499824,32cyclictest0-21swapper/018:45:530
2084499824,31cyclictest0-21swapper/021:50:360
2084499824,16cyclictest0-21swapper/019:37:170
20844998226,13cyclictest26027-21wc22:10:540
20844998222,10cyclictest32093-21grep20:10:390
20844998221,16cyclictest1369-21runrttasks22:58:430
79272810,5chrt7928-21aten_r1power_en19:20:411
243799810,4rtkit-daemon2436-21rtkit-daemon18:50:562
2084499815,33cyclictest0-21swapper/023:58:380
2084499815,33cyclictest0-21swapper/023:58:380
2084499814,34cyclictest0-21swapper/021:05:400
2084499814,23cyclictest0-21swapper/019:10:420
20844998124,13cyclictest0-21swapper/022:05:540
2084499805,25cyclictest1369-21runrttasks19:42:390
2084499804,33cyclictest0-21swapper/023:40:300
2084499804,33cyclictest0-21swapper/020:25:470
2084499804,30cyclictest0-21swapper/019:20:470
2084499804,12cyclictest18664-21aten2.4-expect23:05:330
20844998024,12cyclictest0-21swapper/023:15:350
20844998023,10cyclictest28490-21sort18:55:430
20844998023,10cyclictest28490-21sort18:55:430
20844998017,7cyclictest13505-21latency_hist22:55:200
2084499795,13cyclictest0-21swapper/020:05:570
2084499794,24cyclictest0-21swapper/019:05:410
20844997930,9cyclictest17382-21tail21:55:340
2084499793,21cyclictest14904-21munin-node00:05:410
20844997924,11cyclictest1369-21runrttasks21:20:560
20844997922,14cyclictest0-21swapper/019:59:370
2084499785,24cyclictest1369-21runrttasks23:05:080
2084499784,29cyclictest18623-21head20:50:390
2084499783,31cyclictest0-21swapper/021:39:310
20844997823,12cyclictest0-21swapper/021:45:400
20844997823,12cyclictest0-21swapper/021:45:400
20844997812,9cyclictest114550irq/46-eth020:35:420
243799770,4rtkit-daemon2436-21rtkit-daemon23:10:233
243799770,4rtkit-daemon2436-21rtkit-daemon23:10:233
2084499774,32cyclictest0-21swapper/019:00:500
2084499774,30cyclictest0-21swapper/000:00:400
2084499774,24cyclictest21664-21cut18:40:480
20844997729,8cyclictest27417-21unixbench_singl23:20:530
20844997727,9cyclictest32136-21unixbench-2d23:30:550
243799760,11rtkit-daemon2436-21rtkit-daemon19:00:553
2084499764,22cyclictest0-21swapper/021:10:560
2084499764,22cyclictest0-21swapper/020:00:400
2084499754,24cyclictest0-21swapper/019:25:460
20844997422,12cyclictest0-21swapper/020:34:350
20845997313,54cyclictest0-21swapper/123:43:351
2084499734,15cyclictest10888-21cut21:40:410
20845996925,37cyclictest27882-21runrttasks18:54:061
20845996922,39cyclictest1189-21taskset20:11:371
20845996920,42cyclictest0-21swapper/123:35:181
20845996916,47cyclictest0-21swapper/122:57:501
20845996913,50cyclictest0-21swapper/122:50:201
2084599689,52cyclictest0-21swapper/100:05:441
20845996829,32cyclictest16440-21tr23:00:341
2084799674,55cyclictest0-21swapper/319:35:273
20845996625,34cyclictest8667-21hwlatdetect23:50:401
20845996623,34cyclictest22427-21cpu19:50:421
20845996617,42cyclictest0-21swapper/123:45:421
20845996617,42cyclictest0-21swapper/120:40:381
20845996611,47cyclictest0-21swapper/122:35:321
20845996522,37cyclictest12059-21munin-node19:26:041
20845996521,37cyclictest12697-21aten2.4-expect19:30:391
20845996520,27cyclictest1743-21munin-node20:15:591
2084799644,54cyclictest0-21swapper/323:41:383
2084599648,43cyclictest0-21swapper/123:59:431
2084599648,43cyclictest0-21swapper/123:59:431
20845996421,35cyclictest23449-21open_inodes22:05:501
20845996420,37cyclictest28228-21munin-node18:55:501
20845996420,37cyclictest28228-21munin-node18:55:501
20845996417,40cyclictest0-21swapper/123:35:391
20845996417,40cyclictest0-21swapper/121:30:391
20845996417,40cyclictest0-21swapper/120:05:261
20845996342,15cyclictest0-21swapper/121:10:391
20845996325,31cyclictest1369-21runrttasks21:23:551
20845996320,27cyclictest16563-21cat19:36:001
20845996313,43cyclictest0-21swapper/121:20:191
243799620,3rtkit-daemon0-21swapper/218:55:553
243799620,3rtkit-daemon0-21swapper/218:55:553
2084599627,49cyclictest0-21swapper/122:50:371
2084599627,48cyclictest0-21swapper/121:35:391
20845996246,11cyclictest1369-21runrttasks20:28:411
20845996227,28cyclictest13378-21gltestperf00:00:411
20845996221,25cyclictest21556-21sh20:55:421
20845996219,35cyclictest0-21swapper/121:55:231
20845996218,38cyclictest0-21swapper/118:40:421
20845996216,40cyclictest0-21swapper/121:07:311
20845996214,41cyclictest0-21swapper/120:39:331
20845996212,41cyclictest246031munin-node19:55:541
243799610,6rtkit-daemon0-21swapper/219:51:013
20845996118,16cyclictest0-21swapper/122:04:031
20845996117,36cyclictest0-21swapper/122:10:351
243799600,4rtkit-daemon0-21swapper/220:07:533
20845996025,28cyclictest1369-21runrttasks23:06:241
20845996017,36cyclictest0-21swapper/119:50:271
20845996017,26cyclictest20791-21cat20:55:251
20845996015,39cyclictest0-21swapper/122:26:361
20845996015,39cyclictest0-21swapper/122:26:361
20847995940,12cyclictest6349-21gltestperf19:15:473
20845995928,25cyclictest28951-21cut23:25:411
20845995926,26cyclictest25992-21tr23:20:341
20845995926,26cyclictest1369-21runrttasks19:14:401
20845995921,32cyclictest13875-21open_files21:45:531
20845995921,32cyclictest13875-21open_files21:45:531
20845995913,40cyclictest0-21swapper/119:16:011
20845995911,42cyclictest0-21swapper/119:01:001
20845995911,36cyclictest0-21swapper/123:17:531
2084799584,33cyclictest0-21swapper/323:35:183
2084599589,41cyclictest0-21swapper/122:20:431
20845995826,25cyclictest24235-21gltestperf21:00:451
20845995822,24cyclictest0-21swapper/118:45:301
20845995816,35cyclictest0-21swapper/119:42:141
20845995816,34cyclictest0-21swapper/120:30:391
20845995814,38cyclictest0-21swapper/122:15:321
243799570,7rtkit-daemon0-21swapper/218:46:113
2084799578,27cyclictest0-21swapper/320:35:423
2084799575,34cyclictest0-21swapper/321:30:353
20846995738,12cyclictest2256-21unixbench_multi23:35:542
20845995737,14cyclictest0-21swapper/123:13:341
20845995737,14cyclictest0-21swapper/123:13:341
20845995731,20cyclictest1447-21gltestperf19:05:481
20845995729,22cyclictest5203-21idleruntime20:20:491
20845995729,22cyclictest5203-21idleruntime20:20:491
2084599572,49cyclictest0-21swapper/121:25:421
20845995712,38cyclictest0-21swapper/121:42:521
243799560,6rtkit-daemon0-21swapper/219:21:173
2084699564,44cyclictest0-21swapper/222:25:432
2084699564,44cyclictest0-21swapper/222:25:432
20845995626,24cyclictest19094-21unixbench_singl21:55:571
20845995610,41cyclictest0-21swapper/122:30:371
243799550,6rtkit-daemon0-21swapper/218:51:033
2084799555,32cyclictest0-21swapper/320:50:553
2084799555,31cyclictest0-21swapper/323:00:513
2084799555,30cyclictest0-21swapper/322:20:363
2084799555,30cyclictest0-21swapper/300:05:373
2084799553,35cyclictest10331-21hostname19:25:403
20847995516,15cyclictest0-21swapper/322:00:413
2084699554,33cyclictest0-21swapper/219:01:002
2084799545,33cyclictest0-21swapper/321:47:383
2084799545,33cyclictest0-21swapper/321:47:383
2084799545,32cyclictest0-21swapper/320:25:273
2084799545,32cyclictest0-21swapper/320:25:273
2084799545,32cyclictest0-21swapper/318:45:303
2084799545,31cyclictest0-21swapper/319:57:213
2084799544,44cyclictest0-21swapper/323:35:233
2084799544,43cyclictest0-21swapper/319:06:003
20847995437,11cyclictest4361-21wc22:35:353
2084699544,29cyclictest0-21swapper/220:35:262
20846995436,11cyclictest870-21tr19:05:432
2084799535,40cyclictest0-21swapper/321:54:513
2084799535,32cyclictest0-21swapper/323:55:323
2084799535,32cyclictest0-21swapper/323:55:323
2084799534,13cyclictest0-21swapper/322:25:413
2084799534,13cyclictest0-21swapper/322:25:413
20847995334,13cyclictest3181-21aten_r1power_vo21:25:403
2084799533,13cyclictest0-21swapper/322:40:433
20847995328,18cyclictest0-21swapper/322:46:143
2084699534,41cyclictest0-21swapper/223:30:502
20846995335,11cyclictest25211-21unixbench_singl18:46:032
20846995334,11cyclictest7445-21grep20:25:462
20845995315,32cyclictest0-21swapper/120:48:061
2084499534,13cyclictest0-21swapper/020:45:500
243799520,32rtkit-daemon18076-21perl21:55:413
2084799525,40cyclictest0-21swapper/319:42:373
2084799525,31cyclictest0-21swapper/322:15:403
2084799525,31cyclictest0-21swapper/321:40:383
2084799525,29cyclictest0-21swapper/320:16:023
2084799524,30cyclictest0-21swapper/323:55:183
2084799524,28cyclictest0-21swapper/323:22:533
20846995234,11cyclictest14350-21unixbench_multi19:31:012
20846995224,12cyclictest0-21swapper/221:40:372
20845995220,25cyclictest0-21swapper/118:40:291
168732522,10sleep20-21swapper/200:08:052
2084799515,32cyclictest0-21swapper/320:12:543
2084799515,28cyclictest0-21swapper/323:47:573
2084799514,31cyclictest0-21swapper/320:55:473
2084799514,29cyclictest0-21swapper/323:17:533
2084799514,29cyclictest0-21swapper/322:50:413
2084799514,29cyclictest0-21swapper/321:00:373
2084799514,28cyclictest0-21swapper/323:05:523
2084799514,28cyclictest0-21swapper/321:15:523
20847995134,11cyclictest2042-21cpuspeed_turbos22:30:393
2084799513,32cyclictest0-21swapper/320:01:583
2084699515,28cyclictest0-21swapper/218:55:442
2084699515,28cyclictest0-21swapper/218:55:442
2084699514,29cyclictest0-21swapper/221:45:382
2084699514,29cyclictest0-21swapper/221:45:382
2084699514,29cyclictest0-21swapper/219:20:532
2084699514,28cyclictest0-21swapper/223:45:322
2084699514,28cyclictest0-21swapper/220:00:392
2084699514,12cyclictest0-21swapper/221:30:522
20846995133,11cyclictest10474-21grep23:55:352
20846995133,11cyclictest10474-21grep23:55:352
2084699513,26cyclictest0-21swapper/222:44:362
20846995121,13cyclictest0-21swapper/220:05:452
20846995120,13cyclictest0-21swapper/220:40:522
20846995119,14cyclictest0-21swapper/223:50:342
243799500,4rtkit-daemon2436-21rtkit-daemon19:35:313
243799500,4rtkit-daemon2436-21rtkit-daemon19:10:473
2084799505,38cyclictest0-21swapper/320:40:563
2084799505,29cyclictest0-21swapper/322:55:393
2084799504,28cyclictest0-21swapper/323:25:573
2084799504,28cyclictest0-21swapper/321:40:233
2084799504,28cyclictest0-21swapper/320:30:413
2084799504,27cyclictest0-21swapper/322:10:543
2084799504,27cyclictest0-21swapper/320:26:013
2084799504,27cyclictest0-21swapper/319:46:243
20847995015,18cyclictest0-21swapper/320:45:483
2084699504,29cyclictest0-21swapper/220:35:532
2084699504,28cyclictest0-21swapper/223:20:502
2084699504,28cyclictest0-21swapper/222:55:362
2084699504,28cyclictest0-21swapper/222:45:412
2084699504,28cyclictest0-21swapper/222:25:212
2084699504,28cyclictest0-21swapper/222:15:502
2084699504,28cyclictest0-21swapper/222:10:462
2084699504,28cyclictest0-21swapper/222:00:562
2084699504,28cyclictest0-21swapper/221:35:592
2084699504,28cyclictest0-21swapper/221:25:572
2084699504,28cyclictest0-21swapper/221:15:482
2084699504,28cyclictest0-21swapper/219:15:432
2084699504,28cyclictest0-21swapper/219:10:472
2084699504,27cyclictest0-21swapper/222:55:202
2084699504,12cyclictest0-21swapper/221:22:342
20846995034,10cyclictest18847-21tr23:05:342
20846995031,12cyclictest29853-21unixbench_multi21:11:002
2084699503,29cyclictest0-21swapper/222:35:372
20846995022,12cyclictest0-21swapper/220:55:502
183732503,40sleep20-21swapper/219:40:502
2084799494,28cyclictest0-21swapper/321:10:533
2084799494,28cyclictest0-21swapper/300:00:493
2084799494,27cyclictest0-21swapper/321:20:503
2084799494,25cyclictest24290-21sh22:10:213
20847994917,16cyclictest0-21swapper/321:05:463
2084699495,27cyclictest0-21swapper/219:25:402
2084699494,28cyclictest0-21swapper/223:15:412
2084699494,28cyclictest0-21swapper/221:50:512
2084699494,28cyclictest0-21swapper/220:20:452
2084699494,28cyclictest0-21swapper/220:20:452
2084699494,28cyclictest0-21swapper/219:35:572
2084699494,27cyclictest0-21swapper/223:25:572
2084699494,27cyclictest0-21swapper/221:56:002
2084699494,27cyclictest0-21swapper/220:45:492
20846994930,11cyclictest26562-21grep21:05:412
20846994917,13cyclictest0-21swapper/220:15:542
2084699484,28cyclictest0-21swapper/220:50:562
2084699484,27cyclictest0-21swapper/223:10:422
2084699484,27cyclictest0-21swapper/223:10:422
2084699484,27cyclictest0-21swapper/219:45:552
2084699484,26cyclictest0-21swapper/222:05:332
2084499484,26cyclictest0-21swapper/022:35:220
2084699474,26cyclictest0-21swapper/200:00:492
20846994718,12cyclictest0-21swapper/222:30:572
204972474,6sleep00-21swapper/018:36:280
2084699464,26cyclictest0-21swapper/218:40:412
2084699464,25cyclictest0-21swapper/223:42:072
20844994617,12cyclictest0-21swapper/022:15:410
243799450,5rtkit-daemon2436-21rtkit-daemon18:35:493
2084699454,26cyclictest0-21swapper/223:00:372
246402443,34sleep20-21swapper/221:00:552
2084699444,12cyclictest0-21swapper/219:51:002
20846994422,15cyclictest0-21swapper/219:55:412
2084699424,22cyclictest0-21swapper/220:10:382
2084699404,17cyclictest0-21swapper/218:40:302
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional