You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-24 - 01:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Wed Sep 23, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28849999711,21cyclictest0-21swapper/307:35:003
219499960,6rtkit-daemon0-21swapper/005:23:380
219499900,6rtkit-daemon0-21swapper/005:24:380
2884999874,10cyclictest14168-21munin-node09:34:583
28849998731,48cyclictest1227-21runrttasks08:19:473
2884999864,28cyclictest0-21swapper/310:37:203
2884999864,28cyclictest0-21swapper/310:09:223
2884999854,73cyclictest0-21swapper/308:10:413
2884999854,36cyclictest0-21swapper/308:49:253
28849998530,49cyclictest9171-21switchtime09:24:573
28849998530,48cyclictest28744-21fschecks_time10:44:383
2884999853,27cyclictest21511-21python08:54:563
28849998525,10cyclictest31896-21grep06:30:023
28849998521,14cyclictest0-21swapper/306:39:563
28849998514,12cyclictest0-21swapper/305:39:323
2884999844,33cyclictest0-21swapper/305:44:563
2884999844,15cyclictest0-21swapper/310:02:063
2884999843,74cyclictest13575-21taskset10:20:373
28849998429,48cyclictest29019-21needreboot06:24:563
28849998429,47cyclictest24480-21df_abs09:49:383
28849998426,10cyclictest4688-21cut09:19:423
2884999834,25cyclictest0-21swapper/307:04:443
2884999834,13cyclictest0-21swapper/307:26:413
2884999834,12cyclictest0-21swapper/307:47:103
2884999833,30cyclictest0-21swapper/308:14:373
28849998310,9cyclictest107550irq/46-eth010:24:463
2884999824,30cyclictest0-21swapper/306:13:193
2884999824,27cyclictest0-21swapper/310:29:423
2884999824,12cyclictest0-21swapper/309:01:403
28849998238,38cyclictest1679-21switchtime08:24:573
2884999823,34cyclictest0-21swapper/309:18:043
2884999823,34cyclictest0-21swapper/309:18:043
2884999823,29cyclictest27660-21cpuspeed_turbos09:54:363
2884999823,29cyclictest27660-21cpuspeed_turbos09:54:363
2884999823,23cyclictest0-21swapper/308:33:133
28849998229,9cyclictest8605-21cpuspeed_turbos10:14:343
2884999814,26cyclictest0-21swapper/305:24:343
2884999814,21cyclictest0-21swapper/309:47:343
2884999814,16cyclictest0-21swapper/307:52:413
2884999814,12cyclictest0-21swapper/308:41:373
2884999813,26cyclictest0-21swapper/306:44:553
2884999813,24cyclictest0-21swapper/310:13:343
2884999813,21cyclictest4029-21kworker/3:006:19:443
2884999807,12cyclictest0-21swapper/308:07:423
2884999804,34cyclictest0-21swapper/307:59:433
2884999804,26cyclictest0-21swapper/306:00:183
2884999804,22cyclictest0-21swapper/308:53:443
2884999804,12cyclictest0-21swapper/310:41:563
2884999804,12cyclictest0-21swapper/310:41:563
2884999803,13cyclictest0-21swapper/307:23:473
28849998024,10cyclictest1377-21needreboot06:34:553
28849998024,10cyclictest1377-21needreboot06:34:553
28849998010,11cyclictest11241-21cpuspeed_turbos09:29:373
2884999794,29cyclictest0-21swapper/308:34:493
2884999794,29cyclictest0-21swapper/308:34:493
2884999794,21cyclictest0-21swapper/309:42:413
2884999794,21cyclictest0-21swapper/309:11:063
2884999794,11cyclictest0-21swapper/309:07:423
2884999793,27cyclictest0-21swapper/307:54:463
2884999793,27cyclictest0-21swapper/307:54:463
2884999784,67cyclictest0-21swapper/306:54:473
2884999784,23cyclictest0-21swapper/305:49:433
2884999784,23cyclictest0-21swapper/305:49:433
2884999783,26cyclictest0-21swapper/307:11:163
28849997828,8cyclictest30054-21timerandwakeup07:30:013
28849997823,8cyclictest20552-21latency_hist06:09:323
28849997821,12cyclictest7854-21cstates06:49:443
2884999774,22cyclictest0-21swapper/307:40:303
2884999773,21cyclictest7178-21head05:39:533
28849997729,42cyclictest2372-21gltestperf05:29:523
28849997725,11cyclictest19446-21tail07:14:413
2884999754,28cyclictest0-21swapper/305:59:323
2884999753,23cyclictest0-21swapper/306:14:583
28849997524,9cyclictest1246-21latency_hist05:29:333
308122740,8sleep00-21swapper/006:29:470
2884999744,31cyclictest0-21swapper/306:59:513
162072730,3sleep20-21swapper/207:05:042
28841997218,47cyclictest21684-21http_loadtime09:44:440
219499700,6rtkit-daemon0-21swapper/005:24:531
219499700,6rtkit-daemon0-21swapper/005:22:461
2884199695,16cyclictest0-21swapper/009:14:490
2884199695,16cyclictest0-21swapper/009:14:490
28841996925,37cyclictest9802-21cpuspeed_turbos07:49:410
2884899654,54cyclictest0-21swapper/209:24:572
2884899654,53cyclictest21542-21ls08:54:562
28848996527,31cyclictest1227-21runrttasks07:42:312
2884199654,30cyclictest0-21swapper/009:29:550
2884899645,52cyclictest0-21swapper/208:29:382
2884899645,52cyclictest0-21swapper/207:29:402
28846996444,13cyclictest0-21swapper/107:35:021
2884899635,52cyclictest0-21swapper/208:04:492
2884899635,48cyclictest751-21ssh10:02:402
2884899634,53cyclictest0-21swapper/209:02:402
2884899634,51cyclictest0-21swapper/208:34:442
2884899634,51cyclictest0-21swapper/208:34:442
2884899634,51cyclictest0-21swapper/205:59:422
2884199634,29cyclictest0-21swapper/010:04:560
2884899625,51cyclictest0-21swapper/206:34:442
2884899625,51cyclictest0-21swapper/206:34:442
2884899625,50cyclictest0-21swapper/206:24:502
2884899625,38cyclictest0-21swapper/208:03:052
2884899624,52cyclictest0-21swapper/208:49:412
28848996224,13cyclictest0-21swapper/210:24:442
28846996241,13cyclictest0-21swapper/107:49:511
2884199624,14cyclictest0-21swapper/008:39:470
28841996222,21cyclictest25680-21ls08:14:260
199932624,50sleep00-21swapper/010:30:020
2884899615,50cyclictest0-21swapper/209:46:382
2884899615,30cyclictest0-21swapper/209:29:422
2884899614,28cyclictest0-21swapper/206:44:462
2884899613,39cyclictest0-21swapper/209:54:352
2884899613,39cyclictest0-21swapper/209:54:352
28848996116,24cyclictest0-21swapper/207:45:012
2884199615,13cyclictest0-21swapper/007:39:460
2884199614,14cyclictest0-21swapper/005:54:440
2884899606,46cyclictest0-21swapper/210:36:512
2884899605,48cyclictest0-21swapper/210:19:532
2884899604,50cyclictest0-21swapper/210:14:442
28848996017,29cyclictest0-21swapper/207:35:372
2884199604,37cyclictest0-21swapper/010:21:430
2884199604,26cyclictest0-21swapper/008:24:500
2884199604,13cyclictest0-21swapper/009:54:330
2884199604,13cyclictest0-21swapper/009:54:330
2884199603,41cyclictest8506-21ssh07:46:500
2884899596,28cyclictest0-21swapper/210:04:412
2884899595,45cyclictest14246-21python07:54:572
2884899595,45cyclictest14246-21python07:54:572
2884899594,47cyclictest6676-21grep10:09:572
28848995923,29cyclictest10372-21head07:49:472
2884199594,38cyclictest0-21swapper/007:26:360
2884199594,14cyclictest0-21swapper/007:02:420
2884199594,12cyclictest5874-21ls09:20:000
2884899585,27cyclictest0-21swapper/208:24:482
2884899584,30cyclictest0-21swapper/210:44:372
28848995834,11cyclictest0-21swapper/208:15:522
2884699583,30cyclictest0-21swapper/108:22:061
28846995829,12cyclictest0-21swapper/107:24:321
2884199584,14cyclictest0-21swapper/008:19:580
2884199584,13cyclictest0-21swapper/009:29:240
2884199584,13cyclictest0-21swapper/009:03:120
2884199584,13cyclictest0-21swapper/008:17:380
2884199584,13cyclictest0-21swapper/007:54:370
2884199584,13cyclictest0-21swapper/007:54:370
2884199583,36cyclictest0-21swapper/008:49:370
28841995815,18cyclictest31016-21systemd-cgroups10:49:200
2884899575,46cyclictest0-21swapper/209:54:202
2884899574,47cyclictest0-21swapper/208:24:072
2884899573,38cyclictest32364-21munin-run06:34:302
2884899572,49cyclictest0-21swapper/207:21:572
2884199574,34cyclictest0-21swapper/009:11:570
28841995737,14cyclictest0-21swapper/007:35:020
2884899565,46cyclictest0-21swapper/209:23:582
28848995639,10cyclictest26853-21grep07:25:032
28848995637,13cyclictest0-21swapper/209:34:542
28846995638,11cyclictest7078-21grep07:44:481
28846995628,13cyclictest0-21swapper/108:27:401
2884199566,23cyclictest0-21swapper/007:09:470
28841995639,11cyclictest5446-21grep06:44:440
28841995638,11cyclictest8673-21grep06:49:550
2884199563,44cyclictest0-21swapper/009:34:550
2884199563,38cyclictest0-21swapper/008:31:570
22912560,5sleep22374-21grep05:29:522
130682563,10sleep00-21swapper/005:52:190
130682563,10sleep00-21swapper/005:52:190
57802553,10sleep00-21swapper/005:35:340
2884899555,44cyclictest0-21swapper/208:48:452
2884899555,40cyclictest18971-21python09:39:562
2884699554,43cyclictest0-21swapper/109:14:531
2884699554,43cyclictest0-21swapper/109:14:531
28846995528,12cyclictest0-21swapper/109:14:061
2884199554,44cyclictest0-21swapper/008:35:000
2884199554,44cyclictest0-21swapper/008:35:000
2884199554,28cyclictest0-21swapper/006:56:110
28841995525,12cyclictest0-21swapper/010:09:530
28841995521,11cyclictest0-21swapper/010:24:510
247642553,46sleep00-21swapper/010:39:380
247642553,46sleep00-21swapper/010:39:380
127922550,13chrt2884899cyclictest08:43:002
2884899545,28cyclictest0-21swapper/210:34:212
2884699545,29cyclictest0-21swapper/109:47:311
2884699544,43cyclictest0-21swapper/109:27:371
2884699543,44cyclictest0-21swapper/108:54:251
28846995421,19cyclictest0-21swapper/110:26:441
2884199545,29cyclictest0-21swapper/007:33:190
2884199545,28cyclictest0-21swapper/008:59:250
28841995423,13cyclictest0-21swapper/009:59:500
28841995422,12cyclictest0-21swapper/008:05:220
28841995421,14cyclictest0-21swapper/006:04:580
28841995420,12cyclictest0-21swapper/009:49:400
28841995417,14cyclictest0-21swapper/008:00:060
238612543,10sleep00-21swapper/010:37:160
135612543,7sleep113665-21http_loadtime07:54:461
135612543,7sleep113665-21http_loadtime07:54:461
53772532,44sleep10-21swapper/105:35:031
2884899535,41cyclictest0-21swapper/209:14:562
2884899535,41cyclictest0-21swapper/209:14:562
2884899535,30cyclictest0-21swapper/210:40:282
2884899535,30cyclictest0-21swapper/210:40:282
2884899535,28cyclictest0-21swapper/209:09:592
2884899534,42cyclictest0-21swapper/209:04:372
28848995333,12cyclictest20026-21grep06:05:052
28848995320,14cyclictest0-21swapper/208:09:582
2884699534,43cyclictest0-21swapper/109:29:391
2884699534,40cyclictest0-21swapper/108:29:411
2884199534,30cyclictest0-21swapper/006:09:520
2884199534,29cyclictest0-21swapper/010:19:210
2884199534,29cyclictest0-21swapper/009:39:500
2884199534,29cyclictest0-21swapper/006:34:570
2884199534,29cyclictest0-21swapper/006:34:570
2884199533,43cyclictest0-21swapper/009:07:200
28841995320,13cyclictest0-21swapper/007:23:380
28841995317,13cyclictest0-21swapper/008:44:520
28841995317,12cyclictest0-21swapper/006:19:500
10592533,42sleep20-21swapper/205:28:142
2884899525,29cyclictest0-21swapper/207:09:512
2884899525,29cyclictest0-21swapper/207:03:302
2884899525,28cyclictest0-21swapper/205:40:052
2884899525,27cyclictest0-21swapper/205:38:162
2884899524,31cyclictest0-21swapper/206:39:482
2884899524,28cyclictest0-21swapper/206:54:492
2884899524,28cyclictest0-21swapper/206:19:442
28848995225,7cyclictest22810-21latency_hist06:14:312
2884699524,41cyclictest0-21swapper/110:39:481
2884699524,41cyclictest0-21swapper/110:39:481
2884699524,28cyclictest0-21swapper/110:35:571
2884699524,19cyclictest0-21swapper/106:34:311
28846995237,10cyclictest0-21swapper/105:54:491
28846995234,12cyclictest0-21swapper/108:55:131
28846995233,11cyclictest22126-21cpuspeed_turbos07:19:431
28846995232,14cyclictest0-21swapper/108:44:121
28846995232,12cyclictest0-21swapper/108:00:211
28846995231,10cyclictest0-21swapper/107:44:041
2884199525,28cyclictest0-21swapper/005:59:510
2884199524,29cyclictest0-21swapper/006:39:460
28841995235,10cyclictest2753-21strings05:29:570
2884199523,25cyclictest0-21swapper/006:19:310
131442523,9sleep20-21swapper/205:53:182
131442523,9sleep20-21swapper/205:53:182
2884899515,27cyclictest0-21swapper/207:18:472
2884899514,28cyclictest0-21swapper/206:54:292
2884899514,27cyclictest0-21swapper/206:14:492
2884699514,39cyclictest0-21swapper/107:29:461
2884699514,28cyclictest0-21swapper/108:44:371
28846995134,10cyclictest8572-21tr10:14:341
28846995134,10cyclictest6182-21sed09:20:021
28846995134,10cyclictest13442-21needreboot06:59:551
2884699513,26cyclictest0-21swapper/108:39:201
2884699513,26cyclictest0-21swapper/108:39:201
2884699513,25cyclictest0-21swapper/110:00:231
28846995126,8cyclictest3051-21tr06:39:451
28846995118,13cyclictest0-21swapper/110:34:211
2884199514,28cyclictest0-21swapper/007:04:550
2884199514,28cyclictest0-21swapper/005:39:470
2884199513,26cyclictest0-21swapper/006:24:490
215062513,42sleep00-21swapper/007:18:450
154282513,10sleep20-21swapper/205:57:012
2884699504,27cyclictest0-21swapper/109:56:091
2884699504,27cyclictest0-21swapper/109:56:091
28846995036,9cyclictest0-21swapper/107:05:011
2884699503,25cyclictest0-21swapper/109:02:201
268582503,40sleep126876-21python06:20:011
218392502,42sleep10-21swapper/108:07:281
2884899495,29cyclictest0-21swapper/205:19:482
2884899494,26cyclictest0-21swapper/205:44:492
2884699494,25cyclictest0-21swapper/105:32:311
28846994934,8cyclictest18285-21kworker/1:008:09:471
2884699493,42cyclictest0-21swapper/110:23:581
2884699493,28cyclictest0-21swapper/108:15:001
2884699493,27cyclictest0-21swapper/106:04:321
28846994926,11cyclictest0-21swapper/110:44:451
28846994922,10cyclictest14514-21cpuspeed_turbos09:34:361
28846994920,9cyclictest26698-21taskset09:04:361
107572493,10sleep00-21swapper/005:48:160
93292483,9sleep10-21swapper/106:50:451
2884899485,27cyclictest0-21swapper/205:19:342
2884699484,38cyclictest0-21swapper/109:49:391
250512482,41sleep10-21swapper/106:17:441
2884699474,36cyclictest0-21swapper/110:07:331
2884699474,24cyclictest0-21swapper/110:10:431
28846994730,11cyclictest17017-21munin-node07:09:401
28846994710,30cyclictest11122-21head05:49:421
28846994710,30cyclictest11122-21head05:49:421
192862472,39sleep10-21swapper/109:40:001
28846994633,8cyclictest27814-21munin-node06:24:441
28846994631,10cyclictest0-21swapper/105:43:191
285622464,35sleep00-21swapper/005:16:200
227492462,37sleep10-21swapper/106:13:491
181452462,36sleep10-21swapper/106:04:331
108542462,38sleep10-21swapper/105:49:301
2884699454,34cyclictest0-21swapper/107:14:551
72062442,36sleep10-21swapper/106:49:121
2884699434,20cyclictest0-21swapper/106:54:501
28849994217,8cyclictest28954-21cat05:19:343
28846994124,10cyclictest1016-21gltestperf06:34:491
28846994124,10cyclictest1016-21gltestperf06:34:491
2884699384,29cyclictest0-21swapper/105:19:341
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional