You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-08 - 21:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Wed Apr 08, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
309812940,4chrt30983-21latency_hist07:25:411
309812940,4chrt30983-21latency_hist07:25:411
248599940,7rtkit-daemon0-21swapper/109:00:521
248599910,6rtkit-daemon0-21swapper/305:20:533
2468998229,45cyclictest1991-21munin-node08:16:061
160972820,3sleep118-21rcuc/108:36:111
47382800,12sleep2246999cyclictest10:45:242
47382800,12sleep2246999cyclictest10:45:242
2468997727,30cyclictest1287-21snmpd10:35:341
2468997528,28cyclictest30400-21fschecks_time08:10:561
2468997526,27cyclictest31911-21fschecks_count07:25:571
2468997520,32cyclictest0-21swapper/109:24:401
2468997422,46cyclictest0-21swapper/107:46:141
2468997232,21cyclictest24053-21ssh08:50:311
2468997228,38cyclictest7057-21munin-node09:11:061
2468997226,29cyclictest1287-21snmpd09:45:251
2468997219,35cyclictest0-21swapper/106:11:181
2468997123,41cyclictest20854-21unixbench_multi09:31:081
2468997123,28cyclictest30069-21gltestperf09:45:541
2468997121,43cyclictest0-21swapper/109:55:521
2468997027,36cyclictest19306-21crond07:55:391
2468997021,42cyclictest160091ssh10:12:331
2468997021,32cyclictest0-21swapper/110:17:101
2468997021,29cyclictest0-21swapper/107:40:581
2468997018,33cyclictest0-21swapper/107:56:121
2468997015,49cyclictest0-21swapper/109:07:101
2468996926,26cyclictest31782-21missed_timers10:35:581
2468996923,29cyclictest0-21swapper/109:30:371
2468996923,28cyclictest23853-21munin-node10:26:031
2468996921,29cyclictest12060-21munin-run09:20:361
2468996915,37cyclictest0-21swapper/109:50:471
2468996828,12cyclictest4230-21unixbench_singl07:31:131
2468996824,38cyclictest26393-21uname07:16:031
2468996820,42cyclictest0-21swapper/109:35:481
2468996728,12cyclictest12141-21sed10:06:071
2468996723,26cyclictest21813-21munin-node06:01:101
2468996721,29cyclictest0-21swapper/107:35:421
264492663,11sleep30-21swapper/310:28:453
2468996625,35cyclictest1419-21runrttasks06:55:141
2468996621,39cyclictest11327-21munin-node08:30:531
2468996620,24cyclictest0-21swapper/108:44:151
2468996620,24cyclictest0-21swapper/108:44:151
2468996620,21cyclictest0-21swapper/108:55:381
2468996619,41cyclictest0-21swapper/110:45:361
2468996619,40cyclictest5697-21munin-node05:26:021
2468996618,40cyclictest21558-21ssh10:20:561
2468996617,43cyclictest0-21swapper/108:23:011
2468996616,43cyclictest0-21swapper/105:51:161
2468996521,37cyclictest15346-21nscd05:20:561
2468996521,26cyclictest29871-21gltestperf06:16:021
2468996519,40cyclictest0-21swapper/108:00:571
2468996519,40cyclictest0-21swapper/108:00:571
2468996516,21cyclictest0-21swapper/110:44:041
2468996516,21cyclictest0-21swapper/110:44:041
2468996424,33cyclictest2452-21chrt06:26:041
2468996422,14cyclictest1419-21runrttasks08:30:071
2468996421,38cyclictest0-21swapper/108:06:271
2468996420,26cyclictest10085-21latency_hist10:05:351
2468996420,26cyclictest10085-21latency_hist10:05:351
2468996416,42cyclictest0-21swapper/106:41:051
2468996416,42cyclictest0-21swapper/106:41:051
248599630,4rtkit-daemon2484-21rtkit-daemon08:08:013
2470996321,27cyclictest29668-21munin-node08:10:503
2468996332,26cyclictest11873-21gltestperf06:46:021
2468996318,28cyclictest0-21swapper/108:55:391
2468996315,32cyclictest0-21swapper/106:39:521
2468996315,32cyclictest0-21swapper/106:39:521
2468996314,43cyclictest0-21swapper/106:06:171
246899629,26cyclictest25130-21crond07:15:411
2468996230,24cyclictest10676-21gltestperf05:36:041
2468996222,15cyclictest0-21swapper/107:06:091
2468996216,31cyclictest0-21swapper/105:30:561
246799623,53cyclictest41ktimersoftd/008:51:040
182752623,51sleep30-21swapper/307:51:523
2470996121,24cyclictest5554-21munin-node09:10:583
2468996123,33cyclictest0-21swapper/105:44:051
248599600,6rtkit-daemon2484-21rtkit-daemon09:24:513
2470996012,29cyclictest0-21swapper/308:50:373
248599590,4rtkit-daemon2484-21rtkit-daemon10:22:113
247099594,37cyclictest0-21swapper/308:38:533
2470995913,30cyclictest1419-21runrttasks07:05:573
247099585,29cyclictest10632-21awk08:30:383
247099584,37cyclictest0-21swapper/310:35:163
2469995816,25cyclictest0-21swapper/209:20:592
2468995822,29cyclictest14713-21munin-node05:45:541
2468995820,17cyclictest0-21swapper/107:00:421
246799586,45cyclictest0-21swapper/009:58:060
248599570,5rtkit-daemon2484-21rtkit-daemon06:05:132
248599570,5rtkit-daemon2484-21rtkit-daemon05:26:002
247099574,36cyclictest0-21swapper/305:56:093
2470995718,22cyclictest0-21swapper/310:04:443
2470995718,22cyclictest0-21swapper/310:04:443
2470995717,25cyclictest0-21swapper/307:30:333
2470995714,23cyclictest0-21swapper/307:46:003
2468995725,24cyclictest32218-21gltestperf06:21:021
2468995724,17cyclictest19213-21munin-node07:01:031
2468995721,11cyclictest5184-21munin-node06:31:101
248599560,5rtkit-daemon2484-21rtkit-daemon06:11:132
248599560,4rtkit-daemon2484-21rtkit-daemon07:58:023
248599560,4rtkit-daemon2484-21rtkit-daemon07:26:102
247512568,41sleep00-21swapper/009:37:430
247099565,30cyclictest0-21swapper/309:08:303
247099564,36cyclictest0-21swapper/308:44:593
247099564,36cyclictest0-21swapper/308:44:593
247099564,35cyclictest0-21swapper/308:51:473
247099563,35cyclictest0-21swapper/308:05:253
247099563,35cyclictest0-21swapper/308:05:253
2470995622,13cyclictest0-21swapper/309:41:023
246999565,37cyclictest0-21swapper/210:19:582
248599550,5rtkit-daemon2484-21rtkit-daemon07:11:032
248599550,5rtkit-daemon2484-21rtkit-daemon07:05:562
248599550,5rtkit-daemon2484-21rtkit-daemon06:36:052
248599550,5rtkit-daemon2484-21rtkit-daemon06:36:052
248599550,5rtkit-daemon2484-21rtkit-daemon06:26:132
248599550,5rtkit-daemon2484-21rtkit-daemon06:21:052
248599550,5rtkit-daemon2484-21rtkit-daemon05:50:592
247099554,33cyclictest17318-21sed09:26:073
247099553,35cyclictest0-21swapper/307:41:093
247099553,34cyclictest0-21swapper/310:46:573
247099553,24cyclictest0-21swapper/309:33:283
246999553,45cyclictest0-21swapper/209:05:072
2468995529,18cyclictest21307-21runrttasks05:57:181
246799553,46cyclictest41ktimersoftd/008:58:280
220092552,46sleep00-21swapper/007:58:140
248599540,7rtkit-daemon0-21swapper/305:21:532
248599540,5rtkit-daemon2484-21rtkit-daemon08:58:523
248599540,5rtkit-daemon2484-21rtkit-daemon08:25:383
248599540,5rtkit-daemon2484-21rtkit-daemon06:51:042
248599540,4rtkit-daemon2484-21rtkit-daemon06:05:582
248599540,4rtkit-daemon2484-21rtkit-daemon05:36:072
247099544,30cyclictest0-21swapper/307:20:583
247099544,30cyclictest0-21swapper/307:20:583
247099544,29cyclictest0-21swapper/310:10:443
247099544,28cyclictest0-21swapper/309:56:103
247099543,25cyclictest0-21swapper/305:51:053
2470995424,12cyclictest0-21swapper/309:35:573
2470995422,13cyclictest0-21swapper/306:56:113
2470995422,11cyclictest1374-21tail09:50:593
2470995421,14cyclictest0-21swapper/309:16:313
2470995421,14cyclictest0-21swapper/307:36:423
2470995417,10cyclictest11870-21munin-node10:06:053
2469995435,13cyclictest0-21swapper/208:35:552
246799544,25cyclictest1978-21ssh07:30:340
2467995439,9cyclictest25697-21cpuspeed_turbos07:15:550
91682532,44sleep00-21swapper/010:02:140
91682532,44sleep00-21swapper/010:02:140
299532532,7sleep029958-21ssh07:22:230
299532532,7sleep029958-21ssh07:22:230
248599530,5rtkit-daemon2484-21rtkit-daemon07:21:032
248599530,5rtkit-daemon2484-21rtkit-daemon07:21:032
248599530,5rtkit-daemon2484-21rtkit-daemon07:16:032
248599530,4rtkit-daemon2484-21rtkit-daemon07:05:192
248599530,4rtkit-daemon2484-21rtkit-daemon06:45:572
247099536,26cyclictest31658-21irqstats10:35:573
247099535,26cyclictest0-21swapper/309:03:213
247099535,26cyclictest0-21swapper/308:15:503
247099534,29cyclictest0-21swapper/307:32:433
2470995322,13cyclictest0-21swapper/306:30:543
2470995321,8cyclictest1243-21lldpd06:00:553
2470995319,14cyclictest0-21swapper/307:20:413
2470995318,12cyclictest0-21swapper/310:19:053
2470995318,10cyclictest31066-21ssh09:46:103
2470995317,14cyclictest0-21swapper/306:46:093
2470995316,13cyclictest0-21swapper/306:10:593
246999533,43cyclictest1419-21runrttasks08:24:242
246999533,11cyclictest0-21swapper/208:58:142
246799539,36cyclictest0-21swapper/009:19:350
2467995333,14cyclictest0-21swapper/008:05:210
2467995333,14cyclictest0-21swapper/008:05:210
246799533,43cyclictest0-21swapper/009:05:020
246799533,42cyclictest0-21swapper/010:45:490
319492522,45sleep20-21swapper/209:49:262
254872523,11sleep20-21swapper/209:40:232
248599520,4rtkit-daemon2484-21rtkit-daemon07:38:022
247099525,27cyclictest0-21swapper/310:41:023
247099525,27cyclictest0-21swapper/310:41:023
247099525,27cyclictest0-21swapper/306:35:583
247099525,27cyclictest0-21swapper/306:35:583
247099525,27cyclictest0-21swapper/305:35:553
247099524,29cyclictest0-21swapper/306:16:123
247099524,28cyclictest0-21swapper/307:11:093
247099524,28cyclictest0-21swapper/306:50:593
247099524,28cyclictest0-21swapper/305:41:053
2470995234,12cyclictest19044-21gltestperf07:01:003
247099523,26cyclictest0-21swapper/308:31:323
2469995230,16cyclictest27518-21diskmemload08:27:142
2469995210,24cyclictest1419-21runrttasks10:00:502
2469995210,24cyclictest1419-21runrttasks10:00:502
2468995231,13cyclictest2592-21runrttasks05:20:471
246799527,38cyclictest17852-21ssh10:15:520
246799524,29cyclictest0-21swapper/009:41:020
2467995239,8cyclictest22694-21cut06:01:020
2467995235,10cyclictest6027-21wc05:26:050
235422522,9sleep20-21swapper/210:25:252
21032523,42sleep20-21swapper/209:51:272
184162522,9sleep20-21swapper/208:40:572
184162522,9sleep20-21swapper/208:40:572
124082522,42sleep00-21swapper/007:45:040
46932513,42sleep24695-21ssh09:08:302
291202512,9sleep20-21swapper/210:31:102
24872512,9sleep00-21swapper/009:52:300
248599510,5rtkit-daemon2484-21rtkit-daemon05:40:592
247099515,27cyclictest0-21swapper/306:21:013
247099514,28cyclictest0-21swapper/306:05:593
247099514,26cyclictest0-21swapper/306:40:533
247099514,26cyclictest0-21swapper/306:40:533
246999519,35cyclictest21598-21kworker/2:007:45:562
246999514,30cyclictest0-21swapper/210:28:492
246999513,43cyclictest0-21swapper/206:41:032
246999513,43cyclictest0-21swapper/206:41:032
246799514,28cyclictest0-21swapper/008:25:380
2467995138,8cyclictest15533-21gltestperf05:46:020
2467995136,10cyclictest12726-21unixbench_singl08:31:120
246799513,43cyclictest0-21swapper/010:40:580
246799513,43cyclictest0-21swapper/010:40:580
246799513,40cyclictest0-21swapper/007:45:580
167252512,9sleep30-21swapper/305:49:473
308112502,9sleep20-21swapper/206:16:312
248599500,4rtkit-daemon2484-21rtkit-daemon06:30:572
247099504,27cyclictest0-21swapper/306:26:053
247099504,27cyclictest0-21swapper/305:31:103
247099504,27cyclictest0-21swapper/305:29:413
247099504,26cyclictest0-21swapper/305:20:473
246999506,32cyclictest0-21swapper/209:19:492
246999504,40cyclictest0-21swapper/209:31:082
246999504,39cyclictest0-21swapper/210:05:552
246999503,41cyclictest0-21swapper/207:52:182
246999503,23cyclictest0-21swapper/210:36:572
246799509,36cyclictest0-21swapper/009:24:510
246799504,40cyclictest0-21swapper/009:32:590
246799504,40cyclictest0-21swapper/008:26:010
246799504,40cyclictest0-21swapper/005:41:130
246799504,38cyclictest0-21swapper/009:25:460
2467995031,13cyclictest0-21swapper/007:35:540
2467995024,9cyclictest14575-21ssh10:10:510
2467995015,31cyclictest15-21rcuc/009:50:250
224882502,42sleep00-21swapper/010:21:320
10542503,40sleep20-21swapper/208:15:542
286072492,41sleep00-21swapper/006:13:510
248599490,5rtkit-daemon2484-21rtkit-daemon05:45:592
246999495,38cyclictest0-21swapper/209:40:542
246999494,39cyclictest0-21swapper/208:05:552
246999493,41cyclictest0-21swapper/207:57:252
246999493,39cyclictest0-21swapper/209:11:002
246999493,38cyclictest0-21swapper/209:55:542
246999493,28cyclictest0-21swapper/210:11:012
2469994921,12cyclictest0-21swapper/207:34:462
2469994917,18cyclictest26728-21ssh08:53:002
2469994911,20cyclictest0-21swapper/207:40:552
246799494,37cyclictest0-21swapper/008:40:370
2467994930,14cyclictest0-21swapper/008:13:430
246799493,40cyclictest0-21swapper/008:44:330
246799493,40cyclictest0-21swapper/008:44:330
131182492,9sleep20-21swapper/208:32:312
10732492,9sleep00-21swapper/006:25:360
58372482,9sleep00-21swapper/006:33:250
2469994832,11cyclictest30515-21grep08:10:572
246999483,40cyclictest0-21swapper/209:30:042
246999483,39cyclictest0-21swapper/208:46:072
246999483,38cyclictest0-21swapper/208:01:132
246999483,38cyclictest0-21swapper/208:01:132
246799489,7cyclictest15-21rcuc/008:15:530
246799488,10cyclictest0-21swapper/006:50:560
246799487,7cyclictest41ktimersoftd/007:30:590
246799487,11cyclictest0-21swapper/009:10:150
246799484,26cyclictest0-21swapper/008:05:570
246799484,11cyclictest0-21swapper/010:30:480
246799483,39cyclictest0-21swapper/008:49:000
246799483,26cyclictest0-21swapper/009:10:530
202872483,37sleep00-21swapper/007:05:060
46152472,9sleep00-21swapper/005:22:320
246999473,37cyclictest0-21swapper/210:46:052
246799478,33cyclictest0-21swapper/005:35:580
246799475,14cyclictest0-21swapper/007:50:560
2467994718,12cyclictest0-21swapper/005:55:540
191562472,39sleep00-21swapper/005:55:210
174572472,9sleep00-21swapper/006:56:150
262552462,38sleep00-21swapper/006:09:310
2467994633,8cyclictest3149-21unixbench-2d06:26:150
2467994618,11cyclictest0-21swapper/010:05:570
110142462,9sleep00-21swapper/006:45:470
93382452,9sleep20-21swapper/205:31:532
2469994530,9cyclictest16416-21tune2fs06:55:592
246999453,26cyclictest0-21swapper/205:56:132
2467994532,8cyclictest24719-21unixbench_singl07:11:140
2467994522,7cyclictest31187-21ssh10:35:500
23432454,35sleep00-21swapper/005:19:420
223942452,9sleep00-21swapper/007:06:270
246799447,10cyclictest41ktimersoftd/010:25:440
246799444,33cyclictest0-21swapper/006:15:530
246799444,33cyclictest0-21swapper/005:33:120
2467994431,8cyclictest6619-21cpuspeed_turbos06:35:570
2467994431,8cyclictest6619-21cpuspeed_turbos06:35:570
2467994331,8cyclictest9489-21gltestperf06:41:010
2467994331,8cyclictest9489-21gltestperf06:41:010
2469993410,9cyclictest121850irq/46-eth005:20:462
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional