You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 13:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Thu Apr 23, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
966921000,8sleep0942899cyclictest05:06:500
942899983,23cyclictest0-21swapper/009:26:550
942899974,38cyclictest0-21swapper/009:21:420
248599940,6rtkit-daemon0-21swapper/108:18:081
942899934,37cyclictest0-21swapper/009:48:210
943199923,67cyclictest10890-21cpuspeed_turbos09:41:442
9428999138,10cyclictest24308-21tr05:36:530
9428999138,10cyclictest24308-21tr05:36:530
942899913,41cyclictest0-21swapper/008:35:360
942899913,39cyclictest0-21swapper/009:01:460
943199904,66cyclictest28746-21ssh10:06:542
943199904,56cyclictest0-21swapper/208:35:292
942899904,22cyclictest0-21swapper/007:18:500
942899903,36cyclictest19312-21ssh09:06:410
77002900,6sleep17702-21df_abs09:36:441
943199894,71cyclictest0-21swapper/208:41:522
942899895,36cyclictest0-21swapper/007:42:070
942899895,36cyclictest0-21swapper/007:42:070
942899894,41cyclictest0-21swapper/010:27:190
942899894,13cyclictest0-21swapper/007:12:130
942899883,36cyclictest0-21swapper/008:21:420
943199876,61cyclictest23010-21grep08:22:072
943199874,76cyclictest0-21swapper/208:48:472
942899879,21cyclictest0-21swapper/010:32:080
942899879,21cyclictest0-21swapper/010:32:080
942899874,39cyclictest0-21swapper/009:51:590
942899874,39cyclictest0-21swapper/009:51:590
942899874,35cyclictest0-21swapper/005:51:510
942899873,38cyclictest0-21swapper/007:26:590
9428998727,14cyclictest0-21swapper/007:32:050
943199865,73cyclictest0-21swapper/207:40:202
943199864,75cyclictest0-21swapper/209:46:402
943199864,75cyclictest0-21swapper/206:51:552
943199864,50cyclictest0-21swapper/209:32:362
943199863,63cyclictest0-21swapper/210:11:422
943199863,49cyclictest0-21swapper/208:26:452
943199863,49cyclictest0-21swapper/208:26:452
943199862,64cyclictest0-21swapper/209:58:272
942899865,38cyclictest0-21swapper/008:57:040
942899863,43cyclictest0-21swapper/009:35:080
943199857,60cyclictest0-21swapper/207:21:502
943199856,58cyclictest0-21swapper/207:47:092
943199854,74cyclictest0-21swapper/206:06:492
943199854,63cyclictest0-21swapper/209:26:582
943199854,62cyclictest0-21swapper/209:51:512
943199854,62cyclictest0-21swapper/209:51:512
943199853,74cyclictest7262-21ssh08:01:042
942899853,20cyclictest0-21swapper/005:12:110
943199844,73cyclictest0-21swapper/209:04:182
943199844,73cyclictest0-21swapper/207:16:472
943199844,73cyclictest0-21swapper/206:31:582
943199844,72cyclictest0-21swapper/207:45:552
943199844,72cyclictest0-21swapper/207:45:552
943199844,49cyclictest0-21swapper/208:11:442
943199842,63cyclictest0-21swapper/207:32:232
943199835,71cyclictest0-21swapper/209:17:362
943199834,72cyclictest0-21swapper/208:37:012
943199834,72cyclictest0-21swapper/207:53:372
943199834,71cyclictest0-21swapper/209:11:582
943199834,71cyclictest0-21swapper/209:11:582
943199834,60cyclictest0-21swapper/209:07:042
943199833,73cyclictest8323-21tune2fs08:01:512
943199833,72cyclictest0-21swapper/208:21:062
943199833,62cyclictest13748-21grep08:56:562
942899834,22cyclictest0-21swapper/009:16:480
943199824,71cyclictest0-21swapper/206:06:372
943199824,61cyclictest0-21swapper/207:11:512
943199823,65cyclictest0-21swapper/210:31:352
943199823,65cyclictest0-21swapper/210:31:352
943199823,63cyclictest9510-21grep10:26:472
248599820,6rtkit-daemon2484-21rtkit-daemon05:06:462
943199814,70cyclictest0-21swapper/209:36:342
943199813,61cyclictest0-21swapper/209:22:312
248599810,4rtkit-daemon2484-21rtkit-daemon07:30:402
943199804,70cyclictest24055-21munin-node10:02:012
943199804,70cyclictest0-21swapper/210:21:392
943199804,69cyclictest0-21swapper/205:27:052
943199803,63cyclictest0-21swapper/210:20:302
248599800,5rtkit-daemon2484-21rtkit-daemon08:07:092
943199794,69cyclictest0-21swapper/207:06:562
943199794,69cyclictest0-21swapper/207:06:562
248599790,5rtkit-daemon2484-21rtkit-daemon06:57:112
248599790,5rtkit-daemon2484-21rtkit-daemon05:55:512
248599790,4rtkit-daemon2484-21rtkit-daemon05:12:152
943199783,59cyclictest0-21swapper/208:53:092
9428997829,13cyclictest0-21swapper/010:11:540
248599780,4rtkit-daemon2484-21rtkit-daemon06:18:352
943199773,68cyclictest0-21swapper/205:36:562
943199773,68cyclictest0-21swapper/205:36:562
248599770,4rtkit-daemon2484-21rtkit-daemon06:22:352
248599770,4rtkit-daemon2484-21rtkit-daemon06:22:352
248599770,4rtkit-daemon2484-21rtkit-daemon05:32:152
248599770,4rtkit-daemon2484-21rtkit-daemon05:22:232
943199764,47cyclictest0-21swapper/206:12:022
943199764,44cyclictest0-21swapper/206:41:592
943199763,41cyclictest26350-21munin-node05:41:532
248599760,4rtkit-daemon2484-21rtkit-daemon05:47:372
943199753,64cyclictest1287-21snmpd06:39:322
943199753,39cyclictest16150-21df_inode06:26:522
943199744,54cyclictest0-21swapper/207:04:162
943199743,54cyclictest15323-21chrt05:16:592
943199713,61cyclictest0-21swapper/205:56:512
943299704,57cyclictest6130-21gltestperf10:21:483
943299684,54cyclictest9013-21yum-updatesd-he08:51:483
943199685,40cyclictest0-21swapper/206:47:092
943099683,59cyclictest0-21swapper/110:26:391
943099673,58cyclictest0-21swapper/109:06:551
248599670,8rtkit-daemon0-21swapper/207:29:483
943299654,53cyclictest0-21swapper/310:16:563
943299654,53cyclictest0-21swapper/310:06:453
943199655,53cyclictest0-21swapper/205:06:402
943099654,55cyclictest0-21swapper/106:41:481
127572653,8sleep112843-21gltestperf05:12:001
943299644,51cyclictest0-21swapper/308:33:073
943299644,51cyclictest0-21swapper/307:50:503
943099643,54cyclictest9902-21fschecks_time08:51:501
943099643,53cyclictest17157-21sed09:51:301
248599640,5rtkit-daemon2484-21rtkit-daemon07:25:553
102632644,53sleep30-21swapper/309:41:273
943299635,50cyclictest0-21swapper/309:59:303
943299634,52cyclictest0-21swapper/309:32:483
943299634,51cyclictest0-21swapper/309:31:303
943299634,51cyclictest0-21swapper/308:11:323
9430996350,8cyclictest6618-21gltestperf08:46:491
943099633,54cyclictest18769-21munin-node09:51:591
943099633,54cyclictest18769-21munin-node09:51:591
943299624,51cyclictest0-21swapper/309:25:193
943099614,51cyclictest0-21swapper/107:47:091
943099614,50cyclictest0-21swapper/110:32:021
943099614,50cyclictest0-21swapper/110:32:021
943099613,48cyclictest29750-21cpuspeed_turbos09:21:431
295282613,20sleep10-21swapper/107:46:311
295282613,20sleep10-21swapper/107:46:311
943099603,52cyclictest0-21swapper/108:07:011
943299593,50cyclictest0-21swapper/310:26:593
943099594,49cyclictest0-21swapper/109:31:481
943099593,52cyclictest439-21timerandwakeup08:37:041
942899593,49cyclictest0-21swapper/009:46:060
943299584,46cyclictest24293-21systemd-cgroups08:26:323
943299584,46cyclictest0-21swapper/309:01:443
943299583,48cyclictest0-21swapper/310:32:213
943299583,48cyclictest0-21swapper/310:32:213
943099586,46cyclictest0-21swapper/109:01:471
943099585,46cyclictest0-21swapper/108:26:561
943099585,46cyclictest0-21swapper/108:26:561
943099583,48cyclictest3886-21smartctl07:07:031
943099583,48cyclictest3886-21smartctl07:07:031
943099583,48cyclictest0-21swapper/110:16:481
57762583,12sleep10-21swapper/106:06:381
248599580,8rtkit-daemon0-21swapper/208:11:533
943299574,45cyclictest15556-21memory05:17:033
943299574,44cyclictest0-21swapper/308:01:353
943299574,43cyclictest0-21swapper/305:31:593
943299573,47cyclictest0-21swapper/308:26:453
943299573,47cyclictest0-21swapper/308:26:453
943099574,48cyclictest0-21swapper/109:12:011
943099574,48cyclictest0-21swapper/109:12:011
943099574,47cyclictest0-21swapper/110:11:561
943099574,46cyclictest0-21swapper/109:31:311
943099574,35cyclictest9003-21ntp_states08:02:001
943099573,49cyclictest0-21swapper/110:06:481
943099573,48cyclictest829-21idleruntime-cro05:56:381
9430995721,20cyclictest0-21swapper/110:21:581
9430995713,25cyclictest0-21swapper/109:44:221
9428995710,26cyclictest0-21swapper/009:40:160
296842576,44sleep00-21swapper/010:08:210
248599570,6rtkit-daemon2484-21rtkit-daemon09:10:143
224962573,12sleep10-21swapper/106:41:371
943299564,44cyclictest2055-21diskmemload07:17:103
943299564,28cyclictest0-21swapper/307:51:503
9432995615,33cyclictest0-21swapper/307:11:533
9432995612,34cyclictest0-21swapper/308:17:023
943099564,47cyclictest0-21swapper/108:12:011
943099564,46cyclictest22171-21python09:56:591
943099563,46cyclictest0-21swapper/105:47:041
9430995628,13cyclictest0-21swapper/107:28:571
9430995618,16cyclictest0-21swapper/108:46:321
942899564,46cyclictest0-21swapper/008:55:460
188562566,42sleep00-21swapper/006:31:560
943299555,29cyclictest0-21swapper/309:16:593
943299555,29cyclictest0-21swapper/305:06:583
9432995536,11cyclictest13541-21cpuspeed_turbos06:21:513
9432995536,11cyclictest13541-21cpuspeed_turbos06:21:513
9432995535,12cyclictest10807-21ssh08:06:323
943099554,45cyclictest0-21swapper/107:51:581
943099554,34cyclictest0-21swapper/108:58:411
943099554,28cyclictest0-21swapper/109:16:431
943099554,28cyclictest0-21swapper/107:16:351
943099553,46cyclictest14193-21munin-node06:21:581
943099553,46cyclictest14193-21munin-node06:21:581
943099553,45cyclictest0-21swapper/107:17:051
942899553,46cyclictest0-21swapper/008:10:540
248599550,5rtkit-daemon2484-21rtkit-daemon06:57:563
248599550,4rtkit-daemon2484-21rtkit-daemon08:57:143
943299546,30cyclictest0-21swapper/305:47:083
943299545,29cyclictest0-21swapper/308:49:003
943299545,14cyclictest0-21swapper/309:45:123
943299544,41cyclictest17131-21yum-updatesd-he09:51:313
943299544,41cyclictest17131-21yum-updatesd-he09:51:313
943299544,32cyclictest0-21swapper/307:07:013
943299544,32cyclictest0-21swapper/307:07:013
943299544,29cyclictest0-21swapper/306:26:593
943299544,24cyclictest0-21swapper/307:38:453
9432995434,12cyclictest7220-21head06:07:023
9432995420,13cyclictest0-21swapper/310:16:273
943099549,26cyclictest0-21swapper/107:31:521
943099544,43cyclictest0-21swapper/107:56:531
943099544,30cyclictest0-21swapper/105:32:051
942899545,43cyclictest0-21swapper/008:31:120
942899545,43cyclictest0-21swapper/008:31:120
942899545,42cyclictest0-21swapper/007:52:080
942899543,43cyclictest0-21swapper/010:04:020
318842546,42sleep00-21swapper/006:59:210
248599540,5rtkit-daemon2484-21rtkit-daemon06:17:203
248599540,5rtkit-daemon2484-21rtkit-daemon05:52:143
943299535,28cyclictest0-21swapper/308:42:053
943299535,28cyclictest0-21swapper/306:00:043
943299535,27cyclictest0-21swapper/309:13:473
943299535,27cyclictest0-21swapper/309:13:473
943299535,14cyclictest0-21swapper/309:48:323
943299534,29cyclictest0-21swapper/308:36:593
943299534,28cyclictest0-21swapper/307:36:353
943299534,28cyclictest0-21swapper/305:26:403
9432995321,13cyclictest0-21swapper/305:12:043
943099534,43cyclictest0-21swapper/106:27:051
943099534,29cyclictest0-21swapper/106:17:141
943099533,44cyclictest0-21swapper/108:31:431
943099533,44cyclictest0-21swapper/106:51:471
9430995316,22cyclictest0-21swapper/110:05:241
9428995333,14cyclictest0-21swapper/008:42:180
942899533,42cyclictest465-21sort08:37:040
942899533,10cyclictest0-21swapper/007:40:210
327122530,7sleep3361ktimersoftd/307:01:493
248599530,5rtkit-daemon2484-21rtkit-daemon06:52:193
237682533,44sleep10-21swapper/108:24:411
943299525,28cyclictest0-21swapper/305:42:033
943299525,28cyclictest0-21swapper/305:27:053
943299524,12cyclictest28289-21unixbench_singl07:42:093
943299524,12cyclictest28289-21unixbench_singl07:42:093
9432995221,13cyclictest0-21swapper/310:03:593
943299522,44cyclictest0-21swapper/306:02:083
943099525,38cyclictest0-21swapper/105:36:511
943099525,38cyclictest0-21swapper/105:36:511
943099525,29cyclictest0-21swapper/107:38:501
943099525,29cyclictest0-21swapper/105:57:011
943099525,27cyclictest0-21swapper/106:32:111
943099524,28cyclictest0-21swapper/107:22:131
943099524,27cyclictest0-21swapper/105:24:201
943099524,23cyclictest1419-21runrttasks07:01:561
942899524,42cyclictest1419-21runrttasks07:08:330
942899524,42cyclictest1419-21runrttasks07:08:330
942899524,13cyclictest0-21swapper/006:52:110
9428995233,13cyclictest0-21swapper/008:49:510
9428995231,14cyclictest0-21swapper/006:36:580
79512524,43sleep00-21swapper/010:24:580
307742523,9sleep00-21swapper/005:50:080
248599520,4rtkit-daemon2484-21rtkit-daemon06:37:423
159492522,45sleep00-21swapper/007:26:260
943299515,28cyclictest0-21swapper/306:11:553
943299514,28cyclictest0-21swapper/305:39:233
943299514,28cyclictest0-21swapper/305:39:233
943099514,39cyclictest0-21swapper/106:07:041
943099514,28cyclictest0-21swapper/105:29:211
943099514,27cyclictest0-21swapper/105:17:091
943099513,28cyclictest0-21swapper/106:16:381
942899514,41cyclictest0-21swapper/009:12:550
942899514,41cyclictest0-21swapper/009:12:550
9428995133,12cyclictest0-21swapper/008:05:300
942899513,11cyclictest0-21swapper/008:20:220
55662512,42sleep00-21swapper/006:03:550
20022514,40sleep00-21swapper/007:06:070
943099505,13cyclictest31172-21ntp_states06:57:021
943099503,28cyclictest0-21swapper/105:07:081
942899504,39cyclictest0-21swapper/009:56:530
942899504,29cyclictest0-21swapper/007:47:060
9428995014,29cyclictest14591-21tail08:11:450
237292503,40sleep323753-21iostat_ios06:41:593
231202502,42sleep00-21swapper/006:41:520
9432994917,15cyclictest0-21swapper/306:34:323
943099494,37cyclictest0-21swapper/105:06:411
9428994922,12cyclictest0-21swapper/007:58:340
187352492,40sleep00-21swapper/005:23:440
943099483,38cyclictest0-21swapper/106:46:471
9428994813,8cyclictest3159-21netstat10:16:530
79902482,40sleep00-21swapper/006:09:230
943299474,27cyclictest0-21swapper/306:47:063
942899473,38cyclictest0-21swapper/006:46:570
9428994726,13cyclictest0-21swapper/005:42:030
283932473,9sleep10-21swapper/105:45:171
211952462,37sleep00-21swapper/005:29:400
128792462,39sleep00-21swapper/006:20:480
942899455,33cyclictest0-21swapper/006:11:500
9428994521,10cyclictest2035-21hwlatdetect05:56:590
942899445,33cyclictest0-21swapper/005:32:000
93772443,6sleep00-21swapper/005:06:260
161432432,35sleep00-21swapper/006:26:530
9428994227,9cyclictest14769-21grep05:16:530
942899406,11cyclictest0-21swapper/006:23:440
942899406,11cyclictest0-21swapper/006:23:440
943299346,19cyclictest0-21swapper/305:06:413
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional