You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-29 - 00:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Thu May 28, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
295789911111,10cyclictest22966-21cpuspeed_turbos08:08:521
295799910336,47cyclictest0-21swapper/208:13:492
295799910140,53cyclictest0-21swapper/209:58:592
2485991010,5rtkit-daemon2484-21rtkit-daemon07:20:111
2485991010,5rtkit-daemon2484-21rtkit-daemon07:20:111
2485991000,6rtkit-daemon2484-21rtkit-daemon05:39:151
2485991000,5rtkit-daemon2484-21rtkit-daemon06:44:131
248599990,5rtkit-daemon2484-21rtkit-daemon05:19:011
29576999816,25cyclictest1419-21runrttasks09:14:040
248599970,6rtkit-daemon2484-21rtkit-daemon08:16:090
2957999964,32cyclictest0-21swapper/205:23:322
2957999964,28cyclictest0-21swapper/207:49:202
2957999964,28cyclictest0-21swapper/206:04:142
29579999632,11cyclictest0-21swapper/207:55:552
248599960,5rtkit-daemon2484-21rtkit-daemon07:53:551
2957999953,25cyclictest1287-21snmpd08:04:092
248599950,12rtkit-daemon2484-21rtkit-daemon06:46:203
2957999944,26cyclictest0-21swapper/209:25:522
29579999418,8cyclictest121850irq/46-eth004:48:502
29579999418,13cyclictest0-21swapper/208:54:042
2957999938,22cyclictest0-21swapper/209:18:532
2957999938,22cyclictest0-21swapper/209:18:532
2957999926,27cyclictest0-21swapper/207:07:452
2957999924,37cyclictest0-21swapper/207:24:132
2957999924,27cyclictest0-21swapper/209:34:102
2957999924,12cyclictest0-21swapper/209:01:552
29579999239,46cyclictest0-21swapper/208:50:242
29579999233,13cyclictest0-21swapper/208:09:032
2957999923,27cyclictest0-21swapper/209:28:502
29579999218,12cyclictest0-21swapper/205:08:562
248599920,13rtkit-daemon2484-21rtkit-daemon09:22:591
248599920,13rtkit-daemon2484-21rtkit-daemon09:22:591
2957999914,28cyclictest0-21swapper/209:08:552
2957999914,26cyclictest0-21swapper/209:44:072
2957999914,26cyclictest0-21swapper/209:04:012
2957999914,13cyclictest0-21swapper/206:54:352
2957999913,23cyclictest25592-21ssh09:48:462
29579999119,13cyclictest0-21swapper/208:33:552
248599910,4rtkit-daemon2484-21rtkit-daemon06:33:430
2957999907,25cyclictest0-21swapper/208:20:492
2957999904,27cyclictest0-21swapper/207:09:112
2957999904,26cyclictest0-21swapper/207:29:072
2957999903,43cyclictest0-21swapper/206:09:032
2957999903,24cyclictest18129-21cpuspeed_turbos07:13:552
2957999894,36cyclictest0-21swapper/206:43:592
2957999894,36cyclictest0-21swapper/205:29:092
29579998918,10cyclictest15859-21ssh08:44:122
29579998917,15cyclictest0-21swapper/206:37:512
29579998917,15cyclictest0-21swapper/206:37:512
2957999884,28cyclictest0-21swapper/206:14:062
2957999884,27cyclictest0-21swapper/208:39:052
2957999884,27cyclictest0-21swapper/208:39:052
2957999884,26cyclictest0-21swapper/207:43:502
2957999884,25cyclictest0-21swapper/205:03:582
2957999874,27cyclictest0-21swapper/209:56:482
2957999864,15cyclictest0-21swapper/207:59:022
2957999864,15cyclictest0-21swapper/207:59:022
29579998624,14cyclictest27907-21unixbench_singl05:34:172
29579998619,13cyclictest0-21swapper/207:03:352
2957999854,23cyclictest0-21swapper/205:54:012
2957999854,23cyclictest0-21swapper/205:54:012
2957999852,26cyclictest0-21swapper/206:40:102
2957999852,26cyclictest0-21swapper/206:40:102
2957999844,28cyclictest0-21swapper/207:43:402
2957999844,27cyclictest0-21swapper/204:44:142
29579998417,13cyclictest0-21swapper/208:28:552
29576998418,7cyclictest32080-21awk09:58:340
248599840,4rtkit-daemon2484-21rtkit-daemon09:39:063
248599840,4rtkit-daemon2484-21rtkit-daemon08:09:473
2957999835,27cyclictest0-21swapper/209:41:092
2957999834,25cyclictest0-21swapper/207:20:002
2957999834,25cyclictest0-21swapper/207:20:002
2957999833,25cyclictest32243-21hwlatdetect07:33:592
248599830,8rtkit-daemon0-21swapper/107:28:561
2957999824,28cyclictest0-21swapper/209:13:592
29579998218,12cyclictest0-21swapper/205:59:112
2957999814,27cyclictest0-21swapper/208:27:262
2957999804,25cyclictest0-21swapper/205:39:052
2957999803,29cyclictest0-21swapper/204:41:512
2957999803,25cyclictest0-21swapper/206:50:182
2957999794,23cyclictest0-21swapper/205:48:552
248599760,4rtkit-daemon2484-21rtkit-daemon07:19:043
248599760,4rtkit-daemon2484-21rtkit-daemon07:19:043
2957899753,10cyclictest25914-21unixbench_singl08:59:101
2957899693,12cyclictest619-21tr08:23:511
248599690,5rtkit-daemon2484-21rtkit-daemon06:39:433
248599690,5rtkit-daemon2484-21rtkit-daemon06:39:433
248599660,8rtkit-daemon0-21swapper/009:44:583
248599660,7rtkit-daemon0-21swapper/009:27:143
29576996537,13cyclictest0-21swapper/009:48:340
2957699643,11cyclictest0-21swapper/008:24:420
248599640,7rtkit-daemon0-21swapper/006:21:143
29580996320,26cyclictest0-21swapper/309:13:483
2957699624,54cyclictest0-21swapper/008:10:490
248599620,7rtkit-daemon0-21swapper/007:27:343
248599620,6rtkit-daemon9649-21python06:04:143
248599620,6rtkit-daemon0-21swapper/008:30:313
248599620,6rtkit-daemon0-21swapper/007:30:043
117442627,48sleep10-21swapper/109:28:241
29576996113,42cyclictest29468-21aten2.4-expect08:18:500
248599610,7rtkit-daemon0-21swapper/007:39:413
248599610,5rtkit-daemon1298-21ssh07:36:113
29579996034,12cyclictest0-21swapper/206:28:432
29579996032,13cyclictest0-21swapper/205:14:062
29579996032,13cyclictest0-21swapper/205:14:062
2957699604,12cyclictest0-21swapper/007:23:510
2957699604,11cyclictest0-21swapper/009:24:040
2957699603,51cyclictest0-21swapper/007:56:110
248599600,5rtkit-daemon6657-21sh06:56:053
248599600,5rtkit-daemon12951-21ssh08:40:533
248599600,5rtkit-daemon12951-21ssh08:40:533
29578995923,29cyclictest8247-21df_abs06:58:561
2957699594,10cyclictest0-21swapper/008:29:240
2957699593,12cyclictest0-21swapper/006:44:000
2957699592,12cyclictest0-21swapper/006:57:240
2957899584,13cyclictest0-21swapper/108:50:531
2957899583,48cyclictest0-21swapper/109:14:191
155642583,47sleep015644-21mailstats05:09:150
29576995732,11cyclictest0-21swapper/007:03:530
2957699573,48cyclictest0-21swapper/008:50:210
2957699573,47cyclictest0-21swapper/009:01:300
2957699573,11cyclictest0-21swapper/007:20:180
2957699573,11cyclictest0-21swapper/007:20:180
29576995726,24cyclictest8721-21ssh08:34:080
240442577,12sleep10-21swapper/105:28:591
179752573,46sleep00-21swapper/008:00:030
179752573,46sleep00-21swapper/008:00:030
147792573,10sleep30-21swapper/306:14:203
3732562,10sleep30-21swapper/309:09:403
29580995639,10cyclictest21900-21unixbench_singl06:29:153
29580995638,11cyclictest11934-21cut07:04:013
2957899564,12cyclictest0-21swapper/106:33:551
2957899564,12cyclictest0-21swapper/106:33:551
2957699563,9cyclictest0-21swapper/008:44:050
235402563,9sleep30-21swapper/308:57:343
234222562,47sleep10-21swapper/108:57:081
124882562,47sleep00-21swapper/006:10:340
2958099553,35cyclictest0-21swapper/308:04:003
29580995520,11cyclictest32545-21cpu09:58:473
2957899554,45cyclictest32690-21munin-node09:09:101
2957899554,11cyclictest0-21swapper/107:45:471
2957899553,46cyclictest7021-21rm06:57:151
2957899553,46cyclictest15439-21munin-node09:33:481
2957899553,11cyclictest0-21swapper/108:29:121
2957699553,23cyclictest0-21swapper/007:13:410
2957699553,22cyclictest0-21swapper/004:59:020
2957699553,11cyclictest0-21swapper/006:34:030
2957699553,11cyclictest0-21swapper/006:34:030
155052553,13sleep00-21swapper/006:18:560
92122542,44sleep00-21swapper/004:58:470
299662543,43sleep30-21swapper/308:18:563
2958099548,34cyclictest0-21swapper/305:20:193
29580995415,22cyclictest0-21swapper/308:48:393
29579995417,21cyclictest0-21swapper/204:34:092
29576995435,13cyclictest0-21swapper/009:39:060
2957699543,11cyclictest0-21swapper/009:19:050
2957699543,11cyclictest0-21swapper/009:19:050
2957699543,10cyclictest27117-21swap09:49:070
248599540,6rtkit-daemon2484-21rtkit-daemon05:44:082
248599540,5rtkit-daemon2484-21rtkit-daemon04:54:172
2958099535,30cyclictest0-21swapper/309:53:573
2958099535,15cyclictest0-21swapper/309:03:393
2957899535,29cyclictest0-21swapper/105:54:121
2957899535,29cyclictest0-21swapper/105:54:121
2957899534,42cyclictest0-21swapper/108:04:101
2957899533,45cyclictest22307-21diskmemload10:00:091
2957899533,45cyclictest15397-21ps08:44:061
2957899533,44cyclictest0-21swapper/107:03:461
29578995322,12cyclictest0-21swapper/105:01:341
29578995319,12cyclictest0-21swapper/106:43:421
29578995319,12cyclictest0-21swapper/106:43:421
2957699534,11cyclictest0-21swapper/009:07:470
2957699533,11cyclictest0-21swapper/007:15:390
2957699533,11cyclictest0-21swapper/005:34:080
2957699533,11cyclictest0-21swapper/004:43:590
248599530,5rtkit-daemon2484-21rtkit-daemon09:20:223
248599530,5rtkit-daemon2484-21rtkit-daemon09:20:223
248599530,5rtkit-daemon2484-21rtkit-daemon06:19:062
248599530,3rtkit-daemon20006-21ssh07:15:271
226702533,9sleep00-21swapper/008:54:250
315782523,43sleep10-21swapper/108:20:281
2958099525,27cyclictest0-21swapper/305:43:453
2958099524,34cyclictest0-21swapper/308:01:523
2958099524,34cyclictest0-21swapper/308:01:523
2958099523,43cyclictest2358-21sh08:24:283
2958099523,27cyclictest0-21swapper/307:43:553
2957899525,28cyclictest0-21swapper/106:01:441
2957899524,41cyclictest0-21swapper/109:53:471
2957899524,28cyclictest0-21swapper/109:30:381
2957899524,11cyclictest26995-21ps09:49:051
2957899523,45cyclictest0-21swapper/107:53:031
2957899523,44cyclictest0-21swapper/108:00:431
2957899523,44cyclictest0-21swapper/108:00:431
2957899523,43cyclictest1287-21snmpd06:26:491
29578995222,13cyclictest0-21swapper/107:34:281
29578995220,14cyclictest0-21swapper/107:41:501
2957699524,10cyclictest0-21swapper/007:29:080
2957699523,9cyclictest31925-21fschecks_count07:33:560
2957699523,9cyclictest0-21swapper/007:39:120
2957699523,43cyclictest0-21swapper/006:59:030
2957699523,12cyclictest0-21swapper/009:58:540
2957699523,11cyclictest19960-21tune2fs08:03:560
2957699523,11cyclictest0-21swapper/008:43:080
2957699523,11cyclictest0-21swapper/008:43:080
2957699523,11cyclictest0-21swapper/006:49:000
2957699523,11cyclictest0-21swapper/005:53:580
2957699523,11cyclictest0-21swapper/005:53:580
2957699522,42cyclictest753-21ssh09:10:580
283852523,43sleep10-21swapper/108:16:081
157532523,43sleep315854-21users08:44:123
2958099517,25cyclictest0-21swapper/308:35:093
2958099514,28cyclictest0-21swapper/306:59:163
2958099513,32cyclictest0-21swapper/307:16:333
29580995121,13cyclictest0-21swapper/306:49:173
29580995120,13cyclictest0-21swapper/307:54:133
2957899515,27cyclictest0-21swapper/107:27:391
2957899515,27cyclictest0-21swapper/105:26:391
2957899515,27cyclictest0-21swapper/104:44:201
2957899514,28cyclictest0-21swapper/104:54:121
2957899513,40cyclictest14840-21ssh07:08:571
2957699513,41cyclictest6677-21ssh07:44:000
2957699513,10cyclictest0-21swapper/006:39:040
2957699513,10cyclictest0-21swapper/006:39:040
295452513,41sleep00-21swapper/004:33:480
295452513,41sleep00-21swapper/004:33:480
248599510,5rtkit-daemon2484-21rtkit-daemon04:34:183
196152513,9sleep30-21swapper/306:24:483
2958099507,26cyclictest0-21swapper/309:29:073
2958099505,27cyclictest0-21swapper/305:49:053
2958099504,39cyclictest0-21swapper/305:07:493
2958099504,28cyclictest0-21swapper/305:14:163
2958099504,28cyclictest0-21swapper/305:14:163
2958099504,28cyclictest0-21swapper/305:09:193
29580995034,9cyclictest24093-21cut05:28:583
29580995020,13cyclictest0-21swapper/306:34:163
29580995020,13cyclictest0-21swapper/306:34:163
2958099502,43cyclictest0-21swapper/304:39:073
29580995019,13cyclictest0-21swapper/309:34:543
29580995013,19cyclictest26045-21aten_r1power_fr08:13:493
2957899504,40cyclictest0-21swapper/109:03:471
2957899504,28cyclictest0-21swapper/106:31:501
2957899503,9cyclictest0-21swapper/106:51:581
2957899503,43cyclictest0-21swapper/106:09:051
29578995022,12cyclictest0-21swapper/109:43:571
2957699504,11cyclictest0-21swapper/005:46:420
2957699503,11cyclictest0-21swapper/009:35:480
2957699503,11cyclictest0-21swapper/009:29:020
2957699503,11cyclictest0-21swapper/005:40:480
2957699503,11cyclictest0-21swapper/005:30:540
194442503,9sleep10-21swapper/109:38:531
5282493,9sleep30-21swapper/305:47:313
2958099497,26cyclictest0-21swapper/305:33:563
2958099496,26cyclictest0-21swapper/308:58:533
2958099495,27cyclictest0-21swapper/304:44:213
2958099495,26cyclictest0-21swapper/309:50:043
2958099494,29cyclictest0-21swapper/307:48:573
2958099494,27cyclictest0-21swapper/307:09:093
2958099494,27cyclictest0-21swapper/304:49:023
2957899494,39cyclictest0-21swapper/108:40:211
2957899494,39cyclictest0-21swapper/108:40:211
2957899494,27cyclictest0-21swapper/105:34:051
29578994933,10cyclictest5867-21needreboot04:49:101
2957899493,41cyclictest0-21swapper/104:34:211
2957899493,10cyclictest31663-21perl05:44:031
29578994920,11cyclictest0-21swapper/108:34:221
2957699494,26cyclictest0-21swapper/004:36:290
29576994933,11cyclictest9429-21tr07:48:510
210942493,40sleep00-21swapper/005:23:180
18342493,10sleep00-21swapper/005:49:050
183332493,39sleep00-21swapper/006:24:000
2958099484,27cyclictest0-21swapper/305:59:153
2958099484,23cyclictest0-21swapper/304:58:553
29580994831,10cyclictest7933-21gltestperf04:54:053
29579994818,13cyclictest0-21swapper/205:24:052
2957699483,9cyclictest0-21swapper/006:03:450
2957699483,9cyclictest0-21swapper/004:52:290
2957699482,10cyclictest0-21swapper/006:14:380
248599480,4rtkit-daemon2484-21rtkit-daemon06:28:582
137172483,9sleep10-21swapper/105:05:291
118182482,40sleep00-21swapper/005:03:510
29580994729,11cyclictest3585-21aten_r1power_vo05:53:563
29580994729,11cyclictest3585-21aten_r1power_vo05:53:563
29579994715,19cyclictest0-21swapper/205:01:172
29576994731,11cyclictest354-21fschecks_count04:39:040
2957699473,9cyclictest0-21swapper/005:28:160
174542473,39sleep10-21swapper/106:23:001
156462473,38sleep10-21swapper/105:09:161
2957899463,38cyclictest0-21swapper/105:14:101
2957899463,38cyclictest0-21swapper/105:14:101
2957699463,9cyclictest0-21swapper/005:14:060
2957699463,9cyclictest0-21swapper/005:14:060
2957699462,10cyclictest0-21swapper/006:04:020
29580994528,10cyclictest1419-21runrttasks05:24:173
29578994428,10cyclictest1867-21ls05:49:051
2957899442,26cyclictest0-21swapper/106:14:071
18622443,35sleep10-21swapper/104:43:041
29580994319,18cyclictest1419-21runrttasks06:10:533
2957899434,33cyclictest0-21swapper/104:33:481
2957899434,33cyclictest0-21swapper/104:33:481
2957899433,23cyclictest8950-21cut06:04:011
248599400,5rtkit-daemon2484-21rtkit-daemon04:32:183
248599400,5rtkit-daemon2484-21rtkit-daemon04:32:183
2957999324,22cyclictest0-21swapper/204:33:482
2957999324,22cyclictest0-21swapper/204:33:482
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional