You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-09 - 14:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Thu Apr 09, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2238021070,7sleep1474399cyclictest08:44:411
1156521020,17sleep3474599cyclictest06:40:033
474399934,39cyclictest0-21swapper/106:35:151
4743999333,12cyclictest28284-21gltestperf09:39:571
473999913,81cyclictest8044-21grep09:10:010
248599910,4rtkit-daemon2484-21rtkit-daemon06:45:493
474399904,38cyclictest0-21swapper/108:01:441
473999904,77cyclictest1419-21runrttasks09:39:230
473999903,40cyclictest0-21swapper/008:40:120
248599880,5rtkit-daemon2484-21rtkit-daemon07:00:183
474399874,28cyclictest0-21swapper/106:05:021
474399874,27cyclictest0-21swapper/108:35:151
4739998713,67cyclictest0-21swapper/009:39:580
474399864,27cyclictest0-21swapper/105:40:071
474399864,13cyclictest1287-21snmpd09:18:071
473999843,73cyclictest6932-21crond09:09:400
474399835,15cyclictest0-21swapper/109:24:451
473999839,56cyclictest0-21swapper/009:15:530
473999834,73cyclictest0-21swapper/010:32:530
473999834,72cyclictest0-21swapper/009:59:510
473999833,73cyclictest4099-21kworker/0:008:15:110
248599830,5rtkit-daemon2484-21rtkit-daemon09:01:363
473999823,72cyclictest28623-21sh08:04:580
473999823,72cyclictest28623-21sh08:04:580
473999823,71cyclictest8032-21munin-node07:35:010
4739998220,45cyclictest0-21swapper/008:59:380
474399814,15cyclictest0-21swapper/109:48:161
473999818,50cyclictest0-21swapper/007:26:200
473999816,68cyclictest0-21swapper/010:28:150
473999814,70cyclictest6380-21latency09:55:030
473999814,69cyclictest0-21swapper/010:38:060
473999814,56cyclictest0-21swapper/007:46:120
473999813,38cyclictest0-21swapper/010:45:530
248599810,5rtkit-daemon2484-21rtkit-daemon07:56:013
248599810,4rtkit-daemon2484-21rtkit-daemon08:58:293
474399804,14cyclictest0-21swapper/109:11:151
473999804,68cyclictest0-21swapper/009:04:210
473999804,67cyclictest24978-21munin-run07:09:450
4739998033,41cyclictest17925-21munin-node07:50:030
473999803,60cyclictest13035-21df_abs08:29:560
473999803,59cyclictest1419-21runrttasks06:04:590
473999803,58cyclictest6493-21runrttasks07:32:260
473999803,58cyclictest0-21swapper/007:40:160
473999803,56cyclictest1797-21sh09:49:510
248599800,5rtkit-daemon2484-21rtkit-daemon07:05:033
248599800,4rtkit-daemon2484-21rtkit-daemon10:49:243
248599800,4rtkit-daemon2484-21rtkit-daemon10:03:343
248599800,4rtkit-daemon2484-21rtkit-daemon08:52:593
248599800,4rtkit-daemon2484-21rtkit-daemon08:47:143
248599800,4rtkit-daemon2484-21rtkit-daemon08:35:453
248599800,4rtkit-daemon2484-21rtkit-daemon07:47:173
474399798,24cyclictest0-21swapper/107:54:431
474399794,32cyclictest0-21swapper/106:55:041
473999794,68cyclictest0-21swapper/008:12:220
473999794,42cyclictest0-21swapper/007:22:290
473999794,42cyclictest0-21swapper/007:22:290
473999793,69cyclictest0-21swapper/010:11:210
473999793,52cyclictest0-21swapper/009:33:290
248599790,4rtkit-daemon2484-21rtkit-daemon09:58:263
248599790,4rtkit-daemon2484-21rtkit-daemon08:07:163
248599790,4rtkit-daemon2484-21rtkit-daemon08:07:163
248599790,4rtkit-daemon2484-21rtkit-daemon05:45:363
248599790,4rtkit-daemon2484-21rtkit-daemon05:30:373
248599790,4rtkit-daemon2484-21rtkit-daemon05:28:373
473999788,54cyclictest0-21swapper/008:36:500
473999784,67cyclictest0-21swapper/007:14:570
473999784,66cyclictest0-21swapper/008:50:080
473999784,66cyclictest0-21swapper/008:25:110
473999784,58cyclictest0-21swapper/009:23:210
473999784,58cyclictest0-21swapper/008:49:240
473999784,55cyclictest0-21swapper/010:40:120
473999783,65cyclictest19068-21idleruntime-cro05:49:480
4739997817,36cyclictest22277-21cpu10:19:490
248599780,5rtkit-daemon2484-21rtkit-daemon09:10:213
248599780,4rtkit-daemon2484-21rtkit-daemon09:37:203
248599780,4rtkit-daemon2484-21rtkit-daemon08:34:153
248599780,4rtkit-daemon2484-21rtkit-daemon08:17:383
473999773,55cyclictest0-21swapper/010:04:570
473999773,55cyclictest0-21swapper/010:04:570
473999773,55cyclictest0-21swapper/008:23:090
248599770,4rtkit-daemon2484-21rtkit-daemon10:15:113
248599770,4rtkit-daemon2484-21rtkit-daemon10:06:043
248599770,4rtkit-daemon2484-21rtkit-daemon10:06:043
248599770,4rtkit-daemon2484-21rtkit-daemon09:48:193
248599770,4rtkit-daemon2484-21rtkit-daemon09:16:063
248599770,4rtkit-daemon2484-21rtkit-daemon07:44:323
248599770,4rtkit-daemon2484-21rtkit-daemon07:21:103
248599770,4rtkit-daemon2484-21rtkit-daemon07:21:103
248599770,4rtkit-daemon2484-21rtkit-daemon06:04:583
248599770,4rtkit-daemon2484-21rtkit-daemon06:00:363
473999763,66cyclictest3714-21munin-node06:25:210
473999763,66cyclictest0-21swapper/008:02:560
248599760,4rtkit-daemon2484-21rtkit-daemon07:36:023
473999754,64cyclictest0-21swapper/009:25:040
473999754,64cyclictest0-21swapper/007:56:050
473999754,62cyclictest31925-21ssh09:45:030
248599750,4rtkit-daemon2484-21rtkit-daemon09:05:363
473999744,63cyclictest0-21swapper/006:03:170
473999743,63cyclictest14070-21tail06:45:050
473999743,63cyclictest1051-21rs:main0
4739997416,40cyclictest0-21swapper/010:14:510
473999733,63cyclictest20948-21unixbench-2d05:50:220
473999733,63cyclictest10940-21tail06:39:570
473999723,62cyclictest25576-21tr07:09:580
473999723,61cyclictest7679-21tr05:25:020
473999723,61cyclictest1287-21snmpd05:22:310
473999723,61cyclictest10030-21grep06:35:190
473999713,62cyclictest12276-21tail05:34:590
473999713,61cyclictest0-21swapper/006:14:580
473999703,58cyclictest15703-21cut06:49:560
4739997023,41cyclictest1419-21runrttasks05:41:540
4739997011,34cyclictest121850irq/46-eth005:55:000
4739997011,34cyclictest121850irq/46-eth005:55:000
473999693,58cyclictest0-21swapper/005:30:150
4739996923,40cyclictest18164-21head06:54:570
473999683,56cyclictest6662-21df_abs06:30:010
4739996722,39cyclictest1419-21runrttasks06:22:080
248599650,4rtkit-daemon2484-21rtkit-daemon10:20:033
248599640,15rtkit-daemon2484-21rtkit-daemon08:04:233
248599640,14rtkit-daemon2484-21rtkit-daemon08:42:372
248599640,10rtkit-daemon0-21swapper/010:29:551
473999633,34cyclictest0-21swapper/005:19:500
4739996311,45cyclictest204222chrt06:59:470
248599630,13rtkit-daemon2484-21rtkit-daemon07:21:552
248599630,13rtkit-daemon2484-21rtkit-daemon07:21:552
248599620,5rtkit-daemon2484-21rtkit-daemon09:15:212
248599620,5rtkit-daemon2484-21rtkit-daemon07:26:402
248599620,4rtkit-daemon2484-21rtkit-daemon06:05:212
248599620,13rtkit-daemon2484-21rtkit-daemon08:46:372
248599620,13rtkit-daemon2484-21rtkit-daemon08:19:002
248599610,13rtkit-daemon2484-21rtkit-daemon09:29:503
248599610,12rtkit-daemon2484-21rtkit-daemon08:54:062
248599610,12rtkit-daemon2484-21rtkit-daemon06:26:052
474499604,21cyclictest0-21swapper/209:22:482
4744996032,22cyclictest12175-21aten_r1power_en05:34:582
248599600,7rtkit-daemon0-21swapper/208:42:223
248599600,4rtkit-daemon2484-21rtkit-daemon10:11:182
248599600,12rtkit-daemon2484-21rtkit-daemon10:15:332
248599600,12rtkit-daemon2484-21rtkit-daemon09:50:272
248599600,12rtkit-daemon2484-21rtkit-daemon09:38:352
248599600,12rtkit-daemon2484-21rtkit-daemon05:30:592
248599600,10rtkit-daemon0-21swapper/010:35:551
474499594,12cyclictest0-21swapper/210:30:062
4743995929,12cyclictest30068-21tail07:20:041
4743995929,12cyclictest30068-21tail07:20:041
474599585,43cyclictest1419-21runrttasks08:20:093
4744995840,12cyclictest0-21swapper/210:47:032
4743995813,28cyclictest0-21swapper/107:39:551
248599580,7rtkit-daemon0-21swapper/210:28:553
248599580,5rtkit-daemon2484-21rtkit-daemon07:50:312
202182583,12sleep20-21swapper/206:59:462
474599572,22cyclictest0-21swapper/309:23:233
474499574,45cyclictest0-21swapper/209:44:582
474499574,23cyclictest0-21swapper/207:44:502
4744995712,26cyclictest0-21swapper/209:04:562
248599570,4rtkit-daemon2484-21rtkit-daemon10:03:562
248599570,4rtkit-daemon2484-21rtkit-daemon08:24:532
248599570,4rtkit-daemon2484-21rtkit-daemon06:33:422
474599564,35cyclictest0-21swapper/307:26:173
474599564,26cyclictest0-21swapper/310:35:033
474599563,45cyclictest4181-21df_abs06:25:023
474499564,44cyclictest0-21swapper/209:25:092
474499564,23cyclictest0-21swapper/208:09:452
474399565,18cyclictest1491-21missed_timers07:25:091
474399564,21cyclictest0-21swapper/107:36:271
4743995637,11cyclictest1419-21runrttasks08:50:141
248599560,5rtkit-daemon2484-21rtkit-daemon09:58:492
248599560,4rtkit-daemon2484-21rtkit-daemon06:46:562
474499553,21cyclictest121850irq/46-eth008:36:492
474499553,20cyclictest0-21swapper/210:05:102
474499553,20cyclictest0-21swapper/210:05:102
4744995522,26cyclictest22404-21unixbench-2d09:30:102
4744995517,23cyclictest0-21swapper/207:38:202
474399555,42cyclictest0-21swapper/108:48:131
474399555,28cyclictest0-21swapper/109:09:411
474399554,42cyclictest0-21swapper/110:00:061
474399554,32cyclictest0-21swapper/110:15:061
4743995519,28cyclictest7572-21gltestperf10:44:551
248599550,5rtkit-daemon2484-21rtkit-daemon08:31:152
248599550,4rtkit-daemon2484-21rtkit-daemon08:23:302
248599550,4rtkit-daemon2484-21rtkit-daemon08:08:462
248599550,4rtkit-daemon2484-21rtkit-daemon08:08:462
4745995423,13cyclictest0-21swapper/309:40:073
474499544,43cyclictest0-21swapper/208:00:322
474499544,30cyclictest0-21swapper/209:14:412
474499543,37cyclictest1287-21snmpd05:42:322
254502543,43sleep20-21swapper/206:00:172
248599540,5rtkit-daemon2484-21rtkit-daemon09:02:292
248599540,5rtkit-daemon2484-21rtkit-daemon08:54:592
248599540,5rtkit-daemon2484-21rtkit-daemon07:44:022
248599540,5rtkit-daemon2484-21rtkit-daemon07:13:252
248599540,5rtkit-daemon2484-21rtkit-daemon06:50:042
248599540,5rtkit-daemon2484-21rtkit-daemon06:15:352
248599540,5rtkit-daemon2484-21rtkit-daemon06:10:052
248599540,5rtkit-daemon2484-21rtkit-daemon05:45:592
248599540,4rtkit-daemon2484-21rtkit-daemon07:56:242
248599540,4rtkit-daemon2484-21rtkit-daemon07:09:182
248599540,4rtkit-daemon2484-21rtkit-daemon05:55:362
248599540,4rtkit-daemon2484-21rtkit-daemon05:55:362
4745995329,10cyclictest5304-21awk07:30:123
4743995325,10cyclictest14699-21ssh10:08:171
4743995325,10cyclictest14699-21ssh10:08:171
248599530,5rtkit-daemon2484-21rtkit-daemon07:31:252
248599530,5rtkit-daemon2484-21rtkit-daemon06:39:572
248599530,5rtkit-daemon2484-21rtkit-daemon06:20:052
248599530,4rtkit-daemon2484-21rtkit-daemon10:20:562
7952522,9sleep30-21swapper/306:18:153
474599525,29cyclictest0-21swapper/305:20:223
4745995233,11cyclictest2343-21kernelversion06:20:113
474499524,30cyclictest0-21swapper/210:25:132
474499524,25cyclictest0-21swapper/206:34:582
474499523,44cyclictest0-21swapper/210:39:262
4744995222,13cyclictest0-21swapper/207:15:142
474399525,38cyclictest0-21swapper/108:20:091
474399524,31cyclictest0-21swapper/108:09:561
4743995231,13cyclictest0-21swapper/107:55:081
4743995220,13cyclictest0-21swapper/106:44:571
263782522,9sleep30-21swapper/307:12:083
248599520,4rtkit-daemon2484-21rtkit-daemon09:40:352
474599514,27cyclictest0-21swapper/305:59:493
474399515,28cyclictest0-21swapper/106:00:001
474399514,38cyclictest0-21swapper/110:24:581
474399514,29cyclictest0-21swapper/106:25:101
474399514,28cyclictest0-21swapper/110:09:561
474399514,28cyclictest0-21swapper/107:45:141
4743995133,10cyclictest21636-21needreboot07:00:101
4743995127,11cyclictest0-21swapper/108:25:161
4743995112,23cyclictest5392-21tail09:54:511
308562516,9sleep10-21swapper/108:08:461
308562516,9sleep10-21swapper/108:08:461
474599509,23cyclictest0-21swapper/310:43:323
474599504,29cyclictest0-21swapper/310:29:493
474599504,28cyclictest0-21swapper/306:10:093
474599504,26cyclictest18997-21kernelversion07:50:053
474599504,14cyclictest0-21swapper/310:13:473
474499504,39cyclictest0-21swapper/210:39:562
474399506,27cyclictest0-21swapper/109:50:161
474399505,27cyclictest0-21swapper/106:15:041
474399504,28cyclictest0-21swapper/107:29:581
474399504,28cyclictest0-21swapper/105:45:211
474399504,27cyclictest0-21swapper/106:09:591
474399504,12cyclictest3307-21runrttasks09:03:471
4743995030,12cyclictest0-21swapper/110:19:501
4743995021,12cyclictest0-21swapper/108:19:431
4743995020,13cyclictest0-21swapper/109:30:521
151182503,40sleep10-21swapper/109:20:061
474599494,38cyclictest0-21swapper/308:10:183
474599494,36cyclictest0-21swapper/308:24:533
474599494,32cyclictest0-21swapper/309:27:563
474599494,27cyclictest0-21swapper/306:55:023
474599494,23cyclictest0-21swapper/305:50:003
4745994919,12cyclictest0-21swapper/305:19:503
474499494,28cyclictest0-21swapper/205:20:162
474399495,27cyclictest0-21swapper/106:30:171
474399494,27cyclictest0-21swapper/108:56:501
474399494,27cyclictest0-21swapper/108:33:511
4743994923,12cyclictest0-21swapper/110:43:381
248599490,5rtkit-daemon2484-21rtkit-daemon09:50:123
144392492,9sleep30-21swapper/305:39:503
4745994818,13cyclictest0-21swapper/305:35:133
474499484,27cyclictest0-21swapper/205:25:182
4744994834,8cyclictest19608-21tr05:50:032
474499483,27cyclictest0-21swapper/207:00:002
474399485,34cyclictest0-21swapper/105:30:001
474399484,28cyclictest0-21swapper/109:34:551
474399484,27cyclictest0-21swapper/105:20:121
474399484,14cyclictest13029-21sshd05:35:071
4743994818,11cyclictest1287-21snmpd05:25:051
228422480,6sleep30-21swapper/305:55:133
80542472,9sleep30-21swapper/306:32:103
474399476,33cyclictest0-21swapper/106:20:121
474399464,26cyclictest0-21swapper/105:50:221
4743994619,11cyclictest0-21swapper/107:06:521
474599454,34cyclictest0-21swapper/306:49:573
474399454,34cyclictest0-21swapper/107:09:561
474399454,26cyclictest0-21swapper/106:42:421
474399454,22cyclictest0-21swapper/106:49:561
474399453,25cyclictest0-21swapper/107:15:081
248599450,5rtkit-daemon2484-21rtkit-daemon06:35:193
474599444,33cyclictest0-21swapper/307:15:143
474399444,32cyclictest0-21swapper/105:59:491
474399444,32cyclictest0-21swapper/105:59:491
4743994216,7cyclictest4937-21cat05:19:511
248599410,5rtkit-daemon2484-21rtkit-daemon05:15:082
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional