You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-31 - 20:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Tue Mar 31, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2023921070,4sleep220238-21df_abs09:58:222
65062800,4chrt6509-21idleruntime-cro06:03:151
248599800,7rtkit-daemon0-21swapper/109:08:210
248599770,6rtkit-daemon0-21swapper/306:24:570
248599770,6rtkit-daemon0-21swapper/306:24:570
248599770,21rtkit-daemon1287-21snmpd05:38:592
248599770,21rtkit-daemon1287-21snmpd05:38:592
248599730,6rtkit-daemon0-21swapper/305:55:132
189602710,4sleep319107-21expr06:28:293
248599700,8rtkit-daemon0-21swapper/306:12:282
248599680,8rtkit-daemon0-21swapper/305:43:442
2210699684,55cyclictest0-21swapper/310:33:283
248599670,7rtkit-daemon0-21swapper/306:20:572
248599670,6rtkit-daemon25988-21ntp_states05:33:442
2210699674,56cyclictest0-21swapper/309:48:183
2210699674,56cyclictest0-21swapper/309:48:183
248599660,6rtkit-daemon0-21swapper/306:13:282
248599660,6rtkit-daemon0-21swapper/305:48:592
248599660,5rtkit-daemon0-21swapper/306:04:212
248599650,5rtkit-daemon16311-21munin-node06:23:352
248599650,5rtkit-daemon16311-21munin-node06:23:352
2210699655,54cyclictest0-21swapper/307:33:153
2210699654,52cyclictest0-21swapper/307:38:243
248599640,5rtkit-daemon0-21swapper/305:59:062
22105996411,29cyclictest0-21swapper/210:43:052
248599630,6rtkit-daemon0-21swapper/305:29:302
22106996318,24cyclictest4352-21sendmail_mailqu09:33:363
22104996230,13cyclictest0-21swapper/110:23:391
2210299625,51cyclictest0-21swapper/005:48:320
222572615,10sleep00-21swapper/010:48:280
22105996124,15cyclictest4502-21idleruntime07:58:322
2210499617,48cyclictest0-21swapper/110:06:051
2210499613,52cyclictest0-21swapper/108:25:481
2210499613,52cyclictest0-21swapper/108:25:481
122342612,51sleep20-21swapper/208:09:102
2210699604,49cyclictest0-21swapper/309:09:523
2210499603,52cyclictest0-21swapper/110:14:421
2210499603,51cyclictest0-21swapper/108:00:411
2210499603,50cyclictest0-21swapper/107:30:211
66152593,48sleep00-21swapper/008:03:110
2210699593,49cyclictest0-21swapper/310:18:193
2210599595,46cyclictest0-21swapper/209:28:342
2210599594,46cyclictest0-21swapper/208:53:342
22105995923,11cyclictest1419-21runrttasks07:48:062
22105995923,11cyclictest1419-21runrttasks07:48:062
2210499593,51cyclictest0-21swapper/109:29:161
2210499593,51cyclictest0-21swapper/108:35:541
2210499593,50cyclictest0-21swapper/110:49:301
2210499593,50cyclictest0-21swapper/110:44:041
2210499593,50cyclictest0-21swapper/110:09:441
2210499593,50cyclictest0-21swapper/108:47:571
2210499593,49cyclictest0-21swapper/108:50:221
2210499592,51cyclictest0-21swapper/109:22:521
22104995919,23cyclictest0-21swapper/110:41:331
312842584,46sleep20-21swapper/208:38:292
22106995841,10cyclictest18624-21gltestperf10:43:233
2210699583,48cyclictest8361-21aten2.4-expect08:53:193
2210699583,48cyclictest0-21swapper/309:28:213
2210499584,48cyclictest0-21swapper/108:31:201
2210499584,48cyclictest0-21swapper/108:31:201
2210499583,50cyclictest0-21swapper/110:19:051
2210499583,47cyclictest14283-21ntp_states09:48:321
2210499583,47cyclictest14283-21ntp_states09:48:321
2210499583,45cyclictest0-21swapper/110:28:281
2210499583,45cyclictest0-21swapper/110:28:281
2210299583,11cyclictest0-21swapper/009:30:280
2210699574,46cyclictest0-21swapper/308:08:283
22105995726,11cyclictest14834-21diskmemload10:12:192
2210499573,49cyclictest0-21swapper/110:02:051
2210499573,49cyclictest0-21swapper/108:10:181
2210499573,48cyclictest0-21swapper/109:48:021
2210499573,48cyclictest0-21swapper/109:48:021
2210499573,48cyclictest0-21swapper/109:25:351
2210499573,48cyclictest0-21swapper/109:11:091
2210499573,46cyclictest0-21swapper/106:43:501
2210299575,12cyclictest0-21swapper/009:53:320
2210299574,46cyclictest0-21swapper/009:33:330
2210299574,45cyclictest0-21swapper/010:18:380
146932573,8sleep214698-21crond09:03:082
248599560,4rtkit-daemon2484-21rtkit-daemon08:21:001
22106995640,10cyclictest26769-21cpuspeed_turbos10:08:193
2210699564,46cyclictest26127-21ssh09:18:303
22106995638,10cyclictest10496-21gltestperf09:43:273
22106995638,10cyclictest10496-21gltestperf09:43:273
22105995639,11cyclictest26027-21wc09:18:282
22105995611,25cyclictest0-21swapper/208:43:312
2210499564,30cyclictest0-21swapper/109:15:491
2210499563,49cyclictest0-21swapper/108:14:111
2210499563,48cyclictest0-21swapper/107:49:041
2210499563,48cyclictest0-21swapper/107:49:041
2210499563,48cyclictest0-21swapper/107:35:101
2210499563,45cyclictest0-21swapper/105:33:401
2210499563,33cyclictest0-21swapper/109:03:221
2210499563,33cyclictest0-21swapper/109:03:221
2210499562,49cyclictest0-21swapper/109:56:571
2210499562,47cyclictest0-21swapper/108:05:051
2210299565,45cyclictest0-21swapper/010:42:500
2210299563,10cyclictest29857-21cut07:48:290
2210299563,10cyclictest29857-21cut07:48:290
22102995617,32cyclictest24451-21munin-node10:53:210
134902563,47sleep313495-21yum08:58:453
43852553,45sleep10-21swapper/109:33:391
327612552,46sleep00-21swapper/006:58:010
22106995536,11cyclictest23233-21crond06:38:143
2210699553,9cyclictest23047-21munin-node10:03:323
2210599554,14cyclictest0-21swapper/210:24:022
22105995511,26cyclictest0-21swapper/207:33:232
22105995510,11cyclictest29267-21cpuspeed_turbos07:48:242
22105995510,11cyclictest29267-21cpuspeed_turbos07:48:242
2210499554,31cyclictest0-21swapper/106:58:491
2210499553,46cyclictest0-21swapper/109:39:051
2210499553,45cyclictest0-21swapper/110:36:391
2210299555,43cyclictest0-21swapper/008:18:350
2210299554,44cyclictest0-21swapper/010:28:250
2210299554,44cyclictest0-21swapper/010:28:250
22102995522,13cyclictest0-21swapper/008:14:440
313522543,44sleep331354-21sh09:27:283
274882543,43sleep00-21swapper/007:44:120
274882543,43sleep00-21swapper/007:44:120
248599540,3rtkit-daemon2484-21rtkit-daemon10:15:330
2210699544,32cyclictest0-21swapper/308:03:263
2210699543,45cyclictest0-21swapper/308:42:143
2210699543,44cyclictest0-21swapper/307:23:243
2210699543,10cyclictest0-21swapper/308:38:013
22106995422,24cyclictest1419-21runrttasks07:29:313
22105995423,13cyclictest0-21swapper/208:33:442
22105995423,12cyclictest30446-21tune2fs10:13:232
22105995422,12cyclictest2513-21udisks-daemon07:38:352
22105995420,14cyclictest0-21swapper/208:23:302
22105995420,14cyclictest0-21swapper/208:23:302
22105995410,26cyclictest0-21swapper/209:38:202
2210499545,32cyclictest0-21swapper/107:40:151
2210499545,29cyclictest0-21swapper/107:57:501
22104995437,9cyclictest31385-21cut06:53:311
2210499543,46cyclictest0-21swapper/108:39:171
2210499543,46cyclictest0-21swapper/107:46:181
2210499543,46cyclictest0-21swapper/107:46:181
2210499543,45cyclictest25021-21sed10:53:181
2210499542,46cyclictest0-21swapper/108:53:391
2210299543,46cyclictest0-21swapper/009:27:300
150722543,7sleep215076-21ssh09:49:322
150722543,7sleep215076-21ssh09:49:322
74082533,43sleep10-21swapper/107:10:031
74082533,43sleep10-21swapper/107:10:031
265832532,9sleep30-21swapper/305:34:483
248599530,5rtkit-daemon2484-21rtkit-daemon09:48:190
248599530,5rtkit-daemon2484-21rtkit-daemon09:48:190
248599530,5rtkit-daemon2484-21rtkit-daemon08:51:370
248599530,4rtkit-daemon2484-21rtkit-daemon05:23:452
2210699534,43cyclictest0-21swapper/309:07:323
2210699534,43cyclictest0-21swapper/309:07:323
2210699533,44cyclictest0-21swapper/310:02:373
2210699533,44cyclictest0-21swapper/309:13:233
22106995312,23cyclictest34-21rcuc/309:38:253
2210599535,42cyclictest0-21swapper/210:56:152
2210599535,28cyclictest0-21swapper/207:08:212
2210599535,28cyclictest0-21swapper/207:08:212
2210599535,22cyclictest0-21swapper/210:28:182
2210599535,22cyclictest0-21swapper/210:28:182
2210599535,14cyclictest0-21swapper/209:53:242
2210599534,39cyclictest0-21swapper/208:28:212
2210599534,39cyclictest0-21swapper/208:28:212
22105995329,18cyclictest4932-21runrttasks09:34:202
2210499534,30cyclictest0-21swapper/108:58:291
2210499534,29cyclictest0-21swapper/106:28:461
2210499533,44cyclictest0-21swapper/105:38:481
2210499533,44cyclictest0-21swapper/105:38:481
22104995321,14cyclictest0-21swapper/106:16:241
2210299535,40cyclictest0-21swapper/007:35:130
267352523,7sleep314834-21diskmemload08:32:533
267352523,7sleep314834-21diskmemload08:32:533
248599520,5rtkit-daemon2484-21rtkit-daemon10:43:170
248599520,5rtkit-daemon2484-21rtkit-daemon09:43:200
248599520,5rtkit-daemon2484-21rtkit-daemon09:43:200
248599520,5rtkit-daemon2484-21rtkit-daemon08:59:510
2210699524,29cyclictest0-21swapper/307:43:413
2210699524,29cyclictest0-21swapper/307:43:413
2210699524,27cyclictest0-21swapper/308:43:413
2210699524,26cyclictest0-21swapper/308:18:113
2210699523,43cyclictest0-21swapper/310:53:273
2210699522,10cyclictest0-21swapper/309:55:193
2210599528,37cyclictest281ktimersoftd/206:43:332
2210599526,28cyclictest0-21swapper/210:19:512
2210599525,28cyclictest0-21swapper/207:23:302
2210599525,28cyclictest0-21swapper/206:58:372
2210599525,27cyclictest5965-21irqstats08:48:322
2210599525,26cyclictest17566-21df_inode08:18:272
2210599524,30cyclictest0-21swapper/209:03:272
2210599524,30cyclictest0-21swapper/209:03:272
2210599524,30cyclictest0-21swapper/207:03:452
2210599524,30cyclictest0-21swapper/207:03:452
2210599524,29cyclictest0-21swapper/210:03:282
2210599524,27cyclictest0-21swapper/208:08:102
22105995230,15cyclictest0-21swapper/207:33:112
2210499523,44cyclictest0-21swapper/107:03:481
2210499523,44cyclictest0-21swapper/107:03:481
2210499523,43cyclictest0-21swapper/105:43:471
2210499522,44cyclictest0-21swapper/107:13:271
2210499522,44cyclictest0-21swapper/106:37:461
2210299526,40cyclictest0-21swapper/008:53:320
2210299524,42cyclictest0-21swapper/010:03:270
2210299524,40cyclictest0-21swapper/008:23:440
2210299524,40cyclictest0-21swapper/008:23:440
2210299523,45cyclictest0-21swapper/010:08:290
2210299523,42cyclictest0-21swapper/010:33:210
2210299523,42cyclictest0-21swapper/009:58:310
122992522,9sleep00-21swapper/008:09:240
26772512,9sleep00-21swapper/007:00:350
248599510,5rtkit-daemon2484-21rtkit-daemon10:23:330
248599510,5rtkit-daemon2484-21rtkit-daemon09:15:280
248599510,5rtkit-daemon2484-21rtkit-daemon09:03:360
248599510,5rtkit-daemon2484-21rtkit-daemon09:03:360
248599510,5rtkit-daemon2484-21rtkit-daemon07:18:251
248599510,4rtkit-daemon2484-21rtkit-daemon06:38:271
238772513,42sleep00-21swapper/007:38:480
2210699519,24cyclictest0-21swapper/307:53:423
2210699516,27cyclictest0-21swapper/305:33:163
2210699515,28cyclictest0-21swapper/308:28:093
2210699515,28cyclictest0-21swapper/308:28:093
2210699514,41cyclictest0-21swapper/310:48:453
2210699514,41cyclictest0-21swapper/310:23:303
2210699514,30cyclictest0-21swapper/310:13:173
2210699514,28cyclictest0-21swapper/307:08:293
2210699514,28cyclictest0-21swapper/307:08:293
22106995133,12cyclictest5807-21gltestperf08:48:293
2210699512,43cyclictest0-21swapper/306:08:453
22106995117,12cyclictest0-21swapper/308:00:563
2210599516,20cyclictest20719-21ssh09:10:312
2210599515,8cyclictest281ktimersoftd/210:48:232
2210599515,28cyclictest0-21swapper/210:33:182
2210599515,28cyclictest0-21swapper/206:38:302
2210599515,28cyclictest0-21swapper/206:33:322
2210599514,29cyclictest0-21swapper/207:18:332
2210599514,28cyclictest0-21swapper/209:23:302
2210599514,28cyclictest0-21swapper/208:13:252
2210599514,28cyclictest0-21swapper/206:28:302
22105995121,13cyclictest0-21swapper/210:43:402
22105995120,13cyclictest0-21swapper/209:17:452
22105995112,15cyclictest0-21swapper/207:53:322
2210499513,41cyclictest0-21swapper/106:23:271
2210499513,41cyclictest0-21swapper/106:23:271
22104995119,14cyclictest0-21swapper/106:12:231
2210299516,28cyclictest0-21swapper/005:58:490
2210299514,41cyclictest0-21swapper/007:53:350
2210299514,40cyclictest0-21swapper/009:38:370
2210299513,43cyclictest1287-21snmpd05:44:350
2210299513,35cyclictest0-21swapper/007:29:250
220222514,6sleep00-21swapper/005:27:400
169432513,7sleep316949-21ssh10:41:133
121722512,44sleep00-21swapper/007:19:410
97002502,42sleep00-21swapper/007:13:490
39062502,9sleep30-21swapper/305:55:363
2210699504,29cyclictest0-21swapper/306:48:293
2210699504,28cyclictest0-21swapper/306:23:313
2210699504,28cyclictest0-21swapper/306:23:313
2210699504,28cyclictest0-21swapper/306:18:253
2210699504,27cyclictest0-21swapper/307:17:113
2210699504,27cyclictest0-21swapper/306:58:443
2210699504,13cyclictest0-21swapper/310:29:313
2210699504,13cyclictest0-21swapper/310:29:313
2210599504,28cyclictest0-21swapper/206:53:352
22105995027,15cyclictest9946-21cpuspeed_turbos09:43:212
22105995027,15cyclictest9946-21cpuspeed_turbos09:43:212
2210499503,42cyclictest0-21swapper/106:03:441
2210499503,41cyclictest0-21swapper/106:48:491
2210499503,41cyclictest0-21swapper/105:53:281
2210299505,13cyclictest0-21swapper/008:33:400
2210299504,41cyclictest0-21swapper/008:47:290
2210299504,40cyclictest0-21swapper/006:03:290
2210299504,38cyclictest0-21swapper/008:03:230
2210299503,42cyclictest0-21swapper/008:31:310
2210299503,42cyclictest0-21swapper/008:31:310
2210299503,39cyclictest0-21swapper/009:18:190
135042502,9sleep00-21swapper/006:16:170
234682492,9sleep00-21swapper/006:38:220
2210699494,28cyclictest0-21swapper/305:58:433
2210699494,27cyclictest0-21swapper/306:38:473
2210699494,25cyclictest0-21swapper/308:13:373
22106994933,10cyclictest4622-21wc07:03:453
22106994933,10cyclictest4622-21wc07:03:453
22106994933,10cyclictest13178-21unixbench-2d06:13:483
2210699493,40cyclictest0-21swapper/307:48:533
2210699493,40cyclictest0-21swapper/307:48:533
2210699492,42cyclictest0-21swapper/306:53:413
2210599494,26cyclictest0-21swapper/207:13:322
2210499495,26cyclictest0-21swapper/105:48:441
2210499494,38cyclictest0-21swapper/106:18:461
2210499492,42cyclictest0-21swapper/105:28:321
2210299495,36cyclictest27438-21cpuspeed_turbos05:38:290
2210299495,36cyclictest27438-21cpuspeed_turbos05:38:290
160332492,42sleep00-21swapper/006:22:460
2210699484,28cyclictest0-21swapper/305:38:373
2210699484,28cyclictest0-21swapper/305:38:373
2210699484,13cyclictest0-21swapper/305:43:343
22106994830,11cyclictest7091-21cpuspeed_turbos06:03:293
2210699483,29cyclictest0-21swapper/306:43:483
2210499485,24cyclictest14834-21diskmemload07:28:111
2210299485,14cyclictest0-21swapper/008:38:420
22102994811,30cyclictest0-21swapper/006:08:330
145512482,39sleep00-21swapper/007:24:370
301122472,9sleep00-21swapper/006:49:340
266872472,39sleep00-21swapper/005:36:100
2210699473,28cyclictest0-21swapper/307:22:123
2210599475,34cyclictest0-21swapper/206:48:282
2210299475,37cyclictest0-21swapper/007:03:460
2210299475,37cyclictest0-21swapper/007:03:460
22102994732,9cyclictest22787-21grep06:33:480
258542462,37sleep00-21swapper/006:43:220
2210699464,36cyclictest0-21swapper/305:48:433
2210299465,35cyclictest0-21swapper/005:28:270
205252452,9sleep00-21swapper/006:29:070
22102994431,8cyclictest2633-21grep05:53:350
2210299434,33cyclictest0-21swapper/007:08:340
2210299434,33cyclictest0-21swapper/007:08:340
2210699424,30cyclictest0-21swapper/305:28:173
220282423,33sleep10-21swapper/105:27:451
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional