You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-30 - 04:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Thu Apr 30, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
248599970,6rtkit-daemon0-21swapper/121:05:171
248599930,7rtkit-daemon0-21swapper/121:06:241
248599920,6rtkit-daemon0-21swapper/120:02:041
248599920,4rtkit-daemon2484-21rtkit-daemon17:18:331
248599910,6rtkit-daemon0-21swapper/120:02:122
248599910,4rtkit-daemon2484-21rtkit-daemon17:55:171
248599900,6rtkit-daemon0-21swapper/117:06:112
248599900,4rtkit-daemon2484-21rtkit-daemon19:53:193
248599900,4rtkit-daemon2484-21rtkit-daemon17:47:391
248599890,5rtkit-daemon2484-21rtkit-daemon20:59:091
248599890,5rtkit-daemon2484-21rtkit-daemon20:59:091
248599890,5rtkit-daemon2484-21rtkit-daemon18:54:441
248599890,5rtkit-daemon2484-21rtkit-daemon18:54:441
248599890,4rtkit-daemon2484-21rtkit-daemon21:11:011
248599890,4rtkit-daemon2484-21rtkit-daemon18:56:221
248599890,4rtkit-daemon2484-21rtkit-daemon18:43:371
248599880,6rtkit-daemon0-21swapper/120:46:172
248599880,5rtkit-daemon2484-21rtkit-daemon18:47:451
248599880,4rtkit-daemon2484-21rtkit-daemon20:50:321
248599880,4rtkit-daemon2484-21rtkit-daemon18:09:391
248599880,4rtkit-daemon2484-21rtkit-daemon18:09:391
248599850,7rtkit-daemon0-21swapper/017:31:032
248599850,4rtkit-daemon2484-21rtkit-daemon17:07:481
248599840,7rtkit-daemon0-21swapper/020:53:472
248599840,4rtkit-daemon2484-21rtkit-daemon20:46:253
248599830,8rtkit-daemon0-21swapper/021:20:162
248599830,7rtkit-daemon0-21swapper/019:42:272
248599830,7rtkit-daemon0-21swapper/018:00:462
248599810,5rtkit-daemon2484-21rtkit-daemon17:12:411
248599810,4rtkit-daemon2484-21rtkit-daemon18:40:071
248599810,4rtkit-daemon2484-21rtkit-daemon17:20:551
248599800,4rtkit-daemon2484-21rtkit-daemon18:16:011
248599790,6rtkit-daemon0-21swapper/021:10:312
248599790,5rtkit-daemon2484-21rtkit-daemon20:40:031
248599790,5rtkit-daemon2484-21rtkit-daemon20:34:031
248599790,5rtkit-daemon2484-21rtkit-daemon20:26:331
248599780,4rtkit-daemon2484-21rtkit-daemon21:16:541
248599770,4rtkit-daemon2484-21rtkit-daemon17:59:461
248599770,4rtkit-daemon2484-21rtkit-daemon17:31:181
248599760,4rtkit-daemon2484-21rtkit-daemon20:20:481
248599760,4rtkit-daemon2484-21rtkit-daemon20:09:411
248599760,4rtkit-daemon2484-21rtkit-daemon19:50:351
248599760,4rtkit-daemon2484-21rtkit-daemon17:40:551
248599760,11rtkit-daemon34-21rcuc/321:21:013
2693627211,18sleep20-21swapper/216:55:502
248599720,8rtkit-daemon0-21swapper/019:00:441
248599720,6rtkit-daemon0-21swapper/117:05:110
248599710,6rtkit-daemon2484-21rtkit-daemon19:57:573
248599690,7rtkit-daemon0-21swapper/017:26:181
248599690,7rtkit-daemon0-21swapper/017:26:181
248599690,6rtkit-daemon2484-21rtkit-daemon18:11:383
248599690,5rtkit-daemon2484-21rtkit-daemon19:30:353
248599690,5rtkit-daemon2484-21rtkit-daemon19:30:353
248599680,4rtkit-daemon2484-21rtkit-daemon20:29:113
248599680,4rtkit-daemon2484-21rtkit-daemon20:11:263
248599670,5rtkit-daemon2484-21rtkit-daemon20:41:033
248599670,5rtkit-daemon2484-21rtkit-daemon19:42:423
248599670,4rtkit-daemon2484-21rtkit-daemon17:09:483
28541996620,40cyclictest15163-21yum-updatesd-he21:45:401
28543996537,12cyclictest0-21swapper/222:00:392
248599650,4rtkit-daemon2484-21rtkit-daemon21:03:243
248599650,4rtkit-daemon2484-21rtkit-daemon17:33:023
28543996438,12cyclictest0-21swapper/219:32:372
28543996438,12cyclictest0-21swapper/219:32:372
266062643,53sleep20-21swapper/221:02:482
248599640,5rtkit-daemon2484-21rtkit-daemon19:39:051
2854399634,44cyclictest0-21swapper/222:07:532
248599630,2rtkit-daemon0-21swapper/319:24:213
2854399624,50cyclictest0-21swapper/219:20:432
273142625,48sleep127374-21iostat16:55:531
248599620,7rtkit-daemon0-21swapper/319:29:583
248599620,6rtkit-daemon0-21swapper/019:41:571
248599620,4rtkit-daemon37-21ksoftirqd/319:37:283
248599620,10rtkit-daemon0-21swapper/319:13:363
313922613,10sleep20-21swapper/222:20:212
313922613,10sleep20-21swapper/222:20:212
28537996145,11cyclictest0-21swapper/021:44:060
28537996145,11cyclictest0-21swapper/019:20:580
248599610,9rtkit-daemon0-21swapper/319:17:583
248599610,9rtkit-daemon0-21swapper/317:01:193
248599610,7rtkit-daemon0-21swapper/319:06:213
248599610,7rtkit-daemon0-21swapper/318:19:163
248599610,6rtkit-daemon0-21swapper/320:30:563
248599610,4rtkit-daemon15004-21taskset17:36:253
93562603,50sleep00-21swapper/021:33:260
285952603,12sleep20-21swapper/222:10:572
285952603,12sleep20-21swapper/222:10:572
2853799606,23cyclictest0-21swapper/020:00:280
28537996043,10cyclictest21898-21grep19:00:440
248599600,9rtkit-daemon0-21swapper/017:13:112
248599600,8rtkit-daemon0-21swapper/020:39:402
248599600,7rtkit-daemon0-21swapper/017:50:092
302182593,12sleep30-21swapper/320:06:093
28537995944,10cyclictest0-21swapper/021:20:430
2853799594,46cyclictest0-21swapper/022:10:360
2853799594,46cyclictest0-21swapper/022:10:360
28537995938,14cyclictest0-21swapper/019:07:530
28537995937,15cyclictest0-21swapper/021:00:500
248599590,9rtkit-daemon0-21swapper/017:59:312
248599590,8rtkit-daemon0-21swapper/020:40:402
248599590,8rtkit-daemon0-21swapper/020:26:182
248599590,8rtkit-daemon0-21swapper/019:02:362
248599590,8rtkit-daemon0-21swapper/018:45:222
248599590,7rtkit-daemon0-21swapper/017:51:172
248599590,7rtkit-daemon0-21swapper/017:20:402
2854399585,21cyclictest0-21swapper/222:26:092
28543995823,12cyclictest0-21swapper/220:10:532
28543995814,10cyclictest1419-21runrttasks19:15:442
2854199584,40cyclictest0-21swapper/122:25:301
2853799586,45cyclictest0-21swapper/017:22:100
248599580,8rtkit-daemon0-21swapper/018:39:302
248599580,8rtkit-daemon0-21swapper/017:17:182
248599580,4rtkit-daemon5063-21sort18:25:453
248599580,4rtkit-daemon2484-21rtkit-daemon20:20:413
248599580,4rtkit-daemon2484-21rtkit-daemon18:38:523
248599580,12rtkit-daemon2484-21rtkit-daemon19:02:513
181232583,48sleep10-21swapper/120:47:231
16282583,48sleep10-21swapper/120:12:481
2854499577,39cyclictest0-21swapper/318:46:023
2854499575,44cyclictest23320-21df_inode17:55:483
2854499574,28cyclictest0-21swapper/322:20:323
2854199574,27cyclictest0-21swapper/119:59:411
2854199574,12cyclictest0-21swapper/121:38:341
2854199574,12cyclictest0-21swapper/119:16:341
2853799575,45cyclictest0-21swapper/019:35:440
28537995740,11cyclictest0-21swapper/022:00:230
28537995738,13cyclictest0-21swapper/020:10:560
28537995736,15cyclictest0-21swapper/022:00:570
277772573,44sleep027800-21python16:56:000
248599570,8rtkit-daemon0-21swapper/020:58:092
248599570,8rtkit-daemon0-21swapper/020:58:092
248599570,8rtkit-daemon0-21swapper/018:16:312
248599570,8rtkit-daemon0-21swapper/018:09:242
248599570,8rtkit-daemon0-21swapper/018:09:242
248599570,7rtkit-daemon0-21swapper/020:09:262
248599570,7rtkit-daemon0-21swapper/018:11:232
248599570,6rtkit-daemon0-21swapper/018:51:292
248599570,6rtkit-daemon0-21swapper/018:51:292
45212562,9sleep20-21swapper/221:23:492
28544995627,12cyclictest27630-21http_loadtime22:10:423
28544995627,12cyclictest27630-21http_loadtime22:10:423
28543995638,11cyclictest7164-21tr21:30:372
28543995618,23cyclictest0-21swapper/222:22:292
2854199565,31cyclictest0-21swapper/119:46:011
2854199564,15cyclictest0-21swapper/121:21:371
2854199564,12cyclictest0-21swapper/120:19:471
2854199564,12cyclictest0-21swapper/120:19:471
2854199563,12cyclictest0-21swapper/122:01:321
28541995621,16cyclictest0-21swapper/122:16:111
28541995621,16cyclictest0-21swapper/122:16:111
2853799564,46cyclictest0-21swapper/019:31:020
2853799564,46cyclictest0-21swapper/019:31:020
28537995637,12cyclictest0-21swapper/018:15:320
28537995636,13cyclictest0-21swapper/021:40:230
28537995636,13cyclictest0-21swapper/019:46:010
2853799563,44cyclictest0-21swapper/020:20:520
248599560,8rtkit-daemon0-21swapper/020:33:482
139882563,6sleep113992-21ssh21:42:141
63052553,7sleep36309-21ssh21:29:343
2854499555,42cyclictest0-21swapper/321:50:463
2854499554,44cyclictest0-21swapper/321:40:503
2854199555,29cyclictest0-21swapper/121:50:361
2854199554,12cyclictest0-21swapper/121:30:311
2854199554,12cyclictest0-21swapper/119:20:571
2854199554,12cyclictest0-21swapper/119:10:471
2854199554,11cyclictest0-21swapper/121:56:181
28541995524,25cyclictest0-21swapper/122:11:381
28541995524,25cyclictest0-21swapper/122:11:381
28541995519,19cyclictest0-21swapper/119:25:561
2853799555,43cyclictest0-21swapper/020:32:220
2853799554,45cyclictest1419-21runrttasks20:54:000
2853799554,43cyclictest0-21swapper/019:40:590
28537995536,13cyclictest0-21swapper/018:41:030
28537995535,13cyclictest0-21swapper/019:50:430
248599550,6rtkit-daemon0-21swapper/019:53:052
248599550,4rtkit-daemon2484-21rtkit-daemon18:47:302
114272553,44sleep10-21swapper/119:30:551
114272553,44sleep10-21swapper/119:30:551
28544995423,12cyclictest20679-21processes20:50:543
2854399544,45cyclictest0-21swapper/220:24:252
2854399544,43cyclictest0-21swapper/221:40:282
2854399544,28cyclictest0-21swapper/221:49:272
2854199545,29cyclictest0-21swapper/122:07:461
2854199544,30cyclictest0-21swapper/119:05:461
2853799545,42cyclictest0-21swapper/017:45:560
28537995441,8cyclictest1419-21runrttasks21:07:410
2853799544,44cyclictest0-21swapper/019:15:530
28537995435,13cyclictest0-21swapper/022:25:320
28537995435,13cyclictest0-21swapper/019:10:460
2853799543,44cyclictest0-21swapper/020:01:300
28537995428,9cyclictest23962-21crond21:00:240
28537995428,9cyclictest23962-21crond21:00:240
152302543,44sleep30-21swapper/321:45:553
2854499537,34cyclictest0-21swapper/321:20:243
2854499535,41cyclictest0-21swapper/321:34:463
2854399534,29cyclictest0-21swapper/219:45:312
2854399534,27cyclictest0-21swapper/217:28:372
2854399534,27cyclictest0-21swapper/217:28:372
2854399533,44cyclictest0-21swapper/221:09:302
2854199534,29cyclictest0-21swapper/122:20:421
2854199534,13cyclictest0-21swapper/121:28:451
2853799534,41cyclictest0-21swapper/018:36:030
28537995337,11cyclictest0-21swapper/017:55:550
2853799533,44cyclictest0-21swapper/020:16:020
2853799533,44cyclictest0-21swapper/020:16:020
28537995327,12cyclictest0-21swapper/022:09:240
248599530,5rtkit-daemon2484-21rtkit-daemon20:20:263
248599530,5rtkit-daemon2484-21rtkit-daemon20:20:263
23562532,9sleep00-21swapper/018:20:400
12762533,43sleep00-21swapper/021:19:430
307642523,43sleep330768-21sh22:18:043
307642523,43sleep330768-21sh22:18:043
306062523,42sleep00-21swapper/022:17:290
306062523,42sleep00-21swapper/022:17:290
2854499525,28cyclictest0-21swapper/317:40:473
2854499524,41cyclictest0-21swapper/317:21:063
2854499523,13cyclictest0-21swapper/321:14:363
2854399528,26cyclictest0-21swapper/219:05:392
2854399524,27cyclictest0-21swapper/217:01:072
28543995217,13cyclictest0-21swapper/219:30:122
2854199525,28cyclictest0-21swapper/117:02:381
2854199525,27cyclictest0-21swapper/118:27:211
2854199524,12cyclictest0-21swapper/120:42:341
2853799528,8cyclictest0-21swapper/020:43:510
2853799524,40cyclictest0-21swapper/021:10:420
28537995233,13cyclictest0-21swapper/020:37:170
28537995232,14cyclictest0-21swapper/021:50:350
28537995225,12cyclictest0-21swapper/020:07:250
248599520,5rtkit-daemon2484-21rtkit-daemon18:56:072
248599520,5rtkit-daemon2484-21rtkit-daemon18:01:013
177172523,43sleep00-21swapper/017:45:330
2854499515,14cyclictest0-21swapper/321:35:493
2854499514,29cyclictest0-21swapper/321:56:463
2854499514,27cyclictest0-21swapper/322:10:223
28544995120,13cyclictest0-21swapper/320:05:263
28544995120,13cyclictest0-21swapper/317:25:523
28544995120,13cyclictest0-21swapper/317:25:523
2854399515,40cyclictest0-21swapper/219:35:472
2854399514,30cyclictest0-21swapper/221:36:042
2854399514,28cyclictest0-21swapper/218:26:022
28543995111,13cyclictest0-21swapper/219:10:562
2853799514,41cyclictest0-21swapper/022:20:330
2853799514,41cyclictest0-21swapper/018:51:020
2853799514,41cyclictest0-21swapper/018:51:020
2853799514,39cyclictest0-21swapper/018:45:490
280892513,40sleep328131-21cut18:05:473
280892513,40sleep328131-21cut18:05:473
248599510,5rtkit-daemon2484-21rtkit-daemon18:31:003
127692513,42sleep00-21swapper/017:33:230
84482502,41sleep00-21swapper/020:28:150
2854499505,25cyclictest2789-21chrt22:25:373
2854499504,28cyclictest0-21swapper/318:20:483
2854499504,27cyclictest0-21swapper/317:15:583
28544995019,13cyclictest0-21swapper/320:58:393
28544995019,13cyclictest0-21swapper/320:58:393
28544995017,13cyclictest0-21swapper/317:46:053
2854399506,25cyclictest0-21swapper/221:55:232
2854399504,29cyclictest0-21swapper/217:35:502
2854399504,28cyclictest0-21swapper/217:40:522
2854399504,26cyclictest0-21swapper/219:58:482
2854399504,12cyclictest0-21swapper/220:17:412
2854399504,12cyclictest0-21swapper/220:17:412
2854399503,27cyclictest0-21swapper/221:25:542
28543995018,13cyclictest0-21swapper/221:50:462
2854199504,13cyclictest0-21swapper/118:10:421
2854199503,28cyclictest13266-21aten_r1power_fr17:35:441
2853799504,40cyclictest0-21swapper/019:25:520
28537995033,11cyclictest0-21swapper/020:46:500
2853799503,40cyclictest0-21swapper/021:45:500
28537995028,10cyclictest0-21swapper/021:29:180
224822502,9sleep30-21swapper/317:55:153
92892492,9sleep00-21swapper/018:35:110
2854499495,13cyclictest0-21swapper/320:39:533
2854499494,27cyclictest0-21swapper/322:02:023
2854499494,27cyclictest0-21swapper/321:05:543
2853799494,38cyclictest0-21swapper/018:00:500
18922492,41sleep00-21swapper/018:18:380
28543994835,8cyclictest4106-21grep18:21:032
28541994835,9cyclictest26059-21hwlatdetect18:00:541
28541994811,13cyclictest0-21swapper/118:20:431
2853799484,38cyclictest0-21swapper/018:10:320
2853799484,38cyclictest0-21swapper/018:10:320
248599480,4rtkit-daemon2484-21rtkit-daemon19:46:123
31532472,9sleep30-21swapper/317:12:263
28541994711,13cyclictest0-21swapper/118:30:491
2853799473,39cyclictest0-21swapper/018:28:310
137832472,39sleep30-21swapper/318:41:313
57662462,9sleep00-21swapper/017:20:260
2854499462,38cyclictest0-21swapper/318:50:353
2854499462,38cyclictest0-21swapper/318:50:353
28544994619,21cyclictest1419-21runrttasks18:58:443
28544994617,12cyclictest0-21swapper/317:00:353
28543994615,13cyclictest0-21swapper/218:30:542
2853799464,37cyclictest0-21swapper/017:30:320
2853799464,37cyclictest0-21swapper/017:30:320
2853799453,37cyclictest0-21swapper/017:35:500
28537994529,12cyclictest0-21swapper/017:11:020
223672452,9sleep00-21swapper/017:53:430
28537994429,11cyclictest0-21swapper/017:07:480
28537994328,9cyclictest19450-21grep18:55:450
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional