You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-20 - 07:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Thu Aug 20, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2881991024,60cyclictest27798-21grep22:17:072
288199983,73cyclictest20577-21rm22:56:102
288199964,52cyclictest0-21swapper/221:37:252
288199944,46cyclictest0-21swapper/220:07:142
288199944,46cyclictest0-21swapper/219:37:102
288199934,68cyclictest0-21swapper/221:12:052
288199934,65cyclictest0-21swapper/222:32:132
288199934,65cyclictest0-21swapper/222:32:132
288199933,72cyclictest0-21swapper/221:22:122
288199924,67cyclictest0-21swapper/220:45:282
288199914,65cyclictest0-21swapper/221:07:112
288199914,65cyclictest0-21swapper/221:07:112
219499910,5rtkit-daemon2193-21rtkit-daemon23:14:053
219499910,5rtkit-daemon2193-21rtkit-daemon23:14:053
288199904,79cyclictest1577-21timerandwakeup20:47:252
288199904,65cyclictest0-21swapper/221:33:572
288199904,63cyclictest0-21swapper/221:52:002
288199904,62cyclictest18429-21ntpq22:02:152
288199895,60cyclictest0-21swapper/221:57:092
288199894,78cyclictest0-21swapper/223:00:042
288199894,77cyclictest22675-21cpu20:32:062
288199894,67cyclictest0-21swapper/222:48:582
288199894,66cyclictest0-21swapper/220:04:562
288199885,76cyclictest0-21swapper/223:17:142
288199885,64cyclictest0-21swapper/218:32:072
288199885,61cyclictest0-21swapper/222:37:052
288199884,78cyclictest0-21swapper/222:06:532
288199884,78cyclictest0-21swapper/220:22:052
288199884,78cyclictest0-21swapper/218:17:092
288199884,77cyclictest0-21swapper/219:54:572
288199884,67cyclictest0-21swapper/222:12:002
288199884,56cyclictest0-21swapper/223:01:582
288199875,60cyclictest0-21swapper/221:49:472
288199875,60cyclictest0-21swapper/221:49:472
288199874,76cyclictest31038-21fschecks_time22:22:082
288199874,75cyclictest0-21swapper/221:42:062
288199874,66cyclictest0-21swapper/220:37:262
288199873,50cyclictest0-21swapper/222:29:162
288199864,62cyclictest0-21swapper/221:29:582
288199864,58cyclictest0-21swapper/220:27:082
288199864,58cyclictest0-21swapper/220:27:082
2881998613,52cyclictest20773-21ssh21:17:132
288199859,55cyclictest0-21swapper/221:04:002
288199845,57cyclictest0-21swapper/223:07:172
288199844,73cyclictest0-21swapper/220:12:152
288199844,59cyclictest0-21swapper/223:14:572
288199844,59cyclictest0-21swapper/223:14:572
2881998419,39cyclictest0-21swapper/219:44:452
288199835,53cyclictest20929-21sshd18:27:202
288199835,50cyclictest0-21swapper/222:42:142
288199835,45cyclictest0-21swapper/219:12:152
288199834,73cyclictest0-21swapper/220:57:202
288199834,71cyclictest0-21swapper/218:22:132
288199834,58cyclictest0-21swapper/220:52:272
288199834,52cyclictest0-21swapper/220:17:262
288199833,52cyclictest0-21swapper/219:57:282
288199825,52cyclictest0-21swapper/217:53:492
288199824,70cyclictest0-21swapper/218:07:092
288199824,55cyclictest0-21swapper/218:02:102
288199814,68cyclictest0-21swapper/217:57:322
288199804,71cyclictest0-21swapper/219:22:082
288199804,48cyclictest0-21swapper/218:12:072
288199804,46cyclictest0-21swapper/219:28:462
219499800,5rtkit-daemon2193-21rtkit-daemon19:55:363
288199793,69cyclictest20461-21yum-updatesd-he19:33:442
288199788,55cyclictest107550irq/46-eth019:51:542
288199784,67cyclictest0-21swapper/219:06:562
288199784,67cyclictest0-21swapper/219:06:562
288199784,65cyclictest1227-21runrttasks19:07:092
219499780,4rtkit-daemon2193-21rtkit-daemon20:21:123
288199774,66cyclictest0-21swapper/218:42:302
288199773,66cyclictest0-21swapper/218:47:102
288199764,65cyclictest0-21swapper/218:52:082
288199764,64cyclictest0-21swapper/218:39:032
288199754,64cyclictest0-21swapper/218:57:202
288199754,63cyclictest0-21swapper/219:17:182
287499734,61cyclictest0-21swapper/020:27:210
287499734,61cyclictest0-21swapper/020:27:210
6802695,53sleep0858-21cut17:47:190
288199694,57cyclictest0-21swapper/217:51:592
2874996725,33cyclictest26364-21munin-node21:27:180
287499667,51cyclictest0-21swapper/020:57:250
287499666,52cyclictest0-21swapper/022:32:100
287499666,52cyclictest0-21swapper/022:32:100
287499664,54cyclictest0-21swapper/021:07:040
287499664,54cyclictest0-21swapper/021:07:040
287499664,53cyclictest0-21swapper/022:26:480
287499656,50cyclictest0-21swapper/019:52:070
287499653,56cyclictest0-21swapper/022:11:590
2874996517,28cyclictest11241-21fschecks_time21:52:070
287499644,52cyclictest0-21swapper/020:37:250
287499644,52cyclictest0-21swapper/020:02:300
287499643,53cyclictest0-21swapper/022:39:520
287499643,52cyclictest0-21swapper/022:01:090
2874996412,29cyclictest0-21swapper/022:08:010
2882996341,15cyclictest0-21swapper/318:01:583
2882996341,14cyclictest0-21swapper/322:11:583
288299634,31cyclictest0-21swapper/323:02:123
2880996319,30cyclictest0-21swapper/120:45:531
287499634,51cyclictest0-21swapper/023:21:460
287499634,51cyclictest0-21swapper/020:42:180
219499630,8rtkit-daemon0-21swapper/122:46:140
219499630,6rtkit-daemon25105-21gltestperf23:02:060
219499630,6rtkit-daemon14529-21aten2.4-expect22:46:590
288299623,52cyclictest0-21swapper/323:21:223
2882996225,20cyclictest8500-21fschecks_count22:37:063
287499628,46cyclictest0-21swapper/018:27:180
2874996246,11cyclictest0-21swapper/020:53:480
287499624,49cyclictest0-21swapper/020:47:030
219499620,6rtkit-daemon0-21swapper/122:58:360
219499620,5rtkit-daemon29845-21ssh23:08:510
288299614,34cyclictest0-21swapper/320:32:043
287499614,49cyclictest0-21swapper/021:22:030
287499614,49cyclictest0-21swapper/021:02:020
287499614,47cyclictest1227-21runrttasks19:12:150
219499610,5rtkit-daemon19596-21awk22:52:210
219499610,5rtkit-daemon17326-21perl21:12:100
288299604,49cyclictest0-21swapper/320:27:213
288299604,49cyclictest0-21swapper/320:27:213
288299603,51cyclictest0-21swapper/321:47:013
288299603,51cyclictest0-21swapper/321:47:013
287499603,49cyclictest0-21swapper/020:33:440
2882995920,10cyclictest107550irq/46-eth018:52:083
288099593,50cyclictest0-21swapper/121:07:221
288099593,50cyclictest0-21swapper/121:07:221
287499599,12cyclictest0-21swapper/020:24:500
287499595,46cyclictest0-21swapper/020:01:380
287499593,48cyclictest0-21swapper/023:15:190
287499593,48cyclictest0-21swapper/023:15:190
219499590,7rtkit-daemon0-21swapper/122:20:000
288299583,50cyclictest0-21swapper/320:47:243
288299582,50cyclictest0-21swapper/322:54:373
288299582,50cyclictest0-21swapper/321:37:103
288299582,50cyclictest0-21swapper/321:10:523
288299582,50cyclictest0-21swapper/321:10:523
287499583,47cyclictest0-21swapper/020:11:290
219499580,7rtkit-daemon0-21swapper/122:28:450
219499580,6rtkit-daemon0-21swapper/218:45:093
288299572,50cyclictest0-21swapper/321:55:193
288299572,49cyclictest0-21swapper/320:12:483
288099574,26cyclictest1227-21runrttasks23:12:361
288099574,26cyclictest1227-21runrttasks23:12:361
287499579,41cyclictest0-21swapper/018:20:550
287499574,46cyclictest0-21swapper/021:34:550
2874995713,28cyclictest0-21swapper/022:02:220
219499570,7rtkit-daemon0-21swapper/221:25:253
288299564,44cyclictest0-21swapper/321:02:133
288299564,36cyclictest0-21swapper/322:22:503
288299562,48cyclictest0-21swapper/322:58:093
288299562,48cyclictest0-21swapper/322:48:123
288299562,48cyclictest0-21swapper/321:44:223
288299562,48cyclictest0-21swapper/320:22:353
287499569,39cyclictest0-21swapper/020:12:060
287499565,30cyclictest0-21swapper/021:51:490
287499565,30cyclictest0-21swapper/021:51:490
287499564,31cyclictest0-21swapper/021:37:130
217212563,10sleep321725-21ssh21:17:373
186192563,9sleep318714-21timerandwakeup22:02:203
288299554,37cyclictest0-21swapper/321:57:413
288299552,47cyclictest0-21swapper/321:13:543
288299552,47cyclictest0-21swapper/320:43:033
288299552,47cyclictest0-21swapper/320:08:173
2882995518,23cyclictest0-21swapper/321:00:073
288099554,36cyclictest0-21swapper/122:39:231
2880995518,31cyclictest31158-21gltestperf22:22:091
287499556,32cyclictest0-21swapper/019:47:040
2874995512,25cyclictest0-21swapper/018:37:160
288299544,44cyclictest0-21swapper/321:33:353
288299544,43cyclictest0-21swapper/321:27:073
288299544,42cyclictest687-21unixbench_multi19:57:273
288299544,42cyclictest0-21swapper/322:17:223
288299544,36cyclictest0-21swapper/322:34:313
288299544,36cyclictest0-21swapper/322:34:313
288299544,29cyclictest0-21swapper/320:52:073
288299543,44cyclictest0-21swapper/319:42:233
288299543,34cyclictest0-21swapper/322:44:183
2880995440,9cyclictest2864-21munin-run17:51:591
2880995410,8cyclictest107550irq/46-eth020:29:521
2880995410,8cyclictest107550irq/46-eth020:29:521
287499544,44cyclictest0-21swapper/021:43:070
287499544,41cyclictest0-21swapper/020:17:090
287499543,45cyclictest0-21swapper/021:17:130
58072534,13sleep00-21swapper/017:57:130
290242533,11sleep10-21swapper/121:30:291
288299534,42cyclictest0-21swapper/323:07:153
288299533,44cyclictest0-21swapper/322:30:343
2882995324,13cyclictest0-21swapper/319:17:073
288299532,45cyclictest0-21swapper/322:09:353
2880995336,11cyclictest17062-21gltestperf19:27:131
2874995311,26cyclictest0-21swapper/019:32:050
288299525,39cyclictest0-21swapper/318:17:303
288299522,44cyclictest0-21swapper/320:39:153
288299522,43cyclictest0-21swapper/320:02:253
288099524,30cyclictest0-21swapper/121:42:161
2880995211,22cyclictest2798-21cat20:02:091
287499525,27cyclictest0-21swapper/018:47:230
287499524,40cyclictest0-21swapper/019:37:150
287499524,30cyclictest0-21swapper/018:33:370
73072512,42sleep10-21swapper/117:57:421
288299515,28cyclictest0-21swapper/319:22:293
288299515,28cyclictest0-21swapper/318:12:233
288299514,29cyclictest0-21swapper/318:47:253
2882995130,14cyclictest0-21swapper/319:33:433
288099518,36cyclictest0-21swapper/120:12:451
288099514,40cyclictest0-21swapper/122:16:471
288099514,39cyclictest0-21swapper/123:17:041
288099514,29cyclictest0-21swapper/118:21:571
288099514,28cyclictest0-21swapper/121:47:011
288099514,28cyclictest0-21swapper/121:47:011
288099513,26cyclictest0-21swapper/122:07:271
2880995123,12cyclictest0-21swapper/118:42:151
2880995121,13cyclictest0-21swapper/122:56:461
2874995132,11cyclictest16492-21grep19:27:070
2874995117,12cyclictest0-21swapper/019:17:050
253862513,10sleep00-21swapper/019:45:150
241762512,9sleep30-21swapper/318:34:483
167522513,40sleep116850-21hddtemp_smartct20:22:131
93152502,10sleep10-21swapper/121:00:301
288299505,27cyclictest0-21swapper/319:03:393
288299505,27cyclictest0-21swapper/319:03:393
288299504,28cyclictest0-21swapper/318:37:113
288099504,28cyclictest0-21swapper/120:33:371
288099504,28cyclictest0-21swapper/118:52:271
288099504,28cyclictest0-21swapper/118:12:121
288099504,27cyclictest0-21swapper/122:28:131
288099503,43cyclictest21168-21kworker/1:123:05:061
288099503,41cyclictest0-21swapper/121:57:181
288099503,30cyclictest0-21swapper/119:22:051
2880995021,13cyclictest0-21swapper/122:42:241
2880995021,12cyclictest0-21swapper/121:22:581
287499504,29cyclictest0-21swapper/017:52:340
2874995019,25cyclictest0-21swapper/018:02:570
2874995017,13cyclictest0-21swapper/018:57:130
133342502,10sleep10-21swapper/121:55:571
288299494,38cyclictest0-21swapper/318:05:083
288299494,38cyclictest0-21swapper/317:52:133
288299494,37cyclictest0-21swapper/318:57:093
288299492,41cyclictest0-21swapper/318:27:093
288299492,41cyclictest0-21swapper/318:07:103
288099496,26cyclictest0-21swapper/122:47:191
288099494,38cyclictest0-21swapper/120:47:101
288099494,28cyclictest0-21swapper/122:32:181
288099494,28cyclictest0-21swapper/122:32:181
288099494,28cyclictest0-21swapper/121:19:481
288099494,28cyclictest0-21swapper/118:37:161
288099494,28cyclictest0-21swapper/118:32:271
288099494,28cyclictest0-21swapper/118:07:251
288099494,27cyclictest0-21swapper/122:57:161
288099494,27cyclictest0-21swapper/119:52:121
288099494,25cyclictest0-21swapper/122:19:121
2880994920,12cyclictest0-21swapper/123:08:261
2880994920,12cyclictest0-21swapper/121:32:311
287499498,26cyclictest0-21swapper/018:52:080
287499495,29cyclictest0-21swapper/018:08:310
287499494,37cyclictest0-21swapper/018:42:120
287499494,29cyclictest0-21swapper/019:02:140
287499494,29cyclictest0-21swapper/019:02:140
2874994920,14cyclictest0-21swapper/018:12:200
153942492,41sleep10-21swapper/120:20:511
288299485,28cyclictest0-21swapper/319:12:093
288299484,27cyclictest0-21swapper/319:48:473
288299483,38cyclictest361ktimersoftd/319:37:063
288099485,27cyclictest0-21swapper/121:12:101
288099484,28cyclictest0-21swapper/120:07:191
288099484,27cyclictest0-21swapper/121:37:201
288099484,27cyclictest0-21swapper/120:37:211
288099484,27cyclictest0-21swapper/119:47:061
288099484,27cyclictest0-21swapper/119:07:171
288099484,27cyclictest0-21swapper/118:22:191
288099484,27cyclictest0-21swapper/118:02:211
288099484,27cyclictest0-21swapper/117:52:351
288099484,26cyclictest0-21swapper/122:02:201
288099484,24cyclictest0-21swapper/119:58:031
288099483,28cyclictest0-21swapper/119:32:271
288099483,27cyclictest8812-21kworker/1:021:02:101
288099483,27cyclictest0-21swapper/120:52:121
2880994819,12cyclictest0-21swapper/118:47:091
2880994818,12cyclictest0-21swapper/119:42:181
287499484,28cyclictest0-21swapper/018:22:180
2874994830,11cyclictest15000-21tail19:22:200
230712482,40sleep10-21swapper/119:41:251
288299472,39cyclictest0-21swapper/319:10:463
288099474,35cyclictest0-21swapper/119:02:071
288099474,35cyclictest0-21swapper/119:02:071
2874994716,12cyclictest0-21swapper/019:07:090
288299464,22cyclictest0-21swapper/319:27:053
288299463,13cyclictest0-21swapper/318:22:143
2880994518,12cyclictest0-21swapper/118:28:341
288099444,12cyclictest0-21swapper/119:01:561
288099443,26cyclictest0-21swapper/119:12:051
288099423,33cyclictest0-21swapper/119:17:221
288299364,26cyclictest0-21swapper/317:52:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional