You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-29 - 05:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Wed Apr 29, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2392199984,12cyclictest0-21swapper/221:00:472
2392199984,12cyclictest0-21swapper/220:41:392
2392199964,65cyclictest0-21swapper/221:46:332
23921999421,49cyclictest0-21swapper/217:21:542
2392199934,68cyclictest0-21swapper/221:10:152
2392199934,13cyclictest0-21swapper/220:34:522
2392199934,10cyclictest25894-21aten_r1power_en20:01:342
2392199934,10cyclictest25894-21aten_r1power_en20:01:342
2392199924,64cyclictest0-21swapper/219:28:272
2392199924,11cyclictest0-21swapper/221:17:182
2392199919,7cyclictest0-21swapper/219:06:582
2392199914,64cyclictest0-21swapper/220:53:052
2392199914,13cyclictest0-21swapper/218:08:172
2392199913,12cyclictest0-21swapper/220:24:142
2392199913,10cyclictest0-21swapper/220:49:292
2392199913,10cyclictest0-21swapper/220:49:292
23921999120,47cyclictest0-21swapper/219:17:512
23921999120,47cyclictest0-21swapper/219:17:512
23921999117,56cyclictest20787-21ssh19:51:562
23921999115,57cyclictest0-21swapper/222:21:472
23921999112,55cyclictest0-21swapper/220:16:352
2392199907,7cyclictest16762-21diskmemload19:21:412
2392199907,7cyclictest16762-21diskmemload19:21:412
2392199906,12cyclictest0-21swapper/222:10:042
2392199906,12cyclictest0-21swapper/222:10:042
2392199905,14cyclictest0-21swapper/221:36:442
2392199904,62cyclictest0-21swapper/221:56:202
2392199904,12cyclictest0-21swapper/220:27:162
2392199903,12cyclictest0-21swapper/217:07:012
23921999017,53cyclictest24948-21ssh19:11:462
2392199895,60cyclictest0-21swapper/221:01:262
2392199895,10cyclictest1419-21runrttasks21:51:302
2392199894,63cyclictest0-21swapper/219:44:562
2392199894,63cyclictest0-21swapper/219:03:412
2392199894,12cyclictest0-21swapper/220:14:222
285042880,3sleep041ktimersoftd/020:04:470
285042880,3sleep041ktimersoftd/020:04:470
2392199885,62cyclictest0-21swapper/222:12:342
2392199884,9cyclictest16396-21missed_timers21:21:452
2392199884,69cyclictest0-21swapper/220:39:382
2392199884,68cyclictest0-21swapper/221:11:552
2392199884,66cyclictest27571-21gltestperf22:26:372
2392199884,64cyclictest0-21swapper/219:31:362
2392199884,60cyclictest0-21swapper/218:51:502
2392199884,59cyclictest0-21swapper/217:36:502
2392199884,13cyclictest0-21swapper/220:11:182
2392099882,78cyclictest44791sshd21:05:131
2392199874,9cyclictest16024-21ssh19:46:382
2392199874,58cyclictest0-21swapper/219:56:322
2392199874,12cyclictest0-21swapper/221:41:462
2392199873,12cyclictest11247-21ps22:01:472
2392199873,10cyclictest22210-21taskset22:18:132
2392199873,10cyclictest10464-21ps19:36:532
2392099874,76cyclictest0-21swapper/119:46:551
2392099873,75cyclictest0-21swapper/120:43:551
2392199864,12cyclictest0-21swapper/221:32:022
2392099864,74cyclictest25388-21python20:46:531
2392099864,74cyclictest25388-21python20:46:531
2392099863,65cyclictest0-21swapper/121:33:131
2392199855,56cyclictest0-21swapper/218:56:392
2392199854,65cyclictest0-21swapper/218:33:212
2392199854,57cyclictest0-21swapper/217:01:432
2392199853,13cyclictest0-21swapper/217:56:402
2392199853,13cyclictest0-21swapper/217:56:402
2392199853,10cyclictest20617-21runrttasks18:01:392
2392199853,10cyclictest18584-21basename21:26:312
2392199853,10cyclictest18584-21basename21:26:312
2392099854,72cyclictest0-21swapper/120:13:541
2392099843,75cyclictest2896-21fschecks_count19:26:421
2392099843,73cyclictest6473-21munin-node21:56:331
2392199834,54cyclictest0-21swapper/217:41:402
2392199834,13cyclictest0-21swapper/218:11:452
2392199833,62cyclictest8219-21systemd-cgroups17:35:022
2392199833,10cyclictest1676-21nscd17:31:292
2392099834,72cyclictest0-21swapper/121:16:401
2392099834,61cyclictest0-21swapper/122:20:571
2392099833,74cyclictest0-21swapper/120:41:161
2392099833,74cyclictest0-21swapper/118:19:351
2392099833,73cyclictest28236-21fschecks_time19:16:441
2392099833,73cyclictest28236-21fschecks_time19:16:441
2392099833,73cyclictest10033-21fgrep17:36:571
2392099833,73cyclictest0-21swapper/122:15:311
2392099833,47cyclictest0-21swapper/121:23:141
2392199824,61cyclictest15574-21munin-run17:51:282
2392199824,56cyclictest0-21swapper/218:41:372
2392199824,56cyclictest0-21swapper/218:41:372
2392199824,11cyclictest0-21swapper/218:26:412
2392199823,13cyclictest11564-21grep18:47:022
2392099824,70cyclictest0-21swapper/119:54:061
2392099823,72cyclictest7138-21runrttasks21:07:381
2392099823,70cyclictest26778-21cut22:26:291
2392099823,60cyclictest8350-21ntp_kernel_pll_20:21:511
2392199814,12cyclictest0-21swapper/217:01:312
2392099814,70cyclictest0-21swapper/117:06:481
2392099814,69cyclictest0-21swapper/121:37:341
2392099814,69cyclictest0-21swapper/119:21:401
2392099814,69cyclictest0-21swapper/119:21:401
2392099814,61cyclictest0-21swapper/120:56:211
2392099814,61cyclictest0-21swapper/120:09:341
2392099813,71cyclictest0-21swapper/119:33:231
2392099813,52cyclictest31104-21df_abs20:56:361
2392199805,52cyclictest0-21swapper/218:21:272
2392199803,10cyclictest1419-21runrttasks18:22:072
2392099803,71cyclictest11811-21ssh19:40:221
2392099803,71cyclictest0-21swapper/121:11:311
2392099803,70cyclictest10136-21cat22:01:321
2392099803,70cyclictest0-21swapper/120:31:121
2392099803,47cyclictest0-21swapper/119:06:251
2392199794,13cyclictest0-21swapper/217:51:502
2392099795,67cyclictest0-21swapper/120:16:451
2392099794,68cyclictest0-21swapper/122:06:251
2392099794,68cyclictest0-21swapper/122:06:251
2392099794,68cyclictest0-21swapper/121:42:351
2392099794,68cyclictest0-21swapper/119:09:581
2392099794,68cyclictest0-21swapper/118:54:131
2392099794,46cyclictest19642-21ssh21:26:441
2392099794,46cyclictest19642-21ssh21:26:441
2392099793,69cyclictest0-21swapper/122:22:101
23921997822,49cyclictest0-21swapper/217:17:012
23921997822,49cyclictest0-21swapper/217:17:012
2392099784,67cyclictest0-21swapper/120:01:541
2392099784,67cyclictest0-21swapper/120:01:541
2392099784,67cyclictest0-21swapper/117:46:461
2392099784,66cyclictest1419-21runrttasks18:56:381
2392099784,66cyclictest0-21swapper/121:52:481
2392099783,68cyclictest0-21swapper/119:16:031
2392099782,69cyclictest14113-21expr20:31:381
248599770,6rtkit-daemon2484-21rtkit-daemon19:06:143
23921997716,44cyclictest0-21swapper/217:13:402
2392099774,66cyclictest0-21swapper/121:46:511
2392099774,52cyclictest0-21swapper/120:01:081
2392099773,68cyclictest0-21swapper/119:45:581
2392099763,66cyclictest23386-21ls18:06:411
2392199754,56cyclictest0-21swapper/218:38:222
2392199754,56cyclictest0-21swapper/218:38:222
2392099753,66cyclictest1321-21aten2.4-expect17:21:401
2392099753,65cyclictest8388-21munin-run17:36:281
2392099753,65cyclictest0-21swapper/117:02:041
2392099753,39cyclictest0-21swapper/117:51:471
2392099744,64cyclictest0-21swapper/117:42:001
2392099743,64cyclictest1419-21runrttasks18:35:031
2392099743,63cyclictest0-21swapper/118:46:391
2392099734,62cyclictest0-21swapper/117:27:031
23918997329,10cyclictest18246-21sort20:36:450
2392099724,61cyclictest0-21swapper/117:11:411
2392099723,63cyclictest2513-21udisks-daemon18:41:551
2392099723,63cyclictest2513-21udisks-daemon18:41:551
2392099713,62cyclictest0-21swapper/118:23:241
2392099713,61cyclictest20840-21cpuspeed18:01:411
2392099703,61cyclictest0-21swapper/117:16:441
2392099703,61cyclictest0-21swapper/117:16:441
2392099703,60cyclictest5177-21aten_r1power_vo18:36:401
2392099703,60cyclictest5177-21aten_r1power_vo18:36:401
2392099693,48cyclictest0-21swapper/117:58:151
2392099693,48cyclictest0-21swapper/117:58:151
2392099673,42cyclictest0-21swapper/118:11:391
46692665,53sleep00-21swapper/020:16:450
2392099663,56cyclictest0-21swapper/118:26:381
2391899633,54cyclictest0-21swapper/019:56:260
132162633,11sleep00-21swapper/022:06:310
132162633,11sleep00-21swapper/022:06:310
23922996123,14cyclictest0-21swapper/317:41:573
23922996120,25cyclictest4302-21fschecks_count20:16:413
137302612,51sleep00-21swapper/019:41:540
2391899604,47cyclictest0-21swapper/021:38:130
23922995918,23cyclictest1676-21nscd18:31:263
2392099594,48cyclictest0-21swapper/117:01:301
2391899594,48cyclictest0-21swapper/020:54:430
23918995931,21cyclictest0-21swapper/022:01:310
23918995918,32cyclictest16763-21latency_hist19:01:260
23918995838,12cyclictest9672-21cut21:11:440
248599570,5rtkit-daemon2484-21rtkit-daemon18:25:533
2392299574,14cyclictest0-21swapper/320:07:043
2391899575,45cyclictest0-21swapper/019:51:240
2391899575,44cyclictest0-21swapper/022:26:440
2391899575,44cyclictest0-21swapper/021:26:320
2391899575,44cyclictest0-21swapper/021:26:320
23918995739,11cyclictest1978-21unixbench_multi20:11:560
23918995738,12cyclictest16679-21gltestperf17:51:470
232092573,46sleep00-21swapper/018:06:410
133812573,47sleep00-21swapper/020:31:000
298232562,44sleep00-21swapper/020:06:410
2391899564,45cyclictest0-21swapper/022:16:510
23918995621,27cyclictest20711-21tail18:01:400
23922995538,10cyclictest16597-21sh19:46:443
2391899554,44cyclictest0-21swapper/019:41:230
147012553,46sleep014800-21if_eth020:31:450
248599540,6rtkit-daemon2484-21rtkit-daemon19:31:433
248599540,5rtkit-daemon2484-21rtkit-daemon20:50:033
248599540,5rtkit-daemon2484-21rtkit-daemon20:50:033
248599540,5rtkit-daemon2484-21rtkit-daemon17:46:473
248599540,5rtkit-daemon2484-21rtkit-daemon17:21:483
2392299543,44cyclictest0-21swapper/319:43:383
23922995413,35cyclictest24721-21munin-node22:21:483
2391899544,42cyclictest17008-21head21:21:540
2391899544,42cyclictest1419-21runrttasks20:46:270
2391899544,42cyclictest1419-21runrttasks20:46:270
2391899544,41cyclictest0-21swapper/021:06:380
2391899544,30cyclictest0-21swapper/019:07:420
2391899544,13cyclictest0-21swapper/021:54:450
2391899543,45cyclictest0-21swapper/021:01:360
23918995424,26cyclictest0-21swapper/020:45:000
216142542,10sleep00-21swapper/019:54:160
140282543,44sleep00-21swapper/021:18:130
84862532,11sleep00-21swapper/021:57:240
34832532,12sleep00-21swapper/018:31:480
251622533,43sleep00-21swapper/017:01:550
248599530,5rtkit-daemon2484-21rtkit-daemon20:35:263
248599530,5rtkit-daemon2484-21rtkit-daemon20:28:263
248599530,5rtkit-daemon2484-21rtkit-daemon20:14:563
248599530,5rtkit-daemon2484-21rtkit-daemon19:38:053
248599530,5rtkit-daemon2484-21rtkit-daemon18:56:003
248599530,5rtkit-daemon2484-21rtkit-daemon18:46:523
248599530,5rtkit-daemon2484-21rtkit-daemon18:06:013
248599530,5rtkit-daemon2484-21rtkit-daemon17:56:543
248599530,5rtkit-daemon2484-21rtkit-daemon17:56:543
248599530,5rtkit-daemon2484-21rtkit-daemon17:08:263
248599530,4rtkit-daemon2484-21rtkit-daemon17:21:263
248599530,4rtkit-daemon2484-21rtkit-daemon17:21:263
2392299534,14cyclictest0-21swapper/321:53:553
23922995336,11cyclictest14119-21gltestperf22:06:403
23922995336,11cyclictest14119-21gltestperf22:06:403
2392299532,46cyclictest34-21rcuc/319:07:253
23922995318,21cyclictest1419-21runrttasks21:58:403
2391899535,14cyclictest0-21swapper/019:19:340
2391899535,14cyclictest0-21swapper/019:19:340
2391899534,43cyclictest0-21swapper/019:01:540
2391899534,42cyclictest0-21swapper/019:21:440
2391899534,42cyclictest0-21swapper/019:21:440
2391899534,23cyclictest0-21swapper/022:11:380
2391899534,23cyclictest0-21swapper/019:11:440
238982532,45sleep00-21swapper/021:32:160
309202522,44sleep00-21swapper/017:14:450
297842522,43sleep00-21swapper/021:41:440
266732522,40sleep30-21swapper/318:11:563
248599520,6rtkit-daemon2484-21rtkit-daemon17:03:043
248599520,5rtkit-daemon2484-21rtkit-daemon21:07:243
248599520,5rtkit-daemon2484-21rtkit-daemon19:28:133
248599520,5rtkit-daemon2484-21rtkit-daemon18:39:233
248599520,5rtkit-daemon2484-21rtkit-daemon18:39:233
248599520,5rtkit-daemon2484-21rtkit-daemon17:52:253
248599520,5rtkit-daemon2484-21rtkit-daemon17:35:333
248599520,5rtkit-daemon2484-21rtkit-daemon17:11:563
248599520,4rtkit-daemon2484-21rtkit-daemon20:51:403
248599520,4rtkit-daemon2484-21rtkit-daemon20:36:263
248599520,4rtkit-daemon2484-21rtkit-daemon19:57:573
248599520,4rtkit-daemon2484-21rtkit-daemon19:12:363
248599520,4rtkit-daemon2484-21rtkit-daemon18:59:143
248599520,4rtkit-daemon2484-21rtkit-daemon18:44:223
248599520,4rtkit-daemon2484-21rtkit-daemon18:44:223
248599520,4rtkit-daemon2484-21rtkit-daemon18:35:153
248599520,4rtkit-daemon2484-21rtkit-daemon18:18:093
2392299525,28cyclictest0-21swapper/321:46:393
2391899524,24cyclictest32408-21yum-updatesd-he21:46:430
2391899524,22cyclictest0-21swapper/022:21:450
23918995233,11cyclictest11847-21tr17:41:490
153252522,10sleep00-21swapper/017:48:270
100992523,11sleep00-21swapper/020:26:210
95482513,41sleep00-21swapper/018:46:110
95482513,41sleep00-21swapper/018:46:110
248599510,4rtkit-daemon2484-21rtkit-daemon20:42:103
248599510,4rtkit-daemon2484-21rtkit-daemon20:02:043
248599510,4rtkit-daemon2484-21rtkit-daemon20:02:043
248599510,4rtkit-daemon2484-21rtkit-daemon19:26:063
248599510,4rtkit-daemon2484-21rtkit-daemon19:26:063
2392299518,12cyclictest0-21swapper/319:51:363
2392299515,28cyclictest0-21swapper/320:56:483
2392299514,29cyclictest0-21swapper/321:16:303
23922995134,11cyclictest10729-21gltestperf22:01:383
23922995131,13cyclictest0-21swapper/322:18:143
23922995121,13cyclictest0-21swapper/320:21:403
2391899514,27cyclictest0-21swapper/018:26:270
2391899514,13cyclictest0-21swapper/019:26:460
23918995131,13cyclictest0-21swapper/019:31:580
23918995111,33cyclictest0-21swapper/018:46:440
22952512,9sleep00-21swapper/018:30:310
248599500,4rtkit-daemon2484-21rtkit-daemon18:08:313
2392299505,39cyclictest0-21swapper/321:04:133
2392299504,30cyclictest0-21swapper/322:26:553
2392299504,28cyclictest0-21swapper/321:26:483
2392299504,28cyclictest0-21swapper/321:26:483
23922995020,12cyclictest0-21swapper/321:36:233
2391899505,26cyclictest26042-21grep18:11:450
2392299494,39cyclictest0-21swapper/321:23:103
2392299494,27cyclictest0-21swapper/321:11:363
2391899494,40cyclictest0-21swapper/020:58:410
2391899494,37cyclictest0-21swapper/018:36:450
2391899494,37cyclictest0-21swapper/018:36:450
2392299484,28cyclictest0-21swapper/319:16:413
2392299484,28cyclictest0-21swapper/319:16:413
2392299484,26cyclictest0-21swapper/321:41:463
2392299484,26cyclictest0-21swapper/317:36:513
23922994832,10cyclictest17551-21cut22:11:393
23922994819,12cyclictest0-21swapper/321:31:463
23918994831,10cyclictest4609-21head17:26:500
2391899483,39cyclictest0-21swapper/017:56:520
2391899483,39cyclictest0-21swapper/017:56:520
2391899483,28cyclictest0-21swapper/017:17:000
2391899483,28cyclictest0-21swapper/017:17:000
237802484,38sleep00-21swapper/017:00:100
140992482,41sleep00-21swapper/018:53:000
80732472,10sleep00-21swapper/017:33:230
33672472,39sleep00-21swapper/017:24:160
23922994717,13cyclictest0-21swapper/317:26:493
2391899475,34cyclictest0-21swapper/017:06:420
2391899474,27cyclictest0-21swapper/018:16:520
23918994729,11cyclictest10318-21tail17:37:000
248599350,4rtkit-daemon2484-21rtkit-daemon16:59:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional