You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-27 - 15:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Wed May 27, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2210799943,40cyclictest0-21swapper/007:39:470
2210999934,46cyclictest1419-21runrttasks04:48:011
2210999925,40cyclictest0-21swapper/109:09:481
22109998924,8cyclictest25028-21latency_hist08:24:361
2210999884,43cyclictest26779-21munin-node09:14:451
2210799885,27cyclictest0-21swapper/009:02:130
2210799859,8cyclictest121850irq/46-eth009:31:460
93842800,6sleep29385-21wc07:59:552
22107997920,11cyclictest0-21swapper/006:21:060
2210799756,33cyclictest0-21swapper/008:35:360
2211199664,54cyclictest19783-21tail08:14:583
22111996618,40cyclictest6807-21cpuspeed_turbos08:44:473
22111996618,40cyclictest6807-21cpuspeed_turbos08:44:473
233802653,54sleep30-21swapper/307:33:533
2211199654,53cyclictest0-21swapper/305:29:423
2211199624,51cyclictest0-21swapper/306:45:053
2211199624,51cyclictest0-21swapper/306:45:053
2211199616,48cyclictest0-21swapper/307:14:523
2211199615,49cyclictest0-21swapper/307:06:083
2211199615,48cyclictest0-21swapper/307:24:493
2211199615,48cyclictest0-21swapper/307:24:493
2211199614,50cyclictest0-21swapper/309:39:523
2211199614,50cyclictest0-21swapper/306:35:053
2211199614,49cyclictest0-21swapper/309:14:443
2211199614,49cyclictest0-21swapper/305:05:123
22110996131,14cyclictest0-21swapper/208:44:492
22110996131,14cyclictest0-21swapper/208:44:492
22110996127,13cyclictest0-21swapper/206:59:482
295642604,12sleep20-21swapper/209:18:242
2211199605,48cyclictest0-21swapper/309:29:493
2211199605,48cyclictest0-21swapper/307:40:033
2211199605,48cyclictest0-21swapper/306:30:063
2211199605,48cyclictest0-21swapper/305:40:083
2211199605,48cyclictest0-21swapper/304:44:543
2211199605,47cyclictest0-21swapper/306:04:413
2211199605,47cyclictest0-21swapper/306:04:413
2211199604,49cyclictest0-21swapper/310:04:303
2211199604,49cyclictest0-21swapper/309:44:493
2211199604,49cyclictest0-21swapper/309:06:073
2211199604,49cyclictest0-21swapper/306:09:593
2211199604,49cyclictest0-21swapper/305:50:013
2211199604,48cyclictest7671-21grep07:09:543
2211199604,48cyclictest30587-21df09:19:463
2211199604,48cyclictest0-21swapper/308:39:463
2211199604,48cyclictest0-21swapper/305:10:093
22110996036,8cyclictest14837-21diskmemload09:49:512
22110996026,14cyclictest0-21swapper/209:45:572
2211199595,48cyclictest0-21swapper/306:39:483
2211199595,48cyclictest0-21swapper/306:39:483
2211199595,47cyclictest26323-21perl06:49:583
2211199595,47cyclictest0-21swapper/309:00:293
2211199595,47cyclictest0-21swapper/305:58:373
2211199595,46cyclictest14322-21iostat_ios08:54:553
2211199594,48cyclictest0-21swapper/309:10:023
2211199594,48cyclictest0-21swapper/306:58:523
2211199594,48cyclictest0-21swapper/306:25:143
2211199594,48cyclictest0-21swapper/305:29:543
2211199594,47cyclictest22610-21latency09:54:543
2211199594,47cyclictest0-21swapper/308:49:483
2211199594,47cyclictest0-21swapper/305:44:573
2211199594,47cyclictest0-21swapper/305:34:533
22110995930,12cyclictest0-21swapper/208:54:332
22110995929,14cyclictest0-21swapper/206:05:032
22110995929,13cyclictest0-21swapper/207:59:352
2211199585,47cyclictest2876-21munin-run08:39:343
2211199585,46cyclictest26345-21iostat_ios08:24:553
2211199585,46cyclictest0-21swapper/309:50:063
2211199585,46cyclictest0-21swapper/307:53:563
2211199585,45cyclictest0-21swapper/304:50:033
2211199584,48cyclictest2619-21munin-node09:24:583
2211199584,48cyclictest2619-21munin-node09:24:583
2211199584,48cyclictest15284-21munin-node07:20:093
2211199584,48cyclictest15284-21munin-node07:20:093
2211199584,48cyclictest0-21swapper/307:46:133
2211199584,48cyclictest0-21swapper/306:19:393
2211199584,47cyclictest11912-21aten2.4-expect08:04:463
2211199584,47cyclictest0-21swapper/308:29:553
2211199584,47cyclictest0-21swapper/307:59:533
2211199584,47cyclictest0-21swapper/307:35:103
2211199584,47cyclictest0-21swapper/304:39:433
2211199584,45cyclictest15614-21ssh08:09:493
2211199584,45cyclictest15614-21ssh08:09:493
2211199583,49cyclictest0-21swapper/308:21:203
22110995830,13cyclictest0-21swapper/208:34:472
22110995829,14cyclictest0-21swapper/208:44:342
22110995829,14cyclictest0-21swapper/207:17:422
22110995828,14cyclictest0-21swapper/208:05:092
22110995828,14cyclictest0-21swapper/206:55:062
22110995826,13cyclictest0-21swapper/207:50:152
22110995825,14cyclictest0-21swapper/209:01:262
106372583,12sleep30-21swapper/309:37:523
295292573,47sleep129591-21grep05:55:091
227822573,47sleep20-21swapper/209:08:172
2211199574,47cyclictest3344-21idleruntime-cro07:04:373
2211199574,46cyclictest0-21swapper/306:20:143
2211199574,46cyclictest0-21swapper/305:00:133
22110995736,8cyclictest18461-21crond05:34:422
22110995729,14cyclictest0-21swapper/208:15:032
22110995729,14cyclictest0-21swapper/206:36:072
22110995729,12cyclictest0-21swapper/208:24:472
22110995728,15cyclictest0-21swapper/206:43:122
22110995728,15cyclictest0-21swapper/206:43:122
22110995728,13cyclictest0-21swapper/209:39:472
2210999574,46cyclictest0-21swapper/107:15:031
22109995727,24cyclictest0-21swapper/108:05:021
2211199564,47cyclictest0-21swapper/306:05:013
22110995639,10cyclictest25046-21cpuspeed_turbos04:39:582
22110995628,13cyclictest0-21swapper/209:35:302
22110995628,13cyclictest0-21swapper/206:49:512
22110995628,12cyclictest0-21swapper/207:45:002
22110995627,14cyclictest0-21swapper/205:24:432
22110995626,14cyclictest0-21swapper/206:45:292
22110995626,14cyclictest0-21swapper/206:45:292
2211199554,45cyclictest0-21swapper/307:55:173
22110995539,10cyclictest22004-21wc05:40:012
22110995528,12cyclictest0-21swapper/209:25:022
22110995528,12cyclictest0-21swapper/209:25:022
22110995527,14cyclictest0-21swapper/208:10:202
22110995527,14cyclictest0-21swapper/208:10:202
22110995527,13cyclictest0-21swapper/208:58:192
22110995527,13cyclictest0-21swapper/207:42:432
22110995527,13cyclictest0-21swapper/207:26:342
22110995527,13cyclictest0-21swapper/207:26:342
2210999554,45cyclictest0-21swapper/108:45:101
2210999554,45cyclictest0-21swapper/108:45:101
2210999554,44cyclictest0-21swapper/109:50:391
2210799553,46cyclictest0-21swapper/009:54:580
2211099549,26cyclictest0-21swapper/209:09:482
2211099544,29cyclictest0-21swapper/208:19:482
22110995431,8cyclictest14781-21ssh07:20:002
22110995431,8cyclictest14781-21ssh07:20:002
22110995426,12cyclictest0-21swapper/209:57:032
2210999543,44cyclictest30325-21rm07:44:341
22109995426,8cyclictest22773-21ssh07:31:381
133382545,42sleep00-21swapper/009:40:230
248112535,41sleep10-21swapper/107:34:561
22110995327,12cyclictest0-21swapper/207:30:072
22110995324,14cyclictest0-21swapper/208:32:312
2210999534,43cyclictest15167-21munin-node08:10:011
2210999534,43cyclictest15167-21munin-node08:10:011
2210999534,42cyclictest14419-21ssh09:44:171
22109995325,8cyclictest3395-21cat07:04:381
22109995325,12cyclictest0-21swapper/108:59:341
113412533,42sleep20-21swapper/206:25:042
258452522,44sleep00-21swapper/009:12:100
248599520,5rtkit-daemon2484-21rtkit-daemon04:34:550
2211099524,42cyclictest0-21swapper/209:31:342
22110995229,9cyclictest26247-21open_files09:59:582
22110995229,8cyclictest31063-21ssh09:19:512
22110995229,11cyclictest0-21swapper/207:10:472
2210999525,42cyclictest11545-21kworker/1:210:00:301
2210999525,40cyclictest23102-21kworker/1:107:51:321
2210999525,40cyclictest0-21swapper/108:26:111
2210999524,42cyclictest23102-21kworker/1:107:14:161
2210999524,40cyclictest0-21swapper/106:40:161
2210999524,40cyclictest0-21swapper/106:40:161
2210999523,43cyclictest24950-21rm06:48:271
2210999523,43cyclictest24950-21rm06:48:271
2210799529,38cyclictest0-21swapper/007:11:140
2210799526,8cyclictest121850irq/46-eth007:16:130
2211199513,34cyclictest0-21swapper/304:55:003
22110995124,11cyclictest25931-21basename05:49:532
22110995122,13cyclictest0-21swapper/207:34:502
2210999515,40cyclictest0-21swapper/109:03:211
2210999515,40cyclictest0-21swapper/108:35:541
2210999514,41cyclictest11545-21kworker/1:209:25:511
2210999514,41cyclictest11545-21kworker/1:209:25:511
2210999514,41cyclictest0-21swapper/105:30:121
2210999514,40cyclictest23102-21kworker/1:108:15:421
22109995124,7cyclictest12994-21latency_hist08:54:341
2210799514,40cyclictest0-21swapper/007:25:010
2210799514,40cyclictest0-21swapper/007:25:010
2210799514,39cyclictest0-21swapper/008:10:050
2210799514,39cyclictest0-21swapper/008:10:050
2210799513,40cyclictest0-21swapper/006:34:510
2210799512,42cyclictest29655-21ssh09:18:440
163222512,43sleep00-21swapper/008:59:240
107862512,42sleep00-21swapper/008:01:560
64562502,10sleep20-21swapper/205:09:112
42622503,7sleep10-21swapper/108:39:581
2211099504,37cyclictest0-21swapper/205:54:572
2211099504,28cyclictest0-21swapper/206:09:552
22110995034,10cyclictest15621-21tail05:25:162
22110995023,13cyclictest0-21swapper/207:05:232
2210999505,39cyclictest0-21swapper/107:21:131
2210999505,39cyclictest0-21swapper/107:21:131
2210999504,28cyclictest0-21swapper/109:58:231
2210999503,43cyclictest0-21swapper/109:34:071
2210999503,42cyclictest0-21swapper/109:34:431
22109995022,12cyclictest0-21swapper/107:54:531
22109995018,26cyclictest29416-21fschecks_time08:29:501
2210799503,27cyclictest0-21swapper/007:50:050
2210799503,24cyclictest0-21swapper/007:08:450
2210799503,14cyclictest32269-21yum-updatesd-he09:21:050
22107995029,8cyclictest121850irq/46-eth007:34:380
2210799502,43cyclictest0-21swapper/007:20:520
2210799502,43cyclictest0-21swapper/007:20:520
214642502,42sleep00-21swapper/008:18:570
51862493,10sleep10-21swapper/106:13:431
244572492,9sleep20-21swapper/204:39:322
2211199495,26cyclictest0-21swapper/305:23:313
2211199495,26cyclictest0-21swapper/305:23:313
2211099494,26cyclictest0-21swapper/206:21:142
22110994932,11cyclictest2671-21tune2fs05:00:002
2210999496,26cyclictest0-21swapper/105:23:311
2210999496,26cyclictest0-21swapper/105:23:311
2210999495,13cyclictest0-21swapper/109:47:131
2210999494,40cyclictest0-21swapper/109:21:471
2210999494,39cyclictest0-21swapper/108:03:051
2210999494,38cyclictest0-21swapper/105:24:531
2210999493,39cyclictest3931-21cpuspeed_turbos07:04:501
22109994920,12cyclictest0-21swapper/105:09:531
2210799494,39cyclictest0-21swapper/006:54:500
2210799493,40cyclictest0-21swapper/009:34:500
2210799493,39cyclictest0-21swapper/008:50:320
2210799493,18cyclictest0-21swapper/007:03:470
75612482,39sleep20-21swapper/206:18:312
277542482,41sleep00-21swapper/005:51:250
27662482,40sleep00-21swapper/006:08:130
2211199484,26cyclictest0-21swapper/305:15:153
2211099483,28cyclictest0-21swapper/205:59:552
2211099483,28cyclictest0-21swapper/205:59:552
2210999485,26cyclictest0-21swapper/105:48:351
2210999484,38cyclictest25816-21awk06:49:531
2210999484,28cyclictest0-21swapper/105:03:271
2210999483,40cyclictest0-21swapper/107:29:141
2210999483,40cyclictest0-21swapper/107:29:141
2210999483,39cyclictest0-21swapper/106:17:371
22109994822,11cyclictest0-21swapper/106:55:131
22109994817,12cyclictest0-21swapper/105:44:401
2210799486,9cyclictest121850irq/46-eth006:40:500
2210799486,9cyclictest121850irq/46-eth006:40:500
2210799486,16cyclictest0-21swapper/006:45:110
2210799486,16cyclictest0-21swapper/006:45:110
2210799485,14cyclictest0-21swapper/007:59:000
2210799483,40cyclictest5750-21ssh08:42:460
2210799483,40cyclictest0-21swapper/008:25:070
2210799483,39cyclictest0-21swapper/006:00:030
2210799483,39cyclictest0-21swapper/006:00:030
2210799483,38cyclictest21080-21ssh07:29:520
2210799482,40cyclictest0-21swapper/008:30:010
2210799482,38cyclictest24898-21ssh09:59:400
209512484,37sleep00-21swapper/004:30:050
207032483,40sleep10-21swapper/105:37:561
135472482,40sleep00-21swapper/005:23:150
135472482,40sleep00-21swapper/005:23:150
88012473,9sleep20-21swapper/205:13:422
2211199474,27cyclictest0-21swapper/304:34:453
22110994730,11cyclictest31209-21grep04:50:172
22110994724,11cyclictest0-21swapper/205:19:562
2210999474,37cyclictest0-21swapper/107:44:431
2210999474,37cyclictest0-21swapper/106:20:071
2210999474,26cyclictest0-21swapper/106:34:511
22109994721,11cyclictest0-21swapper/109:05:001
2210799473,39cyclictest0-21swapper/008:04:480
2210799473,39cyclictest0-21swapper/006:54:380
2210799473,37cyclictest0-21swapper/009:44:470
22107994712,14cyclictest0-21swapper/007:45:030
22107994711,30cyclictest0-21swapper/008:44:520
22107994711,30cyclictest0-21swapper/008:44:520
121162472,39sleep00-21swapper/006:25:390
111302474,37sleep10-21swapper/105:17:521
2211199464,24cyclictest0-21swapper/304:43:243
2211099464,25cyclictest0-21swapper/206:29:542
2211099463,37cyclictest0-21swapper/204:57:182
2211099463,36cyclictest0-21swapper/205:15:062
2211099463,25cyclictest0-21swapper/205:49:402
22110994629,11cyclictest18698-21basename05:34:512
2210999465,37cyclictest0-21swapper/104:40:181
2210999464,26cyclictest0-21swapper/106:30:061
2210799464,37cyclictest0-21swapper/008:20:450
2210799463,39cyclictest0-21swapper/009:24:420
2210799463,39cyclictest0-21swapper/009:24:420
22107994621,21cyclictest0-21swapper/006:31:160
22107994618,8cyclictest1606-21latency_hist04:59:430
204632462,39sleep00-21swapper/009:04:480
50882452,38sleep00-21swapper/006:12:250
43442452,37sleep00-21swapper/005:04:450
22110994518,21cyclictest0-21swapper/204:47:292
2210999456,34cyclictest0-21swapper/105:49:591
2210999455,33cyclictest0-21swapper/104:39:451
2210999454,13cyclictest0-21swapper/106:25:111
2210999453,24cyclictest0-21swapper/106:04:411
2210999453,24cyclictest0-21swapper/106:04:411
2210799459,32cyclictest7235-21unixbench_singl06:15:130
2210799452,37cyclictest0-21swapper/005:29:530
22107994517,10cyclictest121850irq/46-eth009:49:530
22107994514,13cyclictest0-21swapper/005:25:080
26012443,35sleep10-21swapper/106:06:051
2210999444,13cyclictest0-21swapper/104:50:141
2210999443,36cyclictest0-21swapper/105:08:491
22109994415,9cyclictest22263-21cat04:34:441
22109994415,11cyclictest0-21swapper/104:56:131
2210799449,8cyclictest29652-21gzip05:55:090
2210799444,34cyclictest0-21swapper/004:50:030
2210799443,36cyclictest0-21swapper/005:34:520
2210799443,35cyclictest0-21swapper/005:09:550
2210799443,10cyclictest0-21swapper/005:16:130
22107994424,14cyclictest0-21swapper/004:39:560
40682432,36sleep00-21swapper/005:04:090
2210799433,35cyclictest0-21swapper/005:43:510
2210799433,11cyclictest0-21swapper/005:44:530
2210799422,34cyclictest27533-21df_abs04:44:570
22110994014,11cyclictest0-21swapper/204:34:452
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional