You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-30 - 23:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Tue Dec 30, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2953221210,6sleep129533-21ethtool08:54:001
1523621030,16sleep1328199cyclictest11:48:321
248599960,7rtkit-daemon0-21swapper/008:38:360
138402850,7sleep313841-21sed09:28:563
3279997932,30cyclictest6159-21grep09:13:530
248599790,5rtkit-daemon2484-21rtkit-daemon10:48:533
248599760,4rtkit-daemon2484-21rtkit-daemon11:14:073
248599760,4rtkit-daemon2484-21rtkit-daemon11:14:073
3279997530,38cyclictest21933-21unixbench_multi07:29:170
3279997525,43cyclictest13021-21taskset10:34:030
3279997522,31cyclictest0-21swapper/010:28:480
3279997522,31cyclictest0-21swapper/010:28:480
3279997517,52cyclictest0-21swapper/008:54:040
3279997420,45cyclictest0-21swapper/010:02:320
3279997322,44cyclictest0-21swapper/008:43:390
3279997320,47cyclictest0-21swapper/011:08:330
3279997319,47cyclictest0-21swapper/012:14:030
248599730,8rtkit-daemon0-21swapper/308:21:443
248599730,10rtkit-daemon2484-21rtkit-daemon08:11:073
193427310,52sleep20-21swapper/206:49:042
3279997224,29cyclictest0-21swapper/010:43:520
248599720,5rtkit-daemon2484-21rtkit-daemon12:08:433
3279997124,41cyclictest0-21swapper/009:58:360
3279997123,41cyclictest0-21swapper/010:49:040
3279997120,44cyclictest0-21swapper/009:23:550
248599710,5rtkit-daemon2484-21rtkit-daemon10:28:543
248599710,5rtkit-daemon2484-21rtkit-daemon10:28:543
3279997027,36cyclictest1419-21runrttasks10:09:060
3279997025,38cyclictest8114-21munin-node11:34:050
3279997025,22cyclictest0-21swapper/011:33:040
3279997023,28cyclictest6742-21grep06:59:030
3279997023,28cyclictest6742-21grep06:59:030
3279997019,31cyclictest0-21swapper/011:58:500
3279997016,48cyclictest0-21swapper/012:18:510
248599700,11rtkit-daemon0-21swapper/007:09:020
3279996951,12cyclictest28170-21grep07:44:010
3279996923,40cyclictest0-21swapper/009:05:110
3279996923,40cyclictest0-21swapper/009:05:110
3279996916,46cyclictest0-21swapper/008:44:100
248599690,4rtkit-daemon2484-21rtkit-daemon11:24:073
3279996827,35cyclictest23432-21gltestperf07:34:010
3279996825,25cyclictest9110-21latency_hist10:28:350
3279996823,32cyclictest1419-21runrttasks08:59:040
3279996821,40cyclictest0-21swapper/008:03:580
3279996820,40cyclictest0-21swapper/010:38:520
3279996820,34cyclictest0-21swapper/010:59:090
3279996817,44cyclictest0-21swapper/007:38:570
3279996817,44cyclictest0-21swapper/007:38:570
248599680,6rtkit-daemon2484-21rtkit-daemon12:00:583
248599680,5rtkit-daemon2484-21rtkit-daemon08:14:523
248599680,4rtkit-daemon2484-21rtkit-daemon10:39:093
3279996751,10cyclictest15926-21df_abs07:18:580
3279996742,19cyclictest0-21swapper/007:24:020
3279996722,38cyclictest0-21swapper/011:24:030
3279996720,39cyclictest17758-21aten_r1power_cu09:38:480
3279996720,30cyclictest0-21swapper/008:23:400
248599670,4rtkit-daemon2484-21rtkit-daemon09:59:033
3279996627,33cyclictest9730-21tr08:13:530
3279996623,36cyclictest30875-21chrt11:13:450
3279996623,36cyclictest30875-21chrt11:13:450
3279996621,37cyclictest20845-21fschecks_time09:43:550
3279996620,30cyclictest0-21swapper/007:14:040
3279996620,30cyclictest0-21swapper/006:53:570
3279996616,42cyclictest0-21swapper/008:09:160
248599660,4rtkit-daemon2484-21rtkit-daemon10:23:543
3279996548,11cyclictest18317-21tune2fs11:53:500
3279996531,28cyclictest22161-21sed10:53:530
3279996522,29cyclictest17457-21chrt11:53:310
3279996522,29cyclictest0-21swapper/007:08:040
3279996515,33cyclictest0-21swapper/011:43:450
3279996511,47cyclictest0-21swapper/007:54:120
328399644,41cyclictest0-21swapper/310:22:483
3279996433,14cyclictest1419-21runrttasks10:13:520
3279996430,26cyclictest3056-21grep07:59:010
3279996421,36cyclictest0-21swapper/009:08:550
3279996419,38cyclictest4736-21cpu10:18:480
3279996416,28cyclictest0-21swapper/010:03:500
3279996336,19cyclictest0-21swapper/006:53:430
3279996325,31cyclictest8194-21munin-node09:18:550
3279996317,29cyclictest773-21aten_r1power_cu11:18:430
53012623,50sleep20-21swapper/208:03:592
3279996232,14cyclictest1419-21runrttasks07:52:010
3279996222,35cyclictest0-21swapper/008:49:110
3279996221,35cyclictest0-21swapper/012:08:520
3279996220,36cyclictest0-21swapper/011:39:050
3279996214,42cyclictest0-21swapper/008:28:590
3279996121,14cyclictest0-21swapper/009:48:500
3279996121,14cyclictest0-21swapper/009:48:500
3279996115,40cyclictest0-21swapper/009:33:550
3279996113,40cyclictest0-21swapper/012:03:520
133922613,12sleep20-21swapper/209:28:522
328299604,48cyclictest0-21swapper/209:59:042
3282995933,19cyclictest13355-21grep07:13:582
3279995940,14cyclictest0-21swapper/009:29:040
3279995915,32cyclictest0-21swapper/008:27:230
3279995915,32cyclictest0-21swapper/008:27:230
132722593,47sleep113377-21timerandwakeup08:19:141
3282995818,23cyclictest0-21swapper/208:38:552
251892583,47sleep20-21swapper/208:44:102
328399577,28cyclictest23739-21head09:49:043
328399577,28cyclictest23739-21head09:49:043
328299574,45cyclictest0-21swapper/207:03:522
3279995711,40cyclictest0-21swapper/011:08:450
328399564,31cyclictest0-21swapper/309:58:363
328299564,37cyclictest0-21swapper/209:49:022
328299564,37cyclictest0-21swapper/209:49:022
3281995640,10cyclictest17363-21gltestperf10:43:541
3281995618,29cyclictest0-21swapper/108:03:581
248599560,5rtkit-daemon2484-21rtkit-daemon08:34:063
65192554,11sleep30-21swapper/311:28:523
328399555,29cyclictest0-21swapper/308:39:053
328399554,43cyclictest0-21swapper/311:33:543
328399554,31cyclictest0-21swapper/309:34:023
248599550,5rtkit-daemon2484-21rtkit-daemon10:58:532
248599550,13rtkit-daemon2484-21rtkit-daemon09:00:503
80182542,9sleep10-21swapper/110:24:011
3283995410,36cyclictest6210-21cpuspeed_turbos06:58:573
3283995410,36cyclictest6210-21cpuspeed_turbos06:58:573
248599540,5rtkit-daemon2484-21rtkit-daemon11:38:442
248599540,4rtkit-daemon2484-21rtkit-daemon10:43:462
239492543,44sleep124083-21tr08:43:531
3283995323,13cyclictest0-21swapper/310:33:563
3283995322,13cyclictest0-21swapper/311:39:023
328299537,26cyclictest7965-21awk09:18:382
328299534,42cyclictest0-21swapper/211:28:462
328299534,30cyclictest0-21swapper/209:38:362
3282995336,10cyclictest31799-21gltestperf08:58:582
328299532,44cyclictest0-21swapper/211:08:582
328199534,29cyclictest0-21swapper/109:08:381
328199534,29cyclictest0-21swapper/109:08:381
3281995335,11cyclictest13785-21head09:28:561
328199533,10cyclictest3568-21aten_r1power_fr06:53:551
326772532,44sleep10-21swapper/111:14:281
326772532,44sleep10-21swapper/111:14:281
278862532,43sleep10-21swapper/111:04:121
248599530,4rtkit-daemon2484-21rtkit-daemon11:34:212
248599530,4rtkit-daemon2484-21rtkit-daemon10:18:092
248599530,4rtkit-daemon2484-21rtkit-daemon10:04:402
248599530,4rtkit-daemon2484-21rtkit-daemon09:19:122
248599530,4rtkit-daemon2484-21rtkit-daemon09:09:202
248599530,4rtkit-daemon2484-21rtkit-daemon08:21:512
248599530,4rtkit-daemon2484-21rtkit-daemon08:14:372
248599530,4rtkit-daemon2484-21rtkit-daemon08:11:292
220762532,11sleep20-21swapper/210:53:532
328399525,29cyclictest0-21swapper/312:03:523
328399523,44cyclictest361ktimersoftd/308:04:063
3283995220,13cyclictest0-21swapper/308:44:133
328299524,41cyclictest5782-21needreboot10:19:002
328299524,26cyclictest0-21swapper/206:56:142
328299522,42cyclictest856-21munin-node09:04:022
328299522,42cyclictest856-21munin-node09:04:022
328199526,25cyclictest0-21swapper/107:13:561
328199524,30cyclictest0-21swapper/109:59:091
328199523,24cyclictest0-21swapper/107:43:541
3281995220,13cyclictest0-21swapper/112:03:261
248599520,5rtkit-daemon2484-21rtkit-daemon06:49:031
248599520,4rtkit-daemon2484-21rtkit-daemon11:59:352
248599520,4rtkit-daemon2484-21rtkit-daemon11:48:212
248599520,4rtkit-daemon2484-21rtkit-daemon11:17:452
248599520,4rtkit-daemon2484-21rtkit-daemon11:17:452
248599520,4rtkit-daemon2484-21rtkit-daemon08:57:502
188752523,41sleep20-21swapper/211:53:592
188042522,43sleep10-21swapper/111:53:581
328399515,25cyclictest0-21swapper/309:24:103
328399514,28cyclictest0-21swapper/309:14:093
3283995122,12cyclictest0-21swapper/311:48:503
3282995122,9cyclictest17582-21latency_hist07:23:422
328199516,15cyclictest0-21swapper/109:24:001
328199515,28cyclictest0-21swapper/108:29:021
328199514,30cyclictest0-21swapper/109:13:561
3281995122,12cyclictest0-21swapper/109:58:371
248599510,4rtkit-daemon2484-21rtkit-daemon09:43:563
248599510,13rtkit-daemon2484-21rtkit-daemon10:44:083
328399505,27cyclictest0-21swapper/310:14:103
328399504,39cyclictest0-21swapper/307:34:133
328399504,29cyclictest0-21swapper/311:18:583
328399504,28cyclictest0-21swapper/309:38:533
328399504,28cyclictest0-21swapper/308:33:403
328399504,28cyclictest0-21swapper/306:54:123
328399504,27cyclictest0-21swapper/310:54:063
328399504,20cyclictest0-21swapper/311:58:083
3283995031,11cyclictest1419-21runrttasks08:26:003
3283995031,11cyclictest1419-21runrttasks08:26:003
3283995020,13cyclictest0-21swapper/312:13:533
328399502,35cyclictest0-21swapper/307:08:563
328299507,29cyclictest8877-1kworker/2:2H08:25:322
328299507,29cyclictest8877-1kworker/2:2H08:25:322
328299504,29cyclictest0-21swapper/211:23:492
328299504,28cyclictest0-21swapper/210:33:522
328299504,28cyclictest0-21swapper/209:39:132
328299504,27cyclictest0-21swapper/207:44:002
3282995033,11cyclictest3114-21cut07:59:022
328299502,36cyclictest0-21swapper/209:28:082
328199505,28cyclictest0-21swapper/109:48:541
328199505,28cyclictest0-21swapper/109:48:541
328199505,28cyclictest0-21swapper/107:24:011
328199504,28cyclictest0-21swapper/111:49:081
328199504,28cyclictest0-21swapper/107:59:091
328199504,27cyclictest0-21swapper/110:34:071
3281995031,12cyclictest27848-21sed08:49:131
3281995029,15cyclictest0-21swapper/111:34:031
3281995020,13cyclictest0-21swapper/109:44:011
3281995020,12cyclictest0-21swapper/110:19:091
3281995020,12cyclictest0-21swapper/109:43:371
3281995020,12cyclictest0-21swapper/107:13:441
248599500,5rtkit-daemon2484-21rtkit-daemon12:19:572
248599500,5rtkit-daemon2484-21rtkit-daemon12:03:502
248599500,5rtkit-daemon2484-21rtkit-daemon09:54:102
243462502,40sleep10-21swapper/112:05:141
128852502,10sleep30-21swapper/311:43:443
95242492,9sleep10-21swapper/107:04:091
328399497,26cyclictest0-21swapper/306:53:443
328399495,27cyclictest0-21swapper/310:59:123
328399494,37cyclictest0-21swapper/307:08:433
328399494,28cyclictest0-21swapper/311:04:053
328399494,28cyclictest0-21swapper/308:03:403
328399494,28cyclictest0-21swapper/307:38:563
328399494,28cyclictest0-21swapper/307:38:563
328399494,27cyclictest0-21swapper/308:49:073
328399494,27cyclictest0-21swapper/307:19:183
3283994930,12cyclictest29978-21tr12:18:443
3283994928,14cyclictest0-21swapper/307:53:423
328299494,27cyclictest0-21swapper/211:49:022
328299494,27cyclictest0-21swapper/211:20:052
328299494,27cyclictest0-21swapper/207:23:542
3282994935,8cyclictest19760-21grep10:48:542
3282994932,10cyclictest21481-21ps09:44:052
3282994918,13cyclictest0-21swapper/207:53:532
3282994916,13cyclictest0-21swapper/207:49:032
328199498,24cyclictest30949-21aten_r1power_cu08:58:501
328199494,28cyclictest0-21swapper/112:18:521
328199494,28cyclictest0-21swapper/111:28:521
328199494,28cyclictest0-21swapper/107:19:091
328199494,27cyclictest0-21swapper/109:33:511
328199494,26cyclictest0-21swapper/108:43:401
328199493,26cyclictest0-21swapper/111:43:331
248599490,5rtkit-daemon2484-21rtkit-daemon08:58:283
232542493,7sleep223366-21perl07:34:002
207932492,9sleep10-21swapper/110:50:051
52852482,39sleep10-21swapper/109:10:011
3283994817,12cyclictest0-21swapper/309:08:563
328299484,27cyclictest0-21swapper/212:14:002
328299484,27cyclictest0-21swapper/210:38:472
328299484,27cyclictest0-21swapper/210:08:522
328299484,27cyclictest0-21swapper/208:29:012
328299484,27cyclictest0-21swapper/206:59:132
328299484,27cyclictest0-21swapper/206:59:132
3282994832,10cyclictest7295-21cut10:23:512
3282994831,10cyclictest25656-21head12:08:512
328199485,34cyclictest0-21swapper/110:13:351
328199484,27cyclictest0-21swapper/107:03:431
328199484,27cyclictest0-21swapper/107:03:431
328199484,26cyclictest0-21swapper/111:23:331
328199484,26cyclictest0-21swapper/110:54:001
328199484,26cyclictest0-21swapper/107:43:421
328199484,26cyclictest0-21swapper/107:43:421
328199484,25cyclictest30897-21taskset07:49:091
3281994832,10cyclictest3399-21needreboot10:14:011
3281994810,8cyclictest0-21swapper/110:58:541
306532483,8sleep130712-21iostat10:03:581
304232482,9sleep10-21swapper/111:11:131
278922482,39sleep20-21swapper/211:04:172
248599480,4rtkit-daemon2484-21rtkit-daemon10:04:173
209062482,39sleep10-21swapper/108:35:551
328399475,35cyclictest0-21swapper/307:29:023
328399475,23cyclictest0-21swapper/310:08:503
328399474,35cyclictest1419-21runrttasks07:23:543
328299474,24cyclictest0-21swapper/208:48:522
3282994734,8cyclictest9663-21grep10:28:492
3282994734,8cyclictest9663-21grep10:28:492
3282994734,8cyclictest21904-21unixbench_multi07:29:172
3282994717,12cyclictest0-21swapper/207:38:562
3282994717,12cyclictest0-21swapper/207:38:562
3281994721,8cyclictest29552-21cat12:18:311
302962472,9sleep30-21swapper/311:09:343
248599470,4rtkit-daemon2484-21rtkit-daemon09:04:203
248599470,4rtkit-daemon2484-21rtkit-daemon09:04:203
151582472,9sleep30-21swapper/307:18:213
113972472,39sleep10-21swapper/108:16:281
102122472,37sleep10-21swapper/109:21:581
3283994631,9cyclictest1419-21runrttasks07:55:333
328299464,26cyclictest0-21swapper/207:08:532
3281994615,13cyclictest0-21swapper/111:23:451
328399454,33cyclictest0-21swapper/309:23:383
3283994515,12cyclictest0-21swapper/307:44:273
328199456,12cyclictest0-21swapper/112:08:431
328199455,26cyclictest0-21swapper/108:12:211
328199454,12cyclictest0-21swapper/107:29:131
3281994526,13cyclictest0-21swapper/110:39:081
3281994518,11cyclictest0-21swapper/108:27:231
3281994518,11cyclictest0-21swapper/108:27:231
328199447,29cyclictest0-21swapper/107:34:011
3281994428,11cyclictest0-21swapper/107:54:111
328299434,23cyclictest0-21swapper/208:33:522
328199424,31cyclictest0-21swapper/110:30:561
328199424,31cyclictest0-21swapper/110:30:561
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional