You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-30 - 19:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sat Aug 30, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2299999993,70cyclictest1265-21runrttasks08:55:402
22992999526,12cyclictest22993-21idleruntime-cro05:40:350
22999999217,49cyclictest0-21swapper/210:25:412
2299999914,62cyclictest0-21swapper/207:35:502
2299999904,63cyclictest0-21swapper/210:20:542
2299999904,63cyclictest0-21swapper/210:20:542
2299999884,62cyclictest0-21swapper/209:15:512
2299999875,65cyclictest25612-21chrt10:15:382
2299999874,67cyclictest0-21swapper/207:55:492
2299999874,67cyclictest0-21swapper/206:25:522
22999998721,42cyclictest0-21swapper/206:06:102
2299999864,66cyclictest0-21swapper/210:45:402
2299999864,66cyclictest0-21swapper/208:01:012
2299999864,59cyclictest0-21swapper/206:40:502
22999998613,9cyclictest1584-21nscd09:25:272
2299999858,12cyclictest0-21swapper/209:05:452
2299999844,64cyclictest0-21swapper/210:50:592
2299999844,64cyclictest0-21swapper/208:41:012
2299999844,63cyclictest0-21swapper/207:15:572
2299999844,63cyclictest0-21swapper/207:15:572
2299999844,59cyclictest0-21swapper/209:49:022
22999998419,48cyclictest0-21swapper/206:40:342
22999998419,48cyclictest0-21swapper/206:40:342
2299999834,63cyclictest0-21swapper/209:26:032
2299999834,14cyclictest0-21swapper/211:10:232
2299999834,14cyclictest0-21swapper/211:10:232
2299999824,12cyclictest0-21swapper/209:00:442
2299999823,72cyclictest0-21swapper/206:56:042
22999998218,47cyclictest0-21swapper/207:00:542
22999998212,12cyclictest0-21swapper/207:40:592
2299999814,70cyclictest0-21swapper/208:20:492
2299999814,62cyclictest0-21swapper/205:58:232
2299999814,58cyclictest0-21swapper/208:30:302
2299999814,15cyclictest0-21swapper/209:40:272
2299999814,15cyclictest0-21swapper/209:40:272
2299999814,15cyclictest0-21swapper/208:08:452
22999998113,11cyclictest0-21swapper/206:45:482
22999998110,12cyclictest0-21swapper/207:30:492
2299999805,68cyclictest0-21swapper/206:11:072
2299999804,63cyclictest0-21swapper/205:48:222
2299999804,56cyclictest0-21swapper/208:35:432
2299999803,69cyclictest0-21swapper/207:50:582
2299999795,14cyclictest0-21swapper/207:10:462
2299999794,68cyclictest0-21swapper/210:14:392
2299999794,14cyclictest0-21swapper/210:35:392
2299999794,14cyclictest0-21swapper/209:40:572
2299999793,58cyclictest0-21swapper/211:00:472
2299999784,68cyclictest0-21swapper/209:30:432
2299999784,67cyclictest0-21swapper/205:41:072
2299999784,66cyclictest0-21swapper/207:21:032
2299999784,66cyclictest0-21swapper/207:21:032
22999997822,49cyclictest0-21swapper/208:53:532
22999997822,49cyclictest0-21swapper/208:53:532
22999997821,50cyclictest1112-21sshd10:31:392
22999997814,8cyclictest22983-21cyclictest06:00:472
22999997813,9cyclictest106250irq/46-eth007:26:072
2299999778,14cyclictest0-21swapper/206:15:512
2299999774,65cyclictest0-21swapper/208:31:042
2299999774,57cyclictest0-21swapper/206:33:292
2299999774,13cyclictest0-21swapper/207:46:012
2299999773,21cyclictest0-21swapper/208:46:262
22999997722,49cyclictest1265-21runrttasks06:25:172
2299999764,14cyclictest0-21swapper/209:56:002
2299999763,57cyclictest0-21swapper/207:05:462
22999997620,49cyclictest12495-21cpu10:55:432
22999997617,42cyclictest0-21swapper/208:18:472
2299999759,10cyclictest106250irq/46-eth006:50:592
2299999755,15cyclictest0-21swapper/205:40:362
2299999754,54cyclictest0-21swapper/205:53:222
2299999754,54cyclictest0-21swapper/205:53:222
2299999754,16cyclictest0-21swapper/210:05:482
22999997524,45cyclictest0-21swapper/209:50:552
22999997522,47cyclictest0-21swapper/209:10:472
22999997520,48cyclictest0-21swapper/210:40:502
2299999744,63cyclictest0-21swapper/208:10:452
22999997420,47cyclictest19442-21missed_timers10:00:522
223099630,6rtkit-daemon2229-21rtkit-daemon10:06:521
11912620,6sleep01192-21wc08:15:500
223099610,4rtkit-daemon2229-21rtkit-daemon09:32:011
223099600,5rtkit-daemon2229-21rtkit-daemon07:05:441
324432593,11sleep30-21swapper/308:15:263
223099590,4rtkit-daemon2229-21rtkit-daemon09:00:401
31652583,47sleep00-21swapper/008:20:470
120602573,47sleep10-21swapper/110:55:241
105872572,48sleep31160-21snmpd09:41:353
315902565,43sleep00-21swapper/008:10:590
22995995622,14cyclictest0-21swapper/107:26:041
22995995621,14cyclictest0-21swapper/109:10:401
295152553,7sleep329574-21df_abs07:00:493
191192554,43sleep30-21swapper/306:37:363
191192554,43sleep30-21swapper/306:37:363
2299599546,27cyclictest0-21swapper/110:00:381
22995995411,25cyclictest0-21swapper/106:40:331
22995995411,25cyclictest0-21swapper/106:40:331
181262542,11sleep30-21swapper/307:45:313
132802543,8sleep113426-21sort09:50:271
97162535,10sleep30-21swapper/306:19:463
2300099534,30cyclictest0-21swapper/310:51:033
23000995336,10cyclictest32661-21needreboot09:20:563
2299599535,29cyclictest0-21swapper/109:43:451
2299599535,28cyclictest0-21swapper/106:20:501
2299599535,27cyclictest0-21swapper/105:46:141
2299599534,26cyclictest0-21swapper/109:05:481
22995995321,14cyclictest0-21swapper/106:43:311
179732533,9sleep00-21swapper/009:59:330
39732524,42sleep03945-21munin-node09:30:430
299712523,43sleep10-21swapper/108:09:191
2300099524,25cyclictest0-21swapper/311:00:403
23000995237,9cyclictest2132-21sed06:01:083
2299599525,29cyclictest0-21swapper/109:25:461
2299599524,29cyclictest0-21swapper/110:35:591
2299299523,43cyclictest0-21swapper/006:42:240
223099520,5rtkit-daemon2229-21rtkit-daemon09:16:021
223099520,5rtkit-daemon2229-21rtkit-daemon07:35:431
169252523,42sleep10-21swapper/109:55:511
129882523,10sleep30-21swapper/307:31:163
10562523,10sleep30-21swapper/307:08:153
80242512,42sleep00-21swapper/007:21:060
80242512,42sleep00-21swapper/007:21:060
45602512,9sleep00-21swapper/010:36:210
282692513,41sleep00-21swapper/006:56:070
27832513,10sleep10-21swapper/108:20:361
237962512,43sleep00-21swapper/006:46:150
2300099515,28cyclictest0-21swapper/306:25:483
2300099514,28cyclictest0-21swapper/309:25:553
2300099514,28cyclictest0-21swapper/308:00:313
2300099513,23cyclictest0-21swapper/310:45:383
23000995121,12cyclictest0-21swapper/310:05:253
23000995121,12cyclictest0-21swapper/306:55:553
23000995120,12cyclictest0-21swapper/308:25:293
2299599515,28cyclictest0-21swapper/109:35:491
2299599515,28cyclictest0-21swapper/109:35:491
2299599515,28cyclictest0-21swapper/106:55:491
2299599515,27cyclictest0-21swapper/108:00:591
2299599515,27cyclictest0-21swapper/107:45:461
2299599514,28cyclictest0-21swapper/106:01:051
22992995134,10cyclictest459-21grep10:30:400
2299299513,42cyclictest0-21swapper/008:30:580
22992995112,32cyclictest17055-21munin-node11:05:560
22992995112,32cyclictest17055-21munin-node11:05:560
227262513,42sleep00-21swapper/007:53:140
223099510,4rtkit-daemon2229-21rtkit-daemon10:15:441
223099510,4rtkit-daemon2229-21rtkit-daemon08:06:040
204312513,41sleep00-21swapper/010:05:260
184652513,10sleep30-21swapper/311:05:543
184652513,10sleep30-21swapper/311:05:543
2300099505,27cyclictest0-21swapper/310:30:503
2300099504,28cyclictest0-21swapper/307:20:503
2300099504,28cyclictest0-21swapper/307:20:503
2300099504,28cyclictest0-21swapper/305:50:573
2300099504,28cyclictest0-21swapper/305:50:573
2300099504,27cyclictest0-21swapper/310:40:403
2300099504,27cyclictest0-21swapper/310:20:403
2300099504,27cyclictest0-21swapper/310:20:403
2300099504,27cyclictest0-21swapper/310:15:513
2300099504,27cyclictest0-21swapper/309:00:483
2300099504,27cyclictest0-21swapper/308:50:513
2300099504,27cyclictest0-21swapper/308:50:513
2300099504,24cyclictest0-21swapper/306:05:473
23000995032,11cyclictest25122-21fschecks_time06:50:543
2300099503,28cyclictest0-21swapper/307:36:043
2300099502,42cyclictest0-21swapper/309:32:143
2299599505,27cyclictest0-21swapper/110:20:381
2299599505,27cyclictest0-21swapper/110:20:381
2299599505,25cyclictest23788-21yum06:46:101
2299599504,27cyclictest0-21swapper/107:40:471
22995995036,8cyclictest28844-21head05:50:561
22995995036,8cyclictest28844-21head05:50:561
22995995032,10cyclictest23171-21aten_r1power_cu07:55:431
22995995030,12cyclictest8104-21fschecks_count10:45:431
2299599503,28cyclictest0-21swapper/106:30:341
22995995019,13cyclictest0-21swapper/111:04:061
22995995019,13cyclictest0-21swapper/108:55:401
22995995017,13cyclictest0-21swapper/107:20:531
22995995017,13cyclictest0-21swapper/107:20:531
2299299503,12cyclictest0-21swapper/006:35:070
223099500,5rtkit-daemon2229-21rtkit-daemon11:00:430
223099500,5rtkit-daemon2229-21rtkit-daemon10:40:580
223099500,4rtkit-daemon2229-21rtkit-daemon07:55:570
11172503,10sleep00-21swapper/009:24:430
106732502,42sleep00-21swapper/009:42:400
59502493,9sleep00-21swapper/007:17:510
59502493,9sleep00-21swapper/007:17:510
2300099494,27cyclictest0-21swapper/310:35:533
2300099494,27cyclictest0-21swapper/309:50:493
2300099494,27cyclictest0-21swapper/308:40:543
2300099494,27cyclictest0-21swapper/308:35:303
2300099494,27cyclictest0-21swapper/307:25:513
2300099494,27cyclictest0-21swapper/306:46:043
2300099494,27cyclictest0-21swapper/305:55:533
2300099494,26cyclictest0-21swapper/308:00:543
23000994933,9cyclictest2374-21fschecks_time07:10:523
23000994931,11cyclictest30220-21munin-node10:25:463
23000994919,12cyclictest0-21swapper/310:55:563
23000994917,13cyclictest0-21swapper/307:16:013
23000994917,13cyclictest0-21swapper/307:16:013
2299599495,26cyclictest0-21swapper/107:03:341
2299599494,27cyclictest0-21swapper/108:16:131
2299599494,27cyclictest0-21swapper/106:20:351
2299599494,27cyclictest0-21swapper/106:08:251
22995994933,10cyclictest1738-21taskset10:30:581
22995994932,9cyclictest31228-21gltestperf05:55:551
22995994932,10cyclictest25104-21grep06:50:531
2299599493,27cyclictest0-21swapper/110:45:241
22995994911,20cyclictest0-21swapper/106:30:461
192682493,39sleep10-21swapper/108:55:221
192682493,39sleep10-21swapper/108:55:221
47122482,39sleep00-21swapper/006:06:450
34882482,39sleep00-21swapper/007:11:550
264082482,40sleep00-21swapper/006:54:130
2300099484,27cyclictest0-21swapper/309:45:593
23000994818,12cyclictest0-21swapper/310:10:553
23000994818,12cyclictest0-21swapper/308:30:293
2299599484,27cyclictest0-21swapper/107:50:561
2299599484,26cyclictest0-21swapper/111:09:141
2299599484,26cyclictest0-21swapper/111:09:141
2299599484,26cyclictest0-21swapper/105:43:211
2299599484,25cyclictest0-21swapper/107:31:561
22995994821,9cyclictest15320-21diskstats08:45:481
22995994818,12cyclictest0-21swapper/106:10:561
2299299484,39cyclictest0-21swapper/006:10:550
22992994834,9cyclictest14113-21grep06:26:080
22992994833,10cyclictest21906-21munin-node09:00:490
2299299483,27cyclictest0-21swapper/008:30:300
22992994815,21cyclictest0-21swapper/008:38:590
190152482,10sleep00-21swapper/006:36:160
190152482,10sleep00-21swapper/006:36:160
180162483,10sleep30-21swapper/310:00:093
81902473,38sleep00-21swapper/009:36:280
81902473,38sleep00-21swapper/009:36:280
51702473,37sleep10-21swapper/108:25:351
273972472,39sleep00-21swapper/010:17:510
2300099474,27cyclictest0-21swapper/308:58:533
2300099474,26cyclictest0-21swapper/306:20:553
2300099473,22cyclictest0-21swapper/308:15:413
23000994727,13cyclictest0-21swapper/305:45:363
2300099472,40cyclictest0-21swapper/310:06:153
2299599475,25cyclictest0-21swapper/110:55:411
2299599475,24cyclictest0-21swapper/110:10:501
2299599474,25cyclictest0-21swapper/108:31:001
2299599473,39cyclictest0-21swapper/107:16:061
2299599473,39cyclictest0-21swapper/107:16:061
2299599473,37cyclictest0-21swapper/108:36:001
2299599473,26cyclictest0-21swapper/108:41:011
22995994715,25cyclictest30428-21aten_r1power_po08:10:431
22992994731,10cyclictest30707-21grep05:55:490
22992994731,10cyclictest11232-21strings06:21:020
2299299473,40cyclictest0-21swapper/007:49:550
2299299473,28cyclictest0-21swapper/010:20:470
2299299473,28cyclictest0-21swapper/010:20:470
2299299473,13cyclictest0-21swapper/007:06:300
22992994729,12cyclictest0-21swapper/005:40:530
22992994715,17cyclictest11125-21munin-node09:45:430
149052472,9sleep30-21swapper/308:45:453
310592462,38sleep00-21swapper/007:02:400
275372462,38sleep00-21swapper/005:47:550
2300099464,25cyclictest0-21swapper/308:35:443
2300099464,14cyclictest0-21swapper/306:41:003
23000994629,11cyclictest5564-21tr06:10:493
23000994617,12cyclictest0-21swapper/309:05:503
22995994631,9cyclictest14369-21gltestperf09:50:471
2299299465,35cyclictest0-21swapper/006:01:010
22992994631,9cyclictest16803-21gltestperf07:40:510
22992994620,12cyclictest0-21swapper/008:01:050
22992994616,12cyclictest0-21swapper/010:10:250
227462463,9sleep30-21swapper/307:53:293
223099460,4rtkit-daemon2229-21rtkit-daemon10:52:500
223099460,4rtkit-daemon2229-21rtkit-daemon07:10:591
142772462,10sleep00-21swapper/008:42:310
95392452,38sleep00-21swapper/006:17:250
298012452,9sleep00-21swapper/005:51:170
298012452,9sleep00-21swapper/005:51:170
288082452,37sleep00-21swapper/009:15:120
2300099455,33cyclictest0-21swapper/309:15:273
23000994515,12cyclictest0-21swapper/309:37:183
23000994515,12cyclictest0-21swapper/309:37:183
23000994515,12cyclictest0-21swapper/305:46:003
2299599453,26cyclictest0-21swapper/110:25:371
2299299454,34cyclictest0-21swapper/010:10:590
22992994532,8cyclictest14321-21gltestperf09:50:470
22992994531,9cyclictest25714-21find09:05:580
22992994530,9cyclictest14457-21grep07:35:520
2299299453,37cyclictest0-21swapper/009:18:140
2299299453,36cyclictest0-21swapper/010:45:380
214972452,38sleep00-21swapper/008:58:190
203662453,9sleep30-21swapper/307:48:383
167612453,36sleep00-21swapper/008:48:480
35062442,36sleep00-21swapper/009:27:570
131022443,36sleep00-21swapper/007:32:300
2300099434,24cyclictest0-21swapper/308:05:443
23000994326,10cyclictest14913-21aten_r1power_po06:30:463
2299599435,15cyclictest0-21swapper/109:20:571
2299299434,32cyclictest0-21swapper/008:55:140
2299299434,32cyclictest0-21swapper/008:55:140
22992994328,10cyclictest10933-21crond07:30:320
2300099423,22cyclictest0-21swapper/309:15:413
2299299424,32cyclictest0-21swapper/011:00:230
2299299424,32cyclictest0-21swapper/010:25:470
2299599384,29cyclictest0-21swapper/105:40:361
2300099372,23cyclictest0-21swapper/305:40:363
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional