You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 00:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Thu Nov 20, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21675999521,13cyclictest0-21swapper/008:30:550
2167599944,28cyclictest0-21swapper/010:25:540
2167599944,27cyclictest0-21swapper/011:01:030
2167599914,28cyclictest0-21swapper/011:16:060
2167599914,28cyclictest0-21swapper/010:40:470
2167599898,27cyclictest0-21swapper/012:00:440
2167599883,78cyclictest0-21swapper/010:10:460
2167599883,29cyclictest0-21swapper/007:00:540
2167599874,28cyclictest0-21swapper/009:35:550
2167599864,74cyclictest0-21swapper/009:40:490
2167599864,26cyclictest0-21swapper/011:56:080
21675998631,48cyclictest9071-21cut07:40:540
2167599854,27cyclictest0-21swapper/007:16:120
2167599854,12cyclictest0-21swapper/007:50:520
2167599853,27cyclictest0-21swapper/007:25:520
2167599844,28cyclictest0-21swapper/011:25:310
2167599834,27cyclictest0-21swapper/010:06:040
2167599826,27cyclictest0-21swapper/008:06:010
2167599824,34cyclictest0-21swapper/011:45:300
2167599824,34cyclictest0-21swapper/011:45:300
2167599824,26cyclictest0-21swapper/009:20:530
21675998220,12cyclictest0-21swapper/010:34:210
21675998213,12cyclictest0-21swapper/007:56:120
2167599815,14cyclictest0-21swapper/007:20:530
2167599815,14cyclictest0-21swapper/007:20:530
2167599814,33cyclictest0-21swapper/008:56:040
2167599814,33cyclictest0-21swapper/008:26:070
2167599814,27cyclictest0-21swapper/009:46:090
2167599814,27cyclictest0-21swapper/007:46:130
2167599814,14cyclictest0-21swapper/011:30:570
2167599813,25cyclictest0-21swapper/010:00:490
21675998118,7cyclictest14348-21munin-run11:15:320
21675998117,18cyclictest1369-21runrttasks11:46:240
2167599807,8cyclictest21669-21cyclictest09:25:540
2167599806,13cyclictest0-21swapper/007:30:590
2167599804,31cyclictest0-21swapper/009:56:280
2167599804,27cyclictest0-21swapper/009:50:530
2167599804,27cyclictest0-21swapper/009:01:080
2167599804,26cyclictest0-21swapper/008:54:050
2167599804,26cyclictest0-21swapper/008:00:570
2167599804,26cyclictest0-21swapper/008:00:570
2167599804,23cyclictest0-21swapper/010:52:110
2167599804,13cyclictest0-21swapper/008:40:530
21675998021,9cyclictest14186-21grep12:20:480
243799790,4rtkit-daemon2436-21rtkit-daemon07:36:063
2167599798,28cyclictest0-21swapper/012:25:420
2167599798,28cyclictest0-21swapper/012:25:420
2167599794,34cyclictest0-21swapper/011:50:450
2167599794,32cyclictest0-21swapper/010:35:550
2167599794,29cyclictest0-21swapper/010:45:450
2167599794,25cyclictest0-21swapper/008:49:040
2167599794,25cyclictest0-21swapper/008:49:040
2167599793,26cyclictest0-21swapper/009:11:040
2167599793,12cyclictest0-21swapper/009:15:500
21675997924,9cyclictest6280-21head12:05:420
243799780,4rtkit-daemon2436-21rtkit-daemon07:46:131
2167599784,32cyclictest0-21swapper/010:23:110
2167599784,26cyclictest0-21swapper/010:59:110
2167599784,26cyclictest0-21swapper/010:59:110
2167599784,26cyclictest0-21swapper/008:39:140
2167599784,11cyclictest0-21swapper/007:35:530
2167599783,32cyclictest1369-21runrttasks12:14:300
2167599783,23cyclictest0-21swapper/011:38:100
21675997825,9cyclictest23367-21cpuspeed_turbos08:10:550
2167599774,27cyclictest0-21swapper/007:10:590
2167599774,22cyclictest0-21swapper/008:15:570
2167599774,16cyclictest0-21swapper/007:06:060
2167599774,12cyclictest0-21swapper/011:30:300
2167599773,13cyclictest0-21swapper/010:15:450
2167599773,13cyclictest0-21swapper/010:15:450
2167599765,26cyclictest0-21swapper/011:06:040
2167599764,33cyclictest0-21swapper/009:10:370
2167599744,28cyclictest0-21swapper/012:19:380
2167599734,32cyclictest0-21swapper/009:30:500
2167599734,32cyclictest0-21swapper/009:30:500
21675997212,11cyclictest0-21swapper/008:20:530
243799710,8rtkit-daemon0-21swapper/007:50:581
243799710,4rtkit-daemon2436-21rtkit-daemon11:30:572
243799660,4rtkit-daemon2436-21rtkit-daemon09:41:012
243799660,4rtkit-daemon2436-21rtkit-daemon07:20:072
146222660,6sleep214624-21tail10:05:592
243799650,7rtkit-daemon0-21swapper/008:10:571
243799650,4rtkit-daemon2436-21rtkit-daemon12:05:562
243799650,4rtkit-daemon2436-21rtkit-daemon11:01:062
243799650,4rtkit-daemon2436-21rtkit-daemon10:56:512
243799650,4rtkit-daemon2436-21rtkit-daemon10:56:512
243799650,4rtkit-daemon2436-21rtkit-daemon10:51:212
243799650,4rtkit-daemon2436-21rtkit-daemon10:14:452
243799640,5rtkit-daemon2436-21rtkit-daemon08:46:332
243799640,5rtkit-daemon2436-21rtkit-daemon08:46:332
243799640,4rtkit-daemon2436-21rtkit-daemon07:00:452
243799620,8rtkit-daemon0-21swapper/210:47:212
243799620,7rtkit-daemon0-21swapper/210:21:072
243799620,7rtkit-daemon0-21swapper/207:23:072
243799620,7rtkit-daemon0-21swapper/207:23:072
243799620,3rtkit-daemon29-21ksoftirqd/209:30:172
243799620,10rtkit-daemon0-21swapper/211:39:422
243799610,8rtkit-daemon0-21swapper/212:11:332
243799610,8rtkit-daemon0-21swapper/211:56:332
243799610,8rtkit-daemon0-21swapper/210:41:512
243799610,8rtkit-daemon0-21swapper/210:27:442
243799610,7rtkit-daemon0-21swapper/209:33:022
243799610,7rtkit-daemon0-21swapper/209:33:022
243799610,7rtkit-daemon0-21swapper/207:07:152
243799610,6rtkit-daemon0-21swapper/211:19:422
2167999614,14cyclictest0-21swapper/112:06:001
243799600,9rtkit-daemon0-21swapper/208:36:042
243799600,8rtkit-daemon0-21swapper/211:21:052
243799600,8rtkit-daemon0-21swapper/209:58:232
243799600,7rtkit-daemon0-21swapper/212:02:562
243799600,7rtkit-daemon0-21swapper/210:02:232
243799600,7rtkit-daemon0-21swapper/008:00:351
243799600,6rtkit-daemon0-21swapper/211:45:412
243799600,6rtkit-daemon0-21swapper/211:42:112
243799600,6rtkit-daemon0-21swapper/211:42:112
243799600,6rtkit-daemon0-21swapper/211:09:132
243799600,5rtkit-daemon2436-21rtkit-daemon08:54:332
243799600,4rtkit-daemon2436-21rtkit-daemon11:27:572
243799600,4rtkit-daemon2436-21rtkit-daemon09:08:552
243799600,4rtkit-daemon2436-21rtkit-daemon08:32:262
243799600,10rtkit-daemon0-21swapper/209:54:012
2167999604,13cyclictest0-21swapper/111:25:511
243799590,6rtkit-daemon0-21swapper/212:20:552
243799590,6rtkit-daemon0-21swapper/210:31:592
243799590,5rtkit-daemon25129-21chrt08:14:422
243799590,5rtkit-daemon2436-21rtkit-daemon09:13:102
243799590,5rtkit-daemon0-21swapper/209:50:082
2167999599,27cyclictest0-21swapper/110:05:461
243799580,6rtkit-daemon0-21swapper/207:31:513
243799580,2rtkit-daemon0-21swapper/211:52:262
243799570,2rtkit-daemon0-21swapper/210:16:452
243799570,2rtkit-daemon0-21swapper/210:16:452
136102574,45sleep20-21swapper/207:50:532
243799560,5rtkit-daemon2436-21rtkit-daemon07:46:062
243799560,5rtkit-daemon0-21swapper/209:14:473
21679995622,15cyclictest0-21swapper/109:36:131
243799550,6rtkit-daemon0-21swapper/208:31:193
2168099554,29cyclictest0-21swapper/207:36:042
21680995537,11cyclictest29549-21grep08:21:102
21679995522,15cyclictest0-21swapper/110:55:531
21679995522,15cyclictest0-21swapper/110:55:531
21679995521,15cyclictest0-21swapper/107:01:051
2168199545,26cyclictest0-21swapper/309:36:133
21681995438,10cyclictest5087-21munin-node08:40:593
21681995434,13cyclictest0-21swapper/307:55:393
21681995425,13cyclictest0-21swapper/309:16:083
2168099544,29cyclictest0-21swapper/212:25:542
2168099544,29cyclictest0-21swapper/212:25:542
2168099544,28cyclictest0-21swapper/208:25:552
21680995433,15cyclictest26310-21grep08:15:552
2167999545,31cyclictest0-21swapper/107:06:181
2167999545,30cyclictest0-21swapper/112:05:291
20392543,11sleep10-21swapper/110:47:311
152572542,45sleep30-21swapper/310:06:303
75532533,11sleep10-21swapper/107:36:081
2168099534,40cyclictest0-21swapper/208:06:002
21680995327,20cyclictest28238-21cat07:11:132
2167999536,29cyclictest0-21swapper/109:45:591
2167999535,30cyclictest0-21swapper/111:40:541
2167999535,30cyclictest0-21swapper/111:40:541
2167999535,29cyclictest0-21swapper/110:25:541
2167999535,25cyclictest17101-21aten2.4-expect09:05:481
2167999534,31cyclictest0-21swapper/110:40:491
2167999534,31cyclictest0-21swapper/109:10:571
2167999534,30cyclictest0-21swapper/111:20:581
2167999534,30cyclictest0-21swapper/111:10:461
2167999534,30cyclictest0-21swapper/107:16:041
21679995333,12cyclictest1369-21runrttasks10:20:501
21679995321,14cyclictest0-21swapper/112:25:491
21679995321,14cyclictest0-21swapper/112:25:491
179562532,10sleep30-21swapper/307:59:403
298132523,11sleep10-21swapper/110:39:291
243799520,5rtkit-daemon2436-21rtkit-daemon09:21:102
243412522,9sleep30-21swapper/308:11:093
2168199526,28cyclictest0-21swapper/311:25:443
2168199524,34cyclictest20514-21cat08:05:403
2168199524,34cyclictest20514-21cat08:05:403
2168199523,30cyclictest0-21swapper/308:07:513
2167999526,28cyclictest0-21swapper/109:00:391
2167999525,29cyclictest0-21swapper/110:01:011
2167999525,28cyclictest0-21swapper/108:16:081
2167999524,29cyclictest0-21swapper/108:20:541
2167999524,28cyclictest0-21swapper/111:35:451
2167999524,26cyclictest10955-21munin-node12:15:451
21679995232,12cyclictest17558-21unixbench_singl10:11:071
21679995220,13cyclictest0-21swapper/111:31:021
243799510,5rtkit-daemon2436-21rtkit-daemon12:15:552
243799510,5rtkit-daemon2436-21rtkit-daemon08:56:032
2168199515,28cyclictest0-21swapper/312:20:563
21681995137,9cyclictest0-21swapper/311:01:363
2168199513,40cyclictest0-21swapper/308:46:423
2168199513,40cyclictest0-21swapper/308:46:423
2168099514,29cyclictest0-21swapper/207:30:582
2168099514,28cyclictest0-21swapper/210:36:042
2168099514,28cyclictest0-21swapper/209:01:002
2167999515,30cyclictest0-21swapper/109:51:081
2167999515,28cyclictest0-21swapper/109:15:551
2167999515,27cyclictest1369-21runrttasks09:21:001
21679995130,13cyclictest4363-21unixbench_singl10:51:081
105872513,42sleep10-21swapper/109:57:491
70042503,41sleep10-21swapper/108:42:401
285612502,10sleep30-21swapper/309:28:133
2168199504,29cyclictest0-21swapper/311:05:493
2168199504,28cyclictest0-21swapper/311:11:073
2168199504,28cyclictest0-21swapper/307:06:003
21681995031,12cyclictest18243-21needreboot09:06:013
2168199503,28cyclictest0-21swapper/312:05:303
21681995028,14cyclictest0-21swapper/308:15:473
2168199502,35cyclictest0-21swapper/308:36:033
2167999505,28cyclictest0-21swapper/112:25:161
2167999504,30cyclictest0-21swapper/111:54:381
2167999504,30cyclictest0-21swapper/108:29:141
2167999504,28cyclictest0-21swapper/111:55:471
2167999504,28cyclictest0-21swapper/109:45:361
2167999504,28cyclictest0-21swapper/107:21:121
2167999504,28cyclictest0-21swapper/107:21:121
21679995031,12cyclictest29850-21gltestperf09:30:581
21679995031,12cyclictest29850-21gltestperf09:30:581
21679995020,12cyclictest0-21swapper/112:15:291
118902503,11sleep10-21swapper/108:53:561
243799490,4rtkit-daemon2436-21rtkit-daemon07:25:522
2168199494,27cyclictest0-21swapper/310:51:023
2168199494,27cyclictest0-21swapper/310:15:563
2168199494,27cyclictest0-21swapper/310:15:563
2168199494,27cyclictest0-21swapper/310:00:503
2168199494,27cyclictest0-21swapper/309:45:583
21681994933,10cyclictest3113-21unixbench_multi11:56:033
21681994932,11cyclictest29924-21gltestperf07:16:003
2168199493,28cyclictest0-21swapper/311:21:073
2168199493,28cyclictest0-21swapper/309:21:023
21681994929,13cyclictest0-21swapper/311:30:593
21680994925,15cyclictest0-21swapper/209:17:312
21680994920,12cyclictest0-21swapper/211:11:072
21679994919,13cyclictest0-21swapper/107:43:511
21679994919,13cyclictest0-21swapper/107:31:021
213422494,6sleep00-21swapper/006:56:460
141712493,11sleep10-21swapper/108:57:311
68772482,40sleep30-21swapper/310:56:363
68772482,40sleep30-21swapper/310:56:363
243799480,5rtkit-daemon2436-21rtkit-daemon07:42:062
22632483,39sleep10-21swapper/108:33:371
2168199484,39cyclictest0-21swapper/307:25:543
2168199484,27cyclictest0-21swapper/311:50:313
2168199484,27cyclictest0-21swapper/309:56:083
2168199484,26cyclictest0-21swapper/307:25:413
2168199484,26cyclictest0-21swapper/307:25:413
21681994832,10cyclictest17388-21unixbench-2d12:26:023
21681994832,10cyclictest17388-21unixbench-2d12:26:023
2168199483,30cyclictest0-21swapper/308:55:523
21681994818,12cyclictest0-21swapper/309:00:543
21680994828,13cyclictest18036-21crond08:00:392
2167999485,26cyclictest0-21swapper/110:18:121
2167999485,26cyclictest0-21swapper/110:18:121
2167999484,26cyclictest0-21swapper/107:13:461
98002473,38sleep10-21swapper/111:05:411
33212472,10sleep30-21swapper/309:41:393
273772472,9sleep30-21swapper/310:33:513
2168199475,25cyclictest0-21swapper/312:05:543
2168199474,36cyclictest0-21swapper/308:30:383
21681994731,11cyclictest27720-21needreboot11:40:573
21681994731,11cyclictest27720-21needreboot11:40:573
21681994731,10cyclictest28339-21unixbench-2d07:11:133
2168199473,26cyclictest0-21swapper/310:41:043
21681994729,12cyclictest0-21swapper/310:46:013
21680994732,9cyclictest31994-21tune2fs09:35:572
2167999475,27cyclictest0-21swapper/108:39:031
2167999475,26cyclictest0-21swapper/110:34:211
2167999474,26cyclictest0-21swapper/107:28:481
2167999474,12cyclictest0-21swapper/108:06:121
2167999473,31cyclictest0-21swapper/109:27:411
2167999473,27cyclictest0-21swapper/111:48:091
21679994728,11cyclictest7803-21cpuspeed_turbos08:45:521
21679994728,11cyclictest7803-21cpuspeed_turbos08:45:521
21679994713,11cyclictest0-21swapper/108:01:151
21679994713,11cyclictest0-21swapper/108:01:151
238042462,9sleep30-21swapper/307:02:363
2168199465,13cyclictest0-21swapper/307:41:063
2168199464,23cyclictest21157-21diskstats10:20:513
2168199464,13cyclictest0-21swapper/311:35:493
21680994628,11cyclictest5938-21sed08:40:582
191712462,10sleep20-21swapper/208:01:002
191712462,10sleep20-21swapper/208:01:002
2168199455,33cyclictest0-21swapper/312:15:563
2168199455,32cyclictest0-21swapper/310:10:453
2168199455,24cyclictest0-21swapper/309:54:153
2168199454,34cyclictest0-21swapper/311:16:043
2168199454,33cyclictest0-21swapper/308:20:493
2168199454,33cyclictest0-21swapper/307:00:423
21681994525,14cyclictest0-21swapper/310:35:533
2167999455,12cyclictest0-21swapper/111:01:041
2168199445,13cyclictest0-21swapper/310:29:203
2168199444,34cyclictest0-21swapper/312:10:503
2168199444,22cyclictest0-21swapper/309:30:503
2168199444,22cyclictest0-21swapper/309:30:503
21681994428,9cyclictest11272-21fgrep08:51:073
2167999443,12cyclictest0-21swapper/107:00:421
2168199434,33cyclictest0-21swapper/307:46:103
21681994327,11cyclictest0-21swapper/311:50:423
203452434,32sleep20-21swapper/206:56:002
2167999424,31cyclictest0-21swapper/111:16:081
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional