You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-18 - 07:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Tue Nov 18, 2025 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
243799880,7rtkit-daemon0-21swapper/120:36:451
243799880,5rtkit-daemon10183-21latency_hist22:27:551
243799880,5rtkit-daemon10183-21latency_hist22:27:551
243799870,8rtkit-daemon0-21swapper/121:24:201
894799855,48cyclictest12394-21munin-run22:32:543
243799850,7rtkit-daemon0-21swapper/022:32:552
243799750,6rtkit-daemon0-21swapper/122:18:111
243799730,8rtkit-daemon0-21swapper/020:38:221
243799730,7rtkit-daemon0-21swapper/319:48:323
243799730,5rtkit-daemon18-21rcuc/121:37:571
243799720,6rtkit-daemon0-21swapper/120:43:151
243799720,5rtkit-daemon18-21rcuc/120:33:001
8947997122,40cyclictest4822-21unixbench_singl22:13:293
8947997116,46cyclictest12696-21munin-node20:18:373
243799700,6rtkit-daemon18-21rcuc/121:03:291
243799690,4rtkit-daemon2436-21rtkit-daemon19:13:031
243799690,4rtkit-daemon2436-21rtkit-daemon19:07:181
243799690,4rtkit-daemon2436-21rtkit-daemon00:28:363
243799680,7rtkit-daemon0-21swapper/021:57:041
243799680,6rtkit-daemon0-21swapper/121:59:341
243799680,5rtkit-daemon2436-21rtkit-daemon19:18:101
243799680,5rtkit-daemon2436-21rtkit-daemon19:09:111
894799673,13cyclictest0-21swapper/322:07:553
8947996716,36cyclictest18556-21munin-node23:53:133
8938996746,14cyclictest0-21swapper/021:02:590
243799670,5rtkit-daemon2436-21rtkit-daemon00:14:513
243799670,4rtkit-daemon2436-21rtkit-daemon22:59:473
8947996518,26cyclictest10998-21fschecks_time20:13:193
8947996518,26cyclictest10998-21fschecks_time20:13:193
894699655,52cyclictest0-21swapper/221:38:092
894699655,52cyclictest0-21swapper/221:38:092
243799650,5rtkit-daemon34-21rcuc/320:07:383
243799650,5rtkit-daemon2829-21yum-updatesd-he19:57:163
8938996442,15cyclictest0-21swapper/019:18:320
8947996314,40cyclictest1243-21snmpd20:23:373
894699634,51cyclictest0-21swapper/221:17:582
243799630,5rtkit-daemon27154-21ntp_states19:38:323
243799630,5rtkit-daemon19730-21iostat_ios19:23:253
8947996218,36cyclictest31566-21latency00:18:153
894699624,50cyclictest0-21swapper/221:58:162
894699624,50cyclictest0-21swapper/200:08:172
894499626,28cyclictest0-21swapper/121:17:571
8944996239,15cyclictest0-21swapper/121:12:581
305272623,12sleep20-21swapper/220:53:252
243799620,8rtkit-daemon0-21swapper/022:28:401
243799620,7rtkit-daemon0-21swapper/022:08:491
243799620,6rtkit-daemon0-21swapper/219:03:043
243799620,6rtkit-daemon0-21swapper/022:06:191
243799620,5rtkit-daemon0-21swapper/219:44:023
8944996111,41cyclictest0-21swapper/100:30:291
8938996134,9cyclictest0-21swapper/021:33:160
311642613,12sleep20-21swapper/222:03:142
243799610,8rtkit-daemon0-21swapper/021:27:581
243799610,14rtkit-daemon2436-21rtkit-daemon22:38:333
894799605,48cyclictest19859-21munin-node20:33:273
8947996011,28cyclictest19619-21crond20:32:593
8947996010,42cyclictest0-21swapper/320:42:593
894699604,49cyclictest0-21swapper/222:13:262
8944996037,15cyclictest0-21swapper/123:08:151
8944996037,15cyclictest0-21swapper/123:08:151
8944996010,26cyclictest0-21swapper/121:48:111
243799600,6rtkit-daemon0-21swapper/020:49:521
18792603,49sleep00-21swapper/023:18:090
8947995942,10cyclictest7808-21needreboot23:28:173
8947995927,24cyclictest14628-21gltestperf23:43:143
8947995920,31cyclictest26139-21cut21:53:103
8946995912,29cyclictest0-21swapper/200:13:022
8938995940,13cyclictest0-21swapper/021:57:570
894799589,30cyclictest0-21swapper/323:37:523
8947995816,19cyclictest27064-21runrttasks23:03:063
8947995814,37cyclictest0-21swapper/323:08:083
8947995814,37cyclictest0-21swapper/323:08:083
8947995813,39cyclictest0-21swapper/320:43:333
894699584,47cyclictest0-21swapper/222:33:092
894699583,48cyclictest0-21swapper/220:29:332
894699583,37cyclictest0-21swapper/223:49:252
894699583,37cyclictest0-21swapper/223:49:252
92932573,12sleep00-21swapper/019:03:180
894799579,26cyclictest3002-21cat22:12:563
8947995714,37cyclictest0-21swapper/320:52:593
8947995710,31cyclictest0-21swapper/321:38:133
8947995710,31cyclictest0-21swapper/321:38:133
8947995710,26cyclictest23528-21telnet21:48:113
894699574,46cyclictest0-21swapper/221:32:582
894799568,32cyclictest0-21swapper/323:22:473
894799564,38cyclictest0-21swapper/321:47:573
894799564,38cyclictest0-21swapper/321:47:573
8947995613,26cyclictest0-21swapper/323:58:033
8947995612,36cyclictest0-21swapper/320:58:113
894499564,33cyclictest0-21swapper/120:03:251
8944995635,14cyclictest0-21swapper/123:38:051
893899563,43cyclictest0-21swapper/021:43:100
893899563,43cyclictest0-21swapper/021:43:100
894799556,32cyclictest0-21swapper/319:08:143
894799555,31cyclictest0-21swapper/300:12:503
8947995538,10cyclictest14691-21head21:28:193
8947995537,12cyclictest24204-21sed00:03:113
8947995512,37cyclictest28759-21df_abs21:58:133
8947995512,35cyclictest22112-21iostat_ios19:28:253
8947995512,35cyclictest22112-21iostat_ios19:28:253
8947995511,29cyclictest14514-21diskstats19:13:213
894699554,31cyclictest0-21swapper/221:53:102
894499554,43cyclictest0-21swapper/119:28:011
8938995532,10cyclictest0-21swapper/022:34:490
893899553,45cyclictest0-21swapper/021:23:480
8938995512,27cyclictest4807-21unixbench_singl22:13:290
243799550,5rtkit-daemon2436-21rtkit-daemon23:03:172
894799544,39cyclictest0-21swapper/322:18:153
8947995422,25cyclictest1369-21runrttasks00:23:133
8947995420,27cyclictest17863-21timerwakeupswit21:33:303
8947995420,26cyclictest9950-21cut21:18:213
8947995414,24cyclictest1015-21crond23:17:523
8947995413,21cyclictest0-21swapper/322:33:223
8947995412,22cyclictest0-21swapper/322:23:133
8947995412,22cyclictest0-21swapper/322:23:133
8946995438,10cyclictest24997-21cpuspeed_turbos20:43:142
894499543,42cyclictest9098-21head23:33:081
8938995440,9cyclictest286612sleep000:13:060
893899544,42cyclictest0-21swapper/021:48:280
243799540,5rtkit-daemon2436-21rtkit-daemon23:38:153
894799534,30cyclictest0-21swapper/322:43:273
894799534,29cyclictest0-21swapper/321:08:243
894799534,29cyclictest0-21swapper/319:18:223
894799533,42cyclictest0-21swapper/321:26:253
8947995319,27cyclictest2429-21df_abs21:03:173
8947995310,36cyclictest9437-21sed20:08:333
894699534,22cyclictest0-21swapper/223:08:122
894699534,22cyclictest0-21swapper/223:08:122
8946995335,11cyclictest1439-21sed22:08:202
894699533,25cyclictest0-21swapper/222:53:072
8944995334,13cyclictest0-21swapper/119:48:021
893899535,40cyclictest0-21swapper/000:03:040
893899534,40cyclictest0-21swapper/019:53:120
8938995331,17cyclictest6460-21hwlatdetect20:03:220
31352534,37sleep00-21swapper/000:28:060
305102533,8sleep030525-21basename00:18:030
243799530,4rtkit-daemon2436-21rtkit-daemon22:49:253
894799524,29cyclictest0-21swapper/319:58:223
894799524,27cyclictest0-21swapper/321:17:573
8947995215,17cyclictest114550irq/46-eth023:48:053
8947995215,17cyclictest114550irq/46-eth023:48:053
894699524,33cyclictest0-21swapper/219:28:152
894699524,33cyclictest0-21swapper/219:28:152
894699524,28cyclictest0-21swapper/200:18:222
894499529,36cyclictest0-21swapper/120:23:301
894499524,30cyclictest0-21swapper/122:48:111
894499524,29cyclictest0-21swapper/123:18:081
8944995235,10cyclictest912-21cut19:53:151
893899525,40cyclictest0-21swapper/021:13:150
893899524,41cyclictest0-21swapper/020:28:310
893899524,41cyclictest0-21swapper/019:08:220
893899524,40cyclictest0-21swapper/020:08:120
893899524,27cyclictest0-21swapper/019:38:170
8938995236,11cyclictest0-21swapper/019:48:350
893899523,44cyclictest0-21swapper/020:13:360
893899523,44cyclictest0-21swapper/020:13:360
893899523,32cyclictest272932tr23:03:080
26112524,12sleep20-21swapper/221:03:202
243799520,5rtkit-daemon2436-21rtkit-daemon23:25:013
243799520,4rtkit-daemon2436-21rtkit-daemon22:57:093
130772523,10sleep10-21swapper/120:18:171
894799514,28cyclictest0-21swapper/319:33:173
8947995118,25cyclictest9966-21gltestperf19:03:243
8947995118,23cyclictest0-21swapper/320:57:153
894699514,41cyclictest0-21swapper/221:23:182
894699514,41cyclictest0-21swapper/219:08:192
894699514,39cyclictest0-21swapper/220:13:172
894699514,39cyclictest0-21swapper/220:13:172
894699514,30cyclictest0-21swapper/221:18:252
894699514,29cyclictest0-21swapper/223:58:152
894699514,29cyclictest0-21swapper/223:28:112
894699513,29cyclictest0-21swapper/222:58:132
894699513,27cyclictest0-21swapper/221:43:312
894699513,27cyclictest0-21swapper/221:43:312
894699513,27cyclictest0-21swapper/219:23:232
8946995119,13cyclictest0-21swapper/220:38:152
894499517,37cyclictest1559-21munin-run21:02:581
894499515,39cyclictest1243-21snmpd20:08:331
894499514,40cyclictest0-21swapper/123:23:251
894499514,39cyclictest0-21swapper/119:33:351
8944995128,7cyclictest27988-21iostat_ios23:03:161
893899515,39cyclictest0-21swapper/020:33:330
893899514,41cyclictest0-21swapper/019:13:360
893899514,40cyclictest0-21swapper/019:43:310
893899514,39cyclictest0-21swapper/022:58:150
8938995133,11cyclictest2300-21grep00:23:240
51682512,9sleep20-21swapper/220:01:252
148152512,42sleep00-21swapper/020:22:390
894699506,27cyclictest0-21swapper/219:53:292
894699505,26cyclictest0-21swapper/223:39:122
894699504,27cyclictest0-21swapper/223:44:122
894699504,26cyclictest0-21swapper/222:51:492
894699504,23cyclictest0-21swapper/200:04:292
894699503,26cyclictest0-21swapper/200:23:192
894699502,9cyclictest0-21swapper/223:33:292
8946995018,13cyclictest0-21swapper/219:48:222
8946995017,13cyclictest0-21swapper/220:23:292
894499506,37cyclictest0-21swapper/119:43:021
894499506,36cyclictest0-21swapper/100:13:081
894499504,28cyclictest0-21swapper/120:13:161
894499504,28cyclictest0-21swapper/120:13:161
894499504,26cyclictest0-21swapper/123:53:041
8944995032,11cyclictest25449-21grep22:58:161
8944995011,12cyclictest0-21swapper/100:23:101
893899505,29cyclictest0-21swapper/020:38:260
893899504,39cyclictest0-21swapper/023:23:250
893899504,39cyclictest0-21swapper/023:08:280
893899504,39cyclictest0-21swapper/023:08:280
893899504,39cyclictest0-21swapper/021:28:260
893899504,38cyclictest0-21swapper/023:47:520
893899504,38cyclictest0-21swapper/023:33:260
893899504,29cyclictest0-21swapper/022:43:180
893899504,29cyclictest0-21swapper/022:08:230
893899504,28cyclictest0-21swapper/019:23:260
893899504,25cyclictest0-21swapper/021:03:120
8938995033,12cyclictest0-21swapper/023:53:030
8938995029,14cyclictest0-21swapper/000:08:120
54932502,9sleep20-21swapper/222:18:092
894699494,29cyclictest0-21swapper/219:03:182
894699494,28cyclictest0-21swapper/220:03:322
894699494,27cyclictest0-21swapper/219:33:162
894699494,26cyclictest0-21swapper/219:18:262
894699493,27cyclictest0-21swapper/222:23:122
894699493,27cyclictest0-21swapper/222:23:122
894699493,27cyclictest0-21swapper/221:33:292
894699493,27cyclictest0-21swapper/220:08:322
8946994921,13cyclictest0-21swapper/219:43:022
894699492,9cyclictest0-21swapper/222:38:222
8946994919,11cyclictest0-21swapper/221:08:452
8946994918,13cyclictest0-21swapper/222:43:212
894499498,11cyclictest0-21swapper/121:47:571
894499498,11cyclictest0-21swapper/121:47:571
894499495,26cyclictest0-21swapper/123:59:281
894499494,37cyclictest0-21swapper/100:22:501
8944994923,7cyclictest19548-21latency_hist22:47:541
893899499,33cyclictest0-21swapper/020:43:110
893899495,37cyclictest0-21swapper/022:18:290
893899494,39cyclictest0-21swapper/022:28:190
893899494,38cyclictest0-21swapper/023:28:090
893899494,37cyclictest0-21swapper/022:38:230
893899494,36cyclictest0-21swapper/022:53:060
893899494,28cyclictest0-21swapper/023:58:110
893899494,28cyclictest0-21swapper/022:03:190
893899494,28cyclictest0-21swapper/020:28:000
893899494,28cyclictest0-21swapper/019:58:150
893899494,28cyclictest0-21swapper/019:28:190
893899494,28cyclictest0-21swapper/019:28:190
302162492,9sleep20-21swapper/219:45:402
243799490,5rtkit-daemon2436-21rtkit-daemon23:22:532
894699484,29cyclictest0-21swapper/220:58:172
8946994816,12cyclictest0-21swapper/220:18:172
8944994833,9cyclictest31098-21tail20:53:331
893899485,35cyclictest0-21swapper/021:18:120
893899485,26cyclictest0-21swapper/022:23:280
893899485,26cyclictest0-21swapper/022:23:280
893899484,37cyclictest0-21swapper/023:13:050
893899484,37cyclictest0-21swapper/021:58:250
893899483,39cyclictest0-21swapper/019:33:210
893899483,27cyclictest0-21swapper/022:48:230
205662482,9sleep00-21swapper/021:40:140
205662482,9sleep00-21swapper/021:40:140
894699474,28cyclictest0-21swapper/221:48:122
894699474,24cyclictest0-21swapper/223:23:042
894699473,28cyclictest0-21swapper/219:13:282
8946994710,14cyclictest0-21swapper/223:56:532
894499475,34cyclictest0-21swapper/123:47:521
894499474,27cyclictest0-21swapper/122:33:591
894499474,26cyclictest0-21swapper/119:58:311
894499473,38cyclictest201ktimersoftd/123:28:191
893899473,38cyclictest0-21swapper/023:42:520
8938994712,12cyclictest0-21swapper/021:08:220
8938994710,22cyclictest7150irq/45-ahci20:52:590
311922472,9sleep00-21swapper/020:53:350
205622473,9sleep10-21swapper/121:40:111
205622473,9sleep10-21swapper/121:40:111
894699464,35cyclictest0-21swapper/223:13:122
894699464,24cyclictest0-21swapper/220:48:202
8946994616,13cyclictest0-21swapper/220:33:162
894499465,34cyclictest0-21swapper/123:48:161
894499465,34cyclictest0-21swapper/123:48:161
894499464,35cyclictest0-21swapper/122:38:161
894499464,35cyclictest0-21swapper/119:48:171
894499464,34cyclictest0-21swapper/122:53:181
894499464,23cyclictest0-21swapper/100:03:031
8938994627,13cyclictest0-21swapper/019:03:030
109462463,35sleep10-21swapper/121:19:151
8946994515,12cyclictest0-21swapper/200:28:092
893899454,25cyclictest0-21swapper/023:48:030
893899454,25cyclictest0-21swapper/023:48:030
230882453,9sleep10-21swapper/119:31:081
230882453,9sleep10-21swapper/119:31:081
14352453,9sleep10-21swapper/123:17:301
8944994428,11cyclictest0-21swapper/122:17:201
894499434,33cyclictest0-21swapper/100:08:041
894499424,12cyclictest0-21swapper/119:03:031
894699352,27cyclictest0-21swapper/219:03:042
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional