You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-26 - 07:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Fri Apr 26, 2024 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
288929910018,54cyclictest0-21swapper/217:53:522
242299970,4rtkit-daemon2421-21rtkit-daemon18:58:303
28892999618,53cyclictest0-21swapper/219:28:472
2889299954,65cyclictest0-21swapper/219:48:462
28892999521,49cyclictest0-21swapper/220:08:402
2889299934,21cyclictest0-21swapper/218:08:462
2889299924,63cyclictest0-21swapper/222:28:332
2889299924,63cyclictest0-21swapper/222:28:332
242299920,4rtkit-daemon2421-21rtkit-daemon22:04:083
242299920,4rtkit-daemon2421-21rtkit-daemon18:58:453
2889299914,63cyclictest0-21swapper/218:14:112
242299910,4rtkit-daemon2421-21rtkit-daemon18:13:473
2889299904,62cyclictest0-21swapper/221:59:002
2889299904,60cyclictest0-21swapper/221:25:292
28892999011,8cyclictest0-21swapper/218:58:442
2888899903,67cyclictest0-21swapper/018:43:500
2889299883,75cyclictest0-21swapper/217:43:472
2889299883,67cyclictest0-21swapper/219:18:512
28892998814,11cyclictest11043-21yum-updatesd-he21:08:402
2888899884,54cyclictest0-21swapper/017:23:510
2888899884,54cyclictest0-21swapper/017:23:510
2889299874,66cyclictest0-21swapper/222:33:522
2889299874,66cyclictest0-21swapper/222:33:522
2889299874,66cyclictest0-21swapper/220:34:112
2888899874,76cyclictest0-21swapper/021:28:390
2888899874,75cyclictest22305-21idleruntime-cro19:23:330
242299870,6rtkit-daemon2421-21rtkit-daemon19:18:523
2889299864,65cyclictest0-21swapper/220:18:562
2889299864,64cyclictest0-21swapper/220:43:532
28892998619,10cyclictest29328-21grep18:28:542
28892998610,59cyclictest0-21swapper/221:33:512
28892998610,13cyclictest0-21swapper/221:18:432
2888899864,74cyclictest0-21swapper/018:08:490
2888899863,75cyclictest25399-21sh20:33:290
2889299853,62cyclictest0-21swapper/220:04:042
28892998516,12cyclictest0-21swapper/220:00:162
28892998516,12cyclictest0-21swapper/220:00:162
28892998510,15cyclictest0-21swapper/222:08:412
2888899855,73cyclictest0-21swapper/021:24:040
2888899854,74cyclictest9255-21aten2.4-expect22:08:380
2888899853,76cyclictest0-21swapper/020:12:200
2888899853,75cyclictest5758-21crond20:58:290
2888899853,75cyclictest5758-21crond20:58:290
2889299848,64cyclictest0-21swapper/219:08:532
2889299848,64cyclictest0-21swapper/219:08:532
2889299847,13cyclictest0-21swapper/219:53:402
2889299844,63cyclictest0-21swapper/221:52:192
2889299844,62cyclictest0-21swapper/217:48:462
2889199848,20cyclictest0-21swapper/120:48:291
2888899845,72cyclictest0-21swapper/018:38:360
2888899844,73cyclictest0-21swapper/022:43:360
2888899844,73cyclictest0-21swapper/019:49:030
2888899844,72cyclictest0-21swapper/022:28:550
2888899844,72cyclictest0-21swapper/022:28:550
2888899844,72cyclictest0-21swapper/021:43:390
2888899844,72cyclictest0-21swapper/021:43:390
2888899844,72cyclictest0-21swapper/019:03:570
2889299834,72cyclictest28196-21fschecks_count19:33:482
2889299834,71cyclictest0-21swapper/221:45:322
2889299834,71cyclictest0-21swapper/221:45:322
2889299834,63cyclictest0-21swapper/220:23:402
2889299834,62cyclictest0-21swapper/218:48:582
2889299834,23cyclictest0-21swapper/217:23:492
2889299834,23cyclictest0-21swapper/217:23:492
28892998312,13cyclictest0-21swapper/218:34:002
2888899835,71cyclictest0-21swapper/018:24:010
2888899834,70cyclictest21848-21aten_r1power_po22:33:330
2888899834,70cyclictest21848-21aten_r1power_po22:33:330
2888899833,74cyclictest0-21swapper/021:10:080
2888899833,73cyclictest16337-21nfs_client19:09:020
2888899833,73cyclictest16337-21nfs_client19:09:020
2888899833,73cyclictest14248-21aten_r1power_fr22:18:360
2888899833,73cyclictest0-21swapper/020:33:400
2888899833,72cyclictest0-21swapper/022:13:510
2889299824,71cyclictest0-21swapper/222:03:432
28892998225,50cyclictest1286-21runrttasks18:43:552
2888899825,70cyclictest0-21swapper/021:49:020
2888899824,71cyclictest0-21swapper/022:23:340
2888899824,71cyclictest0-21swapper/021:58:500
2888899823,72cyclictest0-21swapper/018:48:450
2888899823,49cyclictest0-21swapper/021:20:440
2889299814,68cyclictest0-21swapper/220:33:192
2889299814,68cyclictest0-21swapper/217:39:542
2889299814,23cyclictest0-21swapper/222:48:372
2888899814,70cyclictest0-21swapper/020:18:570
2888899814,70cyclictest0-21swapper/017:49:140
2888899813,53cyclictest2470-21tail21:53:460
28893998028,24cyclictest0-21swapper/319:18:343
28893998028,24cyclictest0-21swapper/319:18:343
2889299804,69cyclictest0-21swapper/222:43:382
2889299804,68cyclictest0-21swapper/221:39:052
2889299803,70cyclictest0-21swapper/218:23:552
28892998026,47cyclictest0-21swapper/218:39:022
28892998016,13cyclictest0-21swapper/220:50:232
2888899804,41cyclictest12767-21munin-run20:08:310
2888899803,71cyclictest0-21swapper/021:36:270
2888899803,70cyclictest29316-21munin-node22:48:540
2888899803,70cyclictest26274-21basename21:38:370
2888899803,69cyclictest27345-21crond19:33:320
242299800,4rtkit-daemon2421-21rtkit-daemon21:10:183
242299800,4rtkit-daemon2421-21rtkit-daemon19:44:582
242299800,4rtkit-daemon2421-21rtkit-daemon17:34:112
2889299794,58cyclictest0-21swapper/222:23:342
2889299793,22cyclictest13616-21df17:58:522
28892997917,12cyclictest0-21swapper/218:03:482
2888899795,67cyclictest0-21swapper/018:23:360
2888899795,67cyclictest0-21swapper/018:23:360
2888899794,68cyclictest0-21swapper/017:34:050
2888899794,67cyclictest0-21swapper/021:03:580
2888899794,67cyclictest0-21swapper/020:38:390
2888899793,71cyclictest0-21swapper/018:39:080
2888899793,69cyclictest6959-21chrt19:54:010
2888899793,69cyclictest0-21swapper/019:58:450
2888899793,69cyclictest0-21swapper/019:58:450
2888899793,68cyclictest0-21swapper/019:34:050
242299790,5rtkit-daemon2421-21rtkit-daemon20:15:122
242299790,5rtkit-daemon2421-21rtkit-daemon18:54:452
242299790,5rtkit-daemon2421-21rtkit-daemon17:31:112
242299790,4rtkit-daemon2421-21rtkit-daemon20:55:562
242299790,4rtkit-daemon2421-21rtkit-daemon20:55:562
2889299784,67cyclictest0-21swapper/218:23:302
2889299784,67cyclictest0-21swapper/218:23:302
2889299784,24cyclictest0-21swapper/220:59:032
28892997825,45cyclictest1286-21runrttasks19:03:512
28892997811,13cyclictest0-21swapper/222:18:402
2888899785,66cyclictest0-21swapper/018:28:590
2888899784,66cyclictest9664-21munin-run18:58:340
2888899783,68cyclictest9002-21snmpd20:25:200
2888899783,68cyclictest0-21swapper/019:38:540
242299780,4rtkit-daemon2421-21rtkit-daemon21:55:162
242299780,4rtkit-daemon2421-21rtkit-daemon20:41:042
2889299775,15cyclictest0-21swapper/222:38:462
2889299774,65cyclictest0-21swapper/221:13:582
2889299774,14cyclictest0-21swapper/219:28:252
2888899773,67cyclictest6968-21gltestperf20:58:520
2888899773,67cyclictest24491-21taskset19:24:140
2888899773,67cyclictest0-21swapper/019:18:340
2888899773,67cyclictest0-21swapper/019:18:340
2888899773,66cyclictest0-21swapper/018:04:080
2888899773,60cyclictest0-21swapper/020:48:370
28892997620,49cyclictest12577-21head22:13:462
28892997612,13cyclictest0-21swapper/219:38:432
2888899765,64cyclictest0-21swapper/017:53:450
28892997516,10cyclictest8516-21munin-node21:03:592
2888899754,63cyclictest0-21swapper/020:43:500
2888899753,43cyclictest0-21swapper/022:03:350
28888997521,36cyclictest0-21swapper/021:15:170
2889299744,61cyclictest0-21swapper/221:28:572
2888899744,63cyclictest0-21swapper/020:13:470
2888899743,65cyclictest0-21swapper/018:00:230
2888899743,64cyclictest0-21swapper/019:44:340
2888899743,45cyclictest0-21swapper/018:14:070
2888899734,62cyclictest0-21swapper/017:38:570
2888899733,64cyclictest0-21swapper/022:38:450
2888899733,64cyclictest0-21swapper/018:59:160
2888899733,47cyclictest0-21swapper/017:33:390
2889299725,11cyclictest0-21swapper/219:13:452
2889299725,11cyclictest0-21swapper/219:13:452
2888899723,53cyclictest0-21swapper/017:43:460
2889299716,12cyclictest1286-21runrttasks17:23:382
2888899695,56cyclictest865-21dbus-daemon17:23:380
2889399688,36cyclictest0-21swapper/322:23:263
2889399675,41cyclictest0-21swapper/319:08:523
2889399675,41cyclictest0-21swapper/319:08:523
242299670,4rtkit-daemon2421-21rtkit-daemon20:10:273
242299670,4rtkit-daemon2421-21rtkit-daemon19:49:363
242299670,4rtkit-daemon2421-21rtkit-daemon17:26:413
242299670,4rtkit-daemon2421-21rtkit-daemon17:26:413
242299660,5rtkit-daemon2421-21rtkit-daemon20:18:573
242299630,4rtkit-daemon2421-21rtkit-daemon20:53:483
242299630,4rtkit-daemon2421-21rtkit-daemon20:53:483
242299620,4rtkit-daemon2421-21rtkit-daemon18:02:173
242299610,4rtkit-daemon2421-21rtkit-daemon18:28:463
2889199597,41cyclictest0-21swapper/121:18:281
28891995833,17cyclictest0-21swapper/121:53:271
242299580,5rtkit-daemon975-21munin-node18:38:533
28891995724,12cyclictest10418-21crond17:53:361
137092572,11sleep10-21swapper/122:15:351
10602573,10sleep11177-21munin-node19:43:511
28891995638,11cyclictest2096-21cut18:38:531
278152563,12sleep30-21swapper/320:37:093
242299560,6rtkit-daemon0-21swapper/221:32:093
91672553,45sleep39211-21ls17:48:583
66492552,11sleep10-21swapper/117:43:001
242299550,5rtkit-daemon2421-21rtkit-daemon19:47:213
242299550,5rtkit-daemon2421-21rtkit-daemon18:52:153
124452554,44sleep112466-21ntp_offset21:09:001
254102543,10sleep30-21swapper/318:21:273
254102543,10sleep30-21swapper/318:21:273
250112543,43sleep125046-21netstat21:33:551
242299540,5rtkit-daemon2421-21rtkit-daemon20:24:193
242299540,5rtkit-daemon2421-21rtkit-daemon19:36:443
242299540,5rtkit-daemon2421-21rtkit-daemon19:31:513
242299540,4rtkit-daemon2421-21rtkit-daemon20:28:343
2889199535,28cyclictest0-21swapper/121:19:041
278082533,42sleep10-21swapper/121:39:031
278032533,12sleep10-21swapper/118:24:431
242299530,5rtkit-daemon2421-21rtkit-daemon22:14:003
242299530,5rtkit-daemon2421-21rtkit-daemon20:02:203
242299530,5rtkit-daemon2421-21rtkit-daemon20:02:203
242299530,5rtkit-daemon2421-21rtkit-daemon19:38:513
242299530,4rtkit-daemon2421-21rtkit-daemon21:54:013
242299530,4rtkit-daemon2421-21rtkit-daemon21:03:483
242299530,4rtkit-daemon2421-21rtkit-daemon20:43:343
242299530,4rtkit-daemon2421-21rtkit-daemon20:41:343
242299530,4rtkit-daemon2421-21rtkit-daemon19:57:583
242299530,4rtkit-daemon2421-21rtkit-daemon17:33:563
208982532,11sleep10-21swapper/121:28:151
78792522,12sleep30-21swapper/317:48:303
28891995228,17cyclictest0-21swapper/120:48:381
281682523,42sleep128173-21diskstats19:33:471
247012523,12sleep10-21swapper/119:26:581
242299520,4rtkit-daemon2421-21rtkit-daemon21:39:093
242299520,4rtkit-daemon2421-21rtkit-daemon18:25:023
242299520,4rtkit-daemon2421-21rtkit-daemon18:09:253
312622512,11sleep30-21swapper/321:48:363
2889399514,39cyclictest0-21swapper/321:33:483
2889399514,27cyclictest0-21swapper/318:44:103
2889399513,31cyclictest0-21swapper/320:14:313
2889199514,39cyclictest0-21swapper/120:04:031
2889199514,28cyclictest0-21swapper/122:43:401
2889199514,28cyclictest0-21swapper/120:34:121
2889199513,42cyclictest0-21swapper/121:04:031
28891995121,12cyclictest0-21swapper/121:53:431
242299510,5rtkit-daemon2421-21rtkit-daemon22:08:533
171512512,13sleep10-21swapper/119:12:351
171512512,13sleep10-21swapper/119:12:351
156902512,11sleep30-21swapper/321:16:113
119172512,42sleep10-21swapper/119:00:141
323182502,42sleep10-21swapper/119:42:221
28893995020,13cyclictest0-21swapper/318:34:143
2889199504,29cyclictest0-21swapper/120:39:011
2889199504,29cyclictest0-21swapper/120:08:411
2889199504,28cyclictest0-21swapper/122:49:031
2889199504,28cyclictest0-21swapper/121:58:451
28891995021,22cyclictest0-21swapper/118:19:001
28891995021,22cyclictest0-21swapper/118:19:001
28891995019,13cyclictest0-21swapper/118:48:591
195162502,41sleep10-21swapper/119:15:171
195162502,41sleep10-21swapper/119:15:171
39922492,11sleep10-21swapper/117:36:141
2889399494,28cyclictest0-21swapper/322:26:133
2889399494,28cyclictest0-21swapper/320:48:553
2889399494,27cyclictest0-21swapper/321:23:383
2889399494,27cyclictest0-21swapper/319:04:143
2889199494,28cyclictest0-21swapper/118:28:491
2889199494,27cyclictest0-21swapper/122:38:581
2889199493,39cyclictest0-21swapper/117:59:051
276032498,31sleep30-21swapper/317:18:573
128402492,10sleep10-21swapper/117:57:181
81472483,38sleep10-21swapper/121:01:501
50622483,12sleep10-21swapper/119:52:011
313162483,12sleep10-21swapper/117:27:321
313162483,12sleep10-21swapper/117:27:321
308472482,40sleep10-21swapper/121:46:081
308472482,40sleep10-21swapper/121:46:081
2889399484,35cyclictest0-21swapper/320:58:433
2889399484,27cyclictest0-21swapper/322:45:423
2889399484,27cyclictest0-21swapper/322:33:493
2889399484,27cyclictest0-21swapper/322:33:493
2889399484,26cyclictest0-21swapper/320:03:443
2889399484,26cyclictest0-21swapper/319:24:073
2889399483,28cyclictest0-21swapper/318:04:083
2889199485,25cyclictest0-21swapper/120:18:421
28891994817,13cyclictest0-21swapper/122:23:561
28891994817,13cyclictest0-21swapper/119:18:571
228232482,40sleep10-21swapper/120:27:521
144782484,37sleep10-21swapper/119:05:381
87162472,40sleep10-21swapper/122:06:361
75872472,38sleep10-21swapper/117:44:411
2889399474,27cyclictest0-21swapper/317:39:183
2889399473,27cyclictest0-21swapper/322:39:063
2889399473,26cyclictest0-21swapper/317:29:053
28893994718,20cyclictest0-21swapper/317:53:563
2889199474,26cyclictest0-21swapper/120:28:571
28891994729,11cyclictest26033-21head19:28:551
28891994727,14cyclictest0-21swapper/121:28:381
180542472,39sleep30-21swapper/321:19:103
2889199464,35cyclictest0-21swapper/122:28:521
2889199464,35cyclictest0-21swapper/122:28:521
2889199464,34cyclictest0-21swapper/122:09:041
2889199464,26cyclictest0-21swapper/120:53:521
2889199464,26cyclictest0-21swapper/120:53:521
2889199463,26cyclictest16275-21fschecks_time20:13:471
28891994615,13cyclictest0-21swapper/118:09:101
237652462,12sleep10-21swapper/122:35:021
237652462,12sleep10-21swapper/122:35:021
2889399454,25cyclictest0-21swapper/322:28:383
2889399454,25cyclictest0-21swapper/322:28:383
2889399454,24cyclictest0-21swapper/322:00:333
2889199454,34cyclictest0-21swapper/119:53:411
2889199454,34cyclictest0-21swapper/118:34:071
2889199454,25cyclictest0-21swapper/119:59:091
2889199454,25cyclictest0-21swapper/119:59:091
169992452,37sleep10-21swapper/118:04:031
164152453,36sleep10-21swapper/122:23:011
314602442,10sleep30-21swapper/322:51:293
2889399444,22cyclictest0-21swapper/321:43:583
2889399444,22cyclictest0-21swapper/321:43:583
2889199444,33cyclictest0-21swapper/118:44:121
2889199443,33cyclictest0-21swapper/118:53:421
2889199434,33cyclictest0-21swapper/118:13:541
28891994019,15cyclictest0-21swapper/117:28:561
273622318,14sleep10-21swapper/117:18:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional