You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-09-19 - 19:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

Intel(R) Core(TM) i3-6100U CPU @ 2.30GHz, Linux 4.9.47-rt37 (Profile)

Latency plot of shadow in rack #7, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack7slot7s.osadl.org (updated Mon Sep 06, 2021 00:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11982215164,82sleep30-21swapper/319:07:553
11923215161,85sleep10-21swapper/119:07:091
99402790,1sleep21242799cyclictest21:20:102
1191927861,12sleep20-21swapper/219:07:062
1206627635,37sleep00-21swapper/019:09:000
78212720,1sleep30-21swapper/323:34:413
129532720,0sleep00-21swapper/022:30:100
222162710,1sleep20-21swapper/200:07:292
125842700,0sleep00-21swapper/000:22:370
297702680,2sleep30-21swapper/321:34:093
221142660,2sleep30-21swapper/321:28:483
153442660,2sleep11242699cyclictest19:35:001
57842650,1sleep30-21swapper/323:55:523
284112240,2sleep20-21swapper/221:55:432
1242799230,22cyclictest0-21swapper/220:42:152
123412230,1sleep20-21swapper/200:22:272
316052220,1sleep00-21swapper/023:51:170
1242799220,1cyclictest0-21swapper/220:53:032
1242599190,1cyclictest0-21swapper/021:32:270
12427991815,2cyclictest31785-21ssh23:51:242
1242599186,6cyclictest14111-21munin-run19:25:000
271642170,0sleep00-21swapper/000:32:340
13952160,2sleep20-21swapper/222:44:582
13952160,2sleep20-21swapper/222:44:582
1242799155,5cyclictest56250irq/126-enp2s0-21:44:232
1242599151,10cyclictest5333-21kworker/0:121:49:320
1242599150,1cyclictest0-21swapper/022:15:460
258702140,1sleep10-21swapper/121:54:021
1242599140,10cyclictest5333-21kworker/0:119:43:400
284052130,2sleep30-21swapper/321:10:303
1242799138,4cyclictest16550irq/16-i801_smb21:13:302
1242599130,1cyclictest0-21swapper/022:06:300
62242120,1sleep30-21swapper/321:17:443
1242899124,7cyclictest22558-21perf23:45:003
1242899123,8cyclictest19694-21perf20:10:003
1242799129,3cyclictest16550irq/16-i801_smb22:05:022
1242799128,4cyclictest16550irq/16-i801_smb22:15:042
1242799121,1cyclictest0-21swapper/221:48:492
12425991210,1cyclictest0-21swapper/019:29:120
1242599120,6cyclictest0-21swapper/000:10:020
1242899113,6cyclictest20938-21perf20:20:003
1242899110,9cyclictest229-21systemd-journal19:20:003
1242799117,4cyclictest16550irq/16-i801_smb23:56:232
1242799117,4cyclictest16550irq/16-i801_smb19:51:532
1242799117,4cyclictest16550irq/16-i801_smb19:18:192
1242799116,4cyclictest16550irq/16-i801_smb22:47:482
1242799116,4cyclictest16550irq/16-i801_smb22:47:482
1242799116,4cyclictest16550irq/16-i801_smb22:11:422
1242799116,4cyclictest16550irq/16-i801_smb21:04:512
1242699115,1cyclictest16616-21dump-pmu-power21:25:001
1242699113,2cyclictest39-21rcuop/200:02:501
1242599117,3cyclictest0-21swapper/000:06:080
1242599114,4cyclictest0-21swapper/021:57:330
1242599113,7cyclictest11558-21tr00:00:000
1242599110,6cyclictest12856-21munin-run19:15:000
1242599110,3cyclictest0-21swapper/022:38:390
1242599110,10cyclictest27520-21diskmemload21:39:280
81102100,1sleep10-21swapper/121:41:291
73112100,1sleep30-21swapper/300:19:043
56672100,3sleep11242699cyclictest00:17:531
325222100,1sleep30-21swapper/323:51:573
126292100,9sleep356250irq/126-enp2s0-22:07:233
1242899105,3cyclictest1327-21apt-key00:15:003
1242799107,3cyclictest16550irq/16-i801_smb22:26:352
1242799106,4cyclictest16550irq/16-i801_smb23:46:212
1242799106,4cyclictest16550irq/16-i801_smb23:35:192
1242799106,4cyclictest16550irq/16-i801_smb23:17:482
1242799106,4cyclictest16550irq/16-i801_smb22:21:442
1242799106,4cyclictest16550irq/16-i801_smb20:49:482
1242799106,4cyclictest16550irq/16-i801_smb19:56:382
1242799106,4cyclictest16550irq/16-i801_smb19:33:052
1242799100,1cyclictest0-21swapper/221:30:202
1242699105,4cyclictest15820-21sh22:55:001
1242699103,6cyclictest56350irq/127-enp2s0-21:46:001
1242699101,8cyclictest229-21systemd-journal23:25:001
1242699100,4cyclictest39-21rcuop/200:05:251
1242699100,2cyclictest28105-21systemd-cgroups00:11:181
1242599106,1cyclictest0-21swapper/021:13:220
1242599102,7cyclictest0-21swapper/022:43:200
1242599102,7cyclictest0-21swapper/022:43:200
1242599101,7cyclictest0-21swapper/023:01:290
1242599101,5cyclictest0-21swapper/022:22:320
1242599100,9cyclictest0-21swapper/022:26:580
1242599100,7cyclictest0-21swapper/023:45:000
1242599100,5cyclictest0-21swapper/021:17:110
1242599100,2cyclictest0-21swapper/023:16:160
31949290,1sleep30-21swapper/322:20:563
28770290,1sleep10-21swapper/100:33:401
21913290,1sleep30-21swapper/322:59:183
16525290,1sleep20-21swapper/223:40:382
14352290,1sleep10-21swapper/123:16:261
14115290,1sleep30-21swapper/323:16:163
13638290,1sleep30-21swapper/323:38:433
124289994,4cyclictest56450irq/128-enp2s0-23:12:193
124289994,4cyclictest56250irq/126-enp2s0-00:35:163
124289993,4cyclictest1916-21ssh22:00:003
124289990,8cyclictest47-21ksoftirqd/323:27:373
124289990,8cyclictest15939-21cron19:40:003
124289990,5cyclictest229-21systemd-journal22:30:533
124289990,5cyclictest0-21swapper/323:45:563
124289990,4cyclictest0-21swapper/321:49:523
124279996,3cyclictest16550irq/16-i801_smb22:55:382
124279996,3cyclictest16550irq/16-i801_smb21:16:442
124279996,3cyclictest16550irq/16-i801_smb20:59:502
124279996,3cyclictest16550irq/16-i801_smb20:19:432
124279996,3cyclictest16550irq/16-i801_smb00:11:132
124279995,3cyclictest229-21systemd-journal00:29:552
124279994,4cyclictest56450irq/128-enp2s0-23:33:412
124279994,4cyclictest16550irq/16-i801_smb23:06:572
124279994,4cyclictest1337-21runrttasks00:38:162
124279994,4cyclictest12423-21cyclictest19:30:002
124279994,4cyclictest0-21swapper/222:03:462
124279993,5cyclictest56150irq/125-enp2s0-21:39:152
124279993,5cyclictest0-21swapper/222:34:252
124279991,2cyclictest0-21swapper/223:03:252
124279990,2cyclictest5512-21ssh23:10:122
124269996,2cyclictest25196-21sh22:38:521
124269995,3cyclictest11570-21awk00:00:001
124269992,2cyclictest39-21rcuop/222:57:411
124269991,2cyclictest39-21rcuop/223:14:061
124269990,5cyclictest56450irq/128-enp2s0-22:05:111
124269990,5cyclictest0-21swapper/121:26:161
124269990,5cyclictest0-21swapper/100:36:121
124269990,4cyclictest39-21rcuop/221:36:001
124269990,3cyclictest4316-21ssh22:46:551
124269990,3cyclictest4316-21ssh22:46:551
124269990,3cyclictest39-21rcuop/222:20:401
124269990,3cyclictest39-21rcuop/221:17:241
124269990,2cyclictest0-21swapper/121:55:431
124259994,4cyclictest0-21swapper/023:05:150
124259994,4cyclictest0-21swapper/022:55:020
124259993,5cyclictest0-21swapper/000:17:580
124259992,4cyclictest6541-21ssh23:10:560
124259992,4cyclictest0-21swapper/023:30:330
124259992,4cyclictest0-21swapper/023:29:310
124259992,4cyclictest0-21swapper/022:10:290
124259991,7cyclictest0-21swapper/021:25:120
124259990,8cyclictest0-21swapper/021:42:030
124259990,6cyclictest9454-21ssh22:50:260
124259990,6cyclictest0-21swapper/000:37:530
124259990,6cyclictest0-21swapper/000:25:050
124259990,4cyclictest22380-21perf20:30:000
124259990,1cyclictest0-21swapper/023:45:590
124259990,1cyclictest0-21swapper/022:02:570
12292290,1sleep30-21swapper/321:44:283
9376280,1sleep20-21swapper/222:50:232
27396280,0sleep20-21swapper/221:08:422
19999280,1sleep10-21swapper/120:11:221
16808280,1sleep10-21swapper/119:45:101
13863280,1sleep30-21swapper/321:23:013
124289986,1cyclictest0-21swapper/322:40:093
124289986,1cyclictest0-21swapper/322:40:093
124289986,1cyclictest0-21swapper/320:33:003
124289986,1cyclictest0-21swapper/320:22:553
124289986,1cyclictest0-21swapper/320:12:223
124289984,3cyclictest56450irq/128-enp2s0-22:53:533
124289984,3cyclictest56350irq/127-enp2s0-23:01:473
124289984,3cyclictest56250irq/126-enp2s0-00:05:393
124289984,3cyclictest56150irq/125-enp2s0-22:11:383
124289984,3cyclictest22368-21munin-run20:30:003
124289983,4cyclictest56250irq/126-enp2s0-20:44:343
124289983,4cyclictest56150irq/125-enp2s0-22:17:483
124289983,4cyclictest229-21systemd-journal19:51:533
124289983,1cyclictest513-21rs:main3
124289982,5cyclictest56250irq/126-enp2s0-21:01:583
124289982,5cyclictest56250irq/126-enp2s0-19:22:263
124289982,5cyclictest56150irq/125-enp2s0-22:01:513
124289980,7cyclictest56450irq/128-enp2s0-00:21:373
124289980,7cyclictest0-21swapper/323:20:543
124289980,7cyclictest0-21swapper/319:42:053
124289980,6cyclictest26977-21sort22:40:003
124289980,6cyclictest19833-21kworker/3:121:50:323
124289980,6cyclictest19004-1kworker/3:2H00:31:313
124289980,6cyclictest0-21swapper/321:35:103
124289980,4cyclictest0-21swapper/300:03:543
124279985,2cyclictest12857-21perf19:15:012
124279984,3cyclictest20644-21ssh21:50:122
124279984,3cyclictest16550irq/16-i801_smb20:08:452
124279984,3cyclictest14314-21ssh00:01:522
124279984,3cyclictest11450irq/122-ahci[0020:30:002
124279983,4cyclictest56450irq/128-enp2s0-23:20:552
124279983,4cyclictest56150irq/125-enp2s0-21:25:152
124279981,6cyclictest56450irq/128-enp2s0-00:30:442
124279981,6cyclictest56450irq/128-enp2s0-00:15:152
124279981,6cyclictest0-21swapper/223:25:192
124279981,6cyclictest0-21swapper/219:48:052
124279981,5cyclictest229-21systemd-journal22:35:082
124279980,6cyclictest19134-21wc20:05:002
124269986,1cyclictest0-21swapper/122:40:591
124269986,1cyclictest0-21swapper/122:40:591
124269986,1cyclictest0-21swapper/122:25:051
124269986,1cyclictest0-21swapper/120:54:491
124269986,1cyclictest0-21swapper/120:42:121
124269986,1cyclictest0-21swapper/119:24:321
124269984,3cyclictest30947-21apt-get21:35:001
124269983,4cyclictest56450irq/128-enp2s0-23:35:231
124269983,1cyclictest513-21rs:main1
124269982,0cyclictest0-21swapper/123:45:261
124269982,0cyclictest0-21swapper/123:05:351
124269981,3cyclictest56250irq/126-enp2s0-20:49:481
124269981,2cyclictest542-21snmpd22:30:521
124269981,2cyclictest39-21rcuop/222:00:281
124269981,2cyclictest39-21rcuop/200:27:251
124269981,1cyclictest39-21rcuop/223:02:521
124269981,1cyclictest27520-21diskmemload23:27:291
124269980,7cyclictest0-21swapper/123:30:361
124269980,5cyclictest0-21swapper/122:16:301
124269980,4cyclictest32390-21ssh21:13:221
124269980,4cyclictest16792-21ssh22:10:131
124269980,3cyclictest398-21ssh23:52:111
124269980,2cyclictest16436-21ssh23:40:341
124259986,1cyclictest3-21ksoftirqd/020:40:000
124259986,1cyclictest3-21ksoftirqd/020:00:000
124259986,1cyclictest0-21swapper/022:45:030
124259986,1cyclictest0-21swapper/022:45:030
124259984,1cyclictest0-21swapper/021:20:560
124259984,1cyclictest0-21swapper/000:01:310
124259982,3cyclictest0-21swapper/023:36:040
124259980,8cyclictest0-21swapper/021:09:520
124259980,7cyclictest20723-21ssh21:50:160
124259980,5cyclictest0-21swapper/023:22:350
124259980,4cyclictest542-21snmpd20:23:000
124259980,3cyclictest542-21snmpd19:46:480
18869270,1sleep30-21swapper/320:02:383
124289975,1cyclictest0-21swapper/321:09:523
124289975,1cyclictest0-21swapper/319:58:003
124289975,1cyclictest0-21swapper/319:46:393
124289974,2cyclictest0-21swapper/322:45:043
124289974,2cyclictest0-21swapper/322:45:043
124289973,3cyclictest513-21rs:main3
124289973,3cyclictest513-21rs:main3
124289972,4cyclictest56250irq/126-enp2s0-22:25:003
124289972,4cyclictest56150irq/125-enp2s0-19:30:143
124289970,6cyclictest0-21swapper/319:28:433
124289970,6cyclictest0-21swapper/300:25:083
124289970,5cyclictest229-21systemd-journal20:55:213
124279974,3cyclictest16550irq/16-i801_smb20:32:592
124279974,3cyclictest16550irq/16-i801_smb20:12:222
124279974,3cyclictest16550irq/16-i801_smb19:36:112
124279971,5cyclictest542-21snmpd19:43:282
124279971,5cyclictest0-21swapper/220:35:232
124279971,5cyclictest0-21swapper/220:20:012
124279971,4cyclictest137012sleep219:20:042
124269975,1cyclictest0-21swapper/121:09:521
124269975,1cyclictest0-21swapper/120:35:221
124269975,1cyclictest0-21swapper/119:59:391
124269975,1cyclictest0-21swapper/119:39:171
124269975,1cyclictest0-21swapper/119:26:331
124269975,1cyclictest0-21swapper/119:15:051
124269974,2cyclictest21060-21apt-config20:20:001
124269973,3cyclictest513-21rs:main1
124269971,5cyclictest56250irq/126-enp2s0-20:08:441
124269970,6cyclictest542-21snmpd19:13:061
124269970,6cyclictest22362-21apt-get20:30:001
124269970,4cyclictest0-21swapper/100:20:241
124269970,2cyclictest56150irq/125-enp2s0-20:02:501
124259977,0cyclictest0-21swapper/020:00:440
124259975,1cyclictest3-21ksoftirqd/019:20:000
124259971,3cyclictest513-21rs:main0
124259970,7cyclictest0-21swapper/020:55:210
124259970,7cyclictest0-21swapper/019:51:530
124259970,7cyclictest0-21swapper/019:36:110
124259970,6cyclictest0-21swapper/020:09:320
124259970,4cyclictest474-21gmain20:45:560
124259970,1cyclictest0-21swapper/019:33:000
124289960,5cyclictest23416-21taskset20:35:303
124289960,5cyclictest0-21swapper/320:46:253
124269962,3cyclictest56250irq/126-enp2s0-19:51:051
124269962,3cyclictest1337-21runrttasks20:55:171
124269960,5cyclictest229-21systemd-journal20:21:261
124269960,4cyclictest542-21snmpd21:00:341
124259963,2cyclictest26688-21sshd21:02:310
124259962,1cyclictest542-21snmpd20:52:580
124259960,5cyclictest0-21swapper/020:42:200
124259960,5cyclictest0-21swapper/020:11:380
124259960,3cyclictest0-21swapper/020:30:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional