You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-06-13 - 01:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

Intel(R) Core(TM) i3-2310E CPU @ 2.10GHz, Linux 4.19.1-rt3 (Profile)

Latency plot of shadow in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack8slot2s.osadl.org (updated Sat Jun 12, 2021 12:43:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
177121120,1sleep10-21swapper/109:29:541
29602210644,20sleep30-21swapper/307:13:133
29682210543,20sleep10-21swapper/107:14:161
29671210443,20sleep00-21swapper/007:14:060
30216998280,1cyclictest0-21swapper/007:25:190
2977728246,21sleep20-21swapper/207:15:292
30218997370,2cyclictest0-21swapper/207:25:192
30219993937,1cyclictest0-21swapper/307:25:193
30217993628,6cyclictest0-21swapper/107:25:191
84152330,0sleep00-21swapper/009:37:380
30216993229,2cyclictest0-21swapper/007:17:390
313872300,0sleep00-21swapper/012:46:290
313872300,0sleep00-21swapper/012:46:290
43712280,0sleep10-21swapper/112:18:081
140842260,0sleep00-21swapper/011:56:430
3021899230,21cyclictest0-21swapper/209:07:522
30218992219,2cyclictest0-21swapper/207:17:392
3021899210,1cyclictest0-21swapper/210:37:582
57432150,1sleep30-21swapper/312:20:183
3021699154,5cyclictest16913-21perf07:57:380
3021999143,5cyclictest0-21swapper/312:27:013
30219991412,1cyclictest0-21swapper/311:09:253
3021699145,7cyclictest17934-21basename09:47:380
46452130,2sleep3391rcuc/310:42:193
3021999139,2cyclictest4376-21head09:32:553
3021999139,2cyclictest1801-21tail11:43:053
3021899139,2cyclictest16953-21cron09:07:382
3021899131,5cyclictest10499-21grep10:13:212
3021699139,2cyclictest22622-21ssh11:32:530
3021699136,5cyclictest9-21ksoftirqd/012:41:070
3021699135,6cyclictest0-21swapper/008:26:560
3021699134,3cyclictest0-21swapper/007:41:090
30216991311,1cyclictest9-21ksoftirqd/012:07:510
3021699131,11cyclictest23632-21kworker/0:009:22:210
3021999127,3cyclictest4213-21cat10:07:383
3021999127,3cyclictest28612-21ntp_offset12:43:003
3021999127,3cyclictest28612-21ntp_offset12:43:003
3021999124,2cyclictest0-21swapper/309:09:123
3021999123,4cyclictest0-21swapper/310:22:113
3021999123,4cyclictest0-21swapper/310:17:023
3021999123,3cyclictest0-21swapper/310:29:543
3021899124,2cyclictest121rcu_preempt11:12:532
3021899120,10cyclictest0-21swapper/212:07:562
3021799124,6cyclictest0-21swapper/111:07:421
3021799124,6cyclictest0-21swapper/109:42:451
3021799120,2cyclictest28893-21ssh11:06:091
3021699129,2cyclictest29042-21ssh11:06:230
3021699128,3cyclictest23632-21kworker/0:011:47:350
3021699128,2cyclictest4779-21cpuspeed_turbos10:07:550
3021699128,2cyclictest4779-21cpuspeed_turbos10:07:550
3021699128,2cyclictest30933-21tail11:08:000
3021699128,2cyclictest27226-21cut09:22:580
3021699127,4cyclictest9-21ksoftirqd/012:03:270
3021699127,2cyclictest9-21ksoftirqd/009:14:310
3021699124,6cyclictest0-21swapper/012:16:540
3021699124,6cyclictest0-21swapper/008:20:070
3021699124,4cyclictest0-21swapper/011:38:200
3021699124,3cyclictest0-21swapper/011:28:320
3021699124,3cyclictest0-21swapper/010:02:500
3021699124,3cyclictest0-21swapper/009:08:390
3021699124,3cyclictest0-21swapper/007:48:330
3021699124,2cyclictest12742-21ssh10:16:290
3021699124,2cyclictest0-21swapper/011:13:530
3021699123,2cyclictest121rcu_preempt09:29:250
3021699123,2cyclictest0-21swapper/010:50:090
3021699121,9cyclictest0-21swapper/010:57:540
3021699121,1cyclictest121rcu_preempt11:57:510
3021699120,1cyclictest121rcu_preempt09:32:550
3021999118,2cyclictest0-21swapper/311:03:043
3021999117,2cyclictest27838-21ntp_offset09:23:053
3021999117,2cyclictest23915-21ssh09:18:143
3021999116,3cyclictest32120-21sh11:42:383
3021999116,3cyclictest14202-21unixbench_multi08:58:103
3021999115,4cyclictest0-21swapper/309:43:023
3021999115,4cyclictest0-21swapper/308:10:343
3021999115,3cyclictest0-21swapper/310:55:033
3021999115,3cyclictest0-21swapper/308:25:563
3021999113,7cyclictest0-21swapper/310:09:173
3021999113,7cyclictest0-21swapper/310:09:173
3021999113,6cyclictest21426-21ntp_states10:58:073
3021999113,6cyclictest0-21swapper/312:07:513
3021999113,6cyclictest0-21swapper/311:23:233
3021999113,6cyclictest0-21swapper/311:23:233
3021999113,6cyclictest0-21swapper/311:18:343
3021999113,6cyclictest0-21swapper/311:13:283
3021999113,6cyclictest0-21swapper/309:02:573
3021999113,6cyclictest0-21swapper/307:29:213
3021999113,4cyclictest0-21swapper/309:29:003
3021999113,3cyclictest0-21swapper/310:26:023
3021999113,3cyclictest0-21swapper/309:53:133
3021999113,3cyclictest0-21swapper/309:38:403
3021999113,3cyclictest0-21swapper/308:27:503
3021999112,7cyclictest0-21swapper/312:02:033
3021999112,7cyclictest0-21swapper/309:57:403
3021999112,6cyclictest0-21swapper/311:55:153
3021999112,4cyclictest0-21swapper/308:38:563
3021999112,3cyclictest0-21swapper/308:04:283
3021999112,3cyclictest0-21swapper/307:44:003
3021899113,2cyclictest3919-21kworker/2:108:12:572
3021899110,10cyclictest11596-21kworker/2:012:22:222
3021799115,5cyclictest0-21swapper/111:43:561
3021799115,5cyclictest0-21swapper/111:26:341
3021799115,5cyclictest0-21swapper/111:26:341
3021799115,5cyclictest0-21swapper/109:36:291
3021799114,6cyclictest0-21swapper/110:02:131
3021799114,5cyclictest515-21in:imuxsock08:37:181
3021799114,1cyclictest0-21swapper/111:00:411
3021799113,6cyclictest0-21swapper/110:46:241
3021799113,6cyclictest0-21swapper/109:41:031
3021799113,6cyclictest0-21swapper/108:47:381
3021799112,7cyclictest0-21swapper/112:13:011
3021799110,1cyclictest0-21swapper/111:27:591
3021699118,1cyclictest0-21swapper/011:18:100
3021699117,2cyclictest8132-21grep12:22:550
3021699117,1cyclictest0-21swapper/008:27:550
3021699116,3cyclictest23632-21kworker/0:009:56:350
3021699116,3cyclictest22107-21idleruntime-cro12:37:380
3021699115,5cyclictest9-21ksoftirqd/008:47:510
3021699115,5cyclictest9-21ksoftirqd/008:47:510
3021699115,3cyclictest23632-21kworker/0:010:22:470
3021699114,5cyclictest9-21ksoftirqd/008:43:070
3021699114,5cyclictest23632-21kworker/0:008:32:590
3021699114,5cyclictest0-21swapper/012:17:390
3021699114,5cyclictest0-21swapper/007:37:150
3021699114,3cyclictest0-21swapper/010:01:560
3021699114,3cyclictest0-21swapper/009:04:540
3021699114,3cyclictest0-21swapper/008:13:400
3021699114,2cyclictest10646-21diskstats07:42:570
3021699114,2cyclictest0-21swapper/008:04:270
3021699113,7cyclictest0-21swapper/010:37:120
3021699113,6cyclictest0-21swapper/010:18:350
3021699113,6cyclictest0-21swapper/008:38:530
3021699113,3cyclictest23632-21kworker/0:011:27:150
3021699113,3cyclictest23632-21kworker/0:011:27:150
3021699113,3cyclictest0-21swapper/009:49:220
3021699113,3cyclictest0-21swapper/008:08:310
3021699113,3cyclictest0-21swapper/007:58:340
3021699113,2cyclictest0-21swapper/010:52:560
3021699111,5cyclictest121rcu_preempt10:43:010
3021699111,5cyclictest121rcu_preempt07:27:530
3021699111,5cyclictest0-21swapper/008:58:370
3021699111,5cyclictest0-21swapper/008:54:510
202112110,0sleep30-21swapper/312:34:293
93702100,7sleep29384-21ssh12:23:112
3021999106,2cyclictest243842sleep312:38:193
3021999106,2cyclictest18819-21forks09:47:593
3021999106,2cyclictest0-21swapper/311:48:043
3021999105,4cyclictest0-21swapper/308:45:593
3021999105,3cyclictest6576-21head10:43:133
3021999105,3cyclictest18130-21sh11:28:003
3021999105,3cyclictest13011-21df12:27:533
3021999104,4cyclictest0-21swapper/310:34:093
3021999103,6cyclictest0-21swapper/308:18:283
3021999103,3cyclictest0-21swapper/312:04:423
3021999103,3cyclictest0-21swapper/308:14:073
3021999103,3cyclictest0-21swapper/307:40:333
3021999103,2cyclictest0-21swapper/311:33:383
3021999102,4cyclictest0-21swapper/308:52:443
3021999102,3cyclictest0-21swapper/307:57:403
3021999101,7cyclictest0-21swapper/312:12:543
3021999101,7cyclictest0-21swapper/307:33:063
3021999101,7cyclictest0-21swapper/307:18:073
3021999101,2cyclictest8959-21memory08:47:573
3021999101,2cyclictest8959-21memory08:47:573
3021999100,9cyclictest0-21swapper/310:50:443
3021999100,8cyclictest13952-21threads07:48:103
3021899108,1cyclictest0-21swapper/208:53:562
3021899106,2cyclictest30561-21fschecks_count12:12:552
3021899106,2cyclictest21499-21munin-run08:07:372
3021899106,2cyclictest20806-21fschecks_time10:58:002
3021899106,2cyclictest18958-21sh10:56:142
3021899106,2cyclictest17773-21grep11:27:572
3021899103,2cyclictest13342-21if_enp3s008:58:012
3021899103,2cyclictest11596-21kworker/2:011:57:512
3021899102,3cyclictest17415-21grep07:57:562
3021899102,2cyclictest28865-21proc_pri11:38:042
3021899102,1cyclictest121rcu_preempt12:03:032
3021899102,1cyclictest121rcu_preempt07:42:382
3021899101,7cyclictest32256-21cron10:37:382
3021899101,7cyclictest0-21swapper/208:42:382
3021899101,4cyclictest26703-21aten2_r8power_c09:22:512
3021899101,3cyclictest22808-21wget10:27:562
3021899101,2cyclictest5213-21cron07:32:382
3021899101,2cyclictest24912-21ssh09:53:352
3021899101,2cyclictest121rcu_preempt11:07:552
3021899100,9cyclictest0-21swapper/211:55:262
3021899100,9cyclictest0-21swapper/210:23:162
3021899100,1cyclictest0-21swapper/209:30:262
3021799108,1cyclictest0-21swapper/107:52:591
3021799107,2cyclictest18149-21/usr/sbin/munin10:23:251
3021799106,2cyclictest30882-21cut07:18:011
3021799106,2cyclictest21736-21diskmemload10:07:551
3021799106,2cyclictest21736-21diskmemload10:07:551
3021799105,4cyclictest11497-21ntpq10:48:121
3021799104,5cyclictest0-21swapper/112:06:191
3021799104,5cyclictest0-21swapper/111:40:311
3021799104,5cyclictest0-21swapper/111:20:551
3021799104,5cyclictest0-21swapper/110:03:071
3021799104,5cyclictest0-21swapper/109:26:091
3021799104,4cyclictest0-21swapper/109:47:571
3021799103,6cyclictest0-21swapper/112:39:111
3021799103,1cyclictest0-21swapper/111:59:551
3021799100,9cyclictest14419-21ssh12:28:091
3021799100,9cyclictest0-21swapper/112:33:291
3021799100,9cyclictest0-21swapper/110:32:591
3021699106,2cyclictest5727-21fschecks_time11:47:580
3021699104,5cyclictest101ktimersoftd/010:38:010
3021699102,6cyclictest23632-21kworker/0:010:28:150
3021699101,4cyclictest0-21swapper/012:27:390
302199994,3cyclictest15313-21grep07:52:593
302199994,3cyclictest0-21swapper/309:12:513
302199994,3cyclictest0-21swapper/308:32:443
302189997,1cyclictest0-21swapper/211:44:562
302189997,1cyclictest0-21swapper/211:32:462
302189997,1cyclictest0-21swapper/209:45:062
302189997,1cyclictest0-21swapper/208:50:262
302189997,1cyclictest0-21swapper/208:50:262
302189997,1cyclictest0-21swapper/208:33:162
302189996,2cyclictest8913-21grep09:38:002
302189996,2cyclictest4080-21cstates09:32:522
302189996,2cyclictest28603-21ntp_offset12:43:002
302189996,2cyclictest28603-21ntp_offset12:43:002
302189995,2cyclictest5305-21if_enp4s010:08:022
302189995,2cyclictest5305-21if_enp4s010:08:022
302189995,2cyclictest30467-21grep08:23:062
302189995,2cyclictest20940-21mailstats09:13:032
302189995,2cyclictest15948-21open_files07:53:052
302189994,3cyclictest21736-21diskmemload09:57:532
302189992,1cyclictest121rcu_preempt12:37:532
302189992,1cyclictest121rcu_preempt10:43:022
302189992,1cyclictest121rcu_preempt10:18:162
302189992,1cyclictest121rcu_preempt10:03:242
302189992,1cyclictest121rcu_preempt08:07:512
302189992,1cyclictest121rcu_preempt07:42:552
302189992,1cyclictest121rcu_preempt07:33:022
302189991,2cyclictest121rcu_preempt11:03:072
302189991,2cyclictest121rcu_preempt09:17:522
302189991,1cyclictest121rcu_preempt12:33:052
302189991,1cyclictest121rcu_preempt09:48:042
302189990,2cyclictest5802-21tail11:47:592
302189990,2cyclictest121rcu_preempt11:17:532
302189990,1cyclictest121rcu_preempt10:48:162
302189990,1cyclictest0-21swapper/208:20:362
302179997,1cyclictest14056-21ssh11:56:391
302179997,1cyclictest0-21swapper/111:33:591
302179997,1cyclictest0-21swapper/108:01:491
302179996,2cyclictest8063-21tr07:37:561
302179996,2cyclictest558-21runrttasks08:07:531
302179996,2cyclictest32694-21ssh10:37:571
302179996,2cyclictest11903-21tail08:53:071
302179995,2cyclictest9866-21tr10:13:091
302179995,2cyclictest31439-21grep08:27:511
302179995,2cyclictest29139-21unixbench_multi12:43:041
302179995,2cyclictest29139-21unixbench_multi12:43:041
302179995,2cyclictest16211-21mailstats09:03:081
302179994,4cyclictest0-21swapper/110:54:561
302179994,4cyclictest0-21swapper/109:18:451
302179994,1cyclictest0-21swapper/111:17:141
302179993,4cyclictest515-21in:imuxsock09:55:191
302179993,2cyclictest515-21in:imuxsock07:34:181
302179993,1cyclictest0-21swapper/110:20:141
302179991,6cyclictest8426-21irqstats12:22:571
302179991,2cyclictest19425-21/usr/sbin/munin08:03:081
302179991,2cyclictest0-21swapper/111:47:591
302179991,2cyclictest0-21swapper/110:28:541
302179990,8cyclictest0-21swapper/112:08:041
302179990,8cyclictest0-21swapper/109:07:591
302179990,7cyclictest8271-21cpuspeed_turbos08:47:521
302179990,7cyclictest8271-21cpuspeed_turbos08:47:521
302179990,1cyclictest0-21swapper/108:39:391
302189985,2cyclictest13869-21getsmi07:48:092
302189984,2cyclictest5425-21cron08:42:382
302189981,6cyclictest0-21swapper/211:23:022
302189981,6cyclictest0-21swapper/211:23:022
302189981,2cyclictest13532-21ssh12:27:572
302189981,1cyclictest121rcu_preempt08:27:502
302179985,2cyclictest558-21runrttasks08:22:481
302179985,2cyclictest26967-21cat08:17:561
302179985,2cyclictest20098-21df09:12:551
302179984,2cyclictest12517-21/usr/sbin/munin07:48:041
302179980,6cyclictest10411-21cpuspeed_turbos07:42:551
302179980,2cyclictest24056-21/usr/sbin/munin08:12:521
302179980,2cyclictest12587-21/usr/sbin/munin08:58:011
302179970,6cyclictest3145-21/usr/sbin/munin07:27:561
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional