You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-13 - 01:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Core i7-M620 @2667 MHz, Linux 4.19.106-rt45+ (Profile)

Latency plot of shadow in rack #3, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Fri Aug 12, 2022 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12954211295,12sleep20-21swapper/207:07:012
13012210897,6sleep30-21swapper/307:07:463
12927210695,6sleep00-21swapper/007:06:390
12911210081,6sleep10-21swapper/107:06:281
56602800,1sleep20-21swapper/209:40:292
1321799330,2cyclictest0-21swapper/211:06:122
1321799330,2cyclictest0-21swapper/209:35:382
1321799320,3cyclictest0-21swapper/210:57:112
1321599321,3cyclictest0-21swapper/008:28:080
1321599320,2cyclictest0-21swapper/011:18:120
1321799310,3cyclictest0-21swapper/208:16:402
1321599310,8cyclictest0-21swapper/007:38:100
1321599310,3cyclictest0-21swapper/008:09:360
1321599310,2cyclictest0-21swapper/010:51:110
1321799300,5cyclictest0-21swapper/208:30:152
1321799300,5cyclictest0-21swapper/207:17:052
1321799300,4cyclictest0-21swapper/212:34:432
1321799300,4cyclictest0-21swapper/210:18:392
1321799300,4cyclictest0-21swapper/208:08:362
1321799300,3cyclictest0-21swapper/211:55:222
1321799300,3cyclictest0-21swapper/211:52:262
1321599302,10cyclictest0-21swapper/011:14:410
1321599300,9cyclictest0-21swapper/010:41:110
1321599300,6cyclictest0-21swapper/008:02:550
1321599300,3cyclictest0-21swapper/009:18:080
1321599300,10cyclictest0-21swapper/011:52:110
1321799290,2cyclictest0-21swapper/207:14:052
1321599290,8cyclictest0-21swapper/007:55:400
1321599290,5cyclictest0-21swapper/008:20:250
1321599290,10cyclictest0-21swapper/009:11:100
1321599290,10cyclictest0-21swapper/009:11:100
1321799280,4cyclictest0-21swapper/212:16:132
1321799280,4cyclictest0-21swapper/209:06:252
1321599270,4cyclictest0-21swapper/012:38:270
1321599270,3cyclictest0-21swapper/009:52:410
1321799260,3cyclictest0-21swapper/209:33:082
1321599262,12cyclictest0-21swapper/010:32:590
1321599261,9cyclictest0-21swapper/012:23:570
1321799251,3cyclictest0-21swapper/209:56:262
1321799250,3cyclictest0-21swapper/211:04:112
1321599251,3cyclictest0-21swapper/009:20:410
1321799241,5cyclictest0-21swapper/208:14:252
1321799241,3cyclictest0-21swapper/212:27:112
1321799240,3cyclictest0-21swapper/207:31:352
1321599241,3cyclictest0-21swapper/011:35:110
1321599241,3cyclictest0-21swapper/008:16:250
1321599240,3cyclictest0-21swapper/007:34:350
1321599231,3cyclictest0-21swapper/012:19:420
1321599231,10cyclictest0-21swapper/008:38:550
1321599230,3cyclictest0-21swapper/008:42:100
1321599230,3cyclictest0-21swapper/007:23:050
1321599230,3cyclictest0-21swapper/007:12:250
1321599222,3cyclictest0-21swapper/012:25:420
1321599222,3cyclictest0-21swapper/009:30:410
1321599222,14cyclictest0-21swapper/010:00:010
1321599220,8cyclictest4668-21gdm-simple-gree10:46:590
1321599220,3cyclictest0-21swapper/011:57:130
1321599220,1cyclictest0-21swapper/009:56:380
1321799210,19cyclictest0-21swapper/210:35:132
1321599211,3cyclictest0-21swapper/011:29:410
1321599211,3cyclictest0-21swapper/007:19:100
1321599210,2cyclictest0-21swapper/008:30:170
1321599210,19cyclictest0-21swapper/008:10:140
1321799201,3cyclictest0-21swapper/209:12:102
1321799201,3cyclictest0-21swapper/209:12:102
1321799200,3cyclictest0-21swapper/212:08:432
1321799200,2cyclictest0-21swapper/211:40:132
1321799200,18cyclictest0-21swapper/212:10:152
1321699200,2cyclictest0-21swapper/107:50:101
1321599201,17cyclictest19396-21apt-get10:20:160
1321599200,3cyclictest0-21swapper/009:47:560
1321599200,2cyclictest0-21swapper/011:05:260
1321599200,2cyclictest0-21swapper/011:00:340
1321599200,2cyclictest0-21swapper/010:25:180
1321599200,2cyclictest0-21swapper/009:40:180
1321599200,2cyclictest0-21swapper/009:26:340
1321599200,18cyclictest24901-21cut12:00:230
1321799191,3cyclictest0-21swapper/212:20:422
1321799191,3cyclictest0-21swapper/211:23:422
1321799191,3cyclictest0-21swapper/210:02:562
1321799190,5cyclictest0-21swapper/207:24:402
1321799190,4cyclictest0-21swapper/208:44:402
1321599199,8cyclictest26933-21perl07:45:130
1321599190,3cyclictest0-21swapper/008:45:080
1321599190,2cyclictest0-21swapper/012:10:220
1321599190,2cyclictest0-21swapper/011:45:220
1321599190,2cyclictest0-21swapper/011:30:220
1321599190,2cyclictest0-21swapper/011:20:140
1321599190,2cyclictest0-21swapper/010:15:300
1321599190,2cyclictest0-21swapper/010:11:140
1321599190,2cyclictest0-21swapper/009:05:290
1321599190,2cyclictest0-21swapper/009:03:370
1321599190,2cyclictest0-21swapper/008:55:090
1321599190,2cyclictest0-21swapper/007:50:170
1321599190,2cyclictest0-21swapper/007:25:160
1321799181,3cyclictest0-21swapper/208:22:102
1321599182,3cyclictest0-21swapper/010:06:110
1321599180,2cyclictest0-21swapper/012:30:220
1321599180,2cyclictest0-21swapper/012:05:020
1321599180,2cyclictest0-21swapper/011:41:140
1321599180,2cyclictest0-21swapper/010:36:140
1321599180,2cyclictest0-21swapper/009:35:220
1321599180,2cyclictest0-21swapper/008:50:170
1321599180,1cyclictest0-21swapper/007:40:170
13216991712,3cyclictest18760-21grep10:15:291
1321599170,2cyclictest0-21swapper/010:55:060
13218991613,2cyclictest9800-21kworker/u8:009:57:043
13218991613,2cyclictest974-21kworker/u8:108:31:043
13218991613,2cyclictest24411-21kworker/u8:011:04:043
13218991613,2cyclictest1996-21kworker/u8:109:44:043
13218991613,2cyclictest19853-21kworker/u8:012:12:043
13218991613,2cyclictest17897-21kworker/u8:108:52:043
13218991613,2cyclictest15883-21kworker/u8:209:29:043
13217991613,2cyclictest21501-21kworker/u8:009:02:042
1321799160,5cyclictest0-21swapper/211:17:422
13218991512,2cyclictest9259-21kworker/u8:107:30:043
13218991512,2cyclictest20687-21kworker/u8:112:06:043
13218991512,2cyclictest19853-21kworker/u8:011:50:043
13218991512,2cyclictest15883-21kworker/u8:209:24:043
1321899150,3cyclictest0-21swapper/308:45:123
1321899150,13cyclictest7471-21fschecks_count08:20:143
1321799151,3cyclictest0-21swapper/212:37:572
1321799150,4cyclictest0-21swapper/211:10:422
13218991411,2cyclictest9800-21kworker/u8:010:08:043
13218991411,2cyclictest6413-21kworker/u8:211:33:043
13218991411,2cyclictest6307-21munin-node3
13218991411,2cyclictest5950-21kworker/u8:210:31:043
13218991411,2cyclictest24411-21kworker/u8:010:46:043
13218991411,2cyclictest20687-21kworker/u8:112:19:043
13218991411,2cyclictest20687-21kworker/u8:112:00:043
13218991411,2cyclictest13111-21kworker/u8:207:56:043
13218991411,2cyclictest13111-21kworker/u8:207:51:043
13218991411,2cyclictest13111-21kworker/u8:207:16:043
1321899140,12cyclictest37-21rcuc/308:45:003
13217991411,2cyclictest1996-21kworker/u8:109:52:042
13217991411,2cyclictest15883-21kworker/u8:209:23:042
13217991411,2cyclictest13111-21kworker/u8:207:50:042
13217991411,2cyclictest13111-21kworker/u8:207:44:042
1321799140,13cyclictest0-21swapper/207:35:152
13216991411,2cyclictest0-21swapper/111:15:241
1321699140,13cyclictest0-21swapper/110:30:141
1321699140,12cyclictest18802-21iostat_ios08:50:151
1321899139,2cyclictest12-21rcu_preempt10:56:113
1321899139,2cyclictest0-21swapper/311:39:233
13218991310,2cyclictest24411-21kworker/u8:010:38:043
13218991310,2cyclictest20687-21kworker/u8:112:27:043
13218991310,2cyclictest19853-21kworker/u8:011:47:043
13218991310,2cyclictest13111-21kworker/u8:208:00:043
13218991310,2cyclictest13111-21kworker/u8:207:47:043
13218991310,2cyclictest0-21swapper/309:32:413
1321899130,12cyclictest0-21swapper/308:10:153
1321799139,2cyclictest19270-21sed08:50:242
1321799133,7cyclictest0-21swapper/209:48:592
1321799131,3cyclictest0-21swapper/209:27:082
1321799131,3cyclictest0-21swapper/207:28:052
13217991310,2cyclictest24411-21kworker/u8:010:54:042
13217991310,2cyclictest24411-21kworker/u8:010:44:042
13217991310,2cyclictest13111-21kworker/u8:207:49:042
13216991310,2cyclictest0-21swapper/110:55:141
13216991310,2cyclictest0-21swapper/107:40:251
1321699130,12cyclictest0-21swapper/112:25:221
1321699130,12cyclictest0-21swapper/109:35:151
1321699130,12cyclictest0-21swapper/108:35:291
1321699130,12cyclictest0-21swapper/108:20:181
1321699130,12cyclictest0-21swapper/108:10:001
1321899129,2cyclictest974-21kworker/u8:108:35:043
1321899129,2cyclictest974-21kworker/u8:108:06:043
1321899129,2cyclictest9295-21diskstats08:25:133
1321899129,2cyclictest6413-21kworker/u8:211:15:043
1321899129,2cyclictest22997-21fschecks_count07:35:133
1321899129,2cyclictest21501-21kworker/u8:009:03:043
1321899129,2cyclictest21501-21kworker/u8:008:59:043
1321899129,2cyclictest20687-21kworker/u8:112:35:043
1321899129,2cyclictest20687-21kworker/u8:111:56:043
1321899129,2cyclictest0-21swapper/312:34:333
1321899129,2cyclictest0-21swapper/309:15:313
1321799129,2cyclictest974-21kworker/u8:108:37:042
1321799129,2cyclictest6413-21kworker/u8:211:32:042
1321799129,2cyclictest0-21swapper/210:10:202
1321799129,2cyclictest0-21swapper/208:45:242
1321799120,2cyclictest0-21swapper/211:35:152
1321799120,11cyclictest0-21swapper/211:45:262
1321799120,11cyclictest0-21swapper/210:45:152
1321699129,2cyclictest10187-21which11:20:251
1321699129,2cyclictest0-21swapper/112:15:241
1321699129,2cyclictest0-21swapper/111:30:281
1321699129,2cyclictest0-21swapper/110:45:141
1321699129,2cyclictest0-21swapper/110:40:121
1321699129,2cyclictest0-21swapper/110:20:171
1321699129,2cyclictest0-21swapper/108:40:151
1321699123,7cyclictest0-21swapper/111:45:231
1321699121,3cyclictest13428-21munin-node1
1321699120,2cyclictest0-21swapper/112:35:191
1321699120,2cyclictest0-21swapper/111:05:201
1321699120,2cyclictest0-21swapper/110:50:241
1321699120,2cyclictest0-21swapper/109:10:211
1321699120,2cyclictest0-21swapper/109:10:211
1321699120,11cyclictest1959-21diskstats11:00:211
1321699120,11cyclictest0-21swapper/112:00:311
1321699120,11cyclictest0-21swapper/110:25:201
1321699120,11cyclictest0-21swapper/110:00:251
1321699120,10cyclictest0-21swapper/108:30:121
1321899118,2cyclictest9800-21kworker/u8:010:11:043
1321899118,2cyclictest5950-21kworker/u8:210:29:043
1321899118,2cyclictest37-21rcuc/311:25:273
1321899118,2cyclictest24411-21kworker/u8:010:53:043
1321899118,2cyclictest24411-21kworker/u8:010:41:043
1321899118,2cyclictest1996-21kworker/u8:109:36:043
1321899118,2cyclictest13111-21kworker/u8:207:10:043
1321899118,2cyclictest0-21swapper/307:25:143
1321899116,3cyclictest0-21swapper/307:40:203
1321899110,3cyclictest26802-21timerwakeupswit09:10:273
1321899110,3cyclictest26802-21timerwakeupswit09:10:273
1321799112,6cyclictest0-21swapper/210:31:022
1321799112,5cyclictest0-21swapper/210:20:312
1321799110,10cyclictest0-21swapper/212:00:222
1321699118,2cyclictest0-21swapper/112:10:161
1321699118,2cyclictest0-21swapper/112:05:201
1321699118,2cyclictest0-21swapper/111:25:261
1321699118,2cyclictest0-21swapper/110:09:311
1321699118,2cyclictest0-21swapper/107:25:151
1321699111,9cyclictest14810-21munin-node1
1321699111,8cyclictest16688-21df_inode08:45:121
1321699111,3cyclictest31382-21df09:25:151
1321699110,9cyclictest5573-21munin-node1
1321699110,9cyclictest0-21swapper/111:55:321
1321699110,9cyclictest0-21swapper/108:00:261
1321699110,3cyclictest31487-21sed07:55:251
1321699110,1cyclictest0-21swapper/111:50:241
1321899107,2cyclictest9259-21kworker/u8:107:20:043
1321899104,4cyclictest6877-21chrt08:18:493
1321899101,7cyclictest4668-21gdm-simple-gree11:44:593
1321899101,3cyclictest10887-21cron11:24:593
1321799107,2cyclictest6413-21kworker/u8:211:26:042
1321799107,2cyclictest15883-21kworker/u8:209:19:042
1321799107,2cyclictest0-21swapper/208:00:242
1321799106,2cyclictest13838-21apt10:05:152
1321799102,5cyclictest0-21swapper/207:57:022
1321799101,6cyclictest0-21swapper/210:27:592
1321799101,5cyclictest21769-21munin-run09:00:002
1321699107,2cyclictest5351-21munin-node1
1321699107,2cyclictest0-21swapper/109:50:241
1321699107,2cyclictest0-21swapper/109:15:191
1321699106,3cyclictest17230-21grep07:20:171
1321699105,3cyclictest20273-21tr08:55:121
1321699104,2cyclictest2849-21sshd08:06:311
1321699100,9cyclictest20687-21kworker/u8:112:32:041
1321699100,8cyclictest9884-21sed08:25:181
1321699100,8cyclictest16057-21fschecks_time10:10:171
1321699100,8cyclictest0-21swapper/109:40:281
1321699100,8cyclictest0-21swapper/109:00:121
1321699100,8cyclictest0-21swapper/107:30:171
1321699100,3cyclictest856-21df09:30:201
132189996,2cyclictest24411-21kworker/u8:011:08:043
132189994,3cyclictest8293-21cpu09:50:193
132189994,3cyclictest24309-21if_eth009:05:153
132189994,3cyclictest19706-21fschecks_count10:20:213
132189994,3cyclictest0-21swapper/310:00:183
132189993,4cyclictest17616-21grep10:15:163
132189992,6cyclictest12-21rcu_preempt09:48:483
132189991,3cyclictest32536-21timerwakeupswit12:20:253
132179996,2cyclictest974-21kworker/u8:108:27:042
132169996,2cyclictest6387-21munin-node1
132169996,2cyclictest0-21swapper/111:40:131
132169996,2cyclictest0-21swapper/110:35:151
132169996,2cyclictest0-21swapper/109:55:151
132169996,2cyclictest0-21swapper/109:20:181
132169995,2cyclictest31835-21fschecks_time12:20:141
132169991,2cyclictest0-21swapper/107:45:181
132169990,2cyclictest0-21swapper/109:05:181
132169983,3cyclictest22958-21df_abs07:35:121
132169983,3cyclictest15502-21sed07:15:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional