You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-20 - 16:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot6s.osadl.org (updated Mon May 20, 2024 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13162115104,6sleep00-21swapper/007:06:220
1269211087,17sleep30-21swapper/307:05:453
1317210786,14sleep10-21swapper/107:06:231
1261210580,19sleep20-21swapper/207:05:402
58012860,1sleep3381ktimersoftd/312:28:383
297222730,1sleep329727-21unixbench_multi08:15:313
188982730,1sleep0101ktimersoftd/009:45:210
94772690,0sleep20-21swapper/210:45:272
87242610,1sleep30-21swapper/308:45:173
232552600,0sleep20-21swapper/211:00:312
1633993717,18cyclictest17971-21diskmemload12:30:143
1632993212,18cyclictest0-21swapper/208:05:112
1629993116,13cyclictest0-21swapper/112:30:141
250212240,0sleep20-21swapper/211:38:432
163399231,20cyclictest22572-21ssh10:25:113
76352220,1sleep37638-21cpu11:55:113
163399221,19cyclictest0-21swapper/311:15:153
1629992218,2cyclictest5176-21kworker/u8:111:22:041
1629992217,3cyclictest17971-21diskmemload10:10:101
163399210,3cyclictest28589-21sed09:20:233
162999212,2cyclictest0-21swapper/112:03:041
162999212,2cyclictest0-21swapper/111:03:041
1629992118,2cyclictest24654-21kworker/u8:010:08:051
163399201,3cyclictest15625-21chrt10:16:353
163399200,2cyclictest0-21swapper/307:25:103
1629992017,2cyclictest4396-21kworker/u8:109:34:041
1629992017,2cyclictest2564-21kworker/u8:210:39:041
1629992017,2cyclictest15904-21kworker/u8:209:42:051
162999200,2cyclictest0-21swapper/108:55:111
162999200,2cyclictest0-21swapper/107:20:111
1633991910,2cyclictest17971-21diskmemload09:40:403
163399190,2cyclictest0-21swapper/312:12:233
163399190,2cyclictest0-21swapper/312:00:263
163399190,2cyclictest0-21swapper/311:25:483
163399190,2cyclictest0-21swapper/309:57:163
163399190,12cyclictest17971-21diskmemload09:30:153
163399190,11cyclictest0-21swapper/311:20:193
163299190,2cyclictest0-21swapper/207:25:102
163299190,17cyclictest0-21swapper/210:40:132
1629991916,2cyclictest5176-21kworker/u8:111:32:051
1629991916,2cyclictest32482-21kworker/u8:008:31:031
1629991916,2cyclictest32360-21kworker/u8:012:25:041
1629991916,2cyclictest29805-21kworker/u8:209:58:041
1629991916,2cyclictest24654-21kworker/u8:009:52:051
1629991916,2cyclictest14806-21kworker/u8:010:51:051
1629991916,2cyclictest14740-21kworker/u8:012:14:041
1629991916,2cyclictest14527-21kworker/u8:107:46:051
1629991916,2cyclictest10115-21kworker/u8:011:25:041
162999191,2cyclictest13855-21popularity-cont07:37:051
162999190,14cyclictest0-21swapper/110:46:041
162999190,14cyclictest0-21swapper/109:26:051
162999190,14cyclictest0-21swapper/108:41:041
163399182,13cyclictest0-21swapper/310:45:003
1633991810,2cyclictest0-21swapper/311:07:493
163399180,2cyclictest0-21swapper/307:50:103
163399180,16cyclictest0-21swapper/308:15:013
1629991815,2cyclictest7832-21kworker/u8:008:50:051
1629991815,2cyclictest25698-21kworker/u8:112:16:041
1629991815,2cyclictest2564-21kworker/u8:211:19:051
1629991815,2cyclictest20479-21kworker/u8:212:21:051
1629991815,2cyclictest20033-21kworker/u8:309:48:041
1629991815,2cyclictest13494-21kworker/u8:210:19:051
1629991815,2cyclictest10107-21kworker/u8:007:40:041
1629991815,2cyclictest10107-21kworker/u8:007:32:041
162999180,13cyclictest0-21swapper/110:31:031
1627991813,3cyclictest7744-21cpuspeed_turbos11:55:130
1627991813,3cyclictest21586-21ssh11:35:130
163399179,2cyclictest17971-21diskmemload11:00:563
163399179,2cyclictest0-21swapper/312:23:483
163399179,2cyclictest0-21swapper/307:10:203
163399178,2cyclictest0-21swapper/310:50:013
163399178,2cyclictest0-21swapper/309:16:003
163399177,3cyclictest14966-21hwlatdetect07:40:193
163399177,3cyclictest1131-21ssh10:36:133
163399175,3cyclictest17971-21diskmemload11:35:123
163399174,4cyclictest23050-21tr09:50:153
163399172,6cyclictest0-21swapper/307:45:313
163399170,1cyclictest0-21swapper/309:38:073
163399170,16cyclictest0-21swapper/309:45:133
163399170,11cyclictest0-21swapper/311:51:123
1629991714,2cyclictest9422-21kworker/u8:112:05:041
1629991714,2cyclictest4396-21kworker/u8:109:37:041
1629991714,2cyclictest21489-21kworker/u8:010:43:051
1629991714,2cyclictest20149-21kworker/u8:211:52:041
1629991714,2cyclictest18345-21kworker/u8:007:58:041
1629991714,2cyclictest1558-21kworker/u8:007:18:041
1629991714,2cyclictest10115-21kworker/u8:011:41:041
162999170,2cyclictest0-21swapper/111:49:041
162999170,2cyclictest0-21swapper/109:19:051
162999170,16cyclictest0-21swapper/108:10:101
162999170,15cyclictest0-21swapper/111:35:361
162799170,16cyclictest0-21swapper/010:40:140
163399169,2cyclictest0-21swapper/311:31:363
163399168,2cyclictest0-21swapper/311:40:093
163399168,2cyclictest0-21swapper/310:06:233
163399165,2cyclictest5095-21runrttasks08:50:123
163399164,4cyclictest10970-21tr07:30:193
163399161,6cyclictest0-21swapper/308:59:083
163399161,13cyclictest18619-21hddtemp_smartct10:20:173
163399161,13cyclictest13855-21popularity-cont07:37:073
163399160,1cyclictest0-21swapper/309:00:133
163399160,12cyclictest0-21swapper/310:00:163
163399160,11cyclictest0-21swapper/309:11:503
163299161,3cyclictest9214-21diskstats10:10:142
1632991613,2cyclictest4278-21ssh09:30:122
1629991613,2cyclictest7832-21kworker/u8:009:11:031
1629991613,2cyclictest7832-21kworker/u8:009:01:051
1629991613,2cyclictest10829-21kworker/u8:012:35:041
163399150,9cyclictest0-21swapper/311:10:103
163399150,10cyclictest0-21swapper/310:11:303
163299150,13cyclictest8094-21ssh11:20:142
1629991512,2cyclictest7832-21kworker/u8:008:45:041
1629991512,2cyclictest6128-21kworker/u8:208:22:041
162999150,2cyclictest0-21swapper/107:54:051
162999150,14cyclictest0-21swapper/107:12:051
162999150,13cyclictest0-21swapper/110:59:161
162999150,11cyclictest0-21swapper/109:06:041
162799151,12cyclictest0-21swapper/010:15:180
162799150,3cyclictest25472-21ssh09:17:130
162799150,3cyclictest22319-21latency_hist08:00:000
162799150,13cyclictest28814-21ssh11:42:200
163399141,7cyclictest0-21swapper/308:22:023
163399140,12cyclictest0-21swapper/312:07:573
163299149,3cyclictest2797-21ssh09:28:112
163299142,7cyclictest0-21swapper/211:30:012
163299141,2cyclictest17971-21diskmemload11:42:152
1632991411,2cyclictest17971-21diskmemload11:10:142
163299141,11cyclictest17971-21diskmemload10:34:202
163299140,3cyclictest0-21swapper/209:23:002
163299140,2cyclictest0-21swapper/209:14:252
163299140,12cyclictest29510-21smartctl08:15:292
163299140,12cyclictest17971-21diskmemload12:18:352
163299140,12cyclictest17971-21diskmemload09:56:342
163299140,12cyclictest17491-21apt-get10:55:102
163299140,12cyclictest0-21swapper/212:10:132
163299140,12cyclictest0-21swapper/211:15:352
1629991411,2cyclictest6128-21kworker/u8:208:16:051
162999140,3cyclictest0-21swapper/110:27:051
162999140,2cyclictest0-21swapper/111:08:051
162999140,13cyclictest0-21swapper/111:12:461
162999140,13cyclictest0-21swapper/108:03:051
1627991411,2cyclictest0-21swapper/009:21:320
1627991411,2cyclictest0-21swapper/008:00:230
162799141,11cyclictest21454-21ssh09:13:110
162799140,3cyclictest0-21swapper/012:17:350
162799140,3cyclictest0-21swapper/010:00:130
162799140,12cyclictest32218-21pzem11:10:260
162799140,12cyclictest12994-21munin-node0
162799140,12cyclictest0-21swapper/011:50:180
162799140,12cyclictest0-21swapper/011:19:330
1633991310,2cyclictest27060-21apt-get10:30:103
1633991310,2cyclictest0-21swapper/312:15:143
1633991310,2cyclictest0-21swapper/307:15:323
163399130,2cyclictest0-21swapper/310:55:193
163399130,12cyclictest0-21swapper/310:47:193
163399130,12cyclictest0-21swapper/309:05:193
163399130,12cyclictest0-21swapper/307:20:183
163299138,3cyclictest0-21swapper/211:09:222
163299138,3cyclictest0-21swapper/209:37:232
163299132,7cyclictest0-21swapper/208:35:002
163299131,7cyclictest0-21swapper/207:50:012
1632991310,2cyclictest17971-21diskmemload10:55:002
1632991310,2cyclictest0-21swapper/212:26:242
1632991310,2cyclictest0-21swapper/211:51:422
1632991310,2cyclictest0-21swapper/210:36:342
1632991310,2cyclictest0-21swapper/210:26:452
1632991310,2cyclictest0-21swapper/209:51:422
1632991310,2cyclictest0-21swapper/209:48:322
1632991310,2cyclictest0-21swapper/209:19:202
1632991310,2cyclictest0-21swapper/209:05:182
163299130,2cyclictest17971-21diskmemload12:31:252
163299130,2cyclictest0-21swapper/212:38:182
163299130,2cyclictest0-21swapper/210:08:512
163299130,2cyclictest0-21swapper/208:35:202
163299130,2cyclictest0-21swapper/207:50:112
163299130,2cyclictest0-21swapper/207:35:152
163299130,2cyclictest0-21swapper/207:10:122
163299130,12cyclictest0-21swapper/212:21:242
1629991310,2cyclictest6829-21kworker/u8:110:21:041
1629991310,2cyclictest0-21swapper/109:22:371
162999130,2cyclictest0-21swapper/110:01:041
162999130,2cyclictest0-21swapper/107:26:051
162999130,12cyclictest0-21swapper/111:56:161
162799139,2cyclictest17453-21ssh10:55:070
162799132,8cyclictest0-21swapper/008:34:010
1627991310,2cyclictest0-21swapper/012:03:250
1627991310,2cyclictest0-21swapper/011:49:460
1627991310,2cyclictest0-21swapper/010:48:280
1627991310,2cyclictest0-21swapper/010:25:040
1627991310,2cyclictest0-21swapper/010:07:070
1627991310,2cyclictest0-21swapper/009:26:120
1627991310,2cyclictest0-21swapper/008:55:180
162799130,2cyclictest28184-21munin-node0
162799130,2cyclictest0-21swapper/012:11:460
162799130,2cyclictest0-21swapper/011:31:430
162799130,2cyclictest0-21swapper/010:21:550
162799130,12cyclictest0-21swapper/009:54:330
162799130,11cyclictest17971-21diskmemload09:58:550
162799130,11cyclictest0-21swapper/011:06:010
146672130,9sleep014677-21ssh11:26:350
163399129,2cyclictest0-21swapper/312:36:583
163399120,2cyclictest0-21swapper/311:47:273
163399120,2cyclictest0-21swapper/309:25:353
163399120,11cyclictest0-21swapper/308:05:303
163299129,2cyclictest0-21swapper/212:06:302
163299129,2cyclictest0-21swapper/210:20:042
163299129,2cyclictest0-21swapper/210:15:412
163299129,2cyclictest0-21swapper/209:40:312
163299129,2cyclictest0-21swapper/208:40:232
163299129,2cyclictest0-21swapper/207:55:232
163299122,6cyclictest0-21swapper/207:35:002
163299121,9cyclictest31389-21modprobe11:45:192
163299120,6cyclictest0-21swapper/208:55:012
163299120,2cyclictest0-21swapper/209:00:292
163299120,2cyclictest0-21swapper/208:25:332
163299120,11cyclictest0-21swapper/212:00:262
163299120,11cyclictest0-21swapper/211:55:272
163299120,11cyclictest0-21swapper/211:30:112
163299120,11cyclictest0-21swapper/210:00:252
163299120,10cyclictest0-21swapper/208:20:082
163299120,10cyclictest0-21swapper/208:00:312
162999122,7cyclictest5883-21gdm-simple-gree08:08:581
162799129,2cyclictest1662-21copy07:10:030
162799129,2cyclictest0-21swapper/010:35:220
162799129,2cyclictest0-21swapper/009:43:500
162799129,2cyclictest0-21swapper/007:50:150
162799120,2cyclictest15302-21ssh10:51:460
162799120,2cyclictest0-21swapper/012:25:250
162799120,2cyclictest0-21swapper/012:23:360
162799120,2cyclictest0-21swapper/011:21:450
162799120,2cyclictest0-21swapper/011:00:160
162799120,2cyclictest0-21swapper/009:00:150
162799120,1cyclictest11430-21ssh09:36:560
162799120,11cyclictest0-21swapper/012:35:260
162799120,11cyclictest0-21swapper/012:30:270
162799120,11cyclictest0-21swapper/012:05:270
162799120,11cyclictest0-21swapper/010:10:550
162799120,11cyclictest0-21swapper/009:32:230
163399118,2cyclictest0-21swapper/308:25:323
163299111,8cyclictest26390-21munin-node2
163299111,8cyclictest0-21swapper/207:15:182
163299110,3cyclictest0-21swapper/208:45:152
162799118,2cyclictest0-21swapper/009:05:110
162799118,2cyclictest0-21swapper/008:35:090
162799118,2cyclictest0-21swapper/008:15:150
162799118,2cyclictest0-21swapper/007:40:140
162799117,2cyclictest0-21swapper/007:30:180
162799111,5cyclictest0-21swapper/008:45:000
163299107,2cyclictest0-21swapper/207:40:342
163299101,7cyclictest7845-21munin-run07:25:012
163299100,3cyclictest0-21swapper/208:55:122
162999102,7cyclictest0-21swapper/108:37:591
162799100,9cyclictest0-21swapper/008:25:190
16339996,2cyclictest0-21swapper/308:30:593
16339994,3cyclictest7932-21latency_hist08:45:003
16339994,3cyclictest4210-21cpuspeed_turbos08:35:133
16339994,3cyclictest21098-21latency07:55:183
16279996,2cyclictest0-21swapper/008:20:080
16279994,3cyclictest6602-21cut08:40:170
16279994,3cyclictest5095-21runrttasks07:25:130
16279990,7cyclictest0-21swapper/007:15:590
16279990,6cyclictest0-21swapper/008:50:290
16279990,6cyclictest0-21swapper/008:07:580
16339983,3cyclictest22448-21aten2.4_r3power08:00:133
16299983,3cyclictest1028-21mailstats08:25:321
16279983,3cyclictest0-21swapper/007:45:140
16279982,4cyclictest6191-21telnet07:20:120
16279981,4cyclictest26781-21df_inode08:10:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional