You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-06-13 - 00:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

Intel(R) Core(TM) i7 CPU M 620 @ 2.67GHz, Linux 4.19.106-rt45+ (Profile)

Latency plot of shadow in rack #3, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack3slot6s.osadl.org (updated Sat Jun 12, 2021 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32246211293,14sleep00-21swapper/007:08:390
32042210586,13sleep10-21swapper/107:06:001
31617210088,6sleep30-21swapper/307:05:293
3232829981,12sleep20-21swapper/207:09:412
172022810,0sleep30-21swapper/310:50:003
87952710,1sleep10-21swapper/109:00:011
28142700,0sleep20-21swapper/210:10:252
32383992921,6cyclictest3749-21runrttasks12:24:042
3238199264,18cyclictest0-21swapper/007:51:030
3238199243,18cyclictest0-21swapper/011:09:030
32383992320,2cyclictest26014-21kworker/u8:109:11:042
32383992320,2cyclictest26014-21kworker/u8:109:11:032
32383992320,2cyclictest19447-21kworker/u8:209:34:042
32383992219,2cyclictest27923-21kworker/u8:211:21:032
32383992219,2cyclictest19447-21kworker/u8:209:49:042
32383992219,2cyclictest15836-21kworker/u8:007:11:032
3238399220,18cyclictest0-21swapper/208:59:042
3238199224,2cyclictest0-21swapper/007:49:030
3238199223,3cyclictest0-21swapper/008:05:040
3238199223,12cyclictest0-21swapper/009:00:040
32383992118,2cyclictest6751-21kworker/u8:211:59:032
32383992118,2cyclictest26014-21kworker/u8:109:17:042
32383992118,2cyclictest26014-21kworker/u8:108:52:032
32383992118,2cyclictest19447-21kworker/u8:209:35:042
32383992118,2cyclictest15836-21kworker/u8:008:37:032
32383992118,2cyclictest15836-21kworker/u8:007:30:042
32383992118,2cyclictest15836-21kworker/u8:007:20:042
32383992118,2cyclictest15836-21kworker/u8:007:18:042
32383992118,2cyclictest14705-21kworker/u8:207:47:042
32383992118,2cyclictest11281-21kworker/u8:011:10:042
3238399210,18cyclictest0-21swapper/212:02:042
3238399210,18cyclictest0-21swapper/211:05:032
3238199212,2cyclictest0-21swapper/011:48:030
3238199212,2cyclictest0-21swapper/011:41:040
3238199212,2cyclictest0-21swapper/011:24:030
3238199212,2cyclictest0-21swapper/007:38:040
3238499200,18cyclictest12-21rcu_preempt09:25:153
3238499200,18cyclictest0-21swapper/308:10:133
32383992017,2cyclictest4831-21kworker/u8:011:45:032
32383992017,2cyclictest30678-21kworker/u8:010:07:042
32383992017,2cyclictest27923-21kworker/u8:211:39:042
32383992017,2cyclictest2053-21kworker/u8:210:36:042
32383992017,2cyclictest2053-21kworker/u8:210:20:042
32383992017,2cyclictest16726-21kworker/u8:108:11:022
32383992017,2cyclictest15836-21kworker/u8:008:22:042
32383992017,2cyclictest14705-21kworker/u8:207:51:042
32383992017,2cyclictest12414-21kworker/u8:112:13:032
32383992017,2cyclictest11281-21kworker/u8:010:54:042
32383992017,2cyclictest11281-21kworker/u8:010:47:032
3238399200,18cyclictest0-21swapper/210:30:182
3238199200,4cyclictest0-21swapper/011:59:040
3238199200,4cyclictest0-21swapper/010:07:030
3238199200,3cyclictest0-21swapper/010:49:030
3238199200,3cyclictest0-21swapper/010:36:040
3238199200,3cyclictest0-21swapper/007:57:030
32383991916,2cyclictest30678-21kworker/u8:010:17:032
32383991916,2cyclictest30678-21kworker/u8:010:00:042
32383991916,2cyclictest27923-21kworker/u8:211:33:032
32383991916,2cyclictest19447-21kworker/u8:209:54:032
32383991916,2cyclictest19447-21kworker/u8:209:42:042
32383991916,2cyclictest16726-21kworker/u8:108:09:042
32383991916,2cyclictest16726-21kworker/u8:107:57:032
32383991916,2cyclictest15836-21kworker/u8:009:25:032
32383991916,2cyclictest15836-21kworker/u8:009:22:042
32383991916,2cyclictest15836-21kworker/u8:008:33:042
3238399190,18cyclictest0-21swapper/210:40:032
3238199191,2cyclictest0-21swapper/008:25:040
32384991815,2cyclictest4831-21kworker/u8:011:46:043
32384991815,2cyclictest27923-21kworker/u8:211:19:043
32384991815,2cyclictest19447-21kworker/u8:209:41:043
32384991815,2cyclictest16147-21kworker/u8:212:21:023
32383991815,2cyclictest4831-21kworker/u8:011:41:042
32383991815,2cyclictest18046-21kworker/u8:107:43:042
32383991815,2cyclictest15836-21kworker/u8:007:35:032
3238399180,7cyclictest0-21swapper/210:29:042
3238399180,5cyclictest0-21swapper/212:29:032
3238199182,2cyclictest0-21swapper/009:45:040
3238199181,2cyclictest0-21swapper/010:16:040
32384991714,2cyclictest26014-21kworker/u8:109:12:043
32384991714,2cyclictest26014-21kworker/u8:109:12:033
32384991714,2cyclictest2053-21kworker/u8:210:23:043
32384991714,2cyclictest2053-21kworker/u8:210:18:033
32384991714,2cyclictest16147-21kworker/u8:212:37:033
32383991714,2cyclictest30678-21kworker/u8:009:58:042
32383991714,2cyclictest26014-21kworker/u8:109:00:042
32383991714,2cyclictest24144-21kworker/u8:208:15:032
32383991714,2cyclictest16147-21kworker/u8:212:17:032
32383991714,2cyclictest15836-21kworker/u8:008:25:032
3238199173,2cyclictest0-21swapper/011:33:040
32384991613,2cyclictest8742-21kworker/u8:011:54:043
32384991613,2cyclictest26014-21kworker/u8:108:55:043
32384991613,2cyclictest26014-21kworker/u8:108:54:033
32384991613,2cyclictest26014-21kworker/u8:108:49:043
32384991613,2cyclictest18046-21kworker/u8:107:41:043
32384991613,2cyclictest16147-21kworker/u8:212:19:043
32384991613,2cyclictest15836-21kworker/u8:008:20:043
32384991613,2cyclictest15836-21kworker/u8:007:29:043
3238499161,13cyclictest0-21swapper/307:50:193
32383991613,2cyclictest16147-21kworker/u8:212:38:032
3238199161,2cyclictest0-21swapper/007:32:040
32384991512,2cyclictest30678-21kworker/u8:010:14:043
32384991512,2cyclictest30678-21kworker/u8:010:05:043
32384991512,2cyclictest2053-21kworker/u8:210:32:043
32384991512,2cyclictest19447-21kworker/u8:209:38:033
32384991512,2cyclictest16726-21kworker/u8:107:56:043
32384991512,2cyclictest15836-21kworker/u8:008:32:043
32384991512,2cyclictest15836-21kworker/u8:007:31:043
32384991512,2cyclictest15836-21kworker/u8:007:16:043
32384991512,2cyclictest11281-21kworker/u8:011:03:043
32384991512,2cyclictest11281-21kworker/u8:010:57:043
3238499151,12cyclictest25530-21munin-node3
32384991510,3cyclictest0-21swapper/307:45:233
3238499150,2cyclictest0-21swapper/312:29:033
3238499150,13cyclictest0-21swapper/309:45:243
3238299151,2cyclictest0-21swapper/107:10:241
32382991512,2cyclictest0-21swapper/112:15:211
3238299150,3cyclictest0-21swapper/112:35:261
3238199152,2cyclictest0-21swapper/008:13:040
32381991512,2cyclictest9-21ksoftirqd/012:30:150
3238199150,4cyclictest0-21swapper/008:22:040
3238499142,6cyclictest0-21swapper/310:00:013
32384991411,2cyclictest6751-21kworker/u8:212:03:043
32384991411,2cyclictest6751-21kworker/u8:211:57:033
32384991411,2cyclictest15836-21kworker/u8:007:23:023
3238499140,2cyclictest0-21swapper/310:00:133
3238499140,2cyclictest0-21swapper/308:05:243
3238499140,12cyclictest39-21ksoftirqd/309:30:293
32383991411,2cyclictest15836-21kworker/u8:008:44:042
3238399140,13cyclictest0-21swapper/212:30:042
3238399140,12cyclictest0-21swapper/208:45:232
32382991411,2cyclictest0-21swapper/111:25:011
32382991411,2cyclictest0-21swapper/110:25:411
32382991411,2cyclictest0-21swapper/107:45:191
32382991410,2cyclictest0-21swapper/110:45:001
3238299140,2cyclictest0-21swapper/111:20:201
3238299140,2cyclictest0-21swapper/107:40:251
3238199142,11cyclictest0-21swapper/009:18:030
3238199141,2cyclictest0-21swapper/008:36:040
32381991411,2cyclictest0-21swapper/009:55:140
3238199140,4cyclictest0-21swapper/010:54:040
3238199140,3cyclictest0-21swapper/007:44:040
3238199140,12cyclictest0-21swapper/007:25:170
3238499133,5cyclictest0-21swapper/309:10:013
32384991310,2cyclictest27923-21kworker/u8:211:36:043
32384991310,2cyclictest26014-21kworker/u8:109:01:043
32384991310,2cyclictest16726-21kworker/u8:108:01:033
32384991310,2cyclictest15836-21kworker/u8:009:23:033
32384991310,2cyclictest15836-21kworker/u8:008:29:033
32384991310,2cyclictest15836-21kworker/u8:007:13:043
32384991310,2cyclictest12414-21kworker/u8:112:06:043
32384991310,2cyclictest11281-21kworker/u8:011:07:033
32384991310,2cyclictest0-21swapper/310:25:163
32384991310,2cyclictest0-21swapper/309:15:273
3238499130,8cyclictest0-21swapper/311:28:043
3238299138,3cyclictest0-21swapper/110:05:491
32382991310,2cyclictest0-21swapper/111:45:131
32382991310,2cyclictest0-21swapper/110:15:151
32382991310,2cyclictest0-21swapper/108:45:241
32382991310,2cyclictest0-21swapper/108:30:221
3238299130,2cyclictest23808-21sensors11:05:361
3238299130,2cyclictest0-21swapper/109:40:011
3238299130,2cyclictest0-21swapper/109:25:141
3238299130,12cyclictest0-21swapper/109:45:401
3238299130,12cyclictest0-21swapper/108:25:291
3238199131,2cyclictest0-21swapper/009:33:030
3238199130,3cyclictest0-21swapper/010:13:040
3238199130,2cyclictest0-21swapper/012:28:030
3238199130,2cyclictest0-21swapper/009:22:040
311072130,2sleep00-21swapper/008:30:280
3238499129,2cyclictest4831-21kworker/u8:011:43:043
3238499129,2cyclictest0-21swapper/311:30:263
32384991210,1cyclictest0-21swapper/308:35:263
3238499120,11cyclictest0-21swapper/310:35:243
3238299129,2cyclictest0-21swapper/111:55:131
3238299129,2cyclictest0-21swapper/110:30:331
3238299129,2cyclictest0-21swapper/109:55:281
3238299129,2cyclictest0-21swapper/108:35:261
3238299129,2cyclictest0-21swapper/107:15:211
3238299128,2cyclictest0-21swapper/112:25:141
3238299128,2cyclictest0-21swapper/107:50:171
3238299122,7cyclictest0-21swapper/111:00:591
3238299122,7cyclictest0-21swapper/110:35:591
3238299122,7cyclictest0-21swapper/108:10:591
3238299121,9cyclictest20844-21munin-node1
3238299121,9cyclictest0-21swapper/111:50:141
3238299121,9cyclictest0-21swapper/110:55:171
3238299120,2cyclictest0-21swapper/110:10:201
3238299120,2cyclictest0-21swapper/108:23:081
3238299120,2cyclictest0-21swapper/108:00:191
3238299120,11cyclictest0-21swapper/112:10:231
3238299120,11cyclictest0-21swapper/111:15:341
3238299120,11cyclictest0-21swapper/110:45:331
3238299120,11cyclictest0-21swapper/109:35:211
3238199129,2cyclictest0-21swapper/012:00:160
3238199127,3cyclictest13168-21latency09:10:220
3238199127,3cyclictest13168-21latency09:10:220
3238199126,4cyclictest3727-21Xorg12:35:590
3238199122,2cyclictest0-21swapper/007:19:040
3238199120,11cyclictest0-21swapper/009:40:240
3238499118,2cyclictest27923-21kworker/u8:211:20:043
3238499118,2cyclictest11281-21kworker/u8:010:53:043
3238499118,2cyclictest0-21swapper/309:50:213
3238499116,3cyclictest0-21swapper/308:15:203
3238499111,7cyclictest0-21swapper/308:42:023
3238399118,2cyclictest0-21swapper/211:00:332
3238299117,2cyclictest6076-21df_abs07:25:191
3238299117,2cyclictest0-21swapper/112:20:131
3238299117,2cyclictest0-21swapper/112:05:151
3238299117,2cyclictest0-21swapper/110:20:191
3238299117,2cyclictest0-21swapper/110:00:151
3238299112,5cyclictest0-21swapper/108:19:591
3238299111,8cyclictest0-21swapper/107:35:161
3238299111,3cyclictest20001-21munin-node1
3238299110,9cyclictest3543-21cpuspeed_turbos11:40:171
3238299110,9cyclictest14635-21taskset09:15:141
3238299110,9cyclictest0-21swapper/111:30:141
3238299110,9cyclictest0-21swapper/110:50:151
3238299110,9cyclictest0-21swapper/108:40:121
3238299110,2cyclictest0-21swapper/112:30:011
3238299110,10cyclictest0-21swapper/107:55:181
3238199118,2cyclictest0-21swapper/012:15:190
3238199118,2cyclictest0-21swapper/011:00:140
3238199110,9cyclictest0-21swapper/010:20:330
3238199110,9cyclictest0-21swapper/010:00:220
3238199110,2cyclictest0-21swapper/009:25:180
3238199110,10cyclictest0-21swapper/012:10:230
3238199110,10cyclictest0-21swapper/011:15:320
3238499102,7cyclictest0-21swapper/310:41:013
3238399107,2cyclictest0-21swapper/212:05:152
3238299107,2cyclictest5193-21apt-get08:50:141
3238299107,2cyclictest10944-21df_abs09:05:151
3238299107,2cyclictest0-21swapper/111:35:161
3238299107,2cyclictest0-21swapper/109:00:141
3238299106,2cyclictest0-21swapper/109:50:151
3238299102,6cyclictest0-21swapper/109:20:591
3238299100,9cyclictest0-21swapper/111:13:311
3238299100,8cyclictest8156-21smartctl07:30:191
3238299100,3cyclictest0-21swapper/109:10:211
3238299100,3cyclictest0-21swapper/109:10:211
3238199107,2cyclictest0-21swapper/012:05:010
3238199107,2cyclictest0-21swapper/011:10:120
3238199105,3cyclictest31966-21wc11:30:000
3238199105,3cyclictest11093-21unixbench_multi10:30:490
3238199102,7cyclictest0-21swapper/008:43:580
3238199102,6cyclictest0-21swapper/009:35:590
3238199102,6cyclictest0-21swapper/009:05:010
3238199102,6cyclictest0-21swapper/008:54:590
3238199100,8cyclictest0-21swapper/009:53:250
3238199100,2cyclictest0-21swapper/010:42:040
323849994,3cyclictest22428-21hwlatdetect12:30:163
323849994,3cyclictest10161-21latency07:35:213
323849991,5cyclictest0-21swapper/312:10:163
323839996,2cyclictest8041-21cut11:50:192
323839990,8cyclictest0-21swapper/210:55:032
323829996,2cyclictest0-21swapper/112:00:131
323829996,2cyclictest0-21swapper/107:20:121
323819994,3cyclictest559-21hddtemp_smartct07:10:210
323819994,3cyclictest4057-21cpuspeed_turbos07:20:130
323819994,3cyclictest3749-21runrttasks10:58:160
323819994,3cyclictest3511-21cut08:45:160
323819994,3cyclictest19926-21cron12:25:000
323819991,6cyclictest0-21swapper/011:50:240
323819991,3cyclictest24935-21fschecks_time08:15:160
323819991,3cyclictest0-21swapper/008:00:150
323819990,2cyclictest0-21swapper/010:25:140
323839985,2cyclictest0-21swapper/209:05:182
323839983,3cyclictest0-21swapper/211:15:142
323839980,6cyclictest0-21swapper/208:03:032
323819984,3cyclictest0-21swapper/011:35:140
323819983,3cyclictest7519-21modprobe08:55:160
323839973,3cyclictest30414-21df_abs11:25:202
323839970,6cyclictest0-21swapper/207:25:032
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional