You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-05-28 - 18:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Core i3-2310E @2100 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of shadow in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot2s.osadl.org (updated Sun May 28, 2023 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2587599144139,3cyclictest26343-21diskstats07:10:202
904021390,0sleep10-21swapper/110:00:361
2587699138127,10cyclictest0-21swapper/307:30:223
2587699107105,1cyclictest0-21swapper/307:10:053
2557029046,32sleep20-21swapper/207:09:412
2541629047,31sleep00-21swapper/007:07:420
2529529047,32sleep30-21swapper/307:06:083
2399729046,32sleep10-21swapper/107:05:221
327322870,0sleep30-21swapper/308:30:413
25873996966,1cyclictest3429-21apt-get07:30:220
25873994644,1cyclictest0-21swapper/007:10:050
25874994029,10cyclictest0-21swapper/107:30:221
25874992923,5cyclictest211rcuc/107:25:271
25874992922,6cyclictest211rcuc/110:15:261
2587599271,6cyclictest0-21swapper/208:10:212
71042260,1sleep00-21swapper/010:57:110
25874992620,3cyclictest211rcuc/108:45:341
255372260,0sleep10-21swapper/109:17:441
280362210,0sleep00-21swapper/009:20:270
2587699210,20cyclictest0-21swapper/309:10:213
2587599210,20cyclictest0-21swapper/207:30:232
25874992118,1cyclictest0-21swapper/110:25:211
2587599190,16cyclictest0-21swapper/211:20:222
2587499199,5cyclictest22-21ksoftirqd/111:31:441
2587499183,14cyclictest0-21swapper/107:10:171
2587699174,8cyclictest18936-21ssh10:39:303
2587699174,8cyclictest18936-21ssh10:39:303
2587599163,12cyclictest0-21swapper/209:45:222
2587499160,1cyclictest0-21swapper/107:20:211
2587399160,14cyclictest0-21swapper/010:00:250
2587599153,7cyclictest5894-21ssh09:58:262
2587499158,5cyclictest23919-21cron08:15:041
2587499155,8cyclictest0-21swapper/107:35:541
2587399151,9cyclictest27710-21wc08:20:320
45892140,1sleep30-21swapper/311:53:173
265192140,0chrt0-21swapper/309:19:183
2587699149,3cyclictest1271-21grep08:35:313
2587699145,4cyclictest28552-21irqstats11:45:283
2587699144,8cyclictest0-21swapper/309:05:263
2587699144,5cyclictest0-21swapper/312:25:233
2587699142,9cyclictest12130-21taskset08:57:513
2587599148,4cyclictest28-21ksoftirqd/207:40:052
2587599144,5cyclictest27474-21ssh12:14:052
2587599144,5cyclictest0-21swapper/210:40:452
2587599144,5cyclictest0-21swapper/209:09:572
2587599144,5cyclictest0-21swapper/207:19:122
2587599144,5cyclictest0-21swapper/207:19:122
2587499143,6cyclictest16952-21diskmemload09:30:461
2587399149,3cyclictest7748-21tr12:25:240
2587399145,4cyclictest0-21swapper/008:31:230
25873991410,2cyclictest12347-21tr09:00:050
233472140,1chrt0-21swapper/011:11:340
2587699137,4cyclictest6681-21tr08:45:333
2587699134,6cyclictest0-21swapper/307:17:243
2587699134,6cyclictest0-21swapper/307:17:243
2587699134,4cyclictest0-21swapper/309:53:223
2587699134,3cyclictest20126-21mailstats10:10:343
2587699133,5cyclictest0-21swapper/308:00:263
2587699131,7cyclictest0-21swapper/307:35:243
2587699131,11cyclictest0-21swapper/310:55:233
2587599134,4cyclictest0-21swapper/211:40:582
2587599133,5cyclictest0-21swapper/211:56:472
2587599133,5cyclictest0-21swapper/211:26:342
2587599133,5cyclictest0-21swapper/210:48:482
25875991311,1cyclictest0-21swapper/209:25:242
2587499139,2cyclictest13619-21/usr/sbin/munin12:30:291
2587499137,5cyclictest22-21ksoftirqd/109:24:101
2587499136,5cyclictest514-21dbus-daemon08:20:331
2587499135,5cyclictest0-21swapper/109:58:111
2587499134,8cyclictest0-21swapper/111:38:361
2587499134,8cyclictest0-21swapper/110:31:041
2587499134,8cyclictest0-21swapper/110:14:501
2587499134,8cyclictest0-21swapper/109:12:361
2587499134,8cyclictest0-21swapper/108:59:101
2587499134,8cyclictest0-21swapper/108:01:501
2587499134,4cyclictest0-21swapper/110:45:401
2587499134,4cyclictest0-21swapper/107:44:041
2587399135,2cyclictest141rcu_preempt09:50:210
2587399134,4cyclictest240-21systemd-journal10:49:010
2587399134,4cyclictest0-21swapper/009:14:270
164862130,0chrt0-21swapper/111:05:331
326812120,5sleep228-21ksoftirqd/211:49:592
2587699127,3cyclictest30939-21missed_timers10:20:303
2587699126,4cyclictest23437-21grep09:45:243
2587699126,4cyclictest1149-21cut07:25:213
2587699125,6cyclictest0-21swapper/311:29:163
2587699125,6cyclictest0-21swapper/310:15:053
2587699125,6cyclictest0-21swapper/307:58:433
2587699125,5cyclictest34-21ksoftirqd/312:20:173
2587699124,3cyclictest0-21swapper/310:40:573
2587699123,4cyclictest0-21swapper/311:11:043
2587699122,5cyclictest0-21swapper/309:40:303
2587699121,9cyclictest9374-21unixbench_multi10:00:383
2587699121,6cyclictest7739-21processes11:55:383
2587699121,6cyclictest0-21swapper/312:35:213
2587599129,2cyclictest0-21swapper/209:50:322
2587599126,4cyclictest13772-21head12:30:302
2587599125,5cyclictest240-21systemd-journal08:30:242
2587599124,7cyclictest0-21swapper/210:02:112
2587599124,6cyclictest0-21swapper/210:25:062
2587599124,2cyclictest0-21swapper/210:51:162
2587599123,7cyclictest17202-1kworker/u9:109:15:312
2587599123,5cyclictest0-21swapper/210:35:212
2587599123,5cyclictest0-21swapper/210:35:212
2587599123,4cyclictest0-21swapper/210:20:282
2587599122,5cyclictest0-21swapper/211:33:072
2587599120,4cyclictest2089-21cpuspeed_turbos12:20:242
2587499126,4cyclictest12514-21grep09:35:271
2587499125,5cyclictest16943-21cron09:10:051
2587499124,5cyclictest8477-21ssh11:27:461
2587499124,5cyclictest29887-21strings08:25:301
2587499124,5cyclictest21796-21irqstats11:10:341
2587499124,5cyclictest0-21swapper/112:04:561
2587499124,5cyclictest0-21swapper/110:06:241
2587499124,5cyclictest0-21swapper/107:53:321
2587499124,2cyclictest0-21swapper/110:50:081
2587499123,8cyclictest0-21swapper/110:37:501
2587499123,8cyclictest0-21swapper/110:37:501
2587499122,8cyclictest0-21swapper/111:46:041
2587499122,5cyclictest2237-21smartctl09:25:381
2587499122,5cyclictest0-21swapper/107:45:301
2587499121,6cyclictest30734-21chrt10:20:281
2587499121,6cyclictest24572-21diskmemload11:41:361
2587399129,2cyclictest0-21swapper/012:33:580
2587399128,3cyclictest12-21ksoftirqd/012:20:050
2587399128,3cyclictest12-21ksoftirqd/012:20:050
2587399126,4cyclictest547-21snmpd10:50:240
2587399126,4cyclictest240-21systemd-journal10:24:230
2587399126,4cyclictest23850-21ls10:15:040
2587399126,4cyclictest1226-21grep11:20:350
2587399126,1cyclictest12-21ksoftirqd/011:15:290
2587399126,1cyclictest12-21ksoftirqd/011:05:230
2587399126,1cyclictest12-21ksoftirqd/009:15:370
2587399125,6cyclictest0-21swapper/012:01:530
2587399125,5cyclictest514-21dbus-daemon07:35:290
2587399125,5cyclictest10854-21cut07:45:280
2587399125,2cyclictest12-21ksoftirqd/011:50:320
2587399125,1cyclictest12-21ksoftirqd/011:35:260
2587399124,6cyclictest0-21swapper/011:25:160
2587399124,6cyclictest0-21swapper/008:07:280
2587399124,4cyclictest25198-21ssh10:15:310
2587399124,4cyclictest0-21swapper/007:18:270
2587399124,4cyclictest0-21swapper/007:18:270
2587399124,3cyclictest0-21swapper/012:36:030
2587399124,2cyclictest12-21ksoftirqd/009:25:240
2587399123,7cyclictest774-21perf08:39:590
2587399121,6cyclictest0-21swapper/010:30:390
2587399121,4cyclictest24965-21awk10:45:050
37032110,1sleep10-21swapper/112:20:411
2587699116,3cyclictest28102-21grep11:15:403
2587699116,3cyclictest12411-21dump-pmu-power07:50:053
2587699115,5cyclictest0-21swapper/311:01:333
2587699115,5cyclictest0-21swapper/309:33:013
2587699115,5cyclictest0-21swapper/307:44:343
2587699115,4cyclictest952-21swap11:20:343
2587699115,4cyclictest9348-21head10:30:373
2587699115,4cyclictest13264-21wc09:00:333
2587699115,4cyclictest13264-21wc09:00:333
2587699114,6cyclictest24406-21ssh11:41:223
2587699114,5cyclictest16952-21diskmemload12:05:113
2587699114,5cyclictest0-21swapper/311:08:223
2587699114,3cyclictest0-21swapper/310:45:393
2587699113,6cyclictest40550irq/33-enp3s0-r09:56:533
2587699112,8cyclictest0-21swapper/310:50:293
2587699111,5cyclictest0-21swapper/309:22:373
2587699110,9cyclictest30087-21pluginstate12:15:493
2587699110,9cyclictest30087-21pluginstate12:15:493
2587699110,9cyclictest13677-21ssh12:30:303
2587699110,10cyclictest21479-21ssh11:40:003
2587599118,2cyclictest30852-21ssh09:22:322
2587599116,3cyclictest28687-21aten2_r8power_c12:15:252
2587599116,3cyclictest28687-21aten2_r8power_c12:15:252
2587599116,3cyclictest24899-21tune2fs10:15:282
2587599116,3cyclictest20984-21sh10:11:102
2587599116,3cyclictest1981-21kernelversion07:25:272
2587599116,3cyclictest18478-21uname09:10:302
2587599115,5cyclictest11179-21mailstats11:00:392
2587599115,5cyclictest0-21swapper/211:17:552
2587599115,5cyclictest0-21swapper/207:47:012
2587599115,4cyclictest240-21systemd-journal08:40:042
2587599115,4cyclictest10852-21head08:55:262
2587599114,6cyclictest0-21swapper/211:09:332
2587599114,5cyclictest14258-21ssh12:01:142
2587599114,5cyclictest0-21swapper/212:09:232
2587599114,5cyclictest0-21swapper/209:38:132
2587599114,5cyclictest0-21swapper/209:01:122
2587599114,5cyclictest0-21swapper/209:01:122
2587599114,4cyclictest0-21swapper/211:55:022
2587599113,7cyclictest0-21swapper/208:17:592
2587599113,5cyclictest0-21swapper/208:07:342
2587599113,2cyclictest0-21swapper/211:10:152
2587599110,9cyclictest11438-21apt-get09:35:052
2587599110,6cyclictest13930-21/usr/sbin/munin10:05:292
2587599110,4cyclictest18194-21grep11:35:412
2587599110,4cyclictest10828-21ssh10:31:082
2587499116,3cyclictest4584-21latency_hist11:25:041
2587499116,3cyclictest16952-21diskmemload10:55:331
2587499115,5cyclictest0-21swapper/109:45:201
2587499115,5cyclictest0-21swapper/107:58:201
2587499115,4cyclictest30594-21grep12:15:551
2587499115,4cyclictest30594-21grep12:15:551
2587499115,4cyclictest26433-21cut11:15:251
2587499115,4cyclictest1828-21cat11:50:331
2587499115,1cyclictest0-21swapper/108:15:281
2587499114,5cyclictest514-21dbus-daemon08:35:491
2587499114,5cyclictest12602-21apt-get09:00:281
2587499114,5cyclictest12602-21apt-get09:00:281
2587499114,5cyclictest0-21swapper/112:39:031
2587499114,5cyclictest0-21swapper/111:56:081
2587499114,5cyclictest0-21swapper/108:53:151
2587499114,5cyclictest0-21swapper/108:40:401
2587499114,2cyclictest187712ntp_offset09:40:341
2587499113,5cyclictest0-21swapper/112:29:481
2587499113,5cyclictest0-21swapper/110:41:081
2587499113,5cyclictest0-21swapper/108:33:361
2587499113,5cyclictest0-21swapper/107:15:391
2587499113,5cyclictest0-21swapper/107:15:391
2587499113,2cyclictest0-21swapper/109:51:201
2587499111,5cyclictest13283-21ssh11:03:001
2587499111,5cyclictest0-21swapper/112:05:081
2587399117,2cyclictest12-21ksoftirqd/012:05:320
2587399116,3cyclictest530-21runrttasks09:36:410
2587399116,3cyclictest2807-21latency12:20:300
2587399116,3cyclictest11737-21latency11:30:350
2587399115,5cyclictest0-21swapper/008:25:410
2587399115,4cyclictest10005-21cron08:55:040
2587399115,4cyclictest0-21swapper/009:09:390
2587399115,4cyclictest0-21swapper/008:17:230
2587399115,1cyclictest12-21ksoftirqd/011:41:030
2587399115,1cyclictest12-21ksoftirqd/010:25:340
2587399114,6cyclictest0-21swapper/007:40:160
2587399114,5cyclictest0-21swapper/009:04:300
2587399114,5cyclictest0-21swapper/009:04:300
2587399113,1cyclictest12-21ksoftirqd/012:14:130
2587399110,6cyclictest16952-21diskmemload09:33:340
2587699106,2cyclictest8096-21cpu08:50:293
2587699106,2cyclictest604-21sh09:25:133
2587699106,2cyclictest31252-21aten2_r8power_c07:20:223
2587699106,2cyclictest29277-21entropy08:25:253
2587699105,3cyclictest13854-21unixbench_singl12:00:443
2587699105,3cyclictest0-21swapper/312:10:143
2587699104,5cyclictest0-21swapper/307:54:013
2587699104,4cyclictest3847-21fschecks_time08:40:283
2587699104,4cyclictest25599-21awk08:15:353
2587699103,5cyclictest547-21snmpd10:05:173
2587699101,6cyclictest15306-21ssh11:34:163
2587699100,9cyclictest0-21swapper/310:25:213
2587699100,3cyclictest12157-21tr09:35:253
2587599107,2cyclictest8660-21sed07:40:342
2587599106,3cyclictest4352-21grep10:55:242
2587599105,4cyclictest16020-21awk07:55:272
2587599105,4cyclictest0-21swapper/212:35:302
2587599105,3cyclictest8821-21interrupts08:50:402
2587599105,3cyclictest4712-21switchtime08:40:392
2587599105,3cyclictest11213-21sh12:28:102
2587599104,5cyclictest0-21swapper/208:25:592
2587599104,4cyclictest530-21runrttasks09:40:092
2587599104,4cyclictest17551-21cut08:00:222
2587599103,5cyclictest0-21swapper/208:22:352
2587599101,7cyclictest0-21swapper/207:20:292
2587499104,5cyclictest0-21swapper/108:05:161
2587499101,1cyclictest0-21swapper/112:12:101
2587399107,2cyclictest12-21ksoftirqd/009:55:310
2587399107,2cyclictest12-21ksoftirqd/008:00:270
2587399107,1cyclictest12-21ksoftirqd/011:45:210
2587399106,2cyclictest12-21ksoftirqd/011:55:250
2587399106,2cyclictest12-21ksoftirqd/011:00:260
2587399106,2cyclictest12-21ksoftirqd/007:55:320
2587399106,2cyclictest12-21ksoftirqd/007:25:300
2587399105,3cyclictest14344-21ntp_kernel_err10:05:320
2587399105,3cyclictest12890-21grep07:50:210
2587399105,3cyclictest12-21ksoftirqd/008:50:040
2587399104,5cyclictest0-21swapper/007:24:450
2587399104,4cyclictest22059-21wc08:10:230
2587399104,2cyclictest141rcu_preempt09:42:450
2587399103,5cyclictest3392-21aten2_r8power_e08:40:250
2587399101,4cyclictest0-21swapper/009:47:490
218692100,1sleep30-21swapper/308:10:223
141442100,0sleep00-21swapper/010:35:180
141442100,0sleep00-21swapper/010:35:180
258769995,2cyclictest20731-21grep08:05:403
258769993,4cyclictest28088-21grep08:20:343
258759994,4cyclictest0-21swapper/207:50:222
258759993,4cyclictest6535-21cat08:45:322
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional