You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-03 - 12:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Core i3-2310E @2100 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of shadow in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot2s.osadl.org (updated Sat Jun 03, 2023 00:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
962721540,0sleep30-21swapper/321:58:463
31190210742,31sleep10-21swapper/119:08:121
31033210644,32sleep30-21swapper/319:06:093
3132129147,32sleep20-21swapper/219:09:532
3108229147,31sleep00-21swapper/019:06:460
57162840,0sleep10-21swapper/121:24:341
31616996967,1cyclictest0-21swapper/319:22:393
31615996563,1cyclictest0-21swapper/219:22:392
197542610,1sleep00-21swapper/000:11:340
197542610,1sleep00-21swapper/000:11:340
31613995452,1cyclictest0-21swapper/019:22:390
31616994642,2cyclictest0-21swapper/319:10:163
31615994139,1cyclictest0-21swapper/219:10:162
78892330,0chrt0-21swapper/222:58:412
9202300,0sleep00-21swapper/023:53:060
31613993028,1cyclictest0-21swapper/019:10:160
3161699291,27cyclictest0-21swapper/319:40:113
228152260,0sleep00-21swapper/023:43:040
3161399240,23cyclictest0-21swapper/019:45:110
319782230,0sleep30-21swapper/322:20:273
3161699221,20cyclictest0-21swapper/300:00:273
3161699221,1cyclictest0-21swapper/300:20:283
261692220,0sleep00-21swapper/022:45:290
3161699215,5cyclictest31658-21users20:15:523
3161699215,5cyclictest14110-21ssh21:31:163
208202210,0sleep30-21swapper/322:09:573
3161699194,4cyclictest7606-21ssh22:58:163
3161699184,6cyclictest23343-21ssh22:10:543
3161699184,4cyclictest31167-21ssh21:48:153
3161699184,4cyclictest27827-21ssh21:14:563
3161699184,4cyclictest24546-21sh23:14:453
3161699184,4cyclictest20859-21ssh21:38:313
3161699184,4cyclictest17997-21ssh22:36:473
3161699184,4cyclictest11810-21sh23:01:353
3161699174,4cyclictest547-21snmpd21:16:583
3161699174,4cyclictest1313-21sh22:51:423
3161699174,3cyclictest2051-21sh23:23:413
3161699174,3cyclictest14419-21diskmemload22:34:203
3161699173,4cyclictest14382-21ssh00:05:513
3161699173,4cyclictest11762-21sh23:32:323
3161599177,3cyclictest28-21ksoftirqd/220:05:372
3161399173,5cyclictest12-21ksoftirqd/022:25:440
31613991713,3cyclictest12-21ksoftirqd/023:00:020
3161699164,3cyclictest1482-21sh00:26:223
3161699163,5cyclictest8550-21sh21:25:543
3161699163,5cyclictest26958-21sh23:46:243
3161699163,4cyclictest3074-21ssh21:51:503
3161699160,1cyclictest0-21swapper/322:40:263
3161599162,2cyclictest11346-21ssh00:37:172
3161399168,2cyclictest12-21ksoftirqd/023:30:420
3161399166,3cyclictest12-21ksoftirqd/022:20:390
3161399165,7cyclictest12-21ksoftirqd/000:35:320
3161399165,4cyclictest12-21ksoftirqd/022:05:420
3161399162,8cyclictest12-21ksoftirqd/021:29:150
3161399162,6cyclictest141rcu_preempt22:00:480
3161399162,2cyclictest141rcu_preempt21:55:440
3161399161,9cyclictest12-21ksoftirqd/022:37:350
3161399161,8cyclictest12-21ksoftirqd/021:50:380
3161399161,10cyclictest12-21ksoftirqd/000:00:390
3161699154,5cyclictest9328-21gltestperf00:35:293
3161699154,4cyclictest6447-21chrt20:34:223
3161699154,4cyclictest32263-21ssh23:51:293
3161699154,4cyclictest22573-21chrt19:57:433
3161699154,4cyclictest18128-21chrt19:49:453
3161699154,3cyclictest27674-21sh23:16:313
3161699153,8cyclictest0-21swapper/322:15:373
3161699153,5cyclictest1101-21sh21:20:123
3161699153,4cyclictest25135-21ssh21:42:023
3161699153,4cyclictest24673-21ssh00:16:363
3161699153,4cyclictest20158-21taskset00:12:143
3161699153,4cyclictest20158-21taskset00:12:143
3161699153,4cyclictest0-21swapper/323:59:103
3161699153,3cyclictest22707-21diskmemload22:25:233
3161599152,4cyclictest9649-21fschecks_time19:30:252
3161599152,3cyclictest271rcuc/222:09:222
3161599151,8cyclictest28-21ksoftirqd/222:18:522
3161599151,8cyclictest28-21ksoftirqd/222:13:292
3161599151,6cyclictest0-21swapper/222:27:332
3161599150,6cyclictest8332-21ssh21:56:502
3161599150,6cyclictest3257-21ssh22:54:382
3161599150,4cyclictest2816-21ssh23:55:302
3161399156,2cyclictest12-21ksoftirqd/019:25:290
3161399155,4cyclictest141rcu_preempt21:14:000
3161399155,3cyclictest12-21ksoftirqd/023:55:380
3161399155,3cyclictest12-21ksoftirqd/023:35:350
3161399155,3cyclictest12-21ksoftirqd/020:25:320
3161399154,7cyclictest12-21ksoftirqd/023:15:390
3161399154,7cyclictest12-21ksoftirqd/022:15:520
3161399154,7cyclictest12-21ksoftirqd/022:14:490
3161399154,5cyclictest12-21ksoftirqd/000:20:400
3161399154,3cyclictest12-21ksoftirqd/023:45:170
3161399154,2cyclictest141rcu_preempt20:05:400
3161399153,8cyclictest12-21ksoftirqd/022:55:090
3161399153,6cyclictest12-21ksoftirqd/000:32:520
3161399153,2cyclictest141rcu_preempt23:00:350
3161399152,9cyclictest12-21ksoftirqd/000:20:090
3161399150,10cyclictest12-21ksoftirqd/023:29:400
3161699146,6cyclictest240-21systemd-journal00:35:093
3161699144,4cyclictest20218-21chrt19:52:023
3161699144,3cyclictest23016-21chrt20:00:153
3161699144,2cyclictest16387-21sh23:36:273
3161699143,4cyclictest27113-21taskset20:06:323
3161699143,4cyclictest0-21swapper/322:00:113
3161699143,3cyclictest8507-21chrt20:36:143
3161699143,3cyclictest0-21swapper/320:55:143
3161699142,3cyclictest0-21swapper/323:28:493
3161599146,3cyclictest28-21ksoftirqd/221:50:412
3161599145,3cyclictest28-21ksoftirqd/221:46:372
3161599144,3cyclictest23250-21sh23:43:422
3161599142,5cyclictest0-21swapper/222:22:402
3161599142,4cyclictest8352-21sed20:35:502
3161599142,4cyclictest271rcuc/222:33:002
3161599142,4cyclictest25891-21ntp_kernel_pll_23:45:422
3161599142,4cyclictest16320-21unixbench_multi23:05:382
3161599142,4cyclictest12250-21ntpq22:00:422
3161599142,3cyclictest28453-21ssh21:15:302
3161599141,9cyclictest28-21ksoftirqd/223:27:082
3161599141,8cyclictest28-21ksoftirqd/223:37:272
3161599141,8cyclictest28-21ksoftirqd/223:18:062
3161599141,8cyclictest28-21ksoftirqd/221:43:472
3161599141,8cyclictest28-21ksoftirqd/221:14:502
3161599141,8cyclictest28-21ksoftirqd/200:29:182
3161599141,7cyclictest28-21ksoftirqd/223:31:482
3161599141,7cyclictest28-21ksoftirqd/221:28:412
3161599141,7cyclictest28-21ksoftirqd/200:05:142
3161599141,7cyclictest28-21ksoftirqd/200:04:172
3161599141,5cyclictest19838-21timerandwakeup19:50:392
3161599140,6cyclictest16423-21ssh21:34:452
3161499148,4cyclictest4292-21cron19:20:091
3161499147,6cyclictest22707-21diskmemload21:40:061
3161499144,5cyclictest24623-21ssh22:12:461
3161499144,5cyclictest0-21swapper/121:01:011
3161499142,4cyclictest0-21swapper/123:19:541
31614991410,3cyclictest22-21ksoftirqd/123:15:091
3161499140,5cyclictest18989-21taskset22:07:101
3161399148,2cyclictest12-21ksoftirqd/022:44:340
3161399146,2cyclictest12-21ksoftirqd/021:35:420
3161399145,3cyclictest12-21ksoftirqd/000:25:370
3161399144,6cyclictest141rcu_preempt20:10:310
3161399144,6cyclictest12-21ksoftirqd/021:34:360
3161399144,6cyclictest12-21ksoftirqd/000:07:140
3161399144,3cyclictest12-21ksoftirqd/021:05:240
3161399144,3cyclictest12-21ksoftirqd/019:30:220
3161399143,7cyclictest12-21ksoftirqd/023:05:340
3161399143,2cyclictest141rcu_preempt23:21:380
3161399142,7cyclictest141rcu_preempt21:19:320
3161399142,7cyclictest141rcu_preempt20:15:310
3161399142,7cyclictest141rcu_preempt19:35:250
3161399142,5cyclictest141rcu_preempt21:43:210
31613991410,3cyclictest12-21ksoftirqd/021:00:090
3161399140,7cyclictest12-21ksoftirqd/019:50:390
322312130,0chrt0-21swapper/120:20:091
3161699136,5cyclictest8914-21dump-pmu-power19:30:093
3161699136,5cyclictest32512-21grep20:20:293
3161699136,5cyclictest13047-21unixbench_multi19:35:343
3161699135,6cyclictest20010-21sed21:00:413
3161699134,4cyclictest20620-21/usr/sbin/munin21:05:283
3161699134,4cyclictest0-21swapper/320:47:183
3161699134,4cyclictest0-21swapper/319:15:103
3161699133,8cyclictest0-21swapper/320:55:043
3161699133,4cyclictest11082-21chrt20:44:323
3161699133,3cyclictest0-21swapper/320:27:093
3161699133,3cyclictest0-21swapper/319:33:563
3161699132,7cyclictest0-21swapper/323:05:523
3161599133,5cyclictest17287-21ssh21:35:282
3161599132,4cyclictest16810-21basename19:45:322
3161599132,3cyclictest9390-21sh23:00:262
3161599132,3cyclictest28-21ksoftirqd/220:25:402
3161599132,2cyclictest7745-21wc19:25:342
3161599131,8cyclictest28-21ksoftirqd/223:20:372
3161599131,8cyclictest28-21ksoftirqd/223:11:062
3161599131,7cyclictest28-21ksoftirqd/223:53:402
3161599131,7cyclictest28-21ksoftirqd/222:45:232
3161599131,7cyclictest28-21ksoftirqd/222:36:292
3161599131,7cyclictest28-21ksoftirqd/220:20:292
3161599131,7cyclictest28-21ksoftirqd/220:15:342
3161599131,7cyclictest28-21ksoftirqd/219:40:112
3161599131,7cyclictest28-21ksoftirqd/200:30:102
3161599131,4cyclictest12164-21if_enp3s019:35:262
3161599131,10cyclictest0-21swapper/220:00:342
3161599130,8cyclictest28-21ksoftirqd/200:11:502
3161599130,8cyclictest28-21ksoftirqd/200:11:502
3161599130,7cyclictest28-21ksoftirqd/222:40:152
3161599130,6cyclictest6195-21chrt20:31:042
3161599130,6cyclictest17964-21chrt20:59:142
3161599130,3cyclictest3132-21ssh21:20:432
3161499135,5cyclictest0-21swapper/122:16:101
3161499135,2cyclictest0-21swapper/122:48:041
3161499134,8cyclictest0-21swapper/123:33:041
3161499134,8cyclictest0-21swapper/120:28:441
3161499134,8cyclictest0-21swapper/100:11:361
3161499134,8cyclictest0-21swapper/100:11:361
3161499134,3cyclictest10573-21basename22:00:091
3161499133,5cyclictest7317-21ssh22:57:501
3161499133,5cyclictest203-21jbd2/sda1-823:20:361
3161499133,5cyclictest0-21swapper/122:53:131
3161499133,5cyclictest0-21swapper/119:54:311
3161499132,6cyclictest25331-21ssh21:11:121
3161399133,4cyclictest141rcu_preempt20:20:300
3161399132,7cyclictest12-21ksoftirqd/021:20:370
3161399132,5cyclictest141rcu_preempt22:30:110
3161399132,5cyclictest141rcu_preempt21:45:370
3161399132,5cyclictest141rcu_preempt20:30:280
3161399132,2cyclictest141rcu_preempt20:00:220
3161399131,7cyclictest141rcu_preempt20:35:330
3161399131,7cyclictest12-21ksoftirqd/019:55:250
3161399130,4cyclictest12-21ksoftirqd/023:10:350
3161699125,5cyclictest28251-21sed20:10:253
3161699124,2cyclictest0-21swapper/322:46:323
3161599122,2cyclictest0-21swapper/221:08:132
3161599122,2cyclictest0-21swapper/220:11:382
3161599121,9cyclictest0-21swapper/220:50:352
3161599121,7cyclictest28-21ksoftirqd/221:00:402
3161599121,7cyclictest28-21ksoftirqd/219:55:362
3161599121,7cyclictest28-21ksoftirqd/200:20:442
3161599121,7cyclictest28-21ksoftirqd/200:15:222
3161599120,7cyclictest28-21ksoftirqd/219:15:352
3161499126,4cyclictest29037-21head21:15:341
3161499125,5cyclictest45-21kcompactd019:25:401
3161499125,5cyclictest240-21systemd-journal21:55:091
3161499125,5cyclictest0-21swapper/100:21:441
3161499124,8cyclictest0-21swapper/122:43:141
3161499124,7cyclictest0-21swapper/119:22:391
3161499124,6cyclictest203-21jbd2/sda1-823:42:381
3161499124,5cyclictest0-21swapper/122:38:401
3161499124,5cyclictest0-21swapper/122:22:121
3161499124,5cyclictest0-21swapper/122:00:581
3161499124,5cyclictest0-21swapper/120:37:401
3161499124,5cyclictest0-21swapper/119:56:561
3161499124,5cyclictest0-21swapper/119:37:121
3161499124,5cyclictest0-21swapper/119:33:481
3161499122,5cyclictest0-21swapper/120:20:321
3161499121,9cyclictest14255-21grep19:40:311
3161499121,6cyclictest4826-21/usr/sbin/munin22:25:281
3161499121,6cyclictest24756-21ssh21:41:281
3161499121,6cyclictest2369-21ssh00:28:041
3161499121,6cyclictest14874-21ssh22:35:001
3161499121,4cyclictest3910-21ntp_states23:55:391
3161399124,2cyclictest13296-21taskset20:48:250
3161399123,5cyclictest141rcu_preempt20:40:320
3161399121,7cyclictest12-21ksoftirqd/020:52:490
3161399121,10cyclictest0-21swapper/019:15:230
3161399120,7cyclictest12-21ksoftirqd/021:00:350
3161399120,5cyclictest141rcu_preempt19:40:360
3161699111,3cyclictest19613-21grep23:40:273
3161599115,4cyclictest11645-21cut20:45:282
3161599111,6cyclictest28-21ksoftirqd/220:40:402
3161499117,2cyclictest31868-21grep19:10:241
3161499117,2cyclictest10428-21unixbench_singl00:35:381
3161499115,4cyclictest18097-21http21:00:091
3161499115,4cyclictest14195-21grep00:05:401
3161499115,3cyclictest14751-21strings20:50:381
3161499114,6cyclictest22707-21diskmemload00:17:371
3161499114,5cyclictest8924-21apt-get23:00:101
3161499114,5cyclictest7807-21ssh00:00:101
3161499114,5cyclictest27800-21ssh23:47:381
3161499114,5cyclictest0-21swapper/123:52:101
3161499114,5cyclictest0-21swapper/120:01:381
3161499114,5cyclictest0-21swapper/119:50:021
3161499114,2cyclictest0-21swapper/121:48:501
3161499113,8cyclictest0-21swapper/123:36:101
3161499113,8cyclictest0-21swapper/120:33:181
3161499113,8cyclictest0-21swapper/120:06:001
3161499113,5cyclictest0-21swapper/121:09:061
3161499113,3cyclictest7019-21df21:25:301
3161499112,4cyclictest15803-21ntp_states23:05:351
3161499111,7cyclictest22707-21diskmemload00:32:141
3161499111,5cyclictest16433-21ssh21:34:461
3161499104,5cyclictest10076-21sed20:40:351
3161499104,4cyclictest28077-21df20:10:231
3161499103,5cyclictest11529-21cpu20:45:281
3161499103,5cyclictest0-21swapper/123:26:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional