You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-01-29 - 17:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.4.229-rt200 (Profile)

Latency plot of shadow in rack #1, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a -t3 -p99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack1slot2s.osadl.org (updated Sun Jan 29, 2023 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2583026867,0sleep10-21swapper/106:58:181
2539026160,0sleep30-21swapper/306:57:123
2599723730,0sleep20-21swapper/207:00:152
2600023625,0sleep00-21swapper/007:00:170
4160,0ktimersoftd/00-21swapper/009:33:480
35160,0ktimersoftd/30-21swapper/311:32:183
339960,0migration/38776-21sh11:46:343
339960,0migration/38764-21sh12:03:423
339960,0migration/36814-21sh09:10:383
339960,0migration/326608-21sh10:01:423
339960,0migration/32208-21sh10:05:523
339960,0migration/311791-21munin-node08:02:103
28845060,0irq/26-eth0-rx-29765-21ssh11:17:453
28845060,0irq/26-eth0-rx-13801-21sh09:12:223
28845060,0irq/26-eth0-rx-12676-21grep09:52:093
262059960,0cyclictest23172-21diskmemload10:13:132
262059960,0cyclictest0-21swapper/212:21:052
262059960,0cyclictest0-21swapper/208:57:142
262049960,0cyclictest0-21swapper/109:41:071
149960,0migration/06659-21taskset11:24:420
149960,0migration/028796-21kthreadcore11:57:100
149960,0migration/021983-21latency08:57:110
149960,0migration/015202-21sh11:29:560
4150,0ktimersoftd/00-21swapper/010:45:260
4150,0ktimersoftd/00-21swapper/009:22:220
339950,0migration/38384-21mdstat10:07:113
339950,0migration/36653-21kthreadcore08:47:143
339950,0migration/34409-21kthreadcore09:27:103
339950,0migration/33320-21latency_hist08:46:483
339950,0migration/331851-21kthreadcore07:52:123
339950,0migration/328234-21munin-node12:17:123
339950,0migration/32706-21latency_hist08:21:493
339950,0migration/326162-21kthreadcore10:57:123
339950,0migration/322035-21load08:57:123
339950,0migration/321040-21aten2_r1power_c10:37:023
339950,0migration/320960-21taskset07:46:003
339950,0migration/319315-21kthreadcore11:12:133
339950,0migration/317273-21taskset09:36:543
339950,0migration/311719-21kernelversion12:07:093
339950,0migration/310913-21kthreadcore11:27:123
339950,0migration/310655-21fschecks_time08:52:073
28855050,0irq/27-eth0-tx-4832-21cut09:27:102
28855050,0irq/27-eth0-tx-2243-21perl09:47:102
28845050,0irq/26-eth0-rx-7343-21aten2_r1power_c07:12:023
28845050,0irq/26-eth0-rx-6331-21runrttasks11:46:543
28845050,0irq/26-eth0-rx-31189-21nfs_client09:42:113
28845050,0irq/26-eth0-rx-30967-21df_abs11:02:043
28845050,0irq/26-eth0-rx-30251-21if_err_eth110:42:073
28845050,0irq/26-eth0-rx-25189-21fschecks_time11:37:053
28845050,0irq/26-eth0-rx-15991-21sshd09:34:273
28845050,0irq/26-eth0-rx-13034-21forks10:32:063
28845050,0irq/26-eth0-rx-11055-21awk10:47:203
28845050,0irq/26-eth0-rx-0-21swapper/312:27:383
28845050,0irq/26-eth0-rx-0-21swapper/312:24:553
28845050,0irq/26-eth0-rx-0-21swapper/311:09:113
28845050,0irq/26-eth0-rx-0-21swapper/310:52:393
28845050,0irq/26-eth0-rx-0-21swapper/310:22:093
28845050,0irq/26-eth0-rx-0-21swapper/310:17:273
28845050,0irq/26-eth0-rx-0-21swapper/309:50:183
28845050,0irq/26-eth0-rx-0-21swapper/309:22:053
28845050,0irq/26-eth0-rx-0-21swapper/309:20:133
27150,0ktimersoftd/20-21swapper/210:18:192
27150,0ktimersoftd/20-21swapper/209:33:482
262059955,0cyclictest0-21swapper/211:52:332
262059955,0cyclictest0-21swapper/211:27:102
262059955,0cyclictest0-21swapper/209:20:052
262059953,0cyclictest26520-21awk09:42:072
262059950,0cyclictest0-21swapper/212:30:042
262059950,0cyclictest0-21swapper/210:32:082
262059950,0cyclictest0-21swapper/209:56:212
262059950,0cyclictest0-21swapper/209:07:192
262049955,0cyclictest23172-21diskmemload12:20:591
262049955,0cyclictest0-21swapper/111:44:241
262049955,0cyclictest0-21swapper/110:24:381
262049955,0cyclictest0-21swapper/110:03:591
262049955,0cyclictest0-21swapper/109:58:461
262049955,0cyclictest0-21swapper/109:47:161
262049950,0cyclictest0-21swapper/111:57:011
262049950,0cyclictest0-21swapper/111:48:591
262049950,0cyclictest0-21swapper/110:39:181
262039955,0cyclictest0-21swapper/012:18:100
262039955,0cyclictest0-21swapper/008:36:490
262039954,0cyclictest16143-21ps11:12:120
262039950,0cyclictest0-21swapper/010:35:510
249950,0watchdog/230524-21kthreadcore08:42:112
249950,0watchdog/20-21swapper/212:12:072
19150,0ktimersoftd/10-21swapper/110:45:261
179950,0migration/17494-21kthreadcore08:47:141
179950,0migration/131665-21unixbench-2d09:42:161
179950,0migration/129968-21latency11:37:111
179950,0migration/128382-21kthreadcore07:02:091
179950,0migration/12720-21fschecks_time07:57:061
179950,0migration/110131-21kthreadcore07:37:071
179950,0migration/110037-21switchtime10:27:151
169950,0watchdog/127914-21memory08:37:121
169950,0watchdog/10-21swapper/111:12:071
149950,0migration/09898-21taskset10:09:060
149950,0migration/07557-21ntp_kernel_pll_12:02:110
149950,0migration/06739-21taskset11:06:570
149950,0migration/05360-21kthreadcore07:07:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional