You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-14 - 20:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Core i3-2310E @2100 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of shadow in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack8slot2s.osadl.org (updated Sun Aug 14, 2022 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
844299131129,1cyclictest0-21swapper/207:18:372
8152210745,31sleep20-21swapper/207:15:172
1918621060,3sleep228-21ksoftirqd/211:30:542
7991210445,30sleep30-21swapper/307:13:133
8043210244,47sleep00-21swapper/007:13:500
68602990,1sleep30-21swapper/312:18:503
217532960,0sleep30-21swapper/309:35:143
656528845,31sleep10-21swapper/107:10:461
8443997068,1cyclictest0-21swapper/307:15:303
8441995345,7cyclictest0-21swapper/107:15:301
8440993531,3cyclictest6438-21ssh12:18:140
44562350,1sleep10-21swapper/109:48:231
8440993226,4cyclictest21653-21ssh09:35:060
154032310,0sleep30-21swapper/309:58:193
77662300,1sleep20-21swapper/209:21:062
275132300,3sleep334-21ksoftirqd/310:09:463
844099270,1cyclictest0-21swapper/010:30:300
159012270,1sleep20-21swapper/210:59:032
9202260,1sleep30-21swapper/312:42:113
12892260,0sleep20-21swapper/208:05:542
99442250,1sleep20-21swapper/212:21:012
8440992519,2cyclictest600-21ssh12:12:480
8440992418,1cyclictest12396-21kworker/0:010:10:240
8440992416,3cyclictest26523-21ssh10:37:060
844099241,21cyclictest0-21swapper/012:30:420
844299230,22cyclictest0-21swapper/212:30:422
8441992321,1cyclictest141rcu_preempt09:20:461
8441992317,1cyclictest141rcu_preempt11:15:471
844399220,1cyclictest0-21swapper/309:20:473
844199220,21cyclictest0-21swapper/109:05:441
79512220,1sleep20-21swapper/209:51:002
844299210,1cyclictest0-21swapper/209:15:442
844099216,9cyclictest13587-21sh12:25:290
205942200,1sleep00-21swapper/011:02:540
844399199,6cyclictest34-21ksoftirqd/309:53:273
844399198,6cyclictest34-21ksoftirqd/309:43:453
844399197,8cyclictest34-21ksoftirqd/312:23:113
844399197,5cyclictest34-21ksoftirqd/310:30:273
844299191,16cyclictest22990-21apt10:05:502
844099199,6cyclictest27717-21ssh11:10:040
844399189,6cyclictest34-21ksoftirqd/311:40:263
844399189,6cyclictest34-21ksoftirqd/310:03:453
844399189,6cyclictest34-21ksoftirqd/308:45:533
844399189,6cyclictest34-21ksoftirqd/308:45:533
844399189,2cyclictest34-21ksoftirqd/312:28:163
844399188,6cyclictest34-21ksoftirqd/311:32:553
844399188,6cyclictest34-21ksoftirqd/311:07:083
844399188,6cyclictest34-21ksoftirqd/310:47:303
844399188,6cyclictest34-21ksoftirqd/310:43:183
844399188,6cyclictest34-21ksoftirqd/310:33:443
8443991810,5cyclictest34-21ksoftirqd/312:06:093
844399179,5cyclictest34-21ksoftirqd/312:38:493
844399179,5cyclictest34-21ksoftirqd/311:23:353
844399179,2cyclictest34-21ksoftirqd/312:12:583
844399179,2cyclictest34-21ksoftirqd/309:45:473
844399178,6cyclictest34-21ksoftirqd/312:31:303
844399178,6cyclictest34-21ksoftirqd/312:00:593
844399178,6cyclictest34-21ksoftirqd/311:17:103
844399178,6cyclictest34-21ksoftirqd/310:39:433
844399178,6cyclictest34-21ksoftirqd/309:36:313
844399178,6cyclictest34-21ksoftirqd/309:18:113
844399177,6cyclictest34-21ksoftirqd/311:01:573
844399177,6cyclictest34-21ksoftirqd/310:10:303
844399177,6cyclictest34-21ksoftirqd/310:10:303
844399177,3cyclictest34-21ksoftirqd/311:56:213
844399168,5cyclictest34-21ksoftirqd/311:45:393
844399168,5cyclictest34-21ksoftirqd/311:25:323
844399168,5cyclictest34-21ksoftirqd/310:15:493
844399168,2cyclictest34-21ksoftirqd/310:24:103
844399167,6cyclictest34-21ksoftirqd/310:57:563
844399167,6cyclictest34-21ksoftirqd/307:21:253
844399167,5cyclictest34-21ksoftirqd/311:44:133
844399167,5cyclictest34-21ksoftirqd/309:27:183
844399167,5cyclictest34-21ksoftirqd/308:15:523
844399167,5cyclictest34-21ksoftirqd/307:30:573
844399166,6cyclictest34-21ksoftirqd/310:51:513
844399166,6cyclictest34-21ksoftirqd/308:21:503
844399166,6cyclictest34-21ksoftirqd/308:15:243
844399165,7cyclictest34-21ksoftirqd/311:53:523
114752160,0chrt0-21swapper/111:24:321
844399156,6cyclictest34-21ksoftirqd/308:37:263
844399155,6cyclictest34-21ksoftirqd/308:32:413
844199151,8cyclictest141rcu_preempt11:10:521
844099152,9cyclictest0-21swapper/010:25:490
844099150,11cyclictest22718-21taskset07:45:000
844399146,5cyclictest34-21ksoftirqd/308:01:013
844399146,2cyclictest34-21ksoftirqd/311:10:423
844399146,2cyclictest34-21ksoftirqd/309:13:123
844399145,5cyclictest34-21ksoftirqd/309:06:273
844399144,6cyclictest34-21ksoftirqd/307:54:283
844399144,5cyclictest41650irq/33-enp3s0-r07:45:053
844399143,6cyclictest34-21ksoftirqd/308:56:573
844399143,5cyclictest34-21ksoftirqd/309:00:463
844299144,5cyclictest0-21swapper/210:45:492
844299144,5cyclictest0-21swapper/210:16:492
844299140,9cyclictest0-21swapper/208:15:462
844199144,5cyclictest0-21swapper/110:15:561
844099145,4cyclictest0-21swapper/008:34:010
844099142,9cyclictest14906-21irqstats12:25:500
844099140,7cyclictest16480-21munin-run09:30:280
844399135,5cyclictest34-21ksoftirqd/307:46:183
844399134,6cyclictest34-21ksoftirqd/308:29:593
844399133,7cyclictest34-21ksoftirqd/308:07:513
844399132,3cyclictest34-21ksoftirqd/308:51:023
844399130,1cyclictest0-21swapper/307:55:413
844299139,3cyclictest32221-21diskmemload09:56:162
844299133,5cyclictest29853-21which11:10:572
844299132,6cyclictest0-21swapper/208:04:152
844299130,11cyclictest20775-21ssh10:03:062
844199135,7cyclictest0-21swapper/110:30:251
844199135,3cyclictest0-21swapper/108:55:411
844199133,5cyclictest0-21swapper/112:09:561
844199133,5cyclictest0-21swapper/110:44:141
844199131,7cyclictest19935-21ssh11:01:591
844199131,7cyclictest141rcu_preempt11:55:441
844199131,3cyclictest221ksoftirqd/108:50:531
844099136,6cyclictest6884-21/usr/sbin/munin08:20:440
844099134,8cyclictest0-21swapper/011:47:580
844099134,8cyclictest0-21swapper/010:11:240
844099134,8cyclictest0-21swapper/010:11:240
844099134,8cyclictest0-21swapper/009:51:340
844099134,8cyclictest0-21swapper/009:40:280
844099134,8cyclictest0-21swapper/007:16:100
844099134,4cyclictest0-21swapper/008:47:370
844099134,4cyclictest0-21swapper/008:47:370
844099133,5cyclictest32009-21apt-get08:05:300
75082130,0sleep10-21swapper/110:20:501
844399122,6cyclictest0-21swapper/307:25:503
844299127,4cyclictest521-21dbus-daemon10:11:052
844299127,4cyclictest521-21dbus-daemon10:11:052
844299124,5cyclictest32221-21diskmemload12:35:512
844299124,5cyclictest28812-21awk07:55:512
844299123,8cyclictest0-21swapper/210:35:322
844299122,5cyclictest0-21swapper/212:00:372
844299121,6cyclictest21792-21awk07:40:502
844199127,4cyclictest0-21swapper/110:55:291
844199127,3cyclictest30227-21grep12:10:501
844199124,7cyclictest0-21swapper/111:05:501
844199124,7cyclictest0-21swapper/109:32:091
844199124,6cyclictest11452-21ssh11:53:341
844199123,4cyclictest0-21swapper/109:02:411
844199122,3cyclictest0-21swapper/112:40:231
844199121,8cyclictest3754-21snmpd11:25:451
844199121,7cyclictest0-21swapper/112:03:261
844199121,7cyclictest0-21swapper/109:25:321
844199120,7cyclictest0-21swapper/112:40:431
844099127,3cyclictest1485-21head09:15:530
844099127,2cyclictest17238-21/usr/sbin/munin08:41:040
844099126,2cyclictest25314-21cpuspeed_turbos12:35:480
844099125,5cyclictest229-21systemd-journal08:12:430
844099125,5cyclictest0-21swapper/011:33:540
844099124,5cyclictest0-21swapper/012:05:480
844099124,5cyclictest0-21swapper/011:56:580
844099124,5cyclictest0-21swapper/011:28:500
844099124,5cyclictest0-21swapper/011:16:560
844099123,5cyclictest0-21swapper/012:01:120
844099122,5cyclictest18167-21munin-run07:35:290
844099121,6cyclictest8311-21open_inodes11:20:560
844099121,6cyclictest0-21swapper/008:55:460
844099120,7cyclictest8136-21df11:50:440
844399117,2cyclictest17785-21unixbench_singl08:41:093
844399114,5cyclictest18462-21cut07:35:443
844299116,4cyclictest229-21systemd-journal11:58:212
844299116,3cyclictest5371-21sh12:16:452
844299116,3cyclictest32221-21diskmemload10:25:522
844299116,3cyclictest2588-21idleruntime-cro12:15:292
844299115,5cyclictest5410-21ssh11:47:552
844299115,5cyclictest2093-21latency_hist10:45:292
844299115,4cyclictest23257-21tr07:45:442
844299115,4cyclictest20092-21grep10:30:572
844299115,4cyclictest18846-21df07:35:462
844299115,4cyclictest13271-21grep11:25:492
844299114,5cyclictest521-21dbus-daemon07:50:552
844299114,5cyclictest0-21swapper/209:01:172
844299113,6cyclictest32221-21diskmemload11:55:252
844299113,5cyclictest0-21swapper/210:52:322
844299112,8cyclictest0-21swapper/209:11:022
844299112,4cyclictest0-21swapper/209:30:532
844299111,8cyclictest9837-21grep08:25:472
844199115,5cyclictest0-21swapper/112:28:171
844199115,5cyclictest0-21swapper/110:51:201
844199115,5cyclictest0-21swapper/108:06:271
844199114,5cyclictest6349-21/usr/sbin/munin09:51:031
844199114,5cyclictest13772-21grep08:35:291
844199114,5cyclictest0-21swapper/108:23:311
844199113,4cyclictest12585-21ntp_states07:20:531
844199113,3cyclictest25204-21ls11:36:061
844199113,2cyclictest0-21swapper/112:20:331
844199112,7cyclictest18700-21tr07:35:451
844199112,6cyclictest24448-21/usr/sbin/munin10:35:531
844199112,4cyclictest0-21swapper/111:49:491
844199112,4cyclictest0-21swapper/108:28:011
844199112,3cyclictest22-21ksoftirqd/107:35:291
844199111,8cyclictest18136-21ssh11:30:461
844199111,6cyclictest41750irq/34-enp3s0-t10:02:021
844199110,7cyclictest141rcu_preempt10:45:361
844199110,5cyclictest26415-21ssh09:39:061
844199110,5cyclictest22047-21ssh10:33:331
844099117,2cyclictest23808-21cpuspeed_turbos11:35:520
844099115,5cyclictest0-21swapper/009:57:200
844099115,5cyclictest0-21swapper/008:27:340
844099115,5cyclictest0-21swapper/007:39:200
844099115,4cyclictest13700-21cat07:25:290
844099114,5cyclictest311-21ssh10:43:120
844099114,5cyclictest2410-21apt-get10:45:440
844099114,5cyclictest12140-21ssh10:25:220
844099114,5cyclictest0-21swapper/011:40:480
844099114,5cyclictest0-21swapper/011:11:420
844099114,5cyclictest0-21swapper/009:20:340
844099113,5cyclictest0-21swapper/010:57:480
844099112,8cyclictest0-21swapper/010:00:520
844099112,8cyclictest0-21swapper/009:40:480
844099112,4cyclictest0-21swapper/009:05:490
844099111,6cyclictest0-21swapper/007:51:540
844099110,4cyclictest22836-21idleruntime-cro08:55:290
844099110,2cyclictest1166-21ssh12:42:310
327302110,1sleep20-21swapper/211:43:332
844299106,2cyclictest16141-21acpi08:40:502
844299105,4cyclictest23492-21uniq11:05:522
844299105,4cyclictest0-21swapper/211:38:312
844299104,5cyclictest0-21swapper/212:05:562
844299104,4cyclictest2233-21which11:15:512
844299104,4cyclictest17571-21cpuspeed_turbos11:00:442
844299104,4cyclictest0-21swapper/209:28:572
844299104,2cyclictest32636-21sh12:41:122
844299103,5cyclictest18186-21basename07:35:292
844299103,5cyclictest0-21swapper/211:21:182
844299103,5cyclictest0-21swapper/209:46:302
844299103,5cyclictest0-21swapper/208:35:432
844299102,3cyclictest30888-21ssh09:42:422
844299101,8cyclictest0-21swapper/207:21:472
844299100,2cyclictest10136-21ssh10:22:362
844199106,3cyclictest29736-21cut11:40:521
844199105,4cyclictest31252-21ntpq09:10:531
844199105,4cyclictest0-21swapper/108:18:161
844199104,5cyclictest0-21swapper/107:47:001
844199104,4cyclictest25935-21head07:50:481
844199104,4cyclictest229-21systemd-journal08:50:291
844199104,4cyclictest229-21systemd-journal08:50:291
844199103,5cyclictest0-21swapper/109:40:471
844199103,2cyclictest0-21swapper/109:55:571
844199101,7cyclictest19429-21ssh12:30:421
844199101,5cyclictest4962-21ssh12:16:101
844199101,4cyclictest0-21swapper/110:06:071
844199101,3cyclictest15632-21sshd07:27:421
844199101,2cyclictest141rcu_preempt10:10:521
844199101,2cyclictest141rcu_preempt10:10:521
844199100,4cyclictest32749-21/usr/sbin/munin09:15:481
844099106,2cyclictest30434-21grep09:10:450
844099104,5cyclictest0-21swapper/010:50:300
844099104,5cyclictest0-21swapper/010:15:420
844099104,5cyclictest0-21swapper/009:45:300
844099104,5cyclictest0-21swapper/008:35:300
844099104,5cyclictest0-21swapper/008:00:300
844099104,5cyclictest0-21swapper/007:55:420
844099104,4cyclictest25946-21grep09:00:490
844099103,5cyclictest24081-21grep07:45:510
844099102,3cyclictest0-21swapper/008:15:460
844099101,1cyclictest0-21swapper/007:26:500
84429995,2cyclictest11748-21grep08:30:442
84429994,3cyclictest23630-21grep08:55:452
84429994,3cyclictest18543-21sshd08:45:432
84429994,3cyclictest18543-21sshd08:45:432
84429994,3cyclictest14268-21uniq07:25:482
84429993,5cyclictest0-21swapper/209:35:482
84429993,4cyclictest3754-21snmpd08:21:192
84429993,4cyclictest13922-21rm12:25:402
84429992,5cyclictest0-21swapper/208:10:522
84419996,2cyclictest14539-21if_eno108:35:531
84419995,2cyclictest28654-21missed_timers07:55:491
84419993,4cyclictest3901-21grep08:11:001
84419993,4cyclictest0-21swapper/108:00:491
84419991,7cyclictest0-21swapper/108:41:011
84419991,2cyclictest20696-21/usr/sbin/munin07:40:431
84429984,3cyclictest21066-21/usr/sbin/munin08:50:502
84429983,4cyclictest28571-21if_enp3s009:05:492
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional