You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-28 - 15:01

x86 Intel Core i3-2310E @2100 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of system in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot2.osadl.org (updated Tue Mar 28, 2023 12:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
363899113105,7cyclictest0-21swapper/107:11:571
216321070,1sleep02145-21ssh10:47:150
3037210646,45sleep20-21swapper/207:07:392
3037210646,45sleep20-21swapper/207:07:392
25152990,1sleep30-21swapper/308:22:063
329929248,32sleep10-21swapper/107:11:031
329929248,32sleep10-21swapper/107:11:031
312229249,32sleep30-21swapper/307:08:443
312229249,32sleep30-21swapper/307:08:443
321129146,34sleep00-21swapper/007:09:540
321129146,34sleep00-21swapper/007:09:540
180342850,0sleep30-21swapper/310:03:223
3638995848,9cyclictest0-21swapper/107:27:081
3639995654,1cyclictest0-21swapper/207:11:572
3640995552,1cyclictest0-21swapper/307:11:573
3637995452,1cyclictest0-21swapper/007:11:570
72262300,0sleep00-21swapper/010:52:080
26792270,0sleep20-21swapper/209:50:102
255982260,1sleep30-21swapper/311:08:233
364099235,1cyclictest30093-21diskstats11:42:053
364099233,2cyclictest11009-21sed08:41:493
364099231,11cyclictest20993-21timerandwakeup12:02:133
102492230,0sleep20-21swapper/211:23:532
364099221,1cyclictest0-21swapper/310:32:053
364099221,11cyclictest14056-21ntpq11:27:113
364099220,12cyclictest32043-21grep12:12:173
364099216,13cyclictest4108-21cat09:22:093
364099212,6cyclictest7408-21memory07:17:073
364099212,1cyclictest21824-21perf09:06:493
364099211,18cyclictest23150-21seq07:52:133
364099208,10cyclictest16964-21apt-get11:01:493
364099204,6cyclictest0-21swapper/312:01:493
364099202,1cyclictest7322-21aten2_r8power_c11:22:013
364099202,1cyclictest22231-21ntp_states10:07:113
364099201,3cyclictest4166-21sh12:17:033
364099201,2cyclictest5223-21/usr/sbin/munin09:52:073
364099201,1cyclictest26937-21grep12:37:133
364099201,1cyclictest0-21swapper/311:33:153
364099200,8cyclictest31800-21grep09:47:053
3638992012,3cyclictest2786-21memory11:17:171
364099198,9cyclictest14869-21apt-get07:36:513
364099192,7cyclictest9734-21sensors11:52:133
364099192,2cyclictest18521-21ntp_states07:42:093
364099191,5cyclictest15718-21cstates08:52:033
364099191,17cyclictest0-21swapper/312:27:113
364099190,1cyclictest6144-21uptime08:27:153
364099188,9cyclictest0-21swapper/310:37:133
364099188,9cyclictest0-21swapper/308:31:493
364099186,9cyclictest0-21swapper/309:37:113
364099186,11cyclictest0-21swapper/312:22:153
364099185,12cyclictest0-21swapper/311:47:113
364099184,12cyclictest7635-21ssh10:23:213
364099184,12cyclictest7635-21ssh10:23:213
364099183,1cyclictest10931-21irqstats09:57:153
364099182,6cyclictest27610-21users08:02:153
364099182,6cyclictest24340-21df07:57:093
364099181,9cyclictest0-21swapper/311:40:453
364099181,1cyclictest0-21swapper/310:27:153
364099180,9cyclictest16688-21ssh11:01:293
364099180,5cyclictest22063-21apt-get09:07:033
364099180,5cyclictest18161-21ssh09:35:053
364099180,5cyclictest0-21swapper/308:11:493
364099180,5cyclictest0-21swapper/307:22:113
364099180,17cyclictest0-21swapper/309:42:113
364099178,8cyclictest0-21swapper/309:30:273
364099177,9cyclictest23977-21diskmemload10:17:213
364099176,9cyclictest13263-21apt-get08:47:013
364099176,9cyclictest13263-21apt-get08:47:013
364099175,9cyclictest30499-21ssh11:12:353
364099175,11cyclictest4953-21ssh10:50:393
364099175,11cyclictest0-21swapper/310:46:233
364099174,12cyclictest0-21swapper/308:57:053
364099172,2cyclictest3926-21ssh11:18:013
364099172,11cyclictest0-21swapper/310:15:233
364099170,5cyclictest21448-21irqstats12:32:093
364099170,10cyclictest0-21swapper/309:12:113
364099168,7cyclictest0-21swapper/309:20:233
364099165,9cyclictest7136-21/usr/sbin/munin10:52:073
364099164,11cyclictest0-21swapper/312:09:453
364099161,1cyclictest0-21swapper/308:07:033
364099153,11cyclictest0-21swapper/307:46:533
364099151,1cyclictest0-21swapper/308:17:053
364099150,5cyclictest0-21swapper/308:46:493
363999155,2cyclictest241832sh10:37:592
363899150,14cyclictest0-21swapper/110:27:021
364099140,13cyclictest0-21swapper/307:27:013
363899145,4cyclictest0-21swapper/108:46:541
363899145,4cyclictest0-21swapper/108:46:541
363899140,9cyclictest564-21runrttasks08:10:261
363999138,4cyclictest31360-21cron12:41:482
363999131,5cyclictest21700-21awk12:32:122
363899138,3cyclictest27171-21sed10:12:051
363899137,4cyclictest25549-21ntpq09:12:111
363899135,3cyclictest0-21swapper/112:12:101
363899134,4cyclictest11985-21ssh09:57:441
363899134,4cyclictest0-21swapper/109:39:381
363899134,4cyclictest0-21swapper/109:19:161
363899134,4cyclictest0-21swapper/107:32:511
363899132,8cyclictest18724-21ssh12:29:591
363899131,10cyclictest31377-21basename12:41:481
363799136,1cyclictest12-21ksoftirqd/011:30:490
3637991310,2cyclictest19130-21idleruntime-cro12:01:490
364099120,11cyclictest0-21swapper/307:35:593
363999128,2cyclictest29880-21head11:12:162
363999127,3cyclictest22652-21cron11:06:482
363999123,7cyclictest31134-21fschecks_count12:12:102
363999123,2cyclictest0-21swapper/209:29:102
363999121,10cyclictest0-21swapper/208:57:182
363899127,3cyclictest9551-21grep09:56:491
363899126,4cyclictest7305-21uniq08:32:051
363899126,4cyclictest27103-21cron10:46:441
363899125,5cyclictest28593-21apt-get11:12:041
363899125,4cyclictest0-21swapper/107:58:551
363899124,5cyclictest0-21swapper/111:49:061
363799129,2cyclictest6049-21uptime09:52:150
363799125,5cyclictest8761-21df_inode11:52:040
363999119,1cyclictest0-21swapper/209:35:482
363999113,6cyclictest0-21swapper/210:32:152
363999113,6cyclictest0-21swapper/209:02:412
363999113,2cyclictest0-21swapper/210:19:462
363999111,8cyclictest19788-21wc11:32:132
363999111,8cyclictest10561-21munin-run07:26:492
363999111,3cyclictest26157-21perf10:11:492
363999110,9cyclictest7916-21latency_hist11:51:492
363999110,9cyclictest132472sleep209:59:252
363999110,5cyclictest30210-21latency_hist12:11:492
363999110,5cyclictest13996-21/usr/sbin/munin11:57:082
363899117,2cyclictest5996-21ssh09:23:431
363899116,3cyclictest533-21in:imuxsock10:24:531
363899116,3cyclictest533-21in:imuxsock10:24:531
363899115,4cyclictest18476-21cut07:42:081
363899114,6cyclictest0-21swapper/111:31:361
363899114,5cyclictest19386-21ssh11:02:291
363899114,5cyclictest11162-21sh11:53:491
363899114,5cyclictest10668-21wc12:22:121
363899113,3cyclictest0-21swapper/108:53:451
363899113,3cyclictest0-21swapper/108:17:071
363899112,4cyclictest0-21swapper/111:34:571
363899112,4cyclictest0-21swapper/107:48:521
363899111,5cyclictest0-21swapper/111:40:571
363899110,10cyclictest0-21swapper/112:00:031
363799117,3cyclictest30206-21grep09:17:050
363799117,3cyclictest26005-21sed09:12:140
363799116,4cyclictest26133-21aten2_r8power_e08:02:030
363799116,4cyclictest19711-21awk11:32:120
363799116,3cyclictest8927-21aten2_r8power_v09:27:110
363799115,4cyclictest14997-21tr12:27:020
363799113,7cyclictest15127-21lockfile-create10:01:490
363799113,1cyclictest141rcu_preempt12:22:020
363799111,9cyclictest29799-21ntp_states11:12:150
363799111,8cyclictest21872-21aten2_r8power_v07:52:030
363799111,2cyclictest141rcu_preempt12:18:090
363799110,10cyclictest32420-21df10:17:030
223282110,2sleep022330-21grep09:07:070
91242100,2sleep1211rcuc/108:37:031
363999108,1cyclictest0-21swapper/210:25:282
363999108,1cyclictest0-21swapper/210:25:282
363999108,1cyclictest0-21swapper/208:02:282
363999107,2cyclictest31025-21fschecks_count08:12:052
363999107,2cyclictest20508-21ssh12:02:082
363999107,2cyclictest15499-21cpuspeed_turbos07:37:042
363999106,3cyclictest17242-21sh12:28:022
363999106,3cyclictest15000-21cut07:36:492
363999106,3cyclictest14297-21head08:47:092
363999106,3cyclictest14297-21head08:47:092
363999106,2cyclictest29575-21sh11:41:592
363999106,2cyclictest20247-21idleruntime07:47:052
363999105,4cyclictest0-21swapper/210:27:152
363999103,6cyclictest0-21swapper/210:12:042
363999103,6cyclictest0-21swapper/209:54:542
363999103,2cyclictest0-21swapper/209:45:342
363999102,3cyclictest28-21ksoftirqd/208:42:132
363999101,8cyclictest0-21swapper/209:07:482
363999101,7cyclictest27500-21ssh10:42:002
363999101,7cyclictest21970-21cpuspeed_turbos07:52:032
363999101,7cyclictest15542-21aten2_r8power_v08:52:032
363999101,7cyclictest0-21swapper/211:06:552
363999101,7cyclictest0-21swapper/209:20:322
363999101,5cyclictest23977-21diskmemload11:37:232
363999101,4cyclictest4764-21kworker/u8:210:52:042
363999101,3cyclictest12323-21df_inode10:57:112
363999101,2cyclictest0-21swapper/210:47:052
363999100,9cyclictest0-21swapper/209:40:182
363999100,8cyclictest8753-21ssh11:52:042
363999100,8cyclictest7040-21grep08:32:032
363999100,5cyclictest29560-21idleruntime-cro09:16:492
363999100,5cyclictest20621-21ssh10:06:482
363999100,4cyclictest3681-21/usr/sbin/munin12:17:062
363999100,4cyclictest10806-21python12:22:132
363899107,2cyclictest2313-21grep10:47:161
363899106,3cyclictest9036-21sh10:53:431
363899106,3cyclictest23977-21diskmemload10:58:281
363899106,2cyclictest23977-21diskmemload11:25:231
363899105,4cyclictest16851-21rt-features10:02:131
363899105,4cyclictest14649-21tr09:32:091
363899105,3cyclictest564-21runrttasks10:08:121
363899105,3cyclictest25670-21cut09:42:041
363899105,3cyclictest25607-21fschecks_time12:07:061
363899105,3cyclictest23233-21grep07:52:141
363899105,3cyclictest16729-21cat10:32:071
363899105,3cyclictest11726-21sed08:42:051
363899105,3cyclictest0-21swapper/109:01:091
363899105,3cyclictest0-21swapper/107:17:361
363899104,4cyclictest9453-21head09:27:151
363899104,4cyclictest9232-21grep07:22:091
363899104,4cyclictest3953-21expr12:17:021
363899104,4cyclictest30903-21pmu-power11:42:131
363899104,4cyclictest27234-21pmu-power08:02:121
363899104,4cyclictest24360-21pmu-power11:07:171
363899104,4cyclictest231-21systemd-journal08:16:491
363899104,4cyclictest20991-21wc12:02:131
363899103,5cyclictest21815-21ls09:06:491
363899103,5cyclictest0-21swapper/109:06:521
363899102,3cyclictest0-21swapper/112:36:471
363899100,9cyclictest0-21swapper/109:47:331
363899100,8cyclictest22204-21grep10:37:031
363799108,1cyclictest0-21swapper/010:25:330
363799108,1cyclictest0-21swapper/010:25:330
363799108,1cyclictest0-21swapper/008:32:330
363799107,2cyclictest23977-21diskmemload12:32:510
363799107,2cyclictest23977-21diskmemload11:43:190
363799107,2cyclictest23977-21diskmemload11:08:080
363799107,2cyclictest23977-21diskmemload10:57:470
363799107,2cyclictest23977-21diskmemload10:35:040
363799107,2cyclictest23977-21diskmemload10:02:020
363799107,2cyclictest23977-21diskmemload09:40:520
363799107,2cyclictest18340-21sh09:35:190
363799107,2cyclictest14088-21interrupts08:47:080
363799107,2cyclictest14088-21interrupts08:47:080
363799106,3cyclictest7719-21sh11:51:340
363799106,3cyclictest30994-21sh10:44:360
363799106,3cyclictest24597-21fschecks_time11:37:050
363799105,4cyclictest26996-21idleruntime12:37:140
363799105,4cyclictest19222-21awk11:02:200
363799105,4cyclictest18366-21tail08:57:110
363799105,3cyclictest23010-21missed_timers10:37:110
363799105,3cyclictest11732-21grep08:42:050
363799104,5cyclictest24410-21tune2fs07:57:110
363799104,4cyclictest19694-21cpu12:02:010
363799103,5cyclictest18513-21ntpq07:42:090
363799101,8cyclictest3924-21grep09:22:080
363799101,7cyclictest13514-21grep07:32:040
363799100,9cyclictest0-21swapper/008:39:330
363799100,2cyclictest0-21swapper/011:18:450
36399995,3cyclictest2306-21tune2fs11:17:132
36399995,2cyclictest6542-21aten2_r8power_p07:17:012
36399995,2cyclictest25067-21head07:57:182
36399995,2cyclictest13422-21fschecks_time11:27:042
36399994,4cyclictest586-21snmpd08:21:562
36399994,4cyclictest586-21snmpd08:07:402
36399994,4cyclictest4888-21tr08:27:032
36399994,4cyclictest10858-21cut07:27:022
36399991,7cyclictest0-21swapper/208:17:022
36399991,6cyclictest8912-21/usr/sbin/munin08:37:052
36399991,6cyclictest0-21swapper/209:21:552
36399990,4cyclictest17421-21/usr/sbin/munin07:42:022
36389996,2cyclictest2937-21fschecks_count08:22:141
36389995,2cyclictest564-21runrttasks08:26:591
36389993,4cyclictest586-21snmpd10:16:571
36389993,4cyclictest15167-21apt-config07:36:501
36379998,1cyclictest0-21swapper/008:10:130
36379996,2cyclictest8629-21/usr/sbin/munin07:22:160
36379996,2cyclictest7204-21if_enp4s007:17:050
36379996,2cyclictest588-21sshd12:06:590
36379996,2cyclictest30558-21sh12:12:000
36379996,2cyclictest27293-21if_enp3s010:12:060
36379996,2cyclictest21539-21fschecks_count10:07:050
36379996,2cyclictest15702-21entropy07:37:060
36379996,2cyclictest15457-21aten2_r8power_e08:52:020
36379996,2cyclictest10998-21cpuspeed_turbos07:27:020
36379996,2cyclictest10713-21/usr/sbin/munin10:27:010
36379995,3cyclictest25515-21sh09:41:590
36379995,2cyclictest7975-21cut11:22:070
36379995,2cyclictest2902-21entropy08:22:130
36379994,4cyclictest5904-21systemctl08:27:130
36379994,4cyclictest31210-21cut09:47:020
36379994,3cyclictest20945-21/usr/sbin/munin09:02:100
36379993,4cyclictest586-21snmpd08:14:290
36379991,7cyclictest842-21grep08:17:060
36379990,4cyclictest20015-21cstates07:47:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional