You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-11-27 - 07:39

x86 Intel Core i3-2310E @2100 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of system in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot2.osadl.org (updated Sun Nov 27, 2022 00:43:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28388991520,143cyclictest0-21swapper/119:10:321
26044210943,31sleep20-21swapper/219:05:372
283889910393,9cyclictest7738-21apt-get20:50:401
2765429148,32sleep00-21swapper/019:06:310
2761529148,32sleep10-21swapper/119:06:001
2774328946,32sleep30-21swapper/319:07:393
28390998682,1cyclictest0-21swapper/319:10:323
10142860,0sleep30-21swapper/321:25:293
10142860,0sleep30-21swapper/321:25:293
168332820,0sleep00-21swapper/000:35:280
28389996662,3cyclictest0-21swapper/219:10:322
248382610,0sleep20-21swapper/220:15:302
28387994945,3cyclictest0-21swapper/019:10:320
28390993129,1cyclictest0-21swapper/320:50:403
151862300,1sleep20-21swapper/222:35:422
135712300,0sleep30-21swapper/321:00:563
28388992819,6cyclictest29036-21users23:15:531
301572270,0sleep30-21swapper/321:21:323
112252270,0sleep30-21swapper/322:02:453
207422260,1sleep30-21swapper/300:06:333
73372250,0sleep30-21swapper/323:25:493
28387992220,1cyclictest0-21swapper/020:20:410
308212210,0sleep00-21swapper/023:18:090
112542200,0sleep00-21swapper/021:34:320
2838899195,3cyclictest0-21swapper/121:37:101
226932190,1sleep10-21swapper/122:41:341
2838899174,4cyclictest586-21snmpd22:15:591
2838899173,4cyclictest5713-21if_err_enp4s022:55:461
2838899171,6cyclictest12600-21sort21:00:471
2838899171,5cyclictest17293-21sh21:10:451
2838899166,2cyclictest16146-21diskmemload23:38:391
2838899166,2cyclictest16146-21diskmemload23:10:491
2838899165,3cyclictest24395-21gltestperf21:45:521
2838899165,2cyclictest16146-21diskmemload23:20:441
2838899165,2cyclictest0-21swapper/119:55:511
2838899164,4cyclictest586-21snmpd22:54:221
2838899164,3cyclictest5638-21expr19:30:451
2838899164,3cyclictest1814-21head20:35:441
2838899164,3cyclictest0-21swapper/121:25:581
2838899164,3cyclictest0-21swapper/121:25:581
2838899164,10cyclictest0-21swapper/122:11:231
2838899163,5cyclictest7834-21cat00:25:481
2838899162,5cyclictest18862-21sed20:00:471
2838899161,5cyclictest8565-21latency23:55:541
2838899161,5cyclictest3128-21ssh00:20:521
2838899161,5cyclictest28283-21munin-run23:45:281
2838899161,5cyclictest27641-21unixbench_singl22:45:541
2838899161,5cyclictest11232-21sed23:00:501
2838899161,4cyclictest726-21awk19:20:281
2838899161,4cyclictest16669-21awk00:35:281
2838899161,4cyclictest11403-21idleruntime-cro23:30:281
2838899160,6cyclictest14359-21apt-get22:35:281
2838899160,5cyclictest3978-21grep20:40:441
2839099156,3cyclictest34-21ksoftirqd/323:53:253
2839099154,2cyclictest141rcu_preempt22:30:483
2839099153,5cyclictest0-21swapper/321:58:163
2838899155,3cyclictest564-21runrttasks20:14:121
2838899154,3cyclictest5894-21cstates20:45:501
2838899154,3cyclictest3799-21cpuspeed_turbos22:25:411
2838899154,3cyclictest22-21ksoftirqd/120:05:551
2838899154,2cyclictest15424-21cut22:35:441
2838899153,5cyclictest6432-21kworker/u8:100:00:401
2838899153,4cyclictest19647-21latency00:05:541
2838899153,3cyclictest18528-21tr21:40:501
2838899153,3cyclictest0-21swapper/123:35:051
2838899152,4cyclictest3128-21fschecks_time21:55:521
2838899151,5cyclictest30752-21grep22:20:421
2838899151,4cyclictest3691-21gltestperf19:25:441
2838899151,2cyclictest0-21swapper/121:33:101
2838899151,2cyclictest0-21swapper/100:11:281
2838899150,7cyclictest30690-21unixbench_multi00:15:531
2838899150,7cyclictest17436-21cstates00:35:481
2838899150,6cyclictest14550-21cut19:50:451
2838899150,5cyclictest29692-21fschecks_count20:25:441
2838899150,5cyclictest29620-21grep21:50:491
2838899150,5cyclictest29576-21sed21:20:561
2838899150,5cyclictest29363-21grep23:45:511
2838899150,5cyclictest26788-21sendmail20:20:281
2838899150,5cyclictest23609-21proc_pri21:15:511
2838899150,5cyclictest16765-21fschecks_time23:05:471
2838899150,5cyclictest14447-21cpuspeed_turbos21:05:431
2838899150,5cyclictest11383-21grep20:55:521
2838899150,4cyclictest8227-21sh22:00:501
205032150,0sleep00-21swapper/022:40:410
2839099147,5cyclictest34-21ksoftirqd/321:20:163
2839099145,8cyclictest0-21swapper/300:34:023
2839099144,6cyclictest34-21ksoftirqd/322:48:063
2839099142,8cyclictest0-21swapper/321:10:463
2838999144,3cyclictest13674-21idleruntime-cro19:50:282
2838999144,3cyclictest13674-21idleruntime-cro19:50:282
2838999143,6cyclictest0-21swapper/221:11:072
2838999140,6cyclictest207252ssh00:06:312
2838899145,2cyclictest3764-21sh23:51:101
2838899144,3cyclictest16954-21sh22:07:551
2838899144,3cyclictest0-21swapper/119:44:551
2838899143,3cyclictest27359-21cstates20:20:441
2838899142,3cyclictest0-21swapper/120:30:441
2839099137,4cyclictest11071-21ps20:55:503
2839099134,8cyclictest0-21swapper/320:03:023
2839099134,5cyclictest0-21swapper/322:58:063
2839099131,7cyclictest20627-21ssh00:38:403
2839099131,2cyclictest141rcu_preempt22:16:143
2838999137,5cyclictest11757-21ntpq23:00:542
2838999135,6cyclictest0-21swapper/223:15:382
2838999135,6cyclictest0-21swapper/220:55:392
2838999135,6cyclictest0-21swapper/220:13:472
2838999135,4cyclictest0-21swapper/223:08:402
2838999135,3cyclictest0-21swapper/220:05:232
2838999134,4cyclictest0-21swapper/222:01:262
2838999134,4cyclictest0-21swapper/221:25:072
2838999134,4cyclictest0-21swapper/220:52:302
2838999134,4cyclictest0-21swapper/219:53:582
2838999132,6cyclictest16146-21diskmemload00:25:462
2838899130,5cyclictest7702-21grep19:35:411
2838799134,8cyclictest0-21swapper/019:52:520
2838799130,7cyclictest7509-21perf20:50:280
2838799130,1cyclictest0-21swapper/022:55:590
2839099127,4cyclictest0-21swapper/300:17:163
2839099126,4cyclictest29998-21head21:50:513
2839099125,5cyclictest0-21swapper/321:44:303
2839099125,5cyclictest0-21swapper/319:25:343
2839099125,5cyclictest0-21swapper/300:28:123
2839099125,4cyclictest0-21swapper/320:14:413
2839099125,1cyclictest34-21ksoftirqd/323:21:133
2839099124,6cyclictest18883-21ssh23:07:163
2839099124,5cyclictest0-21swapper/323:45:063
2839099124,5cyclictest0-21swapper/322:37:463
2839099124,5cyclictest0-21swapper/322:26:223
2839099124,5cyclictest0-21swapper/320:32:343
2839099124,5cyclictest0-21swapper/320:15:383
2839099124,5cyclictest0-21swapper/319:45:463
2839099124,5cyclictest0-21swapper/319:45:463
2839099124,2cyclictest14826-21ssh23:32:403
2839099123,8cyclictest0-21swapper/323:02:323
2839099123,8cyclictest0-21swapper/322:40:303
2839099123,5cyclictest0-21swapper/321:37:103
2839099123,2cyclictest16146-21diskmemload23:12:123
2839099122,5cyclictest0-21swapper/323:35:473
2839099122,5cyclictest0-21swapper/319:51:523
2839099121,9cyclictest697-21perf19:20:283
2839099121,6cyclictest32045-21diskmemload23:19:443
2839099121,2cyclictest0-21swapper/321:45:503
2838999126,5cyclictest6325-21awk19:30:512
2838999126,4cyclictest231-21systemd-journal21:45:552
2838999124,7cyclictest0-21swapper/223:52:422
2838999124,3cyclictest0-21swapper/220:05:322
2838999124,3cyclictest0-21swapper/200:34:192
2838999123,4cyclictest0-21swapper/219:57:282
2838999121,6cyclictest0-21swapper/221:18:162
2838999120,7cyclictest16146-21diskmemload22:31:392
2838899128,2cyclictest1597-21cut19:20:441
2838799127,3cyclictest16436-21cpuspeed_turbos23:05:450
2838799121,10cyclictest0-21swapper/023:59:280
2839099117,3cyclictest34-21ksoftirqd/320:00:283
2839099116,3cyclictest4466-21sh22:55:283
2839099116,3cyclictest2264-21tr20:35:483
2839099116,3cyclictest1593-21sh00:20:303
2839099115,5cyclictest0-21swapper/320:46:183
2839099115,5cyclictest0-21swapper/320:27:443
2839099115,5cyclictest0-21swapper/319:20:343
2839099115,5cyclictest0-21swapper/300:12:283
2839099114,5cyclictest18507-21ssh22:09:563
2839099114,5cyclictest16146-21diskmemload22:12:143
2839099114,5cyclictest0-21swapper/322:21:263
2839099114,5cyclictest0-21swapper/321:33:073
2839099114,5cyclictest0-21swapper/319:40:563
2839099112,8cyclictest0-21swapper/323:58:423
2839099111,9cyclictest0-21swapper/319:36:343
2839099111,5cyclictest27483-21df_inode20:20:443
2839099111,5cyclictest0-21swapper/321:07:463
2839099111,2cyclictest141rcu_preempt23:45:463
2838999117,2cyclictest30732-21rt-features21:50:592
2838999116,3cyclictest7383-21fschecks_count21:30:502
2838999116,3cyclictest564-21runrttasks22:23:442
2838999115,4cyclictest586-21snmpd23:31:142
2838999115,4cyclictest1-21systemd19:15:322
2838999114,6cyclictest0-21swapper/222:20:092
2838999114,6cyclictest0-21swapper/219:26:332
2838999114,5cyclictest626-21gdbus21:26:002
2838999114,5cyclictest626-21gdbus21:26:002
2838999114,5cyclictest31605-21cut20:30:452
2838999114,2cyclictest7532-21cat20:50:282
2838999113,3cyclictest0-21swapper/222:40:472
2838999113,3cyclictest0-21swapper/219:40:342
2838999113,3cyclictest0-21swapper/200:15:462
2838999112,4cyclictest0-21swapper/223:28:382
2838999112,4cyclictest0-21swapper/223:11:222
2838999112,4cyclictest0-21swapper/221:07:042
2838999112,4cyclictest0-21swapper/220:27:502
2838999111,9cyclictest24561-21idleruntime-cro22:15:272
2838999110,6cyclictest0-21swapper/200:39:582
2838899110,4cyclictest13574-21runrttasks19:49:231
2838899110,4cyclictest13574-21runrttasks19:49:231
2838799115,5cyclictest0-21swapper/000:06:150
2838799114,5cyclictest28258-21cron23:45:280
2838799114,5cyclictest28042-21cut21:20:440
2838799114,5cyclictest0-21swapper/000:36:250
2839099105,5cyclictest0-21swapper/300:01:363
2839099104,5cyclictest0-21swapper/320:40:383
2839099104,5cyclictest0-21swapper/319:30:383
2839099103,5cyclictest20563-21cpu20:05:443
2838999106,3cyclictest541-21/usr/sbin/munin23:20:472
2838999106,2cyclictest30680-21sh23:46:192
2838999106,2cyclictest1503-21cpuspeed_turbos20:35:422
2838999105,4cyclictest400-21ntpq22:50:502
2838999105,4cyclictest2385-21sed00:20:462
2838999105,4cyclictest16146-21diskmemload23:40:522
2838999105,3cyclictest14690-21mailstats00:01:052
2838999105,3cyclictest12261-21sh21:35:332
2838999105,3cyclictest0-21swapper/219:35:402
2838999104,4cyclictest9273-21awk23:56:012
2838999104,4cyclictest626-21gdbus20:20:522
2838999104,4cyclictest4703-21run-parts20:40:512
2838999104,4cyclictest26081-21cut22:45:422
2838999104,4cyclictest17971-21sh21:40:302
2838999103,5cyclictest626-21gdbus23:35:572
2838999103,5cyclictest586-21snmpd22:56:342
2838999103,5cyclictest0-21swapper/200:11:272
2838999102,3cyclictest0-21swapper/221:02:122
2838999102,3cyclictest0-21swapper/219:24:392
2838999100,9cyclictest0-21swapper/222:25:422
2838999100,1cyclictest0-21swapper/221:55:562
2838799107,2cyclictest15958-21ssh22:06:380
2838799107,2cyclictest1016-21sh21:25:290
2838799107,2cyclictest1016-21sh21:25:290
2838799106,3cyclictest21928-21latency_hist21:15:280
2838799106,3cyclictest18758-21uniq20:00:460
2838799106,3cyclictest1829-21grep20:35:440
2838799106,2cyclictest23930-21sh00:10:390
2838799105,4cyclictest231-21systemd-journal22:20:280
2838799105,4cyclictest18811-21readlink23:35:570
2838799105,4cyclictest16993-21basename23:35:280
2838799105,4cyclictest0-21swapper/023:20:460
2838799104,5cyclictest0-21swapper/023:45:450
2838799104,5cyclictest0-21swapper/022:48:580
2838799104,5cyclictest0-21swapper/022:00:440
2838799104,5cyclictest0-21swapper/020:30:470
2838799104,5cyclictest0-21swapper/020:07:470
2838799104,5cyclictest0-21swapper/019:56:010
2838799104,5cyclictest0-21swapper/019:27:240
2838799104,4cyclictest12413-21which19:45:440
2838799104,4cyclictest12413-21which19:45:440
2838799101,7cyclictest1969-21ssh23:50:480
2838799100,9cyclictest0-21swapper/021:36:280
2838799100,9cyclictest0-21swapper/020:55:480
2838799100,5cyclictest0-21swapper/021:41:560
174282100,0chrt28385-21cyclictest22:08:332
283879996,2cyclictest9743-21fschecks_time22:30:500
283879996,2cyclictest8023-21gltestperf19:35:430
283879996,2cyclictest4225-21if_err_enp4s020:40:460
283879996,2cyclictest4169-21fschecks_time22:25:430
283879996,2cyclictest30286-21kernelversion21:50:540
283879996,2cyclictest23657-21open_files20:10:490
283879996,2cyclictest22515-21cpu21:15:430
283879996,2cyclictest22407-21gltestperf23:10:460
283879995,3cyclictest564-21runrttasks22:25:080
283879995,2cyclictest29628-21grep00:15:440
283879995,2cyclictest1549-21grep19:20:440
283879995,2cyclictest11159-21fschecks_time23:00:490
283879994,4cyclictest9209-21unixbench_singl20:50:530
283879994,4cyclictest6672-21entropy23:25:440
283879994,4cyclictest586-21snmpd21:45:550
283879994,4cyclictest519-21dbus-daemon00:01:050
283879994,4cyclictest2036-21tr00:20:430
283879994,4cyclictest13224-21awk21:00:530
283879994,3cyclictest6593-21ssh00:25:280
283879994,3cyclictest19730-21ls22:10:480
283879993,5cyclictest0-21swapper/021:05:310
283879993,4cyclictest15419-21cut22:35:440
283879993,3cyclictest31450-21grep19:15:420
283879992,5cyclictest0-21swapper/021:55:530
283879990,8cyclictest0-21swapper/020:27:580
283879990,4cyclictest0-21swapper/019:41:100
283879990,1cyclictest25903-21strings20:15:480
283879985,2cyclictest32487-21if_enp5s022:50:460
283879983,4cyclictest586-21snmpd19:30:310
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional