You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-05 - 03:36

x86 Intel Core i3-2310E @2100 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of system in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot2.osadl.org (updated Tue Jul 05, 2022 00:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1750799145137,7cyclictest0-21swapper/119:15:091
1750999141137,1cyclictest0-21swapper/319:19:033
1750899139137,1cyclictest0-21swapper/219:19:032
768021190,0sleep00-21swapper/022:30:260
1705721190,0sleep10-21swapper/123:55:221
16827210646,48sleep30-21swapper/319:11:473
642421040,3sleep122-21ksoftirqd/121:51:391
1924721000,0sleep20-21swapper/220:30:222
282282980,1sleep30-21swapper/323:30:303
1681429248,32sleep20-21swapper/219:11:382
1674829047,31sleep00-21swapper/019:10:480
1687528948,30sleep10-21swapper/119:12:261
17506997573,1cyclictest0-21swapper/019:19:030
125822330,1sleep00-21swapper/023:50:200
17509993230,1cyclictest0-21swapper/300:35:163
183042300,1sleep30-21swapper/323:20:203
17508993026,3cyclictest4258-21rm00:18:562
55272290,0sleep30-21swapper/321:50:283
32372290,0sleep20-21swapper/221:48:472
83942270,0sleep20-21swapper/223:09:452
1750799270,1cyclictest0-21swapper/119:50:171
15042270,0sleep30-21swapper/319:50:193
186792230,0sleep00-21swapper/023:56:330
1750899220,1cyclictest0-21swapper/219:50:172
129892220,0sleep00-21swapper/021:22:470
17506992119,1cyclictest0-21swapper/019:35:170
120462210,0sleep10-21swapper/123:13:211
17509992018,1cyclictest0-21swapper/323:25:163
1750699184,8cyclictest32071-21perf23:00:060
1750699181,9cyclictest12567-21idleruntime-cro22:00:060
1750699175,6cyclictest19245-21perf22:45:050
1750699171,9cyclictest26581-21idleruntime-cro19:35:050
1750899163,9cyclictest14151-21runrttasks20:20:172
1750999151,12cyclictest8759-21cpuspeed_turbos21:55:183
1750999150,5cyclictest0-21swapper/320:05:223
1750899158,5cyclictest0-21swapper/223:47:362
1750899154,6cyclictest0-21swapper/200:09:072
1750899152,8cyclictest590-21snmpd00:20:172
36342140,2sleep23633-21df_inode23:40:202
1750999148,4cyclictest17124-21head23:55:223
1750999145,4cyclictest0-21swapper/322:33:403
17509991410,2cyclictest9526-21sh00:25:163
1750899142,10cyclictest28585-21tail22:55:212
1750799145,7cyclictest15243-21hddtemp_smartct21:25:201
17507991411,2cyclictest22716-21kworker/u8:022:57:081
1750699144,5cyclictest0-21swapper/020:20:220
1750999138,4cyclictest32077-21ls23:35:293
1750999135,2cyclictest43750irq/33-enp3s0-r23:18:343
1750999134,4cyclictest0-21swapper/322:40:313
1750999131,10cyclictest5721-21fschecks_count00:20:203
1750999131,10cyclictest0-21swapper/322:38:393
1750899135,6cyclictest0-21swapper/223:50:162
1750899135,3cyclictest16237-21ssh00:31:562
1750899134,6cyclictest8823-21head20:05:262
1750899134,4cyclictest10486-21ssh21:56:062
1750899133,5cyclictest0-21swapper/200:02:192
1750899132,9cyclictest16265-21needreboot22:40:242
1750899131,10cyclictest30513-21processes20:55:262
1750899131,10cyclictest0-21swapper/223:15:062
1750899130,12cyclictest0-21swapper/221:35:162
1750799138,3cyclictest2110-21ps00:15:261
1750799137,4cyclictest20876-21grep20:35:201
1750799136,6cyclictest0-21swapper/123:32:481
1750799135,7cyclictest0-21swapper/122:27:261
1750799134,8cyclictest20976-21/usr/sbin/munin00:00:181
1750799134,7cyclictest22181-21hddtemp_smartct22:10:201
1750799134,6cyclictest0-21swapper/123:24:061
1750799134,5cyclictest0-21swapper/100:25:221
1750799131,2cyclictest0-21swapper/100:40:231
17507991310,2cyclictest32399-21sh23:00:181
1750699138,3cyclictest27407-21cpuspeed_turbos20:50:180
1750699137,4cyclictest23368-21head20:40:200
1750699133,8cyclictest0-21swapper/023:15:230
1750699133,5cyclictest0-21swapper/023:23:060
1750699133,5cyclictest0-21swapper/023:00:230
1750699133,5cyclictest0-21swapper/019:20:310
144602130,3sleep122-21ksoftirqd/123:51:571
204522120,0sleep10-21swapper/119:20:191
1750999129,2cyclictest0-21swapper/321:35:183
1750999126,4cyclictest9824-21cron21:20:053
1750999126,2cyclictest32615-21cstates21:45:183
1750999125,6cyclictest0-21swapper/320:55:303
1750999125,4cyclictest28284-21grep20:50:263
1750999124,7cyclictest43750irq/33-enp3s0-r23:50:223
1750999124,3cyclictest0-21swapper/321:31:083
1750999124,3cyclictest0-21swapper/300:12:433
1750999123,2cyclictest34-21ksoftirqd/323:43:453
1750999121,9cyclictest26891-21aten2_r8power_e19:35:183
1750999121,7cyclictest23499-21sh22:50:173
1750899127,3cyclictest0-21swapper/223:31:392
1750899126,4cyclictest25433-21uniq20:45:192
1750899126,4cyclictest20952-21grep19:20:212
1750899126,4cyclictest18833-21head00:35:202
1750899125,6cyclictest0-21swapper/221:53:472
1750899125,5cyclictest0-21swapper/222:51:442
1750899124,6cyclictest28344-1kworker/u9:200:10:202
1750899124,6cyclictest0-21swapper/223:00:562
1750899124,3cyclictest0-21swapper/221:41:352
1750899124,3cyclictest0-21swapper/221:01:402
1750899124,2cyclictest43850irq/34-enp3s0-t22:05:182
1750899124,2cyclictest0-21swapper/222:48:012
1750899121,9cyclictest29888-21wc19:40:242
1750899121,9cyclictest28277-21unixbench_multi19:35:292
1750899121,9cyclictest0-21swapper/221:23:342
1750899120,10cyclictest29831-21perf22:20:052
1750799128,2cyclictest24497-21irqstats21:35:231
1750799126,4cyclictest7426-21systemctl20:05:061
1750799126,4cyclictest6475-21wc00:20:271
1750799125,6cyclictest0-21swapper/122:50:401
1750799125,4cyclictest20968-21ssh00:37:461
1750799124,7cyclictest30294-21python19:40:281
1750799124,7cyclictest26612-21/usr/sbin/munin00:05:321
1750799124,5cyclictest0-21swapper/120:16:051
1750799124,3cyclictest0-21swapper/122:49:561
1750799124,1cyclictest13892-21ssh21:24:301
1750799122,8cyclictest0-21swapper/119:45:211
1750799121,6cyclictest11246-21ssh21:57:361
1750699128,2cyclictest4507-21grep21:50:200
1750699127,3cyclictest7905-21cpuspeed_turbos20:05:180
1750699125,5cyclictest0-21swapper/019:48:250
1750699125,5cyclictest0-21swapper/019:41:490
1750699125,4cyclictest0-21swapper/020:57:510
1750699125,4cyclictest0-21swapper/020:48:450
1750699124,5cyclictest0-21swapper/023:27:450
1750699124,3cyclictest9035-21mailstats23:45:270
1750699123,8cyclictest0-21swapper/022:22:370
1750699121,8cyclictest23272-21sh00:40:230
1750699120,6cyclictest21210-21perf22:10:060
25782110,0chrt0-21swapper/323:02:203
195502110,1chrt0-21swapper/120:30:251
1750999116,3cyclictest5260-21diskmemload23:05:163
1750999116,3cyclictest28631-21grep21:40:213
1750999116,3cyclictest21322-21entropy00:00:203
1750999115,4cyclictest30071-21sh22:56:273
1750999115,4cyclictest24935-21sh00:42:143
1750999115,4cyclictest238-21systemd-journal20:50:003
1750999115,4cyclictest22255-21cat19:25:053
1750999115,4cyclictest20609-21ntpq22:45:263
1750999115,4cyclictest10761-21head21:20:233
1750999115,4cyclictest10121-21cut20:10:183
1750999114,5cyclictest590-21snmpd20:20:193
1750999113,6cyclictest0-21swapper/322:20:233
1750999113,6cyclictest0-21swapper/300:30:503
1750999113,3cyclictest0-21swapper/319:55:323
1750999113,2cyclictest12849-21ssh22:00:153
1750999112,6cyclictest0-21swapper/322:15:213
1750999112,4cyclictest12202-21ssh23:13:383
1750999112,4cyclictest0-21swapper/321:00:223
1750999111,5cyclictest0-21swapper/321:10:493
1750899117,2cyclictest19544-21fschecks_count21:30:202
1750899116,3cyclictest17755-21grep23:55:282
1750899115,4cyclictest5270-21basename21:15:052
1750899115,4cyclictest23025-21grep20:40:182
1750899115,4cyclictest18679-21latency23:20:232
1750899115,4cyclictest11821-21sh22:35:242
1750899114,6cyclictest0-21swapper/223:35:222
1750899113,6cyclictest0-21swapper/223:28:572
1750899113,6cyclictest0-21swapper/200:40:222
1750899111,8cyclictest23742-21gzip19:25:272
1750899111,5cyclictest23698-21ssh22:11:362
1750899111,4cyclictest10191-21ssh00:25:212
1750899111,3cyclictest788-21munin-run19:50:052
1750899110,5cyclictest2889-21ssh22:25:222
1750899110,4cyclictest30778-21gltestperf22:20:212
1750799117,3cyclictest0-21swapper/122:30:241
1750799117,3cyclictest0-21swapper/121:30:141
1750799117,2cyclictest32297-21kernelversion21:00:241
1750799116,3cyclictest590-21snmpd21:05:291
1750799115,5cyclictest0-21swapper/120:10:211
1750799115,5cyclictest0-21swapper/100:30:231
1750799115,4cyclictest31515-21apt-compat00:11:561
1750799115,4cyclictest0-21swapper/121:10:191
1750799115,3cyclictest15156-21/usr/sbin/munin22:40:161
1750799114,5cyclictest0-21swapper/122:16:001
1750799114,5cyclictest0-21swapper/121:46:051
1750799114,5cyclictest0-21swapper/120:50:221
1750799113,7cyclictest0-21swapper/122:36:061
1750799113,3cyclictest0-21swapper/123:45:221
1750799112,8cyclictest0-21swapper/122:20:161
1750699117,2cyclictest238-21systemd-journal21:45:060
1750699117,2cyclictest19689-21cpuspeed_turbos22:45:190
1750699116,4cyclictest238-21systemd-journal00:22:320
1750699116,3cyclictest17138-21if_err_enp5s020:25:240
1750699115,4cyclictest5171-21sed23:05:210
1750699115,4cyclictest16263-21sh21:25:390
1750699115,4cyclictest10810-21grep20:10:230
1750699114,5cyclictest0-21swapper/020:01:470
1750699114,5cyclictest0-21swapper/000:19:350
1750699113,7cyclictest0-21swapper/021:08:250
1750699112,8cyclictest0-21swapper/021:36:230
1750699111,8cyclictest0-21swapper/023:45:050
1750699111,6cyclictest6589-21ssh21:15:230
1750699111,5cyclictest5260-21diskmemload22:35:520
1750999107,2cyclictest43750irq/33-enp3s0-r00:05:093
1750999106,2cyclictest5260-21diskmemload00:17:223
1750999105,3cyclictest5260-21diskmemload21:25:093
1750999105,3cyclictest18764-21grep22:05:313
1750999104,4cyclictest5496-21cut20:00:173
1750999104,4cyclictest25240-21gltestperf19:30:213
1750999104,4cyclictest238-21systemd-journal20:30:213
1750999104,4cyclictest23224-21df20:40:183
1750999104,4cyclictest17118-21cat20:25:233
1750999104,4cyclictest1372-21grep21:05:193
1750999103,5cyclictest12838-21kernelversion20:15:223
1750999101,8cyclictest0-21swapper/319:45:223
1750999101,7cyclictest22132-21grep22:10:203
1750999101,5cyclictest3751-21ssh22:25:333
1750999101,4cyclictest0-21swapper/320:35:183
1750999100,8cyclictest29029-21aten2_r8power_e19:40:183
1750899105,3cyclictest16006-21timerandwakeup21:25:282
1750899105,3cyclictest0-21swapper/223:15:112
1750899105,3cyclictest0-21swapper/220:28:512
1750899104,4cyclictest10013-21sort20:10:182
1750899103,5cyclictest590-21snmpd21:15:072
1750899102,2cyclictest0-21swapper/221:05:232
1750899101,7cyclictest27344-21tr20:50:182
1750899101,7cyclictest12247-21tr20:15:172
1750899101,6cyclictest6447-21ssh22:30:162
1750899101,1cyclictest0-21swapper/219:30:282
1750899100,4cyclictest13655-21if_eno122:00:302
1750799106,3cyclictest24840-21cpu19:30:181
1750799106,2cyclictest5260-21diskmemload23:40:171
1750799106,2cyclictest5260-21diskmemload23:25:571
1750799106,2cyclictest23416-21cut20:40:201
1750799105,3cyclictest17151-21sh22:05:161
1750799105,3cyclictest16361-21aten2_r8power_e20:25:191
1750799104,4cyclictest4451-21sh23:05:131
1750799104,4cyclictest3537-21sort19:55:181
1750799104,4cyclictest29851-21head20:55:201
1750799104,4cyclictest29120-21ntp_states21:40:261
1750799104,4cyclictest22795-21tr19:25:191
1750799104,3cyclictest1077-21ssh23:37:001
1750799104,2cyclictest0-21swapper/119:36:221
1750799103,6cyclictest0-21swapper/121:15:101
1750799103,6cyclictest0-21swapper/120:23:401
1750799103,3cyclictest0-21swapper/122:01:241
1750799102,7cyclictest0-21swapper/120:05:221
1750799100,6cyclictest13768-21df23:15:201
1750699106,3cyclictest27460-21irqstats23:30:220
1750699105,4cyclictest10449-21sort00:25:240
1750699105,4cyclictest0-21swapper/020:19:440
1750699105,4cyclictest0-21swapper/019:25:400
1750699105,3cyclictest603-21runrttasks22:50:270
1750699105,3cyclictest4039-21if_eno121:10:220
1750699105,3cyclictest3287-21sh22:25:270
1750699105,3cyclictest31535-21dpkg00:11:570
1750699105,3cyclictest27048-21/usr/sbin/munin22:15:270
1750699105,3cyclictest18937-21test21:30:060
1750699104,5cyclictest0-21swapper/022:00:300
1750699104,5cyclictest0-21swapper/020:35:570
1750699104,5cyclictest0-21swapper/000:36:020
1750699104,5cyclictest0-21swapper/000:07:250
1750699104,4cyclictest9507-21head23:10:210
1750699104,4cyclictest3589-21grep19:55:180
1750699104,4cyclictest32589-21grep23:35:340
1750699104,4cyclictest32000-21/usr/sbin/munin21:00:210
1750699104,4cyclictest16059-21sh00:31:360
1750699104,4cyclictest0-21swapper/000:00:370
1750699103,5cyclictest0-21swapper/022:12:300
1750699102,5cyclictest2396-21ssh21:47:110
1750699100,4cyclictest3107-21awk19:55:050
175099994,4cyclictest7740-21hostname23:45:183
175099994,3cyclictest22627-21aten2_r8power_v19:25:183
175089994,4cyclictest20649-21apt-get20:35:192
175089994,3cyclictest3553-21grep19:55:182
175089993,5cyclictest590-21snmpd20:00:172
175079994,3cyclictest25478-21cut20:45:191
175069995,3cyclictest18792-21cstates20:30:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional