You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-23 - 16:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot2.osadl.org (updated Sat Sep 23, 2023 00:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
701699137128,8cyclictest0-21swapper/119:11:461
701899134132,1cyclictest0-21swapper/319:11:463
701599108106,1cyclictest0-21swapper/019:24:380
6717210843,51sleep20-21swapper/219:11:212
6419210844,32sleep00-21swapper/019:07:300
70179910299,2cyclictest0-21swapper/219:11:462
80232930,0sleep20-21swapper/221:56:482
7016999381,11cyclictest0-21swapper/119:24:381
651929246,34sleep10-21swapper/119:08:471
174682920,0sleep10-21swapper/122:05:571
7018998985,2cyclictest0-21swapper/319:24:383
640228948,30sleep30-21swapper/319:07:173
198072860,0sleep30-21swapper/323:12:003
52522820,0sleep30-21swapper/323:29:483
150992760,0sleep00-21swapper/022:02:190
40232690,0sleep00-21swapper/021:52:050
7017995552,2cyclictest0-21swapper/219:24:382
7015993419,1cyclictest0-21swapper/023:46:550
26532270,0sleep20-21swapper/222:55:282
117912270,1sleep228-21ksoftirqd/223:03:462
253132250,1sleep30-21swapper/321:41:583
287702240,1sleep20-21swapper/222:16:562
701599220,12cyclictest0-21swapper/020:51:560
142772220,0sleep00-21swapper/000:11:370
701599205,8cyclictest15615-21ssh22:36:370
701799178,4cyclictest567-21runrttasks21:27:022
701599173,7cyclictest0-21swapper/020:51:370
701599161,8cyclictest8250-21munin-run20:26:370
7015991611,4cyclictest18771-21munin-run00:16:370
701899146,6cyclictest14123-21latency_hist00:11:373
701799144,5cyclictest0-21swapper/221:55:492
701799144,5cyclictest0-21swapper/221:42:002
701799141,5cyclictest23076-21perf19:46:372
701699147,5cyclictest31042-21ntpq20:02:041
701599147,4cyclictest12-21ksoftirqd/021:47:070
701599146,5cyclictest0-21swapper/023:01:290
7015991412,1cyclictest0-21swapper/022:21:570
7015991412,1cyclictest0-21swapper/020:31:560
701899139,3cyclictest34-21ksoftirqd/321:21:373
701799134,5cyclictest0-21swapper/220:17:042
701799134,4cyclictest0-21swapper/223:51:342
701799132,8cyclictest0-21swapper/223:55:282
701699138,4cyclictest4556-21basename00:01:371
701699132,3cyclictest15274-21ntp_states23:07:051
701699132,3cyclictest15274-21ntp_states23:07:051
701599134,8cyclictest0-21swapper/023:20:430
701599134,8cyclictest0-21swapper/000:40:510
701599133,5cyclictest0-21swapper/020:27:020
701599130,3cyclictest28040-21diskmemload21:17:050
158522130,1sleep20-21swapper/222:36:402
701899125,5cyclictest32584-21df_inode20:06:573
701899124,7cyclictest579-21snmpd23:54:343
701899121,2cyclictest0-21swapper/321:14:363
701899121,10cyclictest3155-21ssh23:59:263
701799127,3cyclictest17566-21tr20:46:582
701799127,3cyclictest1417-21sh23:26:382
701799126,4cyclictest6979-21sed00:37:072
701799126,4cyclictest28260-21cron00:26:372
701799124,2cyclictest0-21swapper/223:17:212
701799122,5cyclictest0-21swapper/220:57:352
701799121,5cyclictest28040-21diskmemload23:37:002
701799121,1cyclictest0-21swapper/223:59:462
701699126,4cyclictest18260-21grep19:32:161
701699120,2cyclictest0-21swapper/122:18:421
701599128,2cyclictest21775-21grep22:42:020
701599127,4cyclictest28839-21awk23:52:120
701599127,4cyclictest0-21swapper/020:17:470
701599127,4cyclictest0-21swapper/020:00:470
701599127,3cyclictest30589-21head20:01:580
701599124,6cyclictest23367-21ssh00:21:270
701599124,6cyclictest0-21swapper/000:31:530
701599124,5cyclictest26862-21ssh21:42:510
701599124,5cyclictest0-21swapper/021:37:290
701599123,8cyclictest0-21swapper/021:03:470
701599123,8cyclictest0-21swapper/019:56:370
701599123,6cyclictest17157-21latency_hist20:46:370
701599123,1cyclictest0-21swapper/021:32:350
701599121,6cyclictest0-21swapper/023:08:210
701599121,6cyclictest0-21swapper/023:08:210
701599121,5cyclictest24587-21ntp_states22:12:070
324662120,1sleep30-21swapper/322:52:083
701899118,2cyclictest3835-21turbostat20:16:373
701899118,2cyclictest38250irq/33-enp3s0-r22:36:583
701899115,4cyclictest233-21systemd-journal22:16:373
701899114,6cyclictest729-21ntpd21:50:293
701899110,5cyclictest20014-21unixbench_singl22:07:093
701899110,4cyclictest5531-21uptime22:57:103
701799116,3cyclictest6558-21grep20:21:572
701799116,3cyclictest30557-21grep20:01:582
701799116,3cyclictest10319-21grep00:07:002
701799115,4cyclictest32744-21grep20:06:592
701799115,4cyclictest2488-21grep23:27:002
701799115,4cyclictest13547-21grep20:37:022
701799115,4cyclictest11074-21cut19:17:122
701799115,4cyclictest0-21swapper/220:30:582
701799114,5cyclictest25314-21cat19:51:372
701799114,5cyclictest25314-21cat19:51:372
701799113,7cyclictest0-21swapper/222:32:472
701799113,2cyclictest0-21swapper/223:11:382
701799113,2cyclictest0-21swapper/222:45:002
701799113,2cyclictest0-21swapper/221:41:292
701799113,2cyclictest0-21swapper/221:34:052
701799112,4cyclictest18119-21ntp_states23:42:072
701799111,9cyclictest25550-21ssh22:12:552
701799111,8cyclictest30020-21ssh21:12:102
701799111,5cyclictest233-21systemd-journal22:59:082
701799111,4cyclictest27666-21cat22:47:092
701799111,2cyclictest0-21swapper/223:32:132
701799110,5cyclictest900-21telnet21:16:562
701799110,5cyclictest17042-21latency_hist20:46:372
701699118,2cyclictest567-21runrttasks00:05:011
701699118,2cyclictest19360-21idleruntime-cro21:36:371
701699117,3cyclictest7781-21vmstat22:27:091
701699117,3cyclictest20096-21head20:52:011
701699117,3cyclictest19073-21kworker/u8:120:56:551
701699116,4cyclictest579-21snmpd23:56:071
701699116,4cyclictest29590-21sed21:46:381
701699116,4cyclictest28533-21hostname21:11:571
701699116,4cyclictest25500-21unixbench-2d00:22:111
701699116,3cyclictest16579-21grep20:42:101
701699115,4cyclictest314-21gltestperf20:06:591
701699114,5cyclictest579-21snmpd19:41:071
701699114,5cyclictest516-21dbus-daemon20:21:381
701699114,5cyclictest19786-21python22:07:071
701699114,1cyclictest22-21ksoftirqd/122:37:141
701699111,9cyclictest7013-21cyclictest21:02:591
701699110,2cyclictest12458-21ssh23:37:001
701699110,10cyclictest25486-21ssh22:12:491
701699110,10cyclictest0-21swapper/100:36:201
701599117,2cyclictest28977-21tr00:26:580
701599116,3cyclictest28040-21diskmemload23:27:040
701599115,5cyclictest0-21swapper/022:54:210
701599115,4cyclictest233-21systemd-journal19:36:370
701599115,4cyclictest19547-21grep19:37:010
701599115,4cyclictest16666-21grep22:36:590
701599115,4cyclictest14830-21cron20:41:370
701599115,4cyclictest14575-21tr19:26:590
701599115,4cyclictest0-21swapper/023:37:100
701599114,6cyclictest0-21swapper/019:50:440
701599114,6cyclictest0-21swapper/019:50:440
701599114,5cyclictest579-21snmpd23:32:180
701599114,5cyclictest0-21swapper/021:29:070
701599113,5cyclictest0-21swapper/023:42:030
701599113,3cyclictest8181-21ssh00:04:450
701599113,3cyclictest0-21swapper/019:11:590
701599112,4cyclictest27709-21grep22:47:090
701599112,4cyclictest22449-21ssh23:14:390
701599112,4cyclictest0-21swapper/021:56:490
701599111,5cyclictest221112sleep022:10:210
701599110,6cyclictest8207-21ssh21:23:530
68072110,1sleep10-21swapper/121:22:041
701899108,1cyclictest0-21swapper/323:03:463
701899108,1cyclictest0-21swapper/321:56:563
701899104,5cyclictest27665-21vmstat21:07:083
701899104,4cyclictest4729-21sed20:17:023
701899104,4cyclictest21427-21swap21:37:093
701899104,4cyclictest18063-21cut19:32:143
701899104,4cyclictest14265-21latency22:02:033
701899103,5cyclictest579-21snmpd19:26:403
701899103,5cyclictest19534-21cut20:51:563
701899101,3cyclictest11725-21ssh23:36:483
701899101,2cyclictest23321-21apt-get19:46:553
701899101,2cyclictest23321-21apt-get19:46:553
701899100,9cyclictest0-21swapper/323:46:563
701899100,9cyclictest0-21swapper/323:07:263
701899100,9cyclictest0-21swapper/323:07:263
701899100,9cyclictest0-21swapper/322:14:063
701899100,9cyclictest0-21swapper/300:29:563
701899100,8cyclictest10242-21cat00:41:383
701899100,6cyclictest2753-21ssh00:32:163
701899100,6cyclictest23773-21ssh22:43:423
701899100,5cyclictest24095-21rm00:21:573
701899100,4cyclictest5474-21fschecks_count00:02:003
701899100,4cyclictest14907-21cut20:41:373
701899100,4cyclictest10889-21ssh22:31:433
701899100,3cyclictest27287-21cut22:47:053
701899100,3cyclictest1433-21ssh22:22:003
701799105,4cyclictest0-21swapper/220:00:392
701799105,4cyclictest0-21swapper/200:18:382
701799105,3cyclictest5721-21tr21:21:552
701799105,3cyclictest5301-21cstates00:01:592
701799105,3cyclictest30378-21cstates21:46:562
701799105,3cyclictest20105-21grep19:37:092
701799105,3cyclictest17196-21diskstats19:32:042
701799104,5cyclictest0-21swapper/222:21:562
701799104,5cyclictest0-21swapper/219:27:222
701799103,5cyclictest0-21swapper/200:27:052
701799103,4cyclictest0-21swapper/223:10:572
701799103,4cyclictest0-21swapper/223:10:572
701799102,3cyclictest0-21swapper/200:11:552
701799102,2cyclictest0-21swapper/222:27:022
701799101,7cyclictest28033-21idleruntime-cro21:11:372
701799101,7cyclictest20165-21grep20:52:022
701799101,7cyclictest0-21swapper/219:52:042
701799100,4cyclictest18319-21/usr/sbin/munin22:07:092
701699108,1cyclictest0-21swapper/121:58:391
701699108,1cyclictest0-21swapper/119:19:091
701699107,2cyclictest28040-21diskmemload22:59:141
701699107,2cyclictest26050-21fschecks_time19:51:581
701699107,2cyclictest2572-21sendmail_mailtr22:22:151
701699107,2cyclictest21045-21/usr/sbin/munin22:42:081
701699107,2cyclictest20575-21sensors_temp00:17:051
701699106,3cyclictest28040-21diskmemload21:27:531
701699106,3cyclictest26758-21uniq22:47:001
701699106,3cyclictest17055-21kworker/u8:100:06:581
701699106,3cyclictest11926-21if_err_enp4s022:31:591
701699106,3cyclictest10502-21timerandwakeup23:02:071
701699106,2cyclictest6870-21aten2.4_r8power23:31:571
701699106,2cyclictest45252sleep121:52:111
701699106,2cyclictest19645-21apt-key21:36:381
701699105,4cyclictest6400-21tail00:37:011
701699105,4cyclictest32486-21awk22:52:091
701699105,4cyclictest29932-21cut00:27:061
701699105,4cyclictest25469-21grep23:17:061
701699105,4cyclictest2229-21cat23:26:581
701699105,4cyclictest19069-21apt23:11:551
701699105,4cyclictest11740-21ls20:32:041
701699104,5cyclictest2060-21proc_pri21:17:061
701699104,4cyclictest579-21snmpd19:41:441
701699104,4cyclictest2028-21cut20:11:581
701699103,1cyclictest28040-21diskmemload23:42:401
701699101,8cyclictest0-21swapper/119:50:091
701699101,8cyclictest0-21swapper/119:50:091
701699100,9cyclictest0-21swapper/100:12:001
701699100,3cyclictest28040-21diskmemload23:21:551
701599105,3cyclictest23631-21latency_hist21:01:370
701599105,3cyclictest0-21swapper/020:08:420
701599104,5cyclictest0-21swapper/023:56:410
701599104,5cyclictest0-21swapper/023:22:530
701599104,5cyclictest0-21swapper/022:27:170
701599104,5cyclictest0-21swapper/021:06:530
701599104,5cyclictest0-21swapper/020:12:530
701599104,5cyclictest0-21swapper/000:21:450
701599104,4cyclictest29081-21/usr/sbin/munin21:12:010
701599104,3cyclictest10550-21unixbench-2d23:02:070
701599103,5cyclictest579-21snmpd19:17:010
701599101,4cyclictest0-21swapper/019:42:500
325372100,8sleep132551-21ssh21:48:231
70189996,2cyclictest28040-21diskmemload23:21:423
70189996,2cyclictest28040-21diskmemload22:27:343
70189995,2cyclictest7286-21memory20:22:033
70189994,4cyclictest18437-21sed23:42:093
70189994,4cyclictest10935-21wc20:31:583
70189994,3cyclictest24144-21tr21:01:553
70189994,3cyclictest21416-21cron21:01:323
70189993,5cyclictest579-21snmpd20:47:583
70189993,5cyclictest579-21snmpd20:05:273
70189993,5cyclictest28854-21awk19:57:063
70189993,4cyclictest579-21snmpd23:31:393
70189993,4cyclictest579-21snmpd19:51:593
70189991,7cyclictest3471-21diskstats21:52:013
70189991,7cyclictest0-21swapper/319:42:033
70189991,6cyclictest24819-21grep23:16:583
70189991,6cyclictest20036-21ntp_states19:37:083
70189991,4cyclictest14912-21/usr/sbin/munin21:32:043
70189991,2cyclictest0-21swapper/321:21:543
70189991,2cyclictest0-21swapper/320:27:083
70189991,2cyclictest0-21swapper/319:17:033
70189991,2cyclictest0-21swapper/300:16:473
70189990,5cyclictest16156-21needreboot20:42:053
70189990,5cyclictest14446-21ssh00:11:503
70179994,4cyclictest2640-21cat20:12:022
70179993,4cyclictest24014-21aten2.4_r8power21:01:542
70179993,4cyclictest14369-21sed22:02:052
70179991,6cyclictest0-21swapper/200:31:492
70179990,3cyclictest10675-21/usr/sbin/munin20:32:022
70169996,2cyclictest8590-21aten2.4-expect20:26:561
70169996,2cyclictest26076-21acpi21:06:531
70169995,3cyclictest22-21ksoftirqd/119:26:581
70169995,2cyclictest27875-21grep19:56:591
70169995,2cyclictest23007-21grep23:47:021
70169994,4cyclictest18348-21needreboot20:47:061
70169993,4cyclictest579-21snmpd20:37:221
70159993,5cyclictest0-21swapper/022:16:450
10071290,1sleep30-21swapper/321:26:403
70169983,4cyclictest7019-21if_eno120:22:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional