You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-10-05 - 05:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot2.osadl.org (updated Thu Oct 05, 2023 00:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
543699141133,7cyclictest0-21swapper/119:12:031
543799134132,1cyclictest0-21swapper/219:12:032
5438999492,1cyclictest0-21swapper/319:12:033
109702930,0sleep20-21swapper/219:22:102
514529148,31sleep30-21swapper/319:11:383
502429148,32sleep20-21swapper/219:10:052
496829145,34sleep00-21swapper/019:09:220
484528947,31sleep10-21swapper/119:07:471
233992880,1sleep20-21swapper/221:41:132
5435998785,1cyclictest0-21swapper/019:12:030
5436996860,7cyclictest0-21swapper/119:37:141
5437996058,1cyclictest0-21swapper/219:37:142
5435992826,1cyclictest0-21swapper/023:37:060
283742280,0sleep00-21swapper/023:24:560
230772260,0sleep20-21swapper/223:52:122
185702240,0sleep20-21swapper/222:42:142
166302230,0sleep00-21swapper/023:12:340
76312220,0sleep00-21swapper/021:57:190
5438992220,1cyclictest0-21swapper/323:16:483
5438992220,1cyclictest0-21swapper/300:32:073
5438992219,2cyclictest18186-21strings19:37:143
5436992220,1cyclictest0-21swapper/100:12:061
43462220,0sleep10-21swapper/123:01:281
309872220,0sleep00-21swapper/000:36:310
285342220,0sleep10-21swapper/121:46:371
5438992110,6cyclictest29625-21fschecks_count21:47:103
543899210,1cyclictest0-21swapper/323:22:053
543599210,1cyclictest0-21swapper/020:01:480
5437991914,4cyclictest24205-21ssh21:42:052
543599174,7cyclictest27050-21awk22:51:470
543799164,6cyclictest6687-21taskset21:22:552
5437991612,3cyclictest24700-21kworker/2:221:07:202
543699162,7cyclictest19336-21apt-get23:16:491
5436991610,4cyclictest14440-21ssh21:32:051
543799157,6cyclictest641-21in:imuxsock23:14:282
543799151,12cyclictest9245-21kworker/u8:222:02:022
543699153,1cyclictest22-21ksoftirqd/119:51:551
5436991513,1cyclictest22-21ksoftirqd/123:37:151
543599159,4cyclictest12-21ksoftirqd/000:29:370
543599157,4cyclictest0-21swapper/020:22:440
543599155,5cyclictest0-21swapper/020:38:260
543599155,5cyclictest0-21swapper/020:38:260
543599151,8cyclictest23455-21cron19:51:460
543599150,1cyclictest0-21swapper/000:17:310
150422150,1chrt0-21swapper/100:17:201
543899148,4cyclictest30145-21ls22:21:473
543799149,3cyclictest29512-21turbostat23:26:462
543799149,3cyclictest22985-21cut21:02:092
543799147,5cyclictest579-21snmpd00:03:032
543799146,3cyclictest0-21swapper/222:23:562
543799146,3cyclictest0-21swapper/222:23:562
543799145,4cyclictest0-21swapper/221:16:452
543699145,4cyclictest0-21swapper/123:13:221
543599149,3cyclictest567-21runrttasks19:54:180
543599144,8cyclictest4691-21ssh21:54:560
543599144,5cyclictest26685-21diskmemload22:36:250
543599144,5cyclictest21464-21latency_hist19:46:460
23502140,1sleep30-21swapper/323:31:573
543899138,3cyclictest27858-21sendmail20:01:463
543899137,4cyclictest31478-21systemctl00:01:473
543899137,4cyclictest31478-21systemctl00:01:473
543899134,8cyclictest0-21swapper/321:05:093
543899134,7cyclictest2663-21awk21:52:173
543899134,5cyclictest2173-21ssh00:39:483
543899134,4cyclictest22096-21ntpq22:12:173
543899133,5cyclictest0-21swapper/322:32:113
543899133,5cyclictest0-21swapper/300:22:533
543899132,6cyclictest17422-21ssh21:34:253
543799136,5cyclictest8286-21users19:16:532
543799135,7cyclictest15939-1kworker/u9:121:32:162
543799134,4cyclictest0-21swapper/220:42:132
543799132,8cyclictest543-21ssh21:50:582
543799132,6cyclictest2933-21sshd22:59:152
543699137,4cyclictest10179-21tr20:32:151
543699137,1cyclictest22-21ksoftirqd/119:27:111
543699136,5cyclictest17660-21cron20:51:471
543699135,6cyclictest0-21swapper/119:51:371
543699134,4cyclictest0-21swapper/122:31:231
543599136,5cyclictest10251-21ntpq20:32:170
543599134,8cyclictest0-21swapper/022:58:330
5435991311,1cyclictest0-21swapper/019:37:140
543899127,3cyclictest26668-21cron21:11:473
543899125,5cyclictest0-21swapper/319:47:103
543899124,7cyclictest0-21swapper/322:57:363
543899124,5cyclictest0-21swapper/323:04:133
543899124,5cyclictest0-21swapper/320:35:563
543899122,5cyclictest0-21swapper/322:08:263
543899122,5cyclictest0-21swapper/319:56:403
543899121,6cyclictest27182-21ssh21:44:223
543899120,5cyclictest10564-21grep23:07:103
543799127,4cyclictest4638-21unixbench_multi22:27:202
543799127,2cyclictest28-21ksoftirqd/223:32:072
543799126,4cyclictest20769-21awk23:17:102
543799126,4cyclictest20323-21cpuspeed_turbos20:57:072
543799126,4cyclictest16084-21pluginstate19:32:182
543799126,4cyclictest13818-21cat22:37:132
543799125,5cyclictest30285-21grep20:06:462
543799125,5cyclictest13252-21perf20:41:472
543799125,5cyclictest13252-21perf20:41:472
543799124,3cyclictest0-21swapper/223:47:102
543799124,3cyclictest0-21swapper/220:18:292
543799124,2cyclictest0-21swapper/200:36:392
543799120,10cyclictest10164-21grep23:07:082
543699128,2cyclictest19594-21grep19:42:081
543699127,3cyclictest26685-21diskmemload00:08:051
543699125,5cyclictest13046-21tr22:37:071
543699125,5cyclictest10252-21cron19:21:471
543699124,3cyclictest0-21swapper/122:44:451
543699124,3cyclictest0-21swapper/122:33:391
543699124,3cyclictest0-21swapper/122:17:121
543699124,3cyclictest0-21swapper/121:27:341
543699121,2cyclictest0-21swapper/120:16:461
543699120,10cyclictest28409-21ssh23:25:001
543599127,3cyclictest31924-21ssh21:16:480
543599126,4cyclictest24258-21cron21:06:470
543599126,4cyclictest12079-21grep19:22:220
543599125,5cyclictest0-21swapper/023:46:370
543599124,7cyclictest0-21swapper/021:22:070
543599124,7cyclictest0-21swapper/020:41:480
543599124,5cyclictest14263-21ssh22:04:460
543599124,5cyclictest0-21swapper/023:31:130
543599124,4cyclictest0-21swapper/000:16:210
543599124,3cyclictest23675-21grep23:52:190
543599124,1cyclictest5433-21cyclictest21:35:500
543599122,8cyclictest29686-21tune2fs21:47:100
543599121,6cyclictest3483-21cat00:41:470
543599121,3cyclictest12-21ksoftirqd/023:57:180
543599121,3cyclictest12-21ksoftirqd/023:57:180
543599121,10cyclictest0-21swapper/020:27:050
543599120,1cyclictest0-21swapper/023:16:570
154402120,0chrt0-21swapper/200:17:412
118032120,0chrt0-21swapper/200:14:282
543899117,2cyclictest3168-21grep20:17:093
543899115,5cyclictest17423-21apt-config22:41:473
543899115,4cyclictest15469-21gltestperf23:12:123
543899114,5cyclictest6022-21systemctl20:22:213
543899114,5cyclictest10122-21ssh22:01:053
543899114,5cyclictest0-21swapper/323:28:253
543899114,5cyclictest0-21swapper/322:49:153
543899114,5cyclictest0-21swapper/321:41:163
543899113,6cyclictest17648-21rm00:21:413
543899113,6cyclictest15858-21ssh23:45:263
543899113,5cyclictest0-21swapper/319:25:123
543899113,5cyclictest0-21swapper/300:27:333
543899112,4cyclictest1867-21ssh00:03:353
543899111,9cyclictest0-21swapper/321:28:263
543899111,5cyclictest0-21swapper/319:27:113
543899111,1cyclictest0-21swapper/322:27:273
543899110,5cyclictest18323-21ntp_states23:47:143
543799117,3cyclictest22640-21awk19:47:222
543799117,2cyclictest31069-21fschecks_count20:07:092
543799116,3cyclictest516-21dbus-daemon22:01:462
543799116,3cyclictest4797-21sh23:01:482
543799116,3cyclictest32734-21apt-get20:12:052
543799116,3cyclictest28651-21sh22:19:212
543799115,4cyclictest626-21gdbus00:07:582
543799115,4cyclictest21566-21grep22:12:112
543799114,5cyclictest32188-21telnet21:17:052
543799114,5cyclictest23850-21aten2.4_r8power19:52:072
543799114,5cyclictest0-21swapper/221:27:072
543799114,2cyclictest0-21swapper/223:57:582
543799114,2cyclictest0-21swapper/223:57:582
543799113,6cyclictest0-21swapper/222:56:192
543799113,6cyclictest0-21swapper/222:07:272
543799113,2cyclictest7079-21kworker/2:123:27:142
543799111,5cyclictest141rcu_preempt20:51:472
543799111,4cyclictest23461-21/usr/sbin/munin00:27:132
543799111,3cyclictest28-21ksoftirqd/221:54:282
543699117,2cyclictest27400-21cpuspeed_turbos21:12:081
543699116,3cyclictest567-21runrttasks23:54:091
543699116,3cyclictest23324-21sh21:41:061
543699115,4cyclictest4706-21aten2.4-expect21:22:081
543699115,4cyclictest32198-21grep00:02:091
543699115,4cyclictest27679-21expr23:57:121
543699115,4cyclictest27679-21expr23:57:121
543699115,4cyclictest233-21systemd-journal23:42:181
543699115,4cyclictest19393-21wc00:22:141
543699114,6cyclictest0-21swapper/122:15:501
543699114,5cyclictest579-21snmpd22:01:051
543699114,5cyclictest516-21dbus-daemon00:41:461
543699112,4cyclictest0-21swapper/120:01:071
543699112,4cyclictest0-21swapper/100:31:331
543699111,8cyclictest3747-21sed23:32:221
543699111,8cyclictest0-21swapper/123:06:461
543699110,1cyclictest0-21swapper/122:05:491
543599116,3cyclictest15825-21cut20:47:070
543599115,5cyclictest0-21swapper/021:44:060
543599115,5cyclictest0-21swapper/021:07:120
543599115,4cyclictest729-21ntpd22:17:160
543599115,4cyclictest355-21if_err_enp5s000:02:140
543599115,4cyclictest3344-21if_err_enp5s020:17:100
543599115,4cyclictest31801-21awk20:07:170
543599115,4cyclictest28666-21unixbench-2d21:12:200
543599115,4cyclictest233-21systemd-journal20:56:470
543599115,3cyclictest0-21swapper/022:52:390
543599114,5cyclictest17782-21ssh22:42:020
543599114,5cyclictest10446-21grep23:07:100
543599114,5cyclictest0-21swapper/021:27:120
543599114,5cyclictest0-21swapper/000:07:100
543599113,7cyclictest0-21swapper/019:31:480
543599113,2cyclictest0-21swapper/023:51:270
543599113,2cyclictest0-21swapper/019:31:280
543599110,6cyclictest19066-21/usr/sbin/munin00:22:110
543599110,6cyclictest18757-21ssh22:09:040
543899107,2cyclictest9438-21ntp_states19:17:133
543899107,2cyclictest38250irq/33-enp3s0-r00:12:083
543899107,2cyclictest1486-21head20:12:153
543899106,3cyclictest38250irq/33-enp3s0-r22:52:223
543899106,2cyclictest17175-21sh22:41:473
543899105,4cyclictest14247-21if_eno120:42:113
543899105,4cyclictest0-21swapper/320:54:033
543899105,4cyclictest0-21swapper/320:09:073
543899105,3cyclictest4776-21grep00:07:083
543899105,3cyclictest19444-21aten2.4_r8power19:42:083
543899104,5cyclictest0-21swapper/321:14:213
543899104,4cyclictest22344-21/usr/sbin/munin23:52:073
543899104,4cyclictest16859-21cron19:36:473
543899101,8cyclictest0-21swapper/320:49:163
543899101,2cyclictest7982-21needreboot20:27:133
543899101,2cyclictest0-21swapper/322:02:093
543899100,4cyclictest7874-21diskstats23:37:103
543899100,4cyclictest32579-21df21:17:073
543799107,2cyclictest18576-21df00:22:062
543799106,2cyclictest14535-21sh23:43:192
543799105,3cyclictest0-21swapper/220:53:062
543799105,3cyclictest0-21swapper/220:21:502
543799104,4cyclictest12744-21cut19:27:052
543799103,6cyclictest0-21swapper/219:44:312
543799101,8cyclictest0-21swapper/223:37:192
543799101,7cyclictest7230-21cpuspeed_turbos20:27:062
543799101,7cyclictest22694-21basename22:47:082
543799101,7cyclictest0-21swapper/219:57:042
543799101,3cyclictest10863-21sshd20:34:272
543799100,8cyclictest8649-21idleruntime22:32:102
543799100,2cyclictest0-21swapper/200:39:202
543699108,1cyclictest0-21swapper/123:06:501
543699107,2cyclictest11662-21ntp_states19:22:181
543699106,2cyclictest3812-21mailstats20:17:161
543699106,2cyclictest18043-21aten2.4_r8power20:52:061
543699105,3cyclictest32391-21cpuspeed_turbos21:17:071
543699105,3cyclictest31471-21timerandwakeup23:27:191
543699105,3cyclictest28686-21cstates20:02:091
543699105,3cyclictest17406-21grep23:47:071
543699105,3cyclictest0-21swapper/121:52:131
543699105,3cyclictest0-21swapper/121:47:071
543699104,5cyclictest11317-21apt-get20:37:081
543699104,5cyclictest11317-21apt-get20:37:081
543699104,4cyclictest28177-21cut22:52:151
543699104,4cyclictest233-21systemd-journal21:06:571
543699104,4cyclictest233-21systemd-journal19:36:471
543699104,4cyclictest22-21ksoftirqd/100:32:101
543699104,4cyclictest17549-21grep22:07:191
543699102,6cyclictest0-21swapper/120:22:321
543699102,5cyclictest13528-21apt-get20:42:051
543699101,4cyclictest0-21swapper/120:08:551
543699100,9cyclictest0-21swapper/122:47:201
543699100,5cyclictest20366-21cpuspeed_turbos20:57:071
543699100,1cyclictest0-21swapper/122:22:091
543699100,1cyclictest0-21swapper/122:22:091
543599107,2cyclictest23767-21sendmail21:41:460
543599105,3cyclictest7804-21cat19:16:520
543599105,3cyclictest6546-21grep23:02:180
543599105,3cyclictest2591-21rm23:32:110
543599105,3cyclictest1451-21open_inodes20:12:150
543599105,3cyclictest13249-21fschecks_count22:37:090
543599104,5cyclictest0-21swapper/022:26:540
543599104,5cyclictest0-21swapper/022:22:020
543599104,5cyclictest0-21swapper/022:22:020
543599104,5cyclictest0-21swapper/022:12:080
543599104,5cyclictest0-21swapper/019:57:000
543599101,1cyclictest0-21swapper/020:59:580
54389994,4cyclictest0-21swapper/320:37:053
54389994,4cyclictest0-21swapper/320:37:053
54389994,3cyclictest31966-21fgrep22:22:173
54389994,3cyclictest31966-21fgrep22:22:173
54389994,3cyclictest21641-21grep20:57:183
54389993,4cyclictest29335-21missed_timers20:02:153
54389990,4cyclictest6264-21grep21:22:243
54369995,3cyclictest0-21swapper/121:02:101
54369990,8cyclictest0-21swapper/120:27:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional