You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-22 - 04:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack1slot1.osadl.org (updated Sat Jun 22, 2024 00:45:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
34012217154,50sleep20-21swapper/219:08:242
32752203158,25sleep30-21swapper/319:06:443
31912201161,26sleep10-21swapper/119:05:371
34312197158,26sleep00-21swapper/019:08:450
276862780,0sleep20-21swapper/222:38:062
97362660,0sleep00-21swapper/023:45:000
174352640,0sleep10-21swapper/123:55:151
167282630,0sleep30-21swapper/323:55:013
135742520,0sleep00-21swapper/022:18:090
222082210,0sleep20-21swapper/200:00:322
165282150,0sleep00-21swapper/023:07:440
360899143,5cyclictest6100-21grep23:39:590
267272140,1sleep09-21ksoftirqd/000:08:100
308312130,0sleep10-21swapper/100:14:581
3613991212,0cyclictest0-21swapper/100:25:171
362199109,1cyclictest28-21ksoftirqd/221:30:002
3621991010,0cyclictest0-21swapper/219:24:452
362199100,7cyclictest27115-21snmpd21:54:302
362199100,5cyclictest28251-21apt-get20:00:122
360899103,4cyclictest31857-21latency_hist22:45:000
36299991,5cyclictest0-21swapper/321:50:113
36219998,1cyclictest28-21ksoftirqd/220:30:012
36219998,1cyclictest28-21ksoftirqd/220:30:002
36219997,1cyclictest28-21ksoftirqd/223:15:002
36089999,0cyclictest9-21ksoftirqd/022:52:050
36089992,6cyclictest32755-21ls21:15:000
36089991,4cyclictest9142-21perf00:30:000
36089990,4cyclictest7674-21latency_hist20:25:010
36089990,3cyclictest259-21systemd-journal19:14:550
36089990,1cyclictest0-21swapper/023:47:140
36299986,1cyclictest35-21ksoftirqd/319:50:003
36299986,1cyclictest27115-21snmpd22:50:503
36299986,1cyclictest27115-21snmpd21:41:513
36299986,1cyclictest27115-21snmpd19:25:223
36299982,3cyclictest0-21swapper/322:15:243
36299980,7cyclictest16319-21ntp_states20:40:243
36299980,4cyclictest22017-21apt-get21:45:113
36219988,0cyclictest0-21swapper/221:22:322
36219987,1cyclictest28-21ksoftirqd/222:30:012
36219987,1cyclictest28-21ksoftirqd/221:48:362
36219987,1cyclictest28-21ksoftirqd/219:15:002
36219987,1cyclictest28-21ksoftirqd/200:05:142
36219986,1cyclictest61250irq/122-eno121:40:132
36219986,1cyclictest61250irq/122-eno121:15:242
36219986,1cyclictest61250irq/122-eno121:00:002
36219986,1cyclictest28-21ksoftirqd/200:30:002
36219986,1cyclictest27115-21snmpd19:50:332
36219986,1cyclictest26974-21perf21:05:002
36219983,4cyclictest22784-21sed19:45:262
36219980,7cyclictest0-21swapper/223:00:232
36219980,5cyclictest27115-21snmpd22:31:582
36219980,5cyclictest0-21swapper/222:15:092
36219980,4cyclictest32121-21apt-get22:45:102
36139981,6cyclictest0-21swapper/120:52:041
36089986,1cyclictest9-21ksoftirqd/020:10:000
36089986,1cyclictest29153-21ssh23:25:160
36089986,1cyclictest27115-21snmpd20:59:380
36089986,1cyclictest27115-21snmpd20:50:240
36089983,4cyclictest0-21swapper/019:55:190
36089982,6cyclictest534-21nscd23:01:280
36089982,1cyclictest23840-21ssh23:18:340
36089981,1cyclictest10559-21ssh22:14:490
36089980,7cyclictest27756-21ssh23:24:450
36089980,7cyclictest21124-21ssh22:29:440
36089980,7cyclictest19676-21ssh23:11:300
36089980,7cyclictest1636-21ssh22:45:480
36299976,1cyclictest27115-21snmpd20:16:273
36299975,1cyclictest29457-21ssh00:10:383
36299975,1cyclictest27115-21snmpd20:09:003
36299975,1cyclictest27115-21snmpd19:56:573
36299974,1cyclictest259-21systemd-journal23:29:593
36299973,3cyclictest28594-21apt-get22:40:103
36299972,2cyclictest29309-21diskmemload23:20:083
36299971,4cyclictest9307-21aten_r1power_fr19:20:113
36299970,4cyclictest0-21swapper/300:31:173
36299970,3cyclictest0-21swapper/323:34:403
36299970,3cyclictest0-21swapper/321:25:123
36299970,3cyclictest0-21swapper/300:22:283
36299970,3cyclictest0-21swapper/300:15:383
36299970,2cyclictest29309-21diskmemload00:35:193
36299970,1cyclictest0-21swapper/322:05:133
36219976,1cyclictest61250irq/122-eno123:53:332
36219976,1cyclictest61250irq/122-eno123:45:182
36219976,1cyclictest61250irq/122-eno123:30:392
36219976,1cyclictest61250irq/122-eno122:50:212
36219976,1cyclictest61250irq/122-eno122:41:182
36219976,0cyclictest0-21swapper/200:30:312
36219975,1cyclictest61250irq/122-eno123:25:102
36219975,1cyclictest61250irq/122-eno123:05:162
36219975,1cyclictest61250irq/122-eno121:35:252
36219975,1cyclictest4921-21ssh23:36:262
36219975,1cyclictest27115-21snmpd22:10:282
36219975,1cyclictest18117-21ntpq23:55:212
36219975,1cyclictest11733-21ssh21:30:122
36219974,2cyclictest7197-21cstates19:15:162
36219974,2cyclictest3598-21cyclictest22:00:242
36219973,3cyclictest61250irq/122-eno120:45:122
36219973,2cyclictest30361-21ntpq21:55:262
36219972,4cyclictest14987-21diskstats22:20:142
36219971,2cyclictest3686-21grep20:15:152
36219970,4cyclictest61250irq/122-eno100:35:142
36219970,1cyclictest1070-21sh00:17:112
36139971,5cyclictest0-21swapper/122:09:581
36139971,3cyclictest0-21swapper/121:45:121
36139970,6cyclictest0-21swapper/123:10:031
36139970,6cyclictest0-21swapper/122:04:481
36139970,4cyclictest0-21swapper/121:14:091
36139970,4cyclictest0-21swapper/100:07:431
36139970,3cyclictest0-21swapper/121:35:131
36139970,1cyclictest24595-21chrt23:20:101
36139970,1cyclictest0-21swapper/119:30:181
36089977,0cyclictest0-21swapper/023:55:160
36089976,1cyclictest16924-1kworker/u9:121:44:240
36089975,1cyclictest9759-21ssh21:25:460
36089975,1cyclictest4729-21cat22:05:200
36089975,1cyclictest27115-21snmpd19:52:260
36089975,1cyclictest22132-21memory19:45:190
36089971,5cyclictest30188-21ssh21:55:220
36089971,3cyclictest29309-21diskmemload22:35:150
36089970,6cyclictest4071-21ssh21:20:040
36089970,6cyclictest3019-21ssh21:17:320
36089970,6cyclictest29309-21diskmemload00:20:250
36089970,6cyclictest0-21swapper/021:50:150
36089970,6cyclictest0-21swapper/000:15:130
36089970,2cyclictest0-21swapper/022:31:380
36089970,1cyclictest9348-21ssh00:30:030
36089970,1cyclictest9177-21ssh22:56:450
36089970,1cyclictest22158-21ssh00:00:320
36089970,1cyclictest16062-21ssh23:53:120
36089970,1cyclictest15781-21users19:30:270
36089970,1cyclictest11880-21tr19:25:140
36089970,1cyclictest0-21swapper/022:00:070
36089970,1cyclictest0-21swapper/020:35:160
36089970,1cyclictest0-21swapper/000:10:250
31814270,0sleep20-21swapper/221:12:032
36299965,1cyclictest32076-21ssh21:12:553
36299965,1cyclictest30338-21kworker/3:222:25:273
36299965,1cyclictest27812-21ssh22:38:303
36299965,1cyclictest27115-21snmpd19:42:153
36299965,1cyclictest26759-21sshd21:02:343
36299965,1cyclictest24002-21ssh00:05:043
36299965,1cyclictest23039-21ssh23:15:573
36299965,1cyclictest22042-21ssh22:30:173
36299965,1cyclictest13968-21ssh23:05:053
36299965,1cyclictest11386-21ntpq20:30:183
36299965,0cyclictest29309-21diskmemload22:01:393
36299964,1cyclictest30223-21taskset20:03:193
36299964,1cyclictest27115-21snmpd21:08:143
36299964,1cyclictest27115-21snmpd20:35:443
36299964,1cyclictest27115-21snmpd20:14:393
36299964,0cyclictest29309-21diskmemload21:23:563
36299963,1cyclictest283-21systemd-udevd00:01:153
36299962,2cyclictest29309-21diskmemload21:35:103
36299961,4cyclictest5952-21perf19:15:003
36299961,3cyclictest2993-21ssh21:17:263
36299961,3cyclictest29309-21diskmemload23:35:133
36299961,3cyclictest24719-21grep19:50:183
36299961,3cyclictest0-21swapper/323:40:123
36299961,3cyclictest0-21swapper/320:50:093
36299960,6cyclictest0-21swapper/323:46:593
36299960,5cyclictest0-21swapper/323:10:093
36299960,4cyclictest0-21swapper/323:03:173
36299960,3cyclictest0-21swapper/322:45:153
36299960,2cyclictest0-21swapper/322:55:243
36299960,2cyclictest0-21swapper/321:55:233
36299960,1cyclictest29309-21diskmemload00:25:093
36219966,0cyclictest61250irq/122-eno123:15:112
36219966,0cyclictest61250irq/122-eno122:55:062
36219966,0cyclictest61250irq/122-eno120:06:512
36219966,0cyclictest61250irq/122-eno119:58:252
36219966,0cyclictest61250irq/122-eno119:38:032
36219966,0cyclictest61250irq/122-eno100:20:222
36219965,1cyclictest61250irq/122-eno123:40:092
36219965,1cyclictest61250irq/122-eno123:20:182
36219965,1cyclictest61250irq/122-eno122:05:142
36219965,1cyclictest61250irq/122-eno119:42:492
36219965,1cyclictest61250irq/122-eno119:30:112
36219965,1cyclictest1712-21ntpq20:10:202
36219965,1cyclictest0-21swapper/219:25:172
36219962,3cyclictest12710-21/usr/sbin/munin20:35:142
36219961,4cyclictest6933-21sh20:20:252
36219960,6cyclictest0-21swapper/220:34:402
36219960,5cyclictest27115-21snmpd00:10:202
36219960,5cyclictest0-21swapper/220:40:582
36139961,5cyclictest0-21swapper/120:13:181
36139960,6cyclictest0-21swapper/123:43:391
36139960,6cyclictest0-21swapper/122:50:161
36139960,6cyclictest0-21swapper/122:47:301
36139960,6cyclictest0-21swapper/122:43:081
36139960,6cyclictest0-21swapper/122:22:011
36139960,6cyclictest0-21swapper/122:19:251
36139960,6cyclictest0-21swapper/121:29:291
36139960,6cyclictest0-21swapper/120:31:521
36139960,6cyclictest0-21swapper/119:26:191
36139960,4cyclictest0-21swapper/123:47:141
36139960,4cyclictest0-21swapper/123:25:091
36139960,4cyclictest0-21swapper/123:03:351
36139960,4cyclictest0-21swapper/122:30:501
36139960,4cyclictest0-21swapper/121:31:351
36139960,4cyclictest0-21swapper/120:35:231
36139960,4cyclictest0-21swapper/100:20:091
36139960,3cyclictest0-21swapper/123:54:551
36139960,3cyclictest0-21swapper/123:32:201
36139960,3cyclictest0-21swapper/122:25:121
36139960,3cyclictest0-21swapper/122:13:511
36139960,3cyclictest0-21swapper/100:04:381
36139960,2cyclictest0-21swapper/121:50:281
36139960,1cyclictest0-21swapper/121:55:261
36139960,1cyclictest0-21swapper/121:20:041
36139960,1cyclictest0-21swapper/120:45:391
36139960,1cyclictest0-21swapper/120:40:021
36139960,0cyclictest0-21swapper/100:31:071
36089965,1cyclictest10223-21apt-get20:30:090
36089964,1cyclictest16548-21tail19:35:090
36089964,1cyclictest0-21swapper/021:30:250
36089963,1cyclictest259-21systemd-journal20:05:000
36089962,0cyclictest0-21swapper/020:40:120
36089960,6cyclictest0-21swapper/019:20:270
36089960,6cyclictest0-21swapper/019:15:210
36089960,5cyclictest29309-21diskmemload22:20:150
36089960,5cyclictest18766-21/usr/sbin/munin19:40:160
36089960,0cyclictest0-21swapper/023:30:090
36089960,0cyclictest0-21swapper/021:35:140
36089960,0cyclictest0-21swapper/021:00:450
36089960,0cyclictest0-21swapper/020:27:470
36089960,0cyclictest0-21swapper/020:27:470
36089960,0cyclictest0-21swapper/000:35:040
22682260,0sleep00-21swapper/021:45:170
36299954,1cyclictest27115-21snmpd20:47:373
36299954,1cyclictest27115-21snmpd19:32:023
36299954,1cyclictest14424-21ssh22:20:043
36299952,0cyclictest29309-21diskmemload21:30:183
36299951,3cyclictest9892-21seq20:28:553
36299951,3cyclictest9892-21seq20:28:543
36299951,3cyclictest17652-21sh23:55:173
36299951,2cyclictest0-21swapper/319:15:123
36299950,4cyclictest0-21swapper/320:55:123
36299950,2cyclictest0-21swapper/319:35:093
36299950,1cyclictest0-21swapper/322:10:583
36219954,1cyclictest61250irq/122-eno121:05:142
36219950,4cyclictest20971-21uname20:50:152
36139955,0cyclictest0-21swapper/119:20:251
36139955,0cyclictest0-21swapper/100:38:501
36139953,1cyclictest16268-21chrt23:06:511
36139950,5cyclictest0-21swapper/121:03:381
36139950,5cyclictest0-21swapper/120:22:181
36139950,5cyclictest0-21swapper/119:49:031
36139950,5cyclictest0-21swapper/119:15:071
36139950,2cyclictest0-21swapper/123:37:201
36139950,2cyclictest0-21swapper/120:15:221
36139950,1cyclictest0-21swapper/122:35:581
36139950,1cyclictest0-21swapper/121:40:011
36139950,1cyclictest0-21swapper/121:15:461
36139950,1cyclictest0-21swapper/100:17:141
36139950,0cyclictest0-21swapper/123:15:561
36139950,0cyclictest0-21swapper/122:56:311
36089954,1cyclictest17741-21telnet20:45:120
36089953,1cyclictest27115-21snmpd21:05:020
36089951,1cyclictest0-21swapper/020:15:100
36299940,3cyclictest5797-21tr20:20:143
36139944,0cyclictest0-21swapper/120:26:311
36139944,0cyclictest0-21swapper/120:26:311
36139942,1cyclictest0-21swapper/120:55:131
36139940,3cyclictest0-21swapper/119:52:551
36139940,2cyclictest0-21swapper/120:00:171
36139940,2cyclictest0-21swapper/119:55:171
36139940,2cyclictest0-21swapper/119:35:091
36139940,2cyclictest0-21swapper/119:10:171
36139940,0cyclictest0-21swapper/120:05:111
36089942,1cyclictest757-21runrttasks20:10:090
36139930,2cyclictest0-21swapper/121:05:111
36139930,1cyclictest0-21swapper/119:40:081
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional