You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-28 - 06:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Tue May 28, 2024 00:45:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
132492216153,50sleep00-21swapper/019:09:580
132152209147,22sleep30-21swapper/319:09:333
129852206150,22sleep10-21swapper/119:06:331
131772201160,27sleep20-21swapper/219:09:032
244052130,0sleep10-21swapper/100:35:111
1335299130,1cyclictest0-21swapper/223:32:482
1334599130,13cyclictest0-21swapper/121:50:111
1334599130,1cyclictest0-21swapper/123:45:131
1335299121,7cyclictest8603-21apt-get22:00:102
1334099113,4cyclictest27048-21perf23:55:010
1334099112,4cyclictest5175-21date22:39:590
13340991110,1cyclictest9-21ksoftirqd/022:50:210
1335299100,9cyclictest0-21swapper/221:51:462
25099290,1sleep20-21swapper/219:35:152
133589990,7cyclictest4629-21diskmemload21:24:463
133529990,9cyclictest0-21swapper/223:18:402
133529990,3cyclictest0-21swapper/221:48:322
133409992,6cyclictest9921-21ssh22:45:210
11482290,0sleep00-21swapper/022:03:400
21721280,0sleep20-21swapper/222:16:272
133589982,4cyclictest15790-21apt-get22:10:113
133589982,4cyclictest15790-21apt-get22:10:103
133589982,4cyclictest1406-21apt-get21:50:123
133589982,3cyclictest4629-21diskmemload22:50:213
133529986,1cyclictest8849-21snmpd23:25:422
133529986,1cyclictest8849-21snmpd21:38:492
133529986,1cyclictest61250irq/122-eno123:38:392
133529986,1cyclictest61250irq/122-eno123:21:182
133529986,1cyclictest61250irq/122-eno123:08:442
133529986,1cyclictest61250irq/122-eno100:04:592
133529984,2cyclictest530-21systemd-logind00:10:282
133529983,2cyclictest259-21systemd-journal21:34:552
133529981,4cyclictest25148-21grep23:50:312
133459985,2cyclictest0-21swapper/120:55:001
133459981,1cyclictest0-21swapper/123:18:161
133459980,7cyclictest0-21swapper/121:20:031
133459980,5cyclictest0-21swapper/120:10:101
133459980,1cyclictest0-21swapper/123:55:111
133409986,1cyclictest8849-21snmpd20:18:340
133409985,2cyclictest18741-21perf19:20:000
133409985,1cyclictest259-21systemd-journal20:00:010
133409985,1cyclictest259-21systemd-journal19:44:590
133409984,3cyclictest27766-21perf00:39:590
133409982,1cyclictest27267-21/usr/sbin/munin23:55:290
133409981,6cyclictest9585-21apt00:15:070
133409981,6cyclictest27351-21ssh23:10:120
133409981,6cyclictest26982-21apt-get22:25:100
133409980,7cyclictest12968-21hddtemp_smartct21:20:170
133409980,7cyclictest1100-21ssh22:33:510
133589976,1cyclictest8849-21snmpd23:55:223
133589976,1cyclictest8849-21snmpd23:44:143
133589976,1cyclictest8849-21snmpd22:41:063
133589976,1cyclictest8849-21snmpd22:39:263
133589976,1cyclictest8849-21snmpd22:19:383
133589976,1cyclictest8849-21snmpd21:29:333
133589976,1cyclictest8849-21snmpd20:48:213
133589976,1cyclictest8849-21snmpd00:15:163
133589976,1cyclictest2255-21aten_r1power_vo23:20:113
133589975,1cyclictest35-21ksoftirqd/323:00:013
133589975,1cyclictest22976-21ssh21:35:113
133589975,1cyclictest14430-21cat19:10:183
133589973,4cyclictest534-21nscd22:07:253
133589972,4cyclictest0-21swapper/323:50:133
133589972,3cyclictest17791-21/usr/sbin/munin19:15:253
133589971,3cyclictest0-21swapper/323:49:313
133589970,6cyclictest4629-21diskmemload21:58:333
133589970,5cyclictest0-21swapper/320:25:183
133589970,5cyclictest0-21swapper/300:00:233
133589970,3cyclictest0-21swapper/323:12:463
133589970,3cyclictest0-21swapper/323:05:063
133529977,0cyclictest0-21swapper/222:07:252
133529976,1cyclictest8849-21snmpd00:19:362
133529976,1cyclictest61250irq/122-eno123:13:082
133529976,1cyclictest61250irq/122-eno122:40:262
133529976,1cyclictest61250irq/122-eno122:40:002
133529976,1cyclictest61250irq/122-eno121:27:442
133529976,1cyclictest61250irq/122-eno100:30:172
133529976,1cyclictest61250irq/122-eno100:20:262
133529976,1cyclictest28-21ksoftirqd/221:16:232
133529975,1cyclictest8849-21snmpd22:46:202
133529975,1cyclictest8849-21snmpd00:08:272
133529975,1cyclictest61250irq/122-eno123:55:142
133529975,1cyclictest61250irq/122-eno123:45:002
133529975,1cyclictest61250irq/122-eno122:30:192
133529975,1cyclictest61250irq/122-eno120:20:142
133529975,1cyclictest61250irq/122-eno119:50:142
133529975,1cyclictest23387-21latency_hist23:05:012
133529973,2cyclictest530-21systemd-logind19:40:272
133529971,3cyclictest61250irq/122-eno100:35:122
133529971,3cyclictest29418-21sh21:43:252
133529970,6cyclictest0-21swapper/200:25:482
133529970,4cyclictest259-21systemd-journal20:55:012
133529970,4cyclictest0-21swapper/221:10:062
133529970,3cyclictest0-21swapper/221:55:102
133529970,1cyclictest0-21swapper/223:48:232
133529970,1cyclictest0-21swapper/222:55:102
133529970,1cyclictest0-21swapper/221:20:032
133459970,6cyclictest0-21swapper/122:46:461
133459970,5cyclictest0-21swapper/121:35:181
133459970,4cyclictest0-21swapper/122:20:111
133459970,4cyclictest0-21swapper/100:26:091
133459970,2cyclictest0-21swapper/123:53:361
133459970,2cyclictest0-21swapper/123:25:281
133459970,1cyclictest0-21swapper/120:35:131
133409976,1cyclictest8849-21snmpd19:51:570
133409976,1cyclictest17768-21sshd20:27:290
133409975,1cyclictest8849-21snmpd21:12:150
133409975,1cyclictest8849-21snmpd20:51:150
133409974,0cyclictest4629-21diskmemload22:10:380
133409974,0cyclictest4629-21diskmemload22:10:370
133409974,0cyclictest4629-21diskmemload00:21:180
133409972,4cyclictest0-21swapper/020:20:130
133409972,1cyclictest16067-21cstates21:25:140
133409971,5cyclictest31798-21ssh00:00:200
133409971,5cyclictest23725-21ssh23:05:100
133409971,3cyclictest19396-21sed19:24:590
133409970,6cyclictest6202-21ssh21:55:280
133409970,6cyclictest5842-21ssh23:25:130
133409970,6cyclictest4629-21diskmemload21:40:290
133409970,6cyclictest441-21chrt21:48:000
133409970,6cyclictest32225-1kworker/u9:023:20:060
133409970,6cyclictest26647-21gpgv22:25:000
133409970,6cyclictest20616-21ssh23:45:150
133409970,6cyclictest16976-21chrt00:25:000
133409970,6cyclictest14185-21ssh22:05:530
133409970,5cyclictest0-21swapper/021:50:200
133409970,4cyclictest5924-21/usr/sbin/munin00:10:270
133409970,3cyclictest0-21swapper/023:38:590
133409970,3cyclictest0-21swapper/019:45:140
133409970,2cyclictest16534-21grep22:55:100
133409970,1cyclictest9305-21apt-get23:30:130
133409970,1cyclictest4629-21diskmemload22:40:480
133409970,1cyclictest2643-21cstates00:05:140
133409970,1cyclictest222662sleep021:33:470
133409970,1cyclictest20040-21cstates22:15:130
133409970,1cyclictest0-21swapper/023:15:290
133409970,1cyclictest0-21swapper/023:03:320
133409970,1cyclictest0-21swapper/021:36:050
133409970,1cyclictest0-21swapper/000:30:260
133589965,1cyclictest8849-21snmpd20:50:593
133589965,1cyclictest8849-21snmpd20:12:263
133589965,1cyclictest8849-21snmpd19:46:193
133589965,1cyclictest8849-21snmpd19:39:403
133589965,1cyclictest8849-21snmpd19:23:483
133589965,1cyclictest6608-21cat23:25:183
133589965,1cyclictest31408-21ssh23:15:153
133589965,1cyclictest31361-21ntpq20:55:213
133589965,1cyclictest10393-21ssh21:15:543
133589964,1cyclictest7991-21ssh00:11:093
133589963,2cyclictest31779-21ntp_kernel_err22:30:213
133589962,1cyclictest13830-21df_inode00:20:133
133589961,3cyclictest4629-21diskmemload21:41:083
133589961,3cyclictest19575-21apt-get19:25:073
133589961,2cyclictest14628-21ntp_states20:20:213
133589960,6cyclictest0-21swapper/321:47:593
133589960,6cyclictest0-21swapper/300:35:553
133589960,3cyclictest0-21swapper/323:02:513
133589960,3cyclictest0-21swapper/322:45:543
133589960,3cyclictest0-21swapper/322:02:103
133589960,3cyclictest0-21swapper/319:40:253
133589960,3cyclictest0-21swapper/300:25:153
133529966,0cyclictest61250irq/122-eno122:50:422
133529966,0cyclictest61250irq/122-eno122:25:362
133529966,0cyclictest61250irq/122-eno120:35:292
133529966,0cyclictest61250irq/122-eno120:33:462
133529966,0cyclictest61250irq/122-eno120:26:022
133529966,0cyclictest61250irq/122-eno120:01:322
133529966,0cyclictest61250irq/122-eno119:45:072
133529966,0cyclictest61250irq/122-eno119:10:142
133529965,1cyclictest8849-21snmpd22:20:022
133529965,1cyclictest8849-21snmpd21:07:232
133529965,1cyclictest61250irq/122-eno121:00:122
133529964,1cyclictest757-21runrttasks19:25:072
133529962,1cyclictest16873-21/usr/sbin/munin22:10:212
133529962,1cyclictest16873-21/usr/sbin/munin22:10:202
133529960,6cyclictest0-21swapper/219:17:382
133529960,4cyclictest0-21swapper/220:45:152
133529960,0cyclictest0-21swapper/220:40:082
133529960,0cyclictest0-21swapper/220:05:122
133459966,0cyclictest0-21swapper/123:35:201
133459963,1cyclictest0-21swapper/120:45:271
133459960,6cyclictest0-21swapper/122:59:011
133459960,6cyclictest0-21swapper/120:43:321
133459960,6cyclictest0-21swapper/119:45:161
133459960,6cyclictest0-21swapper/100:30:461
133459960,5cyclictest0-21swapper/123:14:211
133459960,5cyclictest0-21swapper/122:51:171
133459960,5cyclictest0-21swapper/122:11:111
133459960,5cyclictest0-21swapper/122:11:111
133459960,5cyclictest0-21swapper/119:37:031
133459960,4cyclictest0-21swapper/122:30:281
133459960,3cyclictest0-21swapper/122:35:151
133459960,3cyclictest0-21swapper/100:15:061
133459960,2cyclictest0-21swapper/122:25:091
133459960,2cyclictest0-21swapper/121:45:171
133459960,2cyclictest0-21swapper/121:05:001
133459960,2cyclictest0-21swapper/120:30:121
133459960,1cyclictest0-21swapper/123:30:171
133459960,1cyclictest0-21swapper/123:00:101
133459960,1cyclictest0-21swapper/122:00:271
133459960,1cyclictest0-21swapper/120:20:081
133459960,1cyclictest0-21swapper/119:50:201
133459960,1cyclictest0-21swapper/119:19:541
133409965,1cyclictest8849-21snmpd20:03:470
133409962,3cyclictest26063-21gltestperf20:45:240
133409961,1cyclictest0-21swapper/019:25:070
133409960,6cyclictest23311-21ntp_states19:30:230
133409960,5cyclictest16496-21ssh23:40:080
133409960,1cyclictest0-21swapper/021:05:160
133409960,1cyclictest0-21swapper/019:36:580
133409960,0cyclictest0-21swapper/021:15:290
133409960,0cyclictest0-21swapper/020:40:120
133409960,0cyclictest0-21swapper/020:35:200
133409960,0cyclictest0-21swapper/019:13:380
133589955,0cyclictest10505-21kworker/3:121:01:373
133589954,1cyclictest9258-21ssh23:30:053
133589954,1cyclictest8849-21snmpd23:35:193
133589954,1cyclictest26975-21ssh22:25:093
133589953,1cyclictest8218-21runrttasks20:07:093
133589953,1cyclictest5105-21cpuspeed_turbos21:10:133
133589952,2cyclictest4629-21diskmemload22:20:403
133589951,3cyclictest22931-21apt-get20:40:083
133589951,2cyclictest259-21systemd-journal00:05:003
133589950,3cyclictest0-21swapper/321:05:103
133589950,2cyclictest0-21swapper/319:50:223
133589950,1cyclictest0-21swapper/300:30:013
133529955,0cyclictest61250irq/122-eno119:22:512
133529954,1cyclictest61250irq/122-eno120:55:092
133529954,1cyclictest61250irq/122-eno120:10:112
133529954,1cyclictest61250irq/122-eno119:30:012
133529953,1cyclictest11871-21grep20:15:122
133459953,1cyclictest25402sleep123:20:141
133459953,1cyclictest240942sleep119:33:051
133459951,2cyclictest0-21swapper/123:05:131
133459950,5cyclictest0-21swapper/119:43:041
133459950,5cyclictest0-21swapper/119:20:501
133459950,4cyclictest0-21swapper/100:21:031
133459950,3cyclictest196-21jbd2/sda2-819:25:311
133459950,3cyclictest0-21swapper/123:40:121
133459950,3cyclictest0-21swapper/121:05:111
133459950,3cyclictest0-21swapper/100:11:171
133459950,3cyclictest0-21swapper/100:02:591
133459950,2cyclictest0-21swapper/122:43:041
133459950,2cyclictest0-21swapper/121:30:301
133459950,2cyclictest0-21swapper/120:55:131
133459950,2cyclictest0-21swapper/100:05:131
133459950,1cyclictest0-21swapper/122:15:101
133459950,1cyclictest0-21swapper/122:09:461
133459950,1cyclictest0-21swapper/121:42:201
133459950,1cyclictest0-21swapper/121:25:221
133459950,1cyclictest0-21swapper/121:15:081
133459950,1cyclictest0-21swapper/121:10:351
133409951,2cyclictest20267-21runrttasks20:34:230
133409950,5cyclictest0-21swapper/021:04:160
133409950,5cyclictest0-21swapper/020:56:370
133409950,5cyclictest0-21swapper/020:11:100
133409950,2cyclictest0-21swapper/020:05:170
133589944,0cyclictest8849-21snmpd19:34:293
133589942,2cyclictest13331-21cyclictest19:55:203
133589942,1cyclictest18820-21fschecks_time20:30:153
133589941,2cyclictest19335-21sh21:30:083
133589940,3cyclictest12643-21timerwakeupswit20:15:233
133589940,3cyclictest0-21swapper/320:35:113
133589940,1cyclictest4364-21cstates20:00:153
133529944,0cyclictest61250irq/122-eno119:55:052
133459942,1cyclictest0-21swapper/119:10:101
133459941,2cyclictest0-21swapper/120:00:111
133459940,4cyclictest0-21swapper/120:25:091
133459940,3cyclictest0-21swapper/121:55:121
133459940,2cyclictest0-21swapper/120:05:121
133459940,1cyclictest0-21swapper/120:15:111
133459931,1cyclictest0-21swapper/119:55:091
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional