You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-20 - 00:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Fri Apr 19, 2024 12:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
325512234160,25sleep30-21swapper/307:06:443
3102229157,25sleep20-21swapper/207:09:402
325232212158,42sleep00-21swapper/007:06:200
327202202163,26sleep10-21swapper/107:08:551
42499180,5cyclictest0-21swapper/111:25:091
193892150,1sleep09-21ksoftirqd/009:44:240
419991412,1cyclictest9-21ksoftirqd/011:40:000
41999134,6cyclictest790-21lldpd10:41:400
419991210,1cyclictest9-21ksoftirqd/009:25:000
419991210,1cyclictest9-21ksoftirqd/008:04:590
419991110,1cyclictest9-21ksoftirqd/010:00:000
42999109,1cyclictest28-21ksoftirqd/212:05:302
429991010,0cyclictest0-21swapper/210:52:282
42999100,9cyclictest12433-21/usr/sbin/munin09:35:192
41999109,1cyclictest9-21ksoftirqd/012:30:110
41999109,1cyclictest9-21ksoftirqd/007:15:010
41999108,1cyclictest9-21ksoftirqd/011:25:110
41999102,4cyclictest14205-21perf08:45:010
41999100,5cyclictest26676-21perf10:40:000
4339997,1cyclictest35-21ksoftirqd/312:11:513
4339993,6cyclictest2881-21munin-node09:41:583
4299999,0cyclictest0-21swapper/212:10:362
4299998,1cyclictest28-21ksoftirqd/212:30:132
4299998,1cyclictest28-21ksoftirqd/211:25:002
4299998,1cyclictest28-21ksoftirqd/211:05:142
4299998,1cyclictest28-21ksoftirqd/210:30:012
4299998,1cyclictest28-21ksoftirqd/209:25:142
4299996,2cyclictest28-21ksoftirqd/212:04:372
4299991,4cyclictest0-21swapper/207:55:012
4299990,7cyclictest202662sleep208:55:202
4199998,1cyclictest9-21ksoftirqd/010:25:000
4199997,1cyclictest9-21ksoftirqd/009:25:010
4199994,4cyclictest0-21swapper/012:35:210
4199992,6cyclictest9-21ksoftirqd/012:02:130
4199991,6cyclictest1470-21sendmail-mta11:06:080
4199990,3cyclictest12174-21awk09:35:000
4199990,1cyclictest25944-21diskmemload09:35:220
4199990,1cyclictest0-21swapper/010:00:100
4339987,1cyclictest35-21ksoftirqd/308:50:003
4339986,1cyclictest8849-21snmpd09:33:473
4339986,1cyclictest8849-21snmpd07:18:463
4339980,3cyclictest0-21swapper/310:53:263
4339980,0cyclictest0-21swapper/308:40:103
4299988,0cyclictest28-21ksoftirqd/211:10:162
4299987,1cyclictest28-21ksoftirqd/211:55:202
4299987,1cyclictest28-21ksoftirqd/211:20:182
4299986,1cyclictest28-21ksoftirqd/209:54:182
4299986,1cyclictest28-21ksoftirqd/208:15:002
4299985,2cyclictest9550-21munin-run10:15:002
4299983,2cyclictest259-21systemd-journal10:45:002
4299981,6cyclictest8849-21snmpd09:41:262
4299981,6cyclictest0-21swapper/211:50:222
4299981,5cyclictest25944-21diskmemload12:35:132
4299980,6cyclictest0-21swapper/210:58:592
4299980,6cyclictest0-21swapper/210:58:592
4249986,1cyclictest326312sleep109:18:111
4249980,4cyclictest0-21swapper/110:02:571
4199988,0cyclictest9-21ksoftirqd/011:45:000
4199987,1cyclictest9-21ksoftirqd/012:25:130
4199987,1cyclictest9-21ksoftirqd/011:55:140
4199987,1cyclictest9-21ksoftirqd/008:50:120
4199986,1cyclictest9-21ksoftirqd/010:05:140
4199986,1cyclictest9-21ksoftirqd/008:50:000
4199986,1cyclictest8849-21snmpd10:59:490
4199986,1cyclictest8849-21snmpd10:59:490
4199986,1cyclictest8849-21snmpd08:14:380
4199986,1cyclictest11826-21sendmail-msp08:40:000
4199985,3cyclictest534-21nscd07:10:160
4199983,1cyclictest9-21ksoftirqd/011:10:130
4199982,6cyclictest25944-21diskmemload10:11:270
4199982,0cyclictest25944-21diskmemload09:46:450
4199980,7cyclictest7188-21ssh12:24:270
4199980,7cyclictest27415-21ssh12:06:390
4199980,7cyclictest25949-21ssh11:20:320
4199980,7cyclictest22528-21ssh11:16:170
4199980,7cyclictest21976-21ssh10:32:240
4199980,1cyclictest32214-21ssh12:14:530
17932280,0sleep30-21swapper/312:38:153
8179270,0sleep30-21swapper/309:29:143
4339976,1cyclictest8849-21snmpd11:14:233
4339976,1cyclictest8849-21snmpd11:07:353
4339976,1cyclictest8849-21snmpd10:40:343
4339976,1cyclictest8849-21snmpd09:55:113
4339976,1cyclictest8849-21snmpd09:16:043
4339976,1cyclictest8849-21snmpd07:56:143
4339976,1cyclictest8849-21snmpd07:33:343
4339976,1cyclictest35-21ksoftirqd/307:15:003
4339976,1cyclictest21326-21cat07:50:193
4339975,1cyclictest8849-21snmpd10:48:073
4339975,1cyclictest8849-21snmpd08:21:233
4339975,1cyclictest8849-21snmpd07:47:493
4339975,1cyclictest8191-21cat08:30:173
4339973,0cyclictest25944-21diskmemload09:22:553
4339970,4cyclictest0-21swapper/312:16:323
4339970,4cyclictest0-21swapper/310:28:333
4339970,3cyclictest0-21swapper/311:56:303
4339970,3cyclictest0-21swapper/311:20:133
4339970,3cyclictest0-21swapper/309:54:353
4339970,2cyclictest0-21swapper/312:26:203
4339970,2cyclictest0-21swapper/311:40:043
4339970,2cyclictest0-21swapper/311:29:323
4339970,2cyclictest0-21swapper/311:00:453
4339970,2cyclictest0-21swapper/310:10:553
4339970,1cyclictest757-21runrttasks10:38:423
4299976,1cyclictest61250irq/122-eno112:15:142
4299976,1cyclictest61250irq/122-eno110:30:162
4299976,1cyclictest61250irq/122-eno110:15:132
4299976,1cyclictest61250irq/122-eno110:06:512
4299976,1cyclictest61250irq/122-eno109:49:022
4299976,1cyclictest61250irq/122-eno107:50:152
4299976,1cyclictest28-21ksoftirqd/211:35:132
4299976,1cyclictest28-21ksoftirqd/210:20:102
4299976,1cyclictest28-21ksoftirqd/210:00:202
4299976,1cyclictest28-21ksoftirqd/207:15:002
4299976,0cyclictest61250irq/122-eno108:15:012
4299975,1cyclictest9964-21ssh09:30:192
4299975,1cyclictest8849-21snmpd12:21:492
4299975,1cyclictest8849-21snmpd10:40:042
4299975,1cyclictest8849-21snmpd08:06:052
4299975,1cyclictest7417-21ssh11:40:142
4299975,1cyclictest61250irq/122-eno107:30:122
4299975,1cyclictest32517-21cat11:30:162
4299975,1cyclictest28-21ksoftirqd/211:45:172
4299975,1cyclictest28-21ksoftirqd/210:35:222
4299975,1cyclictest28-21ksoftirqd/209:15:142
4299974,2cyclictest25944-21diskmemload09:10:112
4299973,2cyclictest259-21systemd-journal08:25:002
4299970,5cyclictest417-21cyclictest11:16:592
4249971,6cyclictest0-21swapper/112:04:581
4249971,4cyclictest0-21swapper/107:15:001
4249970,6cyclictest0-21swapper/111:11:261
4249970,6cyclictest0-21swapper/110:41:041
4249970,5cyclictest0-21swapper/112:25:131
4249970,5cyclictest0-21swapper/111:56:231
4249970,4cyclictest0-21swapper/109:35:041
4249970,3cyclictest0-21swapper/110:05:161
4249970,1cyclictest0-21swapper/110:20:071
4249970,1cyclictest0-21swapper/109:48:371
4199976,1cyclictest9-21ksoftirqd/008:25:000
4199976,1cyclictest9-21ksoftirqd/008:00:000
4199976,1cyclictest8849-21snmpd08:58:570
4199976,1cyclictest8849-21snmpd07:48:520
4199976,1cyclictest26174-1kworker/u9:109:12:120
4199975,1cyclictest958-21users11:30:230
4199972,4cyclictest0-21swapper/012:15:180
4199972,3cyclictest12079-21uname07:30:180
4199972,1cyclictest23659-21/usr/sbin/munin09:50:120
4199971,6cyclictest29898-1kworker/u9:209:15:120
4199971,1cyclictest10308-21apt-get11:45:120
4199970,6cyclictest25944-21diskmemload10:46:380
4199970,6cyclictest12387-1kworker/u9:211:50:150
4199970,6cyclictest1235-1kworker/u9:010:50:030
4199970,6cyclictest11305-21ssh11:00:370
4199970,6cyclictest0-21swapper/008:25:160
4199970,4cyclictest0-21swapper/007:50:130
4199970,1cyclictest15706-21ssh10:25:040
4199970,1cyclictest10078-21ssh10:15:210
4199970,1cyclictest0-21swapper/009:02:280
14680270,5sleep20-21swapper/207:35:242
4339965,1cyclictest8849-21snmpd09:48:383
4339965,1cyclictest8849-21snmpd08:16:323
4339965,1cyclictest8849-21snmpd08:08:263
4339965,1cyclictest8849-21snmpd07:20:193
4339965,1cyclictest7188-21ssh12:24:263
4339965,1cyclictest24048-21ssh12:02:373
4339965,1cyclictest22624-21ssh11:16:353
4339965,1cyclictest21258-21ssh10:30:233
4339965,1cyclictest16900-21ntpq07:40:183
4339965,1cyclictest1334-21ssh11:31:263
4339965,1cyclictest10084-21ssh10:15:223
4339964,1cyclictest8849-21snmpd10:20:063
4339964,1cyclictest14927-21ssh09:37:163
4339964,0cyclictest25944-21diskmemload10:05:033
4339963,1cyclictest530-21systemd-logind09:05:233
4339963,1cyclictest259-21systemd-journal08:15:003
4339962,3cyclictest0-21swapper/311:35:113
4339961,4cyclictest757-21runrttasks10:55:123
4339961,4cyclictest757-21runrttasks10:55:123
4339961,4cyclictest11338-21apt-get12:30:103
4339961,2cyclictest7074-21latency_hist08:30:003
4339960,5cyclictest31605-21ssh10:00:133
4339960,2cyclictest531-21irqbalance12:07:433
4339960,2cyclictest27857-21timerwakeupswit09:10:223
4339960,2cyclictest0-21swapper/311:50:173
4299966,0cyclictest61250irq/122-eno112:25:162
4299966,0cyclictest61250irq/122-eno109:58:312
4299966,0cyclictest61250irq/122-eno108:25:222
4299966,0cyclictest61250irq/122-eno107:45:112
4299966,0cyclictest61250irq/122-eno107:25:122
4299966,0cyclictest61250irq/122-eno107:20:012
4299965,1cyclictest61250irq/122-eno111:01:202
4299965,1cyclictest10811-21ntpq08:35:172
4299964,1cyclictest61250irq/122-eno109:05:112
4299964,1cyclictest28-21ksoftirqd/208:40:122
4299964,1cyclictest28-21ksoftirqd/208:35:002
4299963,2cyclictest27055-21grep08:00:262
4299960,6cyclictest0-21swapper/207:19:282
4299960,5cyclictest2875-21awk09:20:222
4299960,5cyclictest0-21swapper/207:41:552
4249962,1cyclictest0-21swapper/112:35:161
4249960,6cyclictest0-21swapper/109:58:201
4249960,6cyclictest0-21swapper/108:24:241
4249960,6cyclictest0-21swapper/107:49:471
4249960,6cyclictest0-21swapper/107:30:161
4249960,6cyclictest0-21swapper/107:21:251
4249960,4cyclictest0-21swapper/112:20:281
4249960,4cyclictest0-21swapper/110:54:521
4249960,4cyclictest0-21swapper/109:11:101
4249960,3cyclictest0-21swapper/111:40:061
4249960,3cyclictest0-21swapper/111:00:121
4249960,3cyclictest0-21swapper/110:38:011
4249960,3cyclictest0-21swapper/110:31:131
4249960,2cyclictest0-21swapper/111:21:281
4249960,2cyclictest0-21swapper/110:57:451
4249960,2cyclictest0-21swapper/110:57:451
4249960,2cyclictest0-21swapper/109:31:081
4249960,2cyclictest0-21swapper/109:21:531
4249960,2cyclictest0-21swapper/108:47:091
4249960,2cyclictest0-21swapper/107:50:211
4249960,1cyclictest0-21swapper/112:30:401
4249960,1cyclictest0-21swapper/111:33:061
4249960,1cyclictest0-21swapper/111:16:401
4249960,1cyclictest0-21swapper/110:45:211
4249960,1cyclictest0-21swapper/110:25:291
4249960,0cyclictest0-21swapper/109:25:011
4199965,1cyclictest9-21ksoftirqd/008:15:000
4199965,1cyclictest8849-21snmpd08:34:170
4199965,1cyclictest8849-21snmpd07:42:100
4199964,1cyclictest9-21ksoftirqd/008:07:200
4199960,6cyclictest0-21swapper/007:29:150
4199960,1cyclictest259-21systemd-journal07:39:550
4199960,0cyclictest0-21swapper/009:07:040
4199960,0cyclictest0-21swapper/007:20:190
4339955,0cyclictest757-21runrttasks08:35:593
4339954,1cyclictest12245-21ssh11:45:473
4339953,1cyclictest13454-21head07:35:123
4339952,1cyclictest19604-21df08:55:143
4339950,1cyclictest21479-21apt-get09:00:123
4299955,0cyclictest61250irq/122-eno108:50:062
4299953,1cyclictest28-21ksoftirqd/209:00:122
4299953,1cyclictest14393-21/usr/sbin/munin08:45:162
4249955,0cyclictest0-21swapper/111:48:251
4249955,0cyclictest0-21swapper/109:52:421
4249955,0cyclictest0-21swapper/107:15:361
4249951,1cyclictest0-21swapper/108:20:001
4249950,5cyclictest0-21swapper/112:05:341
4249950,5cyclictest0-21swapper/111:51:231
4249950,5cyclictest0-21swapper/108:50:421
4249950,5cyclictest0-21swapper/108:33:181
4249950,5cyclictest0-21swapper/107:28:371
4249950,3cyclictest0-21swapper/112:10:451
4249950,3cyclictest0-21swapper/108:55:231
4249950,2cyclictest0-21swapper/112:15:121
4249950,2cyclictest0-21swapper/111:05:131
4249950,2cyclictest0-21swapper/108:25:211
4249950,1cyclictest0-21swapper/110:19:201
4249950,1cyclictest0-21swapper/110:14:401
4249950,1cyclictest0-21swapper/109:40:181
4339942,1cyclictest10303-21tail07:25:203
4339940,2cyclictest26384-21/usr/sbin/munin08:00:183
4339940,1cyclictest17018-21cpuspeed_turbos08:50:143
4249944,0cyclictest0-21swapper/108:11:401
4249944,0cyclictest0-21swapper/107:42:171
4249942,1cyclictest0-21swapper/107:35:161
4249940,4cyclictest0-21swapper/108:05:211
4249940,2cyclictest0-21swapper/108:40:101
4249940,1cyclictest0-21swapper/111:35:091
4249940,1cyclictest0-21swapper/107:55:151
4249940,0cyclictest0-21swapper/109:04:221
4249940,0cyclictest0-21swapper/108:02:011
4249931,1cyclictest0-21swapper/109:05:101
4249931,1cyclictest0-21swapper/108:35:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional