You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-26 - 16:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack1slot1.osadl.org (updated Fri Apr 26, 2024 12:45:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
253092212149,21sleep30-21swapper/307:06:193
252542211148,21sleep00-21swapper/007:05:360
254572203163,26sleep20-21swapper/207:08:152
255082198159,26sleep10-21swapper/107:08:551
316312630,0sleep20-21swapper/209:30:002
316312630,0sleep20-21swapper/209:30:002
52402130,0sleep00-21swapper/008:45:100
2568399123,4cyclictest32314-21perf11:40:000
2569899119,2cyclictest8849-21snmpd12:21:442
2569899119,1cyclictest28-21ksoftirqd/210:01:192
25706991010,0cyclictest0-21swapper/308:50:583
2569899108,1cyclictest28-21ksoftirqd/211:25:002
2569899108,1cyclictest28-21ksoftirqd/210:55:382
2568399108,1cyclictest9-21ksoftirqd/008:09:590
2568399106,3cyclictest757-21runrttasks11:20:520
2568399100,7cyclictest28038-21munin-node11:14:050
257069999,0cyclictest35-21ksoftirqd/311:35:003
256989999,0cyclictest0-21swapper/210:23:062
256989992,4cyclictest16797-21diskmemload10:15:152
256989990,4cyclictest259-21systemd-journal07:15:002
256909999,0cyclictest0-21swapper/107:51:581
256909998,1cyclictest0-21swapper/110:55:181
256909990,7cyclictest0-21swapper/109:21:361
256839995,3cyclictest3346-21ssh11:44:310
256839990,4cyclictest6562-21gpgv09:40:000
256839990,1cyclictest259-21systemd-journal07:40:010
16071290,0sleep00-21swapper/011:16:010
16071290,0sleep00-21swapper/011:16:010
257069987,1cyclictest8849-21snmpd11:36:263
257069987,1cyclictest299552sleep309:25:303
257069987,1cyclictest299552sleep309:25:303
257069986,1cyclictest8849-21snmpd09:15:003
257069986,1cyclictest8849-21snmpd08:11:133
257069986,1cyclictest8849-21snmpd08:04:133
257069984,2cyclictest259-21systemd-journal10:59:153
257069981,0cyclictest0-21swapper/308:55:203
256989986,2cyclictest28-21ksoftirqd/210:45:192
256989986,1cyclictest8849-21snmpd10:29:092
256989986,1cyclictest61250irq/122-eno111:55:212
256989986,1cyclictest61250irq/122-eno111:39:592
256989986,1cyclictest28-21ksoftirqd/209:40:012
256989986,1cyclictest28-21ksoftirqd/208:45:002
256989983,2cyclictest259-21systemd-journal10:54:592
256989982,3cyclictest16797-21diskmemload10:10:082
256989981,6cyclictest25679-21cyclictest11:09:362
256989980,8cyclictest25679-21cyclictest10:05:242
256989980,1cyclictest0-21swapper/209:15:192
256909981,6cyclictest0-21swapper/107:21:061
256909981,3cyclictest0-21swapper/111:07:251
256909980,5cyclictest0-21swapper/110:40:061
256839986,1cyclictest8849-21snmpd08:57:060
256839984,2cyclictest9-21ksoftirqd/011:09:310
256839984,1cyclictest16797-21diskmemload10:20:470
256839981,6cyclictest19558-21ssh10:40:090
256839981,4cyclictest8289-21latency_hist12:35:010
256839981,1cyclictest30326-21ssh09:26:340
256839981,1cyclictest30326-21ssh09:26:330
256839981,1cyclictest12781-21ssh10:30:130
256839980,7cyclictest6927-21ssh11:49:130
256839980,7cyclictest19730-21ssh09:13:000
256839980,6cyclictest25197-21ssh10:04:330
256839980,5cyclictest0-21swapper/012:35:100
257069976,1cyclictest8849-21snmpd10:26:513
257069976,1cyclictest18683-21cat11:20:143
257069975,1cyclictest8849-21snmpd11:26:233
257069975,1cyclictest8849-21snmpd09:30:533
257069975,1cyclictest6562-21ssh11:48:093
257069975,1cyclictest28116-21ssh10:06:293
257069975,0cyclictest16797-21diskmemload10:13:033
257069974,1cyclictest16797-21diskmemload12:01:303
257069973,3cyclictest25679-21cyclictest09:54:523
257069973,1cyclictest16797-21diskmemload12:05:533
257069972,2cyclictest27380-21sendmail08:20:013
257069971,4cyclictest0-21swapper/309:49:373
257069971,3cyclictest20513-21apt-get08:05:103
257069970,6cyclictest10187-21ssh12:35:273
257069970,5cyclictest0-21swapper/310:51:303
257069970,5cyclictest0-21swapper/310:00:063
257069970,3cyclictest16797-21diskmemload11:10:243
257069970,3cyclictest0-21swapper/309:35:503
257069970,0cyclictest0-21swapper/312:25:113
257069970,0cyclictest0-21swapper/311:02:103
257069970,0cyclictest0-21swapper/310:30:513
257069970,0cyclictest0-21swapper/310:16:533
256989976,1cyclictest61250irq/122-eno112:16:582
256989976,1cyclictest61250irq/122-eno111:48:332
256989976,1cyclictest61250irq/122-eno111:00:472
256989976,1cyclictest61250irq/122-eno110:35:232
256989976,1cyclictest61250irq/122-eno109:30:122
256989976,1cyclictest61250irq/122-eno109:00:092
256989975,1cyclictest8849-21snmpd08:56:132
256989975,1cyclictest61250irq/122-eno112:25:112
256989975,1cyclictest61250irq/122-eno112:05:132
256989975,1cyclictest61250irq/122-eno111:30:132
256989975,1cyclictest61250irq/122-eno110:40:092
256989975,1cyclictest61250irq/122-eno108:20:212
256989974,1cyclictest61250irq/122-eno110:30:132
256989972,2cyclictest11324-21grep09:45:152
256989971,5cyclictest534-21nscd11:17:182
256989971,5cyclictest534-21nscd11:17:172
256989971,2cyclictest12042-21sh11:10:532
256989971,1cyclictest23551-21chrt11:26:122
256989971,1cyclictest16797-21diskmemload09:10:092
256989970,4cyclictest24441-21apt-get09:20:112
256989970,4cyclictest0-21swapper/212:31:072
256989970,3cyclictest7596-21apt-get08:50:082
256989970,3cyclictest0-21swapper/212:36:292
256989970,3cyclictest0-21swapper/208:00:132
256909976,1cyclictest0-21swapper/112:20:011
256909971,6cyclictest0-21swapper/109:50:081
256909971,6cyclictest0-21swapper/108:42:361
256909971,3cyclictest0-21swapper/107:45:111
256909970,4cyclictest0-21swapper/112:30:031
256909970,3cyclictest0-21swapper/112:26:121
256909970,3cyclictest0-21swapper/110:31:561
256909970,3cyclictest0-21swapper/108:40:001
256909970,1cyclictest0-21swapper/112:01:271
256909970,1cyclictest0-21swapper/110:19:581
256839976,1cyclictest8849-21snmpd07:31:090
256839976,1cyclictest19543-21taskset12:05:150
256839976,1cyclictest16797-21diskmemload10:37:260
256839975,1cyclictest8849-21snmpd09:45:040
256839975,1cyclictest8849-21snmpd07:10:580
256839975,1cyclictest8737-21ntpq08:50:170
256839975,1cyclictest564-21ssh10:55:400
256839975,1cyclictest27314-21ssh11:31:230
256839975,1cyclictest16662-21ssh09:51:220
256839975,1cyclictest0-21swapper/009:40:110
256839972,2cyclictest259-21systemd-journal07:55:000
256839972,1cyclictest18198-21/usr/sbin/munin09:55:190
256839971,6cyclictest26258-21ssh10:48:130
256839971,6cyclictest0-21swapper/008:30:560
256839970,6cyclictest7434-21ssh11:50:030
256839970,6cyclictest7392-1kworker/u9:210:25:380
256839970,6cyclictest3843-21ssh10:18:400
256839970,6cyclictest27354-21ssh10:50:040
256839970,6cyclictest2633-21tr11:00:140
256839970,6cyclictest26082-21apt-config10:05:120
256839970,6cyclictest24424-21ssh09:20:100
256839970,6cyclictest16903-21date09:10:000
256839970,6cyclictest0-21swapper/012:15:110
256839970,6cyclictest0-21swapper/012:00:280
256839970,6cyclictest0-21swapper/011:25:150
256839970,6cyclictest0-21swapper/009:30:160
256839970,1cyclictest31798-21ssh10:11:290
256839970,1cyclictest30669-21ssh12:20:160
256839970,1cyclictest16797-21diskmemload09:15:010
256839970,1cyclictest0-21swapper/012:10:170
256839970,0cyclictest0-21swapper/008:35:080
257069965,1cyclictest9376-21ssh11:50:393
257069965,1cyclictest8849-21snmpd09:01:283
257069965,1cyclictest8849-21snmpd08:44:563
257069965,1cyclictest8849-21snmpd08:29:093
257069965,1cyclictest28423-21ssh12:16:443
257069965,1cyclictest25437-21ssh10:45:513
257069964,1cyclictest8849-21snmpd09:05:213
257069964,1cyclictest8849-21snmpd07:57:013
257069964,1cyclictest8849-21snmpd07:10:063
257069963,1cyclictest530-21systemd-logind12:10:233
257069963,1cyclictest259-21systemd-journal07:40:003
257069962,1cyclictest530-21systemd-logind12:32:163
257069961,3cyclictest11110-21/usr/sbin/munin11:55:183
257069961,1cyclictest0-21swapper/311:15:103
257069961,1cyclictest0-21swapper/311:15:103
257069961,1cyclictest0-21swapper/309:14:013
257069960,5cyclictest0-21swapper/311:08:003
257069960,4cyclictest0-21swapper/311:42:213
257069960,3cyclictest0-21swapper/309:56:503
257069960,3cyclictest0-21swapper/309:20:373
257069960,2cyclictest259-21systemd-journal10:20:003
257069960,2cyclictest0-21swapper/310:41:443
257069960,2cyclictest0-21swapper/310:35:103
257069960,2cyclictest0-21swapper/309:40:033
257069960,1cyclictest0-21swapper/312:20:103
256989966,0cyclictest61250irq/122-eno109:55:162
256989966,0cyclictest61250irq/122-eno109:50:112
256989966,0cyclictest61250irq/122-eno109:05:162
256989966,0cyclictest61250irq/122-eno108:35:492
256989966,0cyclictest61250irq/122-eno108:34:472
256989966,0cyclictest61250irq/122-eno108:26:072
256989966,0cyclictest61250irq/122-eno107:55:112
256989966,0cyclictest61250irq/122-eno107:45:142
256989966,0cyclictest61250irq/122-eno107:40:382
256989966,0cyclictest61250irq/122-eno107:16:342
256989965,1cyclictest61250irq/122-eno112:00:132
256989965,1cyclictest61250irq/122-eno111:50:152
256989964,1cyclictest8849-21snmpd08:06:192
256989964,1cyclictest8849-21snmpd07:37:052
256989964,1cyclictest61250irq/122-eno108:15:212
256989964,1cyclictest3049-21ssh09:35:042
256989960,6cyclictest0-21swapper/211:40:062
256989960,5cyclictest0-21swapper/207:22:402
256989960,4cyclictest0-21swapper/212:10:112
256909960,6cyclictest0-21swapper/110:52:371
256909960,6cyclictest0-21swapper/110:09:031
256909960,6cyclictest0-21swapper/109:40:281
256909960,6cyclictest0-21swapper/109:30:201
256909960,6cyclictest0-21swapper/109:18:551
256909960,6cyclictest0-21swapper/108:55:241
256909960,6cyclictest0-21swapper/107:26:551
256909960,5cyclictest0-21swapper/109:08:061
256909960,5cyclictest0-21swapper/108:30:411
256909960,4cyclictest0-21swapper/112:05:111
256909960,4cyclictest0-21swapper/111:20:101
256909960,4cyclictest0-21swapper/111:10:361
256909960,4cyclictest0-21swapper/110:10:151
256909960,4cyclictest0-21swapper/110:00:341
256909960,4cyclictest0-21swapper/109:55:061
256909960,3cyclictest0-21swapper/112:17:201
256909960,3cyclictest0-21swapper/110:25:011
256909960,2cyclictest0-21swapper/112:35:181
256909960,2cyclictest0-21swapper/111:44:021
256909960,2cyclictest0-21swapper/110:45:121
256909960,1cyclictest0-21swapper/111:27:031
256909960,1cyclictest0-21swapper/111:18:091
256909960,1cyclictest0-21swapper/111:18:081
256909960,1cyclictest0-21swapper/108:20:161
256909960,1cyclictest0-21swapper/108:03:461
256909960,0cyclictest0-21swapper/111:52:581
256909960,0cyclictest0-21swapper/111:35:021
256909960,0cyclictest0-21swapper/108:15:101
256839965,1cyclictest9-21ksoftirqd/008:20:000
256839965,1cyclictest8849-21snmpd08:41:260
256839962,1cyclictest259-21systemd-journal07:59:590
256839960,6cyclictest0-21swapper/007:25:470
256839960,5cyclictest783-21sshd08:03:490
256839960,5cyclictest31299-21/usr/sbin/munin07:20:200
256839960,5cyclictest11067-21ssh11:55:000
256839960,5cyclictest10673-21/usr/sbin/munin07:45:230
256839960,5cyclictest0-21swapper/008:20:180
256839960,0cyclictest16797-21diskmemload12:25:310
256839960,0cyclictest0-21swapper/009:00:090
256839960,0cyclictest0-21swapper/007:17:310
257069955,0cyclictest0-21swapper/308:22:443
257069954,1cyclictest32474-21ntpq07:20:193
257069953,1cyclictest8849-21snmpd08:38:383
257069953,1cyclictest30575-21/usr/sbin/munin08:30:093
257069953,1cyclictest30059-21ntp_kernel_err07:15:213
257069953,1cyclictest10135-21taskset07:41:163
257069952,2cyclictest13910-21/usr/sbin/munin07:50:183
257069951,2cyclictest0-21swapper/308:45:093
257069950,4cyclictest12915-21date07:50:003
257069950,0cyclictest0-21swapper/307:25:563
256989955,0cyclictest61250irq/122-eno108:45:152
256989953,1cyclictest13604-21cut07:50:152
256989952,2cyclictest3893-21cut07:30:132
256909955,0cyclictest0-21swapper/112:10:211
256909950,5cyclictest0-21swapper/107:38:071
256909950,3cyclictest0-21swapper/111:30:121
256909950,3cyclictest0-21swapper/109:46:331
256909950,2cyclictest0-21swapper/110:35:111
256909950,2cyclictest0-21swapper/110:20:161
256909950,2cyclictest0-21swapper/109:26:351
256909950,2cyclictest0-21swapper/109:26:341
256909950,1cyclictest0-21swapper/111:57:321
256909950,1cyclictest0-21swapper/111:00:131
256909950,1cyclictest0-21swapper/109:35:121
256909950,1cyclictest0-21swapper/109:12:021
256909950,1cyclictest0-21swapper/107:15:121
256909950,0cyclictest0-21swapper/111:45:521
256839953,1cyclictest8849-21snmpd08:28:000
256839951,4cyclictest8475-21telnet07:40:110
256839950,1cyclictest0-21swapper/008:10:100
257069944,0cyclictest4997-21sensors07:30:253
256989943,1cyclictest61250irq/122-eno107:25:132
256989940,3cyclictest0-21swapper/208:10:102
256909941,3cyclictest0-21swapper/108:45:181
256909941,1cyclictest0-21swapper/107:55:121
256909940,2cyclictest0-21swapper/109:00:211
256909940,2cyclictest0-21swapper/107:10:101
256909940,1cyclictest0-21swapper/108:05:151
256909940,0cyclictest0-21swapper/108:52:041
256909940,0cyclictest0-21swapper/107:30:251
256909931,1cyclictest0-21swapper/108:10:091
256909930,1cyclictest0-21swapper/108:28:131
256909930,1cyclictest0-21swapper/107:40:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional