You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 20:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack1slot1.osadl.org (updated Sat Apr 27, 2024 12:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
114522217162,44sleep00-21swapper/007:05:040
134322200162,24sleep10-21swapper/107:08:141
133292199159,26sleep20-21swapper/207:06:542
133302198158,26sleep30-21swapper/307:06:553
161232670,0sleep20-21swapper/210:50:222
139172590,0sleep30-21swapper/310:04:063
1365599150,1cyclictest10460-21python12:10:222
13655991412,1cyclictest113082sleep211:28:572
13655991412,1cyclictest113082sleep211:28:562
1365599140,13cyclictest0-21swapper/210:45:162
1365599140,1cyclictest583-21sed11:15:012
1365599140,1cyclictest0-21swapper/208:20:182
176332130,0sleep30-21swapper/312:20:193
13667991310,1cyclictest259-21systemd-journal09:19:153
1365599130,1cyclictest16442-21cat12:20:002
1365599130,1cyclictest0-21swapper/209:43:272
1365599130,0cyclictest0-21swapper/210:38:222
1364399130,12cyclictest0-21swapper/010:00:090
1366799120,9cyclictest6247-21sh11:20:243
13655991211,1cyclictest0-21swapper/209:55:202
1365599120,2cyclictest32301-21apt-get09:45:122
1365599120,11cyclictest24154-21sh10:16:542
1365599120,1cyclictest6512-21diskmemload11:05:012
1365599120,1cyclictest259-21systemd-journal10:28:582
1365599120,1cyclictest11904-21wc10:00:172
1365599120,0cyclictest0-21swapper/210:33:122
1364499120,12cyclictest0-21swapper/109:10:091
1364399123,4cyclictest19935-21cut12:24:590
1366799110,5cyclictest0-21swapper/309:25:113
13655991110,1cyclictest20182-21/usr/sbin/munin12:25:142
1365599111,10cyclictest0-21swapper/207:25:212
1365599111,1cyclictest25853-21cat08:40:192
1365599110,1cyclictest14782-21grep09:20:192
1365599110,1cyclictest0-21swapper/212:07:212
1365599110,1cyclictest0-21swapper/211:50:042
1365599110,1cyclictest0-21swapper/211:41:252
1365599110,1cyclictest0-21swapper/211:17:442
1365599110,1cyclictest0-21swapper/210:59:422
1365599110,1cyclictest0-21swapper/209:15:192
1365599110,1cyclictest0-21swapper/209:12:022
1365599110,0cyclictest0-21swapper/212:37:402
1365599110,0cyclictest0-21swapper/209:39:292
1365599110,0cyclictest0-21swapper/209:33:172
1364399119,1cyclictest9-21ksoftirqd/011:10:150
1364399119,1cyclictest9-21ksoftirqd/010:15:170
1364399119,1cyclictest9-21ksoftirqd/007:45:010
13643991110,1cyclictest9-21ksoftirqd/011:04:110
13643991110,1cyclictest9-21ksoftirqd/009:20:130
246752100,0sleep10-21swapper/109:35:001
1366799102,8cyclictest6199-21taskset10:36:513
1365599102,0cyclictest6512-21diskmemload10:06:492
1365599100,9cyclictest0-21swapper/212:32:162
1365599100,2cyclictest0-21swapper/211:36:512
1365599100,2cyclictest0-21swapper/210:40:422
1365599100,10cyclictest0-21swapper/209:25:102
1365599100,1cyclictest4371-21hddtemp_smartct09:50:182
1365599100,1cyclictest11605-21ntp_states08:10:192
1365599100,1cyclictest0-21swapper/212:15:182
1365599100,1cyclictest0-21swapper/212:00:542
1365599100,1cyclictest0-21swapper/211:30:582
1365599100,1cyclictest0-21swapper/211:22:052
1365599100,1cyclictest0-21swapper/210:12:152
1365599100,1cyclictest0-21swapper/207:55:182
1365599100,1cyclictest0-21swapper/207:50:112
1365599100,0cyclictest0-21swapper/211:46:402
1365599100,0cyclictest0-21swapper/210:23:412
1364399109,1cyclictest9-21ksoftirqd/012:40:010
1364399109,1cyclictest9-21ksoftirqd/011:35:010
1364399109,1cyclictest9-21ksoftirqd/011:25:000
1364399109,1cyclictest9-21ksoftirqd/009:50:170
1364399108,1cyclictest9-21ksoftirqd/012:25:210
1364399108,1cyclictest9-21ksoftirqd/011:00:000
1364399108,1cyclictest9-21ksoftirqd/008:05:000
1364399108,1cyclictest23965-21gltestperf11:45:170
13643991010,0cyclictest9-21ksoftirqd/009:40:130
1364399101,4cyclictest16043-21df07:15:000
1364399100,6cyclictest5353-21apt-get12:05:140
136559995,1cyclictest259-21systemd-journal08:40:002
136559992,6cyclictest3692-21grep09:00:222
136559990,8cyclictest1794-21munin-run09:00:012
136559990,8cyclictest0-21swapper/208:45:182
136559990,2cyclictest0-21swapper/208:00:112
136559990,1cyclictest5551-21ntp_states09:05:202
136559990,1cyclictest530-21systemd-logind07:10:152
136559990,1cyclictest0-21swapper/211:09:402
136559990,1cyclictest0-21swapper/208:25:022
136559990,0cyclictest0-21swapper/211:55:572
136449990,5cyclictest0-21swapper/110:25:081
136439999,0cyclictest9-21ksoftirqd/011:05:250
136439998,1cyclictest9-21ksoftirqd/012:30:130
136439998,1cyclictest9-21ksoftirqd/010:50:010
136439998,1cyclictest9-21ksoftirqd/010:25:170
136439998,1cyclictest9-21ksoftirqd/010:05:220
136439998,1cyclictest9-21ksoftirqd/009:50:010
136439998,1cyclictest9-21ksoftirqd/007:55:010
136439998,1cyclictest9-21ksoftirqd/007:25:150
136439998,1cyclictest757-21runrttasks10:33:420
136439997,1cyclictest9-21ksoftirqd/011:40:020
136439997,1cyclictest9-21ksoftirqd/008:55:000
136439997,1cyclictest9-21ksoftirqd/008:15:180
136439996,2cyclictest5504-21perf08:00:000
136679986,1cyclictest8849-21snmpd12:37:373
136679986,1cyclictest8849-21snmpd07:51:313
136679984,2cyclictest283-21systemd-udevd12:09:163
136679984,2cyclictest283-21systemd-udevd10:31:153
136679982,5cyclictest15180-21apt-get08:20:123
136679982,5cyclictest12624-21/usr/sbin/munin12:15:193
136679981,3cyclictest0-21swapper/310:45:093
136679980,6cyclictest783-21sshd08:15:583
136679980,5cyclictest6512-21diskmemload11:42:293
136679980,3cyclictest0-21swapper/310:40:123
136559986,1cyclictest8849-21snmpd07:42:402
136559982,1cyclictest31361-21cpuspeed_turbos07:45:132
136559982,1cyclictest16556-21sendmail_mailtr07:15:022
136559980,2cyclictest20684-21head08:30:132
136559980,2cyclictest0-21swapper/208:05:102
136559980,1cyclictest259-21systemd-journal08:55:002
136559980,1cyclictest259-21systemd-journal08:19:592
136559980,1cyclictest259-21systemd-journal07:24:592
136449980,4cyclictest0-21swapper/109:27:331
136439988,0cyclictest9-21ksoftirqd/009:55:180
136439987,1cyclictest9-21ksoftirqd/009:13:450
136439986,1cyclictest9-21ksoftirqd/010:50:160
136439986,1cyclictest9-21ksoftirqd/007:40:000
136439986,1cyclictest25509-21ssh10:20:100
136439986,1cyclictest19665-21idleruntime-cro08:30:000
136439984,2cyclictest259-21systemd-journal11:54:590
136439980,7cyclictest0-21swapper/008:37:140
136439980,4cyclictest6512-21diskmemload09:29:470
136679976,1cyclictest8849-21snmpd09:31:553
136679976,1cyclictest8849-21snmpd08:54:343
136679976,1cyclictest8849-21snmpd08:01:523
136679976,1cyclictest8849-21snmpd07:15:543
136679975,1cyclictest8849-21snmpd12:25:373
136679975,1cyclictest8849-21snmpd09:01:163
136679975,1cyclictest8849-21snmpd08:55:183
136679975,1cyclictest8849-21snmpd08:39:053
136679975,1cyclictest8849-21snmpd08:25:243
136679975,1cyclictest8849-21snmpd07:21:513
136679975,1cyclictest8849-21snmpd07:11:093
136679975,1cyclictest35-21ksoftirqd/308:06:593
136679975,1cyclictest17219-21ssh10:08:003
136679975,1cyclictest1422-21ntpd10:50:303
136679975,1cyclictest10163-21ssh09:58:543
136679974,2cyclictest8849-21snmpd07:28:453
136679974,1cyclictest259-21systemd-journal09:54:563
136679973,2cyclictest530-21systemd-logind12:02:153
136679973,2cyclictest259-21systemd-journal12:14:153
136679973,2cyclictest259-21systemd-journal10:16:153
136679973,2cyclictest259-21systemd-journal09:35:163
136679972,4cyclictest21790-1kworker/u9:011:00:263
136679970,7cyclictest0-21swapper/309:14:053
136679970,3cyclictest0-21swapper/312:31:413
136679970,3cyclictest0-21swapper/311:33:413
136679970,3cyclictest0-21swapper/310:10:143
136559970,1cyclictest26340-21apt07:35:092
136559970,1cyclictest0-21swapper/207:30:142
136449975,2cyclictest0-21swapper/112:39:231
136449973,0cyclictest0-21swapper/112:10:231
136449971,6cyclictest0-21swapper/110:59:041
136449971,6cyclictest0-21swapper/108:38:351
136449971,6cyclictest0-21swapper/108:11:081
136449971,6cyclictest0-21swapper/107:59:221
136449971,3cyclictest0-21swapper/110:05:281
136449971,3cyclictest0-21swapper/108:45:141
136449971,1cyclictest0-21swapper/111:46:311
136449970,6cyclictest0-21swapper/108:40:171
136449970,5cyclictest0-21swapper/112:30:161
136449970,5cyclictest0-21swapper/111:09:561
136449970,4cyclictest0-21swapper/111:00:391
136449970,4cyclictest0-21swapper/110:35:231
136449970,4cyclictest0-21swapper/110:15:141
136449970,4cyclictest0-21swapper/109:16:191
136449970,3cyclictest0-21swapper/111:25:111
136449970,3cyclictest0-21swapper/111:25:111
136449970,3cyclictest0-21swapper/110:45:271
136449970,2cyclictest0-21swapper/111:18:091
136449970,1cyclictest0-21swapper/107:50:161
136449970,0cyclictest0-21swapper/112:25:181
136439977,0cyclictest9-21ksoftirqd/012:15:140
136439977,0cyclictest9-21ksoftirqd/009:15:200
136439976,1cyclictest9-21ksoftirqd/011:35:150
136439976,1cyclictest9-21ksoftirqd/011:25:140
136439976,1cyclictest9-21ksoftirqd/011:25:130
136439976,1cyclictest9-21ksoftirqd/007:20:000
136439976,1cyclictest8849-21snmpd08:56:180
136439975,1cyclictest9-21ksoftirqd/009:35:160
136439975,1cyclictest8849-21snmpd08:45:370
136439970,7cyclictest0-21swapper/012:01:140
136439970,6cyclictest8998-21apt-get12:10:090
136439970,6cyclictest19125-21irqstats10:10:180
136439970,6cyclictest0-21swapper/011:57:300
136439970,3cyclictest0-21swapper/008:40:130
136439970,1cyclictest6512-21diskmemload10:35:250
136439970,1cyclictest31071-21apt-get07:45:110
136439970,1cyclictest0-21swapper/011:15:240
136439970,1cyclictest0-21swapper/010:40:200
136439970,1cyclictest0-21swapper/009:30:130
4420260,0sleep30-21swapper/307:55:223
136679965,1cyclictest8849-21snmpd07:46:373
136679965,1cyclictest8849-21snmpd07:43:413
136679965,1cyclictest8849-21snmpd07:34:023
136679965,1cyclictest31585-21ssh10:27:273
136679965,1cyclictest27800-21ssh11:05:343
136679965,0cyclictest6512-21diskmemload11:10:373
136679964,0cyclictest6512-21diskmemload09:40:343
136679963,1cyclictest283-21systemd-udevd09:45:163
136679963,1cyclictest259-21systemd-journal11:45:003
136679962,3cyclictest531-21irqbalance09:20:123
136679962,2cyclictest259-21systemd-journal08:41:153
136679962,1cyclictest30956-21/usr/sbin/munin11:55:153
136679961,3cyclictest6512-21diskmemload11:15:033
136679960,4cyclictest16154-21entropy11:35:143
136679960,4cyclictest0-21swapper/310:55:123
136679960,3cyclictest0-21swapper/311:25:323
136679960,3cyclictest0-21swapper/311:25:313
136679960,2cyclictest0-21swapper/311:50:343
136679960,2cyclictest0-21swapper/310:20:213
136449962,2cyclictest0-21swapper/111:10:381
136449960,5cyclictest0-21swapper/111:56:051
136449960,5cyclictest0-21swapper/108:55:151
136449960,4cyclictest0-21swapper/111:54:581
136449960,4cyclictest0-21swapper/110:51:401
136449960,4cyclictest0-21swapper/109:51:281
136449960,4cyclictest0-21swapper/109:50:001
136449960,3cyclictest0-21swapper/112:04:361
136449960,3cyclictest0-21swapper/111:37:251
136449960,3cyclictest0-21swapper/108:15:131
136449960,2cyclictest0-21swapper/110:40:041
136449960,2cyclictest0-21swapper/109:37:391
136449960,1cyclictest0-21swapper/111:40:381
136449960,1cyclictest0-21swapper/110:31:031
136449960,1cyclictest0-21swapper/109:00:211
136449960,0cyclictest0-21swapper/109:55:281
136449960,0cyclictest0-21swapper/109:43:201
136439964,1cyclictest2757-21grep09:00:140
136439960,6cyclictest0-21swapper/008:30:130
136439960,6cyclictest0-21swapper/007:33:590
136439960,4cyclictest531-21irqbalance07:23:120
136439960,1cyclictest11443-21memory08:10:160
136439960,0cyclictest0-21swapper/008:05:110
136679952,1cyclictest530-21systemd-logind07:37:153
136679952,1cyclictest283-21systemd-udevd08:31:153
136679952,1cyclictest259-21systemd-journal09:07:153
136679952,1cyclictest259-21systemd-journal08:11:153
136679951,2cyclictest259-21systemd-journal08:50:003
136449955,0cyclictest0-21swapper/110:20:031
136449950,5cyclictest0-21swapper/110:10:091
136449950,5cyclictest0-21swapper/107:48:441
136449950,4cyclictest0-21swapper/108:05:101
136449950,3cyclictest0-21swapper/111:20:581
136449950,3cyclictest0-21swapper/109:20:081
136449950,2cyclictest0-21swapper/112:21:281
136449950,2cyclictest0-21swapper/112:05:231
136449950,2cyclictest0-21swapper/108:24:591
136449950,1cyclictest0-21swapper/112:15:171
136449950,0cyclictest0-21swapper/111:32:211
136439955,0cyclictest0-21swapper/009:05:200
136439954,1cyclictest15303-21telnet08:20:130
136449944,0cyclictest0-21swapper/107:30:591
136449941,2cyclictest7594-21chrt08:01:521
136449940,4cyclictest15825-21chrt07:13:151
136449940,3cyclictest0-21swapper/108:55:001
136449940,3cyclictest0-21swapper/107:26:451
136449940,1cyclictest0-21swapper/110:00:081
136449940,1cyclictest0-21swapper/108:30:151
136449940,1cyclictest0-21swapper/108:25:141
136449940,0cyclictest0-21swapper/107:15:221
136449932,0cyclictest0-21swapper/107:20:101
136449931,1cyclictest0-21swapper/109:05:091
136449931,1cyclictest0-21swapper/107:40:121
136449931,1cyclictest0-21swapper/107:35:091
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional