You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 11:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Sat Apr 27, 2024 00:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
132792230160,55sleep20-21swapper/219:09:352
131702216154,21sleep00-21swapper/019:08:080
130642202145,44sleep30-21swapper/319:06:483
130452197160,25sleep10-21swapper/119:06:331
74432710,0sleep00-21swapper/023:25:020
88232130,0sleep10-21swapper/123:25:231
48912110,0sleep30-21swapper/321:50:403
1340299110,9cyclictest0-21swapper/222:47:242
181962100,0sleep36058-21diskmemload00:24:123
13402991010,0cyclictest0-21swapper/221:18:002
1340299100,9cyclictest15754-21munin-node00:27:032
1340299100,1cyclictest0-21swapper/223:10:202
1339799100,6cyclictest0-21swapper/119:10:111
1339299109,1cyclictest9-21ksoftirqd/023:55:010
1339299109,1cyclictest9-21ksoftirqd/000:35:140
1339299100,7cyclictest6058-21diskmemload23:00:180
134099998,1cyclictest35-21ksoftirqd/320:28:343
134099990,4cyclictest0-21swapper/323:01:083
134029998,1cyclictest28-21ksoftirqd/221:58:172
134029993,4cyclictest8849-21snmpd00:13:002
134029991,5cyclictest6058-21diskmemload00:35:102
134029990,8cyclictest6058-21diskmemload23:59:042
133929998,1cyclictest9-21ksoftirqd/019:15:000
133929997,1cyclictest9-21ksoftirqd/022:49:590
133929991,7cyclictest6058-21diskmemload22:35:180
9216280,0sleep10-21swapper/121:13:131
13459280,0sleep20-21swapper/223:31:492
134099988,0cyclictest0-21swapper/320:23:163
134099986,1cyclictest35-21ksoftirqd/320:10:083
134099984,3cyclictest25688-21nscd21:28:563
134099981,6cyclictest15754-21munin-node21:35:153
134099981,5cyclictest6058-21diskmemload23:15:153
134099981,4cyclictest20999-21kworker/u8:222:10:373
134099980,7cyclictest0-21swapper/322:42:443
134099980,5cyclictest0-21swapper/323:21:173
134099980,1cyclictest0-21swapper/323:50:103
134029986,1cyclictest8849-21snmpd21:44:382
134029986,1cyclictest8849-21snmpd19:25:422
134029986,1cyclictest61250irq/122-eno123:40:142
134029986,1cyclictest61250irq/122-eno123:05:162
134029986,1cyclictest61250irq/122-eno121:35:132
134029986,1cyclictest61250irq/122-eno119:40:162
134029986,1cyclictest61250irq/122-eno100:01:252
134029984,2cyclictest283-21systemd-udevd20:43:152
134029981,6cyclictest15754-21munin-node20:29:492
134029981,3cyclictest6058-21diskmemload21:50:172
134029980,6cyclictest0-21swapper/223:03:272
133979980,7cyclictest196-21jbd2/sda2-823:15:371
133979980,7cyclictest0-21swapper/100:01:051
133979980,2cyclictest0-21swapper/119:15:111
133979980,0cyclictest0-21swapper/121:00:101
133929986,1cyclictest8849-21snmpd23:40:080
133929986,1cyclictest8849-21snmpd22:25:090
133929986,1cyclictest8849-21snmpd20:34:300
133929986,1cyclictest8849-21snmpd19:35:280
133929986,1cyclictest534-21nscd23:10:130
133929984,2cyclictest8849-21snmpd20:25:390
133929981,4cyclictest6058-21diskmemload22:00:090
133929981,4cyclictest534-21nscd23:33:260
133929981,3cyclictest6058-21diskmemload22:17:100
133929980,7cyclictest6065-21apt-get21:10:010
133929980,5cyclictest6058-21diskmemload23:09:280
133929980,5cyclictest0-21swapper/022:55:120
133929980,2cyclictest26998-21ssh21:37:220
133929980,1cyclictest32753-21/usr/sbin/munin23:15:200
134099976,1cyclictest8849-21snmpd23:11:373
134099976,1cyclictest8849-21snmpd22:33:463
134099976,1cyclictest8849-21snmpd21:18:403
134099976,0cyclictest6058-21diskmemload21:40:373
134099975,2cyclictest5770-21aten_r1power_po20:00:113
134099975,1cyclictest8849-21snmpd23:40:443
134099975,1cyclictest8849-21snmpd22:27:033
134099975,1cyclictest8849-21snmpd19:10:483
134099970,5cyclictest31483-21kworker/u8:122:04:103
134099970,5cyclictest0-21swapper/300:13:593
134099970,3cyclictest0-21swapper/321:30:043
134029976,1cyclictest61250irq/122-eno123:48:262
134029976,1cyclictest61250irq/122-eno123:48:262
134029976,1cyclictest61250irq/122-eno123:25:172
134029976,1cyclictest61250irq/122-eno123:16:532
134029976,1cyclictest61250irq/122-eno122:55:322
134029976,1cyclictest61250irq/122-eno122:50:232
134029976,1cyclictest61250irq/122-eno121:10:012
134029976,1cyclictest61250irq/122-eno120:45:122
134029976,1cyclictest61250irq/122-eno119:21:182
134029976,1cyclictest61250irq/122-eno119:15:002
134029976,0cyclictest61250irq/122-eno122:40:252
134029976,0cyclictest61250irq/122-eno121:25:132
134029975,1cyclictest8849-21snmpd23:20:262
134029975,1cyclictest8849-21snmpd21:00:192
134029975,1cyclictest8849-21snmpd19:55:142
134029975,1cyclictest8849-21snmpd19:34:432
134029975,1cyclictest61250irq/122-eno122:20:092
134029975,1cyclictest61250irq/122-eno120:35:232
134029975,1cyclictest61250irq/122-eno100:20:182
134029974,1cyclictest530-21systemd-logind22:34:152
134029973,2cyclictest283-21systemd-udevd22:09:152
134029973,2cyclictest283-21systemd-udevd19:47:152
134029972,3cyclictest11871-21awk22:00:222
134029970,6cyclictest0-21swapper/221:31:402
134029970,5cyclictest61250irq/122-eno100:06:352
134029970,4cyclictest17233-21diskmemload23:37:162
134029970,1cyclictest0-21swapper/200:34:052
133979975,1cyclictest21909-21taskset20:34:361
133979971,6cyclictest0-21swapper/123:04:501
133979971,6cyclictest0-21swapper/120:29:581
133979971,6cyclictest0-21swapper/100:18:581
133979971,3cyclictest0-21swapper/122:45:101
133979970,6cyclictest0-21swapper/122:21:021
133979970,6cyclictest0-21swapper/122:15:271
133979970,6cyclictest0-21swapper/121:35:181
133979970,6cyclictest0-21swapper/120:55:171
133979970,4cyclictest0-21swapper/122:25:121
133979970,4cyclictest0-21swapper/122:13:061
133979970,4cyclictest0-21swapper/121:58:261
133979970,1cyclictest0-21swapper/122:00:511
133929976,1cyclictest8849-21snmpd22:40:260
133929976,1cyclictest8849-21snmpd00:27:280
133929976,1cyclictest8097-21df23:25:150
133929976,1cyclictest637-21ssh00:00:140
133929976,1cyclictest26165-21ssh22:20:180
133929976,1cyclictest21442-1kworker/u9:000:30:400
133929976,1cyclictest10991-21cat21:15:140
133929975,1cyclictest8849-21snmpd21:08:490
133929975,1cyclictest8849-21snmpd20:42:000
133929975,1cyclictest16526-21sed23:35:230
133929975,1cyclictest0-21swapper/020:10:130
133929974,0cyclictest0-21swapper/020:15:140
133929973,1cyclictest6058-21diskmemload00:15:460
133929972,1cyclictest6613-21/usr/sbin/munin21:55:120
133929972,1cyclictest6058-21diskmemload00:05:580
133929971,1cyclictest2588-21ssh22:32:550
133929970,6cyclictest8948-21kernelversion20:05:160
133929970,6cyclictest4977-21ssh21:50:560
133929970,6cyclictest31264-21ssh21:44:160
133929970,6cyclictest29617-21ssh23:55:130
133929970,6cyclictest24065-21ssh23:46:040
133929970,6cyclictest24065-21ssh23:46:030
133929970,6cyclictest22186-21/usr/sbin/munin20:35:240
133929970,6cyclictest21059-21aten2.4-expect21:30:120
133929970,6cyclictest20505-21awk19:20:200
133929970,6cyclictest16135-21ssh21:22:160
133929970,6cyclictest1347-21ssh21:45:560
133929970,1cyclictest6058-21diskmemload21:29:100
133929970,1cyclictest5672-21apt-get20:00:100
133929970,1cyclictest17256-21ssh00:21:260
133929970,1cyclictest16253-21ssh22:06:320
133929970,1cyclictest0-21swapper/022:14:250
134099965,1cyclictest9937-21ssh21:59:583
134099965,1cyclictest8849-21snmpd23:46:243
134099965,1cyclictest8849-21snmpd23:46:233
134099965,1cyclictest8849-21snmpd22:08:303
134099965,1cyclictest8849-21snmpd21:01:503
134099965,1cyclictest8849-21snmpd20:15:543
134099965,1cyclictest8849-21snmpd19:41:323
134099965,1cyclictest7273-21ssh00:09:293
134099965,1cyclictest35-21ksoftirqd/300:01:003
134099965,1cyclictest31466-21ssh23:56:343
134099965,1cyclictest14068-21ssh00:17:543
134099965,1cyclictest11144-21ssh23:30:013
134099965,0cyclictest6058-21diskmemload23:37:353
134099964,1cyclictest8849-21snmpd20:30:303
134099964,1cyclictest6058-21diskmemload23:07:013
134099964,1cyclictest35-21ksoftirqd/320:10:003
134099961,3cyclictest939-21apt-get19:50:103
134099961,3cyclictest0-21swapper/300:25:133
134099961,2cyclictest0-21swapper/322:15:083
134099961,1cyclictest0-21swapper/322:59:053
134099960,5cyclictest0-21swapper/300:32:403
134099960,4cyclictest0-21swapper/321:12:023
134099960,3cyclictest0-21swapper/323:25:123
134099960,3cyclictest0-21swapper/322:20:583
134099960,2cyclictest0-21swapper/322:45:183
134099960,2cyclictest0-21swapper/321:21:203
134099960,2cyclictest0-21swapper/319:30:003
134099960,2cyclictest0-21swapper/300:35:233
134029966,0cyclictest61250irq/122-eno123:50:112
134029966,0cyclictest61250irq/122-eno122:35:212
134029966,0cyclictest61250irq/122-eno122:25:012
134029966,0cyclictest61250irq/122-eno121:20:432
134029966,0cyclictest61250irq/122-eno121:05:462
134029966,0cyclictest61250irq/122-eno120:50:102
134029966,0cyclictest61250irq/122-eno120:18:492
134029966,0cyclictest61250irq/122-eno120:11:242
134029966,0cyclictest61250irq/122-eno100:15:102
134029965,1cyclictest61250irq/122-eno122:15:172
134029965,1cyclictest61250irq/122-eno119:10:202
134029965,1cyclictest28131-21sshd19:36:382
134029965,1cyclictest28-21ksoftirqd/220:05:082
134029964,1cyclictest61250irq/122-eno122:10:122
134029963,2cyclictest32707-21grep20:55:202
134029963,1cyclictest31805-21apt-get21:45:122
134029961,3cyclictest8849-21snmpd20:30:432
134029961,1cyclictest0-21swapper/220:20:122
133979961,5cyclictest0-21swapper/120:24:051
133979961,3cyclictest0-21swapper/122:55:121
133979961,3cyclictest0-21swapper/100:05:231
133979961,2cyclictest0-21swapper/121:10:001
133979961,1cyclictest0-21swapper/123:55:111
133979960,6cyclictest0-21swapper/123:41:511
133979960,6cyclictest0-21swapper/122:36:421
133979960,6cyclictest0-21swapper/122:32:241
133979960,6cyclictest0-21swapper/120:47:001
133979960,6cyclictest0-21swapper/120:35:031
133979960,6cyclictest0-21swapper/120:10:141
133979960,6cyclictest0-21swapper/119:57:021
133979960,6cyclictest0-21swapper/119:45:281
133979960,6cyclictest0-21swapper/119:41:221
133979960,6cyclictest0-21swapper/119:31:501
133979960,6cyclictest0-21swapper/119:24:271
133979960,6cyclictest0-21swapper/100:30:121
133979960,6cyclictest0-21swapper/100:12:061
133979960,5cyclictest0-21swapper/123:07:491
133979960,5cyclictest0-21swapper/121:49:091
133979960,5cyclictest0-21swapper/100:35:551
133979960,4cyclictest0-21swapper/123:50:091
133979960,4cyclictest0-21swapper/122:40:121
133979960,4cyclictest0-21swapper/121:32:331
133979960,3cyclictest0-21swapper/123:38:191
133979960,3cyclictest0-21swapper/123:30:101
133979960,2cyclictest0-21swapper/120:50:111
133979960,1cyclictest0-21swapper/123:20:271
133979960,1cyclictest0-21swapper/122:51:491
133979960,1cyclictest0-21swapper/121:25:011
133929965,1cyclictest9-21ksoftirqd/019:15:000
133929965,1cyclictest8849-21snmpd19:29:070
133929965,1cyclictest30407-21ntpq20:50:180
133929964,1cyclictest9-21ksoftirqd/019:40:320
133929960,6cyclictest0-21swapper/021:03:250
133929960,6cyclictest0-21swapper/020:46:350
133929960,6cyclictest0-21swapper/019:55:430
133929960,6cyclictest0-21swapper/019:53:150
133929960,6cyclictest0-21swapper/019:32:550
133929960,5cyclictest7710-21ssh00:10:050
133929960,5cyclictest0-21swapper/020:55:110
133929960,5cyclictest0-21swapper/020:20:160
133929960,2cyclictest0-21swapper/019:45:080
133929960,0cyclictest6058-21diskmemload22:50:180
134099955,0cyclictest1566-21ssh21:46:353
134099954,1cyclictest8849-21snmpd19:22:543
134099954,1cyclictest28932-21sshd20:48:493
134099953,1cyclictest3870-21tr22:35:153
134099951,2cyclictest0-21swapper/319:55:223
134099951,1cyclictest23932-21apt-get19:30:093
134099950,5cyclictest0-21swapper/320:55:123
134099950,5cyclictest0-21swapper/319:48:053
134099950,3cyclictest31402-21idleruntime-cro20:55:003
134099950,2cyclictest0-21swapper/319:35:113
134099950,1cyclictest0-21swapper/322:50:213
134099950,1cyclictest0-21swapper/320:40:093
134099950,1cyclictest0-21swapper/319:15:183
134029954,1cyclictest61250irq/122-eno120:00:222
134029953,1cyclictest61250irq/122-eno119:50:092
133979952,2cyclictest0-21swapper/100:29:281
133979951,2cyclictest0-21swapper/123:45:231
133979951,2cyclictest0-21swapper/123:45:231
133979951,0cyclictest0-21swapper/121:15:091
133979950,5cyclictest0-21swapper/119:29:021
133979950,2cyclictest0-21swapper/122:06:281
133979950,2cyclictest0-21swapper/121:42:241
133979950,2cyclictest0-21swapper/121:20:181
133979950,1cyclictest0-21swapper/121:51:261
133979950,1cyclictest0-21swapper/100:20:481
134099941,2cyclictest0-21swapper/321:05:163
134099941,1cyclictest22186-21/usr/sbin/munin20:35:123
133979944,0cyclictest0-21swapper/120:16:291
133979940,3cyclictest0-21swapper/119:55:001
133979940,1cyclictest0-21swapper/123:10:181
133979940,1cyclictest0-21swapper/120:40:131
133979940,0cyclictest0-21swapper/119:39:041
133979931,1cyclictest0-21swapper/120:05:191
133979931,1cyclictest0-21swapper/120:00:091
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional