You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-15 - 12:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Sat Jun 15, 2024 00:46:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16742210791sleep50-21swapper/519:06:487
11053501050irq/53-eth0-tx-0-21swapper/119:05:471
122501000irq/42-ahci0-21swapper/819:08:5410
12250990irq/42-ahci0-21swapper/219:09:084
1105250920irq/52-eth0-rx-0-21swapper/419:05:116
12250880irq/42-ahci0-21swapper/319:06:525
173550810irq/56-eth1-rx-0-21swapper/919:05:2211
12250800irq/42-ahci0-21swapper/719:08:239
1105250720irq/52-eth0-rx-0-21swapper/1019:05:082
1668826763sleep00-21swapper/019:06:070
1683026657sleep60-21swapper/619:08:028
1668625955sleep110-21swapper/1119:06:063
17173992423cyclictest0-21swapper/1020:00:262
1717399230cyclictest831ksoftirqd/1023:37:112
1717399230cyclictest831ksoftirqd/1000:08:382
1717399225cyclictest831ksoftirqd/1023:33:252
17173992221cyclictest0-21swapper/1019:57:512
1717399220cyclictest831ksoftirqd/1022:16:592
1717399203cyclictest831ksoftirqd/1023:07:202
1717399203cyclictest831ksoftirqd/1021:45:162
1717399203cyclictest831ksoftirqd/1021:16:062
1717399203cyclictest831ksoftirqd/1021:16:062
1717399203cyclictest831ksoftirqd/1020:52:552
1717399203cyclictest831ksoftirqd/1019:26:522
1717399192cyclictest831ksoftirqd/1023:55:182
1717399192cyclictest831ksoftirqd/1023:50:282
1717399192cyclictest831ksoftirqd/1023:45:172
1717399192cyclictest831ksoftirqd/1023:26:482
1717399192cyclictest831ksoftirqd/1023:22:192
1717399192cyclictest831ksoftirqd/1023:12:042
1717399192cyclictest831ksoftirqd/1023:01:152
1717399192cyclictest831ksoftirqd/1022:55:362
1717399192cyclictest831ksoftirqd/1022:50:492
1717399192cyclictest831ksoftirqd/1022:45:152
1717399192cyclictest831ksoftirqd/1022:35:082
1717399192cyclictest831ksoftirqd/1022:33:122
1717399192cyclictest831ksoftirqd/1022:26:382
1717399192cyclictest831ksoftirqd/1022:20:542
1717399192cyclictest831ksoftirqd/1022:00:142
1717399192cyclictest831ksoftirqd/1021:56:292
1717399192cyclictest831ksoftirqd/1021:50:282
1717399192cyclictest831ksoftirqd/1021:42:552
1717399192cyclictest831ksoftirqd/1021:36:372
1717399192cyclictest831ksoftirqd/1021:25:422
1717399192cyclictest831ksoftirqd/1021:20:022
1717399192cyclictest831ksoftirqd/1021:20:012
1717399192cyclictest831ksoftirqd/1021:12:092
1717399192cyclictest831ksoftirqd/1021:09:302
1717399192cyclictest831ksoftirqd/1021:00:122
1717399192cyclictest831ksoftirqd/1020:55:162
1717399192cyclictest831ksoftirqd/1020:45:122
1717399192cyclictest831ksoftirqd/1020:40:272
1717399192cyclictest831ksoftirqd/1020:36:052
1717399192cyclictest831ksoftirqd/1020:32:262
1717399192cyclictest831ksoftirqd/1020:25:102
1717399192cyclictest831ksoftirqd/1020:15:332
1717399192cyclictest831ksoftirqd/1020:10:362
1717399192cyclictest831ksoftirqd/1019:54:282
1717399192cyclictest831ksoftirqd/1019:48:022
1717399192cyclictest831ksoftirqd/1019:35:322
1717399192cyclictest831ksoftirqd/1019:31:082
1717399192cyclictest831ksoftirqd/1019:23:012
1717399192cyclictest831ksoftirqd/1000:35:342
1717399192cyclictest831ksoftirqd/1000:35:342
1717399192cyclictest831ksoftirqd/1000:31:032
1717399192cyclictest831ksoftirqd/1000:25:122
1717399192cyclictest831ksoftirqd/1000:20:392
1717399192cyclictest831ksoftirqd/1000:15:262
1717399192cyclictest831ksoftirqd/1000:12:002
1717399192cyclictest831ksoftirqd/1000:00:322
1717399192cyclictest1105250irq/52-eth0-rx-23:40:242
17173991817cyclictest0-21swapper/1019:15:062
1717399181cyclictest831ksoftirqd/1023:15:042
1717399181cyclictest831ksoftirqd/1022:40:012
1717399181cyclictest831ksoftirqd/1022:10:022
1717399181cyclictest831ksoftirqd/1022:05:012
1717399181cyclictest831ksoftirqd/1021:30:072
1717399181cyclictest831ksoftirqd/1021:30:062
1717399181cyclictest831ksoftirqd/1020:20:102
1717399181cyclictest831ksoftirqd/1020:05:022
1717399181cyclictest831ksoftirqd/1019:40:032
1717399181cyclictest831ksoftirqd/1019:10:092
17172991816cyclictest22812-21iostat_ios20:05:2111
1717299181cyclictest25838-21latency_hist19:20:0011
1717299181cyclictest0-21swapper/923:00:2211
1717299181cyclictest0-21swapper/920:20:3511
1717299181cyclictest0-21swapper/919:52:4811
1717299181cyclictest0-21swapper/919:40:1511
1717299181cyclictest0-21swapper/919:26:1011
17169991816cyclictest16892-21qemu-kvm19:20:148
17169991816cyclictest16892-21qemu-kvm19:15:178
17169991816cyclictest14772-21qemu-kvm22:20:148
17169991816cyclictest14772-21qemu-kvm22:08:378
17157991816cyclictest2320-21snmpd22:06:034
1717999170cyclictest0-21swapper/1121:24:473
1717999170cyclictest0-21swapper/1121:24:463
17172991715cyclictest3094-21snmp_easybox.os22:35:2511
1717299170cyclictest32566-1kworker/9:2H21:08:2611
1717299170cyclictest0-21swapper/922:30:1711
1717299170cyclictest0-21swapper/922:15:3611
1717299170cyclictest0-21swapper/920:40:2011
17170991715cyclictest19482-21snmp_rack3slot921:30:159
17170991715cyclictest19482-21snmp_rack3slot921:30:149
17170991715cyclictest17542-21diskstats00:25:119
17168991716cyclictest14772-21qemu-kvm22:46:017
17168991716cyclictest14772-21qemu-kvm22:41:427
17168991715cyclictest3335-21qemu-kvm21:09:027
17168991715cyclictest14772-21qemu-kvm22:17:207
17167991716cyclictest2357-21lldpd19:49:536
1713899170cyclictest0-21swapper/019:16:020
17179991614cyclictest20621-21chrt19:13:173
1717999160cyclictest0-21swapper/1120:09:303
1717299164cyclictest0-21swapper/921:55:0111
17172991615cyclictest0-21swapper/923:30:3211
17172991615cyclictest0-21swapper/920:50:1011
17170991614cyclictest30755-21snmp_rack3slot922:30:109
1716999163cyclictest0-21swapper/621:44:108
17169991615cyclictest24251-21qemu-kvm20:17:098
17169991615cyclictest14772-21qemu-kvm22:40:168
17169991615cyclictest14772-21qemu-kvm22:35:148
17168991615cyclictest2320-21snmpd20:26:317
17168991615cyclictest14772-21qemu-kvm22:20:357
17168991615cyclictest14771-21qemu-kvm22:08:167
17167991615cyclictest2357-21lldpd22:19:236
1716799160cyclictest0-21swapper/422:00:386
17157991614cyclictest2320-21snmpd22:48:184
17157991614cyclictest2320-21snmpd19:49:304
1717299154cyclictest0-21swapper/921:50:0111
17172991514cyclictest741rcuc/923:52:3411
17172991514cyclictest0-21swapper/922:00:1311
17172991513cyclictest13434-21perl22:50:1911
1717099158cyclictest12250irq/42-ahci22:15:029
17170991514cyclictest29208-21ntp_states23:55:279
17170991513cyclictest7321-21iostat_ios19:40:229
17168991514cyclictest24250-21qemu-kvm20:08:217
17168991514cyclictest2320-21snmpd19:45:057
17167991514cyclictest2357-21lldpd23:09:556
17167991514cyclictest2357-21lldpd20:44:526
17167991514cyclictest13518-21smartctl21:20:326
17167991514cyclictest13518-21smartctl21:20:316
17157991513cyclictest2320-21snmpd22:31:174
17157991513cyclictest2320-21snmpd21:42:164
1714999150cyclictest0-21swapper/119:20:101
1714999150cyclictest0-21swapper/119:15:571
1105250150irq/52-eth0-rx-0-21swapper/719:15:539
1717299143cyclictest0-21swapper/922:45:0111
17172991413cyclictest9368-21taskset20:30:3611
17172991413cyclictest20593-21taskset19:12:5211
17172991413cyclictest0-21swapper/921:10:1511
1717299141cyclictest0-21swapper/923:10:4111
1717199144cyclictest0-21swapper/819:35:0110
1717199143cyclictest0-21swapper/819:40:0010
1717099145cyclictest0-21swapper/720:45:019
1717099144cyclictest0-21swapper/723:30:019
1717099143cyclictest0-21swapper/720:40:019
1717099143cyclictest0-21swapper/720:10:019
17170991412cyclictest6559-21irqstats22:40:259
17169991413cyclictest14771-21qemu-kvm22:14:108
17167991413cyclictest24103-21smartctl22:20:176
17167991413cyclictest2357-21lldpd20:45:536
17157991412cyclictest2320-21snmpd22:51:324
17157991412cyclictest2320-21snmpd20:17:024
17157991412cyclictest2320-21snmpd00:23:034
13450140irq/18-ehci_hcd0-21swapper/021:30:340
13450140irq/18-ehci_hcd0-21swapper/021:30:330
12250140irq/42-ahci0-21swapper/819:16:0010
12250140irq/42-ahci0-21swapper/219:15:594
1717999134cyclictest0-21swapper/1122:42:033
1717999134cyclictest0-21swapper/1121:05:013
1717999133cyclictest0-21swapper/1122:33:033
1717999133cyclictest0-21swapper/1121:28:013
17179991311cyclictest22731-21chrt22:20:033
17179991311cyclictest221572chrt22:19:153
1717299134cyclictest0-21swapper/900:40:0111
1717299134cyclictest0-21swapper/900:40:0111
1717299133cyclictest0-21swapper/923:35:0111
17172991312cyclictest0-21swapper/922:47:4111
17172991312cyclictest0-21swapper/919:55:2111
17172991311cyclictest2978-21perl23:20:1811
17172991311cyclictest27105-21snmp_rack3slot921:40:1811
17172991311cyclictest24268-21ntp_states21:35:3211
1717199134cyclictest0-21swapper/820:25:0110
1717199133cyclictest0-21swapper/823:10:0110
1717199133cyclictest0-21swapper/822:20:4710
1717199133cyclictest0-21swapper/821:15:2310
1717199133cyclictest0-21swapper/821:15:2310
1717199133cyclictest0-21swapper/820:40:4610
1717099134cyclictest0-21swapper/719:35:009
17170991311cyclictest26829-21snmp_rack3slot900:36:499
17170991311cyclictest26829-21snmp_rack3slot900:36:489
17170991311cyclictest15009-21perl19:55:159
17170991311cyclictest14385-21hddtemp_smartct00:20:199
17168991311cyclictest14771-21qemu-kvm22:30:387
17167991312cyclictest2357-21lldpd22:30:226
1716499130cyclictest0-21swapper/321:05:225
17157991311cyclictest2320-21snmpd22:59:334
17157991311cyclictest2320-21snmpd20:46:174
1714999133cyclictest0-21swapper/120:10:001
1714999133cyclictest0-21swapper/100:00:011
17138991311cyclictest4009-21munin-node21:10:350
17138991311cyclictest2302-21nscd22:22:080
1713899131cyclictest0-21swapper/023:15:220
1699130watchdog/00-21swapper/000:16:120
31120ksoftirqd/00-21swapper/022:00:320
1717999123cyclictest0-21swapper/1120:20:013
1717999123cyclictest0-21swapper/1100:10:013
1717299123cyclictest0-21swapper/922:25:0011
1717299123cyclictest0-21swapper/920:15:0011
17172991211cyclictest0-21swapper/922:10:1611
1717299121cyclictest0-21swapper/920:15:1611
1717199123cyclictest0-21swapper/820:55:0010
1717199122cyclictest612-21seq22:34:1710
1717199122cyclictest0-21swapper/821:12:3210
1717099124cyclictest0-21swapper/719:35:019
1717099123cyclictest0-21swapper/721:50:009
1716999123cyclictest0-21swapper/600:04:568
1716999120cyclictest23029-21sadc23:50:008
17168991210cyclictest2320-21snmpd19:30:467
17167991211cyclictest9364-21smartctl20:30:336
17167991211cyclictest2357-21lldpd19:11:516
17167991211cyclictest17225-21smartctl22:55:186
1716499122cyclictest0-21swapper/323:50:235
17157991210cyclictest2320-21snmpd21:22:474
17157991210cyclictest2320-21snmpd21:22:474
1714999124cyclictest0-21swapper/120:50:201
1714999122cyclictest0-21swapper/122:45:201
17138991211cyclictest14802-21smbd22:30:410
17138991210cyclictest28405-21taskset22:25:280
1713899120cyclictest0-21swapper/021:45:310
1713899120cyclictest0-21swapper/020:15:300
6899110migration/87575-21munin-node00:10:3010
6899110migration/829237-21runrttasks22:26:2810
6899110migration/812580-21gltestperf21:20:1510
6899110migration/812580-21gltestperf21:20:1410
551110ksoftirqd/60-21swapper/622:51:518
5499110migration/615547-21fschecks_time20:40:178
481110ksoftirqd/50-21swapper/521:40:217
411110ksoftirqd/40-21swapper/422:40:156
341110ksoftirqd/30-21swapper/322:51:525
31110ksoftirqd/00-21swapper/020:30:330
31110ksoftirqd/00-21swapper/019:40:320
201110ksoftirqd/10-21swapper/121:10:131
1717999115cyclictest0-21swapper/1123:04:563
1717999114cyclictest0-21swapper/1123:15:013
1717999113cyclictest0-21swapper/1123:50:013
1717999113cyclictest0-21swapper/1122:37:173
1717999113cyclictest0-21swapper/1121:46:473
1717999113cyclictest0-21swapper/1121:11:313
1717999113cyclictest0-21swapper/1120:36:153
1717999113cyclictest0-21swapper/1119:50:003
1717999113cyclictest0-21swapper/1119:35:403
1717999113cyclictest0-21swapper/1119:16:153
1717999112cyclictest0-21swapper/1122:46:183
1717999110cyclictest0-21swapper/1120:33:223
1717299119cyclictest4364-21snmp_rack3slot920:25:1311
1717299119cyclictest25986-21snmp_rack3slot923:05:4811
1717299114cyclictest0-21swapper/923:55:0111
1717299114cyclictest0-21swapper/921:30:0111
1717299113cyclictest0-21swapper/923:47:1811
1717299113cyclictest0-21swapper/900:30:4711
1717299112cyclictest0-21swapper/923:15:0011
1717299111cyclictest0-21swapper/919:39:4511
1717199113cyclictest0-21swapper/822:47:3310
1717199113cyclictest0-21swapper/822:03:4710
1717199113cyclictest0-21swapper/821:35:0210
1717199113cyclictest0-21swapper/820:45:1710
1717199113cyclictest0-21swapper/820:16:4710
1717199113cyclictest0-21swapper/819:27:4610
1717199112cyclictest0-21swapper/823:42:4810
1717199112cyclictest0-21swapper/820:13:4510
1717099119cyclictest27086-21snmp_rack3slot919:20:169
1717099119cyclictest25159-21irqstats23:50:269
1717099115cyclictest0-21swapper/720:00:279
1717099114cyclictest0-21swapper/722:05:019
1717099114cyclictest0-21swapper/721:25:019
1717099114cyclictest0-21swapper/720:32:469
1717099113cyclictest0-21swapper/722:24:019
1717099113cyclictest0-21swapper/722:16:469
1717099113cyclictest0-21swapper/721:41:539
1717099113cyclictest0-21swapper/721:24:029
1717099113cyclictest0-21swapper/721:24:029
1717099113cyclictest0-21swapper/721:07:519
1717099113cyclictest0-21swapper/720:50:529
1717099113cyclictest0-21swapper/720:22:529
1717099112cyclictest0-21swapper/723:35:189
1716999115cyclictest551ksoftirqd/621:38:218
1716999115cyclictest0-21swapper/623:19:018
1716999115cyclictest0-21swapper/622:26:198
1716999113cyclictest0-21swapper/621:10:108
1716999112cyclictest0-21swapper/619:35:018
1716799113cyclictest0-21swapper/400:35:186
1716799113cyclictest0-21swapper/400:35:186
17167991110cyclictest2357-21lldpd22:35:246
17167991110cyclictest2357-21lldpd00:09:276
17167991110cyclictest2357-21lldpd00:00:576
17167991110cyclictest18501-21smartctl23:40:386
17167991110cyclictest14838-21smartctl23:35:326
1716799111cyclictest0-21swapper/419:27:266
1716799110cyclictest0-21swapper/420:25:016
1716499113cyclictest0-21swapper/323:45:175
1716499113cyclictest0-21swapper/320:35:195
1716499113cyclictest0-21swapper/320:00:265
1715799119cyclictest2320-21snmpd23:59:494
1715799119cyclictest2320-21snmpd19:59:164
1715799113cyclictest0-21swapper/200:15:204
1715799110cyclictest0-21swapper/220:35:144
1715799110cyclictest0-21swapper/219:35:124
1714999113cyclictest0-21swapper/120:15:181
1714999113cyclictest0-21swapper/100:35:181
1714999113cyclictest0-21swapper/100:35:181
1714999112cyclictest0-21swapper/123:43:221
1713899115cyclictest0-21swapper/023:36:080
1713899113cyclictest0-21swapper/019:25:370
1713899112cyclictest0-21swapper/023:30:340
1713899112cyclictest0-21swapper/023:10:210
901100ksoftirqd/110-21swapper/1123:40:243
901100ksoftirqd/110-21swapper/1123:35:343
901100ksoftirqd/110-21swapper/1122:25:223
901100ksoftirqd/110-21swapper/1122:00:323
901100ksoftirqd/110-21swapper/1121:40:213
901100ksoftirqd/110-21swapper/1100:05:313
8799100watchdog/110-21swapper/1120:41:203
761100ksoftirqd/927567-21smartctl19:20:2011
761100ksoftirqd/90-21swapper/900:20:1911
7599100migration/928686-21munin-node22:25:3511
7399100watchdog/90-21swapper/923:41:2411
691100ksoftirqd/80-21swapper/822:40:1510
691100ksoftirqd/80-21swapper/821:40:2110
691100ksoftirqd/80-21swapper/800:05:3010
6899100migration/829002-21runrttasks19:20:4210
6899100migration/813244-21cstates23:35:1110
6699100watchdog/80-21swapper/823:31:2710
6699100watchdog/80-21swapper/823:18:2810
621100ksoftirqd/70-21swapper/722:35:349
621100ksoftirqd/70-21swapper/722:25:239
551100ksoftirqd/60-21swapper/600:20:188
5499100migration/630802-21gltestperf21:45:188
5499100migration/623867-21munin-node20:50:308
481100ksoftirqd/50-21swapper/523:55:017
481100ksoftirqd/50-21swapper/522:35:347
481100ksoftirqd/50-21swapper/522:00:327
481100ksoftirqd/50-21swapper/520:10:057
481100ksoftirqd/50-21swapper/500:05:317
411100ksoftirqd/40-21swapper/422:25:236
411100ksoftirqd/40-21swapper/421:40:216
3899100watchdog/40-21swapper/421:53:006
3899100watchdog/40-21swapper/419:38:366
3899100watchdog/40-21swapper/419:30:446
341100ksoftirqd/30-21swapper/322:25:235
341100ksoftirqd/30-21swapper/319:20:195
341100ksoftirqd/30-21swapper/300:10:175
3199100watchdog/32609-21runrttasks23:05:245
3199100watchdog/30-21swapper/322:02:075
31100ksoftirqd/00-21swapper/023:50:360
31100ksoftirqd/00-21swapper/023:40:230
31100ksoftirqd/00-21swapper/022:51:520
31100ksoftirqd/00-21swapper/020:10:040
31100ksoftirqd/00-21swapper/020:00:370
31100ksoftirqd/00-21swapper/019:20:200
31100ksoftirqd/00-21swapper/000:10:170
31100ksoftirqd/00-21swapper/000:05:310
271100ksoftirqd/22254-40kipmi022:25:224
271100ksoftirqd/20-21swapper/223:40:234
271100ksoftirqd/20-21swapper/223:35:354
271100ksoftirqd/20-21swapper/222:40:154
201100ksoftirqd/10-21swapper/122:40:151
201100ksoftirqd/10-21swapper/122:35:341
201100ksoftirqd/10-21swapper/122:25:231
201100ksoftirqd/10-21swapper/121:00:311
201100ksoftirqd/10-21swapper/100:10:171
1717999104cyclictest0-21swapper/1122:55:323
1717999103cyclictest0-21swapper/1121:54:533
1717999102cyclictest0-21swapper/1121:37:213
1717999102cyclictest0-21swapper/1120:25:303
1717999102cyclictest0-21swapper/1119:41:153
1717999102cyclictest0-21swapper/1119:33:303
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional