You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 04:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Sat Jul 27, 2024 00:46:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15315210795sleep90-21swapper/919:07:2611
15284210391sleep60-21swapper/619:07:008
12250970irq/42-ahci0-21swapper/119:09:231
12250920irq/42-ahci0-21swapper/219:05:404
1105250920irq/52-eth0-rx-0-21swapper/319:05:035
12250880irq/42-ahci0-21swapper/419:06:486
12250830irq/42-ahci0-21swapper/719:08:379
1554528078sleep80-21swapper/819:09:5010
1105250730irq/52-eth0-rx-0-21swapper/1019:07:022
1526826453sleep50-21swapper/519:06:467
1533226253sleep110-21swapper/1119:07:403
1518325955sleep00-21swapper/019:05:420
1570699290cyclictest0-21swapper/1122:15:493
15703991913cyclictest0-21swapper/1000:07:342
15703991817cyclictest0-21swapper/1019:25:542
1570299181cyclictest9472-1kworker/9:0H22:30:0911
1570299181cyclictest0-21swapper/922:35:3811
1570299181cyclictest0-21swapper/900:05:1711
15700991816cyclictest32348-21munin-run21:00:019
15700991816cyclictest26643-21snmp_rack3slot922:20:109
15703991716cyclictest7596-1kworker/10:1H22:06:092
15703991716cyclictest0-21swapper/1020:30:182
1570399170cyclictest98442sleep1019:42:322
1570399170cyclictest67182sleep1020:22:472
1570399170cyclictest61372sleep1019:36:292
1570399170cyclictest52022chrt00:02:002
1570399170cyclictest33762sleep1021:01:162
1570399170cyclictest325492sleep1021:41:092
1570399170cyclictest317132chrt20:11:342
1570399170cyclictest307592sleep1000:38:402
1570399170cyclictest277282sleep1019:23:292
1570399170cyclictest262792chrt23:02:062
1570399170cyclictest254732sleep1000:30:142
1570399170cyclictest241022sleep1019:18:402
1570399170cyclictest24022chrt19:30:422
1570399170cyclictest224152sleep1022:15:012
1570399170cyclictest217912sleep1021:28:072
1570399170cyclictest213422sleep1020:43:372
1570399170cyclictest206462chrt19:55:452
1570399170cyclictest196682sleep1000:20:512
1570399170cyclictest195012sleep1023:38:572
1570399170cyclictest188962chrt22:51:042
1570399170cyclictest181792sleep1021:23:312
1570399170cyclictest176712sleep1020:38:012
1570399170cyclictest154042chrt22:48:162
1570399170cyclictest150692sleep1022:05:012
1570399170cyclictest150692sleep1022:05:002
1570399170cyclictest145392chrt21:18:412
1570399170cyclictest12250irq/42-ahci20:52:482
1570399170cyclictest12250irq/42-ahci20:08:552
1570399170cyclictest113572sleep1021:59:222
1570399170cyclictest113572sleep1021:59:222
1570399170cyclictest1105250irq/52-eth0-rx-23:50:132
1570399170cyclictest1105250irq/52-eth0-rx-22:30:202
1570399170cyclictest1105250irq/52-eth0-rx-22:20:142
1570399170cyclictest1105250irq/52-eth0-rx-21:30:492
1570399170cyclictest1105250irq/52-eth0-rx-21:05:322
1570399170cyclictest1105250irq/52-eth0-rx-00:10:312
1570399170cyclictest107002sleep1023:25:192
15702991715cyclictest23392-21snmp_rack3slot922:15:0911
15702991715cyclictest18475-21snmp_rack3slot922:06:4011
1570299170cyclictest15595-1kworker/9:1H23:24:1611
1570299170cyclictest12250irq/42-ahci21:45:3311
1570299170cyclictest12250irq/42-ahci21:45:3211
1570299170cyclictest0-21swapper/923:25:2311
1570299170cyclictest0-21swapper/921:55:2211
1570299170cyclictest0-21swapper/921:55:2211
1570299170cyclictest0-21swapper/921:50:3011
15700991715cyclictest16037-21snmp_rack3slot921:20:119
15706991614cyclictest29190-21chrt22:20:383
15702991615cyclictest0-21swapper/923:00:0011
15702991614cyclictest898-21snmp_rack3slot920:15:1511
15702991614cyclictest414-21snmp_easybox.os21:00:1211
15702991614cyclictest24585-21snmp_rack3slot900:30:0911
15702991614cyclictest17042-21munin-node21:20:2111
15702991614cyclictest1330-21snmp_rack3slot923:55:3711
15702991614cyclictest13048-21snmp_easybox.os20:30:2411
15702991614cyclictest1139-21iostat_ios19:30:2011
15700991614cyclictest23799-21snmp_rack3slot922:15:129
15691991615cyclictest7200-21qemu-kvm21:08:167
15683991615cyclictest2357-21lldpd22:51:486
15683991615cyclictest2357-21lldpd22:21:176
15683991615cyclictest2357-21lldpd19:16:096
15703991514cyclictest0-21swapper/1020:19:242
1570399151cyclictest0-21swapper/1022:36:482
1570399151cyclictest0-21swapper/1021:35:262
1570299155cyclictest0-21swapper/900:20:0211
15702991514cyclictest0-21swapper/919:40:1311
15702991514cyclictest0-21swapper/900:01:0111
15702991513cyclictest27361-21snmp_easybox.os23:50:0811
15702991513cyclictest23099-21chrt23:43:3311
15702991513cyclictest20190-21snmp_rack3slot922:10:1311
1570099155cyclictest0-21swapper/721:40:019
15691991514cyclictest28185-21qemu-kvm20:08:157
15683991514cyclictest2701-21smartctl21:00:336
15683991514cyclictest26506-21smartctl20:05:156
15683991514cyclictest2357-21lldpd21:15:156
15683991514cyclictest2357-21lldpd19:20:396
1566199150cyclictest0-21swapper/120:40:241
15706991413cyclictest1105350irq/53-eth0-tx-19:10:263
15706991412cyclictest29696-21tail19:25:153
1570299144cyclictest0-21swapper/920:45:0011
1570299143cyclictest0-21swapper/923:35:0011
1570299143cyclictest0-21swapper/920:55:0111
15702991413cyclictest9472-1kworker/9:0H22:29:3911
15702991413cyclictest24503-21chrt20:03:0811
15702991413cyclictest173550irq/56-eth1-rx-00:20:0111
15702991413cyclictest0-21swapper/923:15:1311
15702991413cyclictest0-21swapper/921:35:1511
15702991413cyclictest0-21swapper/919:55:4011
15702991412cyclictest17081-21snmp_rack3slot919:51:3511
1570099144cyclictest0-21swapper/723:55:019
1570099144cyclictest0-21swapper/720:20:009
15700991412cyclictest31471-21perl22:25:179
15700991412cyclictest30808-21snmp_easybox.os20:10:229
15683991413cyclictest30579-21smartctl20:55:166
1566199140cyclictest0-21swapper/100:30:101
6699130watchdog/80-21swapper/823:51:3110
1570699135cyclictest0-21swapper/1120:25:223
1570699133cyclictest0-21swapper/1100:10:013
15706991311cyclictest277872sleep1119:24:183
15706991311cyclictest21154-21chrt19:15:173
1570399134cyclictest0-21swapper/1000:30:012
1570399131cyclictest0-21swapper/1020:25:432
1570399130cyclictest12250irq/42-ahci23:45:362
1570399130cyclictest12250irq/42-ahci22:59:572
1570299133cyclictest0-21swapper/922:50:0111
15702991312cyclictest0-21swapper/922:00:1311
15702991312cyclictest0-21swapper/922:00:1311
15702991312cyclictest0-21swapper/920:05:1011
15702991312cyclictest0-21swapper/919:46:3711
15702991312cyclictest0-21swapper/919:15:3811
15702991312cyclictest0-21swapper/919:10:1811
1570099134cyclictest0-21swapper/700:20:019
15700991311cyclictest3020-21perl23:15:149
1569199133cyclictest0-21swapper/520:10:177
15691991312cyclictest18639-21qemu-kvm22:08:237
15683991312cyclictest2357-21lldpd00:25:496
15683991312cyclictest2357-21lldpd00:04:506
1567799133cyclictest0-21swapper/321:50:225
1567799133cyclictest0-21swapper/321:20:165
1567799133cyclictest0-21swapper/320:15:185
1570699123cyclictest0-21swapper/1122:00:013
1570699123cyclictest0-21swapper/1122:00:013
1570699123cyclictest0-21swapper/1120:00:003
1570699122cyclictest0-21swapper/1121:09:203
15706991210cyclictest10948-21chrt21:14:313
1570399123cyclictest0-21swapper/1019:14:562
1570399122cyclictest0-21swapper/1022:42:102
1570299123cyclictest0-21swapper/920:10:0111
1570299122cyclictest0-21swapper/921:25:0111
15702991211cyclictest9472-1kworker/9:0H21:10:1011
15702991211cyclictest9472-1kworker/9:0H21:08:3411
15702991211cyclictest741rcuc/920:22:3511
15702991210cyclictest9492-21snmp_rack3slot922:40:1011
15702991210cyclictest14586-21taskset21:19:2011
1570099123cyclictest0-21swapper/721:20:019
15700991210cyclictest29680-21snmp_rack3slot900:35:239
15700991210cyclictest21971-21snmp_rack3slot919:15:199
15700991210cyclictest1587-21snmp_rack3slot922:30:099
1570099120cyclictest0-21swapper/721:10:199
15683991211cyclictest2357-21lldpd21:14:156
15683991211cyclictest2357-21lldpd20:15:436
15683991211cyclictest2357-21lldpd19:46:416
1566199129cyclictest0-21swapper/121:00:191
1566099122cyclictest0-21swapper/000:05:290
15660991211cyclictest0-21swapper/022:50:260
1566099120cyclictest0-21swapper/023:55:300
6699110watchdog/80-21swapper/823:59:3610
5499110migration/63908-21cpuspeed20:20:128
411110ksoftirqd/40-21swapper/420:50:326
341110ksoftirqd/30-21swapper/320:50:325
31110ksoftirqd/00-21swapper/021:20:250
31110ksoftirqd/00-21swapper/019:50:290
271110ksoftirqd/20-21swapper/221:50:174
1699110watchdog/00-21swapper/020:33:230
1570699113cyclictest0-21swapper/1123:35:263
1570699113cyclictest0-21swapper/1123:34:203
1570699113cyclictest0-21swapper/1123:12:123
1570699113cyclictest0-21swapper/1122:09:163
1570699113cyclictest0-21swapper/1121:35:043
1570699113cyclictest0-21swapper/1120:13:343
1570699113cyclictest0-21swapper/1120:10:013
1570699113cyclictest0-21swapper/1100:27:123
1570699113cyclictest0-21swapper/1100:03:203
1570699111cyclictest0-21swapper/1121:23:413
1570399113cyclictest0-21swapper/1022:25:562
1570399113cyclictest0-21swapper/1022:19:562
15703991110cyclictest7596-1kworker/10:1H21:12:072
1570399111cyclictest0-21swapper/1019:52:112
1570299113cyclictest0-21swapper/923:05:5711
1570299113cyclictest0-21swapper/900:11:5611
1570299111cyclictest0-21swapper/919:35:0111
1570299110cyclictest0-21swapper/919:25:2111
1570099119cyclictest7053-21snmp_rack3slot921:06:489
1570099119cyclictest29085-21snmp_rack3slot919:25:119
1570099114cyclictest0-21swapper/722:00:019
1570099114cyclictest0-21swapper/722:00:019
1570099114cyclictest0-21swapper/719:30:019
1570099113cyclictest0-21swapper/723:40:009
1570099113cyclictest0-21swapper/723:30:019
1570099113cyclictest0-21swapper/723:00:019
1570099113cyclictest0-21swapper/720:27:149
1570099113cyclictest0-21swapper/719:44:569
1570099113cyclictest0-21swapper/719:22:109
1570099113cyclictest0-21swapper/700:30:019
1569799119cyclictest0-21swapper/619:10:148
1569799110cyclictest13361-21grep22:45:148
1569199113cyclictest0-21swapper/523:00:217
1569199113cyclictest0-21swapper/519:20:187
1569199113cyclictest0-21swapper/500:25:177
15683991110cyclictest2357-21lldpd23:19:486
15683991110cyclictest2357-21lldpd22:45:486
15683991110cyclictest2357-21lldpd21:40:156
15683991110cyclictest2357-21lldpd21:09:156
15683991110cyclictest2357-21lldpd20:13:436
1568399110cyclictest0-21swapper/422:05:156
1567799113cyclictest0-21swapper/319:50:005
1566199113cyclictest0-21swapper/123:05:181
1566199113cyclictest0-21swapper/121:05:181
1566199113cyclictest0-21swapper/119:30:021
1566199113cyclictest0-21swapper/119:10:191
1566199113cyclictest0-21swapper/100:20:011
1566199110cyclictest32736-21snmp_rack3slot919:30:121
1566199110cyclictest0-21swapper/122:15:021
1566099119cyclictest0-21swapper/019:30:280
1566099117cyclictest0-21swapper/021:27:040
1566099110cyclictest0-21swapper/021:35:300
1566099110cyclictest0-21swapper/020:50:280
1566099110cyclictest0-21swapper/019:20:300
14850110irq/18-uhci_hcd0-21swapper/022:15:280
901100ksoftirqd/110-21swapper/1122:35:313
901100ksoftirqd/110-21swapper/1120:50:333
8999100migration/1110969-21munin-node22:40:293
691100ksoftirqd/80-21swapper/821:25:3010
691100ksoftirqd/80-21swapper/821:10:2110
691100ksoftirqd/80-21swapper/820:50:3210
691100ksoftirqd/80-21swapper/820:30:1310
6899100migration/84667-21cstates21:05:1210
6899100migration/83666-21idleruntime00:00:1910
6899100migration/832380-21cpuspeed_turbos19:30:1110
6899100migration/828087-21taskset20:07:3010
6899100migration/818755-21cpuspeed_turbos20:40:1210
6899100migration/810051-21munin-node23:25:1210
621100ksoftirqd/70-21swapper/720:50:329
5999100watchdog/70-21swapper/721:47:329
5999100watchdog/70-21swapper/721:47:329
551100ksoftirqd/67200-21qemu-kvm21:10:228
551100ksoftirqd/60-21swapper/622:35:318
551100ksoftirqd/60-21swapper/621:30:258
551100ksoftirqd/60-21swapper/621:25:318
551100ksoftirqd/60-21swapper/620:30:128
551100ksoftirqd/60-21swapper/620:25:368
551100ksoftirqd/60-21swapper/620:15:298
551100ksoftirqd/60-21swapper/620:07:148
5499100migration/616394-21cpuspeed_turbos22:50:098
5499100migration/612807-21gltestperf21:15:168
5299100watchdog/60-21swapper/623:20:598
481100ksoftirqd/50-21swapper/522:45:047
481100ksoftirqd/50-21swapper/522:35:317
481100ksoftirqd/50-21swapper/521:10:227
481100ksoftirqd/50-21swapper/520:15:297
4599100watchdog/50-21swapper/522:14:447
4599100watchdog/50-21swapper/521:38:577
4599100watchdog/50-21swapper/520:28:357
4599100watchdog/50-21swapper/519:51:247
4599100watchdog/50-21swapper/519:46:087
4599100watchdog/50-21swapper/519:43:157
4599100watchdog/50-21swapper/519:35:037
4599100watchdog/50-21swapper/519:16:327
4599100watchdog/50-21swapper/519:10:407
411100ksoftirqd/40-21swapper/419:10:166
3899100watchdog/40-21swapper/421:54:246
3899100watchdog/40-21swapper/400:36:526
341100ksoftirqd/30-21swapper/322:45:055
341100ksoftirqd/30-21swapper/321:10:215
341100ksoftirqd/30-21swapper/320:07:145
31100ksoftirqd/00-21swapper/022:40:290
31100ksoftirqd/00-21swapper/022:35:330
31100ksoftirqd/00-21swapper/022:23:420
31100ksoftirqd/00-21swapper/021:30:250
31100ksoftirqd/00-21swapper/021:10:220
271100ksoftirqd/20-21swapper/220:50:334
2499100watchdog/20-21swapper/221:05:114
2499100watchdog/20-21swapper/200:27:084
201100ksoftirqd/10-21swapper/123:35:151
201100ksoftirqd/10-21swapper/120:15:291
1699100watchdog/00-21swapper/023:05:590
1699100watchdog/00-21swapper/022:45:080
1699100watchdog/00-21swapper/021:55:030
1699100watchdog/00-21swapper/021:55:030
1699100watchdog/00-21swapper/020:05:520
1699100watchdog/00-21swapper/000:26:440
1699100watchdog/00-21swapper/000:03:510
1570699103cyclictest0-21swapper/1123:41:213
1570699103cyclictest0-21swapper/1123:19:593
1570699103cyclictest0-21swapper/1122:55:193
1570699102cyclictest0-21swapper/1123:08:123
1570699102cyclictest0-21swapper/1120:56:263
1570699102cyclictest0-21swapper/1100:30:123
1570699102cyclictest0-21swapper/1100:17:413
1570699101cyclictest0-21swapper/1123:20:573
1570699100cyclictest0-21swapper/1120:15:343
1570399109cyclictest0-21swapper/1020:47:512
1570399108cyclictest0-21swapper/1023:20:142
1570399103cyclictest0-21swapper/1021:45:572
1570399103cyclictest0-21swapper/1021:45:562
1570399102cyclictest0-21swapper/1020:01:122
1570399100cyclictest0-21swapper/1000:15:292
1570299103cyclictest0-21swapper/922:25:0111
1570299103cyclictest0-21swapper/920:35:0111
1570299101cyclictest0-21swapper/900:25:1311
1570299100cyclictest0-21swapper/921:30:4111
1570199101cyclictest0-21swapper/822:55:3910
1570199100cyclictest0-21swapper/823:00:1610
1570099108cyclictest21699-21perl00:25:149
1570099108cyclictest18934-21snmp_rack3slot922:51:329
1570099108cyclictest17049-21snmp_rack3slot919:51:119
1570099108cyclictest16472-21snmp_rack3slot923:35:109
1570099104cyclictest0-21swapper/700:15:219
1570099103cyclictest0-21swapper/722:45:029
1570099103cyclictest0-21swapper/722:06:479
1570099103cyclictest0-21swapper/721:04:159
1570099102cyclictest0-21swapper/723:34:429
1570099102cyclictest0-21swapper/722:39:269
1570099102cyclictest0-21swapper/722:10:269
1570099102cyclictest0-21swapper/719:55:269
1570099102cyclictest0-21swapper/700:09:509
1570099101cyclictest0-21swapper/723:10:019
1570099101cyclictest0-21swapper/720:06:269
1569799109cyclictest28185-21qemu-kvm20:13:128
1569799109cyclictest0-21swapper/622:00:018
1569799109cyclictest0-21swapper/622:00:008
1569799109cyclictest0-21swapper/620:35:228
1569799100cyclictest27944-21cat23:50:118
1569799100cyclictest15419-21qemu-kvm19:15:188
1569799100cyclictest0-21swapper/600:05:318
1569199100cyclictest0-21swapper/522:15:347
1568399109cyclictest27451-21smartctl21:35:196
1568399109cyclictest2357-21lldpd22:35:186
1568399108cyclictest0-21swapper/422:30:236
1568399107cyclictest0-21swapper/400:15:166
1568399103cyclictest0-21swapper/423:40:016
1567799109cyclictest0-21swapper/322:50:225
1567799108cyclictest0-21swapper/300:25:015
1567799104cyclictest0-21swapper/323:25:195
1567799102cyclictest0-21swapper/321:35:215
1567799102cyclictest0-21swapper/321:00:015
1567799102cyclictest0-21swapper/320:00:195
1567799102cyclictest0-21swapper/319:15:235
1567799102cyclictest0-21swapper/300:10:235
1567799100cyclictest0-21swapper/323:35:145
1567799100cyclictest0-21swapper/300:05:225
1566699108cyclictest0-21swapper/222:15:104
1566699100cyclictest0-21swapper/223:30:494
1566199104cyclictest0-21swapper/100:20:171
1566199102cyclictest0-21swapper/122:50:181
1566199100cyclictest0-21swapper/123:21:511
1566199100cyclictest0-21swapper/123:01:501
1566199100cyclictest0-21swapper/120:55:111
1566099109cyclictest0-21swapper/022:30:280
1566099109cyclictest0-21swapper/021:05:270
1566099109cyclictest0-21swapper/020:20:260
1566099109cyclictest0-21swapper/019:45:250
1566099109cyclictest0-21swapper/019:10:290
1566099109cyclictest0-21swapper/000:20:270
1566099108cyclictest0-21swapper/023:50:260
1566099108cyclictest0-21swapper/019:40:300
1566099100cyclictest0-21swapper/023:30:320
1566099100cyclictest0-21swapper/023:25:280
1566099100cyclictest0-21swapper/023:20:280
1566099100cyclictest0-21swapper/023:10:270
1566099100cyclictest0-21swapper/022:25:310
1566099100cyclictest0-21swapper/022:10:260
1566099100cyclictest0-21swapper/022:05:330
1566099100cyclictest0-21swapper/021:50:300
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional