You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-24 - 01:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Sat Sep 23, 2023 12:46:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
127501120irq/42-ahci0-21swapper/207:09:034
127501120irq/42-ahci0-21swapper/107:09:341
20359501110irq/53-eth0-tx-0-21swapper/407:05:286
127501030irq/42-ahci0-21swapper/307:08:255
20358501000irq/52-eth0-rx-0-21swapper/707:08:579
2012229287sleep100-21swapper/1007:09:582
1988628878sleep50-21swapper/507:07:287
12750840irq/42-ahci0-21swapper/907:09:1011
1695827969sleep60-21swapper/607:05:058
14950700irq/18-uhci_hcd0-21swapper/1107:05:283
1984826753sleep00-21swapper/007:06:590
1981326253sleep80-21swapper/807:06:3210
20232992914cyclictest0-21swapper/008:23:550
20274992524cyclictest0-21swapper/1108:22:093
2027499210cyclictest0-21swapper/1110:24:463
2027499210cyclictest0-21swapper/1108:16:403
2027499200cyclictest0-21swapper/1109:30:033
20274991917cyclictest0-21swapper/1110:18:313
20232991918cyclictest2035850irq/52-eth0-rx-07:16:280
2023299190cyclictest0-21swapper/009:30:000
2027299181cyclictest761ksoftirqd/909:50:3811
2027299181cyclictest761ksoftirqd/909:05:0111
2027299181cyclictest761ksoftirqd/907:45:1811
2027299181cyclictest761ksoftirqd/907:40:2611
2027299181cyclictest31466-21munin-node07:20:3511
2027299181cyclictest18935-21http_loadtime11:30:2411
2027299181cyclictest17059-21snmp_rack3slot909:15:1911
2027299181cyclictest12666-21switchtime11:20:3811
2027299181cyclictest10612-21kworker/9:011:25:2811
2027299181cyclictest0-21swapper/912:17:3311
2027299181cyclictest0-21swapper/912:00:2011
2027299181cyclictest0-21swapper/911:54:4611
2027299181cyclictest0-21swapper/911:39:2211
2027299181cyclictest0-21swapper/911:03:3011
2027299181cyclictest0-21swapper/910:30:3811
2027299181cyclictest0-21swapper/908:10:2711
2027299181cyclictest0-21swapper/908:10:2611
2027299181cyclictest0-21swapper/907:27:1911
2023299180cyclictest0-21swapper/010:24:360
20273991715cyclictest2925-21snmp_rack3slot909:40:202
20273991715cyclictest28132sleep1011:54:182
20273991715cyclictest25326-21snmp_rack3slot907:56:462
20273991715cyclictest22159-21hddtemp_smartct10:50:252
2027299175cyclictest0-21swapper/910:15:0111
20272991716cyclictest761ksoftirqd/912:05:1811
20272991716cyclictest761ksoftirqd/907:30:3111
20272991716cyclictest19533-21snmp_rack3slot907:50:2011
20272991716cyclictest0-21swapper/910:45:1611
2027299170cyclictest761ksoftirqd/912:25:0011
2027299170cyclictest761ksoftirqd/912:10:1911
2027299170cyclictest761ksoftirqd/909:25:2511
2027299170cyclictest32073-21snmp_rack3slot910:20:1911
2027299170cyclictest12909-21snmp_rack3slot908:25:2411
2027299170cyclictest12624-21snmp_easybox.os09:10:1711
2027299170cyclictest10185-21munin-node08:20:2811
2027299170cyclictest0-21swapper/910:10:0211
2027299170cyclictest0-21swapper/909:20:3111
2027299170cyclictest0-21swapper/909:06:5111
2027299170cyclictest0-21swapper/908:40:3811
2027299170cyclictest0-21swapper/908:39:1811
2027299170cyclictest0-21swapper/908:16:0811
2027299170cyclictest0-21swapper/907:36:1511
20266991715cyclictest29017-21snmp_rack3slot908:01:568
20266991710cyclictest30780-21idleruntime-cro10:20:018
20259991716cyclictest19991-21qemu-kvm07:13:457
20232991712cyclictest0-21swapper/008:25:160
20274991614cyclictest0-21swapper/1111:43:013
20273991615cyclictest5284-1kworker/10:1H11:20:352
20273991615cyclictest5284-1kworker/10:1H10:33:522
20273991615cyclictest5284-1kworker/10:1H08:01:472
20273991615cyclictest318592sleep1012:32:582
20273991615cyclictest0-21swapper/1010:14:272
20273991614cyclictest20592-21snmp_rack3slot908:35:222
20272991615cyclictest8288-1kworker/9:1H09:40:0211
20272991615cyclictest761ksoftirqd/909:55:0011
20272991615cyclictest761ksoftirqd/909:30:2411
20272991615cyclictest31847-21iostat_ios08:50:2711
20272991615cyclictest2879-21munin-node08:55:2411
20272991615cyclictest28677-21munin-node08:45:3411
20272991615cyclictest0-21swapper/912:36:0111
20272991615cyclictest0-21swapper/912:32:0911
20272991615cyclictest0-21swapper/912:28:1411
20272991615cyclictest0-21swapper/911:10:2011
20272991615cyclictest0-21swapper/910:56:4511
20272991615cyclictest0-21swapper/910:53:2311
20272991615cyclictest0-21swapper/910:40:5411
20272991615cyclictest0-21swapper/910:40:5311
20272991615cyclictest0-21swapper/910:01:5811
20272991615cyclictest0-21swapper/909:48:1911
20272991615cyclictest0-21swapper/908:30:2911
20272991615cyclictest0-21swapper/908:02:2411
20272991615cyclictest0-21swapper/907:18:4511
20272991615cyclictest0-21swapper/907:12:0011
20259991615cyclictest321-21qemu-kvm08:27:017
20259991615cyclictest321-21qemu-kvm08:22:037
20259991614cyclictest322-21qemu-kvm08:40:197
20259991614cyclictest322-21qemu-kvm08:08:387
20253991615cyclictest7064-21smartctl09:45:236
20253991615cyclictest4287-21smartctl09:40:366
20237991615cyclictest2349-21snmpd12:03:224
20237991615cyclictest2349-21snmpd11:09:204
2023399164cyclictest0-21swapper/107:25:291
20274991513cyclictest32141-21snmp_rack3slot909:35:223
20274991513cyclictest0-21swapper/1112:35:443
20274991513cyclictest0-21swapper/1111:31:193
20274991513cyclictest0-21swapper/1108:05:293
2027499150cyclictest0-21swapper/1109:08:163
20273991514cyclictest5284-1kworker/10:1H10:09:112
20273991514cyclictest5284-1kworker/10:1H07:35:052
20273991514cyclictest0-21swapper/1011:31:102
20273991514cyclictest0-21swapper/1008:15:212
20273991513cyclictest31109-21snmp_easybox.os07:20:322
20272991514cyclictest761ksoftirqd/909:40:3911
20272991514cyclictest32069-21cat08:05:3311
20272991514cyclictest0-21swapper/911:56:1811
20272991514cyclictest0-21swapper/911:47:1011
20272991514cyclictest0-21swapper/911:40:3211
20272991514cyclictest0-21swapper/911:18:1911
20272991514cyclictest0-21swapper/910:38:5811
20272991514cyclictest0-21swapper/910:38:5711
20272991514cyclictest0-21swapper/910:26:2311
20272991514cyclictest0-21swapper/910:26:2211
20272991514cyclictest0-21swapper/910:10:2911
2026699153cyclictest0-21swapper/607:44:558
20266991513cyclictest6961-21snmp_rack3slot909:45:228
20266991513cyclictest322-21qemu-kvm08:08:578
20266991513cyclictest18491-21snmp_rack3slot910:45:208
20259991513cyclictest321-21qemu-kvm08:45:247
2025399154cyclictest0-21swapper/409:25:286
20253991514cyclictest31612-21smartctl08:50:246
20253991514cyclictest2349-21snmpd09:13:366
20253991514cyclictest2349-21snmpd08:30:046
20253991514cyclictest2349-21snmpd08:25:046
20253991514cyclictest1444-21smartctl12:35:226
20237991514cyclictest2349-21snmpd10:13:214
2023399154cyclictest0-21swapper/107:35:241
2023299153cyclictest0-21swapper/007:10:230
2023299150cyclictest0-21swapper/009:04:590
13950150irq/18-ehci_hcd0-21swapper/012:20:350
13950150irq/18-ehci_hcd0-21swapper/007:50:340
8099140watchdog/100-21swapper/1010:19:282
2027499144cyclictest0-21swapper/1111:35:283
20274991412cyclictest42372sleep1107:30:133
20274991412cyclictest3576-21cpuspeed11:55:173
20274991412cyclictest25504-21ls12:25:193
20274991412cyclictest23420-21chrt10:09:063
20274991412cyclictest11647-21switchtime09:50:363
20274991412cyclictest0-21swapper/1111:49:233
20274991412cyclictest0-21swapper/1111:20:393
20274991412cyclictest0-21swapper/1109:19:493
20274991412cyclictest0-21swapper/1108:49:593
20274991412cyclictest0-21swapper/1108:40:233
20274991412cyclictest0-21swapper/1107:42:283
20274991410cyclictest0-21swapper/1111:25:283
2027499141cyclictest0-21swapper/1110:46:103
2027499141cyclictest0-21swapper/1110:11:263
2027499141cyclictest0-21swapper/1109:46:493
2027499141cyclictest0-21swapper/1107:45:433
2027499141cyclictest0-21swapper/1107:21:003
2027499141cyclictest0-21swapper/1107:15:153
2027499141cyclictest0-21swapper/1107:12:093
2027499140cyclictest0-21swapper/1110:00:083
20273991413cyclictest0-21swapper/1011:35:252
20273991413cyclictest0-21swapper/1010:59:252
20272991413cyclictest0-21swapper/911:05:3611
20272991413cyclictest0-21swapper/907:58:3911
2027099144cyclictest0-21swapper/710:15:009
2026699145cyclictest0-21swapper/612:39:498
2026699145cyclictest0-21swapper/610:44:208
2026699145cyclictest0-21swapper/610:44:198
2026699142cyclictest0-21swapper/607:33:068
20266991413cyclictest15229-21cpuspeed07:45:168
20266991412cyclictest9655-21snmp_rack3slot908:20:228
2023399140cyclictest0-21swapper/110:55:081
20232991413cyclictest3472-21taskset07:26:480
13950140irq/18-ehci_hcd0-21swapper/012:16:240
2027499134cyclictest0-21swapper/1111:05:423
2027499133cyclictest0-21swapper/1107:53:373
20274991311cyclictest7704-21cat07:35:003
20274991311cyclictest12959-21sed09:55:013
20274991311cyclictest0-21swapper/1112:34:453
20274991311cyclictest0-21swapper/1112:00:363
20274991311cyclictest0-21swapper/1111:50:283
20274991311cyclictest0-21swapper/1110:55:073
20274991311cyclictest0-21swapper/1110:50:353
20274991311cyclictest0-21swapper/1110:30:213
20274991311cyclictest0-21swapper/1108:10:383
20274991311cyclictest0-21swapper/1108:10:383
2027499131cyclictest0-21swapper/1112:15:423
2027499131cyclictest0-21swapper/1111:14:033
2027499131cyclictest0-21swapper/1110:27:193
2027499131cyclictest0-21swapper/1110:27:183
2027499131cyclictest0-21swapper/1109:41:183
2027499131cyclictest0-21swapper/1109:25:123
2027499131cyclictest0-21swapper/1109:20:363
2027499131cyclictest0-21swapper/1109:13:393
2027499131cyclictest0-21swapper/1108:35:083
2027499131cyclictest0-21swapper/1108:30:203
2027499131cyclictest0-21swapper/1108:25:403
2027499131cyclictest0-21swapper/1107:26:333
2027499130cyclictest0-21swapper/1112:10:273
2027499130cyclictest0-21swapper/1112:08:493
2027499130cyclictest0-21swapper/1109:00:023
2027499130cyclictest0-21swapper/1107:56:343
20273991312cyclictest5284-1kworker/10:1H07:46:252
2027399131cyclictest12750irq/42-ahci10:40:522
2027399131cyclictest12750irq/42-ahci10:40:522
2027399131cyclictest12750irq/42-ahci09:56:102
2027399130cyclictest99322sleep1012:01:302
2027399130cyclictest831ksoftirqd/1009:03:222
2027399130cyclictest72282sleep1007:33:252
2027399130cyclictest30382sleep1011:10:112
2027399130cyclictest295072sleep1008:47:092
2027399130cyclictest260122sleep1008:44:092
2027399130cyclictest236112sleep1007:11:452
2027399130cyclictest208512sleep1012:16:322
2027399130cyclictest2035850irq/52-eth0-rx-11:40:342
2027399130cyclictest199402sleep1010:45:452
2027399130cyclictest19302sleep1010:24:312
2027399130cyclictest168022sleep1011:26:382
2027399130cyclictest156822chrt08:30:172
2027399130cyclictest14052sleep1009:39:392
2027399130cyclictest131202sleep1007:40:242
2027399130cyclictest12750irq/42-ahci09:08:432
2027399130cyclictest12750irq/42-ahci08:08:272
2027199133cyclictest0-21swapper/810:27:4410
2027199133cyclictest0-21swapper/810:27:4310
2027199133cyclictest0-21swapper/809:43:1210
2027199133cyclictest0-21swapper/808:56:4110
2027199133cyclictest0-21swapper/808:12:3810
2027199133cyclictest0-21swapper/808:12:3810
2027199133cyclictest0-21swapper/807:20:1710
2027099134cyclictest0-21swapper/710:30:009
2027099134cyclictest0-21swapper/710:30:009
2027099133cyclictest0-21swapper/710:20:019
2027099133cyclictest0-21swapper/707:30:019
2026699134cyclictest0-21swapper/607:50:028
20266991311cyclictest5637-21snmp_rack3slot908:15:238
2025999133cyclictest0-21swapper/512:40:007
20259991312cyclictest321-21qemu-kvm08:34:247
2024699134cyclictest0-21swapper/307:55:295
2023799133cyclictest0-21swapper/211:20:234
2023399134cyclictest0-21swapper/108:45:021
20232991311cyclictest6483-21snmp_rack3slot909:45:200
2023299131cyclictest0-21swapper/009:25:240
13950130irq/18-ehci_hcd0-21swapper/010:55:580
13950130irq/18-ehci_hcd0-21swapper/010:05:340
6699120watchdog/80-21swapper/810:24:1710
31120ksoftirqd/00-21swapper/011:20:330
2499120watchdog/20-21swapper/208:52:494
2027499121cyclictest0-21swapper/1111:00:073
2027499121cyclictest0-21swapper/1110:40:553
2027499121cyclictest0-21swapper/1110:40:543
2027499121cyclictest0-21swapper/1110:35:343
2027499121cyclictest0-21swapper/1110:35:343
2027499121cyclictest0-21swapper/1108:56:113
2027499120cyclictest0-21swapper/1112:20:053
2027499120cyclictest0-21swapper/1111:15:343
2027499120cyclictest0-21swapper/1108:52:043
2027499120cyclictest0-21swapper/1108:00:033
2027399122cyclictest0-21swapper/1009:28:112
2027399122cyclictest0-21swapper/1008:20:132
2027399122cyclictest0-21swapper/1007:25:372
20273991211cyclictest0-21swapper/1012:10:202
20273991210cyclictest20691-21snmp_rack3slot909:20:192
2027399121cyclictest38772chrt11:55:172
2027399120cyclictest95312sleep1011:16:362
2027399120cyclictest93412sleep1009:50:032
2027399120cyclictest8762sleep1008:54:452
2027399120cyclictest57022sleep1009:45:142
2027399120cyclictest44182chrt08:56:572
2027399120cyclictest313282sleep1011:46:152
2027399120cyclictest310262chrt11:02:112
2027399120cyclictest300752sleep1009:32:372
2027399120cyclictest30062chrt12:36:082
2027399120cyclictest286212sleep1007:17:582
2027399120cyclictest281512sleep1012:26:572
2027399120cyclictest216172sleep1007:50:492
2027399120cyclictest196762chrt10:03:392
2027399120cyclictest176372sleep1009:15:242
2027399120cyclictest135052sleep1012:05:412
2027399120cyclictest128782chrt10:38:452
2027399120cyclictest128782chrt10:38:442
2027399120cyclictest125522chrt09:10:092
2027399120cyclictest10022chrt08:10:162
2027399120cyclictest10022chrt08:10:152
2027199123cyclictest0-21swapper/809:51:5010
2027199122cyclictest0-21swapper/812:16:1710
2027199122cyclictest0-21swapper/810:55:1410
2027199122cyclictest0-21swapper/810:14:2010
2027199122cyclictest0-21swapper/807:17:0510
2027099123cyclictest0-21swapper/710:35:029
2027099123cyclictest0-21swapper/710:35:019
2027099123cyclictest0-21swapper/709:55:009
2027099122cyclictest0-21swapper/711:14:519
2026699125cyclictest0-21swapper/611:55:008
2026699120cyclictest0-21swapper/612:00:008
20259991211cyclictest2349-21snmpd08:50:117
20259991210cyclictest23348-21qemu-kvm10:47:277
20253991211cyclictest27890-21smartctl07:15:356
20237991211cyclictest2349-21snmpd07:21:054
20237991210cyclictest2349-21snmpd07:14:044
2023399124cyclictest0-21swapper/111:40:261
2023399124cyclictest0-21swapper/111:19:591
2023399124cyclictest0-21swapper/107:20:001
2023299122cyclictest0-21swapper/009:20:230
20232991211cyclictest2035850irq/52-eth0-rx-07:24:480
2023299120cyclictest0-21swapper/008:45:350
31110ksoftirqd/00-21swapper/012:30:340
31110ksoftirqd/00-21swapper/011:25:350
31110ksoftirqd/00-21swapper/010:50:560
2027199118cyclictest0-21swapper/807:57:1210
2027199115cyclictest0-21swapper/807:25:0210
2027199114cyclictest0-21swapper/809:05:0010
2027199113cyclictest0-21swapper/812:36:1910
2027199113cyclictest0-21swapper/812:07:4810
2027199113cyclictest0-21swapper/811:31:4710
2027199113cyclictest0-21swapper/811:22:5510
2027199113cyclictest0-21swapper/811:19:4010
2027199113cyclictest0-21swapper/810:52:0510
2027199113cyclictest0-21swapper/810:30:3610
2027199113cyclictest0-21swapper/810:16:4910
2027199113cyclictest0-21swapper/809:30:2110
2027199113cyclictest0-21swapper/809:27:1310
2027199113cyclictest0-21swapper/808:45:2010
2027199113cyclictest0-21swapper/808:30:3410
2027199112cyclictest0-21swapper/812:03:4710
2027199111cyclictest0-21swapper/810:05:4410
2027099118cyclictest0-21swapper/708:26:539
2027099113cyclictest0-21swapper/711:36:169
2027099113cyclictest0-21swapper/710:08:439
2027099113cyclictest0-21swapper/709:10:019
2027099113cyclictest0-21swapper/708:15:019
2027099113cyclictest0-21swapper/708:15:009
2027099113cyclictest0-21swapper/707:52:089
2027099112cyclictest0-21swapper/708:45:019
2027099111cyclictest0-21swapper/711:24:299
2027099111cyclictest0-21swapper/708:15:169
2027099110cyclictest0-21swapper/709:20:199
2026699119cyclictest322-21qemu-kvm08:10:228
2026699119cyclictest322-21qemu-kvm08:10:228
2026699113cyclictest0-21swapper/612:09:188
2026699113cyclictest0-21swapper/611:26:178
2026699113cyclictest0-21swapper/611:00:458
2026699113cyclictest0-21swapper/608:32:098
2026699110cyclictest0-21swapper/611:39:558
2025999119cyclictest19991-21qemu-kvm07:25:507
2025999113cyclictest0-21swapper/508:55:257
20259991110cyclictest322-21qemu-kvm08:35:217
2025999111cyclictest0-21swapper/509:40:247
2025399113cyclictest0-21swapper/408:20:016
2024699113cyclictest0-21swapper/312:20:275
2023399115cyclictest0-21swapper/111:11:361
2023399113cyclictest0-21swapper/112:30:281
2023399113cyclictest0-21swapper/112:18:321
2023399113cyclictest0-21swapper/109:56:301
2023399113cyclictest0-21swapper/108:35:251
2023399112cyclictest0-21swapper/111:45:261
2023399112cyclictest0-21swapper/109:31:391
2023399112cyclictest0-21swapper/108:20:271
2023399111cyclictest0-21swapper/108:32:461
2023299119cyclictest0-21swapper/010:15:350
2023299115cyclictest0-21swapper/008:05:350
2023299113cyclictest0-21swapper/011:55:230
2023299113cyclictest0-21swapper/008:10:260
2023299113cyclictest0-21swapper/008:10:250
20232991110cyclictest0-21swapper/008:30:350
2023299110cyclictest0-21swapper/009:05:150
1699110watchdog/00-21swapper/007:32:080
14950110irq/18-uhci_hcd0-21swapper/011:35:330
691100ksoftirqd/80-21swapper/807:10:1510
6899100migration/832059-21gltestperf09:35:2010
6899100migration/828520-21cpuspeed_turbos11:00:1810
6899100migration/811105-21unixbench_multi08:20:3910
6699100watchdog/80-21swapper/811:51:4810
6699100watchdog/80-21swapper/811:45:2810
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional