You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-22 - 09:46

x86 Intel Core i7-X980 @3333 MHz, Linux 3.12.31-rt45 (Profile)

Latency plot of system in rack #3, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Wed Mar 22, 2023 00:46:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24127210893sleep20-21swapper/219:07:294
121501060irq/42-ahci0-21swapper/719:08:549
24109210391sleep110-21swapper/1119:07:133
24094210190sleep100-21swapper/1019:07:002
1491950950irq/45-eth0-tx-0-21swapper/319:06:395
1491850940irq/44-eth0-rx-0-21swapper/419:05:236
1491850910irq/44-eth0-rx-0-21swapper/119:05:241
1491850880irq/44-eth0-rx-0-21swapper/519:06:377
123350760irq/18-parport00-21swapper/919:06:0211
119250750irq/18-i801_smb0-21swapper/819:06:0210
2406725955sleep00-21swapper/019:06:390
2266125848sleep60-21swapper/619:05:198
2447299330cyclictest0-21swapper/021:25:180
24510993029cyclictest1491850irq/44-eth0-rx-22:17:099
24509992720cyclictest0-21swapper/622:40:008
24480992625cyclictest1491850irq/44-eth0-rx-22:17:261
24520992524cyclictest12150irq/42-ahci22:17:232
24500992221cyclictest12150irq/42-ahci22:17:236
24472992221cyclictest0-21swapper/022:17:240
24521992120cyclictest0-21swapper/1120:09:033
2452199195cyclictest0-21swapper/1100:07:313
2452099195cyclictest0-21swapper/1019:10:202
24521991816cyclictest276902sleep1121:25:033
24520991817cyclictest831ksoftirqd/1020:25:002
24520991817cyclictest3222sleep1019:17:002
24520991817cyclictest123362sleep1021:02:132
24520991817cyclictest0-21swapper/1023:59:592
2452099181cyclictest831ksoftirqd/1022:35:322
2452099181cyclictest1491850irq/44-eth0-rx-19:45:232
2452099181cyclictest12150irq/42-ahci20:14:592
2452099181cyclictest12150irq/42-ahci20:09:292
2452099181cyclictest119250irq/18-i801_smb22:07:272
24518991816cyclictest31717-21sed00:25:3211
24518991816cyclictest19528-21sed21:55:3111
2451899181cyclictest0-21swapper/921:10:1511
2452199170cyclictest0-21swapper/1122:21:133
24520991716cyclictest831ksoftirqd/1020:15:252
24520991716cyclictest20931-21expr21:15:152
24520991716cyclictest13016-1kworker/10:1H21:20:422
24520991716cyclictest11358-21basename21:45:222
24520991716cyclictest0-21swapper/1023:22:482
2452099170cyclictest93262sleep1019:30:142
2452099170cyclictest90662chrt21:40:402
2452099170cyclictest90662chrt21:40:402
2452099170cyclictest87062chrt20:57:472
2452099170cyclictest8512sleep1020:02:552
2452099170cyclictest831ksoftirqd/1023:15:412
2452099170cyclictest831ksoftirqd/1023:06:302
2452099170cyclictest831ksoftirqd/1022:58:082
2452099170cyclictest831ksoftirqd/1022:50:212
2452099170cyclictest831ksoftirqd/1022:00:172
2452099170cyclictest831ksoftirqd/1021:59:062
2452099170cyclictest831ksoftirqd/1020:45:322
2452099170cyclictest831ksoftirqd/1019:55:122
2452099170cyclictest831ksoftirqd/1000:35:012
2452099170cyclictest811rcuc/1020:50:182
2452099170cyclictest811rcuc/1019:35:182
2452099170cyclictest78972sleep1019:29:252
2452099170cyclictest67572sleep1023:50:542
2452099170cyclictest56112sleep1021:38:182
2452099170cyclictest40222sleep1019:21:122
2452099170cyclictest35352sleep1000:31:002
2452099170cyclictest322212sleep1000:25:362
2452099170cyclictest312382sleep1023:40:302
2452099170cyclictest31182chrt23:45:542
2452099170cyclictest27612sleep1023:01:142
2452099170cyclictest271772sleep1020:40:092
2452099170cyclictest263782sleep1020:36:082
2452099170cyclictest258072chrt00:20:102
2452099170cyclictest243792sleep1019:50:172
2452099170cyclictest231292chrt22:45:232
2452099170cyclictest229562sleep1020:34:222
2452099170cyclictest221612sleep1000:15:102
2452099170cyclictest221612sleep1000:15:092
2452099170cyclictest209902sleep1023:26:402
2452099170cyclictest18992chrt21:33:272
2452099170cyclictest185392sleep1019:40:382
2452099170cyclictest178142sleep1000:07:202
2452099170cyclictest167672sleep1021:10:122
2452099170cyclictest163602sleep1021:50:552
2452099170cyclictest158802chrt21:06:002
2452099170cyclictest1491850irq/44-eth0-rx-23:35:342
2452099170cyclictest1491850irq/44-eth0-rx-22:40:182
2452099170cyclictest1491850irq/44-eth0-rx-22:25:212
2452099170cyclictest1491850irq/44-eth0-rx-22:10:262
2452099170cyclictest1491850irq/44-eth0-rx-00:10:162
2452099170cyclictest132552sleep1022:31:092
2452099170cyclictest126032chrt20:20:072
2452099170cyclictest12150irq/42-ahci23:30:152
2452099170cyclictest12150irq/42-ahci21:25:012
2452099170cyclictest112262sleep1000:00:082
2452099170cyclictest100382sleep1023:11:022
24518991715cyclictest31494-21iostat19:15:2511
24518991715cyclictest24798-21cat19:50:2211
24518991715cyclictest20417-21cut19:45:1911
2451899170cyclictest0-21swapper/921:35:1711
2451899170cyclictest0-21swapper/920:35:1811
2451199174cyclictest0-21swapper/821:35:0110
2451199170cyclictest0-21swapper/821:51:2310
24509991715cyclictest4661-21qemu-kvm20:25:168
24509991715cyclictest16093-21qemu-kvm21:08:398
24521991615cyclictest4849-21python21:35:293
24521991614cyclictest276262sleep1122:09:213
2452199161cyclictest32228-21cpuspeed_turbos22:15:183
2452199160cyclictest0-21swapper/1123:05:153
2452199160cyclictest0-21swapper/1121:40:273
2452199160cyclictest0-21swapper/1121:40:263
2452199160cyclictest0-21swapper/1119:40:403
24518991615cyclictest8488-21smartctl21:40:3211
24518991615cyclictest8488-21smartctl21:40:3111
24518991615cyclictest0-21swapper/920:49:5811
24518991615cyclictest0-21swapper/919:20:1811
24518991614cyclictest22307-21cut22:45:1711
24518991614cyclictest15573-21expr00:05:1911
24518991614cyclictest13524-21awk23:15:3111
2451199163cyclictest0-21swapper/821:31:1610
2451199163cyclictest0-21swapper/819:52:3410
2451199162cyclictest0-21swapper/823:38:3610
2451199162cyclictest0-21swapper/823:16:5810
2451199160cyclictest0-21swapper/822:01:5410
2451199160cyclictest0-21swapper/821:20:2910
2451199160cyclictest0-21swapper/800:33:4910
2450999163cyclictest9550-21fschecks_time19:30:158
2449399169cyclictest1491950irq/45-eth0-tx-21:25:175
2449399163cyclictest0-21swapper/321:40:015
2449399160cyclictest0-21swapper/321:51:005
2449399160cyclictest0-21swapper/321:18:285
24488991615cyclictest1491850irq/44-eth0-rx-21:25:194
2447299162cyclictest0-21swapper/022:08:270
24472991614cyclictest162212sleep021:09:500
24472991614cyclictest0-21swapper/019:30:380
2447299160cyclictest0-21swapper/021:30:280
7399150watchdog/90-21swapper/919:12:1111
2452199150cyclictest28810-21kernelversion20:40:213
2452199150cyclictest21492-21cat23:30:023
2452199150cyclictest0-21swapper/1123:50:553
2452199150cyclictest0-21swapper/1123:39:133
2452199150cyclictest0-21swapper/1123:12:313
2452199150cyclictest0-21swapper/1122:50:013
2452199150cyclictest0-21swapper/1121:56:133
2452199150cyclictest0-21swapper/1121:23:083
2452199150cyclictest0-21swapper/1121:16:473
2452199150cyclictest0-21swapper/1120:50:363
2452199150cyclictest0-21swapper/1119:32:423
2452199150cyclictest0-21swapper/1100:29:373
2451899154cyclictest0-21swapper/922:30:0011
24518991514cyclictest0-21swapper/921:27:1311
24518991513cyclictest5429-21cat22:20:3911
24518991513cyclictest31214-21sed21:30:0011
24518991513cyclictest30239-21taskset20:44:2211
24518991513cyclictest29631-21basename22:10:1911
24518991513cyclictest21151-21taskset23:28:5311
24518991513cyclictest12926-21sed19:35:1411
24518991513cyclictest10303-21logger23:14:3611
2451199155cyclictest0-21swapper/821:10:0210
2451199154cyclictest0-21swapper/823:55:0210
2451199153cyclictest0-21swapper/820:45:0110
2451199153cyclictest0-21swapper/819:21:5910
2451199152cyclictest0-21swapper/823:50:2710
2451199152cyclictest0-21swapper/820:03:5110
2451199152cyclictest0-21swapper/800:23:5910
2451199152cyclictest0-21swapper/800:03:2810
2451199150cyclictest0-21swapper/823:20:2710
2451199150cyclictest0-21swapper/823:00:0710
2451199150cyclictest0-21swapper/822:56:2610
2451199150cyclictest0-21swapper/822:20:1710
2451199150cyclictest0-21swapper/821:49:2610
2451199150cyclictest0-21swapper/821:40:3010
2451199150cyclictest0-21swapper/821:40:3010
2451199150cyclictest0-21swapper/821:26:5310
2451199150cyclictest0-21swapper/821:04:1310
2451199150cyclictest0-21swapper/820:44:2310
2451199150cyclictest0-21swapper/800:27:0510
24500991513cyclictest28012-21python00:20:326
2449399153cyclictest0-21swapper/322:40:005
2449399153cyclictest0-21swapper/320:00:175
2449399150cyclictest0-21swapper/323:07:105
2449399150cyclictest0-21swapper/321:31:455
2449399150cyclictest0-21swapper/300:35:075
24521991412cyclictest0-21swapper/1120:04:563
2452199140cyclictest0-21swapper/1123:56:543
2452199140cyclictest0-21swapper/1123:45:323
2452199140cyclictest0-21swapper/1123:31:283
2452199140cyclictest0-21swapper/1123:23:123
2452199140cyclictest0-21swapper/1123:00:223
2452199140cyclictest0-21swapper/1122:58:213
2452199140cyclictest0-21swapper/1122:49:393
2452199140cyclictest0-21swapper/1122:40:173
2452199140cyclictest0-21swapper/1122:35:473
2452199140cyclictest0-21swapper/1122:30:263
2452199140cyclictest0-21swapper/1122:27:583
2452199140cyclictest0-21swapper/1122:11:393
2452199140cyclictest0-21swapper/1122:00:013
2452199140cyclictest0-21swapper/1121:50:523
2452199140cyclictest0-21swapper/1121:46:053
2452199140cyclictest0-21swapper/1121:32:363
2452199140cyclictest0-21swapper/1121:11:033
2452199140cyclictest0-21swapper/1121:05:163
2452199140cyclictest0-21swapper/1121:00:243
2452199140cyclictest0-21swapper/1120:45:153
2452199140cyclictest0-21swapper/1120:35:223
2452199140cyclictest0-21swapper/1120:31:583
2452199140cyclictest0-21swapper/1120:25:283
2452199140cyclictest0-21swapper/1120:20:463
2452199140cyclictest0-21swapper/1120:16:113
2452199140cyclictest0-21swapper/1120:10:233
2452199140cyclictest0-21swapper/1119:58:123
2452199140cyclictest0-21swapper/1119:53:563
2452199140cyclictest0-21swapper/1119:47:253
2452199140cyclictest0-21swapper/1119:36:113
2452199140cyclictest0-21swapper/1119:19:053
2452199140cyclictest0-21swapper/1119:10:563
2452199140cyclictest0-21swapper/1100:35:233
2452199140cyclictest0-21swapper/1100:34:413
2452199140cyclictest0-21swapper/1100:22:043
2452199140cyclictest0-21swapper/1100:10:043
2452199140cyclictest0-21swapper/1100:00:253
24520991413cyclictest5653-21timerandwakeup22:20:402
2451899144cyclictest0-21swapper/921:20:0211
2451899144cyclictest0-21swapper/900:05:0111
24518991413cyclictest0-21swapper/920:50:2211
24518991412cyclictest7363-21kernelversion20:55:2111
2451199144cyclictest0-21swapper/820:05:0010
2451199144cyclictest0-21swapper/800:05:0110
2451199143cyclictest0-21swapper/823:05:0110
2451199143cyclictest0-21swapper/822:28:4410
2451199143cyclictest0-21swapper/822:06:2610
2451199143cyclictest0-21swapper/820:58:2310
2451199143cyclictest0-21swapper/820:25:0110
2451199142cyclictest0-21swapper/823:41:2710
2451199142cyclictest0-21swapper/823:34:5110
2451199142cyclictest0-21swapper/823:11:5710
2451199142cyclictest0-21swapper/822:52:2510
2451199142cyclictest0-21swapper/820:51:5210
2451199142cyclictest0-21swapper/820:33:2210
2451199142cyclictest0-21swapper/800:37:1010
2451199142cyclictest0-21swapper/800:19:4110
2451199142cyclictest0-21swapper/800:19:4010
2451199141cyclictest0-21swapper/822:46:5610
2451199140cyclictest0-21swapper/822:38:2810
2451199140cyclictest0-21swapper/822:34:1210
2451199140cyclictest0-21swapper/822:16:0710
2451199140cyclictest0-21swapper/820:10:0610
2451199140cyclictest0-21swapper/819:47:1710
2451199140cyclictest0-21swapper/819:40:1210
2451199140cyclictest0-21swapper/819:30:1710
2450999144cyclictest0-21swapper/620:35:018
2449399142cyclictest0-21swapper/322:08:105
2449399140cyclictest0-21swapper/323:41:495
2449399140cyclictest0-21swapper/323:34:335
2449399140cyclictest0-21swapper/322:42:515
2449399140cyclictest0-21swapper/322:32:275
2449399140cyclictest0-21swapper/322:00:105
2449399140cyclictest0-21swapper/321:46:315
2449399140cyclictest0-21swapper/321:24:165
2449399140cyclictest0-21swapper/321:08:465
2449399140cyclictest0-21swapper/319:48:335
2449399140cyclictest0-21swapper/300:33:085
2449399140cyclictest0-21swapper/300:01:115
14750140irq/18-uhci_hcd0-21swapper/022:25:300
2452199133cyclictest0-21swapper/1120:55:003
2452199130cyclictest0-21swapper/1123:41:543
2452199130cyclictest0-21swapper/1123:15:233
2452199130cyclictest0-21swapper/1119:26:173
2452199130cyclictest0-21swapper/1119:20:273
2452199130cyclictest0-21swapper/1100:15:203
2452199130cyclictest0-21swapper/1100:15:193
2451899134cyclictest0-21swapper/923:23:4611
2451899134cyclictest0-21swapper/922:40:0011
2451899133cyclictest0-21swapper/922:53:1011
2451899133cyclictest0-21swapper/922:19:0011
2451899133cyclictest0-21swapper/922:00:2511
2451899133cyclictest0-21swapper/921:05:3011
2451899133cyclictest0-21swapper/920:30:5411
2451899133cyclictest0-21swapper/920:25:2311
2451899133cyclictest0-21swapper/920:22:1511
2451899133cyclictest0-21swapper/920:10:5111
2451899133cyclictest0-21swapper/919:59:5111
2451899133cyclictest0-21swapper/919:28:3011
2451899133cyclictest0-21swapper/900:36:1011
2451899133cyclictest0-21swapper/900:16:5811
2451899133cyclictest0-21swapper/900:16:5811
2451899133cyclictest0-21swapper/900:14:3511
24518991311cyclictest8990-21sort23:55:2011
24518991311cyclictest4704-21expr23:50:1711
24518991311cyclictest32575-21expr23:00:1611
24518991311cyclictest22294-21expr23:30:1511
2451199133cyclictest4346-21kworker/8:021:07:5110
2451199133cyclictest0-21swapper/822:12:0010
2451199133cyclictest0-21swapper/821:17:3110
2451199133cyclictest0-21swapper/820:37:2910
2451199133cyclictest0-21swapper/819:11:3010
2451199132cyclictest0-21swapper/820:20:5210
2451199132cyclictest0-21swapper/820:15:3810
2451199131cyclictest0-21swapper/819:59:2510
2451199130cyclictest0-21swapper/822:43:5010
2450999133cyclictest0-21swapper/623:56:288
2450999133cyclictest0-21swapper/623:39:578
2450999133cyclictest0-21swapper/622:55:258
2450999133cyclictest0-21swapper/622:07:558
2450999133cyclictest0-21swapper/621:46:558
2450999133cyclictest0-21swapper/619:56:228
2450999133cyclictest0-21swapper/600:21:308
2450999133cyclictest0-21swapper/600:05:598
2450999132cyclictest16087-21qemu-kvm21:14:558
24506991312cyclictest16093-21qemu-kvm21:30:407
2450099133cyclictest0-21swapper/423:45:236
2449399137cyclictest0-21swapper/322:10:295
2449399133cyclictest0-21swapper/321:40:205
2449399133cyclictest0-21swapper/321:40:205
2449399130cyclictest0-21swapper/322:28:025
2449399130cyclictest0-21swapper/320:51:275
2449399130cyclictest0-21swapper/320:17:485
2449399130cyclictest0-21swapper/300:19:495
2449399130cyclictest0-21swapper/300:19:495
2449399130cyclictest0-21swapper/300:08:205
2448899133cyclictest0-21swapper/223:35:194
2448899133cyclictest0-21swapper/220:25:204
24488991312cyclictest2339-21snmpd00:09:384
24472991312cyclictest383-21taskset19:17:490
24472991312cyclictest0-21swapper/020:26:080
24472991311cyclictest27108-21chrt21:24:040
24472991311cyclictest19857-21chrt21:14:400
2499130watchdog/20-21swapper/222:12:274
14750130irq/18-uhci_hcd0-21swapper/020:40:270
2451899123cyclictest0-21swapper/921:45:0111
2451899122cyclictest0-21swapper/923:48:2711
2451899122cyclictest0-21swapper/923:44:5811
2451899122cyclictest0-21swapper/923:09:2711
2451899122cyclictest0-21swapper/922:55:5511
2451899122cyclictest0-21swapper/922:26:3111
2451899122cyclictest0-21swapper/922:05:2711
2451899122cyclictest0-21swapper/921:20:5411
2451899122cyclictest0-21swapper/920:18:1611
2451899122cyclictest0-21swapper/920:00:2011
2451899122cyclictest0-21swapper/919:40:0111
2451899122cyclictest0-21swapper/919:31:2211
2451899122cyclictest0-21swapper/900:20:5911
2451199124cyclictest0-21swapper/823:25:0010
2451199123cyclictest0-21swapper/819:35:0110
2451199121cyclictest0-21swapper/819:26:0110
2450999129cyclictest3740-21cpuspeed23:05:158
2450999123cyclictest0-21swapper/619:36:008
2450999122cyclictest0-21swapper/623:12:468
2450999122cyclictest0-21swapper/622:43:068
2450999122cyclictest0-21swapper/620:08:228
2450999122cyclictest0-21swapper/620:01:518
24509991210cyclictest4662-21qemu-kvm20:20:338
2450699122cyclictest0-21swapper/523:50:007
24500991211cyclictest11916-21ntp_kernel_pll_21:45:306
2450099120cyclictest0-21swapper/422:05:176
2449399122cyclictest0-21swapper/319:35:195
2449399120cyclictest0-21swapper/323:19:325
2449399120cyclictest0-21swapper/300:27:595
2448899122cyclictest0-21swapper/221:45:234
2447299120cyclictest0-21swapper/000:25:290
14750120irq/18-uhci_hcd0-21swapper/023:25:290
13350120irq/18-ehci_hcd0-21swapper/023:15:280
13350120irq/18-ehci_hcd0-21swapper/022:47:380
31110ksoftirqd/00-21swapper/022:10:280
31110ksoftirqd/00-21swapper/021:15:280
31110ksoftirqd/00-21swapper/020:50:280
31110ksoftirqd/00-21swapper/020:10:240
31110ksoftirqd/00-21swapper/019:11:040
31110ksoftirqd/00-21swapper/000:23:040
31110ksoftirqd/00-21swapper/000:02:580
2451899119cyclictest13933-21expr21:50:1811
2451899113cyclictest0-21swapper/923:35:3111
2451899113cyclictest0-21swapper/922:35:4711
2451899113cyclictest0-21swapper/921:00:3511
2451899113cyclictest0-21swapper/920:05:2911
2451899113cyclictest0-21swapper/900:32:4711
2451199113cyclictest0-21swapper/800:14:1610
2451199112cyclictest0-21swapper/821:56:4510
2451199112cyclictest0-21swapper/819:15:4410
2451099110cyclictest0-21swapper/720:20:189
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional