You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-12-05 - 01:25

x86 Intel Core i7-X980 @3333 MHz, Linux 3.12.31-rt45 (Profile)

Latency plot of system in rack #3, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Sun Dec 04, 2022 12:46:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
859210693sleep10-21swapper/107:08:051
11153501000irq/52-eth0-rx-0-21swapper/807:09:4510
12050990irq/42-ahci0-21swapper/207:09:094
12050980irq/42-ahci0-21swapper/307:08:265
1115350920irq/52-eth0-rx-0-21swapper/407:06:566
66827667sleep60-21swapper/607:05:348
129250740irq/18-parport00-21swapper/1007:09:452
67627365sleep90-21swapper/907:05:3611
14950720irq/18-uhci_hcd0-21swapper/1107:09:463
68126754sleep00-21swapper/007:05:400
14950670irq/18-uhci_hcd0-21swapper/507:05:267
1115450640irq/53-eth0-tx-0-21swapper/707:05:139
116199320cyclictest0-21swapper/010:20:370
120399290cyclictest0-21swapper/1107:21:533
1115350280irq/52-eth0-rx-4333-21qemu-kvm10:20:377
119799214cyclictest761ksoftirqd/907:40:2111
119799203cyclictest761ksoftirqd/912:35:3011
119799203cyclictest761ksoftirqd/912:25:0711
119799203cyclictest761ksoftirqd/911:45:0711
119799203cyclictest761ksoftirqd/911:25:4511
119799203cyclictest761ksoftirqd/911:20:2911
119799203cyclictest761ksoftirqd/910:51:2711
119799203cyclictest761ksoftirqd/910:37:4311
119799203cyclictest761ksoftirqd/910:32:4511
119799203cyclictest761ksoftirqd/910:26:3911
119799203cyclictest761ksoftirqd/910:18:3711
119799203cyclictest761ksoftirqd/909:46:2611
119799203cyclictest761ksoftirqd/909:41:1411
119799203cyclictest761ksoftirqd/909:36:4111
119799203cyclictest761ksoftirqd/909:18:5311
119799203cyclictest761ksoftirqd/909:10:1111
119799203cyclictest761ksoftirqd/909:05:1011
119799203cyclictest761ksoftirqd/909:04:0911
119799203cyclictest761ksoftirqd/908:47:2311
119799203cyclictest761ksoftirqd/908:47:2211
119799203cyclictest761ksoftirqd/908:33:4411
119799203cyclictest761ksoftirqd/908:29:4311
119799203cyclictest761ksoftirqd/908:23:0411
119799203cyclictest761ksoftirqd/908:17:3311
119799203cyclictest761ksoftirqd/908:10:2311
119799203cyclictest761ksoftirqd/907:35:5811
119799203cyclictest761ksoftirqd/907:25:2911
119799203cyclictest761ksoftirqd/907:20:4411
119799203cyclictest761ksoftirqd/907:12:2911
1198991917cyclictest19120-1kworker/10:2H10:07:142
119799192cyclictest761ksoftirqd/912:23:5311
119799192cyclictest761ksoftirqd/912:11:2411
119799192cyclictest761ksoftirqd/912:06:5011
119799192cyclictest761ksoftirqd/911:57:3011
119799192cyclictest761ksoftirqd/911:50:0211
119799192cyclictest761ksoftirqd/911:41:0311
119799192cyclictest761ksoftirqd/911:41:0311
119799192cyclictest761ksoftirqd/911:19:1911
119799192cyclictest761ksoftirqd/911:11:0711
119799192cyclictest761ksoftirqd/911:06:0511
119799192cyclictest761ksoftirqd/911:06:0411
119799192cyclictest761ksoftirqd/910:40:2111
119799192cyclictest761ksoftirqd/910:20:3411
119799192cyclictest761ksoftirqd/910:14:0111
119799192cyclictest761ksoftirqd/910:08:1911
119799192cyclictest761ksoftirqd/909:34:5211
119799192cyclictest761ksoftirqd/909:29:3211
119799192cyclictest761ksoftirqd/909:22:0311
119799192cyclictest761ksoftirqd/908:40:2111
119799192cyclictest761ksoftirqd/908:35:5711
119799192cyclictest761ksoftirqd/908:08:4111
119799192cyclictest761ksoftirqd/907:58:1411
119799192cyclictest761ksoftirqd/907:53:3211
119799192cyclictest761ksoftirqd/907:30:5211
119899181cyclictest12050irq/42-ahci08:08:482
119899181cyclictest1115350irq/52-eth0-rx-10:30:452
119799181cyclictest761ksoftirqd/910:01:5711
1194991816cyclictest912-21qemu-kvm07:25:168
1194991816cyclictest25243-21qemu-kvm09:30:168
1194991816cyclictest25243-21qemu-kvm09:08:228
1194991816cyclictest25242-21qemu-kvm09:25:168
116199182cyclictest0-21swapper/009:08:250
1203991716cyclictest46622sleep1107:12:023
1198991716cyclictest0-21swapper/1009:55:202
119899170cyclictest98952sleep1008:00:322
119899170cyclictest98742sleep1012:30:142
119899170cyclictest96832sleep1008:45:252
119899170cyclictest96832sleep1008:45:242
119899170cyclictest91892sleep1012:27:492
119899170cyclictest7322sleep1009:20:052
119899170cyclictest60582sleep1007:15:142
119899170cyclictest53892sleep1012:20:382
119899170cyclictest50582sleep1011:36:322
119899170cyclictest45622sleep1007:10:372
119899170cyclictest4032sleep1010:01:342
119899170cyclictest37242sleep1010:50:272
119899170cyclictest34702sleep1007:55:062
119899170cyclictest324442chrt09:16:522
119899170cyclictest319982sleep1008:32:472
119899170cyclictest31532sleep1008:35:472
119899170cyclictest313422sleep1007:45:542
119899170cyclictest313092sleep1012:15:122
119899170cyclictest300672sleep1011:25:432
119899170cyclictest27972sleep1007:53:072
119899170cyclictest277632sleep1007:41:402
119899170cyclictest276762sleep1012:10:132
119899170cyclictest269602sleep1012:07:222
119899170cyclictest268372sleep1010:40:012
119899170cyclictest262942sleep1010:39:382
119899170cyclictest257812sleep1009:54:322
119899170cyclictest254062sleep1008:25:102
119899170cyclictest245552sleep1008:20:342
119899170cyclictest235662sleep1009:05:162
119899170cyclictest204712sleep1011:15:172
119899170cyclictest204582sleep1009:45:202
119899170cyclictest204302sleep1007:30:542
119899170cyclictest199272chrt08:15:212
119899170cyclictest196482sleep1011:57:112
119899170cyclictest193192sleep1011:12:422
119899170cyclictest192732sleep1009:00:152
119899170cyclictest182202sleep1009:40:432
119899170cyclictest177012chrt08:55:492
119899170cyclictest169452sleep1007:28:042
119899170cyclictest163502sleep1012:36:272
119899170cyclictest154102sleep1010:25:002
119899170cyclictest145992sleep1009:35:542
119899170cyclictest141942sleep1008:52:262
119899170cyclictest12972sleep1011:31:092
119899170cyclictest12972sleep1011:31:082
119899170cyclictest123652sleep1011:46:562
119899170cyclictest12050irq/42-ahci09:25:412
119899170cyclictest12050irq/42-ahci08:41:122
119899170cyclictest1115450irq/53-eth0-tx-11:50:392
119899170cyclictest1115450irq/53-eth0-tx-10:58:122
119899170cyclictest1115350irq/52-eth0-rx-12:00:152
119899170cyclictest1115350irq/52-eth0-rx-11:40:262
119899170cyclictest1115350irq/52-eth0-rx-11:40:262
119899170cyclictest1115350irq/52-eth0-rx-11:00:282
119899170cyclictest1115350irq/52-eth0-rx-10:45:172
119899170cyclictest1115350irq/52-eth0-rx-10:20:042
119899170cyclictest1115350irq/52-eth0-rx-10:15:272
119899170cyclictest1115350irq/52-eth0-rx-10:10:062
119899170cyclictest1115350irq/52-eth0-rx-08:10:142
119899170cyclictest1115350irq/52-eth0-rx-07:37:352
119899170cyclictest1115350irq/52-eth0-rx-07:20:342
119899170cyclictest109652sleep1009:30:532
1194991716cyclictest25242-21qemu-kvm09:15:458
1194991715cyclictest25243-21qemu-kvm09:46:278
1193991715cyclictest912-21qemu-kvm07:47:287
1193991715cyclictest11683-21python11:45:297
1181991715cyclictest2383-21snmpd10:16:324
1195991615cyclictest9708-21ps08:45:259
1195991615cyclictest9708-21ps08:45:249
1195991615cyclictest7176-21ps10:10:399
1195991615cyclictest28006-21ps09:10:249
1195991615cyclictest26317-21latency_hist09:55:019
1195991615cyclictest19712-21ps07:30:279
1195991615cyclictest1833-21ps07:50:259
119499169cyclictest0-21swapper/607:50:008
1194991615cyclictest25242-21qemu-kvm09:38:388
1194991615cyclictest25242-21qemu-kvm09:10:298
1194991614cyclictest25243-21qemu-kvm09:43:248
1181991615cyclictest2383-21snmpd07:46:464
116199164cyclictest0-21swapper/008:47:330
116199164cyclictest0-21swapper/008:47:320
116199163cyclictest0-21swapper/007:23:410
116199160cyclictest0-21swapper/009:29:200
1197991514cyclictest1956-21chrt12:19:3511
1197991514cyclictest0-21swapper/907:15:1911
119599154cyclictest0-21swapper/711:55:029
1195991514cyclictest3912-21ps07:10:239
1195991514cyclictest31143-21ps08:30:279
1195991514cyclictest2962-21ps09:20:299
1195991513cyclictest14452-21ps10:20:309
118199150cyclictest0-21swapper/210:20:354
116199150cyclictest12050irq/42-ahci09:15:230
116199150cyclictest0-21swapper/010:15:160
120399140cyclictest0-21swapper/1112:35:153
12050140irq/42-ahci0-21swapper/810:20:4810
12050140irq/42-ahci0-21swapper/110:20:351
1197991413cyclictest2525-21cpuspeed_turbos11:35:1311
119599145cyclictest0-21swapper/709:30:029
119599144cyclictest0-21swapper/709:20:029
119599144cyclictest0-21swapper/708:20:019
119599144cyclictest0-21swapper/708:15:019
1195991413cyclictest4686-21ps12:20:279
1195991413cyclictest24789-21ps09:50:299
1195991413cyclictest1381-21latency_hist10:50:019
1195991413cyclictest13063-21missed_timers08:50:239
1181991412cyclictest2383-21snmpd09:16:034
1161991413cyclictest45932sleep007:11:040
1161991413cyclictest28432-21taskset08:28:490
1115450140irq/53-eth0-tx-0-21swapper/1110:20:333
4599130watchdog/50-21swapper/510:53:477
31130ksoftirqd/00-21swapper/010:35:250
14950130irq/18-uhci_hcd0-21swapper/008:30:280
14950130irq/18-uhci_hcd0-21swapper/008:20:270
14950130irq/18-uhci_hcd0-21swapper/007:35:240
120399134cyclictest0-21swapper/1110:35:023
1197991312cyclictest0-21swapper/912:30:3711
119699130cyclictest0-21swapper/809:30:0010
119699130cyclictest0-21swapper/809:10:0110
119599134cyclictest0-21swapper/712:30:019
119599133cyclictest0-21swapper/712:25:019
119599133cyclictest0-21swapper/707:20:019
1195991312cyclictest29414-21ps11:25:259
1195991312cyclictest27499-21ps08:25:259
1195991312cyclictest2386-21ps08:35:259
1195991312cyclictest14899-21latency_hist09:40:029
119499134cyclictest0-21swapper/608:05:008
1194991312cyclictest4340-21qemu-kvm10:26:388
119499131cyclictest4341-21qemu-kvm10:10:018
119099134cyclictest0-21swapper/308:20:205
118199133cyclictest0-21swapper/210:10:284
118199133cyclictest0-21swapper/209:00:014
117099133cyclictest0-21swapper/111:35:211
116199135cyclictest0-21swapper/008:40:210
116199135cyclictest0-21swapper/007:40:190
116199134cyclictest0-21swapper/009:40:200
116199134cyclictest0-21swapper/009:37:260
116199132cyclictest0-21swapper/008:35:580
116199132cyclictest0-21swapper/007:57:090
691120ksoftirqd/80-21swapper/809:35:0010
411120ksoftirqd/40-21swapper/409:35:006
31120ksoftirqd/00-21swapper/010:45:270
271120ksoftirqd/20-21swapper/209:35:014
128150120irq/18-i801_smb0-21swapper/011:26:290
120399124cyclictest0-21swapper/1107:50:023
120399124cyclictest0-21swapper/1107:30:003
120399123cyclictest0-21swapper/1112:05:013
120399123cyclictest0-21swapper/1110:19:473
1203991210cyclictest9603-21chrt07:17:163
119899123cyclictest0-21swapper/1011:20:002
119799120cyclictest0-21swapper/908:54:5511
119699122cyclictest0-21swapper/807:36:3110
119599129cyclictest0-21swapper/709:44:289
1195991211cyclictest18030-21ps10:25:299
119499125cyclictest0-21swapper/607:35:198
119499123cyclictest0-21swapper/612:15:018
119499123cyclictest0-21swapper/608:55:028
119499122cyclictest0-21swapper/607:35:008
1194991210cyclictest25243-21qemu-kvm09:22:108
1194991210cyclictest13817-21qemu-kvm08:08:248
119399122cyclictest0-21swapper/508:40:177
1193991210cyclictest13816-21qemu-kvm08:08:167
119299124cyclictest0-21swapper/408:40:186
119299120cyclictest0-21swapper/408:25:126
119099128cyclictest8817-21snmp_rack3slot910:15:135
119099128cyclictest0-21swapper/310:20:265
119099128cyclictest0-21swapper/308:33:235
119099128cyclictest0-21swapper/307:39:185
119099128cyclictest0-21swapper/307:28:475
119099122cyclictest0-21swapper/310:25:215
1190991210cyclictest2383-21snmpd07:21:435
118199123cyclictest0-21swapper/211:55:264
1181991210cyclictest0-21swapper/207:20:174
116199124cyclictest0-21swapper/012:30:270
116199123cyclictest0-21swapper/012:22:510
116199123cyclictest0-21swapper/010:52:190
116199123cyclictest0-21swapper/010:40:190
116199123cyclictest0-21swapper/009:45:220
1161991211cyclictest7637-21python10:55:340
116199120cyclictest0-21swapper/009:30:320
116199120cyclictest0-21swapper/008:05:250
3199110watchdog/30-21swapper/311:12:405
31110ksoftirqd/00-21swapper/011:31:310
31110ksoftirqd/00-21swapper/011:31:300
31110ksoftirqd/00-21swapper/011:16:240
1699110watchdog/00-21swapper/008:56:440
14950110irq/18-uhci_hcd0-21swapper/008:10:260
13250110irq/18-ehci_hcd0-21swapper/012:25:280
13250110irq/18-ehci_hcd0-21swapper/010:05:570
128150110irq/18-i801_smb0-21swapper/010:30:390
120399119cyclictest0-21swapper/1109:08:183
120399113cyclictest0-21swapper/1111:05:013
120399113cyclictest0-21swapper/1110:41:483
120399113cyclictest0-21swapper/1110:14:023
120399113cyclictest0-21swapper/1110:00:013
120399112cyclictest0-21swapper/1107:40:013
120399111cyclictest0-21swapper/1112:30:263
120399111cyclictest0-21swapper/1109:40:213
120399111cyclictest0-21swapper/1109:21:093
12050110irq/42-ahci0-21swapper/907:50:0211
1197991110cyclictest17662-1kworker/9:1H08:56:5411
1197991110cyclictest0-21swapper/910:55:2611
119699118cyclictest0-21swapper/810:51:0610
119699113cyclictest0-21swapper/811:48:3910
119699113cyclictest0-21swapper/811:03:2610
119699113cyclictest0-21swapper/810:47:0310
119699113cyclictest0-21swapper/809:46:1710
119699113cyclictest0-21swapper/809:38:3310
119699113cyclictest0-21swapper/809:21:4810
119699113cyclictest0-21swapper/808:22:4710
119699113cyclictest0-21swapper/807:41:1710
119699110cyclictest17608-21idleruntime-cro08:15:0010
119599113cyclictest0-21swapper/712:18:339
119599113cyclictest0-21swapper/711:50:489
119599113cyclictest0-21swapper/709:30:009
119499115cyclictest0-21swapper/607:42:448
119499114cyclictest0-21swapper/608:35:008
119499113cyclictest0-21swapper/610:50:008
119499113cyclictest0-21swapper/609:55:008
119499112cyclictest0-21swapper/608:35:018
119399111cyclictest0-21swapper/510:55:287
119399110cyclictest909-21qemu-kvm07:10:147
119399110cyclictest0-21swapper/510:45:147
119299113cyclictest0-21swapper/411:40:196
119299113cyclictest0-21swapper/411:40:196
119299113cyclictest0-21swapper/411:20:216
119299113cyclictest0-21swapper/410:40:186
1192991110cyclictest2383-21snmpd07:29:536
119299110cyclictest0-21swapper/410:55:196
119099117cyclictest0-21swapper/312:19:145
119099117cyclictest0-21swapper/311:41:575
119099117cyclictest0-21swapper/311:41:565
119099117cyclictest0-21swapper/311:35:575
119099117cyclictest0-21swapper/311:27:595
119099117cyclictest0-21swapper/311:02:095
119099117cyclictest0-21swapper/310:12:555
119099117cyclictest0-21swapper/307:45:375
119099115cyclictest0-21swapper/312:33:075
119099115cyclictest0-21swapper/311:24:365
119099115cyclictest0-21swapper/307:10:035
119099113cyclictest0-21swapper/310:40:005
119099113cyclictest0-21swapper/309:35:195
119099113cyclictest0-21swapper/309:10:175
119099113cyclictest0-21swapper/308:00:195
119099111cyclictest0-21swapper/309:55:245
119099110cyclictest0-21swapper/311:15:005
118199113cyclictest0-21swapper/212:20:214
118199113cyclictest0-21swapper/212:00:204
118199113cyclictest0-21swapper/211:15:234
118199113cyclictest0-21swapper/210:25:214
118199113cyclictest0-21swapper/209:45:214
118199113cyclictest0-21swapper/208:05:194
118199113cyclictest0-21swapper/207:30:214
117099113cyclictest0-21swapper/108:15:181
116199118cyclictest0-21swapper/011:11:210
116199115cyclictest0-21swapper/007:32:300
116199113cyclictest0-21swapper/012:12:430
116199113cyclictest0-21swapper/007:45:200
116199113cyclictest0-21swapper/007:16:200
116199112cyclictest0-21swapper/010:10:370
116199111cyclictest0-21swapper/009:56:190
901100ksoftirqd/110-21swapper/1110:08:403
901100ksoftirqd/110-21swapper/1108:45:023
901100ksoftirqd/110-21swapper/1108:45:013
901100ksoftirqd/110-21swapper/1108:25:153
8999100migration/1119775-21latency_hist11:15:003
8299100migration/1028886-21taskset09:13:012
691100ksoftirqd/80-21swapper/808:30:3210
6899100migration/817356-21fschecks_count11:10:1710
621100ksoftirqd/70-21swapper/710:08:409
621100ksoftirqd/70-21swapper/707:45:279
6199100migration/77664-21munin-node10:55:379
6199100migration/77569-21latency11:40:229
6199100migration/77569-21latency11:40:219
551100ksoftirqd/60-21swapper/612:15:328
551100ksoftirqd/60-21swapper/612:05:218
5499100migration/66490-21cpuspeed_turbos12:25:158
5499100migration/64180-21timerandwakeup07:10:278
5499100migration/63618-21idleruntime11:35:198
481100ksoftirqd/50-21swapper/512:15:337
481100ksoftirqd/50-21swapper/508:30:207
481100ksoftirqd/50-21swapper/508:10:167
4599100watchdog/50-21swapper/510:38:007
4599100watchdog/50-21swapper/509:28:007
411100ksoftirqd/40-21swapper/412:35:246
411100ksoftirqd/40-21swapper/410:50:016
411100ksoftirqd/40-21swapper/408:30:216
3899100watchdog/40-21swapper/409:00:206
341100ksoftirqd/30-21swapper/310:50:015
341100ksoftirqd/30-21swapper/308:10:175
3199100watchdog/30-21swapper/312:12:395
3199100watchdog/30-21swapper/312:07:045
3199100watchdog/30-21swapper/311:57:405
3199100watchdog/30-21swapper/308:28:485
3199100watchdog/30-21swapper/308:08:075
31100ksoftirqd/00-21swapper/012:05:210
31100ksoftirqd/00-21swapper/011:06:210
31100ksoftirqd/00-21swapper/011:06:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional