You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 15:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Thu Dec 04, 2025 12:46:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13563210794sleep20-21swapper/207:06:134
13530210290sleep110-21swapper/1107:05:453
3066350960irq/52-eth0-rx-0-21swapper/507:05:197
182050960irq/55-eth1-rx-0-21swapper/107:09:511
3066350910irq/52-eth0-rx-0-21swapper/307:08:195
3066350900irq/52-eth0-rx-0-21swapper/707:05:319
3066350880irq/52-eth0-rx-0-21swapper/1007:05:242
1386428070sleep90-21swapper/907:09:3211
1390027872sleep00-21swapper/007:10:000
12250710irq/42-ahci0-21swapper/807:05:0710
1355426653sleep60-21swapper/607:06:058
14850650irq/18-uhci_hcd0-21swapper/407:05:256
1404699290cyclictest0-21swapper/1107:26:003
1400499270cyclictest0-21swapper/007:28:400
1404699260cyclictest0-21swapper/1110:11:443
14043992220cyclictest21422-21perl08:45:1510
1400499200cyclictest0-21swapper/010:22:020
1400499200cyclictest0-21swapper/008:18:370
1404499192cyclictest0-21swapper/907:10:0211
14004991917cyclictest129332sleep009:18:370
1404699183cyclictest0-21swapper/1108:17:253
1404599181cyclictest831ksoftirqd/1012:25:182
1404599181cyclictest831ksoftirqd/1012:20:302
1404599181cyclictest831ksoftirqd/1007:15:342
1404599181cyclictest12250irq/42-ahci11:50:312
14044991816cyclictest3922-21diskstats09:50:1411
1404499181cyclictest2192-1kworker/9:2H10:35:3411
1404499181cyclictest0-21swapper/910:00:1211
14043991816cyclictest8477-21diskstats11:25:1410
14043991816cyclictest5184-21irqstats10:35:2310
14043991816cyclictest404-21perl09:45:1510
14043991816cyclictest31932-21snmp_rack3slot911:11:3810
14043991816cyclictest30286-21diskstats11:55:1410
14043991816cyclictest30286-21diskstats11:55:1410
14043991816cyclictest29851-21perl10:25:1610
14043991816cyclictest24624-21perl08:05:1510
14043991816cyclictest23453-21snmp_easybox.os10:15:2510
14043991816cyclictest21744-21snmp_rack3slot909:30:1610
14043991816cyclictest21744-21snmp_rack3slot909:30:1510
14043991816cyclictest20584-21snmp_easybox.os11:40:2510
14043991816cyclictest18307-21iostat08:40:1910
14043991816cyclictest15378-21snmp_rack3slot907:50:4810
14043991816cyclictest1536-21munin-run08:20:0110
14043991816cyclictest15280-21snmp_rack3slot907:10:1310
14043991816cyclictest14443-21snmp_rack3slot909:20:1410
14043991816cyclictest12418-21snmp_rack3slot910:00:2210
14043991816cyclictest11854-21snmp_rack3slot911:30:1310
14043991816cyclictest10198-21df08:30:1410
1400499188cyclictest0-21swapper/009:08:270
14045991716cyclictest831ksoftirqd/1010:10:012
14045991716cyclictest831ksoftirqd/1007:25:022
1404599170cyclictest831ksoftirqd/1012:00:272
1404599170cyclictest831ksoftirqd/1012:00:262
1404599170cyclictest831ksoftirqd/1011:35:182
1404599170cyclictest831ksoftirqd/1010:39:322
1404599170cyclictest831ksoftirqd/1010:30:292
1404599170cyclictest831ksoftirqd/1010:20:062
1404599170cyclictest831ksoftirqd/1009:25:172
1404599170cyclictest831ksoftirqd/1009:25:162
1404599170cyclictest831ksoftirqd/1008:10:232
1404599170cyclictest831ksoftirqd/1008:05:122
1404599170cyclictest831ksoftirqd/1008:00:122
1404599170cyclictest831ksoftirqd/1007:55:202
1404599170cyclictest831ksoftirqd/1007:40:172
1404599170cyclictest811rcuc/1012:10:002
1404599170cyclictest811rcuc/1012:10:002
1404599170cyclictest811rcuc/1011:45:142
1404599170cyclictest811rcuc/1011:45:142
1404599170cyclictest811rcuc/1009:50:202
1404599170cyclictest66912sleep1009:55:022
1404599170cyclictest59372sleep1011:20:252
1404599170cyclictest54762sleep1009:06:582
1404599170cyclictest325012chrt09:45:142
1404599170cyclictest32472chrt11:16:592
1404599170cyclictest323272sleep1011:57:052
1404599170cyclictest323272sleep1011:57:052
1404599170cyclictest319302sleep1011:11:372
1404599170cyclictest314012chrt10:25:302
1404599170cyclictest309532chrt09:41:022
1404599170cyclictest3066350irq/52-eth0-rx-12:39:042
1404599170cyclictest3066350irq/52-eth0-rx-12:05:212
1404599170cyclictest3066350irq/52-eth0-rx-11:40:052
1404599170cyclictest3066350irq/52-eth0-rx-11:30:032
1404599170cyclictest3066350irq/52-eth0-rx-10:50:122
1404599170cyclictest3066350irq/52-eth0-rx-10:10:132
1404599170cyclictest3066350irq/52-eth0-rx-08:23:122
1404599170cyclictest3066350irq/52-eth0-rx-07:35:242
1404599170cyclictest3066350irq/52-eth0-rx-07:34:302
1404599170cyclictest275862sleep1009:39:502
1404599170cyclictest269142sleep1008:52:202
1404599170cyclictest258812sleep1007:20:452
1404599170cyclictest256132sleep1012:34:222
1404599170cyclictest211082sleep1010:58:112
1404599170cyclictest16092sleep1009:00:332
1404599170cyclictest159162sleep1008:36:182
1404599170cyclictest14972sleep1008:19:412
1404599170cyclictest147452sleep1012:19:452
1404599170cyclictest138352sleep1010:48:212
1404599170cyclictest135652sleep1009:20:122
1404599170cyclictest134282sleep1010:04:162
1404599170cyclictest122512chrt08:31:062
1404599170cyclictest12250irq/42-ahci07:48:032
1404599170cyclictest12250irq/42-ahci07:10:382
1404499175cyclictest0-21swapper/909:11:5411
14044991715cyclictest23931-21snmp_rack3slot907:20:1411
1404499170cyclictest21438-1kworker/9:2H07:36:4711
1404499170cyclictest0-21swapper/911:25:2911
1404499170cyclictest0-21swapper/908:45:2911
14043991715cyclictest9227-21ntp_states10:40:2310
14043991715cyclictest7204-21snmp_rack3slot912:06:1310
14043991715cyclictest7147-21diskstats09:10:1410
14043991715cyclictest4285-21snmp_easybox.os08:20:2410
14043991715cyclictest3133-21yum11:15:3310
14043991715cyclictest30459-21snmp_rack3slot908:56:1510
14043991715cyclictest28823-21irqstats08:10:2010
14043991715cyclictest28196-21users11:05:3110
14043991715cyclictest26774-21snmp_easybox.os07:25:1310
14043991715cyclictest26654-21diskstats11:50:1310
14043991715cyclictest26299-21memory09:35:2210
14043991715cyclictest26081-21snmp_rack3slot910:20:1610
14043991715cyclictest25582-21iostat_ios08:50:2010
14043991715cyclictest22640-21diskstats11:00:1510
14043991715cyclictest21097-21perl08:00:1310
14043991715cyclictest20505-21iostat12:25:1910
14043991715cyclictest19446-21snmp_easybox.os07:15:1610
14043991715cyclictest18939-21snmp_rack3slot910:10:1610
14043991715cyclictest18817-21iostat09:25:2010
14043991715cyclictest18817-21iostat09:25:1910
14043991715cyclictest16482-21iostat11:35:1810
14043991715cyclictest16148-21df_inode12:20:1410
14043991715cyclictest14566-21snmp_rack3slot912:17:1510
14043991715cyclictest13618-21yum10:45:3110
14043991715cyclictest10782-21diskstats09:15:1510
14041991712cyclictest26537-21qemu-kvm08:25:018
1404499164cyclictest0-21swapper/910:15:0211
1404499164cyclictest0-21swapper/908:30:0111
14044991615cyclictest0-21swapper/912:05:2511
14044991615cyclictest0-21swapper/911:55:1911
14044991615cyclictest0-21swapper/911:55:1911
14044991615cyclictest0-21swapper/908:35:2511
14044991615cyclictest0-21swapper/907:30:2211
14043991615cyclictest19115-21snmp_rack3slot907:57:1310
14043991615cyclictest18149-21snmp_easybox.os10:55:1410
14043991614cyclictest9475-21yum09:55:3210
14043991614cyclictest6869-21snmp_rack3slot911:21:5210
14043991614cyclictest4289-21perl09:50:1510
14043991614cyclictest29377-21perl09:40:1510
14043991614cyclictest2660-21users10:30:3010
14043991614cyclictest24302-21snmp_easybox.os11:45:2510
14043991614cyclictest24302-21snmp_easybox.os11:45:2410
14043991614cyclictest17261-21users10:50:3010
14043991614cyclictest15098-21ntp_states08:35:2210
14043991614cyclictest10148-21snmp_rack3slot912:10:2510
14043991614cyclictest10148-21snmp_rack3slot912:10:2410
1404299165cyclictest0-21swapper/707:25:029
1404199163cyclictest0-21swapper/611:21:588
1404199162cyclictest0-21swapper/609:38:268
14041991614cyclictest0-21swapper/607:39:568
1404199160cyclictest0-21swapper/612:10:278
1404199160cyclictest0-21swapper/612:10:278
1404199160cyclictest0-21swapper/608:42:348
1401999165cyclictest0-21swapper/211:20:234
14019991614cyclictest2406-21snmpd10:25:544
14004991614cyclictest208122chrt10:14:440
1400499160cyclictest2691-21runrttasks09:22:360
1404499155cyclictest0-21swapper/908:20:0111
14044991514cyclictest0-21swapper/912:35:1611
14044991514cyclictest0-21swapper/911:15:3311
14044991514cyclictest0-21swapper/910:20:1811
14044991514cyclictest0-21swapper/909:46:1411
14044991514cyclictest0-21swapper/909:16:0511
14043991513cyclictest7475-21sensors_temp07:40:2710
14043991513cyclictest5469-21snmp_rack3slot909:06:5110
14043991513cyclictest2650-21snmp_rack3slot907:35:1410
1404399150cyclictest0-21swapper/812:30:2410
1404299155cyclictest0-21swapper/711:05:019
1404199157cyclictest5614-21qemu-kvm09:26:398
1404199157cyclictest5614-21qemu-kvm09:26:398
1404199153cyclictest0-21swapper/611:26:258
1404199153cyclictest0-21swapper/610:36:548
1404199153cyclictest0-21swapper/610:08:268
1404199153cyclictest0-21swapper/608:51:238
1404199153cyclictest0-21swapper/607:59:278
1404199152cyclictest0-21swapper/611:05:258
14041991514cyclictest26542-21qemu-kvm08:08:248
1404199150cyclictest5614-21qemu-kvm09:17:028
1404199150cyclictest13754-21qemu-kvm07:41:398
1404199150cyclictest0-21swapper/612:15:358
1404199150cyclictest0-21swapper/611:48:098
1404199150cyclictest0-21swapper/611:48:088
1404199150cyclictest0-21swapper/611:10:188
1404199150cyclictest0-21swapper/610:27:508
1404199150cyclictest0-21swapper/609:12:278
1404199150cyclictest0-21swapper/607:10:198
14019991513cyclictest2406-21snmpd09:56:244
14019991513cyclictest2406-21snmpd09:08:524
14019991513cyclictest2406-21snmpd07:37:384
14012991514cyclictest3066350irq/52-eth0-rx-08:58:121
1401299150cyclictest0-21swapper/110:30:001
14004991514cyclictest2443-21lldpd09:11:550
3066450140irq/53-eth0-tx-0-21swapper/107:28:421
1404499145cyclictest0-21swapper/911:20:0011
1404499144cyclictest0-21swapper/912:20:0211
1404499144cyclictest0-21swapper/909:20:0211
1404499144cyclictest0-21swapper/907:45:0111
1404499143cyclictest0-21swapper/911:30:0211
14043991412cyclictest23937-21diskstats07:20:1410
1404299144cyclictest0-21swapper/711:10:009
14042991412cyclictest13868-21seq10:48:479
1404199146cyclictest0-21swapper/607:20:508
1404199143cyclictest0-21swapper/610:50:328
1404199143cyclictest0-21swapper/610:20:488
1404199142cyclictest0-21swapper/612:36:338
1404199142cyclictest0-21swapper/612:31:288
1404199142cyclictest0-21swapper/611:53:198
1404199142cyclictest0-21swapper/610:47:258
1404199142cyclictest0-21swapper/607:16:428
1404199141cyclictest0-21swapper/612:20:448
1404199141cyclictest0-21swapper/611:33:248
1404199141cyclictest0-21swapper/607:32:488
1404199140cyclictest0-21swapper/611:35:438
1404199140cyclictest0-21swapper/610:56:328
1404199140cyclictest0-21swapper/610:10:208
1404199140cyclictest0-21swapper/610:04:168
1404199140cyclictest0-21swapper/609:46:038
1404199140cyclictest0-21swapper/608:34:408
1404199140cyclictest0-21swapper/607:29:198
1401999145cyclictest0-21swapper/212:24:224
1401999145cyclictest0-21swapper/211:58:154
1401999145cyclictest0-21swapper/211:58:144
1401999145cyclictest0-21swapper/210:07:464
1401999145cyclictest0-21swapper/208:26:254
1401999145cyclictest0-21swapper/207:10:044
14019991412cyclictest2406-21snmpd08:00:384
1401999141cyclictest0-21swapper/208:43:014
14012991413cyclictest3066350irq/52-eth0-rx-09:27:131
14012991413cyclictest3066350irq/52-eth0-rx-09:27:121
14012991413cyclictest3066350irq/52-eth0-rx-07:42:071
1400499141cyclictest0-21swapper/007:30:120
13450140irq/18-ehci_hcd0-21swapper/007:55:250
12250140irq/42-ahci0-21swapper/507:28:437
12250140irq/42-ahci0-21swapper/407:28:436
1404499134cyclictest0-21swapper/911:05:0011
1404499133cyclictest0-21swapper/911:43:5511
1404499133cyclictest0-21swapper/911:10:5611
1404499133cyclictest0-21swapper/910:50:0111
1404499133cyclictest0-21swapper/910:10:0111
1404499133cyclictest0-21swapper/910:06:5611
1404499133cyclictest0-21swapper/909:55:0111
1404499133cyclictest0-21swapper/909:35:4211
1404499133cyclictest0-21swapper/908:05:0011
1404499132cyclictest0-21swapper/909:40:1511
14044991312cyclictest23908-21hdparm12:30:1711
14044991312cyclictest21438-1kworker/9:2H08:21:5611
14044991311cyclictest29737-21snmp_rack3slot910:25:1511
14043991311cyclictest6920-21perl08:25:1410
1404299134cyclictest0-21swapper/712:00:029
1404299134cyclictest0-21swapper/712:00:029
1404299134cyclictest0-21swapper/709:15:029
1404299134cyclictest0-21swapper/708:05:019
1404299133cyclictest0-21swapper/711:40:019
1404299133cyclictest0-21swapper/709:15:029
1404299133cyclictest0-21swapper/708:50:019
1404199134cyclictest0-21swapper/609:05:008
1404199133cyclictest0-21swapper/609:22:248
1404199133cyclictest0-21swapper/608:37:328
1404199133cyclictest0-21swapper/608:28:518
1404199133cyclictest0-21swapper/607:50:528
1404199132cyclictest0-21swapper/611:00:268
1404199132cyclictest0-21swapper/610:31:568
1404199132cyclictest0-21swapper/610:15:538
1404199132cyclictest0-21swapper/608:56:438
1404199132cyclictest0-21swapper/608:46:388
1404199132cyclictest0-21swapper/607:46:218
1404199131cyclictest0-21swapper/609:42:228
1404199130cyclictest26543-21qemu-kvm08:10:098
14030991311cyclictest2503-21sensors11:15:276
1401999134cyclictest0-21swapper/210:32:174
1401999134cyclictest0-21swapper/209:24:464
1401999134cyclictest0-21swapper/208:15:564
1401999133cyclictest0-21swapper/211:35:184
1401999132cyclictest0-21swapper/210:48:554
1401999132cyclictest0-21swapper/210:12:214
1401999132cyclictest0-21swapper/207:48:324
14019991311cyclictest2406-21snmpd07:34:524
1401999130cyclictest0-21swapper/209:25:414
1401999130cyclictest0-21swapper/209:25:414
14012991312cyclictest8905-21python09:55:271
14012991312cyclictest4787-21python09:05:271
1400499133cyclictest0-21swapper/010:50:170
1400499133cyclictest0-21swapper/008:50:180
14004991312cyclictest2465-21lldpd10:29:260
14004991311cyclictest2387-21nscd08:11:450
31120ksoftirqd/00-21swapper/009:40:250
271120ksoftirqd/20-21swapper/207:25:154
1404499124cyclictest0-21swapper/907:25:2011
1404499122cyclictest0-21swapper/911:46:5411
1404499122cyclictest0-21swapper/911:46:5411
1404499122cyclictest0-21swapper/909:28:2411
1404499122cyclictest0-21swapper/909:28:2311
14044991211cyclictest0-21swapper/912:27:4311
1404399123cyclictest0-21swapper/807:47:5210
1404399122cyclictest0-21swapper/810:06:2310
1404399122cyclictest0-21swapper/809:03:5410
1404299124cyclictest0-21swapper/708:10:019
1404299124cyclictest0-21swapper/707:30:019
1404299123cyclictest0-21swapper/711:25:009
1404299123cyclictest0-21swapper/709:00:019
1404299123cyclictest0-21swapper/708:04:429
1404299122cyclictest0-21swapper/708:37:529
1404299122cyclictest0-21swapper/708:30:379
1404299122cyclictest0-21swapper/708:26:189
1404299122cyclictest0-21swapper/708:23:099
1404299122cyclictest0-21swapper/707:46:379
1404299122cyclictest0-21swapper/707:39:379
1404199123cyclictest0-21swapper/610:40:188
1404199122cyclictest0-21swapper/612:25:498
1404199122cyclictest0-21swapper/609:51:268
1404199121cyclictest0-21swapper/611:59:498
1404199121cyclictest0-21swapper/611:59:488
1404199121cyclictest0-21swapper/609:34:238
1404199121cyclictest0-21swapper/609:34:228
1404199120cyclictest26542-21qemu-kvm08:17:528
1404199120cyclictest0-21swapper/608:05:018
14030991210cyclictest2050-21sensors10:30:256
14030991210cyclictest154782sleep407:52:076
1401999125cyclictest0-21swapper/212:02:554
1401999125cyclictest0-21swapper/212:02:554
1401999124cyclictest0-21swapper/208:10:194
1401999123cyclictest0-21swapper/212:36:164
1401999123cyclictest0-21swapper/212:26:194
1401999123cyclictest0-21swapper/212:19:474
1401999123cyclictest0-21swapper/212:09:524
1401999123cyclictest0-21swapper/211:53:244
1401999123cyclictest0-21swapper/211:48:374
1401999123cyclictest0-21swapper/211:48:364
1401999123cyclictest0-21swapper/211:41:594
1401999123cyclictest0-21swapper/211:31:194
1401999123cyclictest0-21swapper/211:14:564
1401999123cyclictest0-21swapper/211:06:394
1401999123cyclictest0-21swapper/211:04:554
1401999123cyclictest0-21swapper/210:57:484
1401999123cyclictest0-21swapper/210:52:354
1401999123cyclictest0-21swapper/210:38:314
1401999123cyclictest0-21swapper/210:24:014
1401999123cyclictest0-21swapper/210:00:364
1401999123cyclictest0-21swapper/209:48:444
1401999123cyclictest0-21swapper/209:39:084
1401999123cyclictest0-21swapper/209:30:294
1401999123cyclictest0-21swapper/209:30:284
1401999123cyclictest0-21swapper/209:15:064
1401999123cyclictest0-21swapper/209:04:184
1401999123cyclictest0-21swapper/208:54:344
1401999123cyclictest0-21swapper/208:32:584
1401999123cyclictest0-21swapper/208:07:034
1401999123cyclictest0-21swapper/207:41:524
1401999121cyclictest0-21swapper/211:19:194
1401999121cyclictest0-21swapper/207:20:214
14012991211cyclictest9819-21python11:25:261
1400499122cyclictest0-21swapper/012:30:010
1400499122cyclictest0-21swapper/010:40:180
14004991210cyclictest50302chrt08:21:550
1400499121cyclictest0-21swapper/012:35:240
1400499120cyclictest0-21swapper/011:55:250
1400499120cyclictest0-21swapper/011:55:240
1400499120cyclictest0-21swapper/010:30:240
1400499120cyclictest0-21swapper/009:25:270
1400499120cyclictest0-21swapper/009:25:260
13450120irq/18-ehci_hcd0-21swapper/012:10:260
13450120irq/18-ehci_hcd0-21swapper/012:10:260
901110ksoftirqd/110-21swapper/1107:40:143
6199110migration/77195-21runrttasks10:40:109
481110ksoftirqd/50-21swapper/509:00:127
481110ksoftirqd/50-21swapper/508:33:357
481110ksoftirqd/50-21swapper/507:40:167
411110ksoftirqd/40-21swapper/409:00:136
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional