You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 19:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Sat Dec 06, 2025 12:46:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30663501090irq/52-eth0-rx-0-21swapper/807:05:2110
15643210297sleep70-21swapper/707:09:589
15331210290sleep100-21swapper/1007:06:372
122501010irq/42-ahci0-21swapper/307:05:245
122501010irq/42-ahci0-21swapper/107:05:291
1466429785sleep20-21swapper/207:05:284
12250920irq/42-ahci0-21swapper/407:07:446
1541928877sleep60-21swapper/607:07:458
12250880irq/42-ahci0-21swapper/507:05:217
12250760irq/42-ahci0-21swapper/1107:05:583
1544626960sleep00-21swapper/007:08:030
12250610irq/42-ahci0-21swapper/907:05:0211
15751994122cyclictest0-21swapper/009:21:330
15790993617cyclictest0-21swapper/1107:14:323
15751993515cyclictest0-21swapper/007:26:420
1579099310cyclictest0-21swapper/1110:16:093
1579099310cyclictest0-21swapper/1110:16:083
15790992928cyclictest0-21swapper/1107:18:023
15751992914cyclictest0-21swapper/007:14:270
15751992827cyclictest0-21swapper/007:18:010
15751992613cyclictest0-21swapper/009:29:380
1575199260cyclictest0-21swapper/010:20:390
1575199260cyclictest0-21swapper/010:20:390
15751992524cyclictest0-21swapper/010:16:070
15751992524cyclictest0-21swapper/010:16:060
1575199200cyclictest0-21swapper/012:29:180
1578999192cyclictest12250irq/42-ahci12:29:072
1578999192cyclictest12250irq/42-ahci12:21:512
1578999192cyclictest12250irq/42-ahci10:21:112
1578999192cyclictest12250irq/42-ahci10:21:112
1578999192cyclictest12250irq/42-ahci07:30:552
15751991917cyclictest3453-21chrt08:17:110
1579099184cyclictest0-21swapper/1107:20:363
15789991817cyclictest19642-1kworker/10:1H10:25:302
15789991817cyclictest0-21swapper/1011:41:512
15789991817cyclictest0-21swapper/1011:25:072
15789991817cyclictest0-21swapper/1010:05:342
15789991817cyclictest0-21swapper/1009:50:082
15789991817cyclictest0-21swapper/1009:35:092
15789991817cyclictest0-21swapper/1009:20:112
15789991817cyclictest0-21swapper/1008:10:312
15789991817cyclictest0-21swapper/1007:10:452
1578999181cyclictest3066350irq/52-eth0-rx-10:10:312
1578999181cyclictest12250irq/42-ahci12:39:062
1578999181cyclictest12250irq/42-ahci12:30:092
1578999181cyclictest12250irq/42-ahci12:30:092
1578999181cyclictest12250irq/42-ahci12:15:372
1578999181cyclictest12250irq/42-ahci12:11:042
1578999181cyclictest12250irq/42-ahci12:05:232
1578999181cyclictest12250irq/42-ahci12:00:542
1578999181cyclictest12250irq/42-ahci11:56:482
1578999181cyclictest12250irq/42-ahci11:50:332
1578999181cyclictest12250irq/42-ahci11:45:352
1578999181cyclictest12250irq/42-ahci11:35:312
1578999181cyclictest12250irq/42-ahci11:30:112
1578999181cyclictest12250irq/42-ahci11:20:042
1578999181cyclictest12250irq/42-ahci11:15:102
1578999181cyclictest12250irq/42-ahci11:11:462
1578999181cyclictest12250irq/42-ahci11:05:422
1578999181cyclictest12250irq/42-ahci11:00:212
1578999181cyclictest12250irq/42-ahci10:56:122
1578999181cyclictest12250irq/42-ahci10:50:102
1578999181cyclictest12250irq/42-ahci10:45:212
1578999181cyclictest12250irq/42-ahci10:40:252
1578999181cyclictest12250irq/42-ahci10:35:072
1578999181cyclictest12250irq/42-ahci10:31:072
1578999181cyclictest12250irq/42-ahci10:15:462
1578999181cyclictest12250irq/42-ahci10:15:462
1578999181cyclictest12250irq/42-ahci10:00:432
1578999181cyclictest12250irq/42-ahci09:55:212
1578999181cyclictest12250irq/42-ahci09:45:482
1578999181cyclictest12250irq/42-ahci09:40:512
1578999181cyclictest12250irq/42-ahci09:30:132
1578999181cyclictest12250irq/42-ahci09:25:202
1578999181cyclictest12250irq/42-ahci09:17:162
1578999181cyclictest12250irq/42-ahci09:11:242
1578999181cyclictest12250irq/42-ahci09:05:092
1578999181cyclictest12250irq/42-ahci09:00:152
1578999181cyclictest12250irq/42-ahci08:55:242
1578999181cyclictest12250irq/42-ahci08:50:442
1578999181cyclictest12250irq/42-ahci08:45:262
1578999181cyclictest12250irq/42-ahci08:42:422
1578999181cyclictest12250irq/42-ahci08:36:272
1578999181cyclictest12250irq/42-ahci08:30:172
1578999181cyclictest12250irq/42-ahci08:25:202
1578999181cyclictest12250irq/42-ahci08:20:272
1578999181cyclictest12250irq/42-ahci08:15:022
1578999181cyclictest12250irq/42-ahci08:07:302
1578999181cyclictest12250irq/42-ahci08:00:412
1578999181cyclictest12250irq/42-ahci07:55:172
1578999181cyclictest12250irq/42-ahci07:50:102
1578999181cyclictest12250irq/42-ahci07:46:142
1578999181cyclictest12250irq/42-ahci07:40:032
1578999181cyclictest12250irq/42-ahci07:35:312
1578999181cyclictest12250irq/42-ahci07:27:322
1578999181cyclictest12250irq/42-ahci07:20:042
1578999181cyclictest12250irq/42-ahci07:15:102
1578899181cyclictest6619-1kworker/9:2H08:46:1811
1578899181cyclictest26892-1kworker/9:1H11:32:0211
1578899181cyclictest15345-1kworker/9:2H09:22:4411
1578899181cyclictest12250irq/42-ahci12:39:0311
1578899181cyclictest12250irq/42-ahci11:58:4111
1578899181cyclictest0-21swapper/912:18:4311
1578899181cyclictest0-21swapper/912:12:4911
1578899181cyclictest0-21swapper/912:00:5811
1578899181cyclictest0-21swapper/911:27:1911
1578899181cyclictest0-21swapper/910:16:1211
1578899181cyclictest0-21swapper/910:16:1211
1578899181cyclictest0-21swapper/910:02:5211
1578899181cyclictest0-21swapper/909:53:3711
1578899181cyclictest0-21swapper/909:37:1111
1578899181cyclictest0-21swapper/909:10:5611
1578899181cyclictest0-21swapper/909:01:5611
1578899181cyclictest0-21swapper/908:31:0211
1578899181cyclictest0-21swapper/908:02:1611
1578899181cyclictest0-21swapper/907:46:0211
1578899181cyclictest0-21swapper/907:40:3711
1578899181cyclictest0-21swapper/907:30:5211
15785991816cyclictest6914-21snmp_easybox.os11:20:1210
15785991816cyclictest4786-21iostat_ios11:15:1910
15785991816cyclictest4599-21snmp_rack3slot908:20:1310
15785991816cyclictest4174-21iostat_ios10:30:2010
15785991816cyclictest32665-21snmp_rack3slot908:56:0210
15785991816cyclictest32080-21munin-node12:35:3210
15785991816cyclictest2984-21munin-run07:35:0010
15785991816cyclictest29390-21snmp_rack3slot907:25:1410
15785991816cyclictest26723-21yum10:15:3310
15785991816cyclictest26723-21yum10:15:3310
15785991816cyclictest22132-21snmp_easybox.os12:25:1410
15785991816cyclictest21332-21snmp_rack3slot912:22:1310
15785991816cyclictest20102-21snmp_rack3slot910:51:3910
15785991816cyclictest14397-21diskstats10:45:1310
15785991816cyclictest13102-21snmp_easybox.os12:10:2310
15785991816cyclictest11247-21snmp_rack3slot910:40:1810
15785991816cyclictest11088-21snmp_rack3slot907:45:1210
15769991816cyclictest2406-21snmpd11:37:284
15751991817cyclictest0-21swapper/010:54:510
1575199180cyclictest0-21swapper/010:56:590
1579099170cyclictest0-21swapper/1107:26:553
15788991716cyclictest0-21swapper/911:40:3011
1578899171cyclictest0-21swapper/907:56:0011
1578899170cyclictest7716-1kworker/9:1H09:15:1011
1578899170cyclictest6619-1kworker/9:2H08:09:1311
1578899170cyclictest26892-1kworker/9:1H09:55:1411
1578899170cyclictest20391-21kworker/9:108:25:1711
1578899170cyclictest17168-1kworker/9:2H11:38:1211
1578899170cyclictest12250irq/42-ahci12:21:1611
1578899170cyclictest0-21swapper/912:32:1811
1578899170cyclictest0-21swapper/912:32:1811
1578899170cyclictest0-21swapper/912:06:3111
1578899170cyclictest0-21swapper/910:29:1811
1578899170cyclictest0-21swapper/910:21:2411
1578899170cyclictest0-21swapper/910:21:2311
1578899170cyclictest0-21swapper/910:12:0511
1578899170cyclictest0-21swapper/909:46:2511
1578899170cyclictest0-21swapper/909:06:1811
1578899170cyclictest0-21swapper/908:56:2411
1578899170cyclictest0-21swapper/908:40:5411
1578899170cyclictest0-21swapper/908:21:3211
1578899170cyclictest0-21swapper/907:36:2511
15785991716cyclictest13408-21snmp_rack3slot911:27:0310
15785991715cyclictest8015-21diskstats07:40:1310
15785991715cyclictest7445-21snmp_easybox.os12:05:1310
15785991715cyclictest31073-21snmp_rack3slot911:06:1410
15785991715cyclictest30483-21snmp_rack3slot908:10:1410
15785991715cyclictest28028-21snmp_rack3slot911:46:5010
15785991715cyclictest27756-21df_inode09:35:1510
15785991715cyclictest27472-21snmp_rack3slot911:01:5110
15785991715cyclictest26375-21munin-run09:35:0010
15785991715cyclictest25645-21snmp_rack3slot907:20:1310
15785991715cyclictest23372-21df_inode08:45:1610
15785991715cyclictest2329-21snmp_rack3slot911:11:2410
15785991715cyclictest23073-21iostat_ios11:40:2010
15785991715cyclictest22305-21ntp_states10:10:2510
15785991715cyclictest21214-21snmp_rack3slot907:15:1610
15785991715cyclictest18372-21snmp_easybox.os07:10:2510
15785991715cyclictest15652-21snmp_rack3slot908:35:1210
15785991715cyclictest15328-21perl11:30:1610
15785991715cyclictest1358-21snmp_rack3slot909:00:1410
15785991715cyclictest13233-21snmp_rack3slot909:15:1610
15785991715cyclictest12878-21hddtemp_smartct08:30:1710
1576999173cyclictest0-21swapper/211:47:084
15769991715cyclictest2406-21snmpd10:18:444
15769991715cyclictest2406-21snmpd10:18:434
1576999171cyclictest0-21swapper/211:27:594
15751991716cyclictest0-21swapper/012:38:350
15751991716cyclictest0-21swapper/009:54:110
1579099164cyclictest0-21swapper/1109:37:493
15788991615cyclictest26892-1kworker/9:1H11:12:2811
15788991615cyclictest26892-1kworker/9:1H10:41:5811
15788991615cyclictest19934-21md0_resync07:25:0311
15788991615cyclictest19934-21md0_resync07:14:1211
15788991615cyclictest0-21swapper/911:49:4311
15788991615cyclictest0-21swapper/911:07:4311
15788991615cyclictest0-21swapper/910:36:0311
15788991615cyclictest0-21swapper/908:51:0111
15788991615cyclictest0-21swapper/908:37:0811
15788991615cyclictest0-21swapper/908:16:0611
15785991614cyclictest6436-21iostat09:05:2010
15785991614cyclictest5540-21snmp_easybox.os09:50:1210
15785991614cyclictest31809-21perl09:40:1610
15785991614cyclictest28482-21snmp_rack3slot910:20:1510
15785991614cyclictest28482-21snmp_rack3slot910:20:1510
15785991614cyclictest27779-21iostat_ios08:50:2410
15785991614cyclictest22599-21df08:00:1410
15785991614cyclictest22134-21perl10:55:1810
15785991614cyclictest20176-21ntp_states07:55:2510
15785991614cyclictest19410-21iostat11:35:2010
15785991614cyclictest17320-21snmp_rack3slot907:51:0210
15785991614cyclictest16775-21diskstats09:20:1310
15785991614cyclictest1303-21snmp_rack3slot908:15:1510
1578499165cyclictest0-21swapper/709:35:019
15784991614cyclictest2697-21diskstats09:45:149
1578399165cyclictest0-21swapper/610:45:018
15782991615cyclictest31003-21python11:50:267
1576999163cyclictest623-21md0_raid107:28:154
1576999163cyclictest0-21swapper/207:52:014
15769991614cyclictest2406-21snmpd09:57:424
1576999161cyclictest0-21swapper/208:58:414
15751991615cyclictest0-21swapper/008:29:150
1575199160cyclictest0-21swapper/009:16:190
15788991514cyclictest26892-1kworker/9:1H09:42:2111
15788991514cyclictest0-21swapper/911:50:5811
15788991514cyclictest0-21swapper/910:47:0411
15788991514cyclictest0-21swapper/910:31:2311
1578899150cyclictest0-21swapper/911:22:2711
1578899150cyclictest0-21swapper/909:29:4911
1578599154cyclictest0-21swapper/812:35:0210
1578599154cyclictest0-21swapper/812:35:0110
15785991513cyclictest9463-21iostat_ios08:25:2010
15785991513cyclictest26281-21df08:05:1310
15785991513cyclictest1594-21iostat11:55:1910
15785991513cyclictest10390-21memory09:10:3110
1578499155cyclictest0-21swapper/711:50:009
1578199150cyclictest0-21swapper/411:00:176
1576999155cyclictest623-21md0_raid109:39:494
1576999155cyclictest623-21md0_raid109:26:114
1576999153cyclictest19934-21md0_resync08:08:064
1576999152cyclictest0-21swapper/212:19:204
1576999152cyclictest0-21swapper/210:47:304
1576999152cyclictest0-21swapper/208:51:394
1576999150cyclictest0-21swapper/210:25:234
1576999150cyclictest0-21swapper/210:01:464
15751991514cyclictest0-21swapper/010:38:240
15751991514cyclictest0-21swapper/009:13:590
5299140watchdog/60-21swapper/610:35:118
31140ksoftirqd/00-21swapper/008:35:250
15790991413cyclictest623-21md0_raid110:29:273
15788991413cyclictest17168-1kworker/9:2H12:28:1011
15788991413cyclictest0-21swapper/910:55:5311
15788991413cyclictest0-21swapper/909:32:5411
15788991413cyclictest0-21swapper/907:23:5611
15788991413cyclictest0-21swapper/907:16:0511
15785991412cyclictest6557-21snmp_rack3slot912:00:5210
15785991412cyclictest4755-21perl07:35:1610
15785991412cyclictest12071-21snmp_rack3slot909:56:4910
1578499145cyclictest0-21swapper/710:00:009
1578499144cyclictest0-21swapper/712:15:009
1578499144cyclictest0-21swapper/710:30:009
1578499144cyclictest0-21swapper/710:10:029
1578499144cyclictest0-21swapper/709:10:019
1578499144cyclictest0-21swapper/708:05:009
1578499144cyclictest0-21swapper/707:25:029
1578399144cyclictest28551-21qemu-kvm08:09:018
1578399144cyclictest0-21swapper/611:10:008
15783991413cyclictest15506-21qemu-kvm07:44:548
1578399140cyclictest0-21swapper/607:22:048
15782991413cyclictest4331-21latency_hist09:05:017
15782991413cyclictest12795-21switchtime11:25:307
1578199143cyclictest0-21swapper/411:35:196
1576999143cyclictest0-21swapper/212:04:474
1576999143cyclictest0-21swapper/211:51:084
1576999143cyclictest0-21swapper/211:18:374
1576999143cyclictest0-21swapper/210:30:264
1576999143cyclictest0-21swapper/208:35:504
1576999143cyclictest0-21swapper/208:30:174
1576999143cyclictest0-21swapper/208:29:234
15769991412cyclictest2406-21snmpd12:05:434
1576999141cyclictest0-21swapper/211:09:254
1576999141cyclictest0-21swapper/210:40:314
1576999141cyclictest0-21swapper/210:37:194
1576999141cyclictest0-21swapper/209:14:014
1576999141cyclictest0-21swapper/207:36:094
15751991413cyclictest0-21swapper/012:24:060
12250140irq/42-ahci0-21swapper/607:16:328
1579099135cyclictest0-21swapper/1107:39:583
1579099134cyclictest0-21swapper/1111:25:003
1579099130cyclictest0-21swapper/1110:44:563
15785991311cyclictest2698-21diskstats09:45:1510
15785991311cyclictest21651-21yum08:40:3310
15785991311cyclictest17897-21munin-run12:20:0110
1578499134cyclictest0-21swapper/711:30:009
1578499134cyclictest0-21swapper/709:20:009
1578499133cyclictest0-21swapper/712:25:019
1578499133cyclictest0-21swapper/711:55:019
1578499133cyclictest0-21swapper/710:45:019
1578499133cyclictest0-21swapper/709:25:009
1578499133cyclictest0-21swapper/708:49:349
1578499133cyclictest0-21swapper/708:24:279
1578499133cyclictest0-21swapper/707:50:019
1578499130cyclictest0-21swapper/707:20:149
1578399139cyclictest28551-21qemu-kvm08:29:558
1578399134cyclictest0-21swapper/612:10:088
1578399134cyclictest0-21swapper/609:15:018
1578399133cyclictest0-21swapper/611:00:028
1578399133cyclictest0-21swapper/608:39:328
1578399133cyclictest0-21swapper/608:04:018
15781991311cyclictest18114-21sensors09:20:256
1577699133cyclictest0-21swapper/311:05:195
1576999133cyclictest0-21swapper/212:35:164
1576999133cyclictest0-21swapper/212:25:554
1576999133cyclictest0-21swapper/212:20:554
1576999133cyclictest0-21swapper/211:57:364
1576999133cyclictest0-21swapper/211:32:134
1576999133cyclictest0-21swapper/211:20:184
1576999133cyclictest0-21swapper/211:11:474
1576999133cyclictest0-21swapper/211:00:084
1576999133cyclictest0-21swapper/210:57:284
1576999133cyclictest0-21swapper/210:12:374
1576999133cyclictest0-21swapper/210:06:284
1576999133cyclictest0-21swapper/209:30:404
1576999133cyclictest0-21swapper/208:45:064
1576999133cyclictest0-21swapper/208:15:544
1576999133cyclictest0-21swapper/208:10:084
1576999133cyclictest0-21swapper/208:00:274
1576999133cyclictest0-21swapper/207:59:444
1576999133cyclictest0-21swapper/207:46:504
1576999133cyclictest0-21swapper/207:30:054
1576999133cyclictest0-21swapper/207:21:024
1576999133cyclictest0-21swapper/207:18:064
1576999133cyclictest0-21swapper/207:10:114
1576999132cyclictest0-21swapper/210:52:364
1576999132cyclictest0-21swapper/210:20:054
1576999132cyclictest0-21swapper/210:20:054
1576999132cyclictest0-21swapper/209:45:134
1576999132cyclictest0-21swapper/209:00:514
1576999131cyclictest0-21swapper/212:30:284
1576999131cyclictest0-21swapper/212:30:274
1576999131cyclictest0-21swapper/212:10:484
1576999131cyclictest0-21swapper/211:41:464
1576999131cyclictest0-21swapper/209:50:034
1576999131cyclictest0-21swapper/209:23:274
1576999131cyclictest0-21swapper/209:05:564
1576999131cyclictest0-21swapper/208:40:044
1576999131cyclictest0-21swapper/208:22:534
1576999131cyclictest0-21swapper/207:40:044
1576999130cyclictest0-21swapper/209:42:454
1576999130cyclictest0-21swapper/209:15:154
1576399133cyclictest0-21swapper/112:00:211
15763991312cyclictest3066350irq/52-eth0-rx-07:34:341
15751991311cyclictest2691-21runrttasks10:13:120
1575199130cyclictest0-21swapper/009:49:560
1575199130cyclictest0-21swapper/008:49:000
5999120watchdog/70-21swapper/711:24:399
481120ksoftirqd/50-21swapper/507:37:077
411120ksoftirqd/40-21swapper/411:30:556
31120ksoftirqd/00-21swapper/007:45:240
15788991211cyclictest26892-1kworker/9:1H10:54:4511
15788991211cyclictest0-21swapper/910:06:0511
15788991211cyclictest0-21swapper/908:12:4011
1578599123cyclictest0-21swapper/811:51:4310
1578499124cyclictest0-21swapper/712:05:019
1578499124cyclictest0-21swapper/711:35:009
1578499124cyclictest0-21swapper/707:35:019
1578499123cyclictest0-21swapper/710:05:019
1578499123cyclictest0-21swapper/708:15:009
1578499122cyclictest0-21swapper/711:37:069
1578499122cyclictest0-21swapper/709:51:069
1578499122cyclictest0-21swapper/708:53:039
1578499122cyclictest0-21swapper/708:43:279
1578399125cyclictest0-21swapper/610:26:358
1578399125cyclictest0-21swapper/608:51:038
1578399124cyclictest0-21swapper/609:45:008
1578399124cyclictest0-21swapper/608:34:488
1578399123cyclictest0-21swapper/611:15:018
1578399123cyclictest0-21swapper/610:13:588
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional