You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 01:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Tue Dec 30, 2025 12:46:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30081211093sleep00-21swapper/007:06:240
30195210894sleep80-21swapper/807:07:5510
30129210693sleep10-21swapper/107:07:001
26512501040irq/50-eth0-tx-0-21swapper/307:05:465
12450970irq/42-ahci0-21swapper/707:09:499
2651250950irq/50-eth0-tx-0-21swapper/1007:05:122
12450940irq/42-ahci0-21swapper/207:08:554
2651250920irq/50-eth0-tx-0-21swapper/507:05:147
2651150920irq/49-eth0-rx-0-21swapper/907:07:0211
3037528179sleep40-21swapper/407:09:396
14950650irq/18-uhci_hcd0-21swapper/1107:05:273
3012125955sleep60-21swapper/607:06:548
30556993517cyclictest0-21swapper/1109:17:183
30515993029cyclictest2547-21runrttasks07:20:340
30541992416cyclictest31013-21snmp_rack3slot912:16:495
30541992316cyclictest27278-21snmp_rack3slot912:10:385
30541992315cyclictest1402-21snmp_rack3slot910:51:385
30541992315cyclictest13628-21snmp_rack3slot909:40:185
30541992215cyclictest27452-21snmp_easybox.os07:45:255
30541992215cyclictest18318-21snmp_rack3slot909:01:495
30541992215cyclictest11997-21snmp_easybox.os11:50:255
30541992214cyclictest6369-21snmp_rack3slot910:15:135
30541992214cyclictest19688-21snmp_rack3slot911:16:285
3051599228cyclictest0-21swapper/009:14:390
30541992115cyclictest10442-21snmp_rack3slot908:05:405
30541992114cyclictest5110-21snmp_rack3slot910:56:255
30541992114cyclictest1784-21snmp_rack3slot911:36:255
30541992114cyclictest1338-21snmp_easybox.os12:20:255
30541992113cyclictest31957-21snmp_rack3slot907:52:015
30541992113cyclictest28681-21snmp_rack3slot910:45:175
30541992113cyclictest16430-21snmp_rack3slot911:56:505
30541992112cyclictest8849-21snmp_rack3slot911:02:155
30541992112cyclictest13975-21df11:10:125
30541992015cyclictest13198-21snmp_rack3slot912:37:005
30541992013cyclictest29634-21snmp_rack3slot910:00:485
30541992013cyclictest29634-21snmp_rack3slot910:00:485
30541992013cyclictest24375-21iostat_ios09:10:195
30541992012cyclictest14119-21snmp_rack3slot910:25:175
30541992012cyclictest10492-21snmp_rack3slot910:20:175
3051599200cyclictest0-21swapper/010:11:110
3054199190cyclictest0-21swapper/307:15:205
30550991817cyclictest20827-1kworker/10:2H11:37:392
30550991817cyclictest20827-1kworker/10:2H08:50:112
30550991817cyclictest0-21swapper/1010:55:252
30550991816cyclictest23820-21snmp_rack3slot909:10:152
3055099181cyclictest12450irq/42-ahci10:31:412
3055099181cyclictest12450irq/42-ahci10:26:262
3055099181cyclictest12450irq/42-ahci10:07:062
3055099181cyclictest12450irq/42-ahci08:45:052
3055099181cyclictest12450irq/42-ahci08:25:092
3055099181cyclictest12450irq/42-ahci07:49:472
3055099181cyclictest12450irq/42-ahci07:20:472
3054999181cyclictest761ksoftirqd/911:45:1311
3054999181cyclictest761ksoftirqd/911:05:2311
3054999181cyclictest761ksoftirqd/911:00:1511
3054999181cyclictest761ksoftirqd/908:30:2911
3054999181cyclictest23881-21cut09:10:1511
3054999181cyclictest0-21swapper/912:30:1311
3054999181cyclictest0-21swapper/912:20:3911
3054999181cyclictest0-21swapper/912:18:4911
3054999181cyclictest0-21swapper/912:13:0611
3054999181cyclictest0-21swapper/912:00:3011
3054999181cyclictest0-21swapper/911:40:0511
3054999181cyclictest0-21swapper/911:35:4611
3054999181cyclictest0-21swapper/911:30:2911
3054999181cyclictest0-21swapper/911:26:5111
3054999181cyclictest0-21swapper/911:23:3911
3054999181cyclictest0-21swapper/911:16:1911
3054999181cyclictest0-21swapper/910:49:4711
3054999181cyclictest0-21swapper/910:40:5611
3054999181cyclictest0-21swapper/910:35:1511
3054999181cyclictest0-21swapper/910:20:1211
3054999181cyclictest0-21swapper/910:00:5511
3054999181cyclictest0-21swapper/910:00:5411
3054999181cyclictest0-21swapper/909:53:4511
3054999181cyclictest0-21swapper/909:47:0711
3054999181cyclictest0-21swapper/909:47:0711
3054999181cyclictest0-21swapper/909:27:4611
3054999181cyclictest0-21swapper/909:06:4211
3054999181cyclictest0-21swapper/908:59:3011
3054999181cyclictest0-21swapper/908:52:4211
3054999181cyclictest0-21swapper/908:46:5211
3054999181cyclictest0-21swapper/908:35:2011
3054999181cyclictest0-21swapper/908:01:5111
3054999181cyclictest0-21swapper/907:56:0711
3054999181cyclictest0-21swapper/907:45:3111
3054999181cyclictest0-21swapper/907:32:0111
3054999181cyclictest0-21swapper/907:25:3111
3054999181cyclictest0-21swapper/907:11:1211
30541991816cyclictest6626-21snmp_easybox.os08:45:255
30536991816cyclictest2265-21snmpd12:04:584
30550991716cyclictest20827-1kworker/10:2H12:00:282
30550991716cyclictest20827-1kworker/10:2H09:35:292
30550991716cyclictest20827-1kworker/10:2H07:15:542
30550991715cyclictest15653-21grep09:00:122
3055099170cyclictest91862sleep1011:47:032
3055099170cyclictest82782chrt12:30:212
3055099170cyclictest54822chrt10:15:062
3055099170cyclictest48242sleep1010:13:072
3055099170cyclictest42362chrt09:26:472
3055099170cyclictest35282chrt11:40:152
3055099170cyclictest31272sleep1007:55:382
3055099170cyclictest310032sleep1007:10:082
3055099170cyclictest309272sleep1012:15:432
3055099170cyclictest301692sleep1010:46:212
3055099170cyclictest284612chrt11:30:132
3055099170cyclictest280832sleep1010:00:162
3055099170cyclictest280832sleep1010:00:152
3055099170cyclictest273132sleep1012:11:052
3055099170cyclictest2651150irq/49-eth0-rx-11:50:292
3055099170cyclictest2651150irq/49-eth0-rx-09:30:232
3055099170cyclictest2651150irq/49-eth0-rx-09:22:402
3055099170cyclictest2651150irq/49-eth0-rx-08:35:192
3055099170cyclictest2651150irq/49-eth0-rx-07:50:142
3055099170cyclictest2651150irq/49-eth0-rx-07:25:052
3055099170cyclictest264142sleep1009:15:112
3055099170cyclictest260722sleep1009:56:512
3055099170cyclictest240942sleep1011:25:012
3055099170cyclictest238262sleep1012:08:062
3055099170cyclictest228822sleep1010:36:072
3055099170cyclictest225472sleep1011:20:262
3055099170cyclictest21942sleep1008:40:202
3055099170cyclictest217542sleep1009:50:262
3055099170cyclictest21542sleep1012:20:552
3055099170cyclictest208562sleep1009:05:212
3055099170cyclictest197892sleep1011:17:482
3055099170cyclictest164632sleep1011:57:172
3055099170cyclictest160172sleep1011:11:002
3055099170cyclictest158862sleep1009:45:032
3055099170cyclictest158862sleep1009:45:022
3055099170cyclictest145662sleep1008:55:572
3055099170cyclictest144642sleep1009:40:252
3055099170cyclictest13622chrt10:51:102
3055099170cyclictest131122chrt12:35:572
3055099170cyclictest12450irq/42-ahci10:40:152
3055099170cyclictest12450irq/42-ahci08:30:122
3055099170cyclictest12450irq/42-ahci08:20:092
3055099170cyclictest12450irq/42-ahci08:15:532
3055099170cyclictest12450irq/42-ahci08:01:042
3055099170cyclictest12450irq/42-ahci07:41:242
3055099170cyclictest12450irq/42-ahci07:36:102
3055099170cyclictest12450irq/42-ahci07:30:212
3055099170cyclictest123932sleep1011:06:122
3055099170cyclictest122332sleep1008:10:162
3055099170cyclictest120932sleep1010:22:542
3055099170cyclictest105162sleep1008:06:392
30549991716cyclictest0-21swapper/912:25:0911
30549991716cyclictest0-21swapper/911:13:1011
3054999170cyclictest761ksoftirqd/910:15:0111
3054999170cyclictest761ksoftirqd/908:05:2111
3054999170cyclictest0-21swapper/912:35:5211
3054999170cyclictest0-21swapper/912:06:5411
3054999170cyclictest0-21swapper/911:56:5211
3054999170cyclictest0-21swapper/911:50:2711
3054999170cyclictest0-21swapper/910:56:1411
3054999170cyclictest0-21swapper/910:50:1411
3054999170cyclictest0-21swapper/910:30:1611
3054999170cyclictest0-21swapper/910:10:4111
3054999170cyclictest0-21swapper/910:05:3211
3054999170cyclictest0-21swapper/909:58:4311
3054999170cyclictest0-21swapper/909:44:5111
3054999170cyclictest0-21swapper/909:35:2711
3054999170cyclictest0-21swapper/909:34:1411
3054999170cyclictest0-21swapper/909:21:0411
3054999170cyclictest0-21swapper/909:16:2911
3054999170cyclictest0-21swapper/909:03:5711
3054999170cyclictest0-21swapper/908:25:2311
3054999170cyclictest0-21swapper/908:20:0611
3054999170cyclictest0-21swapper/908:17:5111
3054999170cyclictest0-21swapper/908:10:0611
3054999170cyclictest0-21swapper/907:52:0311
3054999170cyclictest0-21swapper/907:42:3611
3054999170cyclictest0-21swapper/907:37:3811
3054999170cyclictest0-21swapper/907:19:3211
30546991716cyclictest10678-21qemu-kvm08:25:078
30546991715cyclictest22098-21qemu-kvm09:47:338
30546991715cyclictest22098-21qemu-kvm09:47:328
3054199172cyclictest0-21swapper/308:25:185
30541991715cyclictest4714-21snmp_easybox.os11:40:245
30541991715cyclictest31777-21snmp_rack3slot907:10:135
30541991715cyclictest3169-21snmp_rack3slot907:56:135
30541991715cyclictest30564-21snmp_rack3slot911:31:015
30541991715cyclictest2697-21snmp_rack3slot910:10:165
30541991715cyclictest26968-21snmp_rack3slot911:26:375
30541991715cyclictest22622-21diskstats07:40:135
30541991715cyclictest21887-21snmp_rack3slot909:06:025
30541991715cyclictest2069-21snmp_rack3slot908:40:165
30541991715cyclictest20129-21snmp_rack3slot912:02:145
30541991715cyclictest11763-21snmp_easybox.os08:55:115
30541991715cyclictest11622-21snmp_easybox.os11:05:255
30536991715cyclictest2265-21snmpd10:32:144
3051599170cyclictest18624-21chrt08:20:060
30549991615cyclictest0-21swapper/910:27:1311
30549991615cyclictest0-21swapper/908:41:3011
30549991615cyclictest0-21swapper/907:20:2911
3054799165cyclictest0-21swapper/712:25:029
3054799164cyclictest0-21swapper/710:50:029
30545991614cyclictest1073-21qemu-kvm10:11:447
30545991614cyclictest1073-21qemu-kvm10:09:007
30541991614cyclictest5094-21snmp_easybox.os12:25:255
30541991614cyclictest30816-21perl08:35:185
30541991614cyclictest26037-21snmp_rack3slot909:56:255
30541991614cyclictest25046-21snmp_rack3slot910:40:175
30541991614cyclictest23287-21snmp_rack3slot911:21:015
30541991614cyclictest22387-21snmp_rack3slot909:51:145
30541991614cyclictest10168-21snmp_rack3slot908:50:275
3053699160cyclictest0-21swapper/208:50:284
30515991615cyclictest0-21swapper/012:15:200
3051599160cyclictest18094-21chrt08:19:550
30550991514cyclictest0-21swapper/1012:25:072
3054799154cyclictest0-21swapper/708:15:019
30546991514cyclictest10678-21qemu-kvm08:24:598
30545991513cyclictest10679-21qemu-kvm08:21:567
3054499150cyclictest0-21swapper/412:20:246
3054499150cyclictest0-21swapper/411:10:146
3054499150cyclictest0-21swapper/409:58:136
3054499150cyclictest0-21swapper/409:15:016
3054499150cyclictest0-21swapper/408:45:166
3054499150cyclictest0-21swapper/407:20:116
30541991514cyclictest7211-21python09:30:275
30541991513cyclictest9169-21snmp_rack3slot911:46:485
30541991513cyclictest17261-21snmp_rack3slot909:45:155
30541991513cyclictest17261-21snmp_rack3slot909:45:155
3053699150cyclictest0-21swapper/211:20:154
3052799150cyclictest0-21swapper/107:25:311
30515991513cyclictest3564-21chrt09:25:250
3051599150cyclictest0-21swapper/011:05:290
3051599150cyclictest0-21swapper/009:09:260
108950150irq/18-i801_smb0-21swapper/107:10:251
6699140watchdog/80-21swapper/810:34:5910
551140ksoftirqd/60-21swapper/609:22:198
30556991413cyclictest13506-21snmp_rack3slot910:25:153
3054899144cyclictest0-21swapper/812:10:0010
3054899144cyclictest0-21swapper/811:00:0210
3054899144cyclictest0-21swapper/810:15:0210
3054899144cyclictest0-21swapper/809:50:0210
3054899144cyclictest0-21swapper/809:50:0110
3054799144cyclictest0-21swapper/709:25:029
3054799144cyclictest0-21swapper/708:10:009
3054799144cyclictest0-21swapper/707:55:019
3054799143cyclictest0-21swapper/711:25:009
3054699148cyclictest10678-21qemu-kvm08:20:008
3054699142cyclictest0-21swapper/610:34:578
30546991412cyclictest29034-21munin-run08:35:018
30541991412cyclictest23671-21snmp_rack3slot912:06:025
30536991412cyclictest2265-21snmpd10:04:574
30536991412cyclictest2265-21snmpd10:04:574
30536991412cyclictest2265-21snmpd09:42:574
30536991412cyclictest2265-21snmpd08:43:414
30527991412cyclictest269112sleep111:25:521
3051599142cyclictest0-21swapper/008:35:010
31140ksoftirqd/00-21swapper/011:59:580
901130ksoftirqd/110-21swapper/1109:35:103
901130ksoftirqd/110-21swapper/1108:32:323
691130ksoftirqd/80-21swapper/809:51:3710
691130ksoftirqd/80-21swapper/809:22:1810
621130ksoftirqd/70-21swapper/708:32:329
551130ksoftirqd/60-21swapper/610:44:478
481130ksoftirqd/522098-21qemu-kvm09:22:187
481130ksoftirqd/50-21swapper/511:59:587
481130ksoftirqd/50-21swapper/511:27:597
481130ksoftirqd/50-21swapper/509:51:377
481130ksoftirqd/50-21swapper/508:32:327
341130ksoftirqd/30-21swapper/309:35:095
341130ksoftirqd/30-21swapper/308:32:335
3055699134cyclictest0-21swapper/1109:20:013
3055699133cyclictest0-21swapper/1111:40:003
3055699133cyclictest0-21swapper/1110:37:233
3055699133cyclictest0-21swapper/1108:38:483
3055699133cyclictest0-21swapper/1107:44:363
3055699133cyclictest0-21swapper/1107:18:463
3055699130cyclictest0-21swapper/1109:28:513
3055099135cyclictest0-21swapper/1011:00:012
3054899134cyclictest0-21swapper/807:33:4110
3054899133cyclictest0-21swapper/812:26:5910
3054899133cyclictest0-21swapper/811:55:3010
3054899133cyclictest0-21swapper/811:54:1410
3054899133cyclictest0-21swapper/811:42:5910
3054899133cyclictest0-21swapper/811:20:5910
3054899133cyclictest0-21swapper/809:25:5110
3054899133cyclictest0-21swapper/809:15:2610
3054899133cyclictest0-21swapper/809:01:1910
3054899133cyclictest0-21swapper/808:20:4810
3054899133cyclictest0-21swapper/808:20:0210
3054899133cyclictest0-21swapper/808:08:1710
3054899133cyclictest0-21swapper/807:50:0110
3054899133cyclictest0-21swapper/807:50:0010
3054899133cyclictest0-21swapper/807:16:1710
3054799135cyclictest0-21swapper/712:17:169
3054799134cyclictest0-21swapper/712:35:009
3054799133cyclictest0-21swapper/711:54:279
3054799133cyclictest0-21swapper/711:48:259
3054799133cyclictest0-21swapper/711:40:559
3054799133cyclictest0-21swapper/711:33:269
3054799133cyclictest0-21swapper/711:02:559
3054799133cyclictest0-21swapper/710:26:569
3054799133cyclictest0-21swapper/710:00:529
3054799133cyclictest0-21swapper/710:00:519
3054799133cyclictest0-21swapper/709:56:529
3054799133cyclictest0-21swapper/709:41:529
3054799133cyclictest0-21swapper/709:31:199
3054799133cyclictest0-21swapper/709:20:029
3054799133cyclictest0-21swapper/709:15:209
3054799133cyclictest0-21swapper/709:12:209
3054799133cyclictest0-21swapper/709:07:509
3054799133cyclictest0-21swapper/709:03:499
3054799133cyclictest0-21swapper/708:28:179
3054799133cyclictest0-21swapper/708:21:479
3054799133cyclictest0-21swapper/707:31:179
3054799133cyclictest0-21swapper/707:25:029
3054799132cyclictest0-21swapper/707:21:249
3054699134cyclictest0-21swapper/610:05:228
3054699133cyclictest0-21swapper/612:13:578
3054699133cyclictest0-21swapper/612:01:568
3054699133cyclictest0-21swapper/611:55:428
3054699133cyclictest0-21swapper/611:49:268
3054699133cyclictest0-21swapper/611:42:558
3054699133cyclictest0-21swapper/611:34:568
3054699133cyclictest0-21swapper/611:20:268
3054699133cyclictest0-21swapper/611:17:558
3054699133cyclictest0-21swapper/610:54:538
3054699133cyclictest0-21swapper/610:45:448
3054699133cyclictest0-21swapper/609:42:218
3054699133cyclictest0-21swapper/609:36:518
3054699133cyclictest0-21swapper/607:55:018
3054699133cyclictest0-21swapper/607:43:488
3054699133cyclictest0-21swapper/607:37:478
3054699130cyclictest0-21swapper/609:55:288
3053699133cyclictest271ksoftirqd/209:48:074
3053699133cyclictest271ksoftirqd/209:48:074
3053699133cyclictest0-21swapper/212:30:014
3053699133cyclictest0-21swapper/210:10:224
3053699133cyclictest0-21swapper/209:05:184
3053699133cyclictest0-21swapper/208:00:184
30536991312cyclictest271ksoftirqd/210:54:084
30536991312cyclictest271ksoftirqd/209:51:384
30536991312cyclictest271ksoftirqd/209:22:194
30536991312cyclictest271ksoftirqd/208:39:314
30536991311cyclictest2265-21snmpd07:58:114
3052799133cyclictest0-21swapper/109:08:101
30527991312cyclictest5842-21chrt12:25:471
3051599130cyclictest0-21swapper/010:45:200
31130ksoftirqd/00-21swapper/010:20:270
31130ksoftirqd/00-21swapper/009:22:030
31130ksoftirqd/00-21swapper/008:40:280
201130ksoftirqd/10-21swapper/109:35:091
201130ksoftirqd/10-21swapper/108:32:331
901120ksoftirqd/110-21swapper/1111:59:583
901120ksoftirqd/110-21swapper/1111:27:593
901120ksoftirqd/110-21swapper/1109:12:593
901120ksoftirqd/110-21swapper/1109:08:103
901120ksoftirqd/110-21swapper/1108:46:393
691120ksoftirqd/80-21swapper/812:14:2110
691120ksoftirqd/80-21swapper/811:27:5810
691120ksoftirqd/80-21swapper/810:02:5710
691120ksoftirqd/80-21swapper/810:02:5710
691120ksoftirqd/80-21swapper/809:13:0010
691120ksoftirqd/80-21swapper/808:32:3210
6699120watchdog/80-21swapper/808:11:3910
621120ksoftirqd/70-21swapper/711:59:599
551120ksoftirqd/60-21swapper/611:54:008
551120ksoftirqd/60-21swapper/611:06:508
551120ksoftirqd/60-21swapper/611:02:408
551120ksoftirqd/60-21swapper/609:54:018
481120ksoftirqd/50-21swapper/510:44:477
481120ksoftirqd/50-21swapper/510:02:587
481120ksoftirqd/50-21swapper/510:02:577
481120ksoftirqd/50-21swapper/509:12:597
481120ksoftirqd/50-21swapper/508:46:397
481120ksoftirqd/50-21swapper/508:42:107
411120ksoftirqd/40-21swapper/411:59:596
411120ksoftirqd/40-21swapper/411:53:596
411120ksoftirqd/40-21swapper/410:52:216
411120ksoftirqd/40-21swapper/410:02:586
411120ksoftirqd/40-21swapper/410:02:576
411120ksoftirqd/40-21swapper/409:22:186
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional