You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-02 - 17:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Fri Jan 02, 2026 12:46:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
205952120107sleep80-21swapper/807:07:3010
26511501120irq/49-eth0-rx-0-21swapper/107:08:521
20521210894sleep100-21swapper/1007:06:322
17672210793sleep20-21swapper/207:05:124
2651250980irq/50-eth0-tx-0-21swapper/907:08:2411
2651150900irq/49-eth0-rx-0-21swapper/507:07:577
2651250860irq/50-eth0-tx-0-21swapper/307:05:255
2651150720irq/49-eth0-rx-0-21swapper/707:08:399
1926327262sleep110-21swapper/1107:05:213
2063126853sleep00-21swapper/007:07:570
2077726661sleep40-21swapper/407:09:146
2059325955sleep60-21swapper/607:07:288
20987993419cyclictest0-21swapper/1109:15:183
20931993332cyclictest0-21swapper/007:15:140
20987992120cyclictest0-21swapper/1109:11:173
2095199210cyclictest0-21swapper/109:11:511
2098799200cyclictest27102-21sed10:10:283
2098699192cyclictest2651150irq/49-eth0-rx-10:25:132
2098699192cyclictest2651150irq/49-eth0-rx-08:25:242
2098699192cyclictest2651150irq/49-eth0-rx-08:25:232
2098599190cyclictest0-21swapper/909:11:0711
2098699181cyclictest12450irq/42-ahci10:46:402
2098699181cyclictest12450irq/42-ahci08:00:012
2098699181cyclictest12450irq/42-ahci07:15:302
2098599181cyclictest13009-21timerwakeupswit10:35:3111
2098599181cyclictest0-21swapper/908:15:1611
20974991816cyclictest23960-21qemu-kvm10:32:387
20974991816cyclictest23960-21qemu-kvm10:16:227
20972991816cyclictest8749-21snmp_rack3slot909:01:495
20972991816cyclictest26844-21snmp_easybox.os08:00:115
20972991816cyclictest25498-21snmp_rack3slot909:25:175
20972991816cyclictest25489-21diskstats10:10:145
20972991816cyclictest25282-21snmp_rack3slot907:15:135
20972991816cyclictest23745-21snmp_rack3slot910:06:015
20972991816cyclictest20833-21snmp_rack3slot908:35:115
20972991816cyclictest16931-21snmp_easybox.os12:10:235
20972991816cyclictest1500-21diskstats12:35:115
20972991816cyclictest13591-21munin-run10:40:015
20972991816cyclictest1330-21snmp_rack3slot908:51:385
20964991816cyclictest32765-21snmp_rack3slot909:35:144
20964991816cyclictest31602-21iostat_ios07:20:184
20964991816cyclictest2265-21snmpd09:28:324
20964991816cyclictest2265-21snmpd08:23:184
20964991816cyclictest2265-21snmpd08:23:184
20964991816cyclictest18991-21snmp_rack3slot910:45:154
2098699170cyclictest90572sleep1008:20:042
2098699170cyclictest90572sleep1008:20:042
2098699170cyclictest85122sleep1008:19:402
2098699170cyclictest83742sleep1009:45:252
2098699170cyclictest76082sleep1012:00:042
2098699170cyclictest75772sleep1007:30:342
2098699170cyclictest68352sleep1010:30:052
2098699170cyclictest64732sleep1011:11:222
2098699170cyclictest58322sleep1009:00:072
2098699170cyclictest48492sleep1008:55:322
2098699170cyclictest46122sleep1008:11:022
2098699170cyclictest4412sleep1007:22:082
2098699170cyclictest35052chrt12:35:312
2098699170cyclictest32262chrt11:51:502
2098699170cyclictest321242chrt09:35:102
2098699170cyclictest311112sleep1010:16:162
2098699170cyclictest307962sleep1009:33:472
2098699170cyclictest304322sleep1008:05:012
2098699170cyclictest301652sleep1008:47:062
2098699170cyclictest294512sleep1012:30:072
2098699170cyclictest290612sleep1011:45:022
2098699170cyclictest28952sleep1011:07:102
2098699170cyclictest28952sleep1011:07:092
2098699170cyclictest286862sleep1011:00:102
2098699170cyclictest286612sleep1012:26:192
2098699170cyclictest282272sleep1011:40:372
2098699170cyclictest276642sleep1010:13:522
2098699170cyclictest269762sleep1009:26:112
2098699170cyclictest2651150irq/49-eth0-rx-11:35:202
2098699170cyclictest2651150irq/49-eth0-rx-10:50:142
2098699170cyclictest2651150irq/49-eth0-rx-10:40:262
2098699170cyclictest2651150irq/49-eth0-rx-08:35:092
2098699170cyclictest2651150irq/49-eth0-rx-07:50:242
2098699170cyclictest244002sleep1012:20:302
2098699170cyclictest243872sleep1007:12:432
2098699170cyclictest236182chrt08:40:052
2098699170cyclictest220952sleep1010:05:152
2098699170cyclictest209972sleep1011:31:132
2098699170cyclictest196452sleep1009:15:472
2098699170cyclictest191412sleep1008:30:412
2098699170cyclictest191412sleep1008:30:402
2098699170cyclictest186392sleep1010:00:142
2098699170cyclictest185362sleep1012:15:052
2098699170cyclictest177442sleep1012:11:172
2098699170cyclictest160802sleep1009:11:462
2098699170cyclictest158352sleep1007:45:112
2098699170cyclictest157482sleep1009:55:272
2098699170cyclictest150272sleep1007:40:592
2098699170cyclictest147042sleep1011:25:112
2098699170cyclictest14172chrt08:52:432
2098699170cyclictest141602sleep1012:06:532
2098699170cyclictest137212chrt11:21:112
2098699170cyclictest137212chrt11:21:112
2098699170cyclictest132902chrt10:35:552
2098699170cyclictest129892chrt09:53:372
2098699170cyclictest124462sleep1009:07:442
2098699170cyclictest12450irq/42-ahci11:55:242
2098699170cyclictest12450irq/42-ahci10:20:062
2098699170cyclictest12450irq/42-ahci08:00:002
2098699170cyclictest11922sleep1007:25:092
2098699170cyclictest114142sleep1007:36:212
2098699170cyclictest100572sleep1011:15:472
2098699170cyclictest100572sleep1011:15:462
2098599170cyclictest0-21swapper/909:35:1011
2098599170cyclictest0-21swapper/907:56:4811
20974991716cyclictest23959-21qemu-kvm10:26:477
20972991715cyclictest7327-21snmp_easybox.os11:15:135
20972991715cyclictest7327-21snmp_easybox.os11:15:125
20972991715cyclictest6204-21snmp_rack3slot908:15:175
20972991715cyclictest28622-21snmp_rack3slot908:45:175
20972991715cyclictest28244-21snmp_rack3slot909:30:115
20972991715cyclictest27906-21snmp_rack3slot910:56:365
20972991715cyclictest27906-21snmp_rack3slot910:56:355
20972991715cyclictest24648-21snmp_rack3slot911:36:265
20972991715cyclictest2405-21snmp_rack3slot908:10:105
20972991715cyclictest20942-21snmp_rack3slot911:30:375
20972991715cyclictest20128-21snmp_rack3slot910:01:225
20972991715cyclictest18601-21diskstats10:45:145
20972991715cyclictest17430-21snmp_rack3slot908:30:145
20972991715cyclictest17430-21snmp_rack3slot908:30:135
20972991715cyclictest16503-21snmp_rack3slot909:57:015
20972991715cyclictest15228-21ntp_states09:10:215
20964991715cyclictest3610-21snmp_rack3slot912:36:484
20964991715cyclictest32408-21snmp_easybox.os11:05:114
20964991715cyclictest32408-21snmp_easybox.os11:05:114
20964991715cyclictest28274-21munin-node10:15:324
20964991715cyclictest21063-21snmp_rack3slot911:32:024
20964991715cyclictest14814-21snmp_rack3slot909:10:174
20964991715cyclictest13738-21snmp_rack3slot911:21:254
20964991715cyclictest13738-21snmp_rack3slot911:21:244
20964991715cyclictest12767-21snmp_easybox.os08:25:124
20964991715cyclictest12767-21snmp_easybox.os08:25:124
20951991715cyclictest65552sleep111:12:251
2098799160cyclictest0-21swapper/1110:08:543
2098799160cyclictest0-21swapper/1107:10:023
20985991615cyclictest741rcuc/912:09:2811
20985991615cyclictest12220-1kworker/9:1H07:15:0111
20985991615cyclictest0-21swapper/910:40:2211
20985991615cyclictest0-21swapper/908:00:0011
2098599161cyclictest0-21swapper/908:55:1411
20972991614cyclictest843-21snmp_rack3slot908:06:375
20972991614cyclictest4487-21diskstats11:10:145
20972991614cyclictest302-21diskstats10:20:135
20972991614cyclictest28334-21snmp_rack3slot911:42:015
20972991614cyclictest26045-21snmp_rack3slot912:25:125
20972991614cyclictest25975-21snmp_rack3slot907:56:235
20972991614cyclictest24975-21snmp_rack3slot912:20:375
20972991614cyclictest21355-21snmp_rack3slot912:15:495
20972991614cyclictest17322-21snmp_rack3slot911:25:485
20972991614cyclictest12314-21snmp_rack3slot909:05:595
20964991614cyclictest7496-21snmp_rack3slot909:45:164
20964991614cyclictest20336-21diskstats07:50:144
20964991614cyclictest14061-21snmp_rack3slot912:05:364
20964991614cyclictest10147-21snmp_rack3slot907:35:174
551150ksoftirqd/60-21swapper/609:11:188
2651250150irq/50-eth0-tx-26372-21munin-node07:15:164
2098599154cyclictest0-21swapper/908:50:0111
2098599154cyclictest0-21swapper/907:50:0211
20985991514cyclictest0-21swapper/910:10:2011
20985991514cyclictest0-21swapper/907:35:0911
2098499154cyclictest0-21swapper/809:35:1810
2098499153cyclictest0-21swapper/807:35:0010
2098499150cyclictest0-21swapper/807:15:1810
20974991513cyclictest23960-21qemu-kvm10:13:587
20972991513cyclictest6904-21snmp_easybox.os10:30:115
20972991513cyclictest4811-21irqstats10:25:185
20972991513cyclictest30739-21snmp_easybox.os11:00:245
20972991513cyclictest30728-21snmp_rack3slot907:20:125
20972991513cyclictest2886-21snmp_rack3slot911:07:025
20972991513cyclictest2886-21snmp_rack3slot911:07:015
20972991513cyclictest24251-21snmp_rack3slot910:51:255
20972991513cyclictest14138-21snmp_rack3slot912:06:365
20972991513cyclictest13569-21snmp_rack3slot908:25:145
20972991513cyclictest13569-21snmp_rack3slot908:25:145
20964991513cyclictest7835-21snmp_rack3slot909:00:244
20964991513cyclictest2265-21snmpd10:51:184
20964991513cyclictest21350-21snmp_rack3slot908:35:134
20964991513cyclictest20688-21snmp_rack3slot909:20:124
2096499150cyclictest0-21swapper/212:20:284
2095199150cyclictest0-21swapper/107:15:141
20931991514cyclictest2547-21runrttasks08:17:500
20931991513cyclictest10376-21turbostat11:20:010
20931991513cyclictest10376-21turbostat11:20:010
2093199151cyclictest0-21swapper/008:09:370
13650150irq/18-ehci_hcd0-21swapper/012:10:250
2098599145cyclictest0-21swapper/911:05:0111
2098599144cyclictest0-21swapper/910:55:0111
2098599144cyclictest0-21swapper/910:15:0111
2098599142cyclictest0-21swapper/910:20:1811
2098599142cyclictest0-21swapper/908:40:1711
20985991413cyclictest22517-21ntp_offset09:20:2211
20985991413cyclictest0-21swapper/911:50:0111
20985991413cyclictest0-21swapper/907:10:3011
2098199144cyclictest0-21swapper/710:45:009
2098199144cyclictest0-21swapper/707:25:019
2098199143cyclictest0-21swapper/708:05:019
20981991413cyclictest7431-21gawk09:00:219
2097499140cyclictest0-21swapper/507:40:257
20972991412cyclictest9614-21snmp_rack3slot912:00:255
20972991412cyclictest3190-21snmp_rack3slot911:51:255
20972991412cyclictest24972-21snmp_rack3slot908:40:135
20972991412cyclictest22368-21snmp_rack3slot907:51:445
20964991412cyclictest3049-21diskstats08:55:164
20964991412cyclictest2265-21snmpd12:04:354
20964991412cyclictest2265-21snmpd09:19:344
20964991412cyclictest2265-21snmpd08:50:334
2093199143cyclictest0-21swapper/010:30:010
20931991413cyclictest2259-21nscd08:10:260
20931991412cyclictest23793-21nscd07:24:090
20931991412cyclictest235942sleep009:24:480
2093199141cyclictest0-21swapper/010:14:350
12450140irq/42-ahci0-21swapper/707:15:129
12450140irq/42-ahci0-21swapper/407:15:176
2098799133cyclictest0-21swapper/1112:32:223
2098799133cyclictest0-21swapper/1112:04:513
2098799133cyclictest0-21swapper/1111:44:203
2098799133cyclictest0-21swapper/1111:25:183
2098799133cyclictest0-21swapper/1109:06:143
2098799133cyclictest0-21swapper/1108:55:463
2098799133cyclictest0-21swapper/1108:09:443
2098799133cyclictest0-21swapper/1107:50:453
2098799133cyclictest0-21swapper/1107:43:143
2098699133cyclictest0-21swapper/1009:40:472
2098599134cyclictest0-21swapper/910:00:1711
2098599134cyclictest0-21swapper/909:45:0111
2098599133cyclictest0-21swapper/912:27:4211
2098599133cyclictest0-21swapper/912:20:0111
2098599133cyclictest0-21swapper/912:00:4911
2098599133cyclictest0-21swapper/911:14:1911
2098599133cyclictest0-21swapper/910:07:1811
2098599133cyclictest0-21swapper/909:27:1011
2098599133cyclictest0-21swapper/908:11:4711
2098599133cyclictest0-21swapper/907:46:4411
2098599133cyclictest0-21swapper/907:41:0011
2098499133cyclictest0-21swapper/807:28:3310
2098199134cyclictest0-21swapper/709:15:019
2098199133cyclictest0-21swapper/711:54:519
2098199133cyclictest0-21swapper/710:33:189
2098199133cyclictest0-21swapper/710:26:489
2098199133cyclictest0-21swapper/707:53:039
2098199132cyclictest0-21swapper/712:10:019
2097599133cyclictest0-21swapper/612:28:228
2097599133cyclictest0-21swapper/612:12:218
2097599133cyclictest0-21swapper/612:08:508
2097599133cyclictest0-21swapper/611:51:208
2097599133cyclictest0-21swapper/611:13:488
2097599133cyclictest0-21swapper/610:50:178
2097599133cyclictest0-21swapper/609:59:468
2097599133cyclictest0-21swapper/609:52:168
2097599133cyclictest0-21swapper/608:48:468
2097599133cyclictest0-21swapper/608:37:158
2097599133cyclictest0-21swapper/608:26:508
2097599133cyclictest0-21swapper/608:26:498
2097599133cyclictest0-21swapper/607:19:598
20974991311cyclictest23960-21qemu-kvm10:21:127
20974991311cyclictest1008-21qemu-kvm08:12:007
2097399133cyclictest0-21swapper/409:00:016
20972991311cyclictest9771-21perl07:35:135
20972991311cyclictest5567-21iostat_ios11:55:205
2096499133cyclictest0-21swapper/211:10:304
2096499133cyclictest0-21swapper/207:55:154
20964991311cyclictest6827-21snmp_rack3slot911:56:264
20964991311cyclictest27907-21snmp_rack3slot910:56:364
20964991311cyclictest27907-21snmp_rack3slot910:56:364
20964991311cyclictest18838-21iostat_ios10:00:154
20964991311cyclictest12889-21snmp_rack3slot909:52:144
20951991311cyclictest28567-21tail08:45:161
2093199133cyclictest0-21swapper/012:10:010
2093199133cyclictest0-21swapper/011:40:000
2093199133cyclictest0-21swapper/011:20:170
2093199133cyclictest0-21swapper/011:20:160
2093199133cyclictest0-21swapper/009:50:180
2093199133cyclictest0-21swapper/008:00:160
1799130watchdog/10-21swapper/109:22:041
13650130irq/18-ehci_hcd0-21swapper/007:35:240
2098799123cyclictest0-21swapper/1110:00:013
2098799123cyclictest0-21swapper/1108:35:023
2098799122cyclictest0-21swapper/1112:24:373
2098799122cyclictest0-21swapper/1112:09:213
2098799122cyclictest0-21swapper/1111:46:493
2098799122cyclictest0-21swapper/1111:32:183
2098799122cyclictest0-21swapper/1111:17:493
2098799122cyclictest0-21swapper/1111:17:493
2098799122cyclictest0-21swapper/1111:10:193
2098799122cyclictest0-21swapper/1111:08:183
2098799122cyclictest0-21swapper/1111:08:183
2098799122cyclictest0-21swapper/1110:55:173
2098799122cyclictest0-21swapper/1110:55:173
2098799122cyclictest0-21swapper/1110:52:183
2098799122cyclictest0-21swapper/1110:34:183
2098799122cyclictest0-21swapper/1110:21:043
2098799122cyclictest0-21swapper/1109:54:493
2098799122cyclictest0-21swapper/1109:37:473
2098799122cyclictest0-21swapper/1109:01:453
2098799122cyclictest0-21swapper/1108:50:153
2098799122cyclictest0-21swapper/1108:29:163
2098799122cyclictest0-21swapper/1108:29:153
2098799122cyclictest0-21swapper/1107:57:003
2098799122cyclictest0-21swapper/1107:26:153
2098799122cyclictest0-21swapper/1107:21:443
2098599123cyclictest0-21swapper/911:35:5011
2098599123cyclictest0-21swapper/911:20:0111
2098599123cyclictest0-21swapper/911:20:0111
2098599123cyclictest0-21swapper/910:49:4811
2098599123cyclictest0-21swapper/910:28:4711
2098599123cyclictest0-21swapper/909:40:1911
2098599123cyclictest0-21swapper/908:24:1811
2098599123cyclictest0-21swapper/908:24:1811
2098599123cyclictest0-21swapper/907:30:0111
2098599123cyclictest0-21swapper/907:21:1511
2098599122cyclictest0-21swapper/912:36:2211
2098599122cyclictest0-21swapper/911:57:2111
2098599122cyclictest0-21swapper/911:54:0711
2098599122cyclictest0-21swapper/910:55:0411
2098599122cyclictest0-21swapper/910:55:0311
2098599122cyclictest0-21swapper/910:31:4811
2098599122cyclictest0-21swapper/909:55:4711
2098599122cyclictest0-21swapper/908:32:2511
2098599122cyclictest0-21swapper/908:32:2411
2098599122cyclictest0-21swapper/908:25:0311
2098599122cyclictest0-21swapper/908:25:0211
20985991211cyclictest0-21swapper/911:25:2111
20985991211cyclictest0-21swapper/911:15:0111
20985991211cyclictest0-21swapper/911:15:0011
2098499124cyclictest0-21swapper/810:50:1910
2098499122cyclictest0-21swapper/811:19:4910
2098499122cyclictest0-21swapper/811:19:4810
2098499122cyclictest0-21swapper/810:30:0310
2098499122cyclictest0-21swapper/808:15:0110
2098499122cyclictest0-21swapper/808:13:4510
2098499121cyclictest0-21swapper/809:50:2010
2098199124cyclictest0-21swapper/709:29:599
2098199123cyclictest0-21swapper/709:52:049
2098199123cyclictest0-21swapper/708:55:019
2098199123cyclictest0-21swapper/708:35:019
2098199123cyclictest0-21swapper/708:20:029
2098199122cyclictest0-21swapper/712:26:219
2098199122cyclictest0-21swapper/710:52:169
2098199122cyclictest0-21swapper/710:17:179
2098199122cyclictest0-21swapper/707:24:459
20981991211cyclictest19747-21gawk11:30:209
2098199120cyclictest30894-21munin-run09:35:009
2097599125cyclictest26751-21awk08:45:028
2097599123cyclictest0-21swapper/610:05:018
2097599123cyclictest0-21swapper/609:50:018
2097599122cyclictest0-21swapper/611:41:508
2097599122cyclictest0-21swapper/611:25:488
2097599122cyclictest0-21swapper/610:24:068
2097599122cyclictest0-21swapper/608:51:158
2097499122cyclictest0-21swapper/511:40:187
2097499122cyclictest0-21swapper/511:10:017
2097499122cyclictest0-21swapper/511:10:007
2097499122cyclictest0-21swapper/507:45:207
2097399123cyclictest0-21swapper/411:00:016
2097399123cyclictest0-21swapper/411:00:016
20972991211cyclictest31652-21python12:30:265
20972991210cyclictest5053-21snmp_rack3slot908:56:385
20972991210cyclictest2738-21snmp_easybox.os09:40:125
20972991210cyclictest22705-21python09:20:255
20972991210cyclictest13678-21snmp_rack3slot911:20:365
20972991210cyclictest13678-21snmp_rack3slot911:20:365
2096499125cyclictest0-21swapper/211:45:204
2096499124cyclictest0-21swapper/210:05:194
20964991210cyclictest2265-21snmpd12:19:054
20964991210cyclictest16453-21snmp_rack3slot909:56:244
2095199122cyclictest0-21swapper/112:25:181
2095199122cyclictest0-21swapper/111:30:181
2095199122cyclictest0-21swapper/107:50:181
2093199129cyclictest0-21swapper/012:25:280
2093199124cyclictest0-21swapper/009:10:230
2093199122cyclictest0-21swapper/012:30:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional