You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-09 - 01:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Sun Nov 09, 2025 00:43:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2758054991611,0cyclictest0-21swapper/320:35:003
275805499140,12cyclictest0-21swapper/321:35:133
2758054991311,1cyclictest0-21swapper/321:40:143
2758054991310,2cyclictest0-21swapper/320:20:133
2758054991310,1cyclictest0-21swapper/319:40:123
275805499130,11cyclictest0-21swapper/322:55:133
275805499121,10cyclictest69450irq/121-eno100:15:133
2758054991211,0cyclictest0-21swapper/320:40:133
275805499120,1cyclictest0-21swapper/321:25:013
275805499120,11cyclictest0-21swapper/322:40:133
275805499120,11cyclictest0-21swapper/322:30:133
275805499120,11cyclictest0-21swapper/322:25:163
275805499120,11cyclictest0-21swapper/322:10:173
275805499120,11cyclictest0-21swapper/321:55:173
275805499120,11cyclictest0-21swapper/321:45:203
2758054991111,0cyclictest0-21swapper/320:35:133
2758054991111,0cyclictest0-21swapper/300:08:373
2758054991110,1cyclictest69450irq/121-eno122:19:263
2758054991110,0cyclictest69450irq/121-eno121:51:003
2758054991110,0cyclictest0-21swapper/323:50:153
275805499110,10cyclictest69450irq/121-eno123:15:143
275805499110,10cyclictest69450irq/121-eno123:00:133
275805499110,10cyclictest0-21swapper/323:30:203
275805499110,10cyclictest0-21swapper/320:50:213
275805499110,0cyclictest0-21swapper/320:25:153
275805499110,0cyclictest0-21swapper/319:50:013
275805499110,0cyclictest0-21swapper/319:30:013
275805499110,0cyclictest0-21swapper/319:10:123
275805499110,0cyclictest0-21swapper/300:30:193
275805499109,1cyclictest0-21swapper/320:00:123
275805499108,1cyclictest69450irq/121-eno119:25:003
2758054991010,0cyclictest69450irq/121-eno123:13:343
2758054991010,0cyclictest69450irq/121-eno122:50:183
2758054991010,0cyclictest69450irq/121-eno121:31:393
2758054991010,0cyclictest0-21swapper/320:10:003
275805499100,9cyclictest69450irq/121-eno123:59:593
275805499100,9cyclictest69450irq/121-eno122:05:133
275805499100,9cyclictest69450irq/121-eno119:15:153
275805499100,9cyclictest0-21swapper/320:19:553
275805499100,0cyclictest0-21swapper/300:00:133
27580549999,0cyclictest69450irq/121-eno123:40:173
27580549999,0cyclictest69450irq/121-eno123:35:203
27580549999,0cyclictest69450irq/121-eno123:08:373
27580549999,0cyclictest69450irq/121-eno120:45:163
27580549999,0cyclictest69450irq/121-eno119:55:143
27580549999,0cyclictest69450irq/121-eno100:10:163
27580549999,0cyclictest0-21swapper/323:30:003
27580549999,0cyclictest0-21swapper/322:35:193
27580549999,0cyclictest0-21swapper/322:20:123
27580549999,0cyclictest0-21swapper/322:00:133
27580549990,8cyclictest69450irq/121-eno121:25:193
27580549988,0cyclictest69450irq/121-eno122:45:163
27580549988,0cyclictest69450irq/121-eno100:35:233
27580549988,0cyclictest0-21swapper/323:20:183
27580549988,0cyclictest0-21swapper/320:10:133
27580549985,2cyclictest69450irq/121-eno121:10:223
27580549980,7cyclictest69450irq/121-eno119:35:243
27580549980,7cyclictest69450irq/121-eno100:28:113
27580549980,1cyclictest0-21swapper/321:15:133
27580549977,0cyclictest69450irq/121-eno123:46:093
27580549977,0cyclictest0-21swapper/300:20:173
27580549975,1cyclictest0-21swapper/319:25:143
27580549960,6cyclictest69450irq/121-eno121:06:373
2756269261,3sleep30-21swapper/319:05:153
27580549955,0cyclictest69450irq/121-eno121:00:173
27580549954,0cyclictest0-21swapper/320:55:183
27580549953,1cyclictest69450irq/121-eno119:50:213
2757826250,0sleep20-21swapper/219:09:032
2841435242,1sleep00-21swapper/022:35:020
2820256240,2sleep22820282-21apt-get21:45:122
2797833240,2sleep22797849-21perf20:50:012
2785528240,2sleep02785546-21apt-get20:20:010
2757568241,0sleep00-21swapper/019:05:440
2755991241,2sleep10-21swapper/119:05:011
2877818231,1sleep22877941-21memory00:00:222
2861163230,1sleep12861317-21ntp_states23:20:171
2826983230,1sleep02827230-21diskstats22:00:150
2815810230,1sleep02815836-21apt-get21:35:140
2801925230,1sleep02801951-21apt-get21:00:110
2783612230,1sleep02783645-21systemd-run20:15:000
2782564230,2sleep22782717-21ntp_states20:10:182
2771418230,2sleep12771639-21grep19:40:191
2764429230,1sleep12764455-21apt-get19:25:141
2888935220,1sleep22889073-21switchtime00:25:222
2886466220,1sleep00-21swapper/000:20:160
2885409220,1sleep12885728-21sed00:20:021
2881649220,1sleep02881926-21df_inode00:10:190
2879872220,1sleep22880024-21memory00:05:172
2866937220,1sleep22867204-21expr23:35:152
2860675220,1sleep22860959-21df23:20:152
2856089220,1sleep12856123-21munin-run23:10:001
2855771220,1sleep00-21swapper/023:07:150
2839332220,1sleep00-21swapper/022:29:530
2835154220,1sleep12835392-21sed22:20:021
2826521220,1sleep22826547-21turbostat.cron22:00:012
2826254220,0sleep00-21swapper/021:57:390
2823459220,1sleep10-21swapper/121:50:191
2821033220,1sleep00-21swapper/021:45:180
2811777220,1sleep12811807-21apt-get21:25:141
2792492220,1sleep22792575-21irqstats20:35:162
2784829220,1sleep02785009-21timerwakeupswit20:15:210
2780038220,0sleep00-21swapper/020:05:160
2775681220,1sleep00-21swapper/019:51:430
2770094220,1sleep00-21swapper/019:38:550
2768520220,1sleep22768546-21apt-get19:35:162
2893586210,0sleep10-21swapper/100:36:061
2893027210,0sleep00-21swapper/000:35:210
2892755210,0sleep20-21swapper/200:35:192
2890409210,0sleep00-21swapper/000:30:160
2890152210,0sleep20-21swapper/200:30:142
2890119210,0sleep10-21swapper/100:30:131
2889345210,0sleep10-21swapper/100:25:251
2888131210,0sleep00-21swapper/000:25:160
2887250210,0sleep10-21swapper/100:20:211
2885729210,0sleep20-21swapper/200:20:022
2884747210,0sleep00-21swapper/000:15:250
2883765210,0sleep20-21swapper/200:15:182
2881522210,0sleep20-21swapper/200:10:172
2881493210,0sleep12881519-21apt-get00:10:161
2880176210,0sleep00-21swapper/000:05:190
2877752210,0sleep10-21swapper/100:00:201
2877477210,0sleep00-21swapper/000:00:190
2877004210,0sleep10-21swapper/123:59:561
2876157210,0sleep00-21swapper/023:55:220
2873369210,0sleep00-21swapper/023:50:190
2873093210,0sleep10-21swapper/123:50:111
2871168210,0sleep20-21swapper/223:45:162
2870797210,1sleep00-21swapper/023:45:020
2870392210,1sleep22870394-21ssh23:41:512
2870365210,1sleep00-21swapper/023:41:370
2869011210,0sleep10-21swapper/123:40:141
2867434210,0sleep10-21swapper/123:35:191
2866558210,0sleep00-21swapper/023:35:010
2866029210,0sleep20-21swapper/223:30:232
2865690210,0sleep00-21swapper/023:30:210
2864722210,0sleep10-21swapper/123:30:141
2863248210,0sleep10-21swapper/123:25:171
2862630210,0sleep00-21swapper/023:25:120
2862618210,0sleep20-21swapper/223:25:062
2861031210,0sleep00-21swapper/023:20:160
2860035210,0sleep20-21swapper/223:17:582
2858429210,0sleep10-21swapper/123:15:131
2857079210,0sleep10-21swapper/123:10:201
2856868210,0sleep00-21swapper/023:10:200
2856124210,0sleep20-21swapper/223:10:012
2854002210,0sleep20-21swapper/223:05:012
2853630210,0sleep00-21swapper/023:01:470
2852782210,0sleep22852932-21ntp_states23:00:172
2852162210,0sleep10-21swapper/123:00:121
2851101210,0sleep20-21swapper/222:55:212
2850965210,0sleep10-21swapper/122:55:201
2850047210,0sleep00-21swapper/022:55:060
2848465210,0sleep20-21swapper/222:50:162
2848391210,0sleep10-21swapper/122:50:151
2848094210,0sleep00-21swapper/022:50:140
2847348210,0sleep20-21swapper/222:46:482
2846070210,0sleep10-21swapper/122:45:151
2845952210,0sleep00-21swapper/022:45:140
2845117210,0sleep00-21swapper/022:40:330
2844589210,0sleep10-21swapper/122:40:181
2844230210,0sleep20-21swapper/222:40:162
2841811210,0sleep20-21swapper/222:35:152
2841716210,0sleep10-21swapper/122:35:141
2841689210,0sleep00-21swapper/022:35:130
2839791210,0sleep20-21swapper/222:30:152
2839151210,0sleep10-21swapper/122:28:181
2838491210,0sleep20-21swapper/222:25:232
2836601210,0sleep10-21swapper/122:20:211
2835865210,0sleep00-21swapper/022:20:160
2835488210,0sleep20-21swapper/222:20:142
2835070210,1sleep20-21swapper/222:19:182
2833327210,0sleep00-21swapper/022:15:170
2832317210,0sleep00-21swapper/022:10:440
2830972210,0sleep10-21swapper/122:10:131
2830719210,0sleep20-21swapper/222:10:022
2830343210,0sleep00-21swapper/022:06:430
2829340210,0sleep20-21swapper/222:05:172
2828886210,0sleep10-21swapper/122:05:121
2828138210,0sleep10-21swapper/122:00:411
2827992210,0sleep20-21swapper/222:00:222
2826184210,0sleep10-21swapper/121:57:041
2824275210,0sleep20-21swapper/221:53:362
2824229210,0sleep00-21swapper/021:53:110
2819992210,0sleep10-21swapper/121:44:551
2818325210,0sleep20-21swapper/221:40:162
2818170210,0sleep00-21swapper/021:40:140
2815933210,0sleep20-21swapper/221:35:152
2815797210,1sleep10-21swapper/121:35:071
2815068210,1sleep00-21swapper/021:30:210
2814067210,0sleep20-21swapper/221:30:152
2813904210,0sleep10-21swapper/121:30:141
2813317210,0sleep00-21swapper/021:27:370
2813073210,0sleep20-21swapper/221:25:232
2810495210,0sleep20-21swapper/221:20:192
2809515210,0sleep10-21swapper/121:20:021
2809050210,0sleep20-21swapper/221:15:222
2808659210,0sleep00-21swapper/021:15:200
2807512210,0sleep10-21swapper/121:15:011
2806376210,0sleep20-21swapper/221:10:182
2806239210,0sleep10-21swapper/121:10:171
2806177210,0sleep00-21swapper/021:10:170
2804808210,0sleep00-21swapper/021:05:190
2803839210,0sleep10-21swapper/121:05:121
2803593210,0sleep20-21swapper/221:05:012
2803322210,0sleep10-21swapper/121:01:361
2802090210,0sleep20-21swapper/221:00:132
2801389210,0sleep20-21swapper/220:56:372
2800895210,0sleep00-21swapper/020:55:200
2799992210,0sleep10-21swapper/120:55:131
2798529210,0sleep10-21swapper/120:50:201
2798370210,0sleep00-21swapper/020:50:190
2798085210,0sleep20-21swapper/220:50:172
2796338210,0sleep00-21swapper/020:45:140
2794812210,0sleep10-21swapper/120:40:191
2794725210,0sleep00-21swapper/020:40:180
2792778210,0sleep00-21swapper/020:35:180
2792226210,0sleep10-21swapper/120:35:151
2791332210,0sleep20-21swapper/220:32:152
2790007210,0sleep10-21swapper/120:30:141
2789637210,0sleep00-21swapper/020:30:010
2789323210,1sleep00-21swapper/020:26:010
2788651210,0sleep20-21swapper/220:25:192
2787973210,0sleep10-21swapper/120:25:141
2787296210,0sleep10-21swapper/120:20:221
2786119210,0sleep20-21swapper/220:20:152
2783890210,0sleep20-21swapper/220:15:142
2783861210,0sleep10-21swapper/120:15:141
2781947210,0sleep10-21swapper/120:10:131
2780855210,0sleep20-21swapper/220:05:222
2780128210,0sleep10-21swapper/120:05:171
2778150210,0sleep20-21swapper/220:00:142
2778121210,0sleep10-21swapper/120:00:131
2777473210,0sleep10-21swapper/119:55:201
2776248210,0sleep20-21swapper/219:55:132
2774029210,0sleep20-21swapper/219:50:012
2772981210,0sleep20-21swapper/219:45:182
2772844210,0sleep10-21swapper/119:45:161
2772782210,0sleep00-21swapper/019:45:150
2770606210,0sleep00-21swapper/019:40:140
2770451210,0sleep20-21swapper/219:40:122
2767894210,0sleep20-21swapper/219:30:242
2767051210,0sleep10-21swapper/119:30:191
2766891210,0sleep00-21swapper/019:30:180
2764860210,0sleep00-21swapper/019:25:170
2761820210,0sleep00-21swapper/019:15:210
2760862210,0sleep20-21swapper/219:15:152
2758458210,0sleep20-21swapper/219:10:142
2758263210,0sleep10-21swapper/119:10:131
2758203210,0sleep00-21swapper/019:10:120
2879389200,0sleep10-21swapper/100:05:041
2875168200,0sleep20-21swapper/223:55:042
2873080200,0sleep20-21swapper/223:50:042
2870993200,0sleep10-21swapper/123:45:031
2858414200,0sleep00-21swapper/023:15:040
2839351200,0sleep10-21swapper/122:30:021
2820241200,0sleep10-21swapper/121:45:031
2809774200,0sleep00-21swapper/021:20:040
2796157200,0sleep10-21swapper/120:45:031
2793983200,0sleep20-21swapper/220:40:052
2778110200,0sleep00-21swapper/020:00:030
2776177200,0sleep00-21swapper/019:55:030
2774264200,0sleep10-21swapper/119:50:041
2768504200,0sleep10-21swapper/119:35:031
2764415200,0sleep20-21swapper/219:25:032
2762501200,0sleep20-21swapper/219:20:032
2762500200,0sleep10-21swapper/119:20:031
2762246200,0sleep00-21swapper/019:20:020
2760564200,0sleep10-21swapper/119:15:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional