You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-10 - 06:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Mon Nov 10, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
267701799140,12cyclictest0-21swapper/323:30:143
2677017991310,1cyclictest0-21swapper/320:45:123
267701799130,1cyclictest0-21swapper/322:40:153
267701799130,11cyclictest0-21swapper/321:30:173
267701799120,9cyclictest0-21swapper/323:25:123
267701799120,11cyclictest69450irq/121-eno120:24:563
267701799120,11cyclictest0-21swapper/323:55:013
267701799120,11cyclictest0-21swapper/323:15:123
267701799120,11cyclictest0-21swapper/323:15:003
267701799120,11cyclictest0-21swapper/321:00:003
267701799120,11cyclictest0-21swapper/320:10:213
267701799119,1cyclictest69450irq/121-eno100:25:193
267701799119,1cyclictest69450irq/121-eno100:25:183
2677017991111,0cyclictest0-21swapper/319:25:003
2677017991110,0cyclictest0-21swapper/319:50:123
267701799110,10cyclictest69450irq/121-eno122:10:213
267701799110,10cyclictest69450irq/121-eno122:00:143
267701799110,10cyclictest69450irq/121-eno121:55:153
267701799110,10cyclictest69450irq/121-eno121:19:103
267701799110,10cyclictest69450irq/121-eno120:50:153
267701799110,10cyclictest0-21swapper/322:05:143
267701799110,10cyclictest0-21swapper/319:40:203
267701799110,10cyclictest0-21swapper/319:30:213
267701799110,10cyclictest0-21swapper/319:25:423
267701799110,0cyclictest0-21swapper/321:00:123
2677017991010,0cyclictest69450irq/121-eno121:44:413
2677017991010,0cyclictest69450irq/121-eno121:25:213
2677017991010,0cyclictest69450irq/121-eno120:15:173
2677017991010,0cyclictest0-21swapper/323:05:183
2677017991010,0cyclictest0-21swapper/321:50:003
2677017991010,0cyclictest0-21swapper/321:45:203
2677017991010,0cyclictest0-21swapper/320:40:143
2677017991010,0cyclictest0-21swapper/319:15:013
267701799100,9cyclictest69450irq/121-eno120:35:203
267701799100,9cyclictest69450irq/121-eno100:08:533
267701799100,0cyclictest0-21swapper/323:56:233
267701799100,0cyclictest0-21swapper/322:20:203
26770179999,0cyclictest69450irq/121-eno122:47:403
26770179999,0cyclictest69450irq/121-eno121:05:173
26770179999,0cyclictest0-21swapper/323:40:203
26770179999,0cyclictest0-21swapper/321:40:003
26770179999,0cyclictest0-21swapper/321:12:593
26770179999,0cyclictest0-21swapper/320:05:143
26770179999,0cyclictest0-21swapper/300:10:173
26770179998,0cyclictest69450irq/121-eno123:00:443
26770179998,0cyclictest0-21swapper/300:00:183
26770179990,8cyclictest69450irq/121-eno123:20:183
26770179990,8cyclictest0-21swapper/323:45:203
26770179990,8cyclictest0-21swapper/322:25:143
26770179990,0cyclictest0-21swapper/319:35:163
26770179988,0cyclictest69450irq/121-eno122:35:143
26770179988,0cyclictest69450irq/121-eno122:19:203
26770179988,0cyclictest69450irq/121-eno121:21:423
26770179988,0cyclictest69450irq/121-eno120:31:463
26770179988,0cyclictest69450irq/121-eno120:00:193
26770179988,0cyclictest69450irq/121-eno119:10:163
26770179988,0cyclictest69450irq/121-eno100:15:203
26770179988,0cyclictest0-21swapper/300:35:143
26770179980,7cyclictest0-21swapper/322:50:213
26770179980,0cyclictest0-21swapper/322:58:423
26770179977,0cyclictest69450irq/121-eno123:35:023
26770179977,0cyclictest69450irq/121-eno119:45:153
26770179977,0cyclictest69450irq/121-eno119:45:143
26770179977,0cyclictest69450irq/121-eno100:24:553
26770179977,0cyclictest0-21swapper/300:30:173
26770179976,0cyclictest0-21swapper/322:30:133
26770179970,7cyclictest0-21swapper/320:25:203
26770179961,4cyclictest69450irq/121-eno119:55:503
2676858261,2sleep30-21swapper/319:09:553
2675204251,2sleep20-21swapper/219:05:142
2677324240,3sleep02677597-21/usr/sbin/munin19:10:160
2676095241,1sleep10-21swapper/119:05:211
2795328230,2sleep12723696-21diskmemload23:59:431
2742496230,1sleep22742522-21apt-get21:55:122
2704493230,2sleep02704566-21sed20:20:020
2675971231,1sleep00-21swapper/019:05:200
2803880220,0sleep00-21swapper/000:18:530
2800528220,1sleep02800610-21irqstats00:10:190
2797486220,1sleep21-21systemd00:05:022
2791424220,1sleep02791428-21ssh23:50:070
2788924220,0sleep00-21swapper/023:43:290
2785337220,1sleep22785583-21diskstats23:35:162
2783810220,1sleep22783919-21ps23:30:202
2780312220,0sleep00-21swapper/023:21:290
2774840220,1sleep02775111-21/usr/sbin/munin23:10:160
2774686220,1sleep22774712-21apt-get23:10:132
2767881220,1sleep22767899-21munin-run22:55:012
2761206220,1sleep00-21swapper/022:36:370
2753367220,1sleep12753655-21df22:20:131
2753266220,1sleep02753366-21cut22:20:120
2746431220,1sleep12746465-21munin-run22:05:011
2745486220,1sleep02745598-21sed22:00:200
2741905220,1sleep00-21swapper/021:52:030
2739896221,0sleep20-21swapper/221:50:002
2737804220,0sleep00-21swapper/021:44:540
2734718220,1sleep10-21swapper/121:35:191
2734098220,1sleep02734366-21df21:35:140
2732722220,1sleep12732870-21grep21:30:231
2732567220,1sleep02732721-21ntp_states21:30:210
2714966220,1sleep22715120-21ntp_states20:45:162
2702571220,1sleep00-21swapper/020:14:560
2684715220,0sleep00-21swapper/019:25:420
2682055220,1sleep22682222-21ntpq19:20:152
2681741220,0sleep00-21swapper/019:20:130
2678833220,1sleep0241rcuc/019:15:020
2812025210,0sleep00-21swapper/000:36:540
2811855210,0sleep20-21swapper/200:35:242
2810297210,0sleep10-21swapper/100:35:031
2810176210,0sleep00-21swapper/000:34:010
2808593210,0sleep20-21swapper/200:30:182
2808496210,0sleep10-21swapper/100:30:171
2807821210,1sleep00-21swapper/000:26:370
2807821210,1sleep00-21swapper/000:26:360
2806820210,0sleep20-21swapper/200:25:192
2806820210,0sleep20-21swapper/200:25:192
2806614210,0sleep10-21swapper/100:25:181
2806614210,0sleep10-21swapper/100:25:181
2805083210,0sleep10-21swapper/100:20:211
2804975210,0sleep00-21swapper/000:20:200
2804723210,0sleep20-21swapper/200:20:182
2803813210,0sleep20-21swapper/200:18:192
2802177210,0sleep10-21swapper/100:15:131
2801870210,0sleep10-21swapper/100:14:361
2800811210,0sleep20-21swapper/200:10:222
2798827210,0sleep20-21swapper/200:05:212
2798618210,0sleep00-21swapper/000:05:200
2796458210,0sleep10-21swapper/100:00:241
2795718210,0sleep00-21swapper/000:00:190
2795018210,0sleep20-21swapper/223:57:002
2793786210,0sleep00-21swapper/023:55:140
2791443210,0sleep10-21swapper/123:50:161
2790850210,0sleep20-21swapper/223:47:052
2790325210,0sleep00-21swapper/023:45:210
2789867210,0sleep10-21swapper/123:45:191
2789045210,0sleep20-21swapper/223:44:352
2787884210,0sleep10-21swapper/123:40:181
2786607210,0sleep10-21swapper/123:36:431
2785153210,0sleep00-21swapper/023:35:140
2784687210,0sleep00-21swapper/023:33:090
2783617210,0sleep10-21swapper/123:30:181
2782387210,0sleep00-21swapper/023:26:210
2781504210,0sleep10-21swapper/123:25:171
2780444210,0sleep10-21swapper/123:22:381
2779616210,0sleep20-21swapper/223:20:192
2776960210,0sleep20-21swapper/223:15:142
2776864210,0sleep10-21swapper/123:15:131
2776775210,0sleep00-21swapper/023:15:120
2776320210,0sleep10-21swapper/123:13:171
2773891210,0sleep00-21swapper/023:07:360
2772860210,0sleep20-21swapper/223:05:222
2772773210,0sleep10-21swapper/123:05:211
2771811210,0sleep10-21swapper/123:02:401
2771220210,0sleep20-21swapper/223:00:212
2770994210,0sleep00-21swapper/023:00:190
2768134210,0sleep10-21swapper/122:55:121
2768115210,1sleep02768117-21ssh22:55:030
2767731210,0sleep00-21swapper/022:53:420
2767716210,0sleep10-21swapper/122:53:361
2764736210,0sleep10-21swapper/122:45:191
2764578210,0sleep00-21swapper/022:45:190
2764378210,0sleep20-21swapper/222:45:162
2762556210,0sleep20-21swapper/222:40:202
2762305210,0sleep00-21swapper/022:40:180
2761852210,0sleep10-21swapper/122:40:031
2760533210,0sleep20-21swapper/222:35:192
2760412210,0sleep10-21swapper/122:35:181
2759029210,0sleep20-21swapper/222:30:512
2757675210,0sleep10-21swapper/122:30:151
2757672210,0sleep00-21swapper/022:30:140
2756306210,0sleep20-21swapper/222:25:192
2755590210,0sleep10-21swapper/122:25:141
2755072210,0sleep00-21swapper/022:25:010
2754434210,0sleep20-21swapper/222:20:222
2752614210,0sleep10-21swapper/122:17:021
2751409210,0sleep20-21swapper/222:15:152
2751149210,0sleep00-21swapper/022:15:130
2750362210,0sleep20-21swapper/222:10:342
2749516210,0sleep00-21swapper/022:10:150
2748520210,0sleep10-21swapper/122:10:001
2748464210,1sleep00-21swapper/022:09:320
2748185210,0sleep20-21swapper/222:07:052
2746848210,0sleep10-21swapper/122:05:161
2745212210,0sleep20-21swapper/222:00:182
2743279210,0sleep00-21swapper/021:55:180
2742918210,0sleep10-21swapper/121:55:151
2740700210,0sleep10-21swapper/121:50:161
2738227210,0sleep10-21swapper/121:45:161
2738129210,0sleep00-21swapper/021:45:150
2738068210,0sleep20-21swapper/221:45:132
2737337210,0sleep10-21swapper/121:40:471
2736220210,0sleep20-21swapper/221:40:152
2733944210,0sleep20-21swapper/221:35:122
2733370210,0sleep20-21swapper/221:31:442
2730588210,0sleep20-21swapper/221:25:192
2730360210,0sleep00-21swapper/021:25:180
2727921210,1sleep00-21swapper/021:20:050
2727448210,0sleep10-21swapper/121:17:411
2725919210,0sleep00-21swapper/021:15:120
2724037210,0sleep10-21swapper/121:10:181
2723946210,1sleep00-21swapper/021:10:170
2722701210,0sleep20-21swapper/221:05:182
2722447210,0sleep00-21swapper/021:05:160
2722022210,0sleep10-21swapper/121:05:131
2720118210,0sleep20-21swapper/221:00:132
2719839210,0sleep10-21swapper/121:00:001
2718955210,0sleep10-21swapper/120:55:211
2718855210,0sleep00-21swapper/020:55:200
2717365210,0sleep20-21swapper/220:50:212
2716694210,0sleep12716778-21irqstats20:50:151
2716446210,0sleep00-21swapper/020:50:140
2714342210,1sleep00-21swapper/020:45:070
2713848210,0sleep10-21swapper/120:41:481
2712803210,0sleep20-21swapper/220:40:172
2712438210,0sleep00-21swapper/020:40:150
2710565210,0sleep20-21swapper/220:35:152
2710506210,0sleep10-21swapper/120:35:141
2710258210,0sleep00-21swapper/020:35:010
2709037210,0sleep20-21swapper/220:30:202
2708909210,0sleep10-21swapper/120:30:191
2708684210,0sleep00-21swapper/020:30:180
2706942210,0sleep00-21swapper/020:25:170
2705554210,0sleep10-21swapper/120:20:181
2704790210,0sleep00-21swapper/020:20:130
2703109210,0sleep20-21swapper/220:15:152
2702579210,0sleep10-21swapper/120:15:021
2701365210,0sleep20-21swapper/220:10:182
2699963210,0sleep10-21swapper/120:05:221
2699002210,0sleep22699028-21apt-get20:05:142
2698126210,0sleep20-21swapper/220:00:222
2697192210,0sleep00-21swapper/020:00:160
2696502210,0sleep00-21swapper/019:55:590
2695337210,0sleep20-21swapper/219:55:132
2694596210,0sleep20-21swapper/219:51:062
2693757210,0sleep10-21swapper/119:50:171
2692214210,0sleep10-21swapper/119:45:201
2692214210,0sleep10-21swapper/119:45:191
2692086210,0sleep00-21swapper/019:45:180
2692086210,0sleep00-21swapper/019:45:180
2691774210,0sleep20-21swapper/219:45:172
2691774210,0sleep20-21swapper/219:45:162
2689591210,0sleep20-21swapper/219:40:172
2689341210,0sleep10-21swapper/119:40:161
2687841210,0sleep20-21swapper/219:35:212
2687642210,0sleep00-21swapper/019:35:180
2687223210,0sleep10-21swapper/119:35:151
2686704210,0sleep00-21swapper/019:31:390
2685490210,0sleep10-21swapper/119:30:151
2684253210,0sleep20-21swapper/219:25:202
2683482210,0sleep10-21swapper/119:25:151
2680337210,0sleep20-21swapper/219:15:202
2679486210,0sleep10-21swapper/119:15:031
2678650210,0sleep10-21swapper/119:12:421
2677169210,0sleep20-21swapper/219:10:152
2797984200,0sleep10-21swapper/100:05:051
2791421200,0sleep20-21swapper/223:50:052
2780950200,0sleep20-21swapper/223:25:022
2768121200,0sleep20-21swapper/222:55:052
2729919200,0sleep10-21swapper/121:25:021
2727918200,0sleep20-21swapper/221:20:032
2727917200,0sleep10-21swapper/121:20:021
2725905200,0sleep20-21swapper/221:15:032
2723923200,0sleep20-21swapper/221:10:022
2720097200,0sleep00-21swapper/021:00:030
2717961200,0sleep20-21swapper/220:55:022
2714338200,0sleep10-21swapper/120:45:031
2706663200,0sleep20-21swapper/220:25:042
2706662200,0sleep10-21swapper/120:25:031
2704749200,0sleep20-21swapper/220:20:032
2700666200,0sleep10-21swapper/120:10:011
2698990200,0sleep00-21swapper/020:05:050
2697077200,0sleep10-21swapper/120:00:051
2695143200,0sleep10-21swapper/119:55:041
2693229200,0sleep00-21swapper/019:50:040
2689142200,0sleep00-21swapper/019:40:030
2685293200,0sleep20-21swapper/219:30:032
2681466200,0sleep10-21swapper/119:20:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional