You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-05-12 - 14:25

Intel(R) Atom(TM) CPU N455 @ 1.66GHz, Linux 5.4.34-rt21 (Profile)

Latency plot of system in rack #3, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6 (updated Mon May 03, 2021 12:45:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2121821030,17sleep121-21ksoftirqd/108:25:301
26552991007,17cyclictest28437-21apt-get11:55:180
2655299956,25cyclictest7990-21apt-get12:30:130
2655299948,74cyclictest29196-21apt-get08:50:140
2655299948,24cyclictest9366-21apt-get11:00:140
2655299947,23cyclictest7644-21apt-get10:55:130
2655299947,22cyclictest5280-21apt-get07:40:130
2655299940,18cyclictest964-21snmpd09:40:180
2655299938,22cyclictest26457-21apt-get11:50:130
2655299937,24cyclictest14473-21apt-get11:15:150
26552999223,57cyclictest0-21swapper/010:00:110
2655299919,70cyclictest26375-21apt-get10:15:150
2655299917,25cyclictest17220-21apt-get08:15:110
26552999110,71cyclictest10725-21apt-get09:30:160
2655299910,14cyclictest10688-21chrt12:35:540
2655299907,24cyclictest3450-21apt-get07:35:120
2655299906,24cyclictest32628-21apt-get09:00:140
26552999017,62cyclictest0-21swapper/007:20:120
2655299898,21cyclictest28107-21apt-get10:20:130
2655299897,73cyclictest5940-21apt-get10:50:130
2655299897,24cyclictest4236-21apt-get10:45:120
26552998914,62cyclictest0-21swapper/008:20:130
26552998911,62cyclictest0-21swapper/009:50:240
2655299890,13cyclictest23341-21unixbench-2d08:30:380
2655299888,68cyclictest31525-21apt-get10:30:170
2655299888,65cyclictest19613-21apt-get11:30:160
2655299887,71cyclictest19538-21apt-get09:55:140
2655299887,66cyclictest24063-21apt-get08:35:160
2655299887,20cyclictest13814-21apt-get08:05:150
2655299886,21cyclictest1137-21apt-get12:10:120
26552998815,56cyclictest0-21swapper/010:10:150
2655299880,11cyclictest0-21swapper/012:15:300
2613728822,30sleep00-21swapper/007:07:590
2655299877,26cyclictest9026-21apt-get09:25:190
2655299877,24cyclictest12116-21apt-get08:00:170
2655299877,22cyclictest16200-21apt-get11:20:160
2655299877,22cyclictest16200-21apt-get11:20:160
2655299877,22cyclictest12433-21apt-get09:35:140
2655299877,19cyclictest20651-21apt-get08:25:160
2655299876,25cyclictest30159-21apt-get12:00:140
26552998715,61cyclictest0-21swapper/009:15:270
26552998712,63cyclictest0-21swapper/009:45:150
2655299868,21cyclictest10392-21apt-get07:55:190
2655299867,20cyclictest11067-21apt-get11:05:130
2655299866,24cyclictest23044-21apt-get11:40:170
2655299866,23cyclictest27496-21apt-get08:45:150
2655299860,16cyclictest3622-21users10:40:430
2655299860,15cyclictest7310-21/usr/sbin/munin07:45:230
2655299860,13cyclictest32473-21apt-get07:25:150
2655299860,12cyclictest520-21vmstat12:05:430
2655299857,22cyclictest22958-21apt-get10:05:130
2655299857,21cyclictest8682-21apt-get07:50:150
2655299857,21cyclictest8682-21apt-get07:50:140
2655299857,21cyclictest1746-21apt-get07:30:150
2655299857,21cyclictest1746-21apt-get07:30:140
2655299856,25cyclictest1897-21apt-get09:05:120
2655299856,18cyclictest29811-21apt-get10:25:170
26552998523,51cyclictest964-21snmpd07:15:280
26552998515,55cyclictest0-21swapper/012:20:130
2655299850,12cyclictest4620-21sed09:10:390
2655299850,12cyclictest4620-21sed09:10:390
2655299850,11cyclictest0-21swapper/011:10:380
2655299847,22cyclictest766-21apt-get10:35:170
2655299847,20cyclictest25789-21apt-get08:40:150
2655299846,20cyclictest30907-21apt-get08:55:150
2655299846,19cyclictest7318-21apt-get09:20:150
2655299840,15cyclictest6284-21apt-get12:25:150
2655299840,12cyclictest26342-21apt-get07:10:100
2655299833,70cyclictest22125-21runrttasks11:35:400
2655299830,11cyclictest15700-21df_inode08:10:190
2655299826,20cyclictest17909-21apt-get11:25:170
2655299826,19cyclictest24746-21apt-get11:45:160
2516227731,33sleep10-21swapper/107:05:201
26559997212,42cyclictest0-21swapper/111:15:121
2655999657,12cyclictest0-21swapper/111:10:131
228892650,6sleep122877-21missed_timers08:30:281
26559996435,14cyclictest26457-21apt-get11:50:141
26559996428,24cyclictest30762-21apt-get07:20:121
276312630,5sleep10-21swapper/108:45:191
26559996310,11cyclictest0-21swapper/109:55:161
2655999628,12cyclictest0-21swapper/108:00:171
26559996233,19cyclictest1746-21apt-get07:30:161
26559996233,19cyclictest1746-21apt-get07:30:161
26559996228,17cyclictest15861-21apt-get09:45:141
2655999617,12cyclictest0-21swapper/110:35:161
2655999617,11cyclictest0-21swapper/108:15:131
26559996133,16cyclictest10725-21apt-get09:30:171
2655999608,37cyclictest0-21swapper/108:40:161
26559996028,18cyclictest18947-21apt-get08:20:121
26559996010,21cyclictest0-21swapper/110:51:501
26559995931,14cyclictest5588-21apt-get09:15:281
26559995927,19cyclictest24670-21apt-get10:10:141
26559995924,29cyclictest0-21swapper/112:35:341
26559995831,15cyclictest29196-21apt-get08:50:141
26559995831,13cyclictest31525-21apt-get10:30:161
26559995828,20cyclictest17827-21apt-get09:50:241
26559995827,22cyclictest4581-21apt-get12:20:121
26559995818,33cyclictest1169-21sshd07:25:541
2655999578,36cyclictest0-21swapper/111:00:151
2655999577,14cyclictest0-21swapper/112:10:121
2655999577,12cyclictest0-21swapper/109:05:151
26559995727,17cyclictest21-21ksoftirqd/112:25:141
26559995727,16cyclictest21253-21apt-get10:00:101
26559995725,25cyclictest0-21swapper/110:25:161
26559995722,21cyclictest21-21ksoftirqd/108:55:151
26559995716,27cyclictest29035-21runrttasks07:15:111
42462560,12sleep12655999cyclictest10:45:171
2655999567,11cyclictest0-21swapper/107:50:151
2655999567,11cyclictest0-21swapper/107:50:151
2655999563,33cyclictest28913-21swap10:20:381
26559995630,15cyclictest26380-21seq10:15:151
26559995616,16cyclictest6811-21munin-run07:45:011
2655999556,11cyclictest0-21swapper/107:55:171
26559995534,15cyclictest20904-21runrttasks11:32:381
26559995526,19cyclictest7318-21apt-get09:20:121
26559995526,13cyclictest22958-21apt-get10:05:121
26559995523,25cyclictest0-21swapper/111:45:141
26559995523,24cyclictest0-21swapper/109:40:141
26559995521,26cyclictest0-21swapper/107:45:141
2655999547,11cyclictest0-21swapper/112:30:141
2655999543,15cyclictest111rcu_preempt11:20:141
2655999543,15cyclictest111rcu_preempt11:20:141
26559995427,18cyclictest11067-21apt-get11:05:121
26559995423,24cyclictest0-21swapper/109:25:201
26559995422,23cyclictest0-21swapper/112:00:141
26559995419,30cyclictest0-21swapper/112:09:441
26559995325,22cyclictest0-21swapper/110:55:141
26559995324,21cyclictest0-21swapper/111:55:171
26559995322,24cyclictest0-21swapper/109:35:141
26559995320,25cyclictest0-21swapper/110:40:161
2655999527,11cyclictest0-21swapper/108:35:141
26559995222,22cyclictest0-21swapper/109:10:131
26559995222,22cyclictest0-21swapper/109:10:131
26559995221,25cyclictest0-21swapper/111:35:161
26559995221,24cyclictest0-21swapper/112:15:141
26559995219,27cyclictest0-21swapper/107:10:231
26559995131,13cyclictest18998-21sed11:25:441
26559995029,12cyclictest0-21swapper/109:00:121
26559994817,18cyclictest21-21ksoftirqd/108:14:181
26559994725,15cyclictest24572-21cron11:45:001
26559994725,15cyclictest13810-21/usr/sbin/munin08:05:381
26559994529,11cyclictest0-21swapper/107:35:161
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:233
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
none18:00:232
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional