You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-20 - 18:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackcslot4s.osadl.org (updated Sat Apr 20, 2024 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2888399282,22cyclictest13368-21munin-run09:39:593
28874992618,6cyclictest952-21munin-run12:20:001
28870992616,5cyclictest10760-21latency_hist07:55:010
2888399254,18cyclictest5603-21update-cracklib07:35:003
28883992517,4cyclictest14480-21lsb_release08:05:003
28883992515,8cyclictest21499-21lsb_release10:05:003
2888399251,19cyclictest6452-21python309:20:013
28883992417,4cyclictest3468-21python307:30:003
28883992416,4cyclictest1789-21sh07:25:003
2888399241,19cyclictest27461-21lsb_release08:45:003
2888399234,14cyclictest4884-40apt-check12:30:093
2888399233,17cyclictest24732-21awk10:15:003
28883992315,5cyclictest4383-21wc12:30:003
28874992312,7cyclictest18791-21date11:35:001
28870992312,7cyclictest4407-21dpkg12:30:000
2888399222,14cyclictest27097-21apt-get12:00:213
28883992214,5cyclictest17716-21dpkg08:15:013
2888399221,3cyclictest20972-21lsb_release08:25:003
2888399221,18cyclictest29599-21munin-run10:30:013
28883992210,6cyclictest0-21swapper/310:55:153
28883992210,10cyclictest30151-21unixbench-2d07:10:253
2888399220,5cyclictest24213-21lsb_release08:35:003
28870992215,5cyclictest24072-21tune2fs11:50:160
28870992214,6cyclictest25735-21awk08:35:270
28870992214,6cyclictest11443-21cat09:30:280
28870992211,8cyclictest27432-21cron08:45:000
28883992115,3cyclictest2592-40apt-check10:45:053
2888399211,4cyclictest26319-21cron10:20:013
28883992114,4cyclictest25254-21idleruntime-cro11:55:003
28883992113,6cyclictest1231-21sed10:40:173
28883992113,5cyclictest15524-21perf11:25:003
28883992113,4cyclictest25378-21mailstats08:35:203
28883992112,4cyclictest10792-21python307:55:003
28883992111,9cyclictest0-21swapper/309:04:553
28883992111,9cyclictest0-21swapper/309:04:553
2888399211,18cyclictest27991-21awk10:25:013
2887999213,15cyclictest16719-21head08:10:152
28879992114,5cyclictest21151-21sed10:00:262
28879992113,6cyclictest3591-21ntpq12:25:222
28879992113,6cyclictest1570-21grep07:20:302
28879992112,7cyclictest29438-21cat07:10:162
28879992112,6cyclictest30044-21ntpq08:50:202
2887499212,16cyclictest21020-21grep11:40:161
28874992113,6cyclictest39-21kauditd11:24:591
28874992113,6cyclictest13088-21memory11:15:201
28874992112,7cyclictest31703-21awk08:55:241
28874992112,6cyclictest18088-21expr08:15:121
28870992115,3cyclictest12372-21sed09:35:150
2888399202,16cyclictest4780-21latency_hist09:15:013
2888399202,12cyclictest1771-21apt-get09:05:103
2888399201,3cyclictest404-21lsb_release10:39:593
28883992013,5cyclictest16323-21sed11:25:183
28883992013,5cyclictest15270-21sed08:05:173
28883992013,4cyclictest959-21perf12:20:003
28883992012,5cyclictest6815-21apt-key09:20:043
28883992011,6cyclictest17832-21snmp_o5powerctl09:50:283
2888399201,15cyclictest18737-21cron11:34:593
2888399201,13cyclictest20614-21apt-get11:40:113
2888399200,3cyclictest2620-21lsb_release12:25:003
2888399200,2cyclictest12201-21ntp_states07:55:153
2887999202,12cyclictest15215-21apt-get09:45:132
28879992016,2cyclictest7908-21sendmail12:40:012
28879992016,2cyclictest7908-21sendmail12:40:002
28879992014,4cyclictest8121-21cat11:00:212
28879992013,5cyclictest32137-21grep07:15:242
28879992013,5cyclictest32137-21grep07:15:232
28879992013,5cyclictest1942-21ntpq12:20:192
28879992013,5cyclictest18927-21snmp_o5powerctl08:15:242
2887999201,13cyclictest18975-21apt-get11:35:122
28874992015,3cyclictest21471-21sh10:05:001
28874992013,5cyclictest29189-21sensors_temp10:25:221
28874992013,5cyclictest2549-21ntpq09:05:191
28874992013,5cyclictest21454-21kworker/u8:210:15:001
28874992013,5cyclictest21020-21cut08:25:001
28874992013,5cyclictest13507-21ls08:00:181
28874992013,5cyclictest1299-21expr12:20:121
2887499201,13cyclictest4972-21sort12:30:111
2887099202,16cyclictest14997-21turbostat09:45:000
2887099202,12cyclictest9251-21apt-get11:05:110
2887099202,12cyclictest2022-21apt-get07:25:130
28870992014,4cyclictest20369-21idleruntime-cro11:40:000
28870992013,5cyclictest5957-21tr09:15:240
28870992013,5cyclictest31692-21awk08:55:240
28870992013,5cyclictest29111-21expr07:10:120
28870992013,5cyclictest28660-21sensors_temp08:45:220
28870992013,5cyclictest27818-21nfs4_client12:00:270
28870992013,5cyclictest22335-21sed08:25:300
28870992013,4cyclictest30674-21sh08:55:000
28870992012,6cyclictest32083-21ls12:15:130
2887099201,14cyclictest3930-40apt-check07:30:060
2887099201,14cyclictest29816-21apt-get10:30:150
28883991914,3cyclictest8242-21missed_timers11:00:233
28883991913,3cyclictest20372-21latency_hist11:40:003
28883991912,5cyclictest32059-21cat08:55:293
28883991912,5cyclictest29891-21timerwakeupswit12:05:313
28883991912,5cyclictest26079-21sed11:55:193
28883991912,5cyclictest22185-21swap08:25:293
28883991912,5cyclictest13973-21sed09:40:163
28883991912,5cyclictest12950-21awk11:15:183
2888399191,16cyclictest10784-21cat11:10:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional