You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-07 - 20:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Characteristics of the 100 highest latencies:
System rackcslot4s.osadl.org (updated Wed Jul 26, 2023 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2072199361,1cyclictest0-21swapper/308:20:063
2072199330,7cyclictest5192-21apt-key12:35:013
20721993113,1cyclictest0-21swapper/310:08:363
20721993112,4cyclictest8061-21grep09:35:353
20721993110,5cyclictest29546-21grep10:35:303
2072199302,7cyclictest2999-21python310:55:013
2072199302,7cyclictest2999-21python310:55:013
2072199300,28cyclictest12152-21cat11:20:013
2072199293,6cyclictest31941-40apt-check07:40:063
2072199288,5cyclictest19580-21sed11:40:273
2072199282,5cyclictest25394-21munin-run08:55:013
2072199281,11cyclictest30118-21snmp_o5powerctl09:05:313
2072199281,10cyclictest24426-21date10:25:023
20721992810,4cyclictest9114-21sed09:40:243
2072199279,3cyclictest27887-21lsb_release07:30:003
2072199277,5cyclictest25649-21ls12:00:003
2072199272,3cyclictest6836-21munin-run11:05:003
2072199272,3cyclictest6836-21munin-run11:05:003
20721992711,3cyclictest22789-21lsb_release07:15:003
20721992711,2cyclictest28620-21if_enp2s007:30:223
2072199271,12cyclictest21523-21head11:45:293
2072199268,5cyclictest31-21ksoftirqd/309:30:193
2072199268,5cyclictest25419-21sed10:25:223
2072199266,5cyclictest31208-21expr12:15:223
20721992610,5cyclictest7300-21ntpq08:00:283
2072199260,5cyclictest13225-21latency_hist08:20:003
2072199260,11cyclictest20964-21gltestperf08:40:233
2072199259,2cyclictest25136-21hwlatdetect07:20:223
2072199259,2cyclictest25136-21hwlatdetect07:20:223
2072199258,5cyclictest18191-21expr11:35:363
2072199258,4cyclictest6503-21cat12:35:303
2072199258,15cyclictest0-21swapper/308:35:003
2072199251,9cyclictest299-21systemd-journal09:29:593
2072199250,1cyclictest2999-21python310:55:003
2072199243,5cyclictest29153-21apt-get12:10:213
2072199241,9cyclictest32233-21lsb_release09:15:003
2072199241,20cyclictest31244-21/usr/sbin/munin10:40:263
2072199241,12cyclictest8750-21apt-get11:10:213
20721992411,2cyclictest29937-21/usr/sbin/munin07:35:343
2072199241,11cyclictest32551-21apt-get12:20:183
2072199240,12cyclictest31-21ksoftirqd/308:35:223
20718992412,8cyclictest31683-21dpkg07:40:011
2072199231,10cyclictest16800-21munin-run10:05:003
20718992315,6cyclictest30120-21snmp_o5powerctl09:05:311
20717992316,4cyclictest29661-21file07:35:000
20717992315,6cyclictest15016-21users09:55:350
20717992314,7cyclictest19024-21df08:35:240
20717992314,6cyclictest3304-21ubuntu-distro-i10:55:010
20717992314,6cyclictest26625-21tune2fs07:25:200
2071799230,20cyclictest3173-21/usr/sbin/munin09:20:400
2072199228,4cyclictest22269-21/usr/sbin/munin08:45:243
20721992212,7cyclictest2909-21snmp_o5powerctl12:25:333
20719992214,6cyclictest1217-21sed09:15:322
20719992213,6cyclictest31880-21snmp_o5powerctl12:15:332
20718992215,4cyclictest1176-21dump-pmu-power07:45:001
20718992214,6cyclictest5743-21sed09:30:211
20718992214,6cyclictest14677-21ntpq11:25:291
20718992213,7cyclictest22195-21sed11:50:001
20717992217,3cyclictest29022-21fschecks_time10:35:230
20717992214,6cyclictest7164-21memory08:00:260
20717992214,6cyclictest17722-21cat11:35:270
20721992113,5cyclictest26655-21apt-key10:30:003
2072199210,3cyclictest3244-21perf09:24:593
20719992115,3cyclictest17009-21turbostat11:35:002
20719992113,6cyclictest4329-21awk09:25:292
2071899212,13cyclictest5722-21apt-get12:35:221
2071899212,12cyclictest6521-21apt-get08:00:201
20718992114,5cyclictest11562-21sed08:15:001
20718992114,5cyclictest1114-21sed09:15:331
20718992113,6cyclictest29378-21wc10:35:281
20718992113,6cyclictest1339-21sed12:20:351
2071899211,16cyclictest24147-21python310:25:001
20717992114,5cyclictest25620-21awk10:25:260
20717992114,5cyclictest23895-21sed08:50:010
20717992114,5cyclictest11224-21unixbench_singl08:10:330
20717992113,6cyclictest9866-21cat11:10:370
20717992113,6cyclictest29950-21awk09:05:280
20717992113,6cyclictest21291-21memory11:45:260
20717992110,7cyclictest11927-21apt-get09:50:180
2072199209,7cyclictest24517-21cut07:20:003
2072199202,16cyclictest27181-21awk12:05:003
20721992013,5cyclictest12775-21sed11:20:263
20721992013,5cyclictest11205-21grep09:45:313
20719992015,3cyclictest11527-21switchtime11:15:372
20719992013,5cyclictest26603-21awk07:25:212
20719992013,5cyclictest23270-21cut07:15:192
20719992013,5cyclictest19970-21sed08:35:352
20719992013,5cyclictest1428-21grep12:20:362
20719992013,5cyclictest13246-21grep09:50:332
20719992013,5cyclictest1041-21awk07:40:332
20719992012,6cyclictest27171-21diskstats10:30:192
20719992012,6cyclictest21586-21tune2fs07:10:182
20719992012,5cyclictest1716-21nmbd11:40:192
20719992011,6cyclictest5595-21ntpq07:55:272
20719992011,6cyclictest30561-21basename09:10:012
20718992013,5cyclictest17808-21sed11:35:321
20718992012,5cyclictest20024-21nfs4_client10:10:261
2071899201,13cyclictest25730-21apt-get12:00:211
2071899201,13cyclictest1496-21apt-get10:50:201
2071899201,13cyclictest1496-21apt-get10:50:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional