You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-12-09 - 18:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3s.osadl.org (updated Mon Dec 09, 2024 12:45:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2536626997570,3cyclictest0-21swapper/008:00:020
2536640997425,7cyclictest2550725-21latency_hist11:40:013
2536626997470,2cyclictest0-21swapper/012:25:020
253662699741,69cyclictest0-21swapper/009:05:020
2536631997344,20cyclictest221rcuc/110:05:021
2536640996916,17cyclictest272-21dbus-daemon10:50:013
2536636996917,18cyclictest2551198-21cat11:50:012
253662699691,6cyclictest0-21swapper/012:35:010
2536640996825,16cyclictest272-21dbus-daemon10:45:013
2536636996726,14cyclictest2537837-21sshd07:30:402
2536636996726,14cyclictest2537837-21sshd07:30:402
2536636996720,14cyclictest2538322-21sed07:40:022
2536636996718,14cyclictest2551570-21latency_hist11:55:022
2536636996618,16cyclictest2539606-21sed08:05:022
2536636996616,18cyclictest2546049-21cat10:10:022
2536626996524,36cyclictest2552412-21latency_hist12:15:010
2536640996221,13cyclictest235-21systemd-journal09:35:013
2536636996037,18cyclictest2553460-21munin-run12:35:002
2536636995938,16cyclictest2549029-21sshd11:09:402
2536636995916,8cyclictest2543371-21systemd-run09:20:012
2536636995738,15cyclictest2543695-21cat09:25:022
2536636995738,15cyclictest2543695-21cat09:25:022
2536640995627,10cyclictest2552904-21sed12:20:023
2536636995638,13cyclictest2550066-21sshd11:26:402
253663699556,31cyclictest0-21swapper/208:30:022
2536631995535,14cyclictest235-21systemd-journal07:25:001
2536636995439,12cyclictest363-21snmpd08:22:502
2536636995439,11cyclictest2539909-21sshd08:10:532
2536636995438,12cyclictest2542520-21sshd09:01:152
2536636995438,11cyclictest2538658-21munin-run07:50:012
2536636995437,14cyclictest2552637-21sshd12:16:412
2536636995436,12cyclictest235-21systemd-journal08:40:012
2536636995435,15cyclictest2543863-21munin-run09:30:002
2536636995339,10cyclictest2537369-21munin-run07:24:592
2536636995338,11cyclictest2548231-21sshd10:51:292
2536636995337,13cyclictest2537043-21sshd07:15:402
2536636995337,11cyclictest2545695-21munin-run10:05:012
2536636995330,18cyclictest2544874-21modprobe09:47:412
2536636995315,13cyclictest150-21pr/ttyS207:42:252
2536631995339,11cyclictest23-21ksoftirqd/108:20:001
253664099524,24cyclictest361rcuc/311:15:023
2536640995232,14cyclictest272-21dbus-daemon08:15:013
2536636995240,9cyclictest2537588-21sshd07:25:442
2536636995239,10cyclictest363-21snmpd10:23:502
2536636995239,10cyclictest363-21snmpd10:23:502
2536636995239,10cyclictest2549271-21sshd11:11:402
2536636995239,10cyclictest2547744-21sshd10:44:402
2536636995238,11cyclictest2540984-21munin-run08:35:012
2536636995237,11cyclictest2548767-21sshd11:01:402
2536636995210,14cyclictest2549821-21sshd11:23:402
253662699523,43cyclictest2548556-21systemd-run11:00:010
2536640995131,15cyclictest1-21systemd07:30:013
2536636995138,9cyclictest363-21snmpd10:35:102
2536636995138,10cyclictest2551603-21sshd11:56:412
2536636995138,10cyclictest2551603-21sshd11:56:412
2536636995138,10cyclictest2550846-21sshd11:41:412
2536636995138,10cyclictest2544518-21cat09:40:052
2536636995137,11cyclictest2550566-21sshd11:36:412
2536636995137,10cyclictest363-21snmpd08:52:132
2536636995135,11cyclictest2541782-21munin-run08:50:012
2536636995127,19cyclictest2542769-21sshd09:05:402
2536631995118,10cyclictest23-21ksoftirqd/111:30:021
2536626995147,2cyclictest0-21swapper/008:05:020
2536636995044,3cyclictest2549569-21munin-run11:20:012
2536636995038,9cyclictest2544610-21sshd09:40:402
2536636995037,9cyclictest2546198-21munin-run10:15:012
2536636995037,9cyclictest2543070-21munin-run09:15:002
2536636995037,10cyclictest2553692-21sshd12:38:412
2536636995037,10cyclictest2538871-21sshd07:50:402
2536636995036,10cyclictest363-21snmpd09:53:412
2536636995022,24cyclictest2551901-21cron12:05:002
2536636995022,22cyclictest2552416-21munin-run12:15:002
2536636995015,12cyclictest363-21snmpd10:30:322
2536636994941,5cyclictest2541517-21munin-run08:45:002
2536636994937,9cyclictest2546424-21sshd10:18:402
2536636994937,8cyclictest0-21swapper/207:58:582
2536636994936,10cyclictest2548487-21sshd10:56:402
2536636994931,14cyclictest363-21snmpd08:18:302
2536636994927,17cyclictest2539669-21sshd08:08:402
253663199496,9cyclictest23-21ksoftirqd/109:38:381
2536631994913,5cyclictest131rcu_preempt08:35:021
253662699494,7cyclictest131rcu_preempt11:20:000
2536636994836,7cyclictest2544114-21munin-run09:35:012
2536636994830,13cyclictest235-21systemd-journal07:15:012
2536631994840,6cyclictest23-21ksoftirqd/109:31:201
2536631994834,8cyclictest306-21in:imuxsock09:15:001
2536631994833,11cyclictest2547468-21cron10:40:001
2536631994824,16cyclictest235-21systemd-journal08:50:001
2536626994835,10cyclictest12-21ksoftirqd/010:05:020
2536640994735,8cyclictest37-21ksoftirqd/307:50:023
2536636994735,9cyclictest363-21snmpd10:48:562
2536636994734,9cyclictest48-21kcompactd012:27:192
2536636994724,18cyclictest2546985-21true10:30:002
253663199477,7cyclictest131rcu_preempt07:10:011
253663199475,5cyclictest131rcu_preempt10:00:001
2536631994730,12cyclictest272-21dbus-daemon07:20:011
253663199472,9cyclictest23-21ksoftirqd/109:30:001
2536631994714,6cyclictest131rcu_preempt12:40:001
2536626994725,16cyclictest272-21dbus-daemon11:45:010
253662699472,40cyclictest2537140-21wc07:20:010
2536636994633,10cyclictest363-21snmpd09:58:452
2536636994632,10cyclictest363-21snmpd12:23:222
2536636994629,14cyclictest363-21snmpd11:30:202
2536636994629,14cyclictest363-21snmpd11:30:202
253663199465,10cyclictest23-21ksoftirqd/109:25:011
253663199465,10cyclictest23-21ksoftirqd/109:25:011
253663199463,6cyclictest131rcu_preempt12:10:021
2536631994628,14cyclictest1-21systemd11:20:011
2536631994628,12cyclictest23-21ksoftirqd/107:40:001
2536631994611,9cyclictest23-21ksoftirqd/110:10:401
2536626994632,10cyclictest1-21systemd09:20:010
2536626994627,14cyclictest1-21systemd11:40:000
2536626994620,21cyclictest12-21ksoftirqd/009:30:010
2536626994619,24cyclictest2551760-21latency_hist12:00:030
2536626994619,24cyclictest2551760-21latency_hist12:00:020
2536626994618,23cyclictest12-21ksoftirqd/008:10:020
2536640994531,10cyclictest2543580-21sshd09:21:193
2536640994531,10cyclictest2543580-21sshd09:21:193
2536631994534,8cyclictest23-21ksoftirqd/111:05:001
2536631994528,14cyclictest235-21systemd-journal10:10:011
2536631994526,15cyclictest1-21systemd08:00:011
253663199452,12cyclictest23-21ksoftirqd/109:00:001
253663199452,10cyclictest23-21ksoftirqd/110:50:011
2536631994510,4cyclictest131rcu_preempt12:00:021
2536631994510,4cyclictest131rcu_preempt12:00:011
2536631994510,11cyclictest23-21ksoftirqd/110:35:021
2536640994434,6cyclictest2548502-21cron11:00:003
2536636994431,9cyclictest2542255-21sshd08:59:402
253663199445,9cyclictest23-21ksoftirqd/111:40:001
253663199445,6cyclictest131rcu_preempt12:05:011
253663199444,7cyclictest23-21ksoftirqd/110:18:401
2536631994434,5cyclictest2553458-21munin-plugin-st12:35:001
253663199441,9cyclictest23-21ksoftirqd/112:15:021
253663199441,5cyclictest131rcu_preempt08:05:021
2536631994413,6cyclictest131rcu_preempt08:40:011
253662699444,4cyclictest131rcu_preempt09:55:010
2536626994429,11cyclictest1-21systemd09:45:000
2536626994419,21cyclictest12-21ksoftirqd/008:20:000
2536640994329,8cyclictest306-21in:imuxsock10:05:003
2536640994326,12cyclictest306-21in:imuxsock11:55:023
2536640994326,12cyclictest306-21in:imuxsock11:55:023
2536636994335,5cyclictest2552168-21systemd-run12:10:002
253663199437,7cyclictest131rcu_preempt11:35:001
253663199437,7cyclictest131rcu_preempt11:35:001
253663199437,5cyclictest131rcu_preempt09:05:021
2536631994335,6cyclictest23-21ksoftirqd/112:20:001
2536631994333,7cyclictest23-21ksoftirqd/112:30:001
2536631994329,10cyclictest23-21ksoftirqd/110:25:021
2536631994329,10cyclictest23-21ksoftirqd/110:25:021
2536631994311,6cyclictest131rcu_preempt11:10:021
253663199431,14cyclictest0-21swapper/112:20:411
2536631994310,6cyclictest131rcu_preempt08:45:021
2536626994332,7cyclictest235-21systemd-journal12:40:010
2536626994328,11cyclictest235-21systemd-journal08:30:010
253662699431,39cyclictest0-21swapper/012:30:020
253662699431,38cyclictest0-21swapper/010:50:020
2536640994232,7cyclictest2552939-21sshd12:24:413
2536640994228,10cyclictest1-21systemd10:30:013
2536640994226,10cyclictest272-21dbus-daemon08:45:013
2536640994225,12cyclictest37-21ksoftirqd/312:05:013
2536631994232,7cyclictest23-21ksoftirqd/111:44:121
2536631994211,9cyclictest23-21ksoftirqd/108:30:011
253663199421,12cyclictest0-21swapper/109:46:411
2536626994235,4cyclictest16950irq/224-800000011:10:000
2536626994235,4cyclictest16950irq/224-800000008:50:010
2536626994228,10cyclictest235-21systemd-journal11:55:000
2536626994225,12cyclictest272-21dbus-daemon12:20:000
2536626994223,11cyclictest0-21swapper/008:15:000
2536640994126,11cyclictest37-21ksoftirqd/309:20:003
2536640994122,12cyclictest272-21dbus-daemon07:15:013
253663199413,6cyclictest131rcu_preempt08:15:011
2536631994132,6cyclictest23-21ksoftirqd/110:45:011
2536631994131,7cyclictest23-21ksoftirqd/111:55:001
2536626994131,5cyclictest306-21in:imuxsock11:50:000
2536626994128,9cyclictest12-21ksoftirqd/009:15:010
253662699412,28cyclictest19050irq/34-mmc107:10:020
2536626994119,16cyclictest235-21systemd-journal10:10:000
253664099407,7cyclictest131rcu_preempt12:10:003
2536640994035,3cyclictest371ksoftirqd/309:40:053
2536640994031,5cyclictest2550885-21kworker/3:012:35:003
2536640994030,6cyclictest2539163-21sendmail08:00:003
2536640994026,10cyclictest2538112-21cron07:39:593
2536640994025,9cyclictest306-21in:imuxsock10:22:403
2536640994025,9cyclictest306-21in:imuxsock10:22:393
2536640994020,13cyclictest272-21dbus-daemon11:25:003
2536640994019,15cyclictest1-21systemd11:10:003
253664099401,5cyclictest131rcu_preempt08:35:013
253663199408,6cyclictest131rcu_preempt08:10:021
253663199406,11cyclictest23-21ksoftirqd/109:10:011
253663199405,5cyclictest131rcu_preempt09:55:021
2536631994031,7cyclictest23-21ksoftirqd/107:30:021
253663199401,7cyclictest2538018-21latency_hist07:35:021
253663199401,7cyclictest2538018-21latency_hist07:35:021
2536631994011,5cyclictest131rcu_preempt09:45:011
253663199401,12cyclictest0-21swapper/107:40:351
253663199401,11cyclictest2543319-21cron09:20:001
2536631994010,5cyclictest131rcu_preempt11:25:001
2536626994025,10cyclictest235-21systemd-journal08:55:010
2536626994022,13cyclictest2538113-21cron07:40:000
253662699402,14cyclictest2542814-21munin-run09:10:010
253662699401,5cyclictest131rcu_preempt11:15:010
253662699401,5cyclictest131rcu_preempt09:00:010
2536640993927,9cyclictest2542197-21wc08:55:033
2536640993925,11cyclictest2546253-21sed10:15:023
253663199392,6cyclictest131rcu_preempt11:15:011
2536631993922,14cyclictest23-21ksoftirqd/111:49:411
2536631993910,5cyclictest131rcu_preempt10:55:011
2536631993910,5cyclictest131rcu_preempt07:15:001
253662699393,6cyclictest131rcu_preempt11:30:020
2536626993929,8cyclictest12-21ksoftirqd/010:40:010
2536626993927,9cyclictest1-21systemd10:55:000
2536626993926,9cyclictest235-21systemd-journal10:33:400
2536626993923,11cyclictest0-21swapper/009:40:010
2536626993922,13cyclictest235-21systemd-journal08:40:010
253662699391,34cyclictest2538411-21sh07:45:010
2536640993827,9cyclictest37-21ksoftirqd/309:15:003
2536640993826,6cyclictest306-21in:imuxsock08:40:013
2536640993819,13cyclictest272-21dbus-daemon08:10:013
253664099381,4cyclictest131rcu_preempt11:50:003
253662699388,25cyclictest151rcuc/007:55:010
2536626993830,5cyclictest19050irq/34-mmc107:32:310
2536626993830,5cyclictest19050irq/34-mmc107:32:310
2536626993829,5cyclictest2543604-21sh09:25:010
2536626993829,5cyclictest2543604-21sh09:25:010
2536626993827,8cyclictest12-21ksoftirqd/010:45:020
2536626993827,8cyclictest12-21ksoftirqd/010:00:010
253662699382,5cyclictest2536828-21munin-run07:15:000
2536626993825,9cyclictest2540465-21sshd08:24:400
2536626993824,11cyclictest12-21ksoftirqd/008:45:000
253662699381,9cyclictest235-21systemd-journal10:26:490
2536640993728,6cyclictest2549527-21cron11:17:003
2536640993728,5cyclictest2540216-21sendmail08:20:003
253664099372,3cyclictest131rcu_preempt10:40:013
2536640993719,11cyclictest306-21in:imuxsock08:46:073
2536640993718,14cyclictest272-21dbus-daemon07:20:003
2536636993714,18cyclictest2536711-21latency_hist07:10:012
2536631993728,6cyclictest23-21ksoftirqd/108:55:011
253663199372,5cyclictest131rcu_preempt08:25:001
253662699373,5cyclictest2537077-21cron07:20:030
2536626993730,4cyclictest16950irq/224-800000011:32:400
2536626993730,4cyclictest16950irq/224-800000011:32:400
253662699372,6cyclictest2537621-21munin-run07:30:000
2536626993725,9cyclictest12-21ksoftirqd/012:05:010
2536626993725,8cyclictest12-21ksoftirqd/009:49:590
253662699371,32cyclictest0-21swapper/011:22:400
2536640993623,9cyclictest37-21ksoftirqd/312:27:413
2536640993622,10cyclictest2537544-21wc07:25:023
2536640993617,15cyclictest272-21dbus-daemon10:10:013
2536640993616,16cyclictest272-21dbus-daemon08:05:013
253663199369,4cyclictest131rcu_preempt10:55:401
253663199361,4cyclictest0-21swapper/107:52:411
2536626993628,5cyclictest19050irq/34-mmc111:00:020
253662699362,30cyclictest235-21systemd-journal10:18:110
253662699361,4cyclictest2544094-21sshd09:33:400
253662699361,32cyclictest0-21swapper/008:28:230
253664099355,9cyclictest37-21ksoftirqd/311:34:093
253664099355,9cyclictest37-21ksoftirqd/311:34:093
253664099355,26cyclictest2546447-21sh10:20:003
2536640993525,6cyclictest306-21in:imuxsock09:00:003
2536640993524,9cyclictest37-21ksoftirqd/307:10:023
2536640993523,9cyclictest37-21ksoftirqd/311:45:013
2536640993523,8cyclictest37-21ksoftirqd/311:55:013
2536640993522,10cyclictest37-21ksoftirqd/312:15:013
2536631993524,8cyclictest23-21ksoftirqd/107:50:011
2536626993524,8cyclictest12-21ksoftirqd/010:15:010
2536626993524,8cyclictest12-21ksoftirqd/007:50:020
2536626993523,9cyclictest272-21dbus-daemon12:10:000
253662699351,4cyclictest131rcu_preempt10:25:010
253662699351,4cyclictest131rcu_preempt10:25:010
253664099343,7cyclictest131rcu_preempt09:29:403
2536640993424,7cyclictest37-21ksoftirqd/307:55:003
2536640993423,6cyclictest2538425-21latency_hist07:45:013
2536640993421,9cyclictest37-21ksoftirqd/309:05:013
2536640993420,12cyclictest37-21ksoftirqd/311:30:023
2536640993420,10cyclictest235-21systemd-journal09:45:013
2536640993326,4cyclictest2542808-21latency_hist09:10:023
253664099332,5cyclictest131rcu_preempt09:45:003
253664099332,5cyclictest131rcu_preempt08:25:003
2536640993321,8cyclictest2548808-21systemd-run11:05:013
2536640993318,11cyclictest235-21systemd-journal10:30:023
2536640993316,13cyclictest37-21ksoftirqd/310:55:013
253663199331,5cyclictest0-21swapper/110:29:011
253664099325,21cyclictest2537875-21munin-run07:35:013
253664099325,21cyclictest2537875-21munin-run07:35:013
2536640993225,4cyclictest2540794-21latency_hist08:30:013
2536640993224,5cyclictest2543872-21kworker/3:009:50:023
253664099321,5cyclictest131rcu_preempt10:00:003
2536640993117,10cyclictest0-21swapper/312:40:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional