You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-09-13 - 08:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3s.osadl.org (updated Fri Sep 13, 2024 00:45:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
59683997513,18cyclictest64166-21wc20:35:011
59675997367,3cyclictest0-21swapper/019:50:020
59675997367,3cyclictest0-21swapper/019:50:020
59683996918,12cyclictest23-21ksoftirqd/121:05:011
59683996918,12cyclictest23-21ksoftirqd/121:05:011
59687996819,43cyclictest64307-21cron20:40:012
59683996817,10cyclictest23-21ksoftirqd/121:20:011
59683996817,10cyclictest23-21ksoftirqd/121:20:011
5968799671,11cyclictest67947-21sshd21:49:142
5968799671,11cyclictest60683-21sshd19:26:142
5968799661,12cyclictest70253-21sshd22:30:142
5968799661,12cyclictest70253-21sshd22:30:142
5967599662,2cyclictest0-21swapper/021:50:010
59687996517,43cyclictest272-21dbus-daemon22:05:002
59687996514,45cyclictest272-21dbus-daemon22:25:002
5968799651,15cyclictest71289-21sshd22:52:142
5968799651,11cyclictest69489-21sshd22:19:092
5968799643,13cyclictest74431-21munin-run23:55:002
5968799642,13cyclictest76481-21sshd00:33:242
59687996415,44cyclictest60205-21tr19:20:002
5968799641,13cyclictest65904-21munin-run21:10:002
5968799632,21cyclictest66391-21cron21:20:012
5968799632,21cyclictest66391-21cron21:20:002
5968799621,15cyclictest72111-21munin-run23:10:012
59683996218,9cyclictest23-21ksoftirqd/121:50:001
5968799614,16cyclictest1-21systemd20:30:002
5968799612,15cyclictest60979-21munin-run19:35:012
5968799612,13cyclictest65631-21munin-run21:05:002
5968799612,13cyclictest65631-21munin-run21:05:002
5968799612,13cyclictest65393-21munin-run21:00:012
5968799611,13cyclictest363-21snmpd21:31:412
5968399619,20cyclictest71175-21cut22:50:021
59683996114,9cyclictest23-21ksoftirqd/121:40:011
5968799603,7cyclictest72597-21cron23:20:002
5968799603,7cyclictest66944-21unin-run21:30:002
59687996023,33cyclictest71574-21latency_hist23:00:012
5968799602,12cyclictest67715-21munin-run21:45:002
59687996017,38cyclictest1-21systemd20:25:012
59687996017,38cyclictest1-21systemd20:25:012
5968799594,11cyclictest235-21systemd-journal23:25:012
5968799593,8cyclictest62778-21munin-run20:10:012
5968799593,8cyclictest62778-21munin-run20:10:012
5968799593,13cyclictest73632-21modprobe23:40:002
5968799592,13cyclictest73934-21munin-run23:45:012
5968799592,13cyclictest68358-21latency_hist21:55:022
5968799592,10cyclictest63042-21munin-run20:15:002
59687995911,4cyclictest0-21swapper/221:13:512
5968799591,13cyclictest73404-21munin-run23:35:012
5968799582,9cyclictest75697-21sshd00:19:242
5968799582,18cyclictest235-21systemd-journal00:10:002
59687995818,35cyclictest412-21sshd22:29:102
5968799581,12cyclictest363-21snmpd00:10:252
5968799581,11cyclictest74698-40mandb00:00:032
59683995840,13cyclictest235-21systemd-journal21:35:011
59683995817,9cyclictest23-21ksoftirqd/119:35:011
5968799572,8cyclictest68476-21munin-run22:00:022
5968799572,20cyclictest62234-21cron20:00:002
5968799572,17cyclictest64083-21munin-run20:35:012
59687995711,39cyclictest0-21swapper/222:45:002
59683995720,12cyclictest1-21systemd23:30:011
59675995739,14cyclictest1-21systemd23:55:000
5968799562,14cyclictest69254-21true22:15:022
5968799562,13cyclictest71860-21munin-run23:05:022
5968799562,12cyclictest73126-21cron23:30:002
59687995616,35cyclictest66668-21cron21:25:002
5968799561,13cyclictest363-21snmpd19:21:332
5968799561,12cyclictest363-21snmpd22:45:152
5968799561,10cyclictest70510-21sshd22:37:142
5968799561,10cyclictest61194-21sshd19:38:142
59675995635,17cyclictest1-21systemd20:40:010
5968799556,6cyclictest0-21swapper/200:30:022
5968799556,6cyclictest0-21swapper/200:30:012
5968799552,8cyclictest61985-21cron19:55:002
59687995522,29cyclictest67582-21latency_hist21:40:022
5968799552,14cyclictest68997-21munin-run22:10:002
5968799552,12cyclictest76807-21systemctl00:40:002
5968799552,10cyclictest61472-21sendmail-mta19:42:442
59683995512,9cyclictest23-21ksoftirqd/122:40:001
59675995534,16cyclictest1-21systemd00:20:000
5968799542,14cyclictest363-21snmpd23:14:222
5968799542,13cyclictest65101-21munin-run20:55:002
5968799542,11cyclictest74957-21munin-run00:05:002
59683995416,13cyclictest63266-21sshd20:18:141
5968799533,6cyclictest64850-21grep20:50:002
5968799533,6cyclictest64599-21modprobe20:45:002
5968799533,6cyclictest64599-21modprobe20:45:002
5968799531,11cyclictest59698-21latency_hist19:10:022
5968799531,11cyclictest363-21snmpd20:01:262
59683995340,9cyclictest69751-21sshd22:20:141
59683995336,12cyclictest235-21systemd-journal23:35:001
59683995333,14cyclictest272-21dbus-daemon23:05:001
59683995315,9cyclictest23-21ksoftirqd/123:10:021
5968799522,13cyclictest74185-21systemd-run23:50:012
5968799522,10cyclictest63275-21cron20:20:002
5968799521,11cyclictest363-21snmpd19:49:002
5968799521,11cyclictest363-21snmpd19:49:002
59675995234,13cyclictest1-21systemd23:00:010
59675995229,17cyclictest1-21systemd22:05:000
5968799512,12cyclictest59874-21modprobe19:15:002
5968799512,12cyclictest59874-21modprobe19:15:002
5968799512,11cyclictest75999-21munin-run00:25:002
59683995132,15cyclictest67678-21sshd21:40:141
59675995135,12cyclictest235-21systemd-journal19:30:020
5967599512,4cyclictest131rcu_preempt20:10:020
5967599512,4cyclictest131rcu_preempt20:10:020
59689994928,16cyclictest1-21systemd19:40:013
59683994930,15cyclictest71549-21sshd22:59:141
59683994929,14cyclictest272-21dbus-daemon19:20:001
59683994926,15cyclictest235-21systemd-journal21:10:001
59689994832,12cyclictest272-21dbus-daemon21:25:003
59683994831,14cyclictest68440-21sshd21:58:141
59683994830,14cyclictest76726-21sshd00:35:231
59683994828,16cyclictest62507-21sshd20:03:501
59683994827,16cyclictest65071-21sshd20:52:141
59683994826,18cyclictest75728-21munin-run00:20:011
5967599483,5cyclictest131rcu_preempt00:00:000
59675994833,11cyclictest1-21systemd20:15:000
59689994733,10cyclictest1-21systemd00:40:013
59683994732,11cyclictest72331-21sshd23:14:161
59683994730,12cyclictest73922-21munin-run23:45:001
59683994633,10cyclictest61969-21sshd19:52:141
59683994632,10cyclictest75966-21sshd00:21:241
59683994631,11cyclictest69211-21sshd22:10:141
5967599463,5cyclictest131rcu_preempt21:35:020
5967599463,4cyclictest12-21ksoftirqd/020:35:010
59675994613,17cyclictest0-21swapper/021:55:020
5968999454,7cyclictest131rcu_preempt21:50:003
59689994518,6cyclictest131rcu_preempt19:50:023
59689994518,6cyclictest131rcu_preempt19:50:023
59683994532,10cyclictest70272-21sshd22:34:141
59683994532,10cyclictest70272-21sshd22:34:141
59683994532,10cyclictest68971-21sshd22:08:141
59683994531,11cyclictest75433-21sshd00:13:231
59683994531,10cyclictest66896-21sshd21:25:141
59683994530,12cyclictest76494-21sshd00:34:271
59683994529,12cyclictest75178-21sshd00:07:241
59683994528,14cyclictest65333-21sshd20:59:141
59683994513,27cyclictest66242-21grep21:15:011
5967599459,5cyclictest131rcu_preempt21:10:000
59675994533,9cyclictest12-21ksoftirqd/021:00:000
5967599452,38cyclictest74160-21cron23:49:590
59675994523,17cyclictest235-21systemd-journal22:00:000
5968999441,6cyclictest131rcu_preempt23:10:013
59683994431,10cyclictest66665-21sshd21:24:141
59683994430,10cyclictest68721-21sshd22:03:151
59683994426,12cyclictest235-21systemd-journal00:05:011
59675994428,12cyclictest1-21systemd23:20:000
5967599442,12cyclictest60476-21munin-run19:25:010
5968999436,5cyclictest131rcu_preempt00:15:013
5968999433,5cyclictest131rcu_preempt20:45:013
5968999433,5cyclictest131rcu_preempt20:45:013
5968999431,5cyclictest131rcu_preempt22:30:023
59683994331,9cyclictest64821-21sshd20:47:141
59683994330,10cyclictest74644-21sshd23:58:241
59683994330,10cyclictest74136-21sshd23:45:141
59683994330,10cyclictest63793-21sshd20:28:141
59683994330,10cyclictest61183-21sshd19:35:141
59683994329,10cyclictest272-21dbus-daemon20:25:011
59683994329,10cyclictest272-21dbus-daemon20:25:011
59683994328,12cyclictest72569-21sshd23:16:141
59683994328,11cyclictest1-21systemd23:40:001
59683994327,13cyclictest72852-21sshd23:20:141
59683994324,15cyclictest61727-21sshd19:48:511
59683994324,15cyclictest61727-21sshd19:48:501
59683994313,25cyclictest76250-21/usr/sbin/munin00:30:011
59683994313,25cyclictest76250-21/usr/sbin/munin00:30:011
59675994329,10cyclictest1-21systemd22:15:010
59675994325,13cyclictest76780-21systemctl00:40:010
5967599431,4cyclictest131rcu_preempt19:20:000
59689994231,7cyclictest65337-21cron21:00:003
59689994230,6cyclictest306-21in:imuxsock23:40:013
59689994228,11cyclictest1-21systemd23:20:003
5968999421,5cyclictest131rcu_preempt19:12:153
5968999421,5cyclictest131rcu_preempt19:12:153
59683994234,4cyclictest69481-21sshd22:17:141
59683994230,9cyclictest64612-21munin-run20:45:021
59683994230,9cyclictest64612-21munin-run20:45:011
59683994230,9cyclictest62223-21sshd19:58:141
59683994230,9cyclictest412-21sshd22:41:141
59683994228,10cyclictest60714-21munin-run19:30:001
59683994228,10cyclictest59875-21munin-run19:15:011
59683994228,10cyclictest59875-21munin-run19:15:011
5967599427,5cyclictest131rcu_preempt22:31:530
5967599427,5cyclictest131rcu_preempt22:31:530
5967599425,6cyclictest131rcu_preempt23:35:010
59675994232,5cyclictest62260-21modprobe20:00:000
59675994227,11cyclictest59855-21sshd19:13:480
59675994227,11cyclictest59855-21sshd19:13:480
59675994223,13cyclictest272-21dbus-daemon23:40:010
5967599421,6cyclictest131rcu_preempt21:25:000
5967599421,11cyclictest12-21ksoftirqd/022:55:010
5968999416,5cyclictest131rcu_preempt20:00:003
5968999414,6cyclictest131rcu_preempt22:55:023
59689994129,10cyclictest60949-21sshd19:34:143
5968999412,6cyclictest0-21swapper/320:25:023
5968999412,6cyclictest0-21swapper/320:25:023
5968999412,4cyclictest131rcu_preempt19:10:023
59689994124,12cyclictest272-21dbus-daemon22:20:003
5968999411,5cyclictest131rcu_preempt00:00:033
59683994130,8cyclictest235-21systemd-journal23:50:021
59683994129,9cyclictest64284-21sshd20:35:141
59683994123,14cyclictest363-21snmpd20:05:041
59683994123,14cyclictest363-21snmpd20:05:041
5967599416,25cyclictest59676-21latency_hist19:10:020
59675994130,7cyclictest12-21ksoftirqd/020:50:020
59675994129,9cyclictest12-21ksoftirqd/023:15:000
59675994125,13cyclictest61480-21sshd19:44:150
59675994124,13cyclictest235-21systemd-journal21:20:000
59675994124,13cyclictest235-21systemd-journal21:20:000
5967599412,35cyclictest70023-21sshd22:29:140
59675994123,13cyclictest272-21dbus-daemon00:30:020
59675994123,13cyclictest272-21dbus-daemon00:30:010
59675994115,6cyclictest131rcu_preempt20:30:000
5968999402,5cyclictest131rcu_preempt22:40:013
5968999401,5cyclictest131rcu_preempt23:00:013
5968999401,5cyclictest131rcu_preempt00:30:023
5968999401,5cyclictest131rcu_preempt00:30:023
5968999401,11cyclictest71128-21wc22:50:023
5967599404,5cyclictest131rcu_preempt23:45:000
59675994032,5cyclictest64733-21latency_hist20:45:020
59675994032,5cyclictest64733-21latency_hist20:45:020
59675994030,5cyclictest306-21in:imuxsock23:10:010
5967599402,8cyclictest72955-21latency_hist23:25:010
59675994028,8cyclictest61252-21true19:40:010
59675994026,10cyclictest235-21systemd-journal23:30:010
59675994019,4cyclictest12-21ksoftirqd/021:05:010
59675994019,4cyclictest12-21ksoftirqd/021:05:010
59689993928,6cyclictest67169-21cron21:35:003
5968999392,4cyclictest131rcu_preempt21:45:013
59689993924,11cyclictest1-21systemd00:20:003
59683993929,8cyclictest59679-21latency_hist19:10:021
59683993927,9cyclictest61476-21sshd19:43:501
59683993925,10cyclictest363-21snmpd20:11:281
59683993918,16cyclictest70003-21sshd22:25:141
59675993931,6cyclictest12-21ksoftirqd/020:05:020
59675993928,8cyclictest235-21systemd-journal19:55:000
59675993925,11cyclictest71031-21sshd22:45:140
59675993924,10cyclictest1-21systemd23:05:010
59675993923,13cyclictest12-21ksoftirqd/022:45:010
59675993923,11cyclictest12-21ksoftirqd/000:34:590
5967599391,34cyclictest66907-21sshd21:27:140
5968999384,5cyclictest131rcu_preempt22:05:013
5968999384,29cyclictest62875-21cat20:10:023
5968999384,29cyclictest62875-21cat20:10:023
5968999383,5cyclictest131rcu_preempt22:24:093
5968999383,3cyclictest131rcu_preempt00:25:023
59689993827,8cyclictest68179-21sshd21:50:143
59689993826,7cyclictest66390-21cron21:20:013
59689993826,7cyclictest66390-21cron21:20:003
59689993825,10cyclictest272-21dbus-daemon23:25:013
5968999381,5cyclictest131rcu_preempt00:05:013
5968999381,4cyclictest131rcu_preempt21:05:023
5968999381,4cyclictest131rcu_preempt21:05:023
59683993825,9cyclictest23-21ksoftirqd/119:25:021
59675993821,13cyclictest1-21systemd21:15:010
5968999373,6cyclictest131rcu_preempt23:11:143
59689993724,10cyclictest235-21systemd-journal23:55:013
59689993721,11cyclictest272-21dbus-daemon23:35:003
59689993719,13cyclictest1-21systemd22:10:023
5968999371,5cyclictest131rcu_preempt20:40:023
59683993729,5cyclictest68300-21latency_hist21:55:021
59675993726,8cyclictest76163-21cat00:25:030
59675993724,9cyclictest12-21ksoftirqd/021:43:140
5967599371,5cyclictest131rcu_preempt20:25:020
5967599371,5cyclictest131rcu_preempt20:25:020
59675993715,18cyclictest131rcu_preempt20:50:140
5968999364,4cyclictest131rcu_preempt20:16:143
59689993621,11cyclictest272-21dbus-daemon22:45:013
5968999361,5cyclictest131rcu_preempt21:15:003
59683993621,10cyclictest363-21snmpd22:51:491
59675993628,6cyclictest12-21ksoftirqd/021:39:050
5967599362,30cyclictest363-21snmpd00:05:250
59675993615,5cyclictest16850irq/134-800000022:22:140
59675993614,17cyclictest12-21ksoftirqd/022:07:000
5967599361,10cyclictest60876-21latency_hist19:30:020
59689993526,6cyclictest60093-21sshd19:16:143
5968999352,4cyclictest131rcu_preempt19:55:003
59689993520,11cyclictest37-21ksoftirqd/321:40:003
5968999351,5cyclictest131rcu_preempt23:50:013
5968999351,5cyclictest131rcu_preempt19:30:013
5968999351,5cyclictest0-21swapper/321:58:143
59689993515,15cyclictest1-21systemd00:10:023
59675993520,10cyclictest1-21systemd22:20:000
5967599351,30cyclictest0-21swapper/000:02:430
59675993511,21cyclictest12-21ksoftirqd/022:40:010
5968999344,3cyclictest131rcu_preempt20:50:003
5968999343,5cyclictest131rcu_preempt20:53:143
59689993421,10cyclictest70426-21cat22:35:023
59689993421,10cyclictest70426-21cat22:35:023
5968999341,5cyclictest131rcu_preempt22:11:143
59689993413,3cyclictest37-21ksoftirqd/320:11:273
59675993420,11cyclictest235-21systemd-journal20:20:000
59689993323,7cyclictest37-21ksoftirqd/321:30:003
59689993323,6cyclictest306-21in:imuxsock19:45:003
59689993322,7cyclictest62515-21cron20:05:003
59689993315,14cyclictest272-21dbus-daemon21:10:003
5968999331,4cyclictest131rcu_preempt23:40:293
5968999324,5cyclictest131rcu_preempt23:03:143
59689993221,6cyclictest235-21systemd-journal23:30:003
59689993220,10cyclictest37-21ksoftirqd/320:30:003
5967599322,4cyclictest131rcu_preempt00:15:010
59689993124,5cyclictest363-21snmpd19:21:183
5968999311,4cyclictest131rcu_preempt20:31:563
5968999303,3cyclictest131rcu_preempt00:34:073
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional