You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-18 - 16:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3s.osadl.org (updated Thu Apr 18, 2024 00:44:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3791922991271,2cyclictest0-21swapper/022:35:020
3791922998985,2cyclictest0-21swapper/021:55:020
3791931998881,5cyclictest30-21ksoftirqd/222:55:022
3791922997534,38cyclictest18650irq/34-mmc123:30:010
3791922997470,2cyclictest0-21swapper/021:25:010
3791925997326,43cyclictest274-21dbus-daemon21:20:011
3791922997366,2cyclictest0-21swapper/022:00:010
379192299732,67cyclictest0-21swapper/022:45:020
3791922997167,2cyclictest0-21swapper/022:25:020
379192599692,14cyclictest3805903-21munin-run23:40:011
3791922996965,2cyclictest0-21swapper/019:50:020
379192599681,16cyclictest3796505-21sshd20:36:421
3791925996738,25cyclictest304-21in:imuxsock22:10:011
379192599672,16cyclictest3804104-21munin-run23:05:011
3791925996710,6cyclictest3792358-21sshd19:17:091
379192599662,16cyclictest3802023-21munin-run22:25:011
379192599662,14cyclictest3807701-21sshd00:14:201
3791925996616,44cyclictest274-21dbus-daemon00:35:011
379192599661,12cyclictest3795204-21sshd20:11:101
379192299666,10cyclictest12-21ksoftirqd/023:45:000
3791925996525,36cyclictest3797337-21latency_hist20:55:021
379192599642,16cyclictest3798377-21munin-run21:15:011
379192599642,15cyclictest3800991-21munin-run22:05:011
3791925996323,35cyclictest235-21systemd-journal21:45:101
379192599632,16cyclictest3808019-21munin-run00:20:011
379192599632,16cyclictest3797078-21munin-run20:50:011
379192599632,14cyclictest3806975-21munin-run00:00:001
379192599622,19cyclictest3797848-21munin-run21:05:011
379192599622,14cyclictest3792122-21munin-run19:14:591
379192599622,13cyclictest3807479-21munin-run00:10:011
3791925996212,4cyclictest0-21swapper/122:18:531
379192599621,13cyclictest1917536-21snmpd21:36:121
379192599612,18cyclictest3805275-21cat23:25:021
379192599612,14cyclictest3802819-21munin-run22:40:011
379192599612,13cyclictest3799412-21munin-run21:35:011
379192599612,13cyclictest3798061-21sshd21:05:091
379192599612,12cyclictest3796812-21munin-run20:45:001
379192599602,15cyclictest3803308-21munin-run22:50:001
379192299602,15cyclictest12-21ksoftirqd/020:40:010
379192599593,9cyclictest3793683-21cron19:45:001
3791925995937,18cyclictest3794728-21latency_hist20:05:001
3791925995915,38cyclictest3800721-21sendmail21:59:591
379192599591,15cyclictest3809016-21cron00:40:001
379192599591,13cyclictest3801454-21sshd22:12:021
3791922995955,2cyclictest0-21swapper/020:20:020
3791931995835,17cyclictest1-21systemd00:00:012
379192599587,14cyclictest1-21systemd19:30:001
379192599582,13cyclictest3798905-21munin-run21:25:001
3791922995852,4cyclictest0-21swapper/023:00:010
379192599572,9cyclictest3795486-21cron20:20:001
379192599572,15cyclictest3803831-21tr23:00:001
379192599572,13cyclictest3804842-21modprobe23:19:091
379192599572,12cyclictest3803574-21munin-run22:55:011
379192599572,12cyclictest1917536-21snmpd22:43:541
379192599571,15cyclictest308-21systemd-logind20:30:011
379192599571,13cyclictest3792666-21sh19:25:011
379192599571,12cyclictest3808226-21sshd00:21:291
379192599571,12cyclictest1917536-21snmpd23:49:531
3791925995634,17cyclictest235-21systemd-journal21:00:001
379192599562,9cyclictest3794440-21cron19:59:591
379192599562,12cyclictest1917536-21snmpd00:25:271
379192599561,10cyclictest3799926-21sshd21:44:091
3791931995547,5cyclictest3803587-21kworker/2:123:55:032
379192599553,8cyclictest3806159-21cron23:45:001
379192599553,11cyclictest3793415-21modprobe19:40:011
379192599553,11cyclictest3793415-21modprobe19:40:011
379192299554,9cyclictest12-21ksoftirqd/000:00:030
3791922995547,3cyclictest0-21swapper/021:45:010
379192299553,10cyclictest12-21ksoftirqd/020:45:000
3791931995435,14cyclictest235-21systemd-journal20:40:012
379192599542,18cyclictest3802249-21sshd22:27:051
379192599541,12cyclictest3804572-21sshd23:12:131
3791931995345,5cyclictest3780035-21kworker/2:322:45:022
379192599532,19cyclictest235-21systemd-journal23:30:001
3791922995344,5cyclictest16850irq/224-800000021:00:000
3791931995243,6cyclictest3780035-21kworker/2:320:27:102
3791931995243,5cyclictest3803587-21kworker/2:100:03:302
3791931995236,12cyclictest1-21systemd23:45:012
3791931995212,6cyclictest131rcu_preempt21:20:002
379192599522,15cyclictest3793939-21modprobe19:50:001
379192599522,11cyclictest3800446-21munin-run21:55:011
379192599522,11cyclictest3799288-21latency_hist21:30:021
3791936995113,6cyclictest131rcu_preempt22:30:023
3791931995142,5cyclictest3780035-21kworker/2:322:00:012
3791931995142,5cyclictest3780035-21kworker/2:321:40:092
3791931995137,11cyclictest1-21systemd23:05:012
3791931995135,12cyclictest274-21dbus-daemon21:05:012
379192599518,9cyclictest23-21ksoftirqd/100:05:011
379192599516,7cyclictest235-21systemd-journal19:55:011
379192599516,7cyclictest235-21systemd-journal19:55:011
379192599513,19cyclictest3805659-21cat23:35:011
379192599512,9cyclictest1-21systemd20:25:001
379192599512,13cyclictest1917536-21snmpd20:30:591
379192599511,13cyclictest3794946-21sshd20:05:101
379192599511,12cyclictest3806655-21sshd23:53:121
379192299516,8cyclictest12-21ksoftirqd/021:37:090
3791922995142,6cyclictest12-21ksoftirqd/022:40:010
3791922995138,8cyclictest3797077-21systemd-run20:50:010
379192299511,9cyclictest3805639-21munin-run23:35:000
3791936995033,13cyclictest3792057-21sed19:10:033
3791936995033,13cyclictest3792057-21sed19:10:033
3791931995042,5cyclictest3780035-21kworker/2:321:36:102
3791931995042,5cyclictest3780035-21kworker/2:321:30:022
3791931995042,5cyclictest3780035-21kworker/2:320:05:022
3791931995041,5cyclictest3780035-21kworker/2:319:30:012
379192299505,10cyclictest12-21ksoftirqd/023:55:020
3791931994941,5cyclictest3780035-21kworker/2:319:15:012
3791931994940,5cyclictest3803587-21kworker/2:100:35:022
3791931994940,5cyclictest3780035-21kworker/2:321:35:012
3791931994939,6cyclictest3780035-21kworker/2:322:40:012
3791931994934,11cyclictest1-21systemd19:50:012
3791931994934,10cyclictest1-21systemd19:45:002
379192299492,9cyclictest12-21ksoftirqd/022:55:010
3791936994833,11cyclictest235-21systemd-journal21:28:483
3791936994830,13cyclictest274-21dbus-daemon00:00:003
3791931994840,5cyclictest3803587-21kworker/2:123:15:012
3791931994840,5cyclictest3780035-21kworker/2:321:09:102
3791931994828,14cyclictest235-21systemd-journal00:40:002
379192599481,12cyclictest1917536-21snmpd22:33:331
379192299486,10cyclictest12-21ksoftirqd/022:10:010
379192299482,11cyclictest12-21ksoftirqd/019:25:010
3791922994810,4cyclictest151rcuc/000:25:010
3791936994730,13cyclictest1-21systemd00:25:013
3791931994739,5cyclictest3803587-21kworker/2:100:27:562
3791931994739,5cyclictest3780035-21kworker/2:320:55:022
3791931994739,5cyclictest3780035-21kworker/2:319:25:012
3791931994738,6cyclictest3803587-21kworker/2:123:25:022
3791922994733,10cyclictest274-21dbus-daemon20:55:020
3791922994732,11cyclictest274-21dbus-daemon23:15:000
379193699467,6cyclictest131rcu_preempt22:40:013
379193699461,6cyclictest131rcu_preempt22:00:013
3791931994638,5cyclictest3803587-21kworker/2:100:24:312
3791931994624,16cyclictest274-21dbus-daemon19:35:012
379192599465,7cyclictest3791932-21wc19:10:021
379192599465,7cyclictest3791932-21wc19:10:011
3791922994637,6cyclictest12-21ksoftirqd/021:10:020
379193699454,24cyclictest361rcuc/323:25:013
3791936994531,11cyclictest274-21dbus-daemon22:05:003
379193199458,7cyclictest131rcu_preempt23:30:002
3791931994537,5cyclictest3803587-21kworker/2:123:35:022
3791931994537,5cyclictest3780035-21kworker/2:320:25:012
3791931994537,5cyclictest3780035-21kworker/2:320:00:022
3791931994530,11cyclictest0-21swapper/223:50:022
3791931994529,12cyclictest235-21systemd-journal20:31:082
379192599456,9cyclictest304-21in:imuxsock23:05:021
379192299455,11cyclictest12-21ksoftirqd/019:15:000
379192299451,7cyclictest0-21swapper/023:20:460
379192299451,11cyclictest12-21ksoftirqd/022:00:000
3791936994429,12cyclictest1-21systemd00:00:033
3791936994428,11cyclictest3804569-21sshd23:12:093
379193699441,5cyclictest131rcu_preempt20:20:003
3791931994436,5cyclictest3803587-21kworker/2:123:20:012
3791931994436,5cyclictest3780035-21kworker/2:321:50:022
3791931994436,5cyclictest3780035-21kworker/2:320:56:592
3791931994436,5cyclictest3780035-21kworker/2:320:09:092
3791931994435,6cyclictest3780035-21kworker/2:321:14:332
3791931994432,9cyclictest30-21ksoftirqd/223:40:012
3791931994428,12cyclictest235-21systemd-journal22:55:092
379192299446,12cyclictest12-21ksoftirqd/000:13:190
379192299444,8cyclictest12-21ksoftirqd/021:15:000
379192299444,7cyclictest12-21ksoftirqd/023:38:090
379192299444,10cyclictest12-21ksoftirqd/021:17:000
3791922994426,14cyclictest3799389-21sshd21:32:090
379193699433,5cyclictest131rcu_preempt23:35:003
3791936994328,12cyclictest274-21dbus-daemon21:50:003
3791936994326,13cyclictest1-21systemd19:40:013
3791936994326,13cyclictest1-21systemd19:40:013
3791931994336,4cyclictest3803587-21kworker/2:100:11:192
3791931994335,5cyclictest3803587-21kworker/2:100:10:022
3791931994335,5cyclictest3780035-21kworker/2:322:30:002
3791931994335,5cyclictest3780035-21kworker/2:322:15:012
3791931994335,5cyclictest3780035-21kworker/2:320:49:512
3791931994335,5cyclictest3780035-21kworker/2:320:40:102
3791931994335,5cyclictest3780035-21kworker/2:320:15:012
3791931994335,5cyclictest3780035-21kworker/2:319:55:022
3791931994335,5cyclictest3780035-21kworker/2:319:55:012
379192299439,7cyclictest151rcuc/022:46:150
379192299435,29cyclictest18650irq/34-mmc122:30:020
3791922994328,10cyclictest1-21systemd00:40:010
379192299431,10cyclictest12-21ksoftirqd/022:18:090
379193699423,3cyclictest131rcu_preempt21:00:003
3791936994228,10cyclictest37-21ksoftirqd/320:50:003
3791936994225,12cyclictest1-21systemd21:40:013
3791936994222,14cyclictest274-21dbus-daemon19:55:013
3791936994222,14cyclictest274-21dbus-daemon19:55:003
379193199423,7cyclictest131rcu_preempt22:50:002
3791931994234,5cyclictest3803587-21kworker/2:123:08:082
3791931994234,5cyclictest3780035-21kworker/2:319:15:172
3791931994233,6cyclictest3780035-21kworker/2:321:25:012
3791931994227,12cyclictest3807963-21cron00:20:002
3791922994229,10cyclictest235-21systemd-journal00:26:290
379192299422,36cyclictest3807427-21sshd00:05:190
3791922994222,14cyclictest274-21dbus-daemon19:40:010
3791922994222,14cyclictest274-21dbus-daemon19:40:010
3791922994215,7cyclictest151rcuc/023:05:020
3791936994129,9cyclictest1-21systemd23:30:013
3791936994128,9cyclictest235-21systemd-journal23:50:003
379193199417,6cyclictest131rcu_preempt21:55:012
3791931994125,11cyclictest274-21dbus-daemon22:20:012
379192299417,5cyclictest131rcu_preempt20:10:020
3791922994130,8cyclictest151rcuc/021:46:550
3791922994124,13cyclictest274-21dbus-daemon20:00:000
379192299411,8cyclictest12-21ksoftirqd/022:11:230
379192299411,8cyclictest0-21swapper/023:48:530
379192299411,36cyclictest0-21swapper/020:30:000
379192299411,10cyclictest3808756-21modprobe00:33:590
3791936994029,8cyclictest37-21ksoftirqd/319:16:083
3791936994029,7cyclictest37-21ksoftirqd/300:35:013
3791936994028,9cyclictest1-21systemd20:40:013
3791936994027,10cyclictest3804812-21sshd23:15:093
379193699402,5cyclictest131rcu_preempt22:55:023
3791936994025,11cyclictest274-21dbus-daemon00:30:013
3791931994031,6cyclictest3780035-21kworker/2:320:15:012
379192299407,9cyclictest12-21ksoftirqd/019:55:010
379192299407,9cyclictest12-21ksoftirqd/019:55:000
3791922994033,4cyclictest0-21swapper/020:04:590
3791922994030,6cyclictest3796268-21cron20:35:000
3791922994028,9cyclictest3793666-21modprobe19:41:090
379192299402,33cyclictest1-21systemd23:15:090
379193699395,6cyclictest131rcu_preempt23:00:003
3791936993928,7cyclictest304-21in:imuxsock21:45:013
3791936993927,8cyclictest3801791-21wc22:20:023
3791936993926,10cyclictest1-21systemd20:00:013
3791936993925,11cyclictest1-21systemd22:45:013
3791936993919,5cyclictest37-21ksoftirqd/319:30:013
3791931993918,4cyclictest30-21ksoftirqd/222:25:022
379192299396,5cyclictest131rcu_preempt19:35:000
3791922993928,9cyclictest12-21ksoftirqd/020:22:090
379192299391,9cyclictest12-21ksoftirqd/019:29:170
379193699383,27cyclictest3803275-21kworker/u8:123:05:023
3791936993827,8cyclictest3799475-21ls21:35:023
3791936993826,8cyclictest3808991-21sshd00:35:303
379193699382,33cyclictest37-21ksoftirqd/321:25:003
3791936993822,12cyclictest274-21dbus-daemon22:25:013
3791936993818,4cyclictest37-21ksoftirqd/300:20:013
3791936993812,22cyclictest3807719-21grep00:15:013
3791922993829,6cyclictest12-21ksoftirqd/023:06:350
3791922993828,7cyclictest235-21systemd-journal00:16:550
3791922993825,10cyclictest12-21ksoftirqd/000:05:000
3791922993822,12cyclictest1917536-21snmpd21:01:050
379192299381,19cyclictest12-21ksoftirqd/021:26:410
379193699374,3cyclictest131rcu_preempt22:15:013
379193699373,4cyclictest131rcu_preempt00:10:013
379193699372,5cyclictest131rcu_preempt21:55:013
3791936993725,7cyclictest3806671-21sh23:55:013
3791936993724,10cyclictest37-21ksoftirqd/320:29:593
3791936993714,3cyclictest37-21ksoftirqd/320:55:023
3791931993729,5cyclictest3780035-21kworker/2:322:35:022
3791931993729,5cyclictest3780035-21kworker/2:319:38:102
3791931993729,5cyclictest3780035-21kworker/2:319:38:102
3791925993715,12cyclictest23-21ksoftirqd/119:35:001
379193699369,5cyclictest37-21ksoftirqd/323:10:013
3791936993627,6cyclictest3798407-21latency_hist21:15:013
379193699362,3cyclictest131rcu_preempt20:45:023
379193699361,4cyclictest131rcu_preempt19:48:093
379193699361,3cyclictest131rcu_preempt20:10:023
379192299366,6cyclictest131rcu_preempt19:16:230
379192299361,6cyclictest12-21ksoftirqd/019:10:030
379192299361,6cyclictest12-21ksoftirqd/019:10:030
379193699354,4cyclictest131rcu_preempt22:07:003
379193699354,3cyclictest131rcu_preempt21:03:093
379193699353,4cyclictest131rcu_preempt19:42:103
379193699353,3cyclictest131rcu_preempt23:42:193
3791936993526,7cyclictest37-21ksoftirqd/320:00:533
3791936993525,7cyclictest3798285-21date21:10:033
3791936993524,8cyclictest3796445-21cat20:35:023
3791936993524,6cyclictest37-21ksoftirqd/323:40:013
3791936993522,10cyclictest3803320-21systemctl22:50:013
379193699351,4cyclictest131rcu_preempt22:35:023
3791931993523,7cyclictest3800965-21cron22:05:002
379192299351,6cyclictest0-21swapper/020:10:550
379193699344,3cyclictest131rcu_preempt21:18:103
3791931993422,9cyclictest3801210-21sshd22:08:082
379193699333,3cyclictest131rcu_preempt19:30:463
3791936993324,7cyclictest3795760-21sshd20:24:093
3791936993316,12cyclictest235-21systemd-journal20:15:003
379193699331,3cyclictest131rcu_preempt19:11:243
3791936993215,3cyclictest37-21ksoftirqd/319:20:453
3791931993023,4cyclictest3791864-21latency_hist19:10:022
3791931993023,4cyclictest3791864-21latency_hist19:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional