You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-20 - 04:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3s.osadl.org (updated Wed Jun 19, 2024 12:45:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
316376199769,39cyclictest3163963-21kworker/u8:107:25:010
3163765996639,23cyclictest1-21systemd09:10:011
316376599663,58cyclictest3175541-21cron10:55:001
3163769996527,33cyclictest3168795-21cron08:45:012
316376599633,55cyclictest3171166-21munin-run09:30:011
316376599633,55cyclictest1917536-21snmpd07:34:011
3163765996327,31cyclictest3171659-21sendmail09:40:001
316376599632,57cyclictest3175062-21munin-run10:45:011
316376599632,56cyclictest3172969-21munin-run10:05:001
316376599623,55cyclictest3178852-21latency_hist11:55:021
316376599622,53cyclictest3180991-21cron12:39:591
3163765996220,37cyclictest274-21dbus-daemon09:00:011
3163765996220,37cyclictest274-21dbus-daemon09:00:011
3163761996214,12cyclictest12-21ksoftirqd/007:57:100
316376599615,45cyclictest3170912-21unin-run09:25:011
316376599612,50cyclictest3165233-21cron07:40:001
3163761996157,2cyclictest0-21swapper/010:50:020
3163761996157,2cyclictest0-21swapper/010:50:020
3163761996114,10cyclictest12-21ksoftirqd/012:15:000
316376599603,49cyclictest3172173-21cron09:49:591
316376599602,53cyclictest3168571-21unin-run08:40:011
316376599602,53cyclictest1917536-21snmpd10:24:331
316376599602,52cyclictest3166037-21munin-run07:55:001
316376599601,12cyclictest3176308-21sshd11:06:431
316376599594,47cyclictest3177876-21cron11:39:591
316376599594,47cyclictest1-21systemd10:00:011
3163765995928,26cyclictest274-21dbus-daemon12:15:011
316376599592,52cyclictest3176892-21munin-run11:20:011
316376599592,50cyclictest3178154-21cron11:45:001
316376599592,49cyclictest1-21systemd09:55:001
316376599591,51cyclictest3169045-21cron08:50:011
316376599591,4cyclictest3168289-21munin-run08:35:001
316376599591,4cyclictest1917536-21snmpd12:09:541
3163765995911,42cyclictest1-21systemd08:45:011
3163769995836,17cyclictest3170608-21cron09:20:002
316376599583,49cyclictest1-21systemd07:25:001
3163765995826,29cyclictest23-21ksoftirqd/109:35:011
316376599582,5cyclictest3167703-21sshd08:24:181
316376599582,52cyclictest1-21systemd08:00:011
316376599582,51cyclictest3171922-21cron09:45:011
3163765995824,30cyclictest413-21sshd07:44:411
316376599582,19cyclictest235-21systemd-journal10:40:011
316376599581,5cyclictest3170327-21sshd09:10:421
316376599581,5cyclictest3170327-21sshd09:10:421
316376599581,4cyclictest3179183-21sshd12:03:421
316376599581,4cyclictest3167156-21sshd08:12:411
316376599581,4cyclictest1917536-21snmpd12:19:561
316376599581,4cyclictest1917536-21snmpd10:59:401
3163761995811,11cyclictest12-21ksoftirqd/012:25:000
3163769995734,18cyclictest3178673-21grep11:55:002
3163769995732,21cyclictest3165231-21cron07:40:012
316376599579,43cyclictest0-21swapper/112:24:581
316376599574,46cyclictest307-21rs:main1
316376599573,50cyclictest48-21kcompactd010:47:521
316376599573,50cyclictest48-21kcompactd010:47:521
316376599573,47cyclictest3173723-21cron10:20:001
316376599573,46cyclictest3164199-21cron07:20:001
3163765995728,24cyclictest1-21systemd08:20:001
316376599572,51cyclictest3166892-21munin-run08:10:011
316376599572,48cyclictest3176073-21cron11:05:001
316376599572,12cyclictest3178967-21munin-run12:00:011
316376599571,4cyclictest3180727-21sshd12:32:421
316376599571,4cyclictest3180727-21sshd12:32:411
3163761995714,13cyclictest12-21ksoftirqd/009:00:010
3163761995714,13cyclictest12-21ksoftirqd/009:00:010
316376599562,4cyclictest1917536-21snmpd10:09:311
3163765995623,30cyclictest23-21ksoftirqd/107:15:011
316376599561,7cyclictest3166624-21/usr/sbin/munin08:05:011
316376599561,15cyclictest3169841-21munin-run09:05:001
3163769995533,16cyclictest307-21rs:main2
316376599554,42cyclictest308-21systemd-logind07:50:011
316376599553,44cyclictest274-21dbus-daemon10:35:011
316376599552,5cyclictest3168128-21ls08:30:021
316376599551,4cyclictest1917536-21snmpd07:29:001
3163769995438,10cyclictest3166866-21cron08:10:002
3163769995435,12cyclictest3178169-21cut11:45:012
3163769995433,16cyclictest3178408-21cron11:50:002
316376599543,46cyclictest3177268-21latency_hist11:25:021
316376599543,43cyclictest235-21systemd-journal10:30:001
316376599542,13cyclictest3169322-21munin-run08:55:011
316376599541,4cyclictest1917536-21snmpd12:30:001
316376599541,4cyclictest1917536-21snmpd10:14:311
316376599541,3cyclictest48-21kcompactd011:45:351
3163761995419,31cyclictest3176083-21latency_hist11:05:020
3163769995339,10cyclictest3164730-21cron07:30:002
3163769995328,19cyclictest3168640-21sed08:40:022
316376599532,46cyclictest3176726-21grep11:15:021
316376599532,45cyclictest413-21sshd11:31:431
3163771995212,8cyclictest37-21ksoftirqd/310:25:023
3163769995237,10cyclictest3176074-21cron11:05:012
3163769995233,16cyclictest3174733-21sshd10:35:342
3163769995231,15cyclictest3171643-21cron09:40:012
3163769995229,18cyclictest307-21rs:main2
316376599524,43cyclictest3170647-21sendmail-msp09:20:011
3163761995233,14cyclictest1-21systemd07:35:020
3163769995130,17cyclictest3175790-21sshd10:58:422
3163769995130,16cyclictest3177369-21cron11:30:012
3163769995129,16cyclictest3170275-21sed09:10:022
3163769995128,18cyclictest3180116-21date12:20:022
3163769995128,18cyclictest3172332-21sed09:50:012
3163769995124,23cyclictest3174000-21cron10:25:002
316376199516,10cyclictest12-21ksoftirqd/011:20:000
316377199508,29cyclictest0-21swapper/310:05:003
3163769995035,11cyclictest1917536-21snmpd10:05:012
3163769995035,10cyclictest235-21systemd-journal09:35:002
3163769995031,15cyclictest3165502-21sshd07:44:412
3163769995031,13cyclictest3165759-21cron07:50:002
3163769995030,12cyclictest274-21dbus-daemon10:00:012
3163769995028,9cyclictest1-21systemd10:50:022
3163769995028,9cyclictest1-21systemd10:50:012
3163769995027,19cyclictest3172004-21cut09:45:022
3163769995027,17cyclictest3177875-21cron11:39:592
3163769995026,19cyclictest3176687-21latency_hist11:15:012
3163769995026,19cyclictest3169714-21cat09:00:022
3163769995026,19cyclictest3169714-21cat09:00:022
316376199504,13cyclictest12-21ksoftirqd/011:10:010
3163761995033,13cyclictest1-21systemd08:24:180
316376199502,7cyclictest12-21ksoftirqd/010:32:420
3163761995010,10cyclictest12-21ksoftirqd/008:30:020
3163769994933,10cyclictest3165005-21unin-run07:35:012
3163769994931,14cyclictest3175540-21cron10:54:592
3163769994929,16cyclictest3175106-21wc10:45:022
3163769994929,10cyclictest235-21systemd-journal08:24:302
3163769994928,15cyclictest274-21dbus-daemon09:30:012
3163769994926,15cyclictest3180993-21modprobe12:39:592
316376599496,36cyclictest0-21swapper/107:10:011
3163761994933,12cyclictest274-21dbus-daemon10:00:000
3163771994819,9cyclictest37-21ksoftirqd/312:20:393
3163771994813,32cyclictest37-21ksoftirqd/308:25:023
3163769994833,11cyclictest3164174-21cron07:17:002
3163769994832,13cyclictest3169285-21sshd08:52:422
3163769994831,13cyclictest3174252-21cron10:30:002
3163769994831,11cyclictest274-21dbus-daemon09:55:002
3163769994830,8cyclictest3173722-21cron10:20:002
3163769994828,13cyclictest3178910-21cron12:00:012
3163769994827,18cyclictest3180466-21sshd12:25:412
3163769994827,18cyclictest3180445-21latency_hist12:25:032
3163769994827,17cyclictest3167396-21sshd08:15:052
3163769994826,17cyclictest3177647-21systemd-run11:35:012
3163769994824,20cyclictest3179459-21grep12:10:002
3163769994823,20cyclictest1-21systemd07:57:092
3163769994823,19cyclictest3179319-21latency_hist12:05:022
3163761994841,4cyclictest16850irq/224-800000011:50:000
3163761994830,14cyclictest274-21dbus-daemon08:05:010
3163771994729,14cyclictest3178887-21sshd11:55:423
3163769994735,9cyclictest1-21systemd09:05:002
3163769994731,11cyclictest3177117-21cron11:25:002
3163769994731,11cyclictest3170497-21grep09:15:032
3163769994731,11cyclictest3170497-21grep09:15:022
3163769994730,13cyclictest3169072-21unin-run08:50:002
3163769994729,11cyclictest3174655-21latency_hist10:35:022
3163769994728,9cyclictest1-21systemd11:20:022
3163769994728,15cyclictest3176480-21ls11:10:012
3163769994727,16cyclictest3168043-21latency_hist08:30:022
3163769994726,17cyclictest3166705-21cat08:05:022
3163769994726,15cyclictest3163795-21latency_hist07:10:012
316376199476,9cyclictest12-21ksoftirqd/007:50:020
316376199476,6cyclictest12-21ksoftirqd/012:05:020
316376199475,12cyclictest12-21ksoftirqd/009:54:420
316376199472,41cyclictest1-21systemd10:12:430
3163769994629,13cyclictest235-21systemd-journal07:50:032
3163769994628,12cyclictest3179715-21true12:15:002
3163769994626,16cyclictest3173202-21sshd10:08:412
316376199468,34cyclictest151rcuc/010:25:020
3163769994527,12cyclictest3173467-21cron10:15:002
3163769994526,11cyclictest3168412-21latency_hist08:35:012
316376199457,7cyclictest12-21ksoftirqd/007:15:020
316376199455,9cyclictest12-21ksoftirqd/008:10:000
3163761994536,5cyclictest3177124-21cron11:25:000
3163761994527,14cyclictest1917536-21snmpd12:40:010
316376199451,11cyclictest3178945-21tr12:00:000
316376199451,10cyclictest12-21ksoftirqd/007:20:010
3163771994433,8cyclictest3170866-21sshd09:20:423
3163771994430,11cyclictest235-21systemd-journal08:49:483
3163769994432,9cyclictest3163937-21cron07:15:002
3163761994437,4cyclictest16850irq/224-800000008:20:010
316376199443,6cyclictest12-21ksoftirqd/011:00:030
3163761994432,9cyclictest3168534-21cat08:40:000
3163761994431,9cyclictest235-21systemd-journal09:20:420
3163771994327,13cyclictest37-21ksoftirqd/310:30:003
3163771994323,13cyclictest235-21systemd-journal08:40:003
316377199431,4cyclictest0-21swapper/307:50:013
316376199431,38cyclictest3166006-21sshd07:53:410
316377199424,21cyclictest0-21swapper/309:00:013
316377199424,21cyclictest0-21swapper/309:00:013
3163771994233,5cyclictest3164197-21cron07:20:003
3163771994228,9cyclictest235-21systemd-journal08:12:123
3163771994226,12cyclictest274-21dbus-daemon12:10:003
3163769994222,16cyclictest3164459-21sshd07:21:402
316376199423,7cyclictest12-21ksoftirqd/012:20:030
3163761994233,7cyclictest12-21ksoftirqd/008:48:420
3163761994229,9cyclictest235-21systemd-journal07:45:000
3163761994227,10cyclictest12-21ksoftirqd/007:10:020
3163771994128,10cyclictest235-21systemd-journal11:22:483
3163769994122,16cyclictest3180721-21sshd12:31:002
3163769994122,16cyclictest3180721-21sshd12:30:592
316376199417,19cyclictest16750irq/134-800000011:10:420
3163761994134,4cyclictest16850irq/224-800000008:55:030
3163761994132,7cyclictest12-21ksoftirqd/008:12:130
316376199413,10cyclictest12-21ksoftirqd/009:46:440
3163761994130,7cyclictest308-21systemd-logind11:30:010
316377199405,7cyclictest37-21ksoftirqd/308:24:193
3163771994025,11cyclictest235-21systemd-journal08:43:483
316376199407,6cyclictest131rcu_preempt09:35:230
316376199407,5cyclictest131rcu_preempt10:05:550
316376199406,6cyclictest12-21ksoftirqd/011:53:430
316376199403,9cyclictest12-21ksoftirqd/009:20:000
3163761994030,7cyclictest3170556-21latency_hist09:15:020
316377199396,8cyclictest37-21ksoftirqd/307:40:013
3163771993929,6cyclictest304-21in:imuxsock12:30:003
3163771993928,7cyclictest3178643-21sshd11:51:433
3163771993927,9cyclictest274-21dbus-daemon10:00:013
3163771993924,11cyclictest235-21systemd-journal08:35:013
3163771993924,10cyclictest274-21dbus-daemon09:35:023
3163771993922,13cyclictest274-21dbus-daemon09:05:003
316376199394,7cyclictest12-21ksoftirqd/011:40:420
3163761993934,3cyclictest0-21swapper/008:35:000
316376199392,10cyclictest12-21ksoftirqd/009:14:200
316376199391,34cyclictest0-21swapper/010:41:180
316377199386,7cyclictest37-21ksoftirqd/310:19:323
316377199384,7cyclictest37-21ksoftirqd/310:45:353
316377199384,7cyclictest37-21ksoftirqd/310:45:353
3163771993827,9cyclictest37-21ksoftirqd/310:51:423
316377199382,26cyclictest0-21swapper/309:10:003
3163771993819,13cyclictest274-21dbus-daemon12:40:013
316376199387,7cyclictest12-21ksoftirqd/010:19:040
316376199385,6cyclictest12-21ksoftirqd/008:44:430
3163761993825,10cyclictest12-21ksoftirqd/009:27:420
3163761993823,10cyclictest235-21systemd-journal07:30:000
316376199381,6cyclictest3170101-21munin-run09:10:000
316376199381,33cyclictest0-21swapper/009:05:000
316377199376,7cyclictest37-21ksoftirqd/308:20:023
316377199375,9cyclictest37-21ksoftirqd/307:30:003
3163771993728,5cyclictest3176085-21munin-plugin-st11:05:003
3163771993726,7cyclictest3171172-21latency_hist09:30:013
3163771993725,9cyclictest37-21ksoftirqd/312:05:023
3163771993725,9cyclictest235-21systemd-journal12:16:493
3163771993725,10cyclictest37-21ksoftirqd/309:20:003
3163771993723,11cyclictest3171831-21sed09:40:023
3163771993722,11cyclictest235-21systemd-journal07:30:193
3163771993721,8cyclictest37-21ksoftirqd/311:35:023
316376199373,7cyclictest12-21ksoftirqd/010:54:590
316376199373,18cyclictest3177880-21modprobe11:40:000
3163761993727,7cyclictest3172943-21sshd10:01:420
316376199371,9cyclictest151rcuc/010:26:410
3163761993719,15cyclictest3180468-21sshd12:25:580
316376199371,32cyclictest0-21swapper/009:33:050
316377199366,6cyclictest37-21ksoftirqd/310:10:003
316377199365,7cyclictest37-21ksoftirqd/310:35:013
3163771993627,7cyclictest37-21ksoftirqd/308:10:013
3163771993624,9cyclictest37-21ksoftirqd/310:59:513
3163771993624,8cyclictest1-21systemd09:15:023
3163771993624,8cyclictest1-21systemd09:15:013
3163761993623,9cyclictest274-21dbus-daemon09:45:010
3163761993623,10cyclictest401-21lldpd07:39:470
3163761993623,10cyclictest12-21ksoftirqd/011:34:430
316376199362,30cyclictest0-21swapper/012:35:020
316376199362,30cyclictest0-21swapper/012:35:020
316377199354,8cyclictest37-21ksoftirqd/311:40:423
3163771993527,5cyclictest3165551-21latency_hist07:45:013
3163771993524,8cyclictest274-21dbus-daemon11:20:013
316377199351,3cyclictest0-21swapper/307:55:413
3163761993526,6cyclictest12-21ksoftirqd/010:40:020
3163761993521,11cyclictest12-21ksoftirqd/012:10:000
3163771993427,4cyclictest3164486-21latency_hist07:25:013
3163771993425,5cyclictest3173517-21latency_hist10:15:033
3163771993422,9cyclictest37-21ksoftirqd/312:33:323
3163771993422,9cyclictest37-21ksoftirqd/312:33:323
3163771993421,9cyclictest274-21dbus-daemon09:55:013
3163771993420,11cyclictest37-21ksoftirqd/311:30:013
3163771993419,10cyclictest274-21dbus-daemon07:15:013
3163771993321,9cyclictest37-21ksoftirqd/310:40:023
316377199331,7cyclictest37-21ksoftirqd/308:02:263
3163771993316,12cyclictest274-21dbus-daemon07:55:003
316377199328,14cyclictest0-21swapper/309:44:423
3163771993225,4cyclictest3176562-21kworker/u8:011:40:003
3163771993122,5cyclictest361rcuc/309:47:433
3163771993121,7cyclictest37-21ksoftirqd/311:50:013
3163771993116,11cyclictest274-21dbus-daemon10:45:003
316377199302,7cyclictest37-21ksoftirqd/311:14:053
316377199301,5cyclictest0-21swapper/308:53:353
3163771992922,5cyclictest37-21ksoftirqd/311:06:283
3163771992918,8cyclictest361rcuc/312:13:503
3163771992619,4cyclictest3163691-21latency_hist07:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional