You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-29 - 21:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3s.osadl.org (updated Wed May 29, 2024 12:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
554617991101,88cyclictest0-21swapper/011:40:020
554617999689,2cyclictest0-21swapper/011:00:030
554617999070,17cyclictest18650irq/34-mmc108:30:020
55461799862,81cyclictest151rcuc/011:45:020
55461799862,81cyclictest151rcuc/011:45:020
554617997712,60cyclictest16750irq/134-800000009:23:520
55461799751,72cyclictest0-21swapper/009:20:020
554617997418,52cyclictest564947-21sshd10:29:020
55461799691,5cyclictest274-21dbus-daemon09:05:010
55461799671,62cyclictest0-21swapper/008:39:490
554617996662,2cyclictest0-21swapper/007:40:030
554617996634,29cyclictest554627-21latency_hist07:10:020
554617996620,41cyclictest0-21swapper/007:23:110
554617996616,12cyclictest1-21systemd09:40:010
554632996522,9cyclictest37-21ksoftirqd/308:00:013
554617996522,38cyclictest1917536-21snmpd12:20:010
55461799651,5cyclictest570327-21munin-run12:10:000
554617996424,36cyclictest12-21ksoftirqd/008:20:000
55461799641,25cyclictest3554913-1kworker/0:1H07:15:020
55463299636,11cyclictest565466-21modprobe10:40:003
554632996326,34cyclictest569022-21kworker/u8:312:20:003
554628996314,11cyclictest30-21ksoftirqd/212:40:002
554628996314,11cyclictest30-21ksoftirqd/210:15:022
554628996314,11cyclictest30-21ksoftirqd/210:15:022
554628996311,13cyclictest30-21ksoftirqd/208:40:022
55461799635,18cyclictest555850-21cron07:35:000
554617996257,2cyclictest0-21swapper/007:50:020
554617996223,35cyclictest12-21ksoftirqd/009:30:010
554617996217,5cyclictest559989-21sshd08:53:300
554617996217,5cyclictest559989-21sshd08:53:290
554632996122,10cyclictest274-21dbus-daemon11:40:013
55461799602,16cyclictest557934-21munin-run08:15:010
55461799601,18cyclictest274-21dbus-daemon08:45:000
554620995934,16cyclictest274-21dbus-daemon10:30:001
554617995923,32cyclictest560990-21latency_hist09:10:030
554617995923,32cyclictest560990-21latency_hist09:10:020
554617995922,33cyclictest149-21pr/ttyS211:33:290
554617995922,32cyclictest304-21in:imuxsock10:19:590
55461799591,17cyclictest571125-21true12:25:010
554632995817,8cyclictest235-21systemd-journal08:15:013
554632995817,13cyclictest235-21systemd-journal10:15:013
554632995817,13cyclictest235-21systemd-journal10:15:013
55461799581,3cyclictest0-21swapper/010:00:020
55461799581,15cyclictest571759-21cat12:35:020
554632995718,11cyclictest37-21ksoftirqd/307:55:003
55461799572,15cyclictest558486-21munin-run08:25:020
554617995721,33cyclictest565477-21latency_hist10:40:020
554617995719,12cyclictest1-21systemd12:15:010
55461799571,3cyclictest0-21swapper/008:05:020
55461799571,21cyclictest0-21swapper/010:25:010
55461799571,21cyclictest0-21swapper/007:29:020
554632995620,7cyclictest37-21ksoftirqd/308:01:303
55461799562,15cyclictest562635-21munin-run09:45:000
55461799561,19cyclictest562887-21munin-run09:50:000
554632995524,10cyclictest37-21ksoftirqd/308:10:013
554632995515,8cyclictest562289-21cut09:35:023
554632995513,11cyclictest235-21systemd-journal08:15:183
55463299551,18cyclictest565105-21grep10:30:023
55461799559,41cyclictest16750irq/134-800000007:15:310
55461799553,7cyclictest131rcu_preempt10:45:010
554617995525,25cyclictest563695-21cat10:05:010
55463299549,9cyclictest0-21swapper/309:25:023
55463299542,19cyclictest559237-21munin-run08:40:013
554632995420,4cyclictest555611-21latency_hist07:30:033
554632995410,11cyclictest0-21swapper/311:05:013
554620995431,15cyclictest274-21dbus-daemon08:05:011
554617995423,27cyclictest561055-21latency_hist09:15:020
55461799541,49cyclictest0-21swapper/011:23:490
554632995320,8cyclictest37-21ksoftirqd/308:45:013
554628995345,5cyclictest542946-21kworker/2:109:25:022
554628995336,13cyclictest274-21dbus-daemon07:20:002
554628995314,12cyclictest0-21swapper/207:50:012
554628995313,10cyclictest0-21swapper/210:40:012
55462099532,29cyclictest221rcuc/110:15:031
55462099532,29cyclictest221rcuc/110:15:021
55461799538,9cyclictest557138-21cron08:00:010
55461799531,4cyclictest0-21swapper/011:11:400
55461799531,4cyclictest0-21swapper/011:11:400
554632995215,10cyclictest561843-21modprobe09:30:003
55462099525,39cyclictest221rcuc/107:10:011
554620995211,20cyclictest0-21swapper/108:50:021
554617995222,26cyclictest12-21ksoftirqd/011:55:020
554617995218,5cyclictest563312-21latency_hist09:55:020
55461799521,22cyclictest48-21kcompactd011:05:560
554628995135,11cyclictest30-21ksoftirqd/210:00:022
554620995130,14cyclictest274-21dbus-daemon12:25:011
554632995037,9cyclictest235-21systemd-journal12:40:013
55463299502,20cyclictest235-21systemd-journal11:10:023
554620995033,13cyclictest568744-21cron11:40:001
55461799508,5cyclictest16750irq/134-800000008:06:290
554617995021,10cyclictest12-21ksoftirqd/012:30:010
554617995020,4cyclictest559759-21latency_hist08:50:020
55462899499,8cyclictest30-21ksoftirqd/208:10:032
55462899498,8cyclictest30-21ksoftirqd/208:30:012
554628994914,8cyclictest30-21ksoftirqd/211:15:012
554628994914,8cyclictest30-21ksoftirqd/211:15:012
554620994926,16cyclictest274-21dbus-daemon12:30:011
554620994919,20cyclictest274-21dbus-daemon09:35:011
55461799493,17cyclictest568267-21munin-run11:30:020
55461799493,17cyclictest568267-21munin-run11:30:010
554617994921,24cyclictest570147-21latency_hist12:05:010
554617994915,5cyclictest557103-21latency_hist07:55:020
55461799491,4cyclictest0-21swapper/010:57:000
55461799491,16cyclictest563908-21cron10:10:000
554632994830,13cyclictest274-21dbus-daemon10:45:073
554617994820,5cyclictest0-21swapper/010:46:210
55461799481,12cyclictest567707-21cron11:20:000
55461799481,12cyclictest567707-21cron11:20:000
554632994721,10cyclictest37-21ksoftirqd/311:50:013
554632994720,9cyclictest37-21ksoftirqd/311:40:023
554632994720,9cyclictest37-21ksoftirqd/311:40:023
554632994720,5cyclictest566447-21latency_hist10:55:023
554632994718,8cyclictest37-21ksoftirqd/310:18:393
55462899475,8cyclictest30-21ksoftirqd/211:20:022
55462899475,8cyclictest30-21ksoftirqd/211:20:012
554628994730,11cyclictest235-21systemd-journal11:40:002
554617994729,13cyclictest274-21dbus-daemon09:00:010
55461799472,40cyclictest307-21rs:main0
55461799472,15cyclictest564233-21latency_hist10:15:020
55461799472,15cyclictest564233-21latency_hist10:15:020
55461799471,20cyclictest0-21swapper/010:34:400
554632994621,6cyclictest37-21ksoftirqd/312:05:023
554620994631,11cyclictest235-21systemd-journal08:20:001
554620994628,14cyclictest235-21systemd-journal11:30:031
55462099462,30cyclictest221rcuc/107:45:021
55461799462,15cyclictest556206-21latency_hist07:40:010
554632994528,14cyclictest562355-21cron09:40:003
554628994537,4cyclictest561335-21sendmail09:20:002
55462099456,12cyclictest0-21swapper/112:20:001
554620994530,12cyclictest1-21systemd12:35:001
554620994530,11cyclictest1-21systemd11:14:351
554620994530,11cyclictest1-21systemd11:14:351
554632994425,14cyclictest1-21systemd09:05:013
554620994431,10cyclictest23-21ksoftirqd/111:00:031
554620994429,11cyclictest274-21dbus-daemon07:20:011
554620994423,15cyclictest274-21dbus-daemon09:10:011
554620994423,15cyclictest274-21dbus-daemon09:10:011
554617994423,14cyclictest12-21ksoftirqd/011:50:000
55461799442,15cyclictest571874-21modprobe12:40:000
55463299433,3cyclictest131rcu_preempt10:45:033
55462899433,10cyclictest30-21ksoftirqd/208:20:022
554620994332,7cyclictest560033-21latency_hist08:55:021
554620994332,7cyclictest560033-21latency_hist08:55:011
554620994328,11cyclictest274-21dbus-daemon10:40:001
554620994328,10cyclictest1-21systemd12:40:011
554617994329,10cyclictest274-21dbus-daemon12:00:000
554632994224,14cyclictest274-21dbus-daemon12:10:013
55462899423,9cyclictest30-21ksoftirqd/209:55:012
554628994233,5cyclictest564420-21cron10:20:002
554628994229,10cyclictest235-21systemd-journal10:27:192
554628994227,12cyclictest274-21dbus-daemon11:35:002
554628994221,17cyclictest568230-21sshd11:28:292
554628994221,17cyclictest568230-21sshd11:28:292
554628994211,7cyclictest0-21swapper/208:23:242
55462899421,11cyclictest30-21ksoftirqd/208:05:012
554628994122,15cyclictest566888-21sshd11:04:292
554628994112,6cyclictest0-21swapper/209:39:212
554628994110,9cyclictest0-21swapper/208:55:012
554628994110,9cyclictest0-21swapper/208:55:012
55462099414,8cyclictest131rcu_preempt12:15:001
554620994124,11cyclictest274-21dbus-daemon11:27:541
554620994124,11cyclictest274-21dbus-daemon11:27:541
55461799411,5cyclictest0-21swapper/008:35:010
55463299404,6cyclictest131rcu_preempt11:23:293
554632994027,11cyclictest37-21ksoftirqd/312:25:003
554632994027,11cyclictest37-21ksoftirqd/309:55:013
554632994026,11cyclictest37-21ksoftirqd/311:27:543
554632994026,11cyclictest37-21ksoftirqd/311:27:543
554632994026,10cyclictest304-21in:imuxsock08:50:003
554632994025,11cyclictest235-21systemd-journal09:20:003
554632994025,11cyclictest1-21systemd11:00:013
554628994027,10cyclictest570813-21sshd12:17:292
554628994026,11cyclictest30-21ksoftirqd/208:50:012
55462899401,8cyclictest30-21ksoftirqd/210:50:012
55462099403,3cyclictest131rcu_preempt10:31:291
554620994032,5cyclictest570087-21unin-run12:05:001
554620994028,7cyclictest304-21in:imuxsock08:35:011
554620994021,13cyclictest567144-21cron11:10:001
554632993926,9cyclictest37-21ksoftirqd/311:20:003
554632993926,9cyclictest37-21ksoftirqd/311:19:593
554632993917,9cyclictest563376-21cron10:00:013
554628993925,11cyclictest566456-21wc10:55:022
554628993925,11cyclictest30-21ksoftirqd/210:35:012
554628993923,11cyclictest569000-21sshd11:40:302
554628993923,11cyclictest569000-21sshd11:40:302
554628993921,15cyclictest567119-21sshd11:05:292
55462899391,11cyclictest1917536-21snmpd12:09:582
55462099398,7cyclictest23-21ksoftirqd/108:13:371
554620993920,5cyclictest23-21ksoftirqd/111:25:001
554620993919,16cyclictest554782-21sshd07:10:291
554620993913,6cyclictest131rcu_preempt10:00:281
554620993912,6cyclictest131rcu_preempt09:30:011
554632993824,9cyclictest1-21systemd08:25:013
554632993822,11cyclictest235-21systemd-journal12:30:013
554632993819,6cyclictest37-21ksoftirqd/308:59:293
554628993830,5cyclictest563941-21kworker/2:210:45:022
554628993828,8cyclictest30-21ksoftirqd/209:15:022
554628993826,9cyclictest570764-21sed12:15:022
554628993824,11cyclictest564693-21sshd10:24:002
554628993824,10cyclictest30-21ksoftirqd/207:30:012
554628993823,11cyclictest570036-21sshd12:00:292
554620993828,7cyclictest555327-21sshd07:21:291
554620993828,7cyclictest23-21ksoftirqd/109:20:021
554620993826,9cyclictest23-21ksoftirqd/110:45:011
554620993826,10cyclictest23-21ksoftirqd/110:10:011
554617993822,12cyclictest566286-21sshd10:51:290
554632993728,6cyclictest559992-21sshd08:53:463
554632993728,6cyclictest559992-21sshd08:53:453
554632993726,9cyclictest37-21ksoftirqd/308:35:013
554632993726,9cyclictest37-21ksoftirqd/307:35:023
55463299372,5cyclictest131rcu_preempt07:20:023
55462899376,16cyclictest30-21ksoftirqd/207:10:022
554628993729,5cyclictest542946-21kworker/2:108:35:022
554628993724,10cyclictest30-21ksoftirqd/207:35:012
554628993722,11cyclictest568013-21munin-run11:25:012
554628993722,11cyclictest30-21ksoftirqd/211:55:012
554628993722,11cyclictest274-21dbus-daemon11:00:012
554628993719,12cyclictest235-21systemd-journal07:45:002
554628993714,19cyclictest563922-21munin-run10:10:012
554620993729,6cyclictest23-21ksoftirqd/111:05:001
554620993726,9cyclictest23-21ksoftirqd/109:00:001
554620993724,9cyclictest563118-21sshd09:53:561
554620993724,10cyclictest23-21ksoftirqd/109:40:001
554620993722,9cyclictest304-21in:imuxsock07:50:001
55463299362,5cyclictest131rcu_preempt12:00:013
554632993624,9cyclictest37-21ksoftirqd/309:50:013
554632993621,12cyclictest1-21systemd11:14:463
554632993621,12cyclictest1-21systemd11:14:463
554632993620,12cyclictest1-21systemd07:25:013
554628993629,4cyclictest556080-21sshd07:35:312
554628993625,8cyclictest235-21systemd-journal08:15:012
554628993623,8cyclictest30-21ksoftirqd/211:49:142
554628993623,10cyclictest562084-21sshd09:33:532
554628993622,10cyclictest30-21ksoftirqd/212:30:032
554628993621,12cyclictest562864-21sshd09:48:552
554628993621,11cyclictest274-21dbus-daemon12:35:002
554628993620,12cyclictest560468-21wc09:00:012
554628993620,12cyclictest1-21systemd12:00:002
554620993626,8cyclictest23-21ksoftirqd/108:10:011
554620993624,9cyclictest23-21ksoftirqd/110:50:021
55462099362,3cyclictest131rcu_preempt09:25:011
554620993623,10cyclictest23-21ksoftirqd/108:39:171
554620993623,10cyclictest23-21ksoftirqd/108:00:011
554620993622,10cyclictest274-21dbus-daemon10:00:011
554620993621,12cyclictest23-21ksoftirqd/109:14:301
55463299354,4cyclictest131rcu_preempt09:15:003
55463299354,4cyclictest131rcu_preempt07:45:023
554632993523,10cyclictest37-21ksoftirqd/309:05:303
554632993523,10cyclictest37-21ksoftirqd/309:05:293
554632993523,10cyclictest37-21ksoftirqd/308:30:023
554628993523,9cyclictest557128-21sshd07:58:282
554628993522,10cyclictest561821-21sshd09:26:292
554628993522,10cyclictest554792-21sshd07:12:292
554628993522,10cyclictest30-21ksoftirqd/207:54:592
554628993514,17cyclictest560557-21systemd-run09:05:012
554620993525,6cyclictest562621-21cron09:45:011
554620993524,9cyclictest23-21ksoftirqd/111:45:021
554620993524,9cyclictest23-21ksoftirqd/111:45:021
554620993524,9cyclictest23-21ksoftirqd/107:55:011
554620993523,10cyclictest23-21ksoftirqd/112:10:011
554620993523,10cyclictest23-21ksoftirqd/111:48:291
554620993522,9cyclictest274-21dbus-daemon08:29:591
55463299347,3cyclictest131rcu_preempt07:15:013
55463299344,3cyclictest131rcu_preempt12:31:293
554632993422,8cyclictest304-21in:imuxsock07:50:003
554632993420,10cyclictest274-21dbus-daemon10:25:013
554632993420,10cyclictest235-21systemd-journal09:44:283
55463299341,6cyclictest0-21swapper/311:55:023
554628993423,8cyclictest30-21ksoftirqd/208:43:092
554628993421,9cyclictest571173-21date12:25:022
554628993419,11cyclictest30-21ksoftirqd/209:43:562
554620993425,7cyclictest23-21ksoftirqd/111:54:541
554620993424,6cyclictest304-21in:imuxsock12:00:001
554620993420,11cyclictest1-21systemd11:20:011
554620993420,11cyclictest1-21systemd11:20:011
554620993418,12cyclictest235-21systemd-journal07:30:011
554632993325,4cyclictest568503-21munin-plugin-st11:35:003
554632993323,6cyclictest304-21in:imuxsock10:10:003
554632993321,10cyclictest37-21ksoftirqd/312:15:003
554632993320,10cyclictest37-21ksoftirqd/307:39:183
554628993319,10cyclictest555340-21sshd07:23:302
55462099334,3cyclictest131rcu_preempt08:45:011
554620993323,5cyclictest23-21ksoftirqd/110:24:011
554620993322,8cyclictest23-21ksoftirqd/110:20:021
554620993322,7cyclictest304-21in:imuxsock09:46:301
554620993313,15cyclictest274-21dbus-daemon10:55:001
554628993220,9cyclictest560864-21wc09:10:022
554628993220,9cyclictest560864-21wc09:10:012
554628993219,9cyclictest1917536-21snmpd10:04:342
554620993223,5cyclictest23-21ksoftirqd/109:05:001
554620993222,5cyclictest23-21ksoftirqd/108:25:011
554620993222,5cyclictest23-21ksoftirqd/107:40:011
55463299314,4cyclictest131rcu_preempt10:05:023
55462099313,3cyclictest131rcu_preempt07:33:291
554632993018,10cyclictest37-21ksoftirqd/310:35:003
55463299282,4cyclictest131rcu_preempt07:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional