You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-21 - 16:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3s.osadl.org (updated Thu Aug 21, 2025 12:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
685100997148,5cyclictest131rcu_preempt09:55:031
685095996861,3cyclictest12-21ksoftirqd/010:25:020
68509599682,43cyclictest131rcu_preempt11:35:020
68509599651,39cyclictest131rcu_preempt07:45:020
685095996459,3cyclictest0-21swapper/008:25:030
685095996459,3cyclictest0-21swapper/008:25:020
68509599637,11cyclictest12-21ksoftirqd/009:20:020
68509599637,11cyclictest12-21ksoftirqd/009:20:010
68510099625,9cyclictest23-21ksoftirqd/112:40:021
68510099625,9cyclictest23-21ksoftirqd/112:40:011
685095996157,2cyclictest0-21swapper/007:30:020
685100996012,6cyclictest131rcu_preempt12:20:001
68510099594,12cyclictest23-21ksoftirqd/111:00:001
685100995916,12cyclictest23-21ksoftirqd/110:45:021
685100995914,5cyclictest131rcu_preempt09:20:011
685100995914,5cyclictest131rcu_preempt09:20:001
68510099586,5cyclictest131rcu_preempt10:25:011
685100995821,10cyclictest23-21ksoftirqd/110:30:011
685100995812,6cyclictest131rcu_preempt09:40:011
68509599581,36cyclictest131rcu_preempt12:30:020
68510099579,11cyclictest23-21ksoftirqd/110:35:021
68510099579,11cyclictest23-21ksoftirqd/110:35:021
68510099575,7cyclictest131rcu_preempt10:20:021
68510499566,37cyclictest696515-21kworker/u8:311:10:012
685100995637,15cyclictest235-21systemd-journal09:00:001
685100995612,16cyclictest131rcu_preempt07:35:031
68509599562,36cyclictest16950irq/224-800000007:20:020
685100995513,4cyclictest131rcu_preempt07:55:001
685100995510,6cyclictest131rcu_preempt10:40:011
685095995530,7cyclictest235-21systemd-journal11:00:380
68509599544,7cyclictest12-21ksoftirqd/009:30:020
685109995335,14cyclictest1-21systemd10:35:013
685109995335,14cyclictest1-21systemd10:35:003
685104995335,14cyclictest1-21systemd08:55:002
68510099537,6cyclictest131rcu_preempt07:40:021
68510099535,10cyclictest23-21ksoftirqd/111:40:021
685100995311,6cyclictest131rcu_preempt07:41:211
685095995335,14cyclictest235-21systemd-journal08:35:000
68509599533,12cyclictest0-21swapper/008:00:000
685109995234,14cyclictest272-21dbus-daemon11:19:593
68510099529,7cyclictest131rcu_preempt10:15:011
68510099523,11cyclictest23-21ksoftirqd/108:50:011
685100995216,11cyclictest23-21ksoftirqd/109:49:591
685095995211,6cyclictest131rcu_preempt10:20:010
685104995132,14cyclictest235-21systemd-journal08:05:002
685100995135,11cyclictest235-21systemd-journal07:30:001
685100995116,7cyclictest23-21ksoftirqd/112:05:011
685100995111,6cyclictest131rcu_preempt12:35:011
685095995132,14cyclictest235-21systemd-journal10:10:000
685095995121,11cyclictest12-21ksoftirqd/011:45:020
685095995121,11cyclictest12-21ksoftirqd/011:45:010
685104995034,12cyclictest1-21systemd08:50:012
68510099509,6cyclictest131rcu_preempt09:05:031
68510099507,9cyclictest23-21ksoftirqd/111:09:591
68510099506,18cyclictest23-21ksoftirqd/111:45:011
68510099506,18cyclictest23-21ksoftirqd/111:45:001
68510099504,9cyclictest23-21ksoftirqd/109:24:591
685100995038,9cyclictest23-21ksoftirqd/111:20:011
685100995015,5cyclictest131rcu_preempt08:55:021
685100995012,6cyclictest131rcu_preempt07:15:011
685100995010,6cyclictest131rcu_preempt11:35:001
68509599503,6cyclictest131rcu_preempt10:50:020
685095995029,14cyclictest235-21systemd-journal07:50:000
685095995019,9cyclictest131rcu_preempt12:40:010
685095995019,9cyclictest131rcu_preempt12:40:010
68509599501,6cyclictest131rcu_preempt08:05:030
685095995013,6cyclictest131rcu_preempt11:25:010
685109994934,11cyclictest235-21systemd-journal07:20:003
685109994931,13cyclictest272-21dbus-daemon12:05:003
685100994930,15cyclictest1-21systemd07:50:011
685100994913,8cyclictest131rcu_preempt10:10:011
685100994912,8cyclictest23-21ksoftirqd/108:10:021
68509599498,6cyclictest131rcu_preempt11:19:590
68509599494,6cyclictest131rcu_preempt12:19:590
68509599494,5cyclictest131rcu_preempt08:50:000
685095994923,4cyclictest131rcu_preempt08:59:170
68509599491,5cyclictest131rcu_preempt09:50:000
685095994910,5cyclictest131rcu_preempt11:55:010
685109994833,11cyclictest1-21systemd08:25:023
685109994833,11cyclictest1-21systemd08:25:013
685109994811,6cyclictest131rcu_preempt08:52:213
685104994835,9cyclictest272-21dbus-daemon11:40:012
68510099486,6cyclictest131rcu_preempt09:45:011
68510099486,11cyclictest23-21ksoftirqd/109:35:001
68510099485,6cyclictest131rcu_preempt08:30:011
68510099483,9cyclictest23-21ksoftirqd/110:00:211
68510099482,6cyclictest131rcu_preempt11:30:021
68510099482,6cyclictest131rcu_preempt11:30:011
685100994812,5cyclictest131rcu_preempt11:15:011
685100994811,6cyclictest131rcu_preempt12:10:031
68509599484,6cyclictest131rcu_preempt09:04:210
68509599483,35cyclictest685099-21latency_hist07:10:010
68509599481,4cyclictest131rcu_preempt07:25:010
685095994811,12cyclictest12-21ksoftirqd/009:45:020
685109994712,6cyclictest131rcu_preempt07:30:013
685104994729,12cyclictest689973-21cron08:44:592
68510099478,9cyclictest23-21ksoftirqd/107:59:051
68510099477,10cyclictest23-21ksoftirqd/111:50:011
68510099475,8cyclictest23-21ksoftirqd/112:26:361
685100994728,15cyclictest272-21dbus-daemon08:25:021
685100994728,15cyclictest272-21dbus-daemon08:25:011
685100994714,5cyclictest131rcu_preempt10:50:021
685100994713,6cyclictest131rcu_preempt11:25:001
68509599477,7cyclictest131rcu_preempt08:55:060
68509599476,6cyclictest131rcu_preempt09:40:000
68510999467,5cyclictest131rcu_preempt10:15:023
68510999463,3cyclictest131rcu_preempt07:35:013
685104994619,5cyclictest30-21ksoftirqd/211:55:022
68510099468,6cyclictest131rcu_preempt07:20:021
685100994616,10cyclictest23-21ksoftirqd/109:05:001
685100994614,5cyclictest131rcu_preempt08:45:001
685100994612,5cyclictest131rcu_preempt08:35:021
685100994611,5cyclictest131rcu_preempt10:00:001
685100994611,5cyclictest131rcu_preempt08:18:211
685100994610,6cyclictest131rcu_preempt11:05:011
68509599466,5cyclictest131rcu_preempt12:35:010
685095994630,11cyclictest686587-21cron07:40:010
68509599462,4cyclictest131rcu_preempt09:15:020
68510999453,37cyclictest699096-21cron11:40:003
685109994529,12cyclictest1-21systemd08:05:013
68510499454,3cyclictest131rcu_preempt11:45:022
68510499454,3cyclictest131rcu_preempt11:45:012
685104994533,9cyclictest235-21systemd-journal11:25:212
685104994533,9cyclictest235-21systemd-journal11:25:202
68510499452,6cyclictest131rcu_preempt08:40:012
68510499452,6cyclictest131rcu_preempt08:40:002
685104994510,25cyclictest30-21ksoftirqd/211:35:022
68510099459,6cyclictest131rcu_preempt09:26:221
685100994534,8cyclictest23-21ksoftirqd/107:24:591
685100994512,5cyclictest131rcu_preempt12:24:581
68509599456,5cyclictest131rcu_preempt10:45:010
685095994538,4cyclictest16950irq/224-800000009:25:000
68509599453,6cyclictest131rcu_preempt08:20:010
685095994536,6cyclictest12-21ksoftirqd/012:23:510
68509599453,5cyclictest131rcu_preempt09:09:590
68509599452,10cyclictest12-21ksoftirqd/011:40:000
68509599451,5cyclictest131rcu_preempt10:00:030
685095994512,9cyclictest12-21ksoftirqd/011:30:010
685095994512,9cyclictest12-21ksoftirqd/011:30:010
685095994512,6cyclictest131rcu_preempt08:40:010
685095994512,6cyclictest131rcu_preempt08:40:000
68510999445,4cyclictest131rcu_preempt09:35:033
68510999444,7cyclictest37-21ksoftirqd/310:55:003
685104994430,10cyclictest687743-21sed08:00:022
68510499442,22cyclictest0-21swapper/208:29:222
68510499441,21cyclictest0-21swapper/212:25:212
68510099449,5cyclictest131rcu_preempt12:10:021
68510099449,5cyclictest131rcu_preempt12:10:021
685100994411,5cyclictest131rcu_preempt12:00:011
685100994411,5cyclictest131rcu_preempt12:00:011
68509599449,5cyclictest131rcu_preempt08:30:000
68509599447,8cyclictest12-21ksoftirqd/010:30:000
68509599447,5cyclictest131rcu_preempt12:05:010
68509599445,6cyclictest131rcu_preempt07:30:000
68509599442,5cyclictest131rcu_preempt11:10:010
68509599442,5cyclictest131rcu_preempt07:15:000
68509599441,5cyclictest131rcu_preempt12:15:010
68509599441,5cyclictest131rcu_preempt12:15:000
68510999437,5cyclictest131rcu_preempt09:10:013
685109994324,14cyclictest688676-21run-parts08:20:003
685104994330,10cyclictest691007-21cron09:05:012
68510099439,5cyclictest131rcu_preempt11:55:011
68509599437,5cyclictest131rcu_preempt10:35:020
68509599437,5cyclictest131rcu_preempt10:35:010
685095994336,4cyclictest16950irq/224-800000010:15:000
685095994315,21cyclictest131rcu_preempt10:50:000
685095994314,5cyclictest131rcu_preempt07:55:010
68510999429,6cyclictest131rcu_preempt10:25:003
685109994227,11cyclictest37-21ksoftirqd/310:00:023
685109994227,11cyclictest235-21systemd-journal09:10:033
685109994227,11cyclictest1-21systemd10:50:013
68510999422,33cyclictest685854-21grep07:25:023
68510999421,7cyclictest700940-21unin-run12:15:023
68510999421,7cyclictest700940-21unin-run12:15:013
685104994231,7cyclictest695223-21cron10:24:592
685104994229,10cyclictest235-21systemd-journal11:05:012
685104994223,15cyclictest1-21systemd08:10:022
685104994210,6cyclictest131rcu_preempt09:50:002
68510099423,5cyclictest0-21swapper/109:15:011
685100994215,17cyclictest23-21ksoftirqd/108:40:001
685100994215,17cyclictest23-21ksoftirqd/108:40:001
68509599424,5cyclictest131rcu_preempt11:00:010
68509599423,4cyclictest131rcu_preempt08:15:000
685095994229,9cyclictest235-21systemd-journal08:44:590
68509599421,4cyclictest131rcu_preempt08:10:020
68510999415,7cyclictest37-21ksoftirqd/312:35:223
68510999415,7cyclictest37-21ksoftirqd/312:35:223
68510999413,5cyclictest131rcu_preempt09:50:013
685109994127,11cyclictest37-21ksoftirqd/309:56:173
685109994124,11cyclictest1-21systemd11:50:003
685109994119,3cyclictest37-21ksoftirqd/312:20:013
68510499414,8cyclictest30-21ksoftirqd/207:35:002
68510499413,11cyclictest131rcu_preempt07:15:012
685104994128,10cyclictest272-21dbus-daemon12:20:002
685104994127,11cyclictest1-21systemd10:55:002
685104994126,11cyclictest272-21dbus-daemon10:00:002
68509599419,6cyclictest131rcu_preempt11:15:000
68509599417,5cyclictest131rcu_preempt09:35:030
68509599412,4cyclictest131rcu_preempt10:40:000
68509599411,5cyclictest131rcu_preempt09:55:010
685109994028,8cyclictest693077-21sshd09:41:213
685109994022,5cyclictest37-21ksoftirqd/308:10:013
685109994022,13cyclictest235-21systemd-journal10:20:003
685109994017,4cyclictest37-21ksoftirqd/308:36:183
685109994017,4cyclictest37-21ksoftirqd/308:36:173
68510499406,3cyclictest131rcu_preempt09:10:012
68510499405,5cyclictest131rcu_preempt12:00:012
68510499405,5cyclictest131rcu_preempt12:00:002
68510499404,3cyclictest131rcu_preempt09:15:012
68510499403,6cyclictest131rcu_preempt12:40:022
68510499403,6cyclictest131rcu_preempt12:40:012
68510499403,3cyclictest131rcu_preempt09:20:002
68510499403,3cyclictest131rcu_preempt09:20:002
68510499403,3cyclictest131rcu_preempt09:00:012
685104994030,8cyclictest30-21ksoftirqd/209:55:002
68510499402,6cyclictest131rcu_preempt11:49:592
685104994024,11cyclictest30-21ksoftirqd/210:30:032
68510499401,4cyclictest131rcu_preempt11:19:592
68510499401,4cyclictest131rcu_preempt08:20:002
68510499401,3cyclictest131rcu_preempt09:25:022
68510499401,31cyclictest272-21dbus-daemon09:30:002
685104994012,7cyclictest131rcu_preempt11:00:012
68510099405,9cyclictest23-21ksoftirqd/108:15:011
68510999396,3cyclictest131rcu_preempt11:30:023
68510999396,3cyclictest131rcu_preempt11:30:013
685109993930,7cyclictest37-21ksoftirqd/307:55:013
685109993927,8cyclictest235-21systemd-journal09:00:013
685109993926,9cyclictest235-21systemd-journal11:35:013
685109993926,9cyclictest235-21systemd-journal09:05:003
685109993919,13cyclictest272-21dbus-daemon12:35:003
685104993926,10cyclictest701005-21date12:15:022
685104993926,10cyclictest701005-21date12:15:012
685104993926,10cyclictest1-21systemd10:05:022
68510499392,4cyclictest131rcu_preempt12:25:012
685104993924,11cyclictest306-21in:imuxsock07:55:002
68510499392,3cyclictest131rcu_preempt11:15:032
68510499392,10cyclictest700720-21latency_hist12:10:012
68510499391,5cyclictest131rcu_preempt10:35:022
68510499391,5cyclictest131rcu_preempt10:35:012
68510099395,5cyclictest131rcu_preempt10:55:021
685095993918,5cyclictest12-21ksoftirqd/011:50:000
685095993913,21cyclictest131rcu_preempt12:10:010
68510999382,7cyclictest0-21swapper/312:10:003
685109993827,7cyclictest698349-21munin-plugin-st11:25:013
685109993825,10cyclictest37-21ksoftirqd/307:40:033
68510499384,3cyclictest131rcu_preempt09:39:592
68510499383,3cyclictest131rcu_preempt10:20:002
68510499383,3cyclictest131rcu_preempt07:45:012
68510499383,11cyclictest131rcu_preempt07:20:002
68510499382,6cyclictest30-21ksoftirqd/207:40:002
68510499382,5cyclictest131rcu_preempt09:45:012
685104993824,10cyclictest1-21systemd07:25:002
68510499382,3cyclictest131rcu_preempt12:35:022
68510099389,6cyclictest131rcu_preempt07:10:011
68509599382,6cyclictest131rcu_preempt12:00:010
68509599382,6cyclictest131rcu_preempt12:00:000
685095993811,9cyclictest131rcu_preempt10:05:010
68510999376,3cyclictest131rcu_preempt08:34:113
68510999373,6cyclictest131rcu_preempt11:56:343
68510999373,6cyclictest131rcu_preempt11:56:333
68510999373,3cyclictest131rcu_preempt11:05:023
685109993728,6cyclictest37-21ksoftirqd/308:30:013
685109993727,7cyclictest37-21ksoftirqd/310:39:593
685109993723,10cyclictest37-21ksoftirqd/310:30:003
685109993722,11cyclictest272-21dbus-daemon07:15:003
68510499374,3cyclictest131rcu_preempt10:39:592
68510499374,3cyclictest131rcu_preempt08:15:002
685104993727,6cyclictest696541-21latency_hist10:50:022
685104993725,8cyclictest686269-21sed07:30:032
685104993724,10cyclictest687104-21sshd07:49:212
685104993723,12cyclictest694667-21sshd10:11:222
68510499371,3cyclictest131rcu_preempt10:10:012
68510999363,3cyclictest131rcu_preempt08:15:013
685109993626,7cyclictest1-21systemd08:45:013
685109993622,10cyclictest37-21ksoftirqd/309:17:013
685109993622,10cyclictest37-21ksoftirqd/309:17:003
68510999361,7cyclictest0-21swapper/311:45:013
68510999361,7cyclictest0-21swapper/311:45:003
68510999361,3cyclictest131rcu_preempt09:55:003
68510499365,5cyclictest131rcu_preempt09:35:022
68510499365,4cyclictest131rcu_preempt10:45:022
68510499363,4cyclictest131rcu_preempt12:05:012
68510499361,7cyclictest30-21ksoftirqd/207:10:012
68510099366,9cyclictest23-21ksoftirqd/108:05:001
68510999355,3cyclictest131rcu_preempt09:29:233
68510999354,3cyclictest131rcu_preempt09:39:253
68510999344,3cyclictest131rcu_preempt11:10:013
685109993426,5cyclictest701227-21kworker/3:212:25:003
685109993426,5cyclictest697005-21sshd10:58:223
685109993426,5cyclictest690519-21kworker/3:110:10:023
685109993426,4cyclictest701704-21cron12:30:013
685109993424,6cyclictest687623-21sh08:00:003
685109993423,6cyclictest306-21in:imuxsock07:50:023
68510499342,3cyclictest131rcu_preempt11:25:012
68510499342,3cyclictest131rcu_preempt08:25:012
68510499342,3cyclictest131rcu_preempt08:25:012
68510499341,4cyclictest131rcu_preempt08:35:002
685109993325,5cyclictest685303-21kworker/3:207:40:023
685109993321,8cyclictest1-21systemd09:25:003
685109993316,13cyclictest272-21dbus-daemon08:50:003
68510999323,4cyclictest131rcu_preempt10:45:013
685109993217,3cyclictest37-21ksoftirqd/307:10:023
685109993118,9cyclictest1-21systemd11:55:013
685109993020,7cyclictest697790-21sshd11:13:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional