You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 11:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3s.osadl.org (updated Tue Nov 25, 2025 00:45:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4135162991082,3cyclictest131rcu_preempt21:45:022
4135155991021,98cyclictest0-21swapper/000:35:030
413516099896,5cyclictest23-21ksoftirqd/121:00:021
413515599681,4cyclictest131rcu_preempt21:50:010
413515599666,7cyclictest121ksoftirqd/022:28:200
413515599664,9cyclictest12-21ksoftirqd/023:40:010
413515599664,9cyclictest12-21ksoftirqd/023:40:000
413515599642,5cyclictest131rcu_preempt22:04:210
413516699634,9cyclictest37-21ksoftirqd/300:00:003
413515599636,10cyclictest12-21ksoftirqd/022:45:000
413515599627,25cyclictest131rcu_preempt20:05:020
4135160996014,7cyclictest23-21ksoftirqd/123:30:021
4135155996017,6cyclictest131rcu_preempt20:25:000
4135155996010,6cyclictest131rcu_preempt23:10:020
413515599596,5cyclictest131rcu_preempt20:00:020
413515599591,7cyclictest121ksoftirqd/022:10:210
413515599591,11cyclictest12-21ksoftirqd/000:15:000
4135155995910,5cyclictest131rcu_preempt22:20:010
4135162995838,15cyclictest235-21systemd-journal00:15:002
413515599589,5cyclictest131rcu_preempt20:15:020
413515599586,8cyclictest12-21ksoftirqd/020:50:020
4135155995813,5cyclictest131rcu_preempt19:45:020
4135155995711,5cyclictest131rcu_preempt19:50:020
413516099566,7cyclictest23-21ksoftirqd/100:30:021
413515599567,6cyclictest131rcu_preempt23:00:010
413515599566,11cyclictest12-21ksoftirqd/020:30:020
413515599562,5cyclictest131rcu_preempt00:10:020
413516699551,5cyclictest131rcu_preempt23:40:013
413516699551,5cyclictest131rcu_preempt23:40:003
413516099559,10cyclictest23-21ksoftirqd/123:20:021
413516099558,8cyclictest23-21ksoftirqd/119:20:001
413516099555,8cyclictest23-21ksoftirqd/122:30:011
413515599558,6cyclictest131rcu_preempt00:40:020
413515599554,6cyclictest12-21ksoftirqd/023:05:020
4135155995524,8cyclictest12-21ksoftirqd/022:40:030
413515599551,5cyclictest131rcu_preempt21:24:210
4135155995515,10cyclictest12-21ksoftirqd/019:40:010
413516099549,9cyclictest23-21ksoftirqd/121:55:021
413516099544,8cyclictest23-21ksoftirqd/121:40:011
413516099544,8cyclictest23-21ksoftirqd/120:45:021
413516099543,8cyclictest23-21ksoftirqd/120:40:001
413516099542,18cyclictest23-21ksoftirqd/122:50:021
413516099542,18cyclictest23-21ksoftirqd/122:50:021
413515599547,9cyclictest12-21ksoftirqd/021:55:020
413515599546,8cyclictest12-21ksoftirqd/020:10:010
413515599546,6cyclictest131rcu_preempt23:15:020
4135155995413,6cyclictest131rcu_preempt00:00:020
4135155995410,5cyclictest131rcu_preempt22:50:020
4135155995410,5cyclictest131rcu_preempt22:50:020
413516699536,8cyclictest37-21ksoftirqd/321:20:003
413516099539,8cyclictest23-21ksoftirqd/119:50:011
413516099537,9cyclictest23-21ksoftirqd/100:02:561
413516099536,10cyclictest23-21ksoftirqd/122:55:011
413516099533,9cyclictest23-21ksoftirqd/121:05:011
413516099533,10cyclictest23-21ksoftirqd/119:45:021
4135160995321,9cyclictest23-21ksoftirqd/122:00:011
4135160995313,11cyclictest23-21ksoftirqd/122:25:021
4135160995311,10cyclictest23-21ksoftirqd/120:50:021
413515599539,11cyclictest12-21ksoftirqd/021:15:000
413515599538,8cyclictest12-21ksoftirqd/022:00:000
413515599537,9cyclictest12-21ksoftirqd/000:30:000
413515599536,7cyclictest12-21ksoftirqd/023:55:020
413515599536,7cyclictest12-21ksoftirqd/023:55:020
413515599535,9cyclictest12-21ksoftirqd/000:05:000
4135155995344,5cyclictest4135158-21ls19:10:020
4135155995310,7cyclictest131rcu_preempt21:40:010
4135155995310,5cyclictest131rcu_preempt19:30:020
413516699525,8cyclictest37-21ksoftirqd/323:25:023
4135166995232,9cyclictest37-21ksoftirqd/321:35:003
4135166995223,21cyclictest361rcuc/322:00:023
4135162995245,5cyclictest30-21ksoftirqd/222:35:022
4135162995245,5cyclictest30-21ksoftirqd/222:35:022
413516099529,9cyclictest23-21ksoftirqd/120:25:011
413516099528,8cyclictest23-21ksoftirqd/123:00:021
413516099528,7cyclictest23-21ksoftirqd/121:17:001
413516099525,9cyclictest23-21ksoftirqd/100:15:011
413516099525,11cyclictest23-21ksoftirqd/121:45:011
413516099524,10cyclictest23-21ksoftirqd/100:40:011
413515599529,5cyclictest131rcu_preempt23:30:020
413515599523,7cyclictest12-21ksoftirqd/021:30:020
413515599523,40cyclictest4149698-21modprobe23:50:000
413515599522,8cyclictest12-21ksoftirqd/021:45:010
4135155995214,10cyclictest12-21ksoftirqd/020:20:020
4135155995213,11cyclictest12-21ksoftirqd/020:30:020
4135155995212,6cyclictest131rcu_preempt21:10:020
4135155995210,5cyclictest131rcu_preempt21:20:030
413516099517,7cyclictest23-21ksoftirqd/122:05:021
413516099516,7cyclictest23-21ksoftirqd/123:35:021
413516099515,9cyclictest23-21ksoftirqd/123:40:021
413516099515,9cyclictest23-21ksoftirqd/123:40:021
413516099513,9cyclictest23-21ksoftirqd/100:25:021
4135160995134,13cyclictest272-21dbus-daemon20:15:011
413516099512,10cyclictest23-21ksoftirqd/119:15:011
413515599519,5cyclictest131rcu_preempt00:20:000
413515599517,6cyclictest131rcu_preempt23:20:010
413515599516,7cyclictest12-21ksoftirqd/000:25:020
413515599516,5cyclictest131rcu_preempt19:15:010
413515599515,8cyclictest12-21ksoftirqd/023:25:010
4135155995111,6cyclictest131rcu_preempt23:45:000
4135155995111,6cyclictest131rcu_preempt22:10:010
413516699501,4cyclictest131rcu_preempt19:45:023
4135166995012,6cyclictest131rcu_preempt23:30:003
413516099508,12cyclictest23-21ksoftirqd/120:00:031
413516099507,8cyclictest23-21ksoftirqd/122:10:021
413516099507,6cyclictest0-21swapper/123:50:011
413516099506,8cyclictest23-21ksoftirqd/123:45:031
413516099505,7cyclictest23-21ksoftirqd/100:00:001
413516099505,12cyclictest23-21ksoftirqd/121:30:001
413516099504,8cyclictest23-21ksoftirqd/119:55:001
413516099504,12cyclictest23-21ksoftirqd/100:20:001
413515599509,5cyclictest131rcu_preempt20:45:020
413515599506,5cyclictest131rcu_preempt19:35:020
413515599506,10cyclictest12-21ksoftirqd/022:25:000
413515599505,11cyclictest12-21ksoftirqd/019:20:000
413515599504,10cyclictest12-21ksoftirqd/021:35:020
4135155995013,9cyclictest12-21ksoftirqd/021:00:010
4135166994938,7cyclictest361rcuc/300:05:013
4135166994933,12cyclictest272-21dbus-daemon20:15:013
413516099496,9cyclictest23-21ksoftirqd/122:34:221
413516099496,9cyclictest23-21ksoftirqd/122:34:211
413516099496,6cyclictest23-21ksoftirqd/100:35:021
413516099495,11cyclictest23-21ksoftirqd/120:55:021
413516099494,9cyclictest23-21ksoftirqd/123:15:011
413516099491,12cyclictest23-21ksoftirqd/123:10:031
413516099491,11cyclictest23-21ksoftirqd/119:30:031
413515599499,7cyclictest131rcu_preempt19:55:030
4135155994913,6cyclictest131rcu_preempt23:35:010
4135155994910,4cyclictest131rcu_preempt21:05:030
413516699485,6cyclictest131rcu_preempt21:30:023
413516699484,10cyclictest37-21ksoftirqd/300:30:003
4135166994838,7cyclictest37-21ksoftirqd/321:10:003
4135166994834,8cyclictest1-21systemd22:25:003
4135166994821,6cyclictest361rcuc/323:45:013
413516699481,8cyclictest4136172-21sed19:30:023
4135162994830,13cyclictest235-21systemd-journal22:50:012
4135162994830,13cyclictest235-21systemd-journal22:50:012
4135162994827,15cyclictest272-21dbus-daemon00:00:002
413516099488,9cyclictest23-21ksoftirqd/122:20:021
413516099485,8cyclictest23-21ksoftirqd/120:10:021
413516099485,10cyclictest23-21ksoftirqd/121:35:021
413516099483,7cyclictest23-21ksoftirqd/121:25:011
413515599488,4cyclictest131rcu_preempt19:25:010
413515599487,8cyclictest12-21ksoftirqd/022:35:020
413515599487,8cyclictest12-21ksoftirqd/022:35:020
4135155994811,6cyclictest131rcu_preempt20:55:020
413516699479,8cyclictest37-21ksoftirqd/319:35:013
413516699474,7cyclictest37-21ksoftirqd/322:20:003
4135166994737,7cyclictest37-21ksoftirqd/300:17:003
413516699472,12cyclictest37-21ksoftirqd/321:45:013
413516699471,10cyclictest37-21ksoftirqd/319:40:003
4135166994710,8cyclictest37-21ksoftirqd/321:48:213
413516099476,9cyclictest23-21ksoftirqd/119:40:001
413516099474,8cyclictest23-21ksoftirqd/120:35:011
413516099474,11cyclictest23-21ksoftirqd/121:10:021
413516099472,11cyclictest23-21ksoftirqd/119:35:021
413516099471,13cyclictest4146127-21sed22:40:011
413516099471,12cyclictest23-21ksoftirqd/119:10:021
413515599475,11cyclictest12-21ksoftirqd/020:40:000
413515599471,8cyclictest12-21ksoftirqd/022:55:020
413516699467,6cyclictest131rcu_preempt22:45:003
413516699466,6cyclictest131rcu_preempt20:45:023
413516699465,9cyclictest37-21ksoftirqd/321:55:003
4135166994638,6cyclictest37-21ksoftirqd/321:40:013
4135166994627,14cyclictest272-21dbus-daemon00:15:013
4135162994628,14cyclictest4140781-21sshd20:59:222
413516099464,6cyclictest23-21ksoftirqd/120:00:011
413516099463,6cyclictest23-21ksoftirqd/100:10:021
413516099462,10cyclictest23-21ksoftirqd/121:10:021
413516099461,5cyclictest0-21swapper/122:15:021
413516099461,12cyclictest23-21ksoftirqd/119:25:021
413516699453,6cyclictest131rcu_preempt22:50:023
413516699453,6cyclictest131rcu_preempt22:50:023
4135166994536,7cyclictest361rcuc/320:55:013
413516699453,5cyclictest131rcu_preempt21:00:003
4135166994532,11cyclictest37-21ksoftirqd/322:10:013
4135166994530,11cyclictest4147109-21systemctl22:59:593
4135166994518,8cyclictest37-21ksoftirqd/320:40:003
413516699451,7cyclictest0-21swapper/322:05:023
413516699451,10cyclictest37-21ksoftirqd/323:20:003
413516099456,6cyclictest23-21ksoftirqd/122:40:021
413516099454,11cyclictest23-21ksoftirqd/120:30:021
413516099453,8cyclictest23-21ksoftirqd/123:00:021
413516099452,9cyclictest23-21ksoftirqd/123:25:021
413516699447,5cyclictest131rcu_preempt22:15:003
413516699444,9cyclictest131rcu_preempt20:00:023
413516699442,8cyclictest37-21ksoftirqd/323:55:003
413516699442,8cyclictest37-21ksoftirqd/323:55:003
4135166994426,14cyclictest361rcuc/319:50:003
413516699441,7cyclictest0-21swapper/319:55:003
413516699441,6cyclictest131rcu_preempt23:10:013
4135162994429,10cyclictest235-21systemd-journal19:50:002
413516099445,9cyclictest23-21ksoftirqd/121:50:031
413516099441,7cyclictest4149961-21munin-run23:55:001
413516099441,7cyclictest4149961-21munin-run23:55:001
413516699435,9cyclictest131rcu_preempt22:40:023
413516699434,6cyclictest131rcu_preempt23:05:013
4135166994333,7cyclictest37-21ksoftirqd/320:50:013
4135166994316,6cyclictest131rcu_preempt20:20:033
413516699431,5cyclictest0-21swapper/319:15:003
4135166994311,9cyclictest131rcu_preempt22:35:023
413516299431,3cyclictest131rcu_preempt19:25:012
413516099432,9cyclictest23-21ksoftirqd/120:20:011
413516699429,6cyclictest131rcu_preempt23:15:003
413516699424,10cyclictest37-21ksoftirqd/320:25:013
4135166994217,8cyclictest37-21ksoftirqd/323:35:023
4135166994216,22cyclictest361rcuc/300:25:003
4135162994227,11cyclictest272-21dbus-daemon20:55:002
413516699416,7cyclictest37-21ksoftirqd/320:29:213
4135166994128,9cyclictest306-21in:imuxsock22:50:023
4135166994128,10cyclictest37-21ksoftirqd/300:30:063
4135166994115,20cyclictest131rcu_preempt21:05:013
4135166994112,5cyclictest131rcu_preempt22:30:013
4135162994128,10cyclictest272-21dbus-daemon20:50:012
4135162994127,10cyclictest4146998-21sed22:55:022
4135162994126,11cyclictest4143937-21run-parts22:00:002
413516299412,18cyclictest4145774-21kworker/u8:023:05:032
413516699406,5cyclictest131rcu_preempt20:02:223
4135166994028,8cyclictest361rcuc/320:35:003
413516699401,7cyclictest4142133-21modprobe21:25:003
413516299404,10cyclictest30-21ksoftirqd/219:20:002
413516299403,3cyclictest131rcu_preempt19:15:022
4135162994031,6cyclictest30-21ksoftirqd/222:05:002
4135162994027,8cyclictest30-21ksoftirqd/221:10:002
4135162994022,12cyclictest306-21in:imuxsock20:20:012
4135162994020,14cyclictest4136631-21cron19:40:002
413516699393,7cyclictest0-21swapper/321:10:213
4135166993924,11cyclictest1-21systemd00:40:013
4135166993922,12cyclictest272-21dbus-daemon20:10:013
413516699391,7cyclictest0-21swapper/300:10:023
4135162993929,6cyclictest4139761-21sendmail20:40:002
4135162993927,9cyclictest235-21systemd-journal22:20:002
4135162993923,10cyclictest272-21dbus-daemon22:15:002
413516699383,5cyclictest131rcu_preempt23:50:013
4135166993826,7cyclictest361rcuc/322:35:003
413516299384,3cyclictest131rcu_preempt20:05:002
413516299383,8cyclictest131rcu_preempt19:55:002
4135162993829,6cyclictest4146420-21cat22:45:012
4135162993825,9cyclictest235-21systemd-journal23:47:212
4135162993824,10cyclictest235-21systemd-journal20:25:012
4135162993823,11cyclictest306-21in:imuxsock21:35:022
413516299375,22cyclictest4152314-21modprobe00:40:012
4135162993726,8cyclictest4149942-21sshd23:54:212
4135162993726,8cyclictest4149942-21sshd23:54:212
4135162993726,7cyclictest4142367-21sshd21:29:212
4135162993723,9cyclictest235-21systemd-journal19:45:012
413516299371,4cyclictest131rcu_preempt23:45:012
413516699361,5cyclictest131rcu_preempt19:20:003
413516299364,3cyclictest131rcu_preempt21:05:022
413516299362,4cyclictest131rcu_preempt20:15:022
4135162993624,9cyclictest30-21ksoftirqd/223:30:022
4135162993624,9cyclictest30-21ksoftirqd/220:00:012
4135162993623,9cyclictest30-21ksoftirqd/222:30:022
4135162993623,10cyclictest4136368-21sshd19:32:212
4135162993622,11cyclictest235-21systemd-journal00:20:002
4135162993622,10cyclictest30-21ksoftirqd/220:45:012
413516299357,3cyclictest131rcu_preempt00:28:212
413516299356,4cyclictest131rcu_preempt22:55:212
413516299354,4cyclictest131rcu_preempt21:55:002
413516299354,3cyclictest131rcu_preempt22:25:012
413516299353,7cyclictest4149163-21cron23:40:012
413516299353,7cyclictest4149163-21cron23:40:002
4135162993516,14cyclictest272-21dbus-daemon23:35:002
4135162993516,14cyclictest1-21systemd23:15:002
413516299347,3cyclictest131rcu_preempt23:10:012
413516299344,5cyclictest131rcu_preempt22:39:592
413516299343,3cyclictest131rcu_preempt19:10:022
413516299343,25cyclictest4141604-21unin-run21:15:012
4135162993424,8cyclictest30-21ksoftirqd/220:10:012
4135162993423,8cyclictest235-21systemd-journal00:02:262
4135162993422,10cyclictest30-21ksoftirqd/223:20:012
4135162993420,9cyclictest0-21swapper/220:35:032
4135162993417,14cyclictest272-21dbus-daemon21:20:012
4135166993315,7cyclictest131rcu_preempt19:10:023
413516299333,6cyclictest131rcu_preempt20:30:002
413516299333,4cyclictest131rcu_preempt23:25:022
4135162993324,7cyclictest30-21ksoftirqd/200:35:022
4135162993319,11cyclictest1-21systemd19:30:012
413516699325,5cyclictest131rcu_preempt19:22:283
4135162993219,9cyclictest1-21systemd22:10:022
4135162993218,9cyclictest306-21in:imuxsock21:43:222
413516299321,3cyclictest131rcu_preempt00:25:032
413516299315,4cyclictest131rcu_preempt21:33:212
413516299314,3cyclictest131rcu_preempt21:25:002
4135162993121,7cyclictest4150852-21ls00:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional