You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-01 - 15:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot3s.osadl.org (updated Thu Jan 01, 2026 12:45:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2459336997652,20cyclictest30-21ksoftirqd/208:09:422
2459336997024,12cyclictest0-21swapper/207:55:032
2459336997024,12cyclictest0-21swapper/207:55:022
2459328996945,6cyclictest131rcu_preempt10:55:020
245932899686,44cyclictest2459329-21latency_hist07:10:020
2459339996327,16cyclictest37-21ksoftirqd/307:50:023
2459336996333,27cyclictest30-21ksoftirqd/208:25:022
245933999621,13cyclictest37-21ksoftirqd/307:15:013
2459336996223,13cyclictest30-21ksoftirqd/210:50:042
245933999619,13cyclictest37-21ksoftirqd/309:20:023
2459339996120,11cyclictest37-21ksoftirqd/309:35:013
2459336996019,10cyclictest309-21in:imuxsock10:50:402
245933699592,21cyclictest2464749-21munin-run08:55:002
245933699592,21cyclictest2464749-21munin-run08:54:592
2459336995920,10cyclictest30-21ksoftirqd/212:35:002
2459336995916,38cyclictest0-21swapper/209:00:002
245933999587,7cyclictest37-21ksoftirqd/308:50:023
2459336995830,25cyclictest30-21ksoftirqd/211:05:012
2459336995821,11cyclictest30-21ksoftirqd/207:39:592
2459328995838,15cyclictest275-21dbus-daemon11:00:020
245933999574,14cyclictest37-21ksoftirqd/311:55:013
2459336995739,13cyclictest238-21systemd-journal07:25:002
2459336995723,5cyclictest2475644-21latency_hist12:25:022
245933999566,6cyclictest37-21ksoftirqd/310:00:013
245933999566,6cyclictest37-21ksoftirqd/310:00:003
245933999566,10cyclictest37-21ksoftirqd/312:10:023
245933999564,9cyclictest37-21ksoftirqd/309:45:003
2459336995623,7cyclictest30-21ksoftirqd/211:00:022
245933999558,9cyclictest37-21ksoftirqd/310:05:023
245933999551,13cyclictest2475678-21sed12:25:023
2459339995510,11cyclictest37-21ksoftirqd/312:05:013
245933999546,10cyclictest37-21ksoftirqd/308:40:003
245933999544,13cyclictest37-21ksoftirqd/309:00:003
2459339995412,10cyclictest37-21ksoftirqd/311:39:593
2459339995411,11cyclictest37-21ksoftirqd/311:20:013
2459339995410,10cyclictest37-21ksoftirqd/310:25:003
2459331995436,13cyclictest238-21systemd-journal12:15:001
245933999537,15cyclictest37-21ksoftirqd/307:20:003
245933999535,8cyclictest37-21ksoftirqd/307:30:013
2459336995318,9cyclictest2467360-21modprobe09:45:012
245932899535,7cyclictest238-21systemd-journal10:35:010
2459328995333,14cyclictest2470190-21cron10:39:590
2459328995330,18cyclictest1-21systemd11:25:010
2459328995310,6cyclictest309-21in:imuxsock12:40:010
245933999521,18cyclictest37-21ksoftirqd/308:35:023
245933999521,13cyclictest37-21ksoftirqd/310:55:023
245933999519,9cyclictest37-21ksoftirqd/311:50:033
245933999519,9cyclictest37-21ksoftirqd/311:50:023
245933999514,10cyclictest37-21ksoftirqd/307:35:023
2459331995130,16cyclictest1-21systemd11:05:011
245932899511,6cyclictest131rcu_preempt07:40:010
245933999507,8cyclictest37-21ksoftirqd/310:30:023
245933999501,8cyclictest0-21swapper/312:00:013
245933999501,13cyclictest37-21ksoftirqd/307:25:033
2459331995034,12cyclictest2470454-21cron10:44:591
245932899502,43cyclictest2474313-21cron12:00:000
245933999496,6cyclictest37-21ksoftirqd/311:00:033
245933999496,10cyclictest37-21ksoftirqd/310:40:013
245933999494,13cyclictest37-21ksoftirqd/309:30:013
245933999493,12cyclictest37-21ksoftirqd/309:50:023
245933999493,12cyclictest37-21ksoftirqd/308:15:013
245933999491,9cyclictest2472051-21sed11:15:023
245933999491,9cyclictest2472051-21sed11:15:013
245933999491,12cyclictest37-21ksoftirqd/310:45:023
2459331994935,10cyclictest238-21systemd-journal08:55:001
2459331994935,10cyclictest238-21systemd-journal08:55:001
2459328994940,5cyclictest16850irq/134-800000008:09:400
245932899492,41cyclictest2465042-21munin-run09:00:010
245933999487,9cyclictest37-21ksoftirqd/310:50:033
245933999487,7cyclictest37-21ksoftirqd/308:44:413
245933999486,8cyclictest37-21ksoftirqd/308:17:003
245933999486,14cyclictest37-21ksoftirqd/307:55:023
245933999486,14cyclictest37-21ksoftirqd/307:55:023
245933999485,6cyclictest37-21ksoftirqd/312:20:023
245933999485,18cyclictest37-21ksoftirqd/312:30:013
245933999483,11cyclictest37-21ksoftirqd/307:40:013
245933999482,13cyclictest37-21ksoftirqd/311:30:033
245933999481,6cyclictest37-21ksoftirqd/309:10:013
2459339994811,4cyclictest131rcu_preempt11:04:593
245933999481,13cyclictest37-21ksoftirqd/309:25:023
2459336994828,16cyclictest275-21dbus-daemon10:15:002
2459331994830,13cyclictest275-21dbus-daemon11:25:001
2459328994833,10cyclictest1-21systemd08:45:010
245933999478,8cyclictest37-21ksoftirqd/310:20:013
245933999476,6cyclictest37-21ksoftirqd/310:35:023
245933999474,6cyclictest37-21ksoftirqd/308:30:023
2459336994729,14cyclictest2465550-21sendmail-mta09:10:012
2459336994729,13cyclictest30-21ksoftirqd/207:20:012
245932899472,40cyclictest2472273-21munin-run11:20:000
245933999466,6cyclictest37-21ksoftirqd/312:40:023
245933999466,10cyclictest37-21ksoftirqd/312:35:003
245933999464,10cyclictest37-21ksoftirqd/311:45:023
2459339994624,16cyclictest238-21systemd-journal09:04:593
245933999461,7cyclictest2463217-21munin-run08:25:003
2459336994628,13cyclictest1-21systemd11:50:012
2459336994628,13cyclictest1-21systemd11:50:012
2459331994627,14cyclictest1-21systemd07:45:001
2459331994626,14cyclictest275-21dbus-daemon09:35:011
2459328994632,10cyclictest2463721-21munin-plugin-st08:35:000
2459328994627,14cyclictest2459807-21sendmail-msp07:20:000
2459328994625,16cyclictest275-21dbus-daemon12:35:010
2459328994621,20cyclictest12-21ksoftirqd/011:35:010
245933999458,12cyclictest37-21ksoftirqd/309:55:023
245933999456,10cyclictest37-21ksoftirqd/308:10:003
245933999455,9cyclictest37-21ksoftirqd/308:55:043
245933999455,9cyclictest37-21ksoftirqd/308:55:033
2459339994535,8cyclictest37-21ksoftirqd/311:35:023
2459339994530,10cyclictest1-21systemd08:00:003
245933999452,10cyclictest37-21ksoftirqd/307:42:543
2459331994526,14cyclictest275-21dbus-daemon09:50:011
2459328994537,5cyclictest131rcu_preempt09:35:020
2459328994533,8cyclictest12-21ksoftirqd/010:30:020
2459328994529,12cyclictest275-21dbus-daemon11:05:000
2459328994527,13cyclictest2475083-21sshd12:11:390
2459328994513,27cyclictest12-21ksoftirqd/012:28:410
245933999444,11cyclictest37-21ksoftirqd/309:40:013
245933999441,13cyclictest37-21ksoftirqd/311:25:023
245933699447,4cyclictest131rcu_preempt10:05:022
2459336994430,10cyclictest30-21ksoftirqd/208:15:022
2459336994426,14cyclictest2472261-21modprobe11:19:592
2459336994413,9cyclictest30-21ksoftirqd/207:35:012
2459331994426,14cyclictest2461853-21systemctl08:00:001
2459328994426,13cyclictest2466053-21cron09:20:010
2459328994425,13cyclictest275-21dbus-daemon12:25:010
2459328994411,5cyclictest131rcu_preempt09:50:010
245933999436,7cyclictest37-21ksoftirqd/312:10:033
245933999436,7cyclictest37-21ksoftirqd/312:10:033
2459339994332,9cyclictest37-21ksoftirqd/310:10:003
245933999431,9cyclictest2462197-21latency_hist08:05:023
245933999431,7cyclictest2471756-21munin-run11:10:003
245933699433,3cyclictest131rcu_preempt12:40:012
2459336994330,9cyclictest1-21systemd10:00:012
2459336994330,9cyclictest1-21systemd10:00:002
2459331994324,13cyclictest238-21systemd-journal09:20:011
2459331994324,12cyclictest2470196-21systemctl10:40:001
2459328994332,7cyclictest2472793-21munin-plugin-st11:30:000
2459328994326,13cyclictest2465530-21cron09:10:010
2459336994230,10cyclictest30-21ksoftirqd/211:25:022
2459336994229,9cyclictest1-21systemd09:35:012
2459336994229,10cyclictest30-21ksoftirqd/209:30:022
2459336994228,10cyclictest309-21in:imuxsock08:15:022
2459336994227,10cyclictest1-21systemd08:45:002
2459331994226,12cyclictest1-21systemd08:35:001
2459331994226,11cyclictest275-21dbus-daemon08:30:011
2459328994233,5cyclictest12-21ksoftirqd/011:10:010
2459328994226,13cyclictest2459491-21sshd07:11:410
2459339994127,10cyclictest2468883-21cron10:15:013
2459336994124,11cyclictest238-21systemd-journal10:35:012
2459331994130,7cyclictest309-21in:imuxsock09:10:001
2459331994129,6cyclictest309-21in:imuxsock11:10:011
2459331994129,10cyclictest23-21ksoftirqd/107:15:191
245933199411,8cyclictest2468644-21modprobe10:10:001
245932899415,6cyclictest131rcu_preempt07:59:590
2459328994134,4cyclictest2468894-21latency_hist10:15:010
2459328994132,5cyclictest2460557-21sh07:35:000
2459328994127,10cyclictest238-21systemd-journal10:49:590
245932899411,36cyclictest2468099-21sshd09:59:410
245932899411,36cyclictest2468099-21sshd09:59:400
2459328994110,6cyclictest131rcu_preempt10:45:010
245933699408,7cyclictest131rcu_preempt12:30:032
245933699406,26cyclictest291rcuc/212:05:022
2459336994028,9cyclictest238-21systemd-journal10:30:002
2459336994023,14cyclictest275-21dbus-daemon09:15:012
245933199409,6cyclictest131rcu_preempt10:35:011
245933199408,6cyclictest131rcu_preempt10:50:411
2459331994025,11cyclictest23-21ksoftirqd/111:55:011
2459331994023,13cyclictest275-21dbus-daemon07:40:011
2459331994018,15cyclictest275-21dbus-daemon10:50:011
245933199401,21cyclictest221rcuc/112:25:031
2459328994030,7cyclictest238-21systemd-journal08:20:020
2459328994029,9cyclictest12-21ksoftirqd/009:55:020
2459328994027,8cyclictest2475374-21munin-plugin-st12:20:000
2459328994026,10cyclictest309-21in:imuxsock08:25:030
2459328994023,11cyclictest238-21systemd-journal08:20:000
245932899401,5cyclictest131rcu_preempt09:45:010
2459339993932,5cyclictest37-21ksoftirqd/309:15:003
245933999391,4cyclictest0-21swapper/307:10:023
2459336993931,6cyclictest30-21ksoftirqd/211:35:032
2459336993929,6cyclictest309-21in:imuxsock12:15:002
2459336993923,12cyclictest1-21systemd12:10:012
2459336993923,12cyclictest1-21systemd12:10:002
2459331993927,9cyclictest23-21ksoftirqd/109:45:021
2459331993927,10cyclictest23-21ksoftirqd/112:00:001
2459331993926,6cyclictest2462143-21latency_hist08:05:011
2459328993925,10cyclictest238-21systemd-journal11:35:020
2459328993923,11cyclictest2466431-21latency_hist09:25:020
2459328993922,13cyclictest275-21dbus-daemon07:55:020
2459328993922,13cyclictest275-21dbus-daemon07:55:020
2459328993915,20cyclictest151rcuc/011:15:030
2459328993915,20cyclictest151rcuc/011:15:020
245932899391,4cyclictest2474598-21modprobe12:04:590
245932899391,34cyclictest0-21swapper/007:30:020
245933699384,9cyclictest131rcu_preempt10:20:022
2459336993824,10cyclictest30-21ksoftirqd/210:40:002
245933199383,4cyclictest131rcu_preempt10:00:021
245933199383,4cyclictest131rcu_preempt10:00:021
245933199382,4cyclictest131rcu_preempt08:19:591
2459331993821,11cyclictest238-21systemd-journal11:00:001
2459328993827,7cyclictest12850irq/18-4d00000010:20:010
245932899382,5cyclictest0-21swapper/010:24:590
2459328993821,13cyclictest2467068-21cron09:40:010
2459336993725,9cyclictest30-21ksoftirqd/208:35:022
2459336993724,9cyclictest30-21ksoftirqd/211:15:012
2459336993724,9cyclictest30-21ksoftirqd/211:15:012
2459336993724,9cyclictest238-21systemd-journal09:35:412
245933699371,4cyclictest131rcu_preempt12:00:012
2459331993727,6cyclictest2465267-21cron09:05:001
2459331993722,11cyclictest23-21ksoftirqd/107:50:011
2459331993721,11cyclictest238-21systemd-journal10:20:001
245932899373,3cyclictest131rcu_preempt10:05:010
2459328993728,6cyclictest19350irq/34-mmc108:05:020
2459328993726,7cyclictest275-21dbus-daemon08:50:010
245932899372,32cyclictest2462727-21sed08:15:010
2459328993719,13cyclictest1-21systemd09:30:000
245932899371,6cyclictest2464011-21munin-run08:40:000
2459336993627,5cyclictest2466055-21sendmail09:20:002
2459336993624,9cyclictest1-21systemd09:05:012
2459336993624,10cyclictest30-21ksoftirqd/212:20:002
2459336993623,10cyclictest275-21dbus-daemon08:00:012
2459336993622,10cyclictest2470480-21systemd-run10:45:012
2459331993627,7cyclictest23-21ksoftirqd/107:15:011
2459331993626,7cyclictest23-21ksoftirqd/108:10:021
245933199362,4cyclictest131rcu_preempt09:55:011
2459331993624,9cyclictest23-21ksoftirqd/112:35:021
2459331993624,10cyclictest23-21ksoftirqd/109:15:021
2459331993623,11cyclictest23-21ksoftirqd/112:35:021
2459331993622,10cyclictest238-21systemd-journal10:04:591
245932899368,4cyclictest131rcu_preempt09:15:000
245932899363,5cyclictest131rcu_preempt12:10:010
245932899363,5cyclictest131rcu_preempt12:10:010
2459328993624,9cyclictest12-21ksoftirqd/008:55:000
2459328993624,9cyclictest12-21ksoftirqd/008:54:590
2459336993523,8cyclictest238-21systemd-journal07:10:412
2459336993523,10cyclictest30-21ksoftirqd/210:10:022
2459336993522,10cyclictest2471742-21cron11:09:592
2459336993521,11cyclictest1-21systemd09:25:022
2459336993517,13cyclictest275-21dbus-daemon08:30:012
245933199354,6cyclictest131rcu_preempt08:45:011
245933199354,3cyclictest131rcu_preempt09:40:001
2459331993527,5cyclictest2466379-21latency_hist09:25:011
2459331993520,12cyclictest2473546-21sshd11:41:401
2459331993520,10cyclictest309-21in:imuxsock11:30:391
2459331993519,13cyclictest2462681-21systemd-run08:15:011
245933199351,3cyclictest131rcu_preempt12:25:021
2459328993525,7cyclictest2473285-21cron11:40:020
2459328993524,8cyclictest2465263-21sshd09:04:400
245932899352,29cyclictest2461248-21latency_hist07:45:020
2459328993521,10cyclictest2461366-21sort07:50:010
245932899351,5cyclictest131rcu_preempt10:09:590
245933699345,6cyclictest131rcu_preempt08:45:422
2459336993424,8cyclictest2469410-21sshd10:22:412
2459336993420,11cyclictest2460284-21sshd07:26:402
245933199345,3cyclictest131rcu_preempt07:30:011
2459331993426,5cyclictest23-21ksoftirqd/111:40:021
245933199342,4cyclictest131rcu_preempt08:59:591
2459331993421,9cyclictest1-21systemd10:15:011
2459331993416,5cyclictest131rcu_preempt07:55:021
2459331993416,5cyclictest131rcu_preempt07:55:011
245932899347,4cyclictest131rcu_preempt07:25:020
2459328993424,8cyclictest12-21ksoftirqd/011:50:020
2459328993424,8cyclictest12-21ksoftirqd/011:50:010
2459328993412,14cyclictest12-21ksoftirqd/011:55:000
2459336993324,7cyclictest30-21ksoftirqd/211:45:012
2459336993323,7cyclictest2467660-21cat09:50:012
2459336993320,10cyclictest2462118-21cron08:04:592
245933699331,9cyclictest2467859-21cron09:55:002
2459336993317,11cyclictest275-21dbus-daemon08:40:012
245933199335,3cyclictest131rcu_preempt08:50:011
245933199333,3cyclictest131rcu_preempt12:10:021
2459331993323,8cyclictest0-21swapper/112:05:011
2459331993321,8cyclictest275-21dbus-daemon07:25:011
2459331993319,9cyclictest23-21ksoftirqd/108:40:021
245933699325,4cyclictest131rcu_preempt07:10:012
2459336993218,10cyclictest30-21ksoftirqd/207:47:552
2459331993222,7cyclictest2466565-21sshd09:29:401
2459331993222,7cyclictest2463421-21latency_hist08:25:031
2459331993219,10cyclictest275-21dbus-daemon12:20:011
2459336993122,7cyclictest30-21ksoftirqd/211:30:012
2459336993119,7cyclictest2473285-21cron11:40:002
2459331993124,4cyclictest2473959-21latency_hist11:50:021
2459331993124,4cyclictest2473959-21latency_hist11:50:011
2459331993121,8cyclictest23-21ksoftirqd/111:15:011
2459331993121,8cyclictest23-21ksoftirqd/111:15:001
2459331993119,9cyclictest0-21swapper/111:30:011
2459331993117,10cyclictest1-21systemd10:30:011
2459336993017,10cyclictest2461164-21cat07:45:022
245933199304,3cyclictest131rcu_preempt12:06:411
245933199302,3cyclictest131rcu_preempt10:25:021
2459331993018,9cyclictest2460603-21cat07:35:021
245933199291,4cyclictest131rcu_preempt11:20:011
245933699283,3cyclictest131rcu_preempt11:55:002
2459331992820,5cyclictest2459447-21latency_hist07:10:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional