You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 23:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot3s.osadl.org (updated Thu Dec 25, 2025 12:45:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
158888399843,77cyclictest0-21swapper/009:05:010
1588883998174,4cyclictest0-21swapper/011:15:020
1588887997513,22cyclictest131rcu_preempt09:15:001
158888799704,5cyclictest131rcu_preempt11:20:011
1588883996819,12cyclictest12-21ksoftirqd/009:00:020
1588883996733,8cyclictest12-21ksoftirqd/011:20:010
1588883996112,12cyclictest12-21ksoftirqd/011:55:020
1588893996017,28cyclictest37-21ksoftirqd/309:15:013
158888399594,33cyclictest0-21swapper/009:50:000
1588883995915,10cyclictest12-21ksoftirqd/012:10:020
1588883995915,10cyclictest12-21ksoftirqd/012:10:020
158888399591,10cyclictest12-21ksoftirqd/010:00:020
158888399589,9cyclictest12-21ksoftirqd/010:20:010
1588883995851,4cyclictest16950irq/224-800000008:35:010
158888399578,9cyclictest12-21ksoftirqd/012:30:030
158888399577,9cyclictest12-21ksoftirqd/010:35:020
158888399576,10cyclictest12-21ksoftirqd/009:19:590
1588883995747,6cyclictest12-21ksoftirqd/009:40:010
1588887995612,10cyclictest23-21ksoftirqd/109:40:021
158888399566,9cyclictest12-21ksoftirqd/011:40:010
158888399565,8cyclictest12-21ksoftirqd/008:40:000
158888399565,17cyclictest12-21ksoftirqd/012:20:020
158888399562,13cyclictest12-21ksoftirqd/010:55:030
1588883995610,9cyclictest12-21ksoftirqd/010:05:020
1588883995610,9cyclictest12-21ksoftirqd/010:05:020
158889099554,6cyclictest131rcu_preempt09:05:012
158888799556,8cyclictest23-21ksoftirqd/112:10:021
158888799556,8cyclictest23-21ksoftirqd/112:10:021
158888399557,11cyclictest12-21ksoftirqd/012:40:010
158888399556,8cyclictest12-21ksoftirqd/007:45:020
1588883995512,10cyclictest12-21ksoftirqd/009:15:000
1588887995438,12cyclictest275-21dbus-daemon10:00:001
1588887995415,6cyclictest131rcu_preempt08:40:001
1588887995411,7cyclictest131rcu_preempt07:40:011
158888399548,5cyclictest131rcu_preempt10:28:250
158888399548,12cyclictest12-21ksoftirqd/010:15:020
158888399547,7cyclictest12-21ksoftirqd/007:25:030
158888399544,14cyclictest12-21ksoftirqd/007:20:010
1588887995313,6cyclictest131rcu_preempt12:40:001
158888399535,9cyclictest12-21ksoftirqd/007:10:010
1588883995335,12cyclictest1-21systemd11:45:010
158888399533,12cyclictest12-21ksoftirqd/007:35:000
158888399532,11cyclictest12-21ksoftirqd/010:45:020
1588883995313,10cyclictest12-21ksoftirqd/012:05:020
158888399531,15cyclictest12-21ksoftirqd/009:55:020
158888399526,5cyclictest12-21ksoftirqd/009:30:020
158888399526,11cyclictest12-21ksoftirqd/009:24:170
158888399524,7cyclictest1602715-21date11:35:020
158888399524,7cyclictest1602715-21date11:35:020
158888399523,8cyclictest12-21ksoftirqd/012:25:010
158888399522,13cyclictest12-21ksoftirqd/008:55:030
158888399522,13cyclictest12-21ksoftirqd/008:30:010
158888399522,12cyclictest12-21ksoftirqd/007:15:010
1588883995212,9cyclictest12-21ksoftirqd/011:10:020
158888799518,5cyclictest131rcu_preempt09:35:011
158888799517,12cyclictest23-21ksoftirqd/112:35:001
158888799515,8cyclictest23-21ksoftirqd/109:30:011
158888799514,9cyclictest23-21ksoftirqd/110:50:011
1588887995141,7cyclictest23-21ksoftirqd/112:14:591
158888799514,10cyclictest23-21ksoftirqd/111:10:001
158888399517,8cyclictest12-21ksoftirqd/008:00:010
158888399516,9cyclictest12-21ksoftirqd/008:55:030
158888399513,9cyclictest12-21ksoftirqd/007:30:010
158888399512,15cyclictest12-21ksoftirqd/007:50:020
158889399503,8cyclictest0-21swapper/312:20:003
1588893995034,12cyclictest1-21systemd09:05:003
158889399501,5cyclictest131rcu_preempt08:40:013
158889099504,5cyclictest131rcu_preempt12:25:022
1588890995033,12cyclictest275-21dbus-daemon10:00:012
158888799507,11cyclictest23-21ksoftirqd/109:25:011
158888799504,11cyclictest23-21ksoftirqd/108:00:011
1588887995022,8cyclictest23-21ksoftirqd/110:15:011
158888799502,13cyclictest23-21ksoftirqd/108:05:011
158888799502,12cyclictest23-21ksoftirqd/109:45:021
1588887995021,24cyclictest131rcu_preempt09:00:001
158888799501,8cyclictest23-21ksoftirqd/109:55:011
158888399507,6cyclictest12-21ksoftirqd/010:50:020
158888399506,7cyclictest12-21ksoftirqd/011:50:020
158888399501,11cyclictest1593978-21cat08:45:020
158889399496,5cyclictest131rcu_preempt08:45:003
158888799495,8cyclictest23-21ksoftirqd/109:10:011
158888399496,12cyclictest12-21ksoftirqd/009:10:030
158888399495,7cyclictest12-21ksoftirqd/008:05:020
158888399495,10cyclictest151rcuc/011:30:010
158888399491,12cyclictest12-21ksoftirqd/012:35:000
1588893994833,11cyclictest1591406-21sshd07:55:283
1588893994832,11cyclictest37-21ksoftirqd/311:00:013
1588893994831,13cyclictest238-21systemd-journal09:24:143
158889099485,5cyclictest131rcu_preempt10:35:022
1588890994834,11cyclictest1-21systemd09:35:012
158889099482,7cyclictest1603151-21modprobe11:45:002
158888799489,6cyclictest131rcu_preempt08:35:021
158888799488,13cyclictest23-21ksoftirqd/112:30:011
158888799487,6cyclictest23-21ksoftirqd/107:50:011
158888799485,10cyclictest23-21ksoftirqd/111:35:021
158888799485,10cyclictest23-21ksoftirqd/111:35:021
158888799483,8cyclictest23-21ksoftirqd/107:27:171
158888799482,6cyclictest131rcu_preempt08:15:011
1588887994820,7cyclictest23-21ksoftirqd/108:20:021
1588887994820,19cyclictest221rcuc/107:55:011
158888799481,21cyclictest0-21swapper/110:30:001
158888399488,10cyclictest12-21ksoftirqd/008:15:010
158888399486,7cyclictest12-21ksoftirqd/011:05:020
158888399484,9cyclictest12-21ksoftirqd/009:45:020
158888399484,10cyclictest12-21ksoftirqd/010:25:010
158888399482,9cyclictest12-21ksoftirqd/012:00:010
158889399477,5cyclictest131rcu_preempt12:40:013
1588893994732,11cyclictest1603914-21systemctl12:00:003
158888799478,6cyclictest131rcu_preempt11:55:011
158888799476,8cyclictest23-21ksoftirqd/110:03:191
158888799476,8cyclictest23-21ksoftirqd/110:03:181
158888799476,6cyclictest131rcu_preempt08:55:011
158888799476,6cyclictest131rcu_preempt08:55:011
158888799474,8cyclictest23-21ksoftirqd/111:00:011
158888799473,9cyclictest23-21ksoftirqd/112:25:001
158888799472,7cyclictest23-21ksoftirqd/108:45:021
1588887994712,5cyclictest131rcu_preempt11:15:011
1588887994710,6cyclictest131rcu_preempt09:50:021
158888399477,9cyclictest12-21ksoftirqd/008:20:030
158888399477,7cyclictest12-21ksoftirqd/009:35:010
158888399476,8cyclictest12-21ksoftirqd/010:55:010
158888399476,11cyclictest12-21ksoftirqd/008:10:020
158888399471,15cyclictest12-21ksoftirqd/007:40:010
158888399471,14cyclictest12-21ksoftirqd/008:25:010
158889099463,7cyclictest131rcu_preempt07:49:592
1588890994630,12cyclictest1-21systemd08:10:012
1588890994618,8cyclictest30-21ksoftirqd/210:45:012
1588890994614,6cyclictest131rcu_preempt09:00:002
158888799467,7cyclictest23-21ksoftirqd/107:25:021
158888799467,7cyclictest23-21ksoftirqd/107:25:021
158888799467,6cyclictest131rcu_preempt08:30:021
1588887994628,12cyclictest1589377-21run-parts07:19:591
1588887994612,9cyclictest131rcu_preempt08:50:021
1588887994612,7cyclictest23-21ksoftirqd/110:20:011
158888399466,9cyclictest12-21ksoftirqd/007:50:020
158888399465,5cyclictest12-21ksoftirqd/011:20:020
158888399461,9cyclictest1594100-21cut08:50:020
158888399461,11cyclictest12-21ksoftirqd/010:40:020
158888399461,11cyclictest12-21ksoftirqd/010:40:010
1588893994528,12cyclictest238-21systemd-journal08:20:013
1588890994534,8cyclictest1605953-21sshd12:37:182
1588890994512,5cyclictest131rcu_preempt09:20:002
158888799456,5cyclictest131rcu_preempt10:55:021
158888799456,5cyclictest131rcu_preempt09:20:021
1588887994533,10cyclictest23-21ksoftirqd/111:30:021
1588887994513,9cyclictest131rcu_preempt08:25:011
158888399458,8cyclictest12-21ksoftirqd/007:25:020
158888399451,4cyclictest0-21swapper/010:10:000
1588893994434,6cyclictest1590150-21munin-plugin-st07:34:593
1588893994432,8cyclictest1603633-21sshd11:53:183
1588893994428,11cyclictest275-21dbus-daemon09:20:003
1588890994429,11cyclictest1-21systemd10:30:002
158888799447,5cyclictest131rcu_preempt11:45:021
158888799445,6cyclictest131rcu_preempt07:10:021
158888799444,9cyclictest23-21ksoftirqd/110:06:181
1588887994431,9cyclictest1603385-21sshd11:49:191
1588887994420,6cyclictest23-21ksoftirqd/107:45:011
1588887994413,5cyclictest131rcu_preempt12:05:001
1588883994430,11cyclictest19350irq/34-mmc112:15:020
158889399437,6cyclictest37-21ksoftirqd/308:10:013
158889399434,6cyclictest131rcu_preempt11:50:003
1588893994328,11cyclictest238-21systemd-journal08:55:033
1588893994326,13cyclictest1601861-21tr11:20:003
158889399432,3cyclictest131rcu_preempt10:05:013
158889399432,3cyclictest131rcu_preempt10:05:013
158889099437,6cyclictest131rcu_preempt12:18:182
158889099434,3cyclictest131rcu_preempt12:15:012
158889099432,6cyclictest131rcu_preempt11:55:012
1588890994321,6cyclictest30-21ksoftirqd/208:15:012
158888799434,5cyclictest131rcu_preempt10:40:021
158888799434,5cyclictest131rcu_preempt10:40:021
1588887994310,6cyclictest131rcu_preempt07:15:011
1588893994225,14cyclictest238-21systemd-journal09:50:003
158889399422,4cyclictest131rcu_preempt10:35:013
158889399421,5cyclictest131rcu_preempt09:59:593
158889099428,6cyclictest131rcu_preempt09:15:002
158889099427,5cyclictest131rcu_preempt11:50:012
158889099424,5cyclictest131rcu_preempt07:40:002
1588890994226,12cyclictest238-21systemd-journal07:20:002
158889099422,5cyclictest131rcu_preempt07:30:012
1588890994221,6cyclictest30-21ksoftirqd/207:25:012
1588890994221,6cyclictest30-21ksoftirqd/207:25:002
158889099421,3cyclictest131rcu_preempt11:05:012
158888799426,11cyclictest23-21ksoftirqd/107:35:011
158888799425,7cyclictest23-21ksoftirqd/112:20:011
158888799423,6cyclictest131rcu_preempt11:25:011
1588887994210,7cyclictest131rcu_preempt10:45:011
1588893994128,8cyclictest1-21systemd11:15:023
1588893994128,10cyclictest275-21dbus-daemon09:40:013
1588893994127,10cyclictest238-21systemd-journal11:45:003
1588893994126,10cyclictest275-21dbus-daemon12:10:013
1588893994126,10cyclictest275-21dbus-daemon12:10:013
158889099413,7cyclictest30-21ksoftirqd/208:30:192
158889099413,5cyclictest131rcu_preempt09:09:592
158889099413,4cyclictest0-21swapper/211:30:022
158889099413,4cyclictest0-21swapper/211:30:022
158889099412,7cyclictest1601840-21modprobe11:20:002
158889099412,5cyclictest131rcu_preempt09:50:002
1588890994119,14cyclictest30-21ksoftirqd/207:45:022
1588890994118,3cyclictest30-21ksoftirqd/209:55:022
158888799418,6cyclictest131rcu_preempt11:05:011
1588887994126,11cyclictest23-21ksoftirqd/112:00:011
158888799412,5cyclictest0-21swapper/111:40:011
158889399405,9cyclictest37-21ksoftirqd/311:22:123
158889399405,6cyclictest131rcu_preempt11:35:013
158889399405,6cyclictest131rcu_preempt11:35:013
158889399403,3cyclictest131rcu_preempt10:10:013
158889399403,3cyclictest131rcu_preempt09:30:023
1588893994031,6cyclictest1599010-21cron10:24:593
1588893994029,8cyclictest1599251-21sshd10:28:183
1588893994029,7cyclictest1595034-21sshd09:05:413
1588893994026,9cyclictest37-21ksoftirqd/308:25:483
1588893994026,11cyclictest1605855-21sed12:35:023
1588893994019,5cyclictest37-21ksoftirqd/311:40:013
158889399401,8cyclictest1605220-21cron12:25:003
158889399401,6cyclictest131rcu_preempt07:20:003
158889099406,5cyclictest131rcu_preempt12:00:002
158889099403,6cyclictest131rcu_preempt12:10:022
158889099403,6cyclictest131rcu_preempt12:10:012
158889099403,5cyclictest131rcu_preempt08:00:022
158889099403,4cyclictest131rcu_preempt07:10:032
158889099402,7cyclictest30-21ksoftirqd/211:00:012
158889099402,5cyclictest131rcu_preempt07:15:012
1588890994025,11cyclictest275-21dbus-daemon09:30:012
158889099402,3cyclictest131rcu_preempt10:10:002
1588890994021,5cyclictest30-21ksoftirqd/211:25:002
1588890994021,13cyclictest275-21dbus-daemon09:40:012
1588890994018,4cyclictest30-21ksoftirqd/210:15:002
158888799408,6cyclictest131rcu_preempt08:08:181
158889399393,3cyclictest131rcu_preempt07:15:013
1588893993927,10cyclictest1600528-21sshd10:52:183
1588893993925,10cyclictest37-21ksoftirqd/308:05:003
158889399392,3cyclictest131rcu_preempt07:40:023
1588893993919,4cyclictest37-21ksoftirqd/310:40:013
1588893993919,4cyclictest37-21ksoftirqd/310:40:003
1588893993915,5cyclictest37-21ksoftirqd/309:45:033
158889099393,3cyclictest131rcu_preempt08:25:012
158889099392,6cyclictest131rcu_preempt08:50:022
158889099392,5cyclictest1-21systemd10:50:012
1588890993921,12cyclictest275-21dbus-daemon12:30:012
1588890993920,15cyclictest238-21systemd-journal08:30:012
1588890993918,4cyclictest30-21ksoftirqd/210:02:192
1588890993918,4cyclictest30-21ksoftirqd/210:02:182
1588890993913,6cyclictest131rcu_preempt10:21:182
158888799399,5cyclictest131rcu_preempt09:04:191
158889399384,3cyclictest131rcu_preempt07:45:013
1588893993817,6cyclictest37-21ksoftirqd/311:05:013
1588893993817,5cyclictest37-21ksoftirqd/307:55:013
1588893993816,5cyclictest37-21ksoftirqd/308:55:013
1588893993816,5cyclictest37-21ksoftirqd/308:55:013
1588890993826,9cyclictest238-21systemd-journal09:20:432
1588890993826,8cyclictest1598700-21sshd10:15:192
1588890993820,4cyclictest30-21ksoftirqd/211:30:012
1588890993818,5cyclictest30-21ksoftirqd/208:55:022
1588890993818,5cyclictest30-21ksoftirqd/208:55:022
158889099381,3cyclictest131rcu_preempt07:35:022
158889099381,3cyclictest0-21swapper/207:55:022
1588887993811,9cyclictest23-21ksoftirqd/110:20:491
158889399373,3cyclictest131rcu_preempt08:50:023
1588893993727,5cyclictest1604204-21latency_hist12:05:013
1588893993721,12cyclictest275-21dbus-daemon07:30:003
1588893993717,5cyclictest37-21ksoftirqd/308:15:003
1588893993716,6cyclictest37-21ksoftirqd/308:25:013
158889399371,3cyclictest131rcu_preempt07:50:013
158889099375,4cyclictest131rcu_preempt10:55:022
158889099373,3cyclictest131rcu_preempt11:40:012
158889099373,3cyclictest131rcu_preempt08:45:012
1588890993728,6cyclictest1604162-21sshd12:02:182
1588890993720,12cyclictest1599745-21sshd10:35:512
1588890993720,12cyclictest1599745-21sshd10:35:512
1588890993719,6cyclictest30-21ksoftirqd/208:40:012
1588890993717,4cyclictest30-21ksoftirqd/209:45:012
158889399363,3cyclictest131rcu_preempt08:35:013
158889399362,29cyclictest1598871-21wc10:20:023
1588893993616,5cyclictest37-21ksoftirqd/310:45:003
1588893993615,5cyclictest37-21ksoftirqd/307:25:013
1588893993615,5cyclictest37-21ksoftirqd/307:25:003
1588890993621,11cyclictest275-21dbus-daemon08:20:002
1588890993618,4cyclictest30-21ksoftirqd/208:05:002
1588890993615,3cyclictest30-21ksoftirqd/211:15:032
1588890993611,5cyclictest30-21ksoftirqd/211:10:012
158888799361,5cyclictest131rcu_preempt10:35:001
158889399354,6cyclictest37-21ksoftirqd/310:45:023
1588893993528,4cyclictest1-21systemd12:30:013
158889399352,3cyclictest131rcu_preempt09:55:003
1588893993517,13cyclictest275-21dbus-daemon09:35:013
158889399351,3cyclictest131rcu_preempt12:15:013
158889099351,3cyclictest131rcu_preempt12:35:012
158889399343,3cyclictest131rcu_preempt07:10:023
1588893993424,7cyclictest1602503-21date11:30:023
1588893993420,10cyclictest238-21systemd-journal10:12:183
1588893993416,4cyclictest37-21ksoftirqd/311:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional