You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-27 - 01:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot3s.osadl.org (updated Fri Dec 26, 2025 12:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1712646991151,110cyclictest0-21swapper/012:40:020
17126469910197,2cyclictest0-21swapper/011:20:020
1712646998379,2cyclictest0-21swapper/009:20:020
1712646998379,2cyclictest0-21swapper/009:20:020
1712646997773,2cyclictest0-21swapper/012:00:020
171264699721,2cyclictest0-21swapper/012:10:010
1712660996817,13cyclictest37-21ksoftirqd/312:10:013
171266099677,19cyclictest1722649-21sed10:20:023
1712660996714,21cyclictest1718703-21cut09:05:023
171266099645,19cyclictest1728790-21date12:20:023
1712660996212,11cyclictest37-21ksoftirqd/309:15:023
1712660996114,14cyclictest37-21ksoftirqd/308:10:013
1712646996157,2cyclictest0-21swapper/011:00:020
1712660996017,10cyclictest37-21ksoftirqd/307:25:013
171264699601,3cyclictest0-21swapper/007:10:020
171266099594,20cyclictest1715601-21sed08:05:023
1712660995918,8cyclictest37-21ksoftirqd/309:20:013
1712660995918,8cyclictest37-21ksoftirqd/309:20:013
171266099583,3cyclictest131rcu_preempt12:25:023
1712656995841,13cyclictest1-21systemd12:15:002
1712660995717,9cyclictest37-21ksoftirqd/310:50:003
1712656995740,13cyclictest1-21systemd10:35:012
1712656995740,13cyclictest1-21systemd10:35:012
1712651995715,26cyclictest23-21ksoftirqd/108:20:031
171266099566,15cyclictest1723734-21/usr/sbin/munin10:45:013
171266099566,15cyclictest1719918-21cat09:30:013
1712660995435,14cyclictest238-21systemd-journal10:00:003
1712660995434,16cyclictest238-21systemd-journal09:35:003
171265199543,6cyclictest131rcu_preempt07:20:011
1712646995410,27cyclictest19350irq/34-mmc111:50:020
171265699532,4cyclictest131rcu_preempt10:45:022
1712646995346,3cyclictest0-21swapper/010:35:020
1712646995346,3cyclictest0-21swapper/010:35:020
171266099527,18cyclictest1714932-21kworker/u8:408:00:033
171266099527,18cyclictest1714932-21kworker/u8:408:00:023
171266099526,15cyclictest1718029-21sh08:55:003
171266099525,15cyclictest1713633-21munin-run07:30:003
1712660995212,7cyclictest37-21ksoftirqd/309:40:023
171264699511,2cyclictest0-21swapper/011:30:020
171264699511,2cyclictest0-21swapper/011:30:020
171265699509,24cyclictest30-21ksoftirqd/212:25:022
171265699503,15cyclictest30-21ksoftirqd/211:50:012
171264699506,41cyclictest12-21ksoftirqd/010:50:010
1712646995035,10cyclictest1-21systemd08:15:010
1712646995017,29cyclictest1712839-21latency_hist07:15:020
171266099494,13cyclictest1723411-21sed10:35:033
1712660994929,14cyclictest238-21systemd-journal11:00:003
1712660994914,11cyclictest1726028-21sshd11:25:223
1712660994914,11cyclictest1726028-21sshd11:25:223
1712646994926,18cyclictest1-21systemd10:25:010
171264699491,13cyclictest1719860-21unin-run09:30:010
1712660994833,11cyclictest1713112-21munin-run07:20:013
1712660994830,15cyclictest1719565-21sshd09:20:213
171265699489,6cyclictest131rcu_preempt08:35:012
1712651994822,19cyclictest275-21dbus-daemon10:40:001
1712646994842,4cyclictest16950irq/224-800000009:10:000
1712646994842,4cyclictest16950irq/224-800000009:10:000
1712646994827,16cyclictest275-21dbus-daemon09:25:000
1712646994818,8cyclictest12-21ksoftirqd/008:05:020
1712660994727,14cyclictest275-21dbus-daemon09:50:013
1712660994711,5cyclictest37-21ksoftirqd/310:25:013
171265699472,6cyclictest131rcu_preempt09:20:012
171265699472,6cyclictest131rcu_preempt09:20:012
1712651994728,15cyclictest1-21systemd09:30:011
1712651994715,23cyclictest1718314-21kworker/u8:110:05:021
171264699478,34cyclictest0-21swapper/012:00:000
1712646994726,14cyclictest238-21systemd-journal12:30:000
171264699472,39cyclictest1-21systemd11:10:010
1712646994718,13cyclictest12-21ksoftirqd/011:55:020
1712660994628,14cyclictest1724795-21sed11:05:013
1712660994628,12cyclictest309-21in:imuxsock10:40:003
1712660994622,17cyclictest275-21dbus-daemon11:35:003
171266099461,41cyclictest275-21dbus-daemon12:15:003
1712656994624,16cyclictest238-21systemd-journal09:50:002
1712651994629,13cyclictest1-21systemd07:45:001
1712651994628,14cyclictest238-21systemd-journal08:40:001
1712646994637,6cyclictest16950irq/224-800000008:25:010
1712646994631,11cyclictest1721368-21cron10:00:000
171264699462,39cyclictest238-21systemd-journal09:45:000
171264699462,39cyclictest1726688-21cat11:40:020
1712656994526,15cyclictest238-21systemd-journal08:30:002
171265699452,3cyclictest131rcu_preempt10:15:012
1712651994533,9cyclictest275-21dbus-daemon09:10:011
1712651994533,9cyclictest275-21dbus-daemon09:10:011
171264699452,7cyclictest238-21systemd-journal07:30:000
1712646994526,14cyclictest238-21systemd-journal08:09:590
1712646994523,16cyclictest238-21systemd-journal07:50:000
171264699452,10cyclictest1-21systemd12:20:010
1712660994430,8cyclictest1717227-21cron08:40:003
1712660994426,14cyclictest1723171-21sshd10:30:213
1712660994421,17cyclictest1725241-21sshd11:12:213
171265699445,10cyclictest30-21ksoftirqd/211:00:592
1712656994430,11cyclictest275-21dbus-daemon08:00:012
1712656994430,11cyclictest275-21dbus-daemon08:00:002
1712651994436,4cyclictest23-21ksoftirqd/109:40:021
1712651994431,9cyclictest238-21systemd-journal11:45:021
1712651994430,10cyclictest1-21systemd07:30:011
171264699449,6cyclictest131rcu_preempt11:25:000
171264699447,14cyclictest19350irq/34-mmc107:55:020
171264699442,38cyclictest1717280-21unin-run08:40:000
171264699442,37cyclictest151rcuc/010:55:010
1712646994420,20cyclictest151rcuc/011:15:020
1712660994328,12cyclictest1721880-21sshd10:05:213
1712660994328,12cyclictest1721880-21sshd10:05:213
1712660994327,11cyclictest309-21in:imuxsock08:45:003
1712660994326,14cyclictest1714630-21sshd07:45:213
1712660994321,13cyclictest0-21swapper/307:15:003
1712660994312,25cyclictest1718310-21unin-run09:00:013
171265699433,19cyclictest1720068-21kworker/u8:209:40:022
171265699432,7cyclictest1724484-21cron11:00:002
1712656994325,13cyclictest275-21dbus-daemon09:30:012
171265199438,6cyclictest131rcu_preempt11:35:011
1712651994336,5cyclictest221rcuc/110:10:021
1712651994336,5cyclictest221rcuc/110:10:021
1712651994326,13cyclictest1-21systemd07:40:011
1712651994326,13cyclictest1-21systemd07:40:001
1712646994335,4cyclictest16950irq/224-800000007:40:000
1712646994335,4cyclictest16950irq/224-800000007:40:000
1712646994323,16cyclictest12-21ksoftirqd/008:50:010
1712646994323,16cyclictest12-21ksoftirqd/008:50:010
1712646994317,21cyclictest131rcu_preempt11:45:020
1712660994228,8cyclictest309-21in:imuxsock10:55:003
1712660994226,12cyclictest1725819-21munin-run11:25:013
1712660994226,12cyclictest1725483-21sshd11:15:203
1712660994225,11cyclictest309-21in:imuxsock08:25:003
1712660994223,13cyclictest1-21systemd12:35:003
1712656994230,8cyclictest1723453-21cron10:40:002
1712656994225,13cyclictest275-21dbus-daemon11:55:002
1712656994224,14cyclictest1-21systemd10:25:012
1712656994224,13cyclictest238-21systemd-journal07:25:012
1712656994223,13cyclictest238-21systemd-journal10:00:002
1712651994229,10cyclictest238-21systemd-journal08:50:011
1712651994229,10cyclictest238-21systemd-journal08:50:011
1712651994227,11cyclictest275-21dbus-daemon10:55:011
171265199421,5cyclictest131rcu_preempt08:00:011
171265199421,5cyclictest131rcu_preempt08:00:011
171264699425,33cyclictest12-21ksoftirqd/009:04:590
1712646994238,2cyclictest0-21swapper/010:20:020
1712646994235,5cyclictest12-21ksoftirqd/010:09:120
1712646994235,5cyclictest12-21ksoftirqd/010:09:120
1712646994234,5cyclictest16950irq/224-800000012:15:010
1712646994233,6cyclictest12850irq/18-4d00000008:00:010
1712646994233,6cyclictest12850irq/18-4d00000008:00:000
1712646994213,6cyclictest131rcu_preempt09:00:010
1712660994131,6cyclictest1714417-21grep07:44:593
1712660994126,9cyclictest1727853-21sshd12:04:213
1712660994125,12cyclictest364-21snmpd09:41:273
1712660994124,13cyclictest1727067-21sshd11:47:213
171265699412,24cyclictest1726022-21kworker/u8:011:40:022
1712656994120,16cyclictest275-21dbus-daemon10:20:012
1712651994130,7cyclictest1716465-21sshd08:24:211
1712651994126,11cyclictest275-21dbus-daemon12:40:021
1712651994123,13cyclictest1-21systemd11:00:591
1712646994130,9cyclictest12-21ksoftirqd/007:35:010
1712646994127,10cyclictest238-21systemd-journal08:40:020
1712646994122,14cyclictest1-21systemd08:20:010
1712660994031,7cyclictest37-21ksoftirqd/312:00:023
1712660994030,7cyclictest1718768-21sshd09:06:213
1712660994030,7cyclictest1718768-21sshd09:06:213
1712660994027,10cyclictest1726526-21sshd11:35:213
1712660994026,10cyclictest1721103-21sshd09:51:213
1712660994021,15cyclictest364-21snmpd12:25:293
1712656994028,9cyclictest275-21dbus-daemon12:10:002
1712656994027,10cyclictest1727601-21systemctl12:00:002
1712656994021,14cyclictest275-21dbus-daemon11:30:022
1712656994021,14cyclictest275-21dbus-daemon11:30:012
1712656994018,16cyclictest238-21systemd-journal12:35:012
1712651994031,6cyclictest1727578-21cron12:00:001
1712651994025,12cyclictest1728357-21cron12:15:001
1712651994022,14cyclictest238-21systemd-journal11:55:001
171265199401,3cyclictest131rcu_preempt11:05:021
171264699405,6cyclictest12-21ksoftirqd/008:35:020
1712646994034,4cyclictest16950irq/224-800000010:40:000
171264699403,32cyclictest1720101-21modprobe09:34:590
1712646994028,8cyclictest12-21ksoftirqd/009:45:020
1712646994027,10cyclictest12-21ksoftirqd/010:15:000
1712646994011,6cyclictest131rcu_preempt09:40:010
171266099394,8cyclictest37-21ksoftirqd/310:25:123
1712660993927,7cyclictest1714264-21cat07:40:023
1712660993927,7cyclictest1714264-21cat07:40:023
1712660993925,10cyclictest1726817-21sshd11:42:213
1712660993920,14cyclictest1-21systemd08:30:013
1712656993927,8cyclictest309-21in:imuxsock07:40:002
1712656993927,8cyclictest309-21in:imuxsock07:40:002
171265199393,5cyclictest131rcu_preempt09:35:021
1712651993926,10cyclictest23-21ksoftirqd/111:00:001
1712651993925,10cyclictest238-21systemd-journal10:25:001
1712646993930,6cyclictest12-21ksoftirqd/010:45:010
1712646993928,6cyclictest1716758-21latency_hist08:30:010
1712646993926,9cyclictest238-21systemd-journal07:20:000
1712660993825,9cyclictest1716172-21cron08:17:013
1712660993824,11cyclictest1716964-21sshd08:33:213
1712660993821,12cyclictest1713860-21sshd07:33:213
171265699383,26cyclictest1718314-21kworker/u8:110:10:022
171265699383,26cyclictest1718314-21kworker/u8:110:10:022
1712656993826,8cyclictest1718823-21pluginstate09:10:012
1712656993826,8cyclictest1718823-21pluginstate09:10:012
1712656993821,13cyclictest238-21systemd-journal08:20:012
1712651993829,7cyclictest23-21ksoftirqd/112:35:011
171265199382,7cyclictest23-21ksoftirqd/110:20:021
1712651993827,8cyclictest23-21ksoftirqd/112:30:021
1712651993826,9cyclictest238-21systemd-journal09:45:001
1712651993824,10cyclictest23-21ksoftirqd/109:25:001
171265199382,3cyclictest131rcu_preempt09:20:011
171265199382,3cyclictest131rcu_preempt09:20:011
1712651993820,13cyclictest275-21dbus-daemon12:10:001
1712646993831,4cyclictest16950irq/224-800000011:35:010
1712646993819,15cyclictest1719074-21sshd09:15:010
1712646993810,6cyclictest131rcu_preempt12:25:020
1712660993722,9cyclictest37-21ksoftirqd/307:55:023
1712660993722,12cyclictest37-21ksoftirqd/310:05:013
1712660993722,11cyclictest37-21ksoftirqd/311:07:213
1712656993729,6cyclictest30-21ksoftirqd/212:30:002
1712656993727,7cyclictest1717219-21sshd08:39:222
1712656993726,8cyclictest1721673-21pluginstate10:05:012
1712656993725,9cyclictest238-21systemd-journal11:44:212
1712656993725,8cyclictest238-21systemd-journal11:24:212
1712656993725,7cyclictest309-21in:imuxsock10:50:012
171265699372,4cyclictest131rcu_preempt12:05:002
1712656993719,14cyclictest275-21dbus-daemon08:10:012
171265199374,29cyclictest1721117-21cron09:55:011
1712651993727,7cyclictest1715692-21cron08:10:001
1712651993726,8cyclictest23-21ksoftirqd/108:05:001
1712651993725,9cyclictest23-21ksoftirqd/108:35:021
1712651993725,10cyclictest23-21ksoftirqd/109:45:021
1712651993724,9cyclictest23-21ksoftirqd/110:00:001
1712646993728,5cyclictest1714411-21sh07:44:590
171264699372,4cyclictest131rcu_preempt08:53:490
1712646993722,11cyclictest12-21ksoftirqd/010:05:010
171264699371,22cyclictest0-21swapper/009:53:270
171266099368,23cyclictest1722316-21latency_hist10:15:023
1712660993622,10cyclictest1727355-21munin-run11:55:003
1712660993620,11cyclictest1717756-21cron08:50:003
1712660993620,11cyclictest1717756-21cron08:50:003
171265699365,5cyclictest131rcu_preempt09:55:012
1712656993629,4cyclictest1716484-21latency_hist08:25:022
1712656993626,6cyclictest309-21in:imuxsock08:15:002
1712656993625,8cyclictest1724986-21sshd11:05:212
1712656993625,8cyclictest1724222-21cron10:55:002
1712656993623,10cyclictest1-21systemd08:50:012
1712656993623,10cyclictest1-21systemd08:50:012
1712656993622,11cyclictest1712777-21sed07:10:022
1712656993621,12cyclictest1718277-21systemctl09:00:012
1712656993621,11cyclictest1-21systemd08:55:002
1712651993626,6cyclictest1715948-21munin-plugin-st08:15:001
1712651993624,9cyclictest23-21ksoftirqd/112:20:021
1712651993622,10cyclictest23-21ksoftirqd/111:45:021
171264699368,5cyclictest131rcu_preempt11:00:590
171264699367,5cyclictest131rcu_preempt10:26:210
1712646993626,6cyclictest309-21in:imuxsock07:25:010
1712660993523,9cyclictest1715975-21sort08:15:023
1712660993521,10cyclictest37-21ksoftirqd/312:40:003
171265699352,3cyclictest131rcu_preempt07:50:002
1712656993519,11cyclictest238-21systemd-journal11:35:002
1712651993526,6cyclictest23-21ksoftirqd/110:15:021
1712651993525,7cyclictest1714884-21sshd07:51:201
1712651993524,7cyclictest23-21ksoftirqd/108:45:001
1712651993524,6cyclictest23-21ksoftirqd/112:25:001
1712651993521,10cyclictest275-21dbus-daemon08:30:011
1712651993519,12cyclictest1-21systemd11:40:011
1712660993410,19cyclictest1712661-21latency_hist07:10:013
171265699349,6cyclictest131rcu_preempt08:45:012
171265699342,6cyclictest131rcu_preempt09:35:002
1712656993425,7cyclictest30-21ksoftirqd/210:30:022
171265699342,4cyclictest131rcu_preempt08:05:002
1712656993422,9cyclictest30-21ksoftirqd/207:10:022
1712656993421,10cyclictest30-21ksoftirqd/212:36:212
1712656993420,11cyclictest30-21ksoftirqd/207:55:022
1712651993425,7cyclictest23-21ksoftirqd/112:05:021
1712651993424,8cyclictest23-21ksoftirqd/107:25:021
1712651993424,7cyclictest1718273-21latency_hist09:00:011
1712651993424,6cyclictest1726045-21cron11:30:001
1712651993424,6cyclictest1726045-21cron11:30:001
1712651993423,8cyclictest0-21swapper/107:10:011
1712651993416,14cyclictest238-21systemd-journal11:25:011
171265199341,3cyclictest131rcu_preempt11:15:011
1712646993410,19cyclictest131rcu_preempt12:35:010
1712656993325,4cyclictest1725284-21latency_hist11:15:022
1712656993322,9cyclictest30-21ksoftirqd/212:20:012
1712656993322,8cyclictest238-21systemd-journal07:33:212
1712656993320,10cyclictest30-21ksoftirqd/211:20:012
171265699331,5cyclictest131rcu_preempt07:20:002
171265199334,5cyclictest0-21swapper/110:45:021
171265199333,5cyclictest131rcu_preempt09:05:011
171265199333,22cyclictest1725524-21modprobe11:20:001
1712651993322,9cyclictest23-21ksoftirqd/108:55:001
1712656993224,5cyclictest1719592-21latency_hist09:25:012
1712656993223,7cyclictest30-21ksoftirqd/209:15:012
1712651993223,5cyclictest23-21ksoftirqd/110:35:021
1712651993223,5cyclictest23-21ksoftirqd/110:35:021
171265699312,4cyclictest131rcu_preempt07:30:002
1712656993124,5cyclictest30-21ksoftirqd/207:45:012
1712651993124,4cyclictest1724149-21latency_hist10:50:021
1712651993122,6cyclictest1723018-21latency_hist10:30:021
1712651993120,8cyclictest0-21swapper/109:15:011
1712651993120,7cyclictest1712806-21sshd07:10:211
1712656993024,4cyclictest1718550-21/usr/sbin/munin09:05:002
171265199302,3cyclictest131rcu_preempt07:45:021
1712651993017,10cyclictest1714085-21cut07:35:021
171265699294,3cyclictest131rcu_preempt09:40:032
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional