You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 17:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3s.osadl.org (updated Wed Dec 31, 2025 12:45:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2335212998733,13cyclictest1-21systemd09:25:001
233520899738,33cyclictest131rcu_preempt10:25:010
2335212996111,9cyclictest23-21ksoftirqd/110:34:591
2335208996135,20cyclictest2335949-21cut07:25:000
2335222996038,16cyclictest1-21systemd11:45:013
2335208996038,17cyclictest238-21systemd-journal09:55:010
2335208995948,6cyclictest2335214-21latency_hist07:10:020
2335222995839,14cyclictest238-21systemd-journal10:49:593
233520899589,8cyclictest12-21ksoftirqd/012:20:010
2335208995841,10cyclictest2348087-21modprobe11:20:010
233520899582,17cyclictest12-21ksoftirqd/007:20:000
2335222995741,13cyclictest37-21ksoftirqd/308:45:013
2335208995721,13cyclictest12-21ksoftirqd/008:20:000
233521299556,32cyclictest0-21swapper/108:30:021
233521299556,32cyclictest0-21swapper/108:30:021
2335208995446,5cyclictest16950irq/224-800000010:19:590
2335208995436,14cyclictest238-21systemd-journal09:59:590
233520899541,7cyclictest12-21ksoftirqd/009:10:020
233521299539,30cyclictest2335646-21kworker/u8:207:55:031
233521299539,30cyclictest2335646-21kworker/u8:207:55:021
233520899536,8cyclictest12-21ksoftirqd/009:00:000
233520899531,11cyclictest12-21ksoftirqd/011:00:010
233520899531,11cyclictest12-21ksoftirqd/011:00:000
2335222995233,13cyclictest238-21systemd-journal11:54:593
2335222995230,17cyclictest238-21systemd-journal09:00:013
233520899526,12cyclictest12-21ksoftirqd/009:25:010
233520899521,15cyclictest12-21ksoftirqd/009:15:010
2335212995141,6cyclictest2335219-21latency_hist07:10:011
2335212995135,11cyclictest1-21systemd12:05:011
2335212995135,11cyclictest1-21systemd12:05:001
233520899519,9cyclictest12-21ksoftirqd/008:40:010
233520899517,12cyclictest12-21ksoftirqd/012:00:010
233520899516,6cyclictest131rcu_preempt11:40:010
233520899514,12cyclictest12-21ksoftirqd/010:40:010
2335208995134,13cyclictest1-21systemd08:50:010
233520899512,41cyclictest1-21systemd09:20:010
233520899512,15cyclictest2345772-21systemd-run10:35:000
233522299504,42cyclictest410-21lldpd09:30:013
233520899508,11cyclictest12-21ksoftirqd/012:10:010
233520899507,11cyclictest12-21ksoftirqd/012:35:000
233520899502,12cyclictest12-21ksoftirqd/009:50:030
233520899501,18cyclictest12-21ksoftirqd/008:25:000
2335222994910,9cyclictest37-21ksoftirqd/312:05:343
2335218994931,14cyclictest238-21systemd-journal10:45:002
233521299497,8cyclictest23-21ksoftirqd/110:21:341
2335212994932,11cyclictest1-21systemd10:00:011
233520899497,11cyclictest12-21ksoftirqd/007:15:000
233520899494,9cyclictest12-21ksoftirqd/012:25:000
233520899493,9cyclictest12-21ksoftirqd/012:40:020
233520899493,9cyclictest12-21ksoftirqd/012:40:010
2335208994928,14cyclictest238-21systemd-journal08:45:000
233520899491,7cyclictest2350940-21munin-run12:15:000
2335222994831,12cyclictest275-21dbus-daemon07:25:013
2335222994826,16cyclictest238-21systemd-journal12:25:003
2335218994831,13cyclictest30-21ksoftirqd/209:30:012
2335218994831,12cyclictest1-21systemd07:55:022
2335218994831,12cyclictest1-21systemd07:55:012
2335218994822,19cyclictest1-21systemd09:50:002
2335218994812,5cyclictest131rcu_preempt11:08:342
2335212994833,11cyclictest275-21dbus-daemon07:35:021
2335212994832,11cyclictest275-21dbus-daemon10:30:001
233520899485,9cyclictest12-21ksoftirqd/007:35:010
233520899485,11cyclictest12-21ksoftirqd/008:30:010
233520899485,11cyclictest12-21ksoftirqd/008:30:000
233520899484,7cyclictest12-21ksoftirqd/007:45:010
2335208994841,4cyclictest16950irq/224-800000010:55:010
2335208994838,7cyclictest12-21ksoftirqd/009:40:010
2335208994812,5cyclictest131rcu_preempt07:55:020
2335208994812,5cyclictest131rcu_preempt07:55:020
2335208994811,6cyclictest131rcu_preempt11:05:020
233522299472,5cyclictest131rcu_preempt10:00:003
233521899475,9cyclictest30-21ksoftirqd/208:37:332
233521899474,3cyclictest131rcu_preempt09:40:022
2335212994731,12cyclictest1-21systemd12:40:011
2335212994731,12cyclictest1-21systemd12:40:011
233520899479,10cyclictest12-21ksoftirqd/008:05:000
233520899478,6cyclictest131rcu_preempt09:30:000
233520899476,8cyclictest12-21ksoftirqd/009:35:010
2335208994712,6cyclictest131rcu_preempt07:50:010
2335222994628,13cyclictest37-21ksoftirqd/309:25:003
2335218994635,7cyclictest309-21in:imuxsock08:20:002
2335218994628,12cyclictest238-21systemd-journal11:50:002
233521299464,6cyclictest23-21ksoftirqd/107:40:001
233520899469,9cyclictest12-21ksoftirqd/011:35:010
233520899467,11cyclictest12-21ksoftirqd/012:05:020
233520899467,11cyclictest12-21ksoftirqd/012:05:010
233520899465,11cyclictest12-21ksoftirqd/010:10:010
233520899465,11cyclictest12-21ksoftirqd/010:10:010
233520899465,11cyclictest12-21ksoftirqd/009:04:330
233520899462,9cyclictest12-21ksoftirqd/009:45:010
2335208994612,5cyclictest131rcu_preempt08:00:020
233520899461,13cyclictest12-21ksoftirqd/008:10:000
233522299454,5cyclictest131rcu_preempt09:15:003
2335222994532,9cyclictest37-21ksoftirqd/310:36:333
2335222994530,12cyclictest37-21ksoftirqd/308:50:023
2335222994527,12cyclictest309-21in:imuxsock10:10:013
2335222994527,12cyclictest309-21in:imuxsock10:10:003
233522299451,9cyclictest2337769-21kworker/3:009:55:023
2335222994513,6cyclictest131rcu_preempt11:10:003
233521899453,3cyclictest131rcu_preempt08:15:022
2335218994531,10cyclictest1-21systemd11:40:012
2335212994526,14cyclictest275-21dbus-daemon11:50:001
233521299452,4cyclictest131rcu_preempt11:55:011
233521299452,4cyclictest131rcu_preempt11:15:021
2335212994510,6cyclictest131rcu_preempt12:35:021
233520899454,9cyclictest12-21ksoftirqd/008:35:000
233520899452,9cyclictest12-21ksoftirqd/011:50:020
233520899452,11cyclictest12-21ksoftirqd/010:45:020
2335208994511,5cyclictest131rcu_preempt10:15:010
233522299446,32cyclictest2339808-21munin-run08:40:013
2335222994421,19cyclictest37-21ksoftirqd/311:15:003
2335222994418,21cyclictest37-21ksoftirqd/309:40:003
2335222994411,6cyclictest131rcu_preempt10:25:013
233522299441,10cyclictest2347326-21latency_hist11:05:023
233521899446,6cyclictest131rcu_preempt07:55:332
233521899443,5cyclictest131rcu_preempt08:50:022
233521299448,8cyclictest23-21ksoftirqd/108:56:321
2335212994431,10cyclictest2339786-21cron08:40:001
2335212994428,12cyclictest1-21systemd11:30:011
233520899445,9cyclictest12-21ksoftirqd/008:15:030
233520899445,11cyclictest12-21ksoftirqd/007:40:020
233520899442,13cyclictest12-21ksoftirqd/011:10:010
2335222994321,11cyclictest131rcu_preempt07:35:013
2335218994327,13cyclictest2338037-21sed08:05:022
233521899431,5cyclictest131rcu_preempt12:20:012
233521299433,5cyclictest131rcu_preempt10:19:591
233521299431,4cyclictest131rcu_preempt10:05:021
233520899435,11cyclictest12-21ksoftirqd/008:55:010
2335208994332,8cyclictest12-21ksoftirqd/011:20:330
233520899431,10cyclictest2348635-21unin-run11:30:010
233522299426,5cyclictest131rcu_preempt08:25:023
2335222994231,8cyclictest2343410-21sshd09:46:333
233522299421,6cyclictest131rcu_preempt09:20:003
233522299421,6cyclictest131rcu_preempt07:15:013
233522299421,5cyclictest131rcu_preempt10:35:013
2335218994232,7cyclictest2346510-21sshd10:45:342
2335218994229,10cyclictest238-21systemd-journal12:00:002
2335218994227,11cyclictest30-21ksoftirqd/207:15:012
2335218994225,13cyclictest1-21systemd08:45:012
2335218994225,12cyclictest309-21in:imuxsock10:40:002
233521899422,3cyclictest131rcu_preempt10:59:342
233521899422,3cyclictest131rcu_preempt10:59:342
233521299423,4cyclictest131rcu_preempt07:59:591
2335212994228,11cyclictest23-21ksoftirqd/111:20:001
2335212994227,12cyclictest23-21ksoftirqd/109:30:021
233521299422,6cyclictest2337250-21latency_hist07:50:011
2335212994224,12cyclictest275-21dbus-daemon11:40:011
233520899426,6cyclictest131rcu_preempt11:15:000
2335208994230,6cyclictest309-21in:imuxsock11:55:000
2335208994211,7cyclictest131rcu_preempt10:05:010
233522299415,4cyclictest131rcu_preempt12:35:013
2335222994132,7cyclictest37-21ksoftirqd/310:05:023
2335222994127,10cyclictest2351712-21cron12:30:003
2335222994126,11cyclictest275-21dbus-daemon11:20:023
2335222994126,11cyclictest1-21systemd07:30:003
2335222994124,11cyclictest275-21dbus-daemon11:50:003
233522299412,3cyclictest131rcu_preempt10:30:013
2335222994119,18cyclictest37-21ksoftirqd/312:00:013
2335222994111,5cyclictest131rcu_preempt08:55:013
233521899418,5cyclictest131rcu_preempt11:44:282
2335218994128,10cyclictest1-21systemd11:25:472
2335218994125,11cyclictest238-21systemd-journal09:45:012
2335218994121,14cyclictest275-21dbus-daemon09:10:002
2335218994118,18cyclictest1-21systemd08:10:002
233521299418,5cyclictest131rcu_preempt12:15:011
233521299415,4cyclictest131rcu_preempt08:30:341
2335212994128,10cyclictest1-21systemd08:15:011
2335212994127,10cyclictest275-21dbus-daemon09:15:001
233520899418,6cyclictest131rcu_preempt11:45:030
2335208994127,9cyclictest12-21ksoftirqd/010:50:000
233522299409,5cyclictest131rcu_preempt07:56:343
233522299405,5cyclictest131rcu_preempt08:18:563
2335222994020,15cyclictest238-21systemd-journal07:55:003
2335222994020,15cyclictest238-21systemd-journal07:55:003
233522299401,5cyclictest131rcu_preempt12:40:023
233522299401,5cyclictest131rcu_preempt12:40:013
2335222994011,7cyclictest131rcu_preempt11:30:023
233521899403,3cyclictest131rcu_preempt12:03:332
233521899403,3cyclictest131rcu_preempt12:03:332
2335218994016,6cyclictest291rcuc/208:35:012
233521299405,3cyclictest131rcu_preempt09:10:001
233521299403,4cyclictest131rcu_preempt08:45:001
2335212994029,7cyclictest2351451-21sshd12:23:331
2335212994028,9cyclictest275-21dbus-daemon09:05:011
2335212994027,9cyclictest1-21systemd10:10:021
2335212994027,9cyclictest1-21systemd10:10:011
2335212994027,10cyclictest23-21ksoftirqd/107:25:001
233521299402,4cyclictest131rcu_preempt10:55:021
2335212994024,11cyclictest238-21systemd-journal09:35:011
2335212994021,13cyclictest238-21systemd-journal07:30:011
233520899405,9cyclictest12-21ksoftirqd/007:30:000
2335208994032,5cyclictest12-21ksoftirqd/012:30:010
2335222993930,5cyclictest2348369-21munin-plugin-st11:24:593
233522299392,5cyclictest131rcu_preempt09:10:023
2335222993924,12cyclictest275-21dbus-daemon07:40:013
233522299391,5cyclictest131rcu_preempt10:20:003
233521899398,3cyclictest131rcu_preempt11:20:002
233521899394,3cyclictest131rcu_preempt07:20:002
2335218993928,7cyclictest2341097-21cron09:04:592
2335218993927,9cyclictest1-21systemd10:30:002
2335218993925,11cyclictest2340841-21systemctl09:00:012
2335218993922,12cyclictest30-21ksoftirqd/209:55:002
233521899391,5cyclictest131rcu_preempt10:00:012
233521299396,6cyclictest131rcu_preempt12:00:021
233521299395,6cyclictest131rcu_preempt10:45:001
233521299394,4cyclictest131rcu_preempt08:55:011
233521299393,3cyclictest131rcu_preempt11:10:011
2335212993926,10cyclictest23-21ksoftirqd/109:20:011
2335212993923,12cyclictest275-21dbus-daemon12:20:011
2335212993919,13cyclictest275-21dbus-daemon10:50:011
233522299382,5cyclictest131rcu_preempt10:15:023
2335222993822,11cyclictest2350421-21cron12:05:013
2335222993822,11cyclictest2350421-21cron12:05:003
233521899386,3cyclictest131rcu_preempt11:25:012
233521899385,3cyclictest131rcu_preempt07:50:002
233521899384,5cyclictest131rcu_preempt12:35:012
2335218993824,10cyclictest30-21ksoftirqd/210:55:002
2335218993824,10cyclictest238-21systemd-journal11:05:002
233521299385,3cyclictest131rcu_preempt08:25:021
233521299383,5cyclictest131rcu_preempt08:05:011
233521299383,3cyclictest131rcu_preempt08:19:591
233521299382,4cyclictest131rcu_preempt09:39:591
233521299382,3cyclictest131rcu_preempt10:15:011
2335212993823,10cyclictest275-21dbus-daemon09:45:011
233522299377,6cyclictest131rcu_preempt08:34:593
233522299375,6cyclictest131rcu_preempt12:20:003
233522299372,5cyclictest131rcu_preempt09:35:023
2335222993719,13cyclictest275-21dbus-daemon11:35:013
233522299371,8cyclictest2335654-21cron07:20:003
233522299371,6cyclictest0-21swapper/311:40:023
233521899374,4cyclictest131rcu_preempt09:19:592
233521899374,3cyclictest131rcu_preempt07:10:012
233521899373,3cyclictest131rcu_preempt11:35:012
233521899372,6cyclictest131rcu_preempt10:35:022
2335218993723,11cyclictest2345369-21sed10:25:022
2335218993722,10cyclictest275-21dbus-daemon12:10:002
2335218993720,11cyclictest275-21dbus-daemon11:55:012
233521899371,7cyclictest0-21swapper/210:15:002
233521899371,3cyclictest131rcu_preempt09:25:012
233521299374,6cyclictest23-21ksoftirqd/108:50:011
233521299373,3cyclictest131rcu_preempt11:02:331
233521299372,5cyclictest131rcu_preempt07:20:031
233521299372,4cyclictest131rcu_preempt12:10:021
233521299372,4cyclictest131rcu_preempt09:50:011
233521299372,3cyclictest131rcu_preempt11:25:011
233521299372,3cyclictest131rcu_preempt11:00:021
233521299372,3cyclictest131rcu_preempt11:00:011
233521299371,4cyclictest131rcu_preempt07:45:001
233520899377,10cyclictest12-21ksoftirqd/010:25:220
233522299362,5cyclictest131rcu_preempt07:50:033
2335222993624,9cyclictest37-21ksoftirqd/307:45:003
2335222993621,6cyclictest309-21in:imuxsock08:05:003
2335222993611,7cyclictest131rcu_preempt10:55:013
233521899366,3cyclictest131rcu_preempt07:30:022
233521899365,3cyclictest131rcu_preempt10:05:002
233521899363,3cyclictest131rcu_preempt08:25:002
2335218993626,7cyclictest2344991-21/usr/sbin/munin10:20:022
233521299365,3cyclictest131rcu_preempt11:35:001
233521299363,3cyclictest131rcu_preempt10:40:021
2335212993622,10cyclictest2335414-21sh07:15:001
233521299361,5cyclictest131rcu_preempt08:10:011
233522299354,4cyclictest131rcu_preempt11:00:013
233522299354,4cyclictest131rcu_preempt11:00:003
2335222993523,9cyclictest238-21systemd-journal12:15:003
233522299351,5cyclictest131rcu_preempt09:45:013
233522299351,5cyclictest131rcu_preempt08:10:023
2335222993510,5cyclictest131rcu_preempt09:05:013
233521899355,3cyclictest131rcu_preempt10:10:022
233521899355,3cyclictest131rcu_preempt10:10:022
233521899352,3cyclictest131rcu_preempt09:15:032
233521899352,28cyclictest2339297-21grep08:30:012
233521899352,28cyclictest2339297-21grep08:30:002
2335218993521,9cyclictest30-21ksoftirqd/207:45:012
2335218993517,13cyclictest238-21systemd-journal12:40:012
2335218993517,13cyclictest238-21systemd-journal12:40:002
233521899351,3cyclictest131rcu_preempt11:15:012
2335218993512,6cyclictest131rcu_preempt07:35:012
233521299352,4cyclictest131rcu_preempt09:55:001
2335222993427,4cyclictest2346290-21latency_hist10:45:023
2335222993424,7cyclictest2339304-21systemd-run08:30:023
2335222993424,7cyclictest2339304-21systemd-run08:30:013
2335222993424,5cyclictest309-21in:imuxsock08:15:023
233521899342,4cyclictest131rcu_preempt12:10:332
2335218993424,8cyclictest30-21ksoftirqd/207:40:022
2335212993423,7cyclictest2351692-21sshd12:25:331
2335222993323,8cyclictest37-21ksoftirqd/307:10:023
2335218993326,4cyclictest2340581-21/usr/sbin/munin08:55:002
2335218993325,5cyclictest2351674-21latency_hist12:25:012
2335218993325,5cyclictest2336047-21latency_hist07:25:012
2335218993321,9cyclictest2351815-21sed12:30:022
233521299331,3cyclictest131rcu_preempt11:45:011
2335218993118,10cyclictest2342702-21cat09:35:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional