You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-28 - 20:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3s.osadl.org (updated Sat Jun 28, 2025 12:45:10)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2353810991141,22cyclictest131rcu_preempt11:50:020
235382099812,5cyclictest131rcu_preempt12:30:013
2353813996219,38cyclictest2358388-21kworker/u8:008:45:021
2353817996017,11cyclictest30-21ksoftirqd/207:25:012
2353817996017,11cyclictest30-21ksoftirqd/207:25:012
2353817996014,5cyclictest131rcu_preempt12:35:002
2353820995913,9cyclictest131rcu_preempt09:00:003
2353820995913,6cyclictest131rcu_preempt10:55:003
235381799587,6cyclictest131rcu_preempt11:55:012
235381799587,6cyclictest131rcu_preempt11:55:012
235381099581,5cyclictest131rcu_preempt12:10:000
235381799577,8cyclictest30-21ksoftirqd/210:10:022
2353820995632,8cyclictest37-21ksoftirqd/308:05:013
2353820995632,8cyclictest37-21ksoftirqd/308:05:013
2353817995614,9cyclictest131rcu_preempt11:10:012
2353817995611,6cyclictest131rcu_preempt07:55:012
2353817995610,6cyclictest131rcu_preempt10:40:012
2353813995639,13cyclictest1-21systemd07:15:011
2353813995639,13cyclictest1-21systemd07:15:011
235382099558,8cyclictest37-21ksoftirqd/311:55:013
235382099558,8cyclictest37-21ksoftirqd/311:55:013
235382099556,7cyclictest37-21ksoftirqd/310:30:003
2353820995510,6cyclictest131rcu_preempt11:40:003
2353817995513,5cyclictest131rcu_preempt11:35:022
235382099547,7cyclictest37-21ksoftirqd/309:34:313
2353820995425,11cyclictest37-21ksoftirqd/308:10:003
235382099541,5cyclictest131rcu_preempt07:10:023
2353820995414,6cyclictest131rcu_preempt12:40:003
2353820995411,5cyclictest131rcu_preempt10:00:013
235381799549,6cyclictest131rcu_preempt10:35:002
235381799543,31cyclictest30-21ksoftirqd/207:15:022
235381399548,26cyclictest363-21snmpd09:15:021
2353810995450,2cyclictest0-21swapper/007:30:020
235382099536,6cyclictest131rcu_preempt11:10:013
2353820995312,4cyclictest131rcu_preempt11:16:323
235381799538,6cyclictest131rcu_preempt10:55:022
235381799538,6cyclictest131rcu_preempt10:55:022
2353817995333,14cyclictest1-21systemd12:10:022
2353817995311,6cyclictest131rcu_preempt11:20:002
2353817995310,8cyclictest131rcu_preempt12:30:022
2353810995348,3cyclictest0-21swapper/007:20:020
2353810995332,14cyclictest12-21ksoftirqd/012:05:030
235382099529,5cyclictest131rcu_preempt11:41:493
2353820995234,14cyclictest235-21systemd-journal11:00:013
2353820995234,14cyclictest235-21systemd-journal11:00:003
235381799529,5cyclictest131rcu_preempt12:40:012
235381799529,5cyclictest131rcu_preempt07:45:002
235381799526,9cyclictest30-21ksoftirqd/208:26:292
235381799526,6cyclictest131rcu_preempt07:40:022
235381799526,6cyclictest131rcu_preempt07:40:022
2353817995243,6cyclictest30-21ksoftirqd/211:50:012
2353817995214,7cyclictest30-21ksoftirqd/212:05:012
2353817995212,6cyclictest131rcu_preempt10:20:002
2353817995211,6cyclictest131rcu_preempt11:40:012
2353810995214,6cyclictest131rcu_preempt12:40:010
235382099517,6cyclictest131rcu_preempt11:15:023
235382099515,6cyclictest131rcu_preempt08:00:003
2353820995112,5cyclictest131rcu_preempt07:55:013
2353820995110,5cyclictest131rcu_preempt11:50:013
2353820995110,5cyclictest131rcu_preempt08:20:013
2353820995110,5cyclictest131rcu_preempt08:20:013
235381799518,5cyclictest131rcu_preempt08:50:012
2353817995114,6cyclictest131rcu_preempt09:10:012
2353817995114,6cyclictest131rcu_preempt09:10:002
2353817995112,8cyclictest30-21ksoftirqd/208:05:032
2353817995111,6cyclictest131rcu_preempt12:15:002
2353817995111,6cyclictest131rcu_preempt10:00:012
2353817995110,6cyclictest131rcu_preempt11:30:002
2353813995138,10cyclictest1-21systemd08:25:001
2353810995133,14cyclictest272-21dbus-daemon11:35:010
235381099512,4cyclictest131rcu_preempt10:55:010
235381099511,46cyclictest0-21swapper/011:10:020
235382099509,5cyclictest131rcu_preempt12:00:003
235382099509,5cyclictest131rcu_preempt11:30:003
235382099508,6cyclictest131rcu_preempt09:40:013
235382099502,5cyclictest131rcu_preempt12:35:013
2353820995011,7cyclictest131rcu_preempt12:25:003
2353820995011,6cyclictest131rcu_preempt07:15:023
2353820995011,6cyclictest131rcu_preempt07:15:023
2353820995011,4cyclictest131rcu_preempt07:45:013
2353820995010,6cyclictest131rcu_preempt08:55:003
2353820995010,6cyclictest131rcu_preempt08:55:003
2353817995017,7cyclictest30-21ksoftirqd/208:35:002
2353817995015,5cyclictest131rcu_preempt09:20:012
2353817995011,9cyclictest131rcu_preempt11:05:002
2353817995010,5cyclictest131rcu_preempt10:45:012
2353817995010,5cyclictest131rcu_preempt10:45:012
235382099499,5cyclictest131rcu_preempt12:15:013
235382099499,5cyclictest131rcu_preempt09:47:313
235382099499,4cyclictest131rcu_preempt10:05:003
235382099498,6cyclictest131rcu_preempt09:30:003
235382099498,5cyclictest131rcu_preempt08:30:003
235382099498,5cyclictest131rcu_preempt07:30:013
235382099498,4cyclictest131rcu_preempt11:25:013
235382099496,7cyclictest131rcu_preempt10:35:023
235382099493,8cyclictest37-21ksoftirqd/307:50:013
2353820994914,5cyclictest131rcu_preempt09:05:013
2353820994912,5cyclictest131rcu_preempt09:20:003
2353820994911,6cyclictest131rcu_preempt07:20:003
235381799499,5cyclictest131rcu_preempt09:30:002
2353817994913,5cyclictest131rcu_preempt12:00:012
2353817994913,5cyclictest131rcu_preempt08:20:022
2353817994913,5cyclictest131rcu_preempt08:20:022
2353817994910,6cyclictest131rcu_preempt08:40:022
2353817994910,15cyclictest131rcu_preempt10:30:022
2353813994930,12cyclictest235-21systemd-journal09:40:001
235381099496,8cyclictest12-21ksoftirqd/009:40:000
235382099489,5cyclictest131rcu_preempt10:45:033
235382099489,5cyclictest131rcu_preempt10:45:023
235382099489,5cyclictest131rcu_preempt10:15:003
235382099487,6cyclictest131rcu_preempt10:40:013
235382099487,6cyclictest131rcu_preempt08:15:003
235382099484,6cyclictest131rcu_preempt09:55:003
2353820994811,6cyclictest131rcu_preempt10:50:003
2353820994811,4cyclictest131rcu_preempt12:10:013
235381799489,7cyclictest30-21ksoftirqd/209:25:022
235381799488,9cyclictest30-21ksoftirqd/209:15:002
235381799487,5cyclictest131rcu_preempt12:20:012
235381799484,10cyclictest30-21ksoftirqd/211:15:012
2353817994814,6cyclictest131rcu_preempt11:25:032
2353817994812,6cyclictest131rcu_preempt08:00:022
2353817994812,6cyclictest131rcu_preempt08:00:022
235382099477,6cyclictest131rcu_preempt09:10:023
235382099477,6cyclictest131rcu_preempt09:10:023
235381799478,5cyclictest131rcu_preempt09:05:002
235381799477,6cyclictest131rcu_preempt09:55:002
235381799477,5cyclictest131rcu_preempt07:50:012
235381799475,6cyclictest131rcu_preempt08:00:002
235381799471,6cyclictest131rcu_preempt09:50:022
2353817994713,9cyclictest131rcu_preempt10:50:012
2353817994710,6cyclictest131rcu_preempt08:25:002
2353810994739,6cyclictest151rcuc/008:10:020
2353810994734,10cyclictest235-21systemd-journal12:15:000
2353810994729,7cyclictest12-21ksoftirqd/010:05:020
2353810994716,19cyclictest131rcu_preempt09:35:010
235381099471,5cyclictest131rcu_preempt10:10:020
235382099466,6cyclictest131rcu_preempt12:20:003
2353820994611,5cyclictest131rcu_preempt09:25:023
235381799468,5cyclictest131rcu_preempt07:25:442
235381799466,8cyclictest30-21ksoftirqd/207:35:002
235381799465,5cyclictest131rcu_preempt10:05:012
2353817994630,12cyclictest1-21systemd10:15:002
235381799461,5cyclictest131rcu_preempt09:40:022
2353817994611,7cyclictest131rcu_preempt09:00:012
2353817994610,5cyclictest131rcu_preempt10:25:022
2353813994633,9cyclictest272-21dbus-daemon08:10:001
235381099464,4cyclictest131rcu_preempt11:15:010
235381099462,25cyclictest131rcu_preempt10:46:310
235381099461,5cyclictest131rcu_preempt07:50:000
235381099461,4cyclictest131rcu_preempt07:55:020
2353810994614,6cyclictest131rcu_preempt09:55:000
235382099459,6cyclictest131rcu_preempt07:25:003
235382099459,6cyclictest131rcu_preempt07:25:003
235382099458,6cyclictest131rcu_preempt10:20:013
235382099458,5cyclictest131rcu_preempt11:05:023
2353820994511,5cyclictest131rcu_preempt10:10:013
2353820994510,19cyclictest131rcu_preempt08:45:013
235381799457,6cyclictest131rcu_preempt07:10:022
235381799456,5cyclictest131rcu_preempt08:15:002
235381799455,10cyclictest30-21ksoftirqd/207:15:012
235381799455,10cyclictest30-21ksoftirqd/207:15:012
235381099452,6cyclictest131rcu_preempt08:00:010
2353810994525,15cyclictest235-21systemd-journal10:55:030
2353810994525,15cyclictest235-21systemd-journal10:55:020
235382099445,9cyclictest37-21ksoftirqd/310:25:023
235382099443,11cyclictest37-21ksoftirqd/309:45:013
2353820994422,5cyclictest37-21ksoftirqd/309:15:003
2353820994414,19cyclictest131rcu_preempt08:40:003
235381799448,6cyclictest131rcu_preempt09:35:012
2353817994432,8cyclictest235-21systemd-journal10:55:002
2353817994414,6cyclictest131rcu_preempt12:24:312
2353817994411,6cyclictest131rcu_preempt08:55:022
2353817994411,6cyclictest131rcu_preempt08:55:022
2353813994429,11cyclictest272-21dbus-daemon11:45:001
235381399442,4cyclictest131rcu_preempt08:05:011
235381399442,4cyclictest131rcu_preempt08:05:011
235381399442,3cyclictest131rcu_preempt11:30:011
235381099446,6cyclictest131rcu_preempt07:40:000
235381099446,6cyclictest131rcu_preempt07:40:000
235381099445,8cyclictest12-21ksoftirqd/009:00:000
235381099445,6cyclictest131rcu_preempt11:30:000
2353810994429,12cyclictest235-21systemd-journal09:04:310
2353810994410,5cyclictest131rcu_preempt11:05:000
235382099439,5cyclictest131rcu_preempt07:40:023
235382099439,5cyclictest131rcu_preempt07:40:023
2353820994311,4cyclictest131rcu_preempt08:49:323
2353817994330,9cyclictest235-21systemd-journal08:41:302
235381799431,8cyclictest0-21swapper/209:45:012
235381399434,3cyclictest131rcu_preempt12:10:021
235381399434,3cyclictest131rcu_preempt10:20:021
2353813994329,10cyclictest1-21systemd12:20:011
2353813994327,12cyclictest272-21dbus-daemon10:50:001
2353813994324,14cyclictest272-21dbus-daemon09:30:001
235381399431,3cyclictest131rcu_preempt11:55:031
235381399431,3cyclictest131rcu_preempt11:55:021
2353810994325,13cyclictest272-21dbus-daemon11:40:010
235381099432,12cyclictest2368818-21munin-run12:00:000
235381099432,10cyclictest235-21systemd-journal10:15:550
2353810994320,9cyclictest12-21ksoftirqd/012:35:010
2353810994311,7cyclictest131rcu_preempt09:10:000
2353810994311,7cyclictest131rcu_preempt09:10:000
235382099428,6cyclictest131rcu_preempt08:35:023
235382099423,10cyclictest37-21ksoftirqd/312:00:313
235382099422,6cyclictest131rcu_preempt07:35:003
235381399428,22cyclictest23-21ksoftirqd/107:55:021
235381399424,3cyclictest131rcu_preempt12:15:011
2353813994229,9cyclictest235-21systemd-journal09:00:311
235381399422,5cyclictest131rcu_preempt10:10:001
2353813994222,15cyclictest272-21dbus-daemon09:20:001
235381399421,15cyclictest281-21systemd-logind10:25:011
2353810994228,8cyclictest272-21dbus-daemon09:15:000
235381099421,5cyclictest131rcu_preempt09:20:000
2353810994215,23cyclictest131rcu_preempt08:20:010
2353810994215,23cyclictest131rcu_preempt08:20:010
2353810994215,22cyclictest131rcu_preempt11:55:020
2353810994215,22cyclictest131rcu_preempt11:55:020
235381099421,36cyclictest2368021-21sshd11:41:320
235381799418,6cyclictest131rcu_preempt11:45:012
235381399418,7cyclictest23-21ksoftirqd/112:35:021
235381099414,5cyclictest131rcu_preempt12:20:010
235381099414,4cyclictest131rcu_preempt08:55:020
235381099414,4cyclictest131rcu_preempt08:55:020
2353810994137,2cyclictest0-21swapper/008:00:020
2353810994137,2cyclictest0-21swapper/008:00:020
2353810994128,10cyclictest2364377-21sshd10:31:310
2353810994124,14cyclictest2357875-21sshd08:25:280
235381099411,5cyclictest235-21systemd-journal07:15:000
235381099411,5cyclictest235-21systemd-journal07:15:000
235381099411,4cyclictest131rcu_preempt09:45:010
235382099403,11cyclictest37-21ksoftirqd/311:35:013
2353820994011,5cyclictest131rcu_preempt08:25:003
235381399407,3cyclictest131rcu_preempt11:05:001
235381399402,3cyclictest131rcu_preempt10:55:021
235381099407,5cyclictest131rcu_preempt10:15:000
2353810994024,11cyclictest12-21ksoftirqd/009:50:010
235381399395,5cyclictest131rcu_preempt07:20:021
235381399394,4cyclictest131rcu_preempt07:30:001
2353813993928,9cyclictest23-21ksoftirqd/112:30:021
2353813993928,7cyclictest2362566-21cron10:00:001
2353813993926,10cyclictest2366483-21sh11:15:021
235381399391,3cyclictest131rcu_preempt11:10:011
235381399391,10cyclictest2361373-21latency_hist09:35:021
235381099396,7cyclictest12-21ksoftirqd/010:25:020
235381099393,6cyclictest131rcu_preempt08:40:020
235381099393,10cyclictest235-21systemd-journal10:00:000
235381099392,6cyclictest131rcu_preempt08:35:000
2353810993924,11cyclictest2364626-21sshd10:36:270
235381099391,5cyclictest131rcu_preempt11:20:020
2353810993915,5cyclictest131rcu_preempt07:25:010
2353810993915,5cyclictest131rcu_preempt07:25:010
2353810993914,6cyclictest131rcu_preempt11:25:000
235381399384,3cyclictest131rcu_preempt07:40:011
235381399384,3cyclictest131rcu_preempt07:40:011
2353813993826,8cyclictest306-21in:imuxsock09:45:001
2353813993825,10cyclictest23-21ksoftirqd/112:05:021
2353813993824,11cyclictest235-21systemd-journal09:00:001
2353813993824,10cyclictest23-21ksoftirqd/110:40:011
2353813993820,6cyclictest131rcu_preempt11:40:011
235381099381,5cyclictest131rcu_preempt10:45:030
235381099381,5cyclictest131rcu_preempt10:45:020
2353810993815,12cyclictest12-21ksoftirqd/007:45:000
235381099381,33cyclictest2354883-21latency_hist07:30:010
235381099381,10cyclictest1-21systemd10:26:310
235381399374,3cyclictest131rcu_preempt08:45:031
235381399373,3cyclictest131rcu_preempt10:45:011
235381399373,3cyclictest131rcu_preempt10:45:011
2353813993727,7cyclictest2370602-21sshd12:30:321
235381399372,3cyclictest131rcu_preempt07:50:001
2353813993718,6cyclictest131rcu_preempt08:40:011
235381399371,4cyclictest131rcu_preempt10:05:001
2353810993727,7cyclictest12-21ksoftirqd/007:10:020
235381099372,5cyclictest131rcu_preempt09:25:020
2353810993725,9cyclictest12-21ksoftirqd/012:30:000
2353810993722,11cyclictest12-21ksoftirqd/008:50:000
235381099371,4cyclictest131rcu_preempt08:15:010
235381399369,6cyclictest131rcu_preempt09:05:021
235381399369,6cyclictest131rcu_preempt09:05:021
2353813993626,7cyclictest2360751-21sshd09:20:311
2353813993626,7cyclictest2358145-21sshd08:34:291
2353813993625,8cyclictest2363345-21sshd10:14:311
2353813993625,5cyclictest23-21ksoftirqd/110:35:011
235381399362,3cyclictest131rcu_preempt08:20:021
235381399362,3cyclictest131rcu_preempt08:20:021
2353813993622,11cyclictest23-21ksoftirqd/111:49:571
2353813993618,6cyclictest131rcu_preempt08:00:011
2353813993618,14cyclictest235-21systemd-journal07:35:001
235381399361,3cyclictest131rcu_preempt07:10:021
235381099361,31cyclictest0-21swapper/012:22:020
2353813993528,4cyclictest2366712-21sshd11:17:311
2353813993521,10cyclictest2368830-21tr12:00:001
2353813993519,12cyclictest2357130-21systemd-run08:15:011
2353810993520,11cyclictest235-21systemd-journal09:30:000
2353810993514,9cyclictest12-21ksoftirqd/008:20:290
235381099351,31cyclictest0-21swapper/008:43:010
235381399346,5cyclictest131rcu_preempt12:24:311
2353813993419,12cyclictest272-21dbus-daemon10:25:491
2353813993412,6cyclictest131rcu_preempt08:55:001
2353813993412,6cyclictest131rcu_preempt08:55:001
2353813993322,8cyclictest23-21ksoftirqd/111:35:001
2353813993320,10cyclictest235-21systemd-journal11:25:011
2353813993317,5cyclictest131rcu_preempt09:55:011
2353813993317,5cyclictest131rcu_preempt07:22:281
2353813993317,5cyclictest131rcu_preempt07:22:281
235381399322,3cyclictest131rcu_preempt07:45:021
2353813993223,6cyclictest2365683-21cron11:00:001
2353813993223,6cyclictest2365683-21cron11:00:001
2353813993221,8cyclictest23-21ksoftirqd/109:50:001
2353813993220,10cyclictest23-21ksoftirqd/108:30:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional