You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 15:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3s.osadl.org (updated Wed Jan 07, 2026 12:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
320411899755,6cyclictest131rcu_preempt12:40:000
3204118996844,19cyclictest275-21dbus-daemon09:00:000
3204118996844,19cyclictest275-21dbus-daemon09:00:000
3204123996726,37cyclictest3210539-21apt-config09:11:021
320412399672,17cyclictest3218877-21munin-run11:55:011
320412399672,17cyclictest3218877-21munin-run11:55:001
320412399652,14cyclictest3205652-21munin-run07:40:011
320412399651,12cyclictest3218344-21sshd11:42:451
320412399651,11cyclictest3216271-21sshd11:02:461
320412399642,13cyclictest3209261-21munin-run08:50:011
3204123996222,37cyclictest23-21ksoftirqd/112:10:011
320412399622,13cyclictest3219405-21munin-run12:05:011
320412399622,12cyclictest3207974-21munin-run08:25:011
320412399621,15cyclictest3210010-21sshd09:04:241
320412399621,11cyclictest364-21snmpd12:29:241
320412399621,11cyclictest364-21snmpd12:29:231
320412399612,16cyclictest3206142-21munin-run07:50:001
320412399602,14cyclictest3212178-21munin-run09:45:011
320412399602,14cyclictest3211397-21munin-run09:30:021
320412399601,10cyclictest3214221-21sshd10:24:241
320412399591,15cyclictest3219111-21sshd11:59:461
320412399591,11cyclictest364-21snmpd08:58:391
320412399591,11cyclictest364-21snmpd08:58:381
320412399591,11cyclictest3217036-21sshd11:17:461
320412399582,13cyclictest3215997-21sshd10:59:271
320412399581,12cyclictest364-21snmpd09:58:501
320412399574,7cyclictest3205880-21modprobe07:45:001
320412399573,6cyclictest3218082-21cron11:40:001
320412399572,9cyclictest3211112-21modprobe09:24:151
320412399572,8cyclictest238-21systemd-journal08:38:241
320412399572,8cyclictest238-21systemd-journal08:38:231
320412399572,7cyclictest3211621-21cron09:35:001
320412399572,7cyclictest3211621-21cron09:35:001
320412399572,16cyclictest3220473-21latency_hist12:25:011
320412399572,13cyclictest3209478-21sshd08:54:071
320412399572,11cyclictest364-21snmpd10:38:571
320412399572,11cyclictest364-21snmpd10:38:571
3204123995719,33cyclictest3220946-21cut12:35:001
3204123995716,36cyclictest1-21systemd07:30:011
320412399571,11cyclictest3210285-21munin-run09:10:001
320412399571,10cyclictest3212428-21pluginstate09:50:021
320412399562,10cyclictest3204860-21munin-run07:25:001
320412399561,14cyclictest3206907-21cron08:05:001
3204123995611,41cyclictest3208982-21cron08:44:591
320412399561,12cyclictest364-21snmpd11:14:511
320412399561,10cyclictest3217813-21sshd11:31:451
3204118995639,13cyclictest3213960-21cron10:20:010
3204118995639,13cyclictest3213960-21cron10:20:000
320413399553,4cyclictest131rcu_preempt12:40:023
3204133995520,26cyclictest37-21ksoftirqd/309:11:013
320412399558,4cyclictest0-21swapper/108:33:191
320412399552,8cyclictest3207159-21cron08:09:591
3204123995519,31cyclictest309-21in:imuxsock12:40:001
320412399551,12cyclictest364-21snmpd11:25:241
320412399551,11cyclictest3206365-21sshd07:53:241
320412399551,10cyclictest3212645-21sshd09:54:191
320412399551,10cyclictest3212645-21sshd09:54:191
3204128995438,12cyclictest275-21dbus-daemon12:15:022
3204128995434,16cyclictest1-21systemd12:10:002
3204123995437,12cyclictest238-21systemd-journal12:20:011
320412399543,6cyclictest1-21systemd11:25:011
320412399542,13cyclictest364-21snmpd07:58:281
320412399541,14cyclictest3219874-21sshd12:11:451
320412399541,11cyclictest3210836-21sshd09:19:241
320411899545,3cyclictest131rcu_preempt10:45:010
3204128995344,6cyclictest3215043-21kworker/2:011:15:012
320412399538,3cyclictest0-21swapper/109:37:411
3204123995323,26cyclictest3218589-21sshd11:45:461
3204123995315,32cyclictest3207676-21modprobe08:20:001
320412399531,48cyclictest3215488-21sshd10:46:231
320412399531,10cyclictest364-21snmpd10:53:491
320412399531,10cyclictest364-21snmpd07:32:141
320412399522,12cyclictest3204340-21latency_hist07:15:011
320412399521,13cyclictest364-21snmpd10:05:541
3204123995211,3cyclictest0-21swapper/108:28:331
320412399521,11cyclictest364-21snmpd10:19:311
320412399521,11cyclictest364-21snmpd10:19:311
320412399521,10cyclictest364-21snmpd10:31:591
3204133995133,13cyclictest275-21dbus-daemon07:20:013
320412399514,6cyclictest3204246-21cat07:10:021
320412399512,6cyclictest3213693-21modprobe10:15:001
320412399512,14cyclictest238-21systemd-journal07:20:021
320411899512,16cyclictest1-21systemd10:40:010
320411899512,16cyclictest1-21systemd10:40:000
320411899512,15cyclictest3206926-21systemd-run08:05:020
3204133995030,15cyclictest1-21systemd11:55:023
3204133995030,15cyclictest1-21systemd11:55:013
320412399504,6cyclictest0-21swapper/110:05:021
3204123995015,30cyclictest1-21systemd11:10:011
3204118995041,3cyclictest0-21swapper/007:45:020
3204128994932,13cyclictest275-21dbus-daemon11:35:012
320412399492,18cyclictest3207444-21wc08:15:021
3204118994932,12cyclictest275-21dbus-daemon12:30:020
3204118994932,12cyclictest275-21dbus-daemon12:30:010
320411899492,10cyclictest3208713-21modprobe08:40:000
320411899492,10cyclictest3208713-21modprobe08:40:000
320413399482,40cyclictest3213007-21wc10:00:013
320412899486,39cyclictest30-21ksoftirqd/207:15:032
3204123994824,21cyclictest3214563-21latency_hist10:30:011
320411899482,41cyclictest3217071-21sendmail11:20:000
3204133994723,5cyclictest37-21ksoftirqd/309:20:013
3204123994711,31cyclictest0-21swapper/110:41:251
320411899474,8cyclictest1-21systemd09:45:010
3204118994743,2cyclictest0-21swapper/008:45:020
320411899473,39cyclictest3210908-21latency_hist09:20:020
3204118994719,24cyclictest3216907-21sort11:15:020
320413399469,6cyclictest131rcu_preempt07:10:033
3204133994627,14cyclictest1-21systemd08:00:003
320413399462,5cyclictest131rcu_preempt07:35:003
320411899463,6cyclictest131rcu_preempt07:20:010
3204118994632,10cyclictest238-21systemd-journal09:55:020
3204133994528,12cyclictest275-21dbus-daemon12:25:013
3204118994533,9cyclictest1-21systemd12:35:000
3204118994530,11cyclictest1-21systemd08:10:000
3204118994529,13cyclictest3208179-21sshd08:26:230
320411899452,39cyclictest3211894-21munin-run09:40:000
320413399443,5cyclictest131rcu_preempt09:55:033
320413399443,5cyclictest131rcu_preempt09:55:023
3204133994432,8cyclictest37-21ksoftirqd/311:00:003
3204133994428,12cyclictest275-21dbus-daemon12:35:003
3204133994426,13cyclictest275-21dbus-daemon11:50:003
3204133994420,5cyclictest37-21ksoftirqd/311:30:013
3204128994430,10cyclictest30-21ksoftirqd/210:45:012
3204128994425,14cyclictest275-21dbus-daemon09:20:002
3204118994440,2cyclictest0-21swapper/011:10:010
3204118994437,4cyclictest16950irq/224-800000010:35:010
3204118994437,4cyclictest16950irq/224-800000008:00:000
3204118994430,10cyclictest3220443-21latency_hist12:25:010
3204118994413,27cyclictest1-21systemd07:24:240
3204133994327,12cyclictest275-21dbus-daemon08:50:013
3204133994325,14cyclictest1-21systemd12:30:023
3204133994325,14cyclictest1-21systemd12:30:013
3204133994325,13cyclictest3216311-21systemd-run11:05:023
3204133994320,5cyclictest37-21ksoftirqd/311:35:023
3204128994328,12cyclictest3215858-21sed10:55:022
3204118994336,4cyclictest16950irq/224-800000009:15:010
320411899433,5cyclictest131rcu_preempt11:00:000
3204118994333,7cyclictest3213436-21cron10:10:000
3204118994330,10cyclictest1-21systemd07:35:000
320411899432,8cyclictest1-21systemd11:05:010
3204118994328,11cyclictest275-21dbus-daemon07:40:000
320411899432,7cyclictest3215762-21modprobe10:55:000
3204133994228,10cyclictest3215000-21systemctl10:40:013
3204133994228,10cyclictest3215000-21systemctl10:40:003
3204133994227,11cyclictest238-21systemd-journal08:55:013
3204133994226,10cyclictest238-21systemd-journal07:50:003
3204133994218,5cyclictest37-21ksoftirqd/311:45:013
3204128994229,9cyclictest238-21systemd-journal09:39:592
3204128994229,9cyclictest1-21systemd08:15:012
3204118994232,7cyclictest12-21ksoftirqd/008:20:030
3204118994231,8cyclictest16950irq/224-800000009:10:000
320411899422,35cyclictest3214550-21grep10:30:020
320411899421,6cyclictest3219669-21munin-run12:10:020
320411899421,3cyclictest131rcu_preempt09:55:030
320411899421,3cyclictest131rcu_preempt09:55:020
3204133994129,8cyclictest37-21ksoftirqd/312:19:593
3204133994122,12cyclictest1-21systemd10:35:003
3204128994128,9cyclictest275-21dbus-daemon10:15:002
3204128994126,10cyclictest275-21dbus-daemon08:20:002
3204118994131,7cyclictest12-21ksoftirqd/008:15:000
320411899412,9cyclictest3220198-21modprobe12:20:000
3204118994123,12cyclictest275-21dbus-daemon09:05:010
320411899411,10cyclictest3205106-21latency_hist07:30:020
3204133994025,12cyclictest3218112-21tr11:39:593
3204133994024,11cyclictest1-21systemd08:20:013
3204133994023,13cyclictest238-21systemd-journal07:30:013
3204133994019,5cyclictest37-21ksoftirqd/309:50:003
3204133994019,5cyclictest37-21ksoftirqd/307:35:253
3204133994018,4cyclictest37-21ksoftirqd/312:10:013
3204133994017,4cyclictest37-21ksoftirqd/309:10:003
3204128994030,6cyclictest309-21in:imuxsock08:40:012
3204128994030,6cyclictest309-21in:imuxsock08:40:002
3204128994025,12cyclictest30-21ksoftirqd/208:05:012
3204118994027,7cyclictest309-21in:imuxsock07:50:010
3204118994019,17cyclictest16850irq/134-800000011:47:460
320411899401,35cyclictest0-21swapper/009:30:010
3204133993926,9cyclictest1-21systemd08:40:013
3204133993926,9cyclictest1-21systemd08:40:013
3204133993920,5cyclictest37-21ksoftirqd/309:35:023
3204133993920,5cyclictest37-21ksoftirqd/309:35:013
3204133993920,4cyclictest37-21ksoftirqd/309:25:003
3204133993919,5cyclictest37-21ksoftirqd/308:10:003
3204128993925,11cyclictest3208434-21sshd08:32:242
3204128993925,10cyclictest30-21ksoftirqd/208:55:012
3204128993924,11cyclictest238-21systemd-journal11:05:002
3204128993923,12cyclictest1-21systemd08:50:002
3204128993921,14cyclictest275-21dbus-daemon11:25:012
3204118993926,9cyclictest275-21dbus-daemon11:39:590
3204118993924,11cyclictest275-21dbus-daemon11:55:020
3204118993924,11cyclictest275-21dbus-daemon11:55:010
3204118993920,15cyclictest238-21systemd-journal11:35:010
3204133993825,9cyclictest1-21systemd08:05:023
3204133993820,4cyclictest37-21ksoftirqd/310:55:003
3204133993817,4cyclictest37-21ksoftirqd/308:44:053
3204133993816,5cyclictest37-21ksoftirqd/308:30:003
3204133993815,6cyclictest37-21ksoftirqd/310:24:593
3204133993815,4cyclictest37-21ksoftirqd/311:20:023
3204128993826,9cyclictest30-21ksoftirqd/211:10:022
3204118993834,2cyclictest0-21swapper/009:50:020
320411899383,3cyclictest131rcu_preempt09:25:000
3204118993825,9cyclictest12-21ksoftirqd/008:35:020
320411899381,8cyclictest3217505-21latency_hist11:25:010
3204118993816,19cyclictest16850irq/134-800000011:40:460
320411899381,34cyclictest0-21swapper/008:50:010
320413399374,5cyclictest131rcu_preempt09:25:233
3204133993723,9cyclictest275-21dbus-daemon07:45:013
3204133993721,12cyclictest275-21dbus-daemon09:45:013
3204133993720,13cyclictest275-21dbus-daemon11:10:003
3204133993718,5cyclictest37-21ksoftirqd/307:53:263
3204133993717,4cyclictest37-21ksoftirqd/311:15:013
3204128993729,5cyclictest1-21systemd10:00:002
3204128993728,5cyclictest3217049-21cron11:20:002
3204128993727,7cyclictest3210265-21cron09:10:012
3204128993724,9cyclictest309-21in:imuxsock09:26:242
3204128993720,11cyclictest309-21in:imuxsock12:39:592
3204118993731,3cyclictest16950irq/224-800000010:50:010
3204118993726,8cyclictest309-21in:imuxsock08:20:020
3204118993726,7cyclictest309-21in:imuxsock12:11:450
320411899371,6cyclictest3219168-21unin-run12:00:000
320411899371,5cyclictest131rcu_preempt08:55:020
320413399367,16cyclictest3219123-21modprobe11:59:593
320413399364,7cyclictest37-21ksoftirqd/312:12:173
320413399364,3cyclictest131rcu_preempt12:04:173
3204133993624,9cyclictest37-21ksoftirqd/310:05:013
3204133993617,4cyclictest37-21ksoftirqd/310:15:253
3204133993617,4cyclictest37-21ksoftirqd/310:15:243
320413399361,5cyclictest275-21dbus-daemon08:35:013
3204133993615,4cyclictest37-21ksoftirqd/307:15:013
320412899365,3cyclictest131rcu_preempt09:00:002
320412899365,3cyclictest131rcu_preempt09:00:002
320412899364,22cyclictest311-21rs:main2
3204128993627,7cyclictest30-21ksoftirqd/211:30:012
3204128993626,6cyclictest3214226-21cron10:24:592
3204128993626,6cyclictest309-21in:imuxsock11:40:012
3204128993626,6cyclictest309-21in:imuxsock09:25:012
3204128993624,9cyclictest30-21ksoftirqd/207:30:012
3204128993623,9cyclictest30-21ksoftirqd/212:25:012
3204128993622,10cyclictest238-21systemd-journal07:50:242
320411899365,3cyclictest131rcu_preempt10:05:030
320411899362,5cyclictest131rcu_preempt07:15:010
3204118993623,8cyclictest12-21ksoftirqd/007:10:030
320413399358,25cyclictest3204836-21kworker/u8:107:25:023
320413399357,17cyclictest3209746-21modprobe09:00:003
320413399357,17cyclictest3209746-21modprobe09:00:003
3204133993518,13cyclictest1-21systemd08:15:003
3204133993513,5cyclictest37-21ksoftirqd/310:14:243
3204128993525,7cyclictest30-21ksoftirqd/209:55:022
3204128993525,7cyclictest30-21ksoftirqd/209:55:012
3204128993524,7cyclictest3206639-21sh08:00:002
3204128993523,9cyclictest30-21ksoftirqd/208:45:002
3204128993522,9cyclictest3215986-21sshd10:56:462
320412899352,22cyclictest291rcuc/210:05:022
3204128993522,10cyclictest3215132-21sed10:40:032
3204128993522,10cyclictest3215132-21sed10:40:022
3204128993518,13cyclictest275-21dbus-daemon12:00:012
3204118993526,5cyclictest12-21ksoftirqd/009:35:010
3204118993526,5cyclictest12-21ksoftirqd/009:35:000
3204118993525,7cyclictest3213782-21latency_hist10:15:010
3204118993522,10cyclictest12-21ksoftirqd/010:23:540
320413399346,18cyclictest3211874-21cron09:39:593
320413399343,6cyclictest3213468-21latency_hist10:10:013
3204133993424,6cyclictest3217364-21cat11:25:013
3204133993416,3cyclictest37-21ksoftirqd/308:24:323
3204128993426,6cyclictest30-21ksoftirqd/208:25:032
3204128993426,5cyclictest3205855-21sshd07:40:242
3204128993418,13cyclictest275-21dbus-daemon10:20:022
3204128993418,13cyclictest275-21dbus-daemon10:20:012
3204133993318,11cyclictest1-21systemd10:30:013
3204128993325,5cyclictest3205698-21latency_hist07:40:012
3204128993324,6cyclictest30-21ksoftirqd/209:15:012
3204128993324,6cyclictest30-21ksoftirqd/208:30:002
3204128993322,8cyclictest30-21ksoftirqd/207:35:012
3204118993320,10cyclictest3206370-21sshd07:54:000
3204118993313,17cyclictest16850irq/134-800000011:28:470
320411899331,30cyclictest0-21swapper/012:05:000
3204133993220,9cyclictest37-21ksoftirqd/310:50:023
3204133993220,7cyclictest37-21ksoftirqd/310:41:243
3204133993219,9cyclictest37-21ksoftirqd/309:02:253
3204128993225,4cyclictest3220441-21latency_hist12:25:032
3204128993225,4cyclictest3220441-21latency_hist12:25:022
3204128993224,6cyclictest0-21swapper/210:30:012
3204128993224,5cyclictest670-21sendmail-mta12:04:322
3204128993223,7cyclictest30-21ksoftirqd/210:10:012
3204128993223,5cyclictest309-21in:imuxsock09:50:002
3204128993222,8cyclictest30-21ksoftirqd/207:15:022
3204128993221,8cyclictest3209992-21sshd09:00:232
3204128993219,9cyclictest30-21ksoftirqd/211:45:002
3204128993218,10cyclictest30-21ksoftirqd/210:45:232
3204128993217,12cyclictest3212152-21cron09:45:002
3204128993211,9cyclictest0-21swapper/208:10:022
3204128993124,5cyclictest30-21ksoftirqd/211:55:012
3204128993124,5cyclictest30-21ksoftirqd/211:55:012
3204128993118,11cyclictest3218610-21sshd11:49:472
3204128993114,12cyclictest275-21dbus-daemon09:35:022
3204128993114,12cyclictest275-21dbus-daemon09:35:012
3204128993022,4cyclictest30-21ksoftirqd/207:49:002
320412899302,20cyclictest0-21swapper/207:25:002
3204128993021,5cyclictest309-21in:imuxsock12:35:012
320412899294,3cyclictest131rcu_preempt12:19:592
3204128992920,6cyclictest3204260-21latency_hist07:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional