You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 10:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3s.osadl.org (updated Wed Jan 07, 2026 00:45:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3141728991191,100cyclictest0-21swapper/000:35:020
3141728991191,100cyclictest0-21swapper/000:35:020
3141728991011,79cyclictest0-21swapper/021:15:010
314172899861,3cyclictest0-21swapper/023:30:010
3141735997129,37cyclictest309-21in:imuxsock23:55:012
3141740996712,10cyclictest37-21ksoftirqd/320:45:013
314173599651,59cyclictest3156135-21munin-run23:50:002
314173599651,59cyclictest3149906-21sshd21:45:372
3141728996561,2cyclictest0-21swapper/000:25:020
3141735996425,35cyclictest3158645-21wc00:35:022
3141735996425,35cyclictest3158645-21wc00:35:022
3141735996422,38cyclictest3148623-21sshd21:20:372
3141740996317,8cyclictest37-21ksoftirqd/300:10:013
314173599632,57cyclictest3152754-21sshd22:41:372
314173599631,57cyclictest3143495-21munin-run19:45:012
3141740996217,8cyclictest37-21ksoftirqd/321:40:003
314173599622,56cyclictest3142704-21munin-run19:30:012
314173599622,56cyclictest3142704-21munin-run19:30:012
314173599622,55cyclictest3158765-21munin-run00:40:012
314173599622,55cyclictest3152018-21munin-run22:30:022
314173599622,55cyclictest3152018-21munin-run22:30:022
314173599621,57cyclictest3154867-21munin-run23:25:012
314173599621,57cyclictest3154867-21munin-run23:25:012
314173599621,56cyclictest3157185-21munin-run00:10:012
314173599621,56cyclictest3155582-21sshd23:37:372
314173599621,56cyclictest3148406-21sendmail-msp21:20:002
314173599613,54cyclictest3153816-21munin-run23:05:002
314173599612,54cyclictest3145023-21munin-run20:15:002
314173599612,54cyclictest3143731-21munin-run19:50:002
314173599611,56cyclictest364-21snmpd22:11:242
314173599611,55cyclictest364-21snmpd20:00:592
314173599611,55cyclictest3150175-21sshd21:54:382
314173599611,55cyclictest3150175-21sshd21:54:382
314173599611,54cyclictest3152262-21systemd-run22:35:002
314173599602,54cyclictest3153297-21munin-run22:55:012
314173599602,53cyclictest3149160-21munin-run21:35:012
314173599602,53cyclictest3149160-21munin-run21:35:002
314173599602,53cyclictest3146343-21munin-run20:40:012
314173599602,51cyclictest3151742-21cron22:25:002
314173599601,55cyclictest30-21ksoftirqd/222:20:002
314173599592,53cyclictest364-21snmpd23:31:412
314173599592,53cyclictest3154065-21munin-run23:10:012
314173599592,52cyclictest3153544-21munin-run23:00:002
314173599592,52cyclictest3150970-21munin-run22:10:012
314173599592,52cyclictest3150721-21munin-run22:04:592
314173599591,54cyclictest364-21snmpd21:11:132
314173599591,54cyclictest3154530-21sshd23:15:372
314173599582,52cyclictest3156623-40logrotate00:00:002
314173599582,52cyclictest3156623-40logrotate00:00:002
314173599582,51cyclictest364-21snmpd19:35:542
314173599581,53cyclictest364-21snmpd21:06:122
314173599581,53cyclictest364-21snmpd20:51:082
314173599581,52cyclictest3141845-21ls19:10:012
3141731995812,12cyclictest23-21ksoftirqd/121:20:011
314173599579,44cyclictest0-21swapper/200:21:512
314173599573,49cyclictest364-21snmpd21:41:582
314173599572,50cyclictest364-21snmpd20:20:202
314173599572,50cyclictest364-21snmpd20:20:192
314173599572,50cyclictest3146567-21cron20:45:012
314173599572,50cyclictest3144773-21munin-run20:10:022
314173599572,50cyclictest3142216-21munin-run19:20:022
314173599571,51cyclictest3154280-21sshd23:10:372
314173599571,51cyclictest3144239-21munin-run20:00:002
314173599561,4cyclictest364-21snmpd22:46:322
314173599561,4cyclictest364-21snmpd22:46:322
314173599554,47cyclictest364-21snmpd00:26:032
314173599553,48cyclictest364-21snmpd21:37:102
314173599552,48cyclictest364-21snmpd20:49:032
314173599551,50cyclictest364-21snmpd20:18:112
314173599551,50cyclictest364-21snmpd00:14:202
314173599551,50cyclictest3147298-21sshd20:56:382
314173599551,49cyclictest364-21snmpd21:01:102
314173599551,49cyclictest3152482-21sshd22:37:372
3141731995535,14cyclictest275-21dbus-daemon20:25:011
3141731995535,14cyclictest275-21dbus-daemon20:25:011
314173599548,42cyclictest30-21ksoftirqd/219:10:022
314173599542,47cyclictest3143987-21systemd-run19:55:002
314173599542,46cyclictest364-21snmpd20:25:322
314173599541,4cyclictest364-21snmpd00:01:472
314173599541,48cyclictest3155886-21munin-run23:45:012
3141731995435,13cyclictest238-21systemd-journal23:00:001
3141728995430,16cyclictest238-21systemd-journal20:55:000
3141740995314,8cyclictest37-21ksoftirqd/319:30:013
3141740995314,8cyclictest37-21ksoftirqd/319:30:003
314173599531,49cyclictest364-21snmpd21:55:042
314173599531,48cyclictest3142967-21unin-run19:35:002
3141728995312,36cyclictest131rcu_preempt21:30:010
3141740995231,16cyclictest238-21systemd-journal21:20:013
314173599522,47cyclictest364-21snmpd19:23:142
314174099517,15cyclictest3145802-21munin-run20:30:003
314173599512,44cyclictest0-21swapper/223:25:192
3141731995136,11cyclictest1-21systemd21:05:001
3141731995134,13cyclictest275-21dbus-daemon23:10:001
3141731995131,15cyclictest238-21systemd-journal00:30:001
314172899519,14cyclictest19350irq/34-mmc121:25:020
314173599501,45cyclictest0-21swapper/200:17:362
3141728995041,6cyclictest12-21ksoftirqd/019:40:010
314173599491,44cyclictest364-21snmpd21:26:392
314173599491,44cyclictest364-21snmpd20:32:232
3141731994933,12cyclictest238-21systemd-journal22:50:011
3141731994933,12cyclictest238-21systemd-journal22:50:011
3141728994934,11cyclictest1-21systemd22:50:010
3141728994934,11cyclictest1-21systemd22:50:010
3141728994930,13cyclictest275-21dbus-daemon23:40:010
3141731994827,14cyclictest275-21dbus-daemon23:35:011
3141731994824,15cyclictest3155592-21cron23:40:001
3141728994834,9cyclictest238-21systemd-journal20:45:010
3141728994830,14cyclictest3157717-21true00:20:000
3141728994822,20cyclictest151rcuc/021:10:010
3141728994820,6cyclictest151rcuc/022:45:010
3141728994819,23cyclictest151rcuc/000:40:000
314172899481,13cyclictest3151725-21sshd22:21:370
3141731994734,10cyclictest275-21dbus-daemon20:40:021
3141731994731,12cyclictest23-21ksoftirqd/123:50:001
3141731994727,7cyclictest309-21in:imuxsock19:35:001
314172899471,12cyclictest3151468-21cron22:20:000
3141728994710,6cyclictest131rcu_preempt22:35:000
3141740994623,16cyclictest238-21systemd-journal22:20:003
3141731994628,13cyclictest1-21systemd19:25:021
314172899463,11cyclictest12-21ksoftirqd/000:00:020
314172899463,11cyclictest12-21ksoftirqd/000:00:020
314173199456,8cyclictest131rcu_preempt22:20:011
3141731994530,11cyclictest238-21systemd-journal23:10:031
3141731994524,15cyclictest1-21systemd23:05:011
314172899453,7cyclictest12-21ksoftirqd/023:20:020
314174099446,9cyclictest37-21ksoftirqd/322:55:013
3141740994437,4cyclictest670-21sendmail-mta21:10:003
3141740994425,14cyclictest275-21dbus-daemon23:05:013
3141731994430,8cyclictest3142161-21cron19:20:001
3141731994429,10cyclictest238-21systemd-journal22:00:001
3141731994426,12cyclictest1-21systemd22:05:011
314173199442,3cyclictest131rcu_preempt00:05:021
3141731994422,15cyclictest1-21systemd20:50:011
3141728994437,4cyclictest16950irq/224-800000020:00:000
314172899441,8cyclictest275-21dbus-daemon21:00:010
3141728994413,10cyclictest12-21ksoftirqd/021:45:010
314174099439,8cyclictest0-21swapper/323:00:003
3141740994328,11cyclictest309-21in:imuxsock22:45:033
3141740994328,11cyclictest309-21in:imuxsock22:45:033
3141731994331,8cyclictest3154559-21cron23:20:001
3141731994328,11cyclictest275-21dbus-daemon00:15:021
3141731994324,14cyclictest275-21dbus-daemon23:45:011
3141728994328,11cyclictest238-21systemd-journal19:45:000
3141728994327,10cyclictest309-21in:imuxsock23:25:010
3141728994327,10cyclictest309-21in:imuxsock23:25:010
314172899432,24cyclictest19350irq/34-mmc100:00:030
314172899431,8cyclictest3142189-21sendmail19:20:000
314174099427,7cyclictest0-21swapper/323:45:013
314174099426,7cyclictest37-21ksoftirqd/321:26:563
3141740994230,8cyclictest3158187-21sshd00:27:373
3141740994214,5cyclictest0-21swapper/300:33:543
3141740994214,5cyclictest0-21swapper/300:33:543
3141740994211,8cyclictest37-21ksoftirqd/323:56:463
3141740994211,8cyclictest37-21ksoftirqd/323:56:463
3141731994228,10cyclictest275-21dbus-daemon19:30:011
3141731994228,10cyclictest275-21dbus-daemon19:30:001
3141731994226,12cyclictest23-21ksoftirqd/119:50:011
3141731994225,11cyclictest3151998-21modprobe22:30:011
3141731994225,11cyclictest3151998-21modprobe22:30:011
314173199421,5cyclictest131rcu_preempt20:29:591
3141728994235,5cyclictest12-21ksoftirqd/019:25:020
3141728994232,7cyclictest12-21ksoftirqd/022:15:010
314172899422,7cyclictest3141929-21unin-run19:15:010
314174099417,8cyclictest37-21ksoftirqd/319:20:383
314174099415,9cyclictest37-21ksoftirqd/320:55:013
314174099415,10cyclictest37-21ksoftirqd/322:25:013
3141740994127,10cyclictest37-21ksoftirqd/323:20:013
3141740994126,12cyclictest3154302-21cron23:14:593
3141740994125,12cyclictest3142062-21latency_hist19:15:023
3141740994124,11cyclictest238-21systemd-journal20:10:003
314174099412,10cyclictest41050lldpd00:12:323
3141740994119,17cyclictest3152493-21cron22:40:003
3141731994129,10cyclictest23-21ksoftirqd/120:20:011
3141731994124,12cyclictest3147316-21cron21:00:011
314172899418,11cyclictest12-21ksoftirqd/020:06:430
314172899414,11cyclictest12-21ksoftirqd/020:20:010
3141728994134,4cyclictest16950irq/224-800000020:24:370
3141728994134,4cyclictest16950irq/224-800000020:24:360
3141728994131,8cyclictest151rcuc/021:20:010
3141728994130,9cyclictest12-21ksoftirqd/023:45:010
3141728994128,8cyclictest12-21ksoftirqd/022:35:370
314172899411,7cyclictest3157437-21munin-run00:15:010
314174099408,6cyclictest0-21swapper/319:15:493
314174099406,8cyclictest37-21ksoftirqd/322:27:073
314174099406,8cyclictest37-21ksoftirqd/322:27:073
3141740994030,6cyclictest274-21cron23:40:003
3141740994029,7cyclictest309-21in:imuxsock21:15:003
3141740994027,10cyclictest275-21dbus-daemon00:25:013
3141740994011,5cyclictest0-21swapper/321:05:003
3141731994032,5cyclictest0-21swapper/119:10:011
3141731994031,5cyclictest309-21in:imuxsock20:54:591
3141731994022,13cyclictest1-21systemd22:40:011
3141728994035,3cyclictest0-21swapper/023:50:000
3141728994033,4cyclictest16950irq/224-800000021:52:380
3141728994033,4cyclictest16950irq/224-800000021:52:380
3141728994031,7cyclictest12-21ksoftirqd/022:06:230
3141728994024,12cyclictest3153783-21sshd23:01:370
314174099395,7cyclictest414-21sshd20:49:373
3141740993927,9cyclictest1-21systemd20:35:003
3141740993924,11cyclictest275-21dbus-daemon20:20:013
314174099392,11cyclictest37-21ksoftirqd/321:00:003
3141740993910,5cyclictest0-21swapper/323:30:003
3141731993930,6cyclictest23-21ksoftirqd/120:07:381
3141731993928,8cyclictest23-21ksoftirqd/122:15:031
3141731993925,10cyclictest275-21dbus-daemon00:10:011
3141731993924,11cyclictest1-21systemd20:15:011
314173199392,22cyclictest238-21systemd-journal00:25:001
3141731993922,13cyclictest1-21systemd20:00:001
3141731993922,11cyclictest275-21dbus-daemon00:00:011
3141731993922,11cyclictest275-21dbus-daemon00:00:011
3141731993921,13cyclictest275-21dbus-daemon19:15:001
314172899399,9cyclictest12-21ksoftirqd/019:30:370
3141728993933,4cyclictest16950irq/224-800000021:03:370
3141728993931,5cyclictest151rcuc/021:30:020
3141728993931,5cyclictest151rcuc/021:30:020
3141728993925,10cyclictest3153518-21sshd22:59:360
3141728993924,12cyclictest3150413-21sshd21:57:010
3141728993913,6cyclictest12-21ksoftirqd/020:30:010
3141740993834,2cyclictest0-21swapper/321:35:023
3141740993834,2cyclictest0-21swapper/321:35:023
3141740993826,9cyclictest37-21ksoftirqd/323:45:033
3141740993824,9cyclictest0-21swapper/320:05:033
3141740993820,14cyclictest3154832-21sshd23:23:373
3141740993820,14cyclictest3154832-21sshd23:23:373
3141731993819,14cyclictest275-21dbus-daemon20:35:011
3141731993819,11cyclictest3149152-21modprobe21:35:011
3141731993819,11cyclictest3149152-21modprobe21:35:001
3141731993818,16cyclictest275-21dbus-daemon00:20:001
3141728993830,5cyclictest12-21ksoftirqd/019:29:370
3141728993830,5cyclictest12-21ksoftirqd/019:29:360
3141728993829,6cyclictest12-21ksoftirqd/000:10:010
3141728993823,10cyclictest3149421-21systemctl21:39:590
314172899381,9cyclictest12-21ksoftirqd/020:40:010
314174099374,8cyclictest37-21ksoftirqd/323:35:013
314174099374,28cyclictest3143968-21cron19:55:003
3141740993725,8cyclictest3144197-21sshd19:55:383
3141740993725,10cyclictest37-21ksoftirqd/320:15:013
3141740993723,10cyclictest275-21dbus-daemon22:15:003
3141740993722,11cyclictest37-21ksoftirqd/321:55:023
3141740993722,11cyclictest37-21ksoftirqd/320:40:013
3141740993720,12cyclictest275-21dbus-daemon21:25:013
3141731993725,8cyclictest23-21ksoftirqd/122:35:021
314173199372,13cyclictest23-21ksoftirqd/100:37:371
314172899375,5cyclictest131rcu_preempt19:50:010
3141728993729,5cyclictest3150717-21latency_hist22:05:000
3141728993728,5cyclictest3153281-21latency_hist22:55:010
3141728993726,8cyclictest12-21ksoftirqd/023:10:010
3141728993725,7cyclictest3146054-21munin-plugin-st20:34:590
3141728993712,5cyclictest131rcu_preempt20:05:020
314174099365,6cyclictest37-21ksoftirqd/321:49:373
3141740993623,10cyclictest37-21ksoftirqd/321:45:023
3141740993622,9cyclictest238-21systemd-journal23:06:373
3141740993621,11cyclictest275-21dbus-daemon19:35:003
314174099361,11cyclictest37-21ksoftirqd/323:53:373
314173199362,8cyclictest23-21ksoftirqd/119:50:371
314173199362,5cyclictest131rcu_preempt21:40:001
3141731993625,6cyclictest3158468-21munin-plugin-st00:35:011
3141731993625,6cyclictest3158468-21munin-plugin-st00:35:001
3141731993621,10cyclictest238-21systemd-journal19:39:591
3141731993619,12cyclictest1-21systemd21:10:001
314172899361,6cyclictest3146912-21sed20:50:020
3141728993616,15cyclictest1-21systemd23:55:010
314172899361,3cyclictest131rcu_preempt22:27:380
314172899361,3cyclictest131rcu_preempt22:27:370
314172899361,32cyclictest3155341-21sshd23:34:370
314174099355,8cyclictest37-21ksoftirqd/300:37:373
3141740993521,9cyclictest37-21ksoftirqd/300:20:003
3141740993514,16cyclictest275-21dbus-daemon19:45:003
314173199356,24cyclictest3148909-21munin-run21:30:001
314173199354,5cyclictest131rcu_preempt22:45:001
314173199354,5cyclictest131rcu_preempt21:50:001
3141731993525,7cyclictest3146557-21sshd20:42:381
3141731993524,7cyclictest3150996-21latency_hist22:10:011
314172899359,5cyclictest131rcu_preempt00:29:590
314172899352,29cyclictest0-21swapper/023:14:590
314172899352,29cyclictest0-21swapper/020:15:020
3141728993521,9cyclictest0-21swapper/021:50:010
3141740993423,6cyclictest309-21in:imuxsock22:35:003
314174099341,7cyclictest37-21ksoftirqd/321:52:383
314174099341,7cyclictest37-21ksoftirqd/321:52:383
314173199344,7cyclictest131rcu_preempt20:05:001
3141731993425,7cyclictest23-21ksoftirqd/121:24:591
3141731993422,9cyclictest23-21ksoftirqd/122:55:011
314174099337,4cyclictest131rcu_preempt00:01:473
3141740993319,10cyclictest37-21ksoftirqd/322:05:013
314173199335,5cyclictest131rcu_preempt21:15:001
314173199332,3cyclictest131rcu_preempt19:45:011
3141728993327,3cyclictest0-21swapper/019:52:370
314174099329,18cyclictest3143200-21modprobe19:40:003
314174099329,17cyclictest3151103-21latency_hist22:10:023
3141740993218,10cyclictest3152768-21sshd22:44:373
3141740993217,11cyclictest3143714-21sshd19:49:373
314173199322,4cyclictest131rcu_preempt23:55:001
3141731993224,5cyclictest3154850-21latency_hist23:25:021
3141731993224,5cyclictest3154850-21latency_hist23:25:021
3141731993224,5cyclictest1-21systemd21:45:011
314173199322,3cyclictest131rcu_preempt22:24:591
3141731993219,9cyclictest1-21systemd21:55:011
3141731993219,9cyclictest1-21systemd21:55:001
3141740993118,8cyclictest309-21in:imuxsock20:21:383
3141740993118,8cyclictest309-21in:imuxsock20:21:373
314173199312,3cyclictest131rcu_preempt23:30:001
314172899296,13cyclictest0-21swapper/019:10:010
3141740992720,5cyclictest3141658-21latency_hist19:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional