You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-11 - 19:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7s.osadl.org (updated Sat Apr 11, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
250847996151,6cyclictest420-21avahi-daemon09:50:410
250848995446,5cyclictest327563-21awk10:00:001
250847995339,10cyclictest421-21dbus-daemon11:50:420
250847995339,10cyclictest421-21dbus-daemon11:50:420
250848995234,15cyclictest1-21systemd10:23:041
250847995144,5cyclictest425808-21/usr/sbin/munin12:00:470
250849995037,8cyclictest286821-21diskmemload11:40:322
250849995037,8cyclictest286821-21diskmemload11:40:322
250847994840,5cyclictest421-21dbus-daemon10:20:010
250849994736,8cyclictest396435-21/usr/sbin/munin11:25:012
250848994738,6cyclictest421-21dbus-daemon12:40:011
250848994638,5cyclictest380309-21systemd-run11:05:011
250848994537,5cyclictest256860-21systemd-run07:30:011
250849994436,5cyclictest428-21mta-sts-daemon09:30:332
250847994437,4cyclictest1054-21mta-sts-daemon11:40:350
250847994437,4cyclictest1054-21mta-sts-daemon11:40:350
250847994435,6cyclictest439-21systemd-logind11:25:440
250849994334,6cyclictest345631-21unixbench_singl10:20:462
250848994335,5cyclictest1-21systemd10:35:021
250849994233,4cyclictest0-21swapper/210:30:312
250847994221,17cyclictest323932-21acpi09:55:240
250848994132,7cyclictest282330-21sh08:55:011
250847994134,4cyclictest438672-21ssh12:20:010
250847994134,4cyclictest347864-21cron10:25:010
250847994133,5cyclictest261409-21latency_hist07:45:020
25084799413,32cyclictest365186-21ssh10:45:340
25084799413,24cyclictest368843-21ssh10:50:280
250849994035,2cyclictest0-21swapper/208:25:012
250849994033,4cyclictest378073-21unixbench_singl11:00:502
250849994032,5cyclictest351952-21systemd-run10:30:012
250849994032,5cyclictest295612-21aten_r2power_vo09:20:262
250849994031,5cyclictest277822-21grep08:40:012
250848994032,5cyclictest435174-21systemd-run12:15:011
25084899402,32cyclictest381450-21ssh11:05:351
250847994034,4cyclictest12350irq/32-eth010:05:360
250847994033,4cyclictest0-21swapper/010:10:460
250847994032,5cyclictest421-21dbus-daemon10:57:190
250849993933,3cyclictest0-21swapper/211:00:002
250849993931,5cyclictest300806-21unixbench-2d09:25:472
250849993931,5cyclictest252346-21systemd-run07:15:012
25084899393,28cyclictest312422-21ssh09:40:341
250848993931,5cyclictest373450-21ntp_states10:55:401
250848993931,5cyclictest1-21systemd09:30:011
250848993924,11cyclictest548-21gdbus10:15:401
250847993931,5cyclictest303173-21ssh09:30:010
25084799392,31cyclictest377521-21ssh11:00:410
250847993923,13cyclictest308860-21timerandwakeup09:35:450
250847993921,13cyclictest421-21dbus-daemon07:45:390
250847993921,13cyclictest421-21dbus-daemon07:45:390
250849993830,5cyclictest439-21systemd-logind12:20:012
250849993830,5cyclictest260367-21fschecks_count07:40:272
25084799388,13cyclictest421-21dbus-daemon10:00:380
25084799385,27cyclictest353179-21ssh10:30:370
25084799383,21cyclictest420-21avahi-daemon08:45:370
250847993831,4cyclictest282426-21latency_hist08:55:020
250847993830,5cyclictest402195-21unixbench-2d11:30:480
250847993830,5cyclictest402195-21unixbench-2d11:30:480
250847993829,6cyclictest420-21avahi-daemon12:05:550
250847993827,7cyclictest394909-21sshd11:22:030
250849993729,5cyclictest445096-21cut12:30:012
250849993729,5cyclictest250858-21systemd-run07:10:012
250849993728,6cyclictest323934-21acpi09:55:242
25084899373,29cyclictest624-21lldpd07:15:401
25084899373,29cyclictest357124-21ssh10:35:341
25084899373,29cyclictest357124-21ssh10:35:341
250848993729,4cyclictest286841-21systemd-run09:10:011
250848993729,4cyclictest286841-21systemd-run09:10:011
250847993728,5cyclictest0-21swapper/012:35:010
250847993726,8cyclictest361636-21timerandwakeup10:40:480
250847993726,8cyclictest252401-21latency_hist07:15:020
250847993723,10cyclictest0-21swapper/010:35:470
250847993723,10cyclictest0-21swapper/010:35:470
250849993629,4cyclictest311284-21cut09:40:012
250849993628,5cyclictest279326-21sh08:45:012
250849993628,5cyclictest267411-21latency_hist08:05:012
250849993627,5cyclictest259878-21latency_hist07:40:022
250848993629,4cyclictest390116-21unixbench_multi11:15:461
250848993628,5cyclictest445107-21ssh12:30:011
250848993627,6cyclictest516-21in:imuxsock08:45:011
250848993627,6cyclictest405885-21mailstats11:35:421
250848993627,6cyclictest405885-21mailstats11:35:421
250848993627,6cyclictest339753-21grep10:15:011
250848993626,8cyclictest271129-21needreboot08:15:331
250847993626,8cyclictest440273-21sed12:20:470
250847993617,16cyclictest151ktimers/009:30:390
250847993614,18cyclictest12350irq/32-eth009:10:350
250849993530,2cyclictest0-21swapper/210:40:012
250849993530,2cyclictest0-21swapper/210:40:012
250848993527,4cyclictest0-21swapper/110:26:031
250847993528,4cyclictest0-21swapper/011:40:010
250847993528,4cyclictest0-21swapper/011:40:010
250847993526,6cyclictest420-21avahi-daemon07:30:460
250847993523,9cyclictest424093-21cron12:00:000
25084799352,26cyclictest312591-21rm09:40:400
250847993522,10cyclictest3559463-21cups-browsed09:15:410
250847993522,10cyclictest316602-21sh09:45:380
250847993522,10cyclictest316602-21sh09:45:380
250847993521,11cyclictest0-21swapper/007:20:000
250849993428,3cyclictest0-21swapper/209:50:382
250849993427,4cyclictest315377-21idleruntime-cro09:45:012
250849993427,4cyclictest253751-21unixbench_singl07:15:462
250849993427,4cyclictest1056-21mta-sts-daemon09:00:002
250849993426,5cyclictest417264-21kernelversion11:50:312
250849993426,5cyclictest417264-21kernelversion11:50:312
250849993425,5cyclictest0-21swapper/211:25:382
250848993429,2cyclictest0-21swapper/112:35:011
250848993426,5cyclictest416373-21grep11:50:001
250848993426,5cyclictest259827-21munin-plugin-st07:40:011
250848993425,6cyclictest421-21dbus-daemon08:05:011
250848993425,6cyclictest420-21avahi-daemon08:50:011
250848993424,7cyclictest400490-21sh11:30:011
250848993423,8cyclictest316976-21timerandwakeup09:45:461
250848993423,8cyclictest316976-21timerandwakeup09:45:461
250848993412,3cyclictest171rcu_preempt10:45:021
25084799346,7cyclictest286821-21diskmemload11:10:390
250847993427,4cyclictest265872-21latency_hist08:00:010
250847993425,5cyclictest1055-21mta-sts-daemon10:28:380
250847993423,8cyclictest1-21systemd12:40:010
25084799342,27cyclictest413633-21ssh11:45:360
250847993419,5cyclictest0-21swapper/012:25:410
250847993419,10cyclictest286821-21diskmemload11:15:360
250847993415,15cyclictest12350irq/32-eth007:50:350
250847993415,15cyclictest12350irq/32-eth007:50:350
250849993327,3cyclictest0-21swapper/210:20:012
250849993326,4cyclictest401887-21sendmail_mailst11:30:442
250849993326,4cyclictest401887-21sendmail_mailst11:30:442
250849993326,4cyclictest333364-21unixbench-2d10:05:462
250849993324,6cyclictest3559463-21cups-browsed12:31:042
25084999332,25cyclictest421384-21ssh11:55:342
250848993326,5cyclictest435676-21aten_r2power_vo12:15:261
250848993325,5cyclictest275356-21fschecks_time08:30:281
250848993324,6cyclictest424524-21/usr/sbin/munin12:00:261
250848993324,6cyclictest261-21systemd-journal09:15:001
25084799333,25cyclictest296150-21ssh09:20:350
250847993322,8cyclictest268239-21ntp_kernel_pll_08:05:360
250847993319,5cyclictest384326-21ssh11:10:000
250849993227,2cyclictest0-21swapper/208:00:002
250849993224,5cyclictest439188-21aten_r2power_vo12:20:272
250849993224,5cyclictest275344-21fschecks_count08:30:282
250849993221,8cyclictest328036-21sh10:00:242
250848993225,5cyclictest0-21swapper/111:55:341
250848993225,4cyclictest274722-21unixbench_multi08:25:441
250848993224,5cyclictest307242-21cron09:35:011
250848993224,5cyclictest285331-21munin-plugin-st09:05:001
250848993224,5cyclictest264658-21aten_r2power_fr07:55:251
250847993225,4cyclictest285351-21systemd-run09:05:010
250847993224,5cyclictest255275-21grep07:20:450
250847993223,5cyclictest0-21swapper/008:45:010
250847993221,8cyclictest273339-21munin-plugin-st08:25:010
25084999314,20cyclictest449101-21ssh12:35:362
250849993125,3cyclictest262807-21kworker/u8:7-xprtiod08:20:012
250849993125,3cyclictest0-21swapper/211:15:012
250849993124,4cyclictest263196-21aten_r2power_po07:50:272
250849993124,4cyclictest263196-21aten_r2power_po07:50:272
250849993124,3cyclictest0-21swapper/211:15:392
250849993123,5cyclictest294980-21munin-run09:20:012
250849993122,6cyclictest286819-21cron09:10:002
250849993122,6cyclictest286819-21cron09:10:002
250849993121,6cyclictest1054-21mta-sts-daemon11:35:022
250849993121,6cyclictest1054-21mta-sts-daemon11:35:022
25084999311,26cyclictest413749-21ssh11:45:402
25084899315,17cyclictest439669-21ssh12:20:341
250848993125,3cyclictest0-21swapper/109:20:451
250848993123,5cyclictest412457-21munin-plugin-st11:45:001
250848993123,5cyclictest412457-21munin-plugin-st11:45:001
250847993121,7cyclictest270852-21fschecks_time08:15:290
250849993022,5cyclictest433287-21unixbench_multi12:10:482
250849993022,5cyclictest3559463-21cups-browsed12:06:502
250849993022,5cyclictest254382-21fschecks_time07:20:282
250848993024,3cyclictest0-21swapper/111:20:471
250848993023,4cyclictest308026-21gltestperf09:35:281
250848993020,7cyclictest332531-21kernelversion10:05:291
25084799302,21cyclictest432729-21ntpq12:10:360
25084799301,9cyclictest252310-21kworker/0:0+events_freezable_power_07:35:370
250847993019,7cyclictest286849-21systemd-run09:10:010
250847993019,7cyclictest286849-21systemd-run09:10:010
250849992923,3cyclictest0-21swapper/209:15:002
250849992922,4cyclictest381496-21ntp_kernel_pll_11:05:372
250849992918,7cyclictest421-21dbus-daemon12:00:362
250848992922,4cyclictest287081-21kworker/u8:2-rpciod10:00:461
250848992922,4cyclictest270249-21unixbench_singl08:10:461
250848992921,5cyclictest255369-21systemd-run07:25:011
250848992920,7cyclictest370872-21sh10:52:331
25084899290,10cyclictest41764450ssh11:50:411
25084899290,10cyclictest41764450ssh11:50:411
25084799295,15cyclictest428-21mta-sts-daemon08:35:370
250847992920,5cyclictest516-21in:imuxsock09:00:010
250847992911,11cyclictest0-21swapper/008:10:280
25084999288,6cyclictest171rcu_preempt10:50:382
250849992822,3cyclictest1054-21mta-sts-daemon08:25:312
250849992822,3cyclictest0-21swapper/209:45:472
250849992822,3cyclictest0-21swapper/209:45:472
250849992821,5cyclictest286821-21diskmemload10:49:032
250849992821,4cyclictest279842-21fschecks_count08:45:282
250849992818,7cyclictest286821-21diskmemload10:43:072
250848992822,3cyclictest0-21swapper/109:20:011
250848992821,4cyclictest1051-21mta-sts-daemon12:05:201
250848992821,3cyclictest0-21swapper/111:35:021
250848992821,3cyclictest0-21swapper/111:35:021
250848992818,7cyclictest365747-21timerwakeupswit10:45:461
25084899281,21cyclictest320661-21ssh09:50:371
25084799282,19cyclictest3559463-21cups-browsed08:25:380
250847992817,8cyclictest266710-21ntp_kernel_pll_08:00:350
250849992721,3cyclictest0-21swapper/210:15:012
250849992719,5cyclictest1051-21mta-sts-daemon07:30:372
250848992720,5cyclictest385484-21ntp_kernel_pll_11:10:331
250848992620,3cyclictest264547-21kworker/u8:13-xprtiod08:05:281
250848992620,3cyclictest236794-21kworker/u8:2-xprtiod07:30:281
250848992620,3cyclictest0-21swapper/109:00:011
250848992619,4cyclictest261282-21head07:40:451
25084799261,15cyclictest171rcu_preempt07:10:010
250849992520,2cyclictest0-21swapper/209:05:002
250849992519,3cyclictest0-21swapper/207:45:392
250849992519,3cyclictest0-21swapper/207:45:392
250849992516,6cyclictest281749-21grep08:50:372
250848992519,4cyclictest1056-21mta-sts-daemon07:45:441
250848992519,4cyclictest1056-21mta-sts-daemon07:45:441
250848992518,5cyclictest1056-21mta-sts-daemon07:11:201
250848992518,4cyclictest273221-21unixbench_multi08:20:471
250847992514,8cyclictest12350irq/32-eth007:25:370
25084999244,15cyclictest269882-21ps08:10:412
25084899248,3cyclictest171rcu_preempt07:50:431
25084899248,3cyclictest171rcu_preempt07:50:431
250848992418,3cyclictest0-21swapper/108:40:011
250847992314,5cyclictest0-21swapper/008:30:460
250848992217,2cyclictest0-21swapper/107:10:011
250849992115,4cyclictest0-21swapper/207:25:272
25084999207,3cyclictest171rcu_preempt08:05:032
25085099193,8cyclictest0-21swapper/311:20:383
25085099193,7cyclictest0-21swapper/312:30:393
25085099192,8cyclictest0-21swapper/312:35:343
25085099192,8cyclictest0-21swapper/311:30:373
25085099192,8cyclictest0-21swapper/311:30:373
25085099192,8cyclictest0-21swapper/309:55:343
25085099191,8cyclictest0-21swapper/311:25:363
25085099183,7cyclictest0-21swapper/309:40:343
25085099182,8cyclictest0-21swapper/309:20:423
25085099182,7cyclictest0-21swapper/309:00:343
25085099182,6cyclictest0-21swapper/307:15:403
25085099172,8cyclictest0-21swapper/311:05:393
25085099171,9cyclictest0-21swapper/311:55:343
25085099171,8cyclictest0-21swapper/310:15:423
25085099163,6cyclictest0-21swapper/312:05:353
25085099162,8cyclictest0-21swapper/312:00:333
25085099162,8cyclictest0-21swapper/310:35:383
25085099162,8cyclictest0-21swapper/310:35:383
25085099162,8cyclictest0-21swapper/310:20:353
25085099162,7cyclictest0-21swapper/309:15:343
25085099162,6cyclictest0-21swapper/310:00:333
25085099153,8cyclictest0-21swapper/311:35:363
25085099153,8cyclictest0-21swapper/311:35:363
25085099153,6cyclictest0-21swapper/310:55:363
25085099152,8cyclictest0-21swapper/312:15:413
25085099152,7cyclictest0-21swapper/311:15:333
25085099152,7cyclictest0-21swapper/309:35:363
25085099152,7cyclictest0-21swapper/307:35:333
25085099151,8cyclictest0-21swapper/312:25:343
25085099151,8cyclictest0-21swapper/310:10:393
25085099151,8cyclictest0-21swapper/309:10:353
25085099151,7cyclictest0-21swapper/307:45:343
25085099151,7cyclictest0-21swapper/307:45:343
25085099151,7cyclictest0-21swapper/307:25:373
25085099144,7cyclictest0-21swapper/311:40:323
25085099144,7cyclictest0-21swapper/311:40:323
25085099143,7cyclictest0-21swapper/309:30:373
25085099142,7cyclictest0-21swapper/311:50:363
25085099142,7cyclictest0-21swapper/311:50:363
25085099142,7cyclictest0-21swapper/310:30:333
25085099142,7cyclictest0-21swapper/309:45:363
25085099142,7cyclictest0-21swapper/309:45:363
25085099142,5cyclictest0-21swapper/308:45:333
25085099141,8cyclictest0-21swapper/312:10:363
25085099140,7cyclictest0-21swapper/307:30:403
25085099133,7cyclictest0-21swapper/310:50:283
25085099133,6cyclictest0-21swapper/310:25:383
25085099132,7cyclictest0-21swapper/312:20:383
25085099132,7cyclictest0-21swapper/311:45:373
25085099132,7cyclictest0-21swapper/311:10:363
25085099132,7cyclictest0-21swapper/310:40:373
25085099132,6cyclictest0-21swapper/310:45:303
25085099132,6cyclictest0-21swapper/307:40:323
25085099132,5cyclictest0-21swapper/307:55:333
25085099131,8cyclictest0-21swapper/309:50:363
25085099131,6cyclictest0-21swapper/308:40:343
25085099131,6cyclictest0-21swapper/308:25:323
25085099131,6cyclictest0-21swapper/308:15:343
25085099122,7cyclictest0-21swapper/310:05:363
25085099122,6cyclictest0-21swapper/307:10:353
25085099122,5cyclictest0-21swapper/308:35:353
25085099122,5cyclictest0-21swapper/308:30:353
25085099121,7cyclictest0-21swapper/311:00:283
25085099121,7cyclictest0-21swapper/309:25:373
25085099121,7cyclictest0-21swapper/308:50:393
25085099121,7cyclictest0-21swapper/308:00:383
25085099121,6cyclictest0-21swapper/308:55:343
25085099121,6cyclictest0-21swapper/307:20:333
25085099111,7cyclictest0-21swapper/307:50:353
25085099111,7cyclictest0-21swapper/307:50:353
25085099111,6cyclictest0-21swapper/308:05:343
25085099111,5cyclictest0-21swapper/309:05:343
25085099111,5cyclictest0-21swapper/309:05:343
25085099102,6cyclictest0-21swapper/308:10:333
25085099101,6cyclictest0-21swapper/308:20:333
2508509981,5cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional