You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-04 - 15:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Sat Jul 04, 2026 12:43:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2616462996351,8cyclictest1813736-21cups-browsed10:40:412
2616460995649,4cyclictest12650irq/32-eth007:10:360
2616460995542,8cyclictest2666762-40mandb09:32:020
2616460995447,4cyclictest2725958-21acpi11:10:250
2616460995245,5cyclictest2641094-21/usr/sbin/munin08:30:300
2616460995243,7cyclictest2716456-21cron10:55:010
2616460995237,4cyclictest2643756-21aten_r2power_en08:40:250
261646199513,43cyclictest2720692-21ssh11:00:411
2616461994839,5cyclictest0-21swapper/109:32:031
2616460994610,11cyclictest2674943-21ssh09:45:400
2616460994540,3cyclictest70-21kswapd009:40:360
2616460994538,5cyclictest2762592-21aten_r2power_po12:10:260
2616460994536,5cyclictest2774594-21/usr/sbin/munin12:30:490
2616460994536,5cyclictest2774594-21/usr/sbin/munin12:30:490
2616461994435,6cyclictest2655590-21latency_hist09:15:021
2616460994430,11cyclictest2751581-21unixbench_singl11:50:480
2616461994334,4cyclictest0-21swapper/111:50:481
2616460994328,11cyclictest2696845-21unixbench_singl10:20:480
2616461994234,5cyclictest2683452-21aten_r2power_po10:00:231
2616460994229,10cyclictest0-21swapper/011:40:000
261646099422,33cyclictest2707383-21lockfile-remove10:40:010
2616460994213,20cyclictest421-21dbus-daemon07:40:410
261646299414,27cyclictest2745018-21ssh11:40:402
2616462994134,4cyclictest2698262-21ssh10:25:022
2616461994131,6cyclictest2670811-21munin-plugin-st09:40:011
2616461994131,6cyclictest2670811-21munin-plugin-st09:40:011
2616461994130,6cyclictest2723498-21missed_timers11:05:331
2616460994117,17cyclictest12650irq/32-eth011:20:420
2616462994033,4cyclictest2728685-21latency_hist11:15:022
2616462994032,5cyclictest421-21dbus-daemon11:00:012
2616462994029,8cyclictest2633767-21needreboot08:05:322
2616461994031,6cyclictest2701465-21latency_hist10:30:031
2616460994034,3cyclictest0-21swapper/010:45:300
2616460994033,4cyclictest2686061-21latency_hist10:05:020
2616460994030,7cyclictest2780305-21munin-plugin-st12:40:000
2616460994030,4cyclictest0-21swapper/009:35:380
2616460994030,4cyclictest0-21swapper/009:35:380
2616462993931,5cyclictest2765495-21ssh12:15:242
2616462993931,5cyclictest2637490-21systemd-run08:20:012
2616462993931,5cyclictest2637490-21systemd-run08:20:012
2616462993930,6cyclictest2741590-21if_wlan011:35:302
2616461993931,4cyclictest0-21swapper/107:25:381
2616461993930,6cyclictest2714191-21if_wlan010:50:301
2616461993930,6cyclictest2617967-21systemd-run07:15:021
261646199392,28cyclictest2729720-21ssh11:15:371
2616460993931,5cyclictest2759077-21cron12:05:010
2616462993831,4cyclictest2716458-21cron10:55:012
2616462993831,4cyclictest2689092-21latency_hist10:10:022
2616462993830,5cyclictest2747349-21aten_r2power_fr11:45:282
2616461993829,5cyclictest694-21cron09:45:001
2616460993830,5cyclictest2768557-21/usr/sbin/munin12:20:280
2616460993811,6cyclictest14-21ksoftirqd/011:45:440
2616462993729,5cyclictest2772804-21unixbench-2d12:25:502
2616462993729,5cyclictest2756000-21munin-run12:00:012
2616462993729,5cyclictest1001-21mta-sts-daemon11:17:132
2616462993726,5cyclictest0-21swapper/211:55:012
2616461993730,4cyclictest1002-21mta-sts-daemon08:25:391
2616461993729,5cyclictest2707350-21munin-run10:40:001
2616461993728,5cyclictest2726396-21kernelversion11:10:311
2616461993725,7cyclictest2695684-21head10:20:261
2616460993731,3cyclictest0-21swapper/010:45:010
2616460993729,5cyclictest1813736-21cups-browsed11:58:420
2616460993726,8cyclictest2659881-21mailstats09:20:430
2616460993723,4cyclictest2762112-21/usr/sbin/munin12:10:020
2616460993714,16cyclictest2702283-21ssh10:30:340
2616460993714,16cyclictest2702283-21ssh10:30:340
2616460993713,15cyclictest12650irq/32-eth012:15:410
2616460993712,6cyclictest14-21ksoftirqd/011:25:370
2616462993628,5cyclictest2693544-21timerandwakeup10:15:502
2616462993623,2cyclictest0-21swapper/208:10:342
2616462993623,2cyclictest0-21swapper/208:10:342
2616461993630,3cyclictest0-21swapper/108:30:351
2616461993629,4cyclictest2682953-21idleruntime-cro10:00:011
2616460993629,4cyclictest2723830-21sh11:05:440
2616460993628,6cyclictest2695161-21cron10:20:010
2616460993624,8cyclictest2664864-21latency_hist09:30:030
2616460993621,12cyclictest2647962-21systemd-run08:55:010
2616462993529,2cyclictest0-21swapper/209:30:402
2616462993528,4cyclictest2736049-21mailstats11:25:432
2616462993527,5cyclictest2670833-21tr09:40:012
2616462993527,5cyclictest2670833-21tr09:40:012
2616462993527,5cyclictest1003-21mta-sts-daemon12:20:242
261646299352,26cyclictest2684047-21ssh10:00:352
261646299351,5cyclictest2680975-21ssh09:55:362
2616461993519,11cyclictest271ktimers/108:10:331
2616461993519,11cyclictest271ktimers/108:10:331
261646099359,4cyclictest14-21ksoftirqd/011:30:410
261646099359,4cyclictest14-21ksoftirqd/011:30:410
261646099359,10cyclictest2652445-21diskmemload10:07:050
2616460993527,5cyclictest1000-21mta-sts-daemon10:10:290
2616460993525,7cyclictest2717362-21missed_timers10:55:330
2616460993514,6cyclictest14-21ksoftirqd/009:15:340
2616460993512,5cyclictest14-21ksoftirqd/009:50:310
2616462993426,5cyclictest2699692-21wc10:25:492
2616462993425,6cyclictest420-21avahi-daemon09:20:022
2616462993424,7cyclictest2674752-21latency09:45:342
2616461993428,3cyclictest0-21swapper/112:15:011
2616461993427,4cyclictest2690385-21mailstats10:10:441
2616461993427,3cyclictest0-21swapper/109:25:411
2616461993426,5cyclictest2771226-21munin-plugin-st12:25:011
2616461993426,5cyclictest2739401-21unixbench_multi11:30:481
2616461993426,5cyclictest2739401-21unixbench_multi11:30:481
261646199342,26cyclictest2708405-21ssh10:40:361
261646099343,26cyclictest2720613-21ssh11:00:370
2616460993428,3cyclictest0-21swapper/010:25:470
2616460993417,3cyclictest171rcu_preempt09:15:020
2616460993412,5cyclictest14-21ksoftirqd/007:15:410
2616462993327,3cyclictest0-21swapper/212:40:002
2616462993327,3cyclictest0-21swapper/209:20:402
2616462993326,4cyclictest0-21swapper/210:10:402
2616462993325,5cyclictest2678535-21unixbench_multi09:50:502
2616462993325,5cyclictest2648466-21fschecks_time08:55:292
2616462993321,9cyclictest2725612-21/usr/sbin/munin11:10:012
2616462993321,9cyclictest2617259-21needreboot07:10:342
261646299331,25cyclictest2705547-21rm10:35:442
2616461993327,3cyclictest0-21swapper/108:40:011
2616461993325,5cyclictest2628378-21unixbench_singl07:45:481
2616461993325,5cyclictest2616474-21systemd-run07:10:021
2616461993325,4cyclictest0-21swapper/112:00:401
2616461993325,3cyclictest0-21swapper/112:15:451
2616461993324,5cyclictest2702241-21needreboot10:30:331
2616461993324,5cyclictest2702241-21needreboot10:30:331
2616461993323,8cyclictest2677293-21sh09:50:251
2616460993327,3cyclictest151ktimers/009:00:390
2616460993326,5cyclictest566-21gmain08:25:360
2616460993326,5cyclictest151ktimers/007:20:390
2616460993323,7cyclictest2630811-21ntp_kernel_pll_07:55:360
261646099332,25cyclictest2729839-21sh11:15:420
2616460993321,9cyclictest0-21swapper/007:45:270
2616460993311,5cyclictest14-21ksoftirqd/008:05:410
2616462993227,2cyclictest0-21swapper/212:15:022
2616462993225,4cyclictest2626898-21unixbench_singl07:40:552
2616462993224,5cyclictest2643441-21munin-run08:40:012
2616462993223,6cyclictest420-21avahi-daemon07:25:022
2616462993223,5cyclictest1000-21mta-sts-daemon11:22:112
2616462993221,7cyclictest2702296-21sh10:30:342
2616462993221,7cyclictest2702296-21sh10:30:342
2616461993225,4cyclictest2762192-21latency_hist12:10:021
2616461993223,6cyclictest2753621-21fschecks_count11:55:301
2616461993223,5cyclictest2713448-21systemd-run10:50:011
2616461993220,9cyclictest2657064-21timerwakeupswit09:15:461
261646199321,24cyclictest2772250-21ssh12:25:371
261646099321,9cyclictest2635329-21ntpq08:10:340
261646099321,9cyclictest2635329-21ntpq08:10:340
2616460993212,6cyclictest14-21ksoftirqd/011:40:380
261646299313,20cyclictest2738829-21ntpq11:30:362
261646299313,20cyclictest2738829-21ntpq11:30:362
2616462993125,3cyclictest2678094-21kworker/u8:2-xprtiod11:00:262
2616462993124,4cyclictest2628907-21cpuspeed07:50:252
2616462993123,5cyclictest2762309-21latency_hist12:10:032
2616462993122,6cyclictest1-21systemd09:25:262
261646099319,5cyclictest14-21ksoftirqd/009:55:350
2616460993126,2cyclictest0-21swapper/007:25:340
2616460993122,6cyclictest151ktimers/007:30:420
2616460993118,3cyclictest171rcu_preempt07:35:330
2616460993112,4cyclictest14-21ksoftirqd/008:45:370
2616460993110,5cyclictest14-21ksoftirqd/012:25:300
261646299309,15cyclictest351ktimers/212:30:412
261646299309,15cyclictest351ktimers/212:30:412
2616462993024,3cyclictest0-21swapper/209:40:292
2616462993023,3cyclictest0-21swapper/209:10:342
2616462993022,5cyclictest1001-21mta-sts-daemon08:30:392
2616461993025,2cyclictest0-21swapper/107:40:011
2616461993024,3cyclictest0-21swapper/110:15:431
261646199302,20cyclictest443-21gpm07:20:401
261646199301,22cyclictest2659641-21ssh09:20:361
2616460993023,4cyclictest2643423-21kworker/u8:6-xprtiod08:55:280
2616462992923,3cyclictest0-21swapper/210:45:352
2616462992921,5cyclictest2652466-21systemd-run09:10:012
2616462992920,5cyclictest2625446-21munin-run07:40:012
2616462992910,13cyclictest420-21avahi-daemon07:45:382
2616461992924,2cyclictest0-21swapper/111:00:011
2616461992923,4cyclictest0-21swapper/112:35:021
2616461992923,4cyclictest0-21swapper/112:35:021
2616461992923,3cyclictest0-21swapper/109:00:011
2616461992922,4cyclictest2652563-21wc09:10:021
2616461992922,3cyclictest0-21swapper/111:40:371
2616461992920,6cyclictest2741871-21ntp_kernel_pll_11:35:361
2616461992920,6cyclictest0-21swapper/110:05:401
261646099296,6cyclictest14-21ksoftirqd/007:10:020
261646099295,4cyclictest14-21ksoftirqd/009:05:350
261646099293,19cyclictest2643447-21awk08:40:010
261646099292,21cyclictest566-21gmain08:00:410
261646299289,14cyclictest665-21snmpd07:55:352
2616462992821,4cyclictest2640477-21systemd08:30:012
2616462992820,6cyclictest428-21mta-sts-daemon12:00:302
2616462992820,5cyclictest567-21gdbus08:50:012
2616462992819,6cyclictest485-21in:imuxsock07:20:012
2616461992821,4cyclictest2778941-21grep12:35:491
2616461992821,3cyclictest0-21swapper/111:20:451
2616461992821,3cyclictest0-21swapper/109:45:381
2616461992819,6cyclictest627-21lldpd11:48:121
261646099282,5cyclictest14-21ksoftirqd/007:50:390
2616462992721,3cyclictest0-21swapper/208:25:002
2616462992718,6cyclictest443-21gpm09:00:502
261646099278,5cyclictest14-21ksoftirqd/008:20:390
261646099278,4cyclictest14-21ksoftirqd/008:15:360
261646099278,4cyclictest14-21ksoftirqd/008:15:360
2616462992623,2cyclictest0-21swapper/208:40:352
261646199266,11cyclictest1003-21mta-sts-daemon08:50:401
2616461992619,3cyclictest0-21swapper/111:25:411
2616461992618,5cyclictest2644978-21systemd-run08:45:021
2616461992618,5cyclictest2638954-21cron08:25:001
2616461992618,5cyclictest2631471-21systemd-run08:00:011
2616461992618,5cyclictest0-21swapper/108:20:001
2616461992618,5cyclictest0-21swapper/108:20:001
2616461992617,6cyclictest1813736-21cups-browsed07:54:151
2616462992510,10cyclictest421-21dbus-daemon07:25:382
261646199253,16cyclictest1000-21mta-sts-daemon08:05:361
2616461992520,2cyclictest0-21swapper/107:45:011
2616461992517,6cyclictest420-21avahi-daemon07:15:421
2616461992517,5cyclictest1813736-21cups-browsed08:49:401
2616462992417,3cyclictest0-21swapper/208:55:012
261646299241,5cyclictest0-21swapper/208:00:392
261646199241,5cyclictest171rcu_preempt08:00:341
261646299231,3cyclictest171rcu_preempt07:30:372
2616461992318,2cyclictest0-21swapper/109:05:021
2616461992318,2cyclictest0-21swapper/107:35:011
261646399212,11cyclictest0-21swapper/309:32:033
261646399203,10cyclictest0-21swapper/311:00:363
261646399192,8cyclictest0-21swapper/309:20:343
261646399192,10cyclictest0-21swapper/312:25:403
261646399182,6cyclictest0-21swapper/308:45:363
261646299187,7cyclictest421-21dbus-daemon07:10:022
261646399172,9cyclictest0-21swapper/312:15:413
261646399172,9cyclictest0-21swapper/311:40:403
261646399172,9cyclictest0-21swapper/311:10:393
261646399163,7cyclictest0-21swapper/311:30:363
261646399163,7cyclictest0-21swapper/311:30:363
261646399162,8cyclictest0-21swapper/310:35:403
261646399162,8cyclictest0-21swapper/310:25:413
261646399162,8cyclictest0-21swapper/310:10:413
261646399162,8cyclictest0-21swapper/310:05:363
261646399162,8cyclictest0-21swapper/309:10:383
261646399162,5cyclictest0-21swapper/309:00:393
261646399161,9cyclictest0-21swapper/309:45:373
261646399161,8cyclictest0-21swapper/311:35:363
261646399161,8cyclictest0-21swapper/311:25:383
261646399161,8cyclictest0-21swapper/310:50:353
261646399153,6cyclictest0-21swapper/312:30:393
261646399153,6cyclictest0-21swapper/312:30:393
261646399152,8cyclictest0-21swapper/309:40:363
261646399152,6cyclictest0-21swapper/307:40:413
261646399151,9cyclictest0-21swapper/311:45:413
261646399151,8cyclictest0-21swapper/312:00:363
261646399151,8cyclictest0-21swapper/311:55:263
261646399151,8cyclictest0-21swapper/310:55:383
261646399151,8cyclictest0-21swapper/310:00:343
261646399151,8cyclictest0-21swapper/309:50:393
261646399151,7cyclictest0-21swapper/309:25:363
261646399151,7cyclictest0-21swapper/308:35:363
261646399143,5cyclictest0-21swapper/310:30:353
261646399143,5cyclictest0-21swapper/310:30:353
261646399142,8cyclictest0-21swapper/310:45:493
261646399142,7cyclictest0-21swapper/311:50:363
261646399142,7cyclictest0-21swapper/311:10:013
261646399142,6cyclictest0-21swapper/312:05:273
261646399141,9cyclictest0-21swapper/310:15:393
261646399141,8cyclictest0-21swapper/312:10:423
261646399141,8cyclictest0-21swapper/310:40:383
261646399141,7cyclictest0-21swapper/311:20:363
261646399141,7cyclictest0-21swapper/311:15:373
261646399141,7cyclictest0-21swapper/309:55:403
261646399141,7cyclictest0-21swapper/308:50:353
261646399141,7cyclictest0-21swapper/307:45:383
261646399141,6cyclictest0-21swapper/307:55:393
261646399141,6cyclictest0-21swapper/307:30:393
261646399134,5cyclictest0-21swapper/310:20:273
261646399133,6cyclictest0-21swapper/309:35:303
261646399133,6cyclictest0-21swapper/309:35:303
261646399132,5cyclictest0-21swapper/307:25:383
261646399131,7cyclictest0-21swapper/312:35:393
261646399131,7cyclictest0-21swapper/312:20:303
261646399131,7cyclictest0-21swapper/307:20:423
261646399131,7cyclictest0-21swapper/307:20:023
261646399131,6cyclictest0-21swapper/308:20:363
261646399131,6cyclictest0-21swapper/308:00:353
261646399121,8cyclictest0-21swapper/308:30:303
261646399121,7cyclictest0-21swapper/309:15:263
261646399121,7cyclictest0-21swapper/308:25:273
261646399121,7cyclictest0-21swapper/308:15:423
261646399121,7cyclictest0-21swapper/308:15:423
261646399121,7cyclictest0-21swapper/308:05:363
261646399121,7cyclictest0-21swapper/307:50:353
261646399113,5cyclictest0-21swapper/308:40:253
261646399113,5cyclictest0-21swapper/307:35:363
261646399112,5cyclictest0-21swapper/309:05:363
261646399111,6cyclictest0-21swapper/308:55:343
261646399111,6cyclictest0-21swapper/308:10:233
261646399111,6cyclictest0-21swapper/308:10:233
261646399111,5cyclictest0-21swapper/307:10:353
261646399107,2cyclictest421rcuc/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional