You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-28 - 19:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Tue Apr 28, 2026 12:43:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
736092995139,7cyclictest0-21swapper/210:30:452
736091995141,6cyclictest898843-21cron11:55:011
736091995041,5cyclictest810592-21unixbench_singl09:55:551
736091994838,7cyclictest439-21systemd-logind08:35:011
736092994739,5cyclictest841923-21grep10:35:572
736092994739,5cyclictest841923-21grep10:35:572
736091994637,6cyclictest421-21dbus-daemon12:20:011
736090994638,5cyclictest856861-21proc_pri11:00:500
736090994638,5cyclictest4122572-21cups-browsed10:02:410
736090994633,11cyclictest0-21swapper/012:40:020
736092994532,10cyclictest789587-21sh09:30:442
736090994538,3cyclictest0-21swapper/011:35:480
736090994535,7cyclictest830161-21mailstats10:20:490
736092994436,5cyclictest851980-21latency_hist10:55:022
736091994433,6cyclictest0-21swapper/110:15:421
736090994437,5cyclictest548-21gdbus10:30:450
736090994415,23cyclictest880197-21ssh11:30:450
736092994334,5cyclictest828747-21latency_hist10:20:022
736091994336,3cyclictest0-21swapper/111:00:571
736090994336,4cyclictest764656-21systemd-run08:45:010
736090994336,4cyclictest4122572-21cups-browsed12:30:380
736090994336,4cyclictest4122572-21cups-browsed12:30:380
736092994233,6cyclictest745109-21systemd-run07:40:012
736091994233,6cyclictest1-21systemd09:10:021
736091994231,7cyclictest420-21avahi-daemon09:11:511
736091994231,7cyclictest420-21avahi-daemon09:11:511
736090994235,4cyclictest863043-21munin-plugin-st11:10:010
736090994235,4cyclictest820748-21ssh10:10:010
736090994234,5cyclictest794029-21/usr/sbin/munin09:35:540
736091994135,3cyclictest0-21swapper/109:00:011
736091994134,4cyclictest739083-21munin-run07:20:011
736091994133,5cyclictest801662-21missed_timers09:45:391
736091994133,5cyclictest801662-21missed_timers09:45:391
736091994132,6cyclictest934773-21cron12:40:001
736091994132,6cyclictest833544-21if_wlan010:25:371
736091994132,6cyclictest833544-21if_wlan010:25:371
736092994032,5cyclictest788498-21latency_hist09:30:022
736092994026,10cyclictest832638-21sh10:25:012
736091994034,3cyclictest0-21swapper/112:00:451
736091994033,4cyclictest0-21swapper/109:40:351
736091994031,6cyclictest788417-21latency_hist09:30:021
736091994031,4cyclictest0-21swapper/112:25:471
736090994034,4cyclictest887550-21aten_r2power_po11:40:340
736090994031,7cyclictest843295-21grep10:40:010
736090994031,7cyclictest843295-21grep10:40:010
736090994028,9cyclictest0-21swapper/011:45:510
73609299396,5cyclictest171rcu_preempt08:05:002
736092993931,5cyclictest887859-21if_wlan011:40:392
736092993930,6cyclictest824885-21latency_hist10:15:022
736092993930,6cyclictest4122567-21cupsd10:00:062
736091993931,6cyclictest0-21swapper/111:40:571
736091993931,5cyclictest874944-21ssh11:25:001
736091993931,5cyclictest855463-21grep11:00:001
736090993930,6cyclictest421-21dbus-daemon09:52:140
736090993922,15cyclictest798383-21unixbench_multi09:40:570
736090993915,20cyclictest191rcuc/011:56:560
736090993915,20cyclictest191rcuc/011:56:560
736092993830,5cyclictest911506-21aten_r2power_vo12:10:332
736092993830,5cyclictest860880-21timerandwakeup11:06:002
736092993830,5cyclictest757124-21idleruntime-cro08:20:002
736092993830,5cyclictest743600-21systemd-run07:35:012
73609299381,15cyclictest900097-21ssh11:55:452
73609299381,15cyclictest900097-21ssh11:55:452
736091993830,4cyclictest0-21swapper/107:40:481
736091993829,5cyclictest0-21swapper/109:40:021
736091993829,4cyclictest0-21swapper/110:50:461
736091993819,16cyclictest736094-21kworker/u8:1+events_unbound07:45:471
736090993832,4cyclictest1-21systemd11:00:010
736090993831,5cyclictest810614-21/usr/sbin/munin09:55:550
736090993831,4cyclictest920658-21grep12:20:560
736092993722,10cyclictest420-21avahi-daemon11:50:502
73609199374,28cyclictest884230-21ssh11:35:481
736091993731,2cyclictest0-21swapper/109:25:021
736091993730,4cyclictest1056-21mta-sts-daemon12:10:341
736091993728,4cyclictest0-21swapper/111:10:471
736091993726,8cyclictest806273-21switchtime09:50:551
73609099374,29cyclictest908141-21ssh12:05:460
736090993731,3cyclictest0-21swapper/008:25:010
736090993730,4cyclictest849185-21sort10:50:370
736090993727,7cyclictest825251-21aten_r2power_cu10:15:320
736090993725,7cyclictest12350irq/32-eth011:25:420
73609299364,27cyclictest805890-21ssh09:50:442
736092993628,5cyclictest0-21swapper/207:20:012
736092993626,7cyclictest834262-21timerandwakeup10:25:542
736092993626,7cyclictest834262-21timerandwakeup10:25:542
736091993629,3cyclictest0-21swapper/112:05:491
736091993628,5cyclictest421-21dbus-daemon12:00:021
736091993628,5cyclictest421-21dbus-daemon12:00:021
736091993627,3cyclictest0-21swapper/110:35:441
736091993627,3cyclictest0-21swapper/110:35:441
736091993625,8cyclictest891418-21acpi11:45:321
73609199362,27cyclictest777464-21ssh09:15:461
736090993613,19cyclictest896238-21ssh11:50:510
736092993529,3cyclictest870992-21kworker/u8:9-xprtiod11:25:002
736092993528,3cyclictest0-21swapper/211:40:012
736092993527,4cyclictest0-21swapper/209:55:432
73609299352,27cyclictest801914-21ssh09:45:462
73609299352,27cyclictest801914-21ssh09:45:462
736091993528,4cyclictest1056-21mta-sts-daemon12:23:021
736091993527,5cyclictest789346-21kernelversion09:30:401
736091993526,6cyclictest548-21gdbus08:05:531
736090993530,2cyclictest0-21swapper/009:50:010
736090993530,2cyclictest0-21swapper/009:50:010
736090993528,4cyclictest870982-21systemd-run11:20:010
736090993528,4cyclictest870982-21systemd-run11:20:010
736090993526,7cyclictest769150-21sh09:00:010
736090993522,9cyclictest12350irq/32-eth009:30:440
736092993427,4cyclictest797231-21aten_r2power_vo09:40:362
736092993426,5cyclictest892389-21mailstats11:45:502
736092993426,4cyclictest0-21swapper/209:25:012
736092993424,7cyclictest1-21systemd09:13:092
736092993424,7cyclictest1-21systemd09:13:092
73609299341,28cyclictest847177-21ssh10:45:452
73609299341,28cyclictest847177-21ssh10:45:452
736091993427,4cyclictest1051-21mta-sts-daemon10:25:021
73609199342,26cyclictest860618-21ssh11:05:551
736091993421,9cyclictest817946-21sendmail-mta10:05:441
736090993427,3cyclictest0-21swapper/009:19:240
736090993425,7cyclictest784313-21cron09:25:010
736090993424,4cyclictest752627-21cron08:05:010
73609299334,24cyclictest876189-21ssh11:25:432
736092993327,3cyclictest0-21swapper/212:25:382
736092993327,3cyclictest0-21swapper/211:05:012
736092993325,4cyclictest0-21swapper/210:05:492
736092993320,8cyclictest351ktimers/212:00:472
736091993325,5cyclictest762157-21fschecks_time08:35:371
73609199332,25cyclictest837855-21ssh10:30:491
736090993326,4cyclictest0-21swapper/012:10:350
736090993323,7cyclictest784816-21/usr/sbin/munin09:25:390
736090993323,4cyclictest0-21swapper/011:10:500
736090993318,7cyclictest12350irq/32-eth010:10:510
736090993318,12cyclictest926811-21ssh12:30:010
736090993313,17cyclictest191rcuc/012:16:580
736092993226,3cyclictest0-21swapper/212:05:422
736092993220,9cyclictest932586-21timerwakeupswit12:35:562
73609299321,26cyclictest864248-21ssh11:10:442
73609199323,21cyclictest822098-21ssh10:10:501
736091993226,3cyclictest0-21swapper/111:30:011
736091993224,6cyclictest1-21systemd09:05:011
736091993223,5cyclictest814635-21unixbench_multi10:00:581
73609099322,4cyclictest171rcu_preempt08:10:430
73609099322,26cyclictest773335-21ntpq09:10:430
73609099322,26cyclictest773335-21ntpq09:10:430
73609099321,5cyclictest762535-21ntpq08:35:460
73609099321,3cyclictest171rcu_preempt07:50:500
736092993123,5cyclictest846203-21cron10:45:002
736092993123,5cyclictest846203-21cron10:45:002
736092993118,10cyclictest928156-21ntp_states12:30:492
736092993118,10cyclictest928156-21ntp_states12:30:492
73609299311,25cyclictest868305-21ssh11:15:482
73609299311,25cyclictest868305-21ssh11:15:482
736091993125,4cyclictest1055-21mta-sts-daemon12:31:261
736091993125,4cyclictest1055-21mta-sts-daemon12:31:261
736091993123,5cyclictest749467-21tail07:50:561
736091993119,9cyclictest766931-21needreboot08:50:421
736090993122,7cyclictest765441-21needreboot08:45:410
736090993122,6cyclictest872818-21unixbench_multi11:20:560
736090993122,6cyclictest740590-21cron07:25:000
736090993115,12cyclictest0-21swapper/007:40:520
73609099311,14cyclictest906846-21munin-run12:05:000
736092993023,4cyclictest778870-21ssh09:17:222
736092993023,4cyclictest1056-21mta-sts-daemon09:38:492
736092993022,5cyclictest879929-21kernelversion11:30:392
736092993021,5cyclictest764624-21cron08:45:012
73609199307,14cyclictest428-21mta-sts-daemon07:35:501
736091993024,3cyclictest0-21swapper/111:35:011
736091993022,5cyclictest756258-21kernelversion08:15:381
736091993020,4cyclictest0-21swapper/111:15:431
736091993020,4cyclictest0-21swapper/111:15:431
736090993025,3cyclictest811780-21kworker/u8:0-xprtiod10:40:370
736090993025,3cyclictest811780-21kworker/u8:0-xprtiod10:40:370
736090993024,3cyclictest0-21swapper/010:25:390
736090993024,3cyclictest0-21swapper/010:25:390
73609099302,3cyclictest171rcu_preempt08:50:480
736090993019,8cyclictest0-21swapper/008:05:560
736090993018,5cyclictest421-21dbus-daemon09:05:010
736092992921,5cyclictest740516-21unixbench_singl07:20:552
736092992921,5cyclictest0-21swapper/208:00:012
736092992920,7cyclictest758162-21proc_pri08:20:502
736091992923,3cyclictest0-21swapper/108:05:011
73609099293,18cyclictest4122572-21cups-browsed07:45:460
736090992917,8cyclictest0-21swapper/007:30:380
736092992820,5cyclictest770551-21unixbench_singl09:00:562
736092992820,5cyclictest4122572-21cups-browsed08:36:562
736091992821,4cyclictest760137-21grep08:30:001
736091992821,4cyclictest760137-21grep08:30:001
736091992820,5cyclictest758645-21ls08:25:001
736091992820,5cyclictest740601-21idleruntime-cro07:25:011
736091992819,6cyclictest4122572-21cups-browsed07:25:441
736091992819,6cyclictest4122572-21cups-browsed07:25:441
736090992821,5cyclictest191rcuc/008:30:450
736090992821,4cyclictest751041-21kworker/u8:10+xprtiod10:50:010
736090992821,4cyclictest751041-21kworker/u8:10+xprtiod10:50:010
736090992820,5cyclictest758975-21aten_r2power_fr08:25:340
736090992820,5cyclictest758975-21aten_r2power_fr08:25:340
736092992722,2cyclictest0-21swapper/210:55:352
736092992721,3cyclictest0-21swapper/207:10:572
736092992720,4cyclictest768147-21fschecks_time08:55:392
736092992720,4cyclictest754686-21idleruntime08:10:362
736092992719,5cyclictest736115-21latency_hist07:10:022
736091992721,4cyclictest1056-21mta-sts-daemon07:55:531
736091992720,3cyclictest0-21swapper/110:40:321
736091992720,3cyclictest0-21swapper/110:40:321
73609099276,13cyclictest428-21mta-sts-daemon07:10:500
736090992721,4cyclictest772119-21cron09:10:010
73609099270,3cyclictest171rcu_preempt07:25:440
73609099270,3cyclictest171rcu_preempt07:25:440
736092992621,2cyclictest0-21swapper/209:06:002
736092992620,3cyclictest739052-21kworker/u8:13-rpciod07:40:482
736092992620,3cyclictest0-21swapper/212:25:012
736092992620,3cyclictest0-21swapper/212:15:322
736092992618,5cyclictest4122572-21cups-browsed07:48:422
736092992618,5cyclictest0-21swapper/207:50:462
736091992620,3cyclictest0-21swapper/108:45:011
736091992618,5cyclictest846810-21fschecks_count10:45:371
736091992618,5cyclictest846810-21fschecks_count10:45:371
736091992618,5cyclictest742604-21fschecks_count07:30:381
736091992618,5cyclictest1054-21mta-sts-daemon07:10:461
73609099267,17cyclictest739053-21kworker/u8:15+events_unbound07:17:030
73609099261,15cyclictest0-21swapper/007:55:480
73609299256,16cyclictest421-21dbus-daemon08:50:442
736092992517,5cyclictest766147-21systemd-run08:50:012
736092992517,5cyclictest4122572-21cups-browsed07:26:062
736092992517,5cyclictest4122572-21cups-browsed07:26:062
736091992517,4cyclictest0-21swapper/108:45:481
736092992418,3cyclictest0-21swapper/208:25:372
736092992418,3cyclictest0-21swapper/208:25:372
736092992416,6cyclictest760831-21latency08:30:382
736092992415,6cyclictest753297-21kernelversion08:05:392
736091992418,3cyclictest0-21swapper/108:15:011
736090992416,3cyclictest171rcu_preempt07:10:010
73609099241,15cyclictest171rcu_preempt08:15:430
736090992411,11cyclictest191rcuc/007:35:280
736091992116,3cyclictest0-21swapper/107:10:021
73609399192,10cyclictest0-21swapper/310:10:493
73609399182,8cyclictest0-21swapper/311:50:503
73609399182,8cyclictest0-21swapper/311:25:423
73609399182,8cyclictest0-21swapper/310:15:423
73609399181,9cyclictest0-21swapper/309:40:443
73609399173,8cyclictest0-21swapper/311:35:483
73609399172,9cyclictest0-21swapper/309:10:453
73609399172,9cyclictest0-21swapper/309:10:453
73609399171,9cyclictest0-21swapper/311:40:483
73609399171,9cyclictest0-21swapper/310:20:493
73609399171,10cyclictest0-21swapper/310:50:473
73609399163,7cyclictest0-21swapper/309:30:443
73609399162,8cyclictest0-21swapper/309:25:013
73609399162,7cyclictest0-21swapper/312:25:373
73609399162,7cyclictest0-21swapper/307:45:463
73609399161,9cyclictest0-21swapper/312:15:443
73609399161,9cyclictest0-21swapper/311:45:423
73609399161,9cyclictest0-21swapper/311:15:453
73609399161,9cyclictest0-21swapper/311:15:453
73609399161,9cyclictest0-21swapper/311:00:423
73609399161,9cyclictest0-21swapper/309:50:433
73609399161,9cyclictest0-21swapper/309:45:473
73609399161,9cyclictest0-21swapper/309:45:473
73609399161,8cyclictest0-21swapper/309:15:423
73609399161,10cyclictest0-21swapper/312:00:463
73609399161,10cyclictest0-21swapper/311:55:513
73609399161,10cyclictest0-21swapper/311:55:513
73609399161,10cyclictest0-21swapper/310:30:433
73609399152,8cyclictest0-21swapper/312:10:353
73609399152,8cyclictest0-21swapper/312:05:423
73609399152,8cyclictest0-21swapper/310:25:373
73609399152,8cyclictest0-21swapper/310:25:373
73609399152,8cyclictest0-21swapper/309:55:433
73609399152,8cyclictest0-21swapper/309:25:353
73609399152,5cyclictest0-21swapper/308:30:453
73609399151,9cyclictest0-21swapper/311:20:443
73609399151,9cyclictest0-21swapper/311:05:493
73609399151,9cyclictest0-21swapper/310:40:513
73609399151,9cyclictest0-21swapper/310:40:513
73609399151,8cyclictest0-21swapper/312:35:403
73609399151,8cyclictest0-21swapper/312:30:443
73609399151,8cyclictest0-21swapper/312:30:443
73609399151,7cyclictest0-21swapper/308:55:473
73609399143,5cyclictest0-21swapper/308:25:433
73609399143,5cyclictest0-21swapper/308:25:433
73609399143,4cyclictest0-21swapper/308:10:453
73609399142,8cyclictest0-21swapper/310:05:443
73609399142,5cyclictest0-21swapper/307:30:453
73609399142,4cyclictest0-21swapper/307:25:423
73609399142,4cyclictest0-21swapper/307:25:423
73609399141,9cyclictest0-21swapper/312:20:433
73609399141,8cyclictest0-21swapper/311:10:433
73609399141,8cyclictest0-21swapper/310:35:383
73609399141,8cyclictest0-21swapper/310:35:383
73609399141,8cyclictest0-21swapper/310:00:433
73609399141,8cyclictest0-21swapper/308:50:443
73609399141,7cyclictest0-21swapper/311:30:453
73609399141,7cyclictest0-21swapper/308:05:463
73609399141,7cyclictest0-21swapper/307:55:543
73609399141,6cyclictest0-21swapper/309:05:473
73609399141,6cyclictest0-21swapper/308:20:443
73609399133,6cyclictest0-21swapper/310:55:563
73609399131,7cyclictest0-21swapper/309:35:353
73609399131,7cyclictest0-21swapper/308:40:413
73609399131,6cyclictest0-21swapper/309:00:493
73609399131,6cyclictest0-21swapper/308:15:413
73609399121,6cyclictest0-21swapper/307:20:483
73609399111,6cyclictest0-21swapper/310:45:403
73609399111,6cyclictest0-21swapper/310:45:403
73609399111,6cyclictest0-21swapper/308:35:433
73609399111,6cyclictest0-21swapper/308:05:023
73609399111,6cyclictest0-21swapper/307:40:003
73609399111,6cyclictest0-21swapper/307:15:403
73609399111,6cyclictest0-21swapper/307:10:483
73609399111,5cyclictest0-21swapper/307:40:413
73609399102,6cyclictest0-21swapper/308:45:413
73609399101,5cyclictest0-21swapper/307:50:363
7360939981,4cyclictest0-21swapper/307:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional