You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-06 - 01:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Tue May 05, 2026 12:43:10)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1882426997561,8cyclictest1982985-21kworker/u8:2+xprtiod10:54:552
1882426995834,19cyclictest0-21swapper/212:40:012
1882424995750,4cyclictest1938319-21munin-plugin-st09:35:000
1882425995648,4cyclictest0-21swapper/109:15:501
1882426995429,21cyclictest0-21swapper/209:30:512
1882425995445,6cyclictest1066724-21cups-browsed09:25:531
1882425995445,6cyclictest1066724-21cups-browsed09:25:531
1882426995325,5cyclictest0-21swapper/208:40:012
1882425995239,10cyclictest1988038-21needreboot10:45:441
1882424995241,8cyclictest0-21swapper/009:15:010
188242699514,39cyclictest2000000-21ssh11:00:492
1882424995040,7cyclictest1946763-21unixbench-2d09:45:590
1882426994923,3cyclictest0-21swapper/209:45:592
1882425994941,5cyclictest1994672-40mandb10:54:581
1882425994940,6cyclictest2063493-21ntp_kernel_pll_12:20:481
1882426994822,5cyclictest421-21dbus-daemon09:11:462
1882426994822,4cyclictest0-21swapper/212:30:582
1882426994819,5cyclictest1066724-21cups-browsed08:54:002
188242699472,22cyclictest1958734-21ssh10:05:502
188242699472,21cyclictest2019821-21ssh11:25:572
1882426994716,7cyclictest351ktimers/210:30:462
1882425994638,5cyclictest1968124-21sort10:20:391
1882426994536,6cyclictest1-21systemd11:45:012
188242699453,34cyclictest2039630-21ssh11:50:522
1882425994537,5cyclictest1961137-21ssh10:10:021
1882426994437,4cyclictest1982952-21idleruntime-cro10:40:012
1882426994436,5cyclictest1995701-21ssh10:55:422
1882426994432,7cyclictest1066724-21cups-browsed11:46:512
1882425994435,6cyclictest2002671-21latency_hist11:05:021
1882424994439,2cyclictest0-21swapper/007:55:010
1882424994438,4cyclictest1930367-21munin-plugin-st09:25:010
1882424994435,6cyclictest1066724-21cups-browsed09:28:500
1882424994435,6cyclictest1066724-21cups-browsed09:28:500
1882424994434,8cyclictest2022387-21systemd-run11:30:010
1882426994332,7cyclictest2047115-21fschecks_time12:00:402
1882426994331,8cyclictest420-21avahi-daemon10:25:502
1882426994323,9cyclictest1961699-21kworker/u8:10+events_unbound11:15:452
1882426994321,5cyclictest0-21swapper/210:45:022
1882425994337,3cyclictest0-21swapper/109:42:341
1882425994335,5cyclictest1913921-21systemd-run08:55:011
1882425994335,5cyclictest1898920-21munin-plugin-st08:05:001
1882425994335,5cyclictest1898920-21munin-plugin-st08:05:001
1882425994328,10cyclictest1066724-21cups-browsed12:10:031
1882426994231,7cyclictest1066724-21cups-browsed12:15:382
1882426994230,8cyclictest421-21dbus-daemon12:20:482
1882425994234,5cyclictest1889915-21cut07:35:011
1882424994233,6cyclictest1924402-21uptime09:16:040
1882424994228,9cyclictest0-21swapper/010:55:490
1882424994222,15cyclictest151ktimers/009:05:490
1882426994131,7cyclictest420-21avahi-daemon08:00:552
1882426994131,7cyclictest420-21avahi-daemon08:00:552
1882426994130,8cyclictest1066724-21cups-browsed10:00:022
1882426994130,7cyclictest420-21avahi-daemon11:38:282
1882426994128,10cyclictest1916372-21sshd09:00:512
1882425994133,5cyclictest2050249-21cut12:05:001
1882425994130,7cyclictest1066724-21cups-browsed10:35:431
1882426994032,5cyclictest2054244-21systemd-run12:10:012
1882426994032,5cyclictest1944969-21ssh09:45:002
1882425994032,5cyclictest2070197-21idleruntime-cro12:30:011
1882425994032,5cyclictest2062213-21munin-plugin-st12:20:011
188242599402,30cyclictest1919828-21ssh09:10:521
1882424994031,6cyclictest2066835-21aten_r2power_fr12:25:380
1882424994023,14cyclictest2043105-21fschecks_count11:55:420
1882424994017,12cyclictest12350irq/32-eth011:40:480
1882426993931,4cyclictest0-21swapper/211:55:522
188242599392,30cyclictest2027741-21sshd11:35:511
1882424993933,3cyclictest2010584-21kworker/u8:9-xprtiod11:15:450
1882424993932,4cyclictest420-21avahi-daemon10:03:250
1882424993925,11cyclictest0-21swapper/011:35:480
1882426993829,6cyclictest439-21systemd-logind11:15:022
1882426993829,6cyclictest439-21systemd-logind11:15:022
1882426993829,5cyclictest1054-21mta-sts-daemon09:15:502
188242599385,30cyclictest2031623-21ssh11:40:491
1882425993829,6cyclictest516-21in:imuxsock08:05:511
1882425993828,6cyclictest420-21avahi-daemon10:56:141
1882425993827,8cyclictest2015996-21mailstats11:20:561
1882425993827,8cyclictest1945979-21latency09:45:421
1882424993830,4cyclictest0-21swapper/012:20:500
1882424993828,6cyclictest12350irq/32-eth011:45:510
188242699378,19cyclictest428-21mta-sts-daemon09:20:552
1882426993731,3cyclictest0-21swapper/212:10:372
1882426993731,3cyclictest0-21swapper/208:20:012
1882426993728,6cyclictest1066724-21cups-browsed09:30:032
1882426993728,6cyclictest1066724-21cups-browsed09:30:032
1882426993724,9cyclictest2066846-21aten_r2power_fr12:25:382
188242599373,26cyclictest2023707-21ssh11:30:521
1882425993730,3cyclictest0-21swapper/112:30:471
1882425993729,5cyclictest2075141-21kernelversion12:35:421
1882425993727,7cyclictest1955121-21sendmail10:00:011
1882425993725,8cyclictest1066724-21cups-browsed12:07:521
1882424993729,5cyclictest421-21dbus-daemon10:40:030
1882424993728,6cyclictest1066724-21cups-browsed10:32:230
1882424993728,5cyclictest0-21swapper/010:45:470
1882424993723,10cyclictest0-21swapper/011:05:020
1882424993630,4cyclictest2015123-21aten_r2power_po11:20:380
1882424993628,5cyclictest2023664-21ntp_kernel_pll_11:30:510
1882424993628,5cyclictest1950213-21sh09:52:310
1882424993627,6cyclictest2059549-21ssh12:15:500
1882424993625,8cyclictest0-21swapper/012:35:410
1882424993621,10cyclictest12350irq/32-eth012:05:470
188242699357,18cyclictest1056-21mta-sts-daemon08:10:472
1882426993529,3cyclictest0-21swapper/209:40:002
1882426993527,5cyclictest1892499-21systemctl07:40:522
1882426993526,6cyclictest1066724-21cups-browsed10:15:252
1882426993526,4cyclictest0-21swapper/210:20:512
1882425993527,5cyclictest439-21systemd-logind08:20:021
1882425993527,5cyclictest2007880-21sh11:10:521
1882425993527,5cyclictest2007880-21sh11:10:521
1882425993527,5cyclictest1967389-21latency_hist10:20:021
1882425993527,5cyclictest1918405-21diskmemload10:33:561
1882425993527,4cyclictest0-21swapper/108:40:511
1882425993526,6cyclictest753-21ntpd08:00:021
1882425993526,6cyclictest753-21ntpd08:00:021
1882424993527,5cyclictest1066724-21cups-browsed11:08:270
1882424993527,5cyclictest1066724-21cups-browsed10:15:510
188242499352,25cyclictest1992078-21ssh10:50:480
188242499351,28cyclictest547-21gmain08:35:470
1882426993427,4cyclictest1051-21mta-sts-daemon10:02:262
1882426993427,4cyclictest0-21swapper/211:25:012
1882425993429,2cyclictest0-21swapper/110:30:001
1882425993425,6cyclictest261-21systemd-journal09:10:011
1882425993424,6cyclictest420-21avahi-daemon09:20:411
1882425993422,9cyclictest2038426-21latency_hist11:50:021
1882424993428,4cyclictest2056150-21unixbench_singl12:10:590
1882424993425,6cyclictest420-21avahi-daemon09:35:590
1882426993323,8cyclictest1915394-21munin-plugin-st09:00:002
188242699332,25cyclictest2023733-21ssh11:30:522
1882425993327,4cyclictest0-21swapper/111:20:001
1882425993327,3cyclictest0-21swapper/111:55:011
1882424993327,2cyclictest0-21swapper/012:30:410
1882424993320,4cyclictest2008358-21unixbench_multi11:11:000
1882424993320,4cyclictest2008358-21unixbench_multi11:11:000
188242499331,29cyclictest2039591-21ssh11:50:500
188242699326,17cyclictest428-21mta-sts-daemon07:10:502
1882426993221,8cyclictest1907910-21cut08:35:022
1882425993226,3cyclictest0-21swapper/109:35:481
1882425993226,3cyclictest0-21swapper/109:00:011
1882425993225,4cyclictest2003432-21sshd11:05:431
1882425993225,4cyclictest1895901-21cron07:55:001
1882425993225,3cyclictest0-21swapper/109:34:251
1882425993224,5cyclictest1885446-21systemd-run07:20:021
1882425993223,6cyclictest1066724-21cups-browsed10:41:401
1882425993223,5cyclictest1888566-21latency_hist07:30:021
1882425993222,6cyclictest420-21avahi-daemon11:28:511
188242499324,24cyclictest1984330-21sh10:40:530
1882424993226,4cyclictest1955107-21cron10:00:010
1882424993225,4cyclictest1910937-21systemd-run08:45:010
1882424993225,3cyclictest0-21swapper/008:50:520
1882424993222,7cyclictest0-21swapper/007:35:010
1882424993220,8cyclictest548-21gdbus10:25:550
1882426993123,5cyclictest1904923-21munin-plugin-st08:25:012
188242699311,24cyclictest1988267-21sshd10:45:522
1882425993122,6cyclictest420-21avahi-daemon11:57:561
1882424993124,4cyclictest1907910-21cut08:35:010
1882426993020,6cyclictest0-21swapper/209:05:532
1882425993023,3cyclictest0-21swapper/110:01:391
1882425993022,4cyclictest0-21swapper/108:25:421
1882425993021,6cyclictest420-21avahi-daemon09:52:411
1882424993024,4cyclictest1883925-21systemd-run07:15:000
1882424993014,13cyclictest151ktimers/007:25:490
1882426992922,4cyclictest1056-21mta-sts-daemon07:25:412
188242699291,22cyclictest2003931-21ssh11:05:542
1882425992920,6cyclictest420-21avahi-daemon08:45:571
1882425992920,6cyclictest1894403-21cron07:50:011
1882425992920,5cyclictest1902053-21latency_hist08:15:021
188242499293,9cyclictest1958722-21ssh10:05:490
1882424992922,5cyclictest1066724-21cups-browsed09:40:090
1882424992921,3cyclictest1963563-21cron10:15:010
1882424992912,12cyclictest421-21dbus-daemon12:00:460
1882426992819,6cyclictest1056-21mta-sts-daemon07:25:022
188242599288,7cyclictest62450lldpd10:13:001
1882425992820,5cyclictest1891946-21fschecks_count07:40:391
1882425992820,5cyclictest1056-21mta-sts-daemon07:20:571
1882425992818,7cyclictest1066724-21cups-browsed08:35:511
1882424992822,4cyclictest1903940-21fschecks_count08:20:400
1882424992818,7cyclictest1903397-21cron08:20:010
1882424992816,10cyclictest0-21swapper/009:00:010
1882426992721,3cyclictest0-21swapper/208:00:002
1882426992721,3cyclictest0-21swapper/208:00:002
1882425992721,3cyclictest0-21swapper/108:35:011
1882425992718,6cyclictest1905112-21latency_hist08:25:031
188242499274,16cyclictest151ktimers/007:45:500
188242499272,20cyclictest1066724-21cups-browsed10:20:510
1882426992620,3cyclictest0-21swapper/208:05:542
1882426992620,3cyclictest0-21swapper/207:40:012
1882426992619,4cyclictest1056-21mta-sts-daemon08:29:512
1882426992618,4cyclictest0-21swapper/210:12:242
1882425992617,6cyclictest1066724-21cups-browsed07:11:011
1882424992620,4cyclictest1916908-21cron09:05:000
1882425992517,5cyclictest1916792-21unixbench_multi09:00:591
1882424992520,3cyclictest151ktimers/007:20:510
1882424992520,2cyclictest0-21swapper/008:00:000
1882424992520,2cyclictest0-21swapper/008:00:000
188242699248,11cyclictest421-21dbus-daemon09:53:542
188242699242,17cyclictest1911840-21sshd08:45:522
1882426992419,2cyclictest0-21swapper/208:45:012
1882426992418,3cyclictest0-21swapper/207:55:002
1882426992418,3cyclictest0-21swapper/207:45:412
1882425992418,3cyclictest0-21swapper/107:40:011
1882424992419,3cyclictest1891885-21cpuspeed07:40:370
1882424992419,3cyclictest1054-21mta-sts-daemon08:00:560
1882424992419,3cyclictest1054-21mta-sts-daemon08:00:560
1882424992418,4cyclictest1890138-21/usr/sbin/munin07:35:530
1882424992417,5cyclictest1066724-21cups-browsed08:07:000
188242699232,17cyclictest1066724-21cups-browsed07:30:492
1882426992315,5cyclictest1066724-21cups-browsed07:18:312
1882424992318,3cyclictest1051-21mta-sts-daemon08:10:470
1882424992310,10cyclictest261-21systemd-journal08:45:200
1882424992216,3cyclictest0-21swapper/007:15:470
188242799212,10cyclictest0-21swapper/310:40:503
188242499218,4cyclictest1905190-21aten_r2power_cu08:25:370
188242799204,9cyclictest0-21swapper/311:00:513
188242799204,10cyclictest0-21swapper/310:20:523
188242799203,11cyclictest0-21swapper/310:15:473
188242799202,10cyclictest0-21swapper/311:55:473
188242799194,8cyclictest0-21swapper/309:10:503
188242799193,10cyclictest0-21swapper/312:10:453
188242799193,10cyclictest0-21swapper/309:15:503
188242799192,10cyclictest0-21swapper/309:20:513
1882426991913,3cyclictest0-21swapper/207:10:022
188242499191,15cyclictest1-21systemd07:10:020
188242799185,7cyclictest0-21swapper/310:55:493
188242799183,9cyclictest0-21swapper/312:15:503
188242799183,9cyclictest0-21swapper/311:50:553
188242799183,9cyclictest0-21swapper/309:55:483
188242799183,9cyclictest0-21swapper/307:15:473
188242799183,10cyclictest0-21swapper/311:40:483
188242799182,9cyclictest0-21swapper/312:05:463
188242799182,10cyclictest0-21swapper/310:25:483
188242799182,10cyclictest0-21swapper/309:35:493
188242799182,10cyclictest0-21swapper/309:25:563
188242799182,10cyclictest0-21swapper/309:25:563
188242799181,9cyclictest0-21swapper/312:00:523
188242799181,9cyclictest0-21swapper/311:10:473
188242799181,9cyclictest0-21swapper/311:10:473
188242799181,11cyclictest0-21swapper/310:54:583
188242799174,8cyclictest0-21swapper/311:15:453
188242799174,8cyclictest0-21swapper/310:45:493
188242799173,9cyclictest0-21swapper/311:20:493
188242799173,9cyclictest0-21swapper/310:35:533
188242799173,8cyclictest0-21swapper/312:20:483
188242799173,7cyclictest0-21swapper/308:20:473
188242799172,9cyclictest0-21swapper/311:25:573
188242799172,9cyclictest0-21swapper/309:30:493
188242799172,8cyclictest0-21swapper/311:05:523
188242799165,4cyclictest0-21swapper/307:35:483
188242799163,6cyclictest0-21swapper/309:45:453
188242799162,8cyclictest0-21swapper/312:30:473
188242799162,8cyclictest0-21swapper/312:25:483
188242799161,7cyclictest0-21swapper/307:40:453
188242799161,7cyclictest0-21swapper/307:25:483
188242799161,7cyclictest0-21swapper/307:10:463
188242599161,11cyclictest1-21systemd07:10:021
188242799155,8cyclictest0-21swapper/311:30:483
188242799153,7cyclictest0-21swapper/310:05:473
188242799152,6cyclictest0-21swapper/308:15:453
188242799151,9cyclictest0-21swapper/311:35:403
188242799151,8cyclictest0-21swapper/310:30:483
188242799151,8cyclictest0-21swapper/308:45:513
188242799151,8cyclictest0-21swapper/308:10:493
188242799151,8cyclictest0-21swapper/307:35:013
188242799151,10cyclictest0-21swapper/312:35:363
188242799143,6cyclictest0-21swapper/307:45:493
188242799143,5cyclictest0-21swapper/308:30:463
188242799143,5cyclictest0-21swapper/307:20:463
188242799142,8cyclictest0-21swapper/309:40:473
188242799142,7cyclictest0-21swapper/309:00:463
188242799142,7cyclictest0-21swapper/308:55:473
188242799142,7cyclictest0-21swapper/307:50:523
188242799142,10cyclictest0-21swapper/311:45:483
188242799132,7cyclictest0-21swapper/310:01:513
188242799132,7cyclictest0-21swapper/309:50:443
188242799132,7cyclictest0-21swapper/308:25:533
188242799132,7cyclictest0-21swapper/308:05:473
188242799132,6cyclictest0-21swapper/308:35:443
188242799132,5cyclictest0-21swapper/307:55:483
188242799132,5cyclictest0-21swapper/307:55:483
188242799131,7cyclictest0-21swapper/309:05:463
188242799131,6cyclictest0-21swapper/308:50:463
188242799122,5cyclictest0-21swapper/308:00:403
188242799122,5cyclictest0-21swapper/308:00:403
188242799121,7cyclictest0-21swapper/310:13:293
188242799121,6cyclictest0-21swapper/308:40:473
18824279992,4cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional