You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-18 - 06:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Fri Sep 18, 2026 00:42:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1757040996144,8cyclictest0-21swapper/219:36:142
1757040994938,6cyclictest47853-21cups-browsed23:20:512
1757038994929,11cyclictest12650irq/32-eth023:36:120
1757038994837,8cyclictest265-21systemd-journal21:30:010
1757040994734,8cyclictest420-21avahi-daemon21:21:142
1757040994734,8cyclictest420-21avahi-daemon21:21:142
1757040994635,8cyclictest47853-21cups-browsed22:55:012
1757039994636,7cyclictest1857255-21munin-run22:55:021
1757039994536,6cyclictest1814627-21latency_hist21:45:021
175703999451,39cyclictest271ktimers/119:31:121
1757040994433,8cyclictest421-21dbus-daemon19:20:022
175703999443,32cyclictest1864759-21ssh23:06:231
175703999443,32cyclictest1864759-21ssh23:06:231
175703999442,35cyclictest1916560-21ssh00:31:161
175703999442,35cyclictest1916560-21ssh00:31:161
1757038994430,11cyclictest1872496-21sendmail23:20:010
1757040994334,6cyclictest1778048-21idleruntime-cro20:20:012
1757039994336,3cyclictest0-21swapper/122:50:011
1757039994335,5cyclictest485-21in:imuxsock21:55:011
1757039994335,5cyclictest1886233-21mailstats23:41:241
1757038994337,4cyclictest1909094-21ssh00:20:010
1757040994234,5cyclictest1906090-21latency_hist00:15:022
1757040994234,5cyclictest1868621-21kworker/u8:3-xprtiod23:20:012
1757040994231,7cyclictest1916874-21ssh00:31:232
1757040994231,7cyclictest1916874-21ssh00:31:232
1757039994237,2cyclictest0-21swapper/122:20:011
1757039994223,11cyclictest271ktimers/120:26:131
1757038994230,8cyclictest151ktimers/019:31:110
1757038994223,13cyclictest12650irq/32-eth000:21:220
1757040994129,7cyclictest1876775-21sh23:26:132
1757039994134,4cyclictest1848068-21sendmail22:40:011
1757039994132,5cyclictest1779746-21latency_hist20:25:021
1757039994132,5cyclictest1779746-21latency_hist20:25:021
175703999412,34cyclictest1800396-21ssh21:21:131
175703999412,34cyclictest1800396-21ssh21:21:131
1757038994129,9cyclictest1799166-21munin-run21:20:010
1757038994129,9cyclictest1799166-21munin-run21:20:010
175703999403,32cyclictest1910498-21ssh00:21:201
1757039994032,5cyclictest1884693-21munin-run23:40:011
1757039994032,5cyclictest1817571-21systemd-run21:50:011
1757039994031,7cyclictest0-21swapper/100:00:021
1757038994031,6cyclictest1773707-21latency_hist20:05:020
1757040993928,7cyclictest47837-21cupsd21:33:102
175704099391,31cyclictest1831048-21ssh22:11:152
1757039993931,5cyclictest1826738-21latency_hist22:05:021
1757039993931,5cyclictest1773580-21systemd-run20:05:011
1757039993929,6cyclictest420-21avahi-daemon21:55:341
1757038993932,4cyclictest1826701-21grep22:05:010
1757038993931,6cyclictest47837-21cupsd23:42:180
1757038993931,4cyclictest1001-21mta-sts-daemon00:30:560
1757038993931,4cyclictest1001-21mta-sts-daemon00:30:560
1757038993929,6cyclictest1001-21mta-sts-daemon21:52:010
1757040993828,7cyclictest1001-21mta-sts-daemon22:21:182
1757040993828,7cyclictest1001-21mta-sts-daemon22:21:182
175703999383,25cyclictest1867681-21ssh23:11:181
1757039993831,3cyclictest0-21swapper/122:21:151
1757039993831,3cyclictest0-21swapper/122:21:151
1757039993830,5cyclictest1784071-21systemd-run20:40:021
1757039993820,10cyclictest271ktimers/121:06:181
1757038993831,4cyclictest1875745-21latency_hist23:25:020
1757038993831,4cyclictest1862134-21unixbench_multi23:01:270
1757038993815,18cyclictest1849418-21sh22:41:180
1757040993725,7cyclictest1861922-21switchtime23:01:262
175704099372,29cyclictest1901327-21ssh00:06:192
175703999373,26cyclictest1892065-21ssh23:51:181
1757039993727,7cyclictest1858300-21latency22:56:101
1757039993726,7cyclictest47853-21cups-browsed22:10:031
1757038993731,4cyclictest1791570-21systemd-run21:05:010
1757038993729,5cyclictest151ktimers/023:31:150
1757040993628,5cyclictest421-21dbus-daemon22:00:012
1757040993628,3cyclictest0-21swapper/221:41:162
1757040993627,4cyclictest0-21swapper/222:16:032
175703999362,27cyclictest1876856-21ssh23:26:171
1757039993612,16cyclictest28-21ksoftirqd/100:01:271
175703899363,21cyclictest1889262-21ssh23:46:220
1757038993630,4cyclictest1837693-21tail22:21:250
1757038993630,4cyclictest1837693-21tail22:21:250
1757038993628,6cyclictest1814534-21true21:45:010
1757040993528,3cyclictest1804502-21kworker/u8:8-xprtiod21:50:012
1757040993527,5cyclictest1-21systemd00:00:012
1757040993524,8cyclictest694-21cron23:10:012
1757040993524,8cyclictest694-21cron23:10:012
1757040993524,8cyclictest1889021-21ntp_kernel_pll_23:46:152
1757040993521,10cyclictest47853-21cups-browsed21:11:302
1757040993513,17cyclictest265-21systemd-journal00:23:302
1757039993528,4cyclictest1799156-21ssh21:20:011
1757039993528,4cyclictest1799156-21ssh21:20:011
1757039993527,5cyclictest1796106-21munin-plugin-st21:15:011
1757039993519,12cyclictest271ktimers/119:51:111
1757038993530,2cyclictest0-21swapper/021:21:150
1757038993530,2cyclictest0-21swapper/021:21:150
1757038993528,4cyclictest1806201-21gltestperf21:31:060
175703899352,28cyclictest1821910-21ssh21:56:190
1757038993522,10cyclictest47853-21cups-browsed23:08:220
1757038993522,10cyclictest47853-21cups-browsed23:08:220
1757040993427,3cyclictest0-21swapper/222:46:152
1757040993426,5cyclictest1782490-21head20:31:242
1757040993426,4cyclictest0-21swapper/200:01:032
1757040993425,6cyclictest1763073-21systemd-run19:30:022
1757040993425,4cyclictest1001-21mta-sts-daemon23:39:582
1757039993420,9cyclictest420-21avahi-daemon00:36:061
175703899345,9cyclictest14-21ksoftirqd/022:26:100
1757038993430,2cyclictest0-21swapper/019:20:010
1757038993428,4cyclictest1915340-21latency_hist00:30:030
1757038993428,4cyclictest1915340-21latency_hist00:30:030
1757038993427,4cyclictest1794867-21unixbench_multi21:11:310
1757038993427,3cyclictest0-21swapper/000:00:000
1757038993411,2cyclictest171rcu_preempt20:56:220
175703899340,9cyclictest14-21ksoftirqd/020:06:180
175703899340,11cyclictest14-21ksoftirqd/019:21:120
1757040993326,3cyclictest0-21swapper/222:05:012
1757040993325,5cyclictest1906932-21sort00:16:082
1757040993324,6cyclictest1819234-21timerandwakeup21:51:242
1757039993327,3cyclictest0-21swapper/100:06:161
1757039993325,5cyclictest1782557-21systemd-run20:35:011
1757039993324,5cyclictest1906045-21cron00:15:011
1757039993323,8cyclictest1758554-21sh19:15:011
1757039993323,7cyclictest694-21cron23:20:011
175703899337,18cyclictest665-21snmpd20:51:130
175703899334,12cyclictest14-21ksoftirqd/022:11:150
1757038993327,4cyclictest1869545-21latency_hist23:15:020
1757038993325,5cyclictest420-21avahi-daemon22:06:120
1757038993323,6cyclictest47837-21cupsd23:51:390
175704099323,23cyclictest1892103-21ssh23:51:202
1757040993226,3cyclictest0-21swapper/220:40:022
1757040993224,4cyclictest0-21swapper/223:44:302
1757040993223,6cyclictest1785465-21unixbench_singl20:41:262
1757040993223,5cyclictest1858712-21mailstats22:56:222
1757040993211,6cyclictest62750lldpd22:28:062
1757039993224,4cyclictest1830757-21kernelversion22:11:081
1757039993223,5cyclictest1811442-21cron21:40:001
1757039993220,8cyclictest1002-21mta-sts-daemon00:26:261
1757039993220,8cyclictest1002-21mta-sts-daemon00:26:261
1757038993225,5cyclictest1793048-21diskmemload00:36:160
175703899322,25cyclictest1876868-21ssh23:26:170
1757038993217,10cyclictest1901309-21ssh00:06:190
1757038993214,12cyclictest171rcu_preempt19:51:170
1757040993124,4cyclictest1767127-21sendmail_mailst19:41:202
1757040993124,4cyclictest1760601-21gltestperf19:21:072
1757040993123,5cyclictest0-21swapper/220:00:012
1757040993123,3cyclictest0-21swapper/223:11:152
1757040993122,5cyclictest1764566-21systemd-run19:35:022
1757040993122,4cyclictest0-21swapper/221:26:462
1757039993125,4cyclictest1757037-21cyclictest21:25:541
1757039993124,4cyclictest1000-21mta-sts-daemon19:21:141
1757039993124,3cyclictest0-21swapper/121:31:181
1757039993123,5cyclictest1789933-21unixbench_multi20:56:291
1757039993121,8cyclictest1843053-21latency22:31:131
175703899316,8cyclictest14-21ksoftirqd/021:46:140
175703899316,10cyclictest14-21ksoftirqd/022:46:160
1757038993124,5cyclictest1834097-21ssh22:16:170
1757038993122,5cyclictest151ktimers/022:50:060
1757038993118,6cyclictest171rcu_preempt20:46:160
1757038993113,2cyclictest171rcu_preempt19:11:110
1757038993110,8cyclictest14-21ksoftirqd/020:15:010
1757040993023,4cyclictest1758563-21systemd19:15:022
1757040993023,4cyclictest1003-21mta-sts-daemon19:51:132
1757040993023,4cyclictest0-21swapper/222:35:022
1757040993022,5cyclictest0-21swapper/222:06:202
1757040993021,5cyclictest1775237-21latency_hist20:10:022
1757040993015,10cyclictest421-21dbus-daemon21:19:242
1757040993015,10cyclictest421-21dbus-daemon21:19:242
1757039993024,3cyclictest0-21swapper/120:20:011
1757039993024,3cyclictest0-21swapper/119:20:011
1757039993022,5cyclictest567-21gdbus20:45:021
1757039993022,5cyclictest1880250-21timerandwakeup23:31:261
1757039993022,5cyclictest1839633-21aten_r2power_vo22:26:021
1757039993022,4cyclictest0-21swapper/123:01:221
175703999302,20cyclictest1873819-21ssh23:21:171
175703899309,13cyclictest171rcu_preempt20:36:170
175703899303,6cyclictest14-21ksoftirqd/022:31:290
1757038993024,3cyclictest191rcuc/020:45:020
1757038993017,2cyclictest171rcu_preempt19:46:120
1757038993011,10cyclictest171rcu_preempt19:36:050
175704099293,20cyclictest421-21dbus-daemon00:36:062
1757040992922,4cyclictest1793048-21diskmemload22:40:222
1757040992920,6cyclictest0-21swapper/200:26:102
1757040992920,6cyclictest0-21swapper/200:26:102
1757040992920,5cyclictest0-21swapper/221:35:022
1757039992922,4cyclictest1766029-21cron19:40:011
1757039992920,6cyclictest0-21swapper/119:30:011
1757039992918,8cyclictest750-21ntpd00:16:161
175703899295,10cyclictest14-21ksoftirqd/000:01:040
175703899291,8cyclictest14-21ksoftirqd/020:16:180
1757038992918,3cyclictest171rcu_preempt00:11:260
1757038992917,2cyclictest171rcu_preempt21:10:010
1757038992915,7cyclictest171rcu_preempt22:56:200
1757038992913,3cyclictest171rcu_preempt22:36:180
1757040992822,3cyclictest0-21swapper/222:36:312
1757040992821,4cyclictest1789917-21unixbench_multi20:56:292
1757040992820,5cyclictest1790798-21missed_timers21:01:122
1757040992818,6cyclictest1787056-21systemd-run20:50:012
1757040992817,9cyclictest1781041-21cron20:30:002
1757039992821,3cyclictest0-21swapper/122:40:081
1757039992820,5cyclictest487-21rs:main1
1757039992819,6cyclictest1889576-21unixbench_multi23:46:261
175703899287,6cyclictest14-21ksoftirqd/019:56:160
175703899286,9cyclictest0-21swapper/020:31:140
175703899284,10cyclictest14-21ksoftirqd/019:41:120
1757038992817,8cyclictest0-21swapper/021:36:080
1757038992815,3cyclictest171rcu_preempt20:21:200
1757038992815,3cyclictest171rcu_preempt20:21:200
1757038992813,3cyclictest171rcu_preempt20:26:070
1757040992720,4cyclictest1773561-21basename20:05:012
1757040992719,5cyclictest0-21swapper/220:25:002
1757040992719,5cyclictest0-21swapper/220:25:002
1757040992718,6cyclictest47853-21cups-browsed23:32:022
1757039992721,3cyclictest0-21swapper/120:15:011
1757039992719,5cyclictest1772079-21systemd-run20:00:011
1757040992618,5cyclictest265-21systemd-journal21:10:012
1757039992620,4cyclictest1757037-21cyclictest20:10:011
1757039992619,5cyclictest1757037-21cyclictest20:51:041
175703899263,4cyclictest151ktimers/019:26:030
1757040992514,8cyclictest750-21ntpd20:11:122
1757039992517,5cyclictest1757078-21latency_hist19:10:021
1757040992416,6cyclictest1757053-21munin-run19:10:022
175703999243,4cyclictest171rcu_preempt20:46:131
1757039992418,4cyclictest1757037-21cyclictest19:41:231
1757038992414,3cyclictest171rcu_preempt19:10:010
1757040992310,10cyclictest351ktimers/220:51:152
1757040992211,8cyclictest1768394-21ntp_kernel_err19:46:122
1757039992214,5cyclictest1790778-21latency21:01:111
175704199202,9cyclictest0-21swapper/323:01:143
175704199194,7cyclictest0-21swapper/300:01:233
175704199193,10cyclictest0-21swapper/321:21:193
175704199193,10cyclictest0-21swapper/321:21:193
175704199184,7cyclictest0-21swapper/300:21:143
175704199183,9cyclictest0-21swapper/323:41:073
175704199183,7cyclictest0-21swapper/322:36:203
175704199182,8cyclictest0-21swapper/300:36:203
175704199182,8cyclictest0-21swapper/300:16:163
175704199182,8cyclictest0-21swapper/300:11:273
175704199182,7cyclictest0-21swapper/319:21:203
175704199175,6cyclictest0-21swapper/321:31:103
175704199175,6cyclictest0-21swapper/321:11:203
175704199174,7cyclictest0-21swapper/323:11:163
175704199172,9cyclictest0-21swapper/323:46:153
175704199172,9cyclictest0-21swapper/322:56:153
175704199172,6cyclictest0-21swapper/321:01:193
175704199163,7cyclictest0-21swapper/323:06:143
175704199163,7cyclictest0-21swapper/323:06:143
175704199162,9cyclictest0-21swapper/323:21:173
175704199162,9cyclictest0-21swapper/322:16:133
175704199162,9cyclictest0-21swapper/322:10:023
175704199162,8cyclictest0-21swapper/323:26:173
175704199162,8cyclictest0-21swapper/321:41:143
175704199162,8cyclictest0-21swapper/300:31:123
175704199162,8cyclictest0-21swapper/300:31:123
175704199162,8cyclictest0-21swapper/300:06:153
175704199162,7cyclictest0-21swapper/323:35:303
175704199161,7cyclictest0-21swapper/321:16:173
175704199161,7cyclictest0-21swapper/321:16:173
175704199161,7cyclictest0-21swapper/320:21:183
175704199161,7cyclictest0-21swapper/320:21:183
175704199154,7cyclictest0-21swapper/321:26:113
175704199153,8cyclictest0-21swapper/322:01:143
175704199153,8cyclictest0-21swapper/321:51:123
175704199153,7cyclictest0-21swapper/323:56:113
175704199152,7cyclictest0-21swapper/322:31:203
175704199152,7cyclictest0-21swapper/321:36:143
175704199152,6cyclictest0-21swapper/320:31:143
175704199152,6cyclictest0-21swapper/320:11:153
175704199151,7cyclictest0-21swapper/322:51:103
175704199151,6cyclictest0-21swapper/319:36:123
175704199147,5cyclictest0-21swapper/322:50:013
175704199145,6cyclictest0-21swapper/323:51:173
175704199145,6cyclictest0-21swapper/322:26:103
175704199144,4cyclictest0-21swapper/320:36:123
175704199143,7cyclictest0-21swapper/321:56:233
175704199143,5cyclictest0-21swapper/319:26:173
175704199142,8cyclictest0-21swapper/323:16:143
175704199142,7cyclictest0-21swapper/322:41:143
175704199137,4cyclictest0-21swapper/321:10:013
175704199136,4cyclictest0-21swapper/300:26:163
175704199136,4cyclictest0-21swapper/300:26:163
175704199132,6cyclictest0-21swapper/322:20:313
175704199132,6cyclictest0-21swapper/322:20:313
175704199132,5cyclictest0-21swapper/320:41:133
175704199131,8cyclictest0-21swapper/321:46:043
175704199131,7cyclictest0-21swapper/319:45:013
175704199131,6cyclictest0-21swapper/320:16:193
175704199131,6cyclictest0-21swapper/319:51:133
175704199126,4cyclictest0-21swapper/320:46:123
175704199126,4cyclictest0-21swapper/320:26:063
175704199126,4cyclictest0-21swapper/319:31:063
175704199126,4cyclictest0-21swapper/319:20:013
175704199126,4cyclictest0-21swapper/319:15:013
175704199122,6cyclictest0-21swapper/322:11:153
175704199121,7cyclictest0-21swapper/323:31:073
175704199121,6cyclictest0-21swapper/319:56:153
175704199113,5cyclictest0-21swapper/320:06:163
175704199111,6cyclictest0-21swapper/320:56:243
175704199105,3cyclictest0-21swapper/319:46:243
175704199101,6cyclictest0-21swapper/320:51:073
175704199101,5cyclictest0-21swapper/319:10:013
17570419991,5cyclictest0-21swapper/320:05:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional