You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-02 - 10:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack2slot7s.osadl.org (updated Wed Sep 02, 2026 00:42:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
151670399602,36cyclictest1630432-21ssh23:16:071
1516703995243,5cyclictest1548196-21systemd-run20:55:011
1516703995130,5cyclictest171rcu_preempt00:26:071
1516703994637,6cyclictest0-21swapper/119:40:011
1516702994640,4cyclictest1542295-21latency_hist20:35:020
1516704994538,3cyclictest0-21swapper/221:21:112
1516704994536,6cyclictest3847961-21cups-browsed22:26:102
1516702994535,8cyclictest1553820-21needreboot21:11:050
1516704994438,3cyclictest0-21swapper/200:21:102
1516703994329,11cyclictest1627838-21timerwakeupswit23:11:171
1516702994335,5cyclictest420-21avahi-daemon22:23:140
1516704994235,3cyclictest0-21swapper/223:41:062
1516704994235,3cyclictest0-21swapper/200:01:182
1516703994231,8cyclictest3847961-21cups-browsed19:16:001
151670299422,31cyclictest1676194-21modprobe00:31:040
1516704994130,7cyclictest420-21avahi-daemon21:51:292
1516703994133,4cyclictest0-21swapper/122:00:001
1516703994132,6cyclictest1590389-21if_wlan022:11:011
1516702994134,4cyclictest1574181-21grep21:45:000
151670299412,29cyclictest1645727-21ssh23:41:070
1516704994033,4cyclictest0-21swapper/223:35:012
1516704994032,4cyclictest1591748-21kworker/u8:3-xprtiod22:15:012
1516703994032,4cyclictest0-21swapper/121:16:061
1516703994031,5cyclictest1530201-21systemd-run19:55:011
1516703994030,8cyclictest421-21dbus-daemon22:30:021
1516702994033,4cyclictest0-21swapper/023:11:080
1516704993932,4cyclictest1656766-21kthreadd00:00:022
1516703993931,5cyclictest694-21cron00:00:011
1516703993931,5cyclictest1568151-21latency_hist21:35:021
1516703993931,5cyclictest1568151-21latency_hist21:35:021
1516703993928,8cyclictest1679109-21latency00:36:011
1516702993932,5cyclictest1636815-21sendmail_mailtr23:26:190
1516702993931,5cyclictest1609252-21mailstats22:41:120
1516702993927,9cyclictest3847961-21cups-browsed21:56:260
1516702993926,10cyclictest0-21swapper/022:16:190
1516704993832,3cyclictest0-21swapper/222:41:062
1516704993832,3cyclictest0-21swapper/219:26:052
151670499382,26cyclictest665-21snmpd21:31:272
151670499382,26cyclictest665-21snmpd21:31:272
1516703993830,5cyclictest1002-21mta-sts-daemon21:23:271
1516702993833,3cyclictest1653748-21kworker/u8:12-xprtiod00:00:010
1516704993728,5cyclictest1000-21mta-sts-daemon20:21:052
1516703993730,4cyclictest1002-21mta-sts-daemon00:16:091
1516703993729,5cyclictest1542199-21systemd-run20:35:011
1516703993726,8cyclictest1563723-21unixbench_singl21:26:171
1516703993712,18cyclictest420-21avahi-daemon23:51:061
1516704993630,3cyclictest0-21swapper/220:06:042
1516704993627,5cyclictest1624878-21unixbench_multi23:06:172
1516703993630,3cyclictest0-21swapper/123:10:011
1516703993629,4cyclictest1659773-21grep00:05:001
1516703993629,4cyclictest1540693-21munin-plugin-st20:30:001
1516703993629,4cyclictest1540693-21munin-plugin-st20:30:001
1516703993628,5cyclictest1527719-21fschecks_time19:46:011
1516703993622,7cyclictest1642599-21sh23:36:041
1516702993631,3cyclictest1516701-21cyclictest19:20:020
1516702993630,4cyclictest1565045-21latency_hist21:30:020
1516702993629,5cyclictest1-21systemd22:30:020
1516702993627,7cyclictest1545189-21munin-plugin-st20:45:020
1516702993627,6cyclictest1652195-21timerandwakeup23:51:160
1516702993616,5cyclictest12650irq/32-eth020:11:050
1516704993528,5cyclictest0-21swapper/221:40:002
1516704993528,5cyclictest0-21swapper/221:40:002
1516704993527,5cyclictest1542114-21unixbench_singl20:31:222
1516703993527,5cyclictest1569871-21unixbench_multi21:36:271
1516703993527,5cyclictest1569871-21unixbench_multi21:36:271
1516703993527,4cyclictest1002-21mta-sts-daemon19:31:061
1516703993521,10cyclictest0-21swapper/100:21:071
151670299353,22cyclictest1667124-21ssh00:16:080
1516702993528,5cyclictest1633269-21ssh23:21:010
1516702993528,3cyclictest0-21swapper/022:01:120
1516702993525,7cyclictest0-21swapper/022:11:040
1516702993524,7cyclictest12650irq/32-eth022:56:040
1516702993524,7cyclictest12650irq/32-eth022:56:040
1516702993516,12cyclictest12650irq/32-eth023:36:050
151670499343,6cyclictest171rcu_preempt23:11:082
1516704993429,2cyclictest0-21swapper/200:15:002
1516704993428,3cyclictest0-21swapper/223:36:042
1516704993428,3cyclictest0-21swapper/222:00:002
1516704993428,2cyclictest0-21swapper/223:51:042
1516704993427,5cyclictest1614000-21latency_hist22:50:022
1516704993427,5cyclictest0-21swapper/221:10:562
1516704993426,5cyclictest1668973-21systemd-run00:20:012
1516704993426,5cyclictest1616986-21systemd-run22:55:012
1516704993426,5cyclictest1604745-21munin-run22:35:012
1516703993428,3cyclictest0-21swapper/123:00:571
1516703993426,5cyclictest1000-21mta-sts-daemon22:24:411
151670399342,26cyclictest1615106-21rm22:51:041
1516702993428,4cyclictest1521071-21tail19:21:190
1516702993426,5cyclictest1574823-21aten_r2power_po21:45:570
1516702993421,9cyclictest567-21gdbus21:31:070
1516702993421,9cyclictest567-21gdbus21:31:070
151670299341,24cyclictest1550542-21sshd21:01:050
151670499337,6cyclictest171rcu_preempt23:26:102
1516704993328,2cyclictest0-21swapper/219:20:012
1516704993327,3cyclictest0-21swapper/200:30:022
1516704993326,4cyclictest1556593-21sort21:16:032
1516704993325,3cyclictest0-21swapper/200:31:042
1516704993324,6cyclictest421-21dbus-daemon20:40:022
1516704993324,6cyclictest1596141-21head22:20:552
1516704993322,8cyclictest1650598-21idleruntime-cro23:50:012
1516704993320,10cyclictest0-21swapper/222:16:082
151670399337,18cyclictest1001-21mta-sts-daemon21:11:061
1516703993324,7cyclictest1575328-21needreboot21:46:051
1516702993324,6cyclictest1678586-21/usr/sbin/munin00:35:590
1516702993318,3cyclictest0-21swapper/020:16:020
1516702993310,15cyclictest421-21dbus-daemon19:15:020
1516704993226,3cyclictest0-21swapper/220:20:012
1516704993225,4cyclictest0-21swapper/223:25:012
1516704993224,4cyclictest0-21swapper/223:16:272
151670499321,11cyclictest171rcu_preempt21:41:072
1516703993227,2cyclictest0-21swapper/122:46:001
1516703993225,4cyclictest1645723-21ntp_kernel_pll_23:41:061
1516703993225,4cyclictest1572179-21missed_timers21:41:011
1516703993224,5cyclictest1580416-21latency_hist21:55:021
1516703993224,5cyclictest0-21swapper/122:35:011
1516703993223,6cyclictest1588179-21unixbench_multi22:06:171
1516703993223,6cyclictest1003-21mta-sts-daemon22:37:201
151670299323,23cyclictest1658036-21ssh00:01:170
1516702993227,3cyclictest1000-21mta-sts-daemon21:25:030
1516702993226,4cyclictest1664300-21mailstats00:11:150
1516702993226,4cyclictest1603495-21grep22:31:190
1516702993224,5cyclictest1656768-21cups-browsed00:26:400
1516702993224,3cyclictest0-21swapper/023:31:080
1516702993223,6cyclictest1615643-21timerwakeupswit22:51:250
1516702993219,11cyclictest0-21swapper/023:20:020
1516704993126,2cyclictest0-21swapper/221:46:062
1516704993125,3cyclictest0-21swapper/221:10:022
1516704993124,3cyclictest0-21swapper/221:26:122
1516704993122,6cyclictest421-21dbus-daemon22:05:372
151670499312,24cyclictest1606048-21sh22:36:092
151670399314,21cyclictest443-21gpm20:56:091
1516703993125,3cyclictest0-21swapper/119:25:011
1516703993124,4cyclictest1638362-21basename23:30:011
1516703993124,4cyclictest1001-21mta-sts-daemon23:20:571
1516703993122,6cyclictest1533210-21systemd-run20:05:011
151670399312,19cyclictest1618164-21ssh22:56:041
151670399312,19cyclictest1618164-21ssh22:56:041
1516703993121,7cyclictest1639398-21latency23:31:021
1516703993116,11cyclictest1593680-21awk22:16:051
1516702993125,3cyclictest0-21swapper/021:50:570
1516702993124,5cyclictest0-21swapper/020:10:020
1516702993120,8cyclictest421-21dbus-daemon00:22:160
1516702993120,8cyclictest0-21swapper/019:26:160
1516704993024,3cyclictest0-21swapper/220:05:012
1516704993023,4cyclictest1530060-21unixbench_multi19:51:172
1516704993022,5cyclictest3847961-21cups-browsed19:42:462
1516704993020,7cyclictest1520548-21ntp_kernel_err19:21:072
1516704993018,9cyclictest1550595-21ntp_kernel_pll_21:01:082
151670499301,23cyclictest1584583-21ssh22:01:062
151670399303,22cyclictest1526562-21sshd19:41:041
1516703993023,4cyclictest1000-21mta-sts-daemon22:41:301
1516703993022,4cyclictest0-21swapper/120:20:011
1516703993019,6cyclictest1666001-21latency_hist00:15:021
1516702993024,4cyclictest1612275-21proc_pri22:46:150
1516702993024,4cyclictest1512831-21kworker/u8:18-nfsiod21:00:010
1516702993024,3cyclictest0-21swapper/023:05:590
1516702993022,6cyclictest1540040-21ntp_kernel_err20:26:050
1516702993022,6cyclictest1540040-21ntp_kernel_err20:26:050
1516702993020,8cyclictest1556824-21missed_timers21:16:070
1516702993017,9cyclictest12650irq/32-eth022:06:080
1516702993016,3cyclictest0-21swapper/021:06:010
151670299301,4cyclictest171rcu_preempt22:36:090
1516704992923,3cyclictest0-21swapper/200:05:042
1516704992921,5cyclictest1540221-21proc_pri20:26:162
1516704992921,5cyclictest1540221-21proc_pri20:26:162
151670499291,25cyclictest1679349-21ssh00:36:112
151670499290,24cyclictest1618141-21ssh22:56:032
151670499290,24cyclictest1618141-21ssh22:56:032
1516703992922,4cyclictest1000-21mta-sts-daemon23:48:551
151670299293,12cyclictest1552685-21diskmemload00:09:330
1516702992923,3cyclictest1002-21mta-sts-daemon19:41:130
1516702992920,4cyclictest3847961-21cups-browsed21:36:160
1516702992920,4cyclictest3847961-21cups-browsed21:36:160
1516704992822,3cyclictest0-21swapper/219:40:012
1516704992820,5cyclictest1544227-21fschecks_time20:40:592
151670399283,18cyclictest1538561-21sshd20:21:051
1516703992822,3cyclictest0-21swapper/122:01:081
1516703992822,3cyclictest0-21swapper/100:10:011
1516703992821,4cyclictest1001-21mta-sts-daemon19:56:081
1516703992820,4cyclictest1552603-21head21:06:311
1516703992818,3cyclictest0-21swapper/100:33:371
1516703992813,8cyclictest1001-21mta-sts-daemon21:01:091
1516702992822,4cyclictest1525625-21unixbench_singl19:36:160
1516704992719,5cyclictest1530691-21fschecks_count19:56:012
1516704992718,6cyclictest485-21in:imuxsock23:05:002
1516704992718,6cyclictest1516713-21systemd-run19:10:022
151670399278,12cyclictest428-21mta-sts-daemon20:41:081
1516703992720,4cyclictest1543548-21unixbench_multi20:36:151
151670299272,19cyclictest1621275-21ssh23:01:040
1516702992718,7cyclictest1547548-21ntp_kernel_pll_20:51:040
1516702992717,7cyclictest0-21swapper/020:05:020
1516704992619,3cyclictest0-21swapper/219:46:142
1516704992617,7cyclictest1547202-21fschecks_time20:50:582
1516703992618,5cyclictest3847961-21cups-browsed20:05:421
1516702992619,5cyclictest1512673-21kworker/u8:11-xprtiod19:56:000
1516702992618,6cyclictest1543712-21systemd-run20:40:020
1516702992613,10cyclictest0-21swapper/019:31:170
1516704992518,4cyclictest1549196-21proc_pri20:56:152
1516704992518,4cyclictest1546626-21unixbench_singl20:46:182
1516702992520,3cyclictest0-21swapper/019:46:140
1516702992518,5cyclictest1644512-21kworker/u8:13-xprtiod23:45:280
1516702992516,6cyclictest1530175-21cron19:55:010
1516702992515,3cyclictest1546635-21unixbench_singl20:46:180
1516704992419,2cyclictest0-21swapper/219:35:012
1516704992417,4cyclictest0-21swapper/220:15:012
151670399245,10cyclictest1002-21mta-sts-daemon20:46:081
1516703992417,4cyclictest1522271-21sendmail_mailst19:26:131
1516702992418,4cyclictest1539187-21cron20:25:000
151670599233,11cyclictest0-21swapper/300:06:053
1516704992317,3cyclictest0-21swapper/219:11:092
151670599222,11cyclictest0-21swapper/322:16:093
151670599213,12cyclictest0-21swapper/300:36:043
151670599212,11cyclictest0-21swapper/321:36:083
151670599212,11cyclictest0-21swapper/321:36:083
151670399212,14cyclictest1535550-21ntpq20:11:061
1516703992110,7cyclictest421-21dbus-daemon19:10:011
151670299212,16cyclictest1516723-21latency_hist19:10:020
151670599205,7cyclictest0-21swapper/322:06:083
151670599204,8cyclictest0-21swapper/323:51:053
151670599203,7cyclictest0-21swapper/320:56:123
151670599203,11cyclictest0-21swapper/321:56:083
151670599203,10cyclictest0-21swapper/323:56:083
151670599202,11cyclictest0-21swapper/323:31:123
151670599202,11cyclictest0-21swapper/321:26:123
151670599202,10cyclictest0-21swapper/322:01:063
151670599202,10cyclictest0-21swapper/300:16:083
151670599201,11cyclictest0-21swapper/321:21:133
151670599201,10cyclictest0-21swapper/323:41:063
151670599194,8cyclictest0-21swapper/323:11:073
151670599194,8cyclictest0-21swapper/322:46:083
151670599193,8cyclictest0-21swapper/321:10:553
151670599192,9cyclictest0-21swapper/321:51:043
151670599192,12cyclictest0-21swapper/322:26:103
151670399196,2cyclictest171rcu_preempt19:11:021
151670599185,8cyclictest0-21swapper/323:36:063
151670599184,9cyclictest0-21swapper/323:06:043
151670599184,8cyclictest0-21swapper/322:36:043
151670599183,9cyclictest0-21swapper/322:11:083
151670599183,6cyclictest0-21swapper/320:01:063
151670599183,10cyclictest0-21swapper/321:31:053
151670599183,10cyclictest0-21swapper/321:31:053
151670599182,11cyclictest0-21swapper/323:46:043
151670599182,11cyclictest0-21swapper/300:31:063
151670599182,10cyclictest0-21swapper/300:01:103
151670599174,8cyclictest0-21swapper/300:25:593
151670599174,6cyclictest0-21swapper/320:26:103
151670599174,6cyclictest0-21swapper/320:26:103
151670599173,9cyclictest0-21swapper/321:01:053
151670599173,10cyclictest0-21swapper/321:46:093
151670599172,9cyclictest0-21swapper/323:21:043
151670599172,9cyclictest0-21swapper/323:00:583
151670599172,9cyclictest0-21swapper/319:46:143
151670599172,10cyclictest0-21swapper/300:21:043
151670599164,8cyclictest0-21swapper/322:31:063
151670599163,8cyclictest0-21swapper/319:26:043
151670599163,7cyclictest0-21swapper/320:06:043
151670599162,9cyclictest0-21swapper/322:59:343
151670599162,9cyclictest0-21swapper/322:59:343
151670599162,9cyclictest0-21swapper/319:56:103
151670599162,8cyclictest0-21swapper/321:16:053
151670599162,8cyclictest0-21swapper/320:36:043
151670599162,8cyclictest0-21swapper/319:31:073
151670599162,11cyclictest0-21swapper/322:41:043
151670599162,10cyclictest0-21swapper/323:26:133
151670599162,10cyclictest0-21swapper/320:41:113
151670599161,9cyclictest0-21swapper/320:21:103
151670599161,9cyclictest0-21swapper/319:15:043
151670599161,7cyclictest0-21swapper/320:11:053
151670599154,6cyclictest0-21swapper/319:41:033
151670599153,7cyclictest0-21swapper/319:21:143
151670599153,7cyclictest0-21swapper/300:11:053
151670599152,8cyclictest0-21swapper/323:16:053
151670599152,8cyclictest0-21swapper/320:31:093
151670599152,7cyclictest0-21swapper/322:51:203
151670599152,6cyclictest0-21swapper/321:06:033
151670599151,8cyclictest0-21swapper/320:46:073
151670599151,8cyclictest0-21swapper/320:16:043
151670599143,7cyclictest0-21swapper/321:41:043
151670599142,8cyclictest0-21swapper/319:36:063
151670599142,8cyclictest0-21swapper/319:11:083
151670599141,8cyclictest0-21swapper/319:51:043
151670599132,7cyclictest0-21swapper/320:51:033
151670599131,8cyclictest0-21swapper/322:20:583
15167059992,5cyclictest0-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional