You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-27 - 13:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3s.osadl.org (updated Sat Dec 27, 2025 00:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
177457399694,19cyclictest238-21systemd-journal00:05:001
1774573996818,12cyclictest275-21dbus-daemon20:55:011
1774573996818,12cyclictest275-21dbus-daemon20:55:011
1774573996721,41cyclictest1791605-21cron00:40:001
1774582996612,12cyclictest37-21ksoftirqd/321:14:593
177457399666,24cyclictest1790553-21modprobe00:20:001
1774573996622,40cyclictest1785101-21sshd22:33:211
1774578996548,14cyclictest1786385-21sshd22:58:202
1774573996522,37cyclictest238-21systemd-journal00:30:031
1774573996517,10cyclictest1779789-21cat20:50:021
177458299644,7cyclictest37-21ksoftirqd/319:20:003
177457399644,11cyclictest1780173-21cron21:00:001
177457399642,16cyclictest1789261-21munin-run23:55:011
1774573996421,4cyclictest1785649-21latency_hist22:45:001
1774573996416,39cyclictest1779534-21cat20:45:011
1774578996345,13cyclictest1784631-21munin-run22:25:012
1774578996344,15cyclictest1787691-21sshd23:20:202
1774578996344,15cyclictest1776817-21sshd19:53:202
177457399634,9cyclictest1777077-21cron20:00:011
177457399634,9cyclictest1777077-21cron20:00:001
177457399633,18cyclictest1784330-21modprobe22:20:011
177457399633,17cyclictest1784099-21latency_hist22:15:011
177457399633,11cyclictest1775298-21modprobe19:25:001
177457399631,17cyclictest1778253-21cat20:20:021
177456899634,9cyclictest12-21ksoftirqd/021:00:000
1774578996247,8cyclictest30-21ksoftirqd/220:45:022
1774578996244,15cyclictest1782524-21sshd21:42:212
1774578996244,13cyclictest1776098-21munin-run19:40:012
177457399625,10cyclictest1788746-21modprobe23:45:001
177457399623,12cyclictest1787990-21munin-run23:30:001
177457399622,14cyclictest1780600-21latency_hist21:05:011
1774578996145,12cyclictest1789022-21munin-run23:50:012
1774578996145,11cyclictest1774991-21cron19:17:002
1774578996144,11cyclictest1787161-21sshd23:11:482
1774578996143,14cyclictest1778890-21sshd20:34:222
1774578996143,14cyclictest1778890-21sshd20:34:222
1774578996143,13cyclictest1788228-21munin-run23:35:012
1774578996142,15cyclictest1781529-21munin-run21:25:022
177457399618,12cyclictest238-21systemd-journal19:30:031
1774573996144,14cyclictest1773952-21kworker/1:219:10:021
177457399613,18cyclictest1-21systemd22:05:021
177457399613,18cyclictest1-21systemd22:05:011
177457399613,13cyclictest1777618-21munin-plugin-st20:10:001
177457399613,10cyclictest1780700-21cron21:10:001
177457399612,17cyclictest1783308-21systemctl22:00:011
1774573996113,8cyclictest1-21systemd00:25:011
1774573996111,44cyclictest0-21swapper/121:40:001
1774578996045,12cyclictest1790052-21munin-run00:10:012
1774578996045,12cyclictest1778657-21munin-run20:30:002
1774578996045,11cyclictest1791100-21munin-run00:30:022
1774578996045,11cyclictest1787413-21sshd23:16:502
1774578996045,11cyclictest1787413-21sshd23:16:502
1774578996044,12cyclictest1788442-21sshd23:35:222
1774578996044,12cyclictest1788442-21sshd23:35:212
1774578996044,12cyclictest1783049-21munin-run21:55:012
1774578996044,12cyclictest1780157-21sshd20:56:272
1774578996044,12cyclictest1779167-21munin-run20:40:002
1774578996043,12cyclictest1777379-21munin-run20:05:002
1774578996042,13cyclictest1777867-21munin-run20:15:002
1774578996015,13cyclictest1784051-21sshd22:11:412
177457399604,16cyclictest1-21systemd21:25:001
177457399602,20cyclictest1776590-21munin-plugin-st19:50:001
177457399602,20cyclictest1-21systemd19:55:001
1774578995945,11cyclictest1779915-21sshd20:53:222
1774578995945,11cyclictest1779915-21sshd20:53:212
1774578995944,11cyclictest1785917-21munin-run22:50:012
1774578995944,11cyclictest1785917-21munin-run22:50:002
1774578995943,12cyclictest1788771-21munin-run23:45:002
1774578995943,12cyclictest1776349-21munin-run19:45:012
1774578995943,11cyclictest1785415-21munin-run22:40:012
1774573995924,30cyclictest1789494-21sshd23:59:221
1774573995922,34cyclictest1783811-21sshd22:09:211
177456899595,8cyclictest12-21ksoftirqd/023:30:020
1774578995851,4cyclictest1780720-21munin-run21:10:012
1774578995845,10cyclictest364-21snmpd23:01:302
1774578995844,11cyclictest1790852-21munin-run00:25:002
1774578995844,10cyclictest1784884-21munin-run22:30:012
1774578995844,10cyclictest1780465-21munin-run21:05:002
1774578995843,11cyclictest1789242-21sshd23:54:212
1774578995843,11cyclictest1783591-21munin-run22:05:022
1774578995843,11cyclictest1783591-21munin-run22:05:022
1774578995843,11cyclictest1781204-21cron21:16:592
1774578995842,13cyclictest1784307-21cron22:17:012
1774578995842,12cyclictest1786936-21munin-run23:10:002
1774578995841,13cyclictest1782798-21munin-run21:50:012
1774578995839,4cyclictest30-21ksoftirqd/219:10:012
1774578995831,22cyclictest238-21systemd-journal22:55:012
177457399586,10cyclictest1786416-21systemctl23:00:011
177457399585,17cyclictest1776068-21munin-plugin-st19:40:001
177457399583,18cyclictest1776334-21munin-plugin-st19:44:591
177457399582,11cyclictest1783148-21latency_hist21:55:021
1774573995814,11cyclictest275-21dbus-daemon20:05:001
1774578995744,9cyclictest1791360-21munin-run00:35:002
1774578995742,11cyclictest1775819-21munin-run19:35:002
177457399575,16cyclictest1787446-21modprobe23:20:011
177457399575,16cyclictest1787446-21modprobe23:20:001
177457399573,16cyclictest1778931-21grep20:35:021
177457399573,16cyclictest1778931-21grep20:35:011
177457399573,13cyclictest238-21systemd-journal22:40:011
177457399573,13cyclictest1775030-21munin-plugin-st19:20:011
177457399572,18cyclictest1788463-21cron23:40:011
177457399572,18cyclictest1788463-21cron23:40:001
177457399572,13cyclictest1786938-21munin-plugin-st23:10:001
1774573995719,9cyclictest275-21dbus-daemon00:10:021
1774573995711,5cyclictest0-21swapper/121:50:011
1774578995642,11cyclictest1777068-21sshd19:58:222
1774578995642,11cyclictest1777068-21sshd19:58:212
1774578995642,11cyclictest1775536-21sshd19:28:212
1774578995641,12cyclictest364-21snmpd21:11:092
1774578995641,11cyclictest364-21snmpd22:31:242
1774578995635,17cyclictest1790520-21sshd00:16:212
177457399565,13cyclictest1781236-21modprobe21:19:591
177457399563,9cyclictest1779154-21modprobe20:40:001
177457399563,18cyclictest1787730-21munin-plugin-st23:25:001
1774578995546,5cyclictest1791645-21munin-run00:40:012
1774578995541,11cyclictest364-21snmpd21:36:152
1774578995541,11cyclictest364-21snmpd20:05:582
1774578995541,11cyclictest364-21snmpd00:01:202
1774578995541,11cyclictest1776588-21munin-run19:50:002
1774578995541,10cyclictest364-21snmpd20:15:102
177457399555,13cyclictest0-21swapper/122:29:591
1774573995523,29cyclictest23-21ksoftirqd/122:25:011
177457399552,18cyclictest1782018-21munin-plugin-st21:34:591
177457399552,17cyclictest1778669-21systemd-run20:30:011
177457399552,15cyclictest1786256-21latency_hist22:55:021
1774582995435,15cyclictest1-21systemd21:05:013
1774582995410,6cyclictest131rcu_preempt21:25:003
1774578995447,4cyclictest1781741-21sshd21:26:322
1774578995444,6cyclictest1775318-21munin-run19:25:012
1774578995442,9cyclictest1790278-21sshd00:13:222
1774578995442,9cyclictest1790278-21sshd00:13:212
1774578995441,10cyclictest364-21snmpd23:56:182
1774578995428,22cyclictest1785748-21latency_hist22:45:022
177457399545,15cyclictest238-21systemd-journal20:25:001
177457399542,16cyclictest1782647-21latency_hist21:45:021
177458299537,5cyclictest131rcu_preempt23:40:013
177458299537,5cyclictest131rcu_preempt23:40:003
1774582995334,15cyclictest238-21systemd-journal23:00:013
177458299531,11cyclictest37-21ksoftirqd/320:40:003
1774578995345,4cyclictest1783796-21sshd22:06:212
1774578995338,11cyclictest364-21snmpd20:23:382
1774573995312,11cyclictest0-21swapper/119:30:001
177458299526,11cyclictest37-21ksoftirqd/320:25:013
177458299525,7cyclictest131rcu_preempt20:10:003
1774578995240,9cyclictest364-21snmpd21:31:332
1774578995233,14cyclictest238-21systemd-journal21:58:202
1774573995228,17cyclictest238-21systemd-journal00:15:011
1774573995228,17cyclictest238-21systemd-journal00:15:001
177456899527,5cyclictest131rcu_preempt21:25:000
1774568995210,10cyclictest12-21ksoftirqd/019:40:010
177458299514,11cyclictest37-21ksoftirqd/322:00:013
177458299512,10cyclictest37-21ksoftirqd/322:40:013
177458299511,10cyclictest37-21ksoftirqd/321:40:003
1774578995138,9cyclictest364-21snmpd20:45:182
1774578995136,11cyclictest1787942-21modprobe23:25:022
177457399513,17cyclictest1-21systemd23:35:011
177456899515,8cyclictest12-21ksoftirqd/000:39:590
177456899513,11cyclictest12-21ksoftirqd/023:41:380
177456899512,44cyclictest1778133-21run-parts20:20:010
177458299506,6cyclictest131rcu_preempt22:15:013
1774582995010,7cyclictest131rcu_preempt23:25:003
177457399502,17cyclictest1774763-21latency_hist19:14:591
1774573995016,9cyclictest23-21ksoftirqd/120:15:011
1774568995017,6cyclictest131rcu_preempt23:05:030
1774582994940,6cyclictest37-21ksoftirqd/320:50:003
1774582994928,15cyclictest1-21systemd22:25:013
1774578994936,10cyclictest364-21snmpd19:10:482
1774568994942,4cyclictest16950irq/224-800000023:40:010
1774568994942,4cyclictest16950irq/224-800000023:40:000
1774568994942,4cyclictest16950irq/224-800000000:00:010
177456899493,8cyclictest12-21ksoftirqd/021:20:010
177458299488,6cyclictest131rcu_preempt00:00:013
1774573994829,14cyclictest1-21systemd22:50:011
1774573994829,14cyclictest1-21systemd22:50:001
1774573994827,12cyclictest1-21systemd23:05:011
1774573994822,23cyclictest23-21ksoftirqd/123:50:011
177456899487,7cyclictest12-21ksoftirqd/022:00:020
177456899483,7cyclictest1785122-21munin-plugin-st22:35:000
1774568994810,8cyclictest12-21ksoftirqd/022:11:210
1774582994731,11cyclictest1-21systemd23:50:013
1774582994710,6cyclictest131rcu_preempt22:20:003
1774582994710,6cyclictest131rcu_preempt19:40:013
177457399475,9cyclictest238-21systemd-journal21:30:011
177456899479,8cyclictest12-21ksoftirqd/021:10:000
177456899478,13cyclictest12-21ksoftirqd/020:25:000
177456899477,10cyclictest12-21ksoftirqd/000:05:010
177456899476,7cyclictest12-21ksoftirqd/020:00:010
177456899476,7cyclictest12-21ksoftirqd/020:00:010
177456899474,10cyclictest12-21ksoftirqd/020:45:020
1774568994720,23cyclictest151rcuc/019:54:220
1774568994717,5cyclictest131rcu_preempt21:30:010
177456899471,12cyclictest1788998-21modprobe23:50:000
1774568994710,12cyclictest12-21ksoftirqd/022:05:020
1774568994710,12cyclictest12-21ksoftirqd/022:05:010
177458299461,6cyclictest1-21systemd21:20:003
177458299461,4cyclictest131rcu_preempt00:35:403
177456899467,9cyclictest12-21ksoftirqd/021:45:000
177456899466,35cyclictest12-21ksoftirqd/021:40:000
177456899465,10cyclictest12-21ksoftirqd/019:30:010
177456899464,31cyclictest1787706-21kworker/u8:323:30:010
1774568994629,13cyclictest1779912-21sshd20:52:220
1774568994629,13cyclictest1779912-21sshd20:52:210
1774568994627,15cyclictest1775778-21sshd19:31:210
177456899462,6cyclictest12-21ksoftirqd/023:15:010
1774582994533,10cyclictest37-21ksoftirqd/321:35:013
177458299452,5cyclictest131rcu_preempt23:10:003
177456899456,8cyclictest12-21ksoftirqd/019:25:020
177456899455,11cyclictest12-21ksoftirqd/020:05:020
177456899453,8cyclictest12-21ksoftirqd/000:35:010
1774568994535,7cyclictest12-21ksoftirqd/019:15:020
177456899451,5cyclictest0-21swapper/022:40:010
1774568994513,14cyclictest12-21ksoftirqd/022:25:030
177456899451,12cyclictest12-21ksoftirqd/021:35:000
177456899451,10cyclictest12-21ksoftirqd/000:30:020
177458299447,6cyclictest131rcu_preempt00:35:023
1774582994433,9cyclictest37-21ksoftirqd/319:55:013
1774582994411,9cyclictest37-21ksoftirqd/323:55:003
177457399444,11cyclictest238-21systemd-journal23:15:001
177456899445,10cyclictest311-21rs:main0
1774568994435,5cyclictest16950irq/224-800000020:10:000
177456899442,36cyclictest311-21rs:main0
177456899441,37cyclictest1787731-21cut23:25:000
177458299433,5cyclictest131rcu_preempt23:05:033
177458299433,5cyclictest131rcu_preempt19:50:003
1774582994326,12cyclictest238-21systemd-journal21:10:003
1774582994311,5cyclictest131rcu_preempt20:00:023
1774582994311,5cyclictest131rcu_preempt20:00:023
177456899436,9cyclictest12-21ksoftirqd/000:10:000
177456899436,12cyclictest12-21ksoftirqd/022:10:020
177456899431,9cyclictest1784325-21cron22:20:000
177458299427,11cyclictest37-21ksoftirqd/300:23:223
177458299425,5cyclictest131rcu_preempt00:15:013
177458299425,5cyclictest131rcu_preempt00:15:013
177458299423,6cyclictest131rcu_preempt20:55:023
177458299423,6cyclictest131rcu_preempt20:55:013
1774582994235,5cyclictest37-21ksoftirqd/320:05:013
1774582994231,8cyclictest1775272-21sshd19:21:163
1774582994211,6cyclictest131rcu_preempt19:30:013
177456899423,12cyclictest12-21ksoftirqd/021:15:000
177456899423,11cyclictest12-21ksoftirqd/023:55:000
1774568994228,8cyclictest1786418-21modprobe23:00:010
177456899422,35cyclictest1790568-21munin-run00:19:590
177456899421,9cyclictest1779346-21sed20:40:020
177458299416,6cyclictest131rcu_preempt22:55:013
177458299415,5cyclictest131rcu_preempt20:20:013
177456899413,7cyclictest12-21ksoftirqd/019:13:210
177456899412,7cyclictest12-21ksoftirqd/022:45:000
1774568994127,11cyclictest1784854-21sshd22:29:220
1774568994123,13cyclictest238-21systemd-journal23:20:010
1774568994123,13cyclictest238-21systemd-journal23:20:000
177458299405,8cyclictest37-21ksoftirqd/321:00:003
1774582994024,13cyclictest309-21in:imuxsock21:40:033
177458299402,32cyclictest1775794-21cron19:35:003
1774582994020,14cyclictest275-21dbus-daemon20:35:013
1774582994020,14cyclictest275-21dbus-daemon20:35:003
1774582994016,10cyclictest131rcu_preempt23:30:023
177456899408,9cyclictest12-21ksoftirqd/000:20:150
177456899407,5cyclictest131rcu_preempt19:50:000
177456899407,5cyclictest131rcu_preempt19:45:000
177458299398,7cyclictest131rcu_preempt23:20:013
177458299398,7cyclictest131rcu_preempt23:20:003
177458299395,5cyclictest131rcu_preempt21:46:363
177458299395,10cyclictest37-21ksoftirqd/322:01:213
177458299395,10cyclictest37-21ksoftirqd/322:01:203
1774582993931,6cyclictest37-21ksoftirqd/323:45:023
1774582993931,6cyclictest37-21ksoftirqd/300:27:203
1774582993929,7cyclictest37-21ksoftirqd/322:10:013
1774582993926,11cyclictest37-21ksoftirqd/321:55:013
177456899396,7cyclictest12-21ksoftirqd/020:30:010
177456899393,26cyclictest1774571-21grep19:10:020
177456899392,33cyclictest364-21snmpd20:31:030
177456899392,33cyclictest364-21snmpd20:31:020
1774568993922,13cyclictest275-21dbus-daemon22:50:010
1774568993922,13cyclictest275-21dbus-daemon22:50:000
1774582993829,5cyclictest1785144-21latency_hist22:35:013
1774582993828,6cyclictest1787175-21cron23:15:003
1774582993813,6cyclictest361rcuc/321:30:013
1774568993811,5cyclictest131rcu_preempt21:55:000
177458299374,6cyclictest131rcu_preempt22:50:023
177458299374,6cyclictest131rcu_preempt22:50:023
1774582993727,7cyclictest37-21ksoftirqd/323:35:023
1774582993726,9cyclictest37-21ksoftirqd/319:45:003
1774582993711,7cyclictest37-21ksoftirqd/322:45:013
177456899372,5cyclictest1779672-21cron20:50:000
177456899372,31cyclictest1780470-21systemd-run21:05:010
177458299361,5cyclictest131rcu_preempt22:30:013
1774582993611,20cyclictest361rcuc/300:20:013
1774582993610,16cyclictest361rcuc/319:11:143
177456899364,4cyclictest131rcu_preempt21:46:360
177456899361,31cyclictest0-21swapper/000:13:220
177456899361,31cyclictest0-21swapper/000:13:220
177458299356,6cyclictest131rcu_preempt20:15:013
177458299354,5cyclictest131rcu_preempt00:10:003
177456899352,8cyclictest12-21ksoftirqd/022:51:210
177458299347,6cyclictest131rcu_preempt20:30:013
1774582993425,6cyclictest361rcuc/300:05:013
1774573993427,4cyclictest1780946-21sshd21:11:211
1774573993422,8cyclictest1791053-21sshd00:25:201
177458299339,7cyclictest131rcu_preempt20:45:023
1774582992821,4cyclictest1774509-21latency_hist19:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional