You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 09:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot3s.osadl.org (updated Thu Dec 25, 2025 00:45:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1526834998884,2cyclictest0-21swapper/000:25:010
152683899852,3cyclictest131rcu_preempt00:05:021
152683899852,3cyclictest131rcu_preempt00:05:021
1526843998270,10cyclictest30-21ksoftirqd/221:15:022
1526843997727,14cyclictest1532674-21latency_hist21:00:012
1526834997571,2cyclictest0-21swapper/000:10:010
1526843997427,12cyclictest1-21systemd23:15:002
1526843997425,16cyclictest1527294-21munin-run19:20:002
1526843996923,17cyclictest1541230-21cat23:45:022
1526843996730,11cyclictest1536900-21munin-run22:25:012
1526843996416,14cyclictest1-21systemd20:25:012
1526843996247,11cyclictest1526993-21sshd19:11:212
1526843996241,17cyclictest1538420-21cron22:55:012
1526843996241,16cyclictest1536371-21munin-run22:15:002
1526843996147,10cyclictest1530106-21sshd20:12:202
1526843996135,21cyclictest1535553-21modprobe21:57:202
1526843996046,11cyclictest1535076-21munin-run21:50:002
1526843996046,10cyclictest1529642-21munin-run20:05:012
1526843996046,10cyclictest1529642-21munin-run20:05:012
1526843996043,14cyclictest364-21snmpd22:15:492
1526843996040,14cyclictest1-21systemd21:30:022
1526843996040,14cyclictest1-21systemd21:30:012
1526834996010,12cyclictest12-21ksoftirqd/020:20:000
1526843995944,11cyclictest1536109-21munin-run22:10:002
1526843995942,14cyclictest364-21snmpd21:05:352
1526843995845,10cyclictest1535295-21sshd21:51:182
1526843995845,10cyclictest1528825-21sshd19:47:202
1526843995843,11cyclictest1540241-21sshd23:29:192
1526843995842,13cyclictest1538928-21sshd23:00:192
1526843995842,12cyclictest1532736-21munin-run21:05:012
152683899583,6cyclictest131rcu_preempt19:50:031
1526843995744,10cyclictest1540743-21sshd23:39:202
1526843995744,10cyclictest1527831-21munin-run19:30:012
1526843995742,11cyclictest1537659-21munin-run22:40:012
1526834995712,5cyclictest131rcu_preempt21:00:000
1526843995644,9cyclictest364-21snmpd19:35:182
1526843995644,9cyclictest1533493-21sshd21:19:202
1526843995640,11cyclictest364-21snmpd22:25:032
1526843995638,14cyclictest364-21snmpd22:33:392
1526843995637,15cyclictest364-21snmpd21:30:402
1526838995613,25cyclictest23-21ksoftirqd/123:25:021
152683499565,6cyclictest131rcu_preempt22:40:000
1526834995613,14cyclictest12-21ksoftirqd/022:20:010
1526843995543,9cyclictest1533759-21sshd21:21:192
1526843995543,8cyclictest364-21snmpd19:30:172
1526843995540,10cyclictest1534533-21cron21:40:002
1526843995537,14cyclictest364-21snmpd20:41:302
1526843995528,4cyclictest364-21snmpd19:50:202
1526843995441,10cyclictest364-21snmpd20:29:112
1526843995440,10cyclictest364-21snmpd00:01:232
1526843995440,10cyclictest364-21snmpd00:01:222
1526843995439,11cyclictest1530346-21sshd20:15:202
1526843995437,13cyclictest364-21snmpd23:48:142
1526843995437,12cyclictest364-21snmpd22:04:082
1526843995341,9cyclictest364-21snmpd22:42:212
1526843995341,9cyclictest364-21snmpd00:16:262
1526843995340,9cyclictest0-21swapper/200:11:242
1526843995340,10cyclictest364-21snmpd00:36:302
1526843995340,10cyclictest364-21snmpd00:36:292
1526843995339,10cyclictest364-21snmpd23:32:152
1526843995339,10cyclictest364-21snmpd23:32:142
1526843995339,10cyclictest364-21snmpd23:18:412
1526843995334,15cyclictest364-21snmpd23:54:272
1526843995242,7cyclictest1542300-21sshd00:07:192
1526843995239,9cyclictest364-21snmpd19:20:362
1526843995239,10cyclictest364-21snmpd23:56:212
1526843995239,10cyclictest364-21snmpd20:45:322
1526843995238,10cyclictest364-21snmpd22:55:572
1526843995238,10cyclictest364-21snmpd22:55:572
1526843995237,11cyclictest364-21snmpd20:33:082
1526843995229,18cyclictest238-21systemd-journal00:25:192
1526843995225,22cyclictest1526908-21date19:10:022
1526834995244,4cyclictest16950irq/224-800000019:50:020
1526834995234,13cyclictest238-21systemd-journal20:30:000
1526847995133,14cyclictest238-21systemd-journal20:45:003
1526843995143,5cyclictest1528610-21munin-run19:45:022
1526843995139,9cyclictest364-21snmpd20:50:322
1526843995139,9cyclictest364-21snmpd00:21:252
1526843995138,10cyclictest364-21snmpd23:21:252
1526843995133,14cyclictest364-21snmpd19:58:142
1526834995141,7cyclictest12-21ksoftirqd/021:20:000
152683499512,42cyclictest284-21systemd-logind23:35:020
152683499512,42cyclictest284-21systemd-logind23:35:010
1526834995111,5cyclictest1534913-21latency_hist21:45:020
1526843995038,9cyclictest364-21snmpd23:08:342
1526843995037,9cyclictest364-21snmpd21:43:092
1526843995037,9cyclictest364-21snmpd00:30:312
1526847994929,14cyclictest1-21systemd20:05:023
1526847994929,14cyclictest1-21systemd20:05:013
1526847994914,6cyclictest131rcu_preempt00:05:033
1526847994914,6cyclictest131rcu_preempt00:05:023
1526843994937,9cyclictest364-21snmpd20:07:022
1526843994936,9cyclictest364-21snmpd22:45:572
1526843994936,9cyclictest364-21snmpd20:36:272
1526834994942,5cyclictest19350irq/34-mmc100:15:020
1526834994942,4cyclictest16950irq/224-800000022:04:260
1526834994914,6cyclictest131rcu_preempt20:00:000
152683899481,4cyclictest131rcu_preempt00:20:001
1526834994834,11cyclictest12-21ksoftirqd/021:10:010
1526847994733,8cyclictest1532466-21grep21:00:003
1526847994730,12cyclictest1-21systemd20:15:003
1526838994729,12cyclictest275-21dbus-daemon21:30:011
1526838994729,12cyclictest275-21dbus-daemon21:30:011
152683899472,4cyclictest131rcu_preempt23:10:011
152683899471,3cyclictest131rcu_preempt00:00:011
152683499477,6cyclictest131rcu_preempt22:35:030
152683499476,11cyclictest12-21ksoftirqd/020:09:590
1526834994740,4cyclictest16950irq/224-800000023:19:590
152683499473,7cyclictest12-21ksoftirqd/023:39:590
1526834994736,8cyclictest12-21ksoftirqd/021:55:020
1526834994736,8cyclictest12-21ksoftirqd/021:40:020
1526834994732,11cyclictest275-21dbus-daemon21:25:010
152684799466,3cyclictest131rcu_preempt22:07:193
152683899464,3cyclictest131rcu_preempt20:10:001
152683899461,3cyclictest131rcu_preempt22:00:021
152683499463,37cyclictest1527818-21modprobe19:30:000
1526834994626,16cyclictest1527314-21sendmail-msp19:20:000
152683499462,12cyclictest1534188-21latency_hist21:30:030
152683499462,12cyclictest1534188-21latency_hist21:30:020
1526834994613,28cyclictest12-21ksoftirqd/019:40:000
152684799458,6cyclictest131rcu_preempt23:59:593
1526847994523,5cyclictest37-21ksoftirqd/323:55:013
1526838994529,12cyclictest1-21systemd21:50:021
152683899452,3cyclictest131rcu_preempt19:10:031
152683899451,3cyclictest131rcu_preempt19:40:001
1526834994526,13cyclictest275-21dbus-daemon23:30:010
1526834994517,24cyclictest12-21ksoftirqd/000:00:010
152684799444,6cyclictest131rcu_preempt22:15:003
152683899445,3cyclictest131rcu_preempt21:00:001
152683499444,5cyclictest131rcu_preempt19:35:000
1526834994433,5cyclictest1542070-21modprobe00:05:010
1526834994433,5cyclictest1542070-21modprobe00:05:000
1526834994432,6cyclictest309-21in:imuxsock00:15:010
1526834994415,9cyclictest12-21ksoftirqd/021:10:200
1526834994413,5cyclictest131rcu_preempt19:10:020
1526847994335,5cyclictest1540747-21cron23:39:593
1526847994326,12cyclictest309-21in:imuxsock21:30:023
1526847994324,12cyclictest275-21dbus-daemon22:35:013
1526838994329,11cyclictest275-21dbus-daemon20:30:011
152683899431,3cyclictest131rcu_preempt21:05:001
152683899431,3cyclictest131rcu_preempt20:33:191
152683499436,6cyclictest131rcu_preempt19:25:010
1526834994322,15cyclictest238-21systemd-journal20:25:010
152683499431,13cyclictest12-21ksoftirqd/022:55:010
1526834994310,11cyclictest12-21ksoftirqd/022:28:180
152684799428,6cyclictest131rcu_preempt20:34:263
1526847994232,6cyclictest309-21in:imuxsock22:40:013
1526847994229,10cyclictest275-21dbus-daemon20:25:013
1526847994224,14cyclictest238-21systemd-journal20:50:003
1526838994231,8cyclictest1534513-21sshd21:36:191
1526838994228,11cyclictest1-21systemd23:30:001
1526838994227,11cyclictest1536479-21sed22:15:021
152683899422,4cyclictest131rcu_preempt22:21:191
152683899422,3cyclictest131rcu_preempt23:45:031
152683899422,3cyclictest131rcu_preempt21:42:181
1526838994223,14cyclictest275-21dbus-daemon21:15:011
152683899421,4cyclictest131rcu_preempt23:05:011
152683899421,4cyclictest131rcu_preempt21:35:001
152683499427,7cyclictest12-21ksoftirqd/022:10:000
1526834994232,7cyclictest12-21ksoftirqd/021:35:000
1526834994228,11cyclictest1535551-21sshd21:57:190
152683499421,8cyclictest12-21ksoftirqd/020:10:200
1526847994126,12cyclictest1543886-21munin-plugin-st00:40:003
1526847994126,12cyclictest1543886-21munin-plugin-st00:40:003
1526847994124,12cyclictest1542853-21systemctl00:20:003
152683899413,5cyclictest131rcu_preempt22:30:021
1526838994130,8cyclictest1541366-21sed23:50:011
1526838994130,8cyclictest1539443-21sshd23:13:191
152683899412,3cyclictest131rcu_preempt22:45:001
152683899411,3cyclictest131rcu_preempt00:15:011
1526834994130,6cyclictest309-21in:imuxsock21:05:000
152683499411,37cyclictest0-21swapper/021:50:010
152683499411,35cyclictest151rcuc/020:55:020
1526847994024,12cyclictest309-21in:imuxsock22:25:003
1526847994011,22cyclictest1531417-21modprobe20:40:003
1526838994030,6cyclictest309-21in:imuxsock20:15:001
1526838994028,8cyclictest238-21systemd-journal21:50:181
152683899402,4cyclictest131rcu_preempt20:05:031
152683899402,4cyclictest131rcu_preempt20:05:021
152683899401,6cyclictest131rcu_preempt22:09:591
152683899401,4cyclictest131rcu_preempt22:20:001
152683899401,4cyclictest131rcu_preempt21:15:181
152683899401,3cyclictest131rcu_preempt19:48:211
1526834994028,9cyclictest12-21ksoftirqd/020:35:010
152684799393,6cyclictest37-21ksoftirqd/321:10:023
1526847993927,6cyclictest309-21in:imuxsock23:00:023
1526847993927,6cyclictest309-21in:imuxsock23:00:013
1526847993925,11cyclictest1535618-21systemd-run22:00:003
1526847993924,10cyclictest238-21systemd-journal00:30:003
1526847993920,13cyclictest275-21dbus-daemon22:20:013
152683899395,10cyclictest131rcu_preempt20:25:021
152683899393,5cyclictest131rcu_preempt23:00:031
152683899393,5cyclictest131rcu_preempt23:00:021
152683899393,5cyclictest131rcu_preempt20:20:001
152683899393,3cyclictest131rcu_preempt22:35:001
152683899393,3cyclictest131rcu_preempt19:31:201
1526838993927,8cyclictest309-21in:imuxsock20:00:001
1526838993926,10cyclictest23-21ksoftirqd/100:10:021
1526838993923,12cyclictest275-21dbus-daemon23:40:001
152683899391,4cyclictest131rcu_preempt00:40:021
152683899391,4cyclictest131rcu_preempt00:40:011
152683899391,3cyclictest131rcu_preempt23:51:191
1526834993930,7cyclictest12-21ksoftirqd/022:15:010
1526834993929,8cyclictest12-21ksoftirqd/023:25:000
152683499392,7cyclictest1543643-21munin-run00:35:000
1526834993925,11cyclictest238-21systemd-journal20:45:000
1526834993913,6cyclictest12-21ksoftirqd/019:15:020
152683499391,34cyclictest0-21swapper/000:30:020
1526847993830,5cyclictest1530393-21sendmail20:20:003
1526847993826,9cyclictest1529843-21sshd20:05:203
1526847993826,8cyclictest37-21ksoftirqd/321:20:013
1526847993822,12cyclictest238-21systemd-journal23:45:033
1526838993825,10cyclictest1533009-21systemd-run21:10:021
152683899382,3cyclictest131rcu_preempt19:30:021
152683899382,3cyclictest131rcu_preempt19:16:211
152683899381,3cyclictest131rcu_preempt23:19:591
152683899381,3cyclictest131rcu_preempt20:40:001
1526834993830,6cyclictest12-21ksoftirqd/023:05:010
1526834993829,6cyclictest12-21ksoftirqd/019:40:200
1526834993827,9cyclictest12-21ksoftirqd/019:55:020
152683499382,6cyclictest1541266-21sshd23:48:220
152683499382,6cyclictest131rcu_preempt23:15:020
152683499382,5cyclictest131rcu_preempt23:45:010
1526834993821,10cyclictest12-21ksoftirqd/022:25:010
1526834993810,5cyclictest131rcu_preempt00:40:030
1526834993810,5cyclictest131rcu_preempt00:40:020
1526847993726,9cyclictest37-21ksoftirqd/321:15:023
1526847993726,8cyclictest238-21systemd-journal19:25:213
1526847993725,10cyclictest37-21ksoftirqd/300:35:003
152684799372,4cyclictest131rcu_preempt23:45:003
1526847993722,12cyclictest37-21ksoftirqd/321:25:003
1526847993720,12cyclictest1-21systemd19:55:013
1526847993719,13cyclictest275-21dbus-daemon20:00:013
1526847993717,14cyclictest275-21dbus-daemon00:15:013
1526847993715,6cyclictest37-21ksoftirqd/321:44:193
1526838993725,6cyclictest1537657-21munin-plugin-st22:40:001
1526838993724,10cyclictest23-21ksoftirqd/119:25:021
1526838993724,10cyclictest1540695-21sed23:35:021
1526838993724,10cyclictest1540695-21sed23:35:021
1526838993723,11cyclictest23-21ksoftirqd/100:30:011
152683899371,4cyclictest131rcu_preempt22:46:191
152683899371,3cyclictest131rcu_preempt20:45:001
152683899371,3cyclictest0-21swapper/100:35:011
1526834993723,11cyclictest12-21ksoftirqd/022:50:010
1526834993710,9cyclictest1538758-21latency_hist23:00:020
1526834993710,9cyclictest1538758-21latency_hist23:00:010
152684799363,4cyclictest131rcu_preempt22:52:303
1526847993627,6cyclictest37-21ksoftirqd/319:45:013
1526847993627,5cyclictest309-21in:imuxsock23:30:013
1526847993625,7cyclictest1540004-21munin-plugin-st23:25:003
1526847993623,7cyclictest37-21ksoftirqd/319:40:003
1526847993621,11cyclictest1542385-21wc00:10:013
1526847993621,10cyclictest275-21dbus-daemon21:50:013
152684799361,3cyclictest131rcu_preempt23:35:033
152684799361,3cyclictest131rcu_preempt23:35:023
152683899363,4cyclictest131rcu_preempt19:14:591
1526838993620,12cyclictest1-21systemd00:25:011
1526834993623,9cyclictest12-21ksoftirqd/022:45:000
152683499361,31cyclictest0-21swapper/020:05:020
152683499361,31cyclictest0-21swapper/020:05:010
152684799356,3cyclictest131rcu_preempt19:10:023
152684799354,4cyclictest131rcu_preempt22:26:183
152684799354,3cyclictest131rcu_preempt20:25:283
1526847993528,4cyclictest1526012-21kworker/u8:019:20:003
1526847993524,6cyclictest309-21in:imuxsock23:15:013
152684799352,3cyclictest131rcu_preempt19:50:023
1526847993518,11cyclictest275-21dbus-daemon21:40:013
152684799351,4cyclictest131rcu_preempt19:15:003
152683499351,31cyclictest1531940-21cron20:50:000
152684799344,3cyclictest131rcu_preempt23:10:013
1526847993423,9cyclictest37-21ksoftirqd/323:02:323
1526847993421,10cyclictest1532183-21sshd20:53:183
1526847993418,13cyclictest275-21dbus-daemon23:20:003
152683899342,3cyclictest131rcu_preempt22:03:181
152683899342,3cyclictest131rcu_preempt20:45:191
152683499346,11cyclictest12-21ksoftirqd/023:10:000
1526834993424,7cyclictest12-21ksoftirqd/020:40:000
152684799333,3cyclictest131rcu_preempt22:44:593
152684799333,3cyclictest131rcu_preempt21:54:593
1526847993324,6cyclictest1534145-21latency_hist21:30:033
1526847993324,6cyclictest1534145-21latency_hist21:30:023
1526847993320,9cyclictest309-21in:imuxsock19:35:013
1526847993320,10cyclictest1532760-21sort21:05:013
1526847993319,10cyclictest275-21dbus-daemon22:50:013
1526847993318,11cyclictest238-21systemd-journal22:05:013
152683899334,3cyclictest131rcu_preempt21:25:011
1526838993322,8cyclictest1528566-21sshd19:41:201
1526838993320,9cyclictest275-21dbus-daemon20:55:011
1526838993320,11cyclictest23-21ksoftirqd/122:50:021
152683499331,3cyclictest0-21swapper/023:55:000
1526847993222,6cyclictest1527629-21wc19:25:013
152684799305,4cyclictest131rcu_preempt00:24:593
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional