You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 00:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackcslot7s.osadl.org (updated Wed Dec 24, 2025 12:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25843082920,8sleep10-21swapper/107:50:201
26190942910,7sleep24497-21PK-Backend09:30:002
26190942910,7sleep24497-21PK-Backend09:30:002
197399860,73rtkit-daemon0-21swapper/207:09:112
26138232790,4sleep24497-21PK-Backend09:15:122
256869727739,13sleep10-21swapper/107:05:501
26026732750,4sleep04497-21PK-Backend08:40:290
197399750,60rtkit-daemon0-21swapper/307:07:203
256873126344,13sleep00-21swapper/007:06:160
197399600,9rtkit-daemon1972-21rtkit-daemon11:55:481
26455342580,13sleep20-21swapper/210:45:102
2569181995811,23cyclictest0-21swapper/307:17:023
197399580,9rtkit-daemon1972-21rtkit-daemon10:43:331
197399570,9rtkit-daemon1972-21rtkit-daemon12:34:530
197399570,9rtkit-daemon1972-21rtkit-daemon12:22:161
256918199551,28cyclictest2647262-21latency_hist10:50:013
197399550,8rtkit-daemon1972-21rtkit-daemon09:25:331
197399550,8rtkit-daemon1972-21rtkit-daemon09:25:331
197399550,10rtkit-daemon1972-21rtkit-daemon11:38:581
26093902540,16sleep013-21ksoftirqd/009:00:250
197399530,9rtkit-daemon1972-21rtkit-daemon10:00:571
197399530,8rtkit-daemon1972-21rtkit-daemon10:41:270
197399530,8rtkit-daemon1972-21rtkit-daemon09:42:471
197399520,8rtkit-daemon1972-21rtkit-daemon11:34:161
25943402510,6chrt4497-21PK-Backend08:20:032
256918199517,28cyclictest2649269-21cat10:55:153
256918199502,44cyclictest2583549-21apt07:50:013
256918199501,45cyclictest1137-21runrttasks12:02:093
2569181994917,28cyclictest2661571-21cat11:30:203
2569181994917,27cyclictest438-20systemd-journal10:31:213
2569181994917,27cyclictest3037-21gmain09:25:033
2569181994917,27cyclictest3037-21gmain09:25:023
2569181994916,28cyclictest2606114-21grep08:50:283
256918199491,42cyclictest2612858-21ntp_states09:10:243
256918199482,30cyclictest26163562/usr/sbin/munin09:20:263
2569181994819,25cyclictest2647734-21hddtemp_smartct10:50:203
2569181994817,26cyclictest2650785-21awk11:00:133
2569181994817,26cyclictest2650785-21awk11:00:123
256918199481,42cyclictest2673273-21/usr/sbin/munin12:05:133
256918199481,42cyclictest1054-21snmpd07:10:253
256918199481,42cyclictest1054-21snmpd07:10:243
2569181994813,29cyclictest2575875-21processes07:25:263
2569181994717,25cyclictest2598199-21cstates08:30:293
2569181994716,26cyclictest2654748-21cut11:10:203
2569181994715,27cyclictest2637157-21cut10:20:223
256918199471,42cyclictest1137-21runrttasks12:15:383
256918199471,41cyclictest2665117-21irqstats11:40:203
256918199471,41cyclictest2593148-21diskstats08:15:173
256918199471,31cyclictest2681346-21taskset12:25:493
25869732460,13sleep342-21ksoftirqd/307:56:043
2569181994617,25cyclictest2643295-21/usr/sbin/munin10:40:003
2569181994614,28cyclictest2607924-21cat08:55:313
2569181994614,28cyclictest2601290-21pkexec08:38:073
2569181994614,27cyclictest2634331-21seq10:11:113
2569181994611,30cyclictest2678739-21expr12:20:143
256918199452,38cyclictest2663655-21ntp_states11:35:263
2569181994520,21cyclictest2610514-21cpuspeed_turbos09:05:123
256918199451,40cyclictest2627756-20unin-run09:55:023
256918199451,38cyclictest2574192-21python307:20:313
2569181994513,28cyclictest2615190-21seq09:18:443
2569181994512,28cyclictest2628221-21cat09:55:153
2569181994512,28cyclictest2588465-21switchtime08:00:283
256918199451,16cyclictest26197132sh09:30:173
2569181994423,18cyclictest2657434-21cron11:20:013
2569181994415,24cyclictest2601846-21cpuspeed_turbos08:40:143
2569181994415,24cyclictest2595227-21tr08:20:223
256918199441,38cyclictest2682692-21ntp_offset12:30:243
2569181994413,26cyclictest2675715-21netstat12:10:253
2569181994413,26cyclictest2609243-21missed_timers09:00:233
197399440,35rtkit-daemon2660054-21sed11:25:220
197399440,35rtkit-daemon2660054-21sed11:25:220
25997952430,14sleep2331rcuc/208:35:032
256918199435,34cyclictest2345-21gdbus10:19:563
256918199432,36cyclictest2669185-21users11:50:303
256918199432,36cyclictest2669185-21users11:50:293
2569181994317,22cyclictest2638979-21missed_timers10:25:213
2569181994312,27cyclictest2621500-21basename09:35:233
2569181994311,28cyclictest2666670-21expr11:45:163
2569181994311,28cyclictest2579250-21netstat07:35:243
197399430,34rtkit-daemon4497-21PK-Backend12:05:220
256918199429,28cyclictest438-20systemd-journal08:29:593
256918199422,35cyclictest2626171-21date09:50:023
2569181994217,21cyclictest2652613-21cpuspeed_turbos11:05:133
2569181994215,23cyclictest2583787-21/usr/sbin/munin07:50:203
2569181994215,22cyclictest2589282-21/usr/sbin/munin08:05:123
256918199421,38cyclictest2591538-21/usr/sbin/munin08:10:223
256918199421,37cyclictest2644505-21cat10:40:293
256918199421,36cyclictest2631425-21/usr/sbin/munin10:05:263
2569181994210,28cyclictest2580574-21cat07:40:143
197399420,33rtkit-daemon2569158-21cyclictest10:12:211
256918199416,30cyclictest2657822-21cat11:20:143
2569181994115,22cyclictest2659633-21cpuspeed_turbos11:25:153
2569181994115,22cyclictest2659633-21cpuspeed_turbos11:25:143
2569181994115,22cyclictest2629936-21cstates10:00:173
2569181994115,22cyclictest1137-21runrttasks12:39:103
256918199411,36cyclictest2578315-21basename07:35:003
256918199411,36cyclictest0-21swapper/311:56:083
2569181994110,28cyclictest42-21ksoftirqd/308:47:193
256916899411,17cyclictest2606650-21perf08:55:001
197399410,34rtkit-daemon4497-21PK-Backend12:14:561
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional