You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 06:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Sun Nov 30, 2025 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
46622204166,25sleep00-21swapper/019:09:520
46622204166,25sleep00-21swapper/019:09:520
44622204166,25sleep10-21swapper/119:07:191
44622204166,25sleep10-21swapper/119:07:181
45292203166,25sleep30-21swapper/319:08:093
45292203166,25sleep30-21swapper/319:08:093
43552202165,25sleep20-21swapper/219:05:552
43552202165,25sleep20-21swapper/219:05:552
790321690,4sleep1476399cyclictest00:09:011
3254521540,5sleep2477099cyclictest20:10:192
477099104101,2cyclictest0-21swapper/222:31:172
102232730,3sleep2311ktimersoftd/221:45:242
251512540,4sleep339-21rcuc/322:20:173
263112470,2sleep20-21swapper/221:10:162
263112470,2sleep20-21swapper/221:10:162
4757994212,14cyclictest640-21munin-run22:40:010
477099375,4cyclictest12050irq/123-ahci[0021:25:022
477099374,27cyclictest31231-40dnf23:46:352
477099371,21cyclictest0-21swapper/219:22:272
475799356,13cyclictest18982-21munin-run00:35:010
4757993511,11cyclictest25873-21idleruntime-cro21:10:000
67462340,4sleep3401ktimersoftd/300:05:183
477099345,3cyclictest12728-21date20:40:022
475799347,12cyclictest6053-21idleruntime-cro20:25:010
4775993317,8cyclictest0-21swapper/319:44:453
477099335,3cyclictest25852-21diskmemload23:15:012
477099332,28cyclictest21138-21cut19:45:152
4770993312,18cyclictest26081-21grep19:55:182
4770993312,18cyclictest13677-21grep21:55:142
477099331,14cyclictest0-21swapper/222:39:252
475799339,11cyclictest8906-21awk21:45:010
477099329,5cyclictest0-21swapper/200:00:282
477099328,4cyclictest7317-21switchtime00:05:262
477099325,3cyclictest16653-21sshd00:28:332
477099325,3cyclictest16653-21sshd00:28:332
477099321,8cyclictest17853-21kernelversion00:30:202
477099321,5cyclictest0-21swapper/221:26:442
4770993212,17cyclictest18244-21cat20:50:212
4770993210,18cyclictest8885-21idleruntime-cro21:45:022
475799322,14cyclictest9528-21munin-run23:00:010
477099317,2cyclictest17062-21awk20:50:022
477099317,20cyclictest0-21swapper/220:00:102
477099315,5cyclictest0-21swapper/222:45:202
477099312,5cyclictest5983-21smart_sda21:35:252
477099311,6cyclictest13680-21ntp_states00:20:232
477099311,5cyclictest5361-21/usr/sbin/munin22:50:312
477099311,27cyclictest848-21sssd_nss22:40:152
477099311,13cyclictest0-21swapper/222:26:372
477099311,12cyclictest0-21swapper/220:06:132
477099311,11cyclictest0-21swapper/223:51:132
4770993110,3cyclictest4485-21latency_hist21:35:022
4770993110,2cyclictest23646-21latency_hist21:05:022
4775993023,4cyclictest5063-21/usr/sbin/munin21:35:143
477099309,3cyclictest2801-21processes23:55:242
477099305,3cyclictest86850irq/129-enp1s0-21:05:152
477099302,7cyclictest0-21swapper/221:15:262
477099302,5cyclictest6938-21munin-run19:15:022
477099302,10cyclictest17690-21latency_hist22:05:022
477099301,7cyclictest8363-21interrupts22:55:202
4770993013,14cyclictest22329-21sed23:25:292
4770993011,3cyclictest8669-21cat20:30:152
477099301,12cyclictest0-21swapper/220:18:452
4770993011,16cyclictest8044-21ls19:15:162
4770993011,16cyclictest26275-21pmu-power23:35:232
4770993010,3cyclictest8231-21acpi00:10:142
4770993010,3cyclictest19713-21cat20:55:152
475799301,13cyclictest24292-21munin-run22:20:010
475799301,13cyclictest24292-21munin-run22:20:010
136162300,7sleep121-21rcuc/120:40:191
477599297,4cyclictest13502-21grep20:40:193
477099299,3cyclictest836-21runrttasks19:53:232
477099299,17cyclictest19831-21needreboot19:40:222
477099298,2cyclictest16358-21/usr/sbin/munin23:15:222
477099296,4cyclictest5352-21/usr/sbin/munin20:20:272
477099295,4cyclictest22902-21/usr/sbin/munin22:15:192
477099295,4cyclictest22902-21/usr/sbin/munin22:15:192
477099293,6cyclictest24207-21smart_sda23:30:242
477099292,6cyclictest0-21swapper/219:25:252
477099292,5cyclictest26495-21munin-run22:25:022
477099292,5cyclictest10750-21df00:15:142
477099291,6cyclictest0-21swapper/222:10:182
477099291,3cyclictest12050irq/123-ahci[0023:45:022
4770992910,3cyclictest10823-21ntpq23:00:242
477099290,17cyclictest0-21swapper/200:39:032
4757992910,16cyclictest29620-21munin-run20:05:000
477599285,9cyclictest0-21swapper/320:09:133
4775992811,4cyclictest18960-21ntpq22:05:223
477599281,10cyclictest31231-40dnf23:46:323
477099289,3cyclictest836-21runrttasks21:50:242
477099288,3cyclictest18925-21netstat22:05:232
477099288,3cyclictest15562-21pmu-power19:30:252
477099287,3cyclictest7321-21ntpq20:25:222
150432280,4sleep3477599cyclictest23:10:183
477599271,15cyclictest759-21dbus-daemon22:25:323
477099279,3cyclictest15017-21sed20:45:022
477099277,3cyclictest12358-21cut23:05:162
475799271,13cyclictest17699-21munin-run22:05:000
477599269,4cyclictest13315-21ntp_states19:25:233
477599269,3cyclictest0-21swapper/319:49:293
4775992610,4cyclictest10860-21irqstats19:20:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional