You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-21 - 08:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Thu May 21, 2026 00:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
173772236160,25sleep00-21swapper/019:06:000
175152229157,21sleep20-21swapper/219:07:472
176082218189,19sleep30-21swapper/319:09:003
176682216144,23sleep10-21swapper/119:09:471
1778299120100,12cyclictest0-21swapper/223:46:162
1778299109105,3cyclictest0-21swapper/200:15:102
17782999996,2cyclictest0-21swapper/222:49:232
227072590,4sleep11777799cyclictest00:10:231
1777799444,19cyclictest19440-21kworker/u8:222:55:211
17777994311,12cyclictest2058-21latency_hist21:00:011
1777799418,21cyclictest1064-21switchtime00:35:241
17777993915,11cyclictest2494-21/usr/sbin/munin19:45:171
1777799387,17cyclictest1364-21gltestperf22:10:151
1777799377,20cyclictest16229-21chrt23:56:521
1777799377,18cyclictest21814-21df_inode20:30:131
1777799369,12cyclictest14645-21latency_hist20:15:011
17777993613,11cyclictest32624-21/usr/sbin/munin23:20:211
17777993612,12cyclictest1452-21awk19:45:011
1777099367,13cyclictest16490-21munin-run00:00:010
1778299357,9cyclictest6480-21perf21:10:012
17782993512,10cyclictest15609-21/usr/sbin/munin23:55:232
1777799357,14cyclictest28893-21expr22:00:121
1777799357,12cyclictest18795-21cat00:05:021
1777799355,24cyclictest19440-21kworker/u8:221:42:451
1777799353,23cyclictest18294-21kworker/u8:023:07:031
17777993523,6cyclictest24462-40dnf23:02:261
17777993516,8cyclictest30290-21/usr/sbin/munin00:30:141
17777993516,6cyclictest808-21snmpd22:54:421
17777993511,11cyclictest18121-21cat22:50:011
17777993511,10cyclictest26258-21munin-run21:55:001
17777993510,11cyclictest31448-21grep23:20:011
1778299348,9cyclictest16013-21ls22:45:022
1778299347,16cyclictest29304-21/usr/sbin/munin23:15:162
17782993410,6cyclictest87350irq/126-enp1s0-22:25:222
17782993410,6cyclictest87350irq/126-enp1s0-22:25:222
17777993412,11cyclictest4568-21cpuspeed_turbos21:05:121
17777993410,12cyclictest1-21systemd20:00:011
17777993410,11cyclictest26749-21latency20:40:241
1777099346,13cyclictest19054-21munin-run20:25:010
1778299338,13cyclictest27741-21/usr/sbin/munin00:25:142
1778299338,11cyclictest6468-21diskmemload00:31:022
1778299337,16cyclictest6076-21/usr/sbin/munin19:55:202
1778299337,16cyclictest28348-21sendmail_mailst23:10:242
17782993314,7cyclictest27149-21hddtemp_smartct21:55:152
17782993310,12cyclictest839-21lldpd00:20:132
1777799339,13cyclictest22082-21/usr/sbin/munin21:45:211
1777799339,11cyclictest0-21swapper/100:20:181
1777799338,13cyclictest29647-21users20:45:251
1777799337,15cyclictest15027-21pmu-power22:40:221
1777799332,22cyclictest3989-21ntpq22:15:211
17777993312,17cyclictest8562-21tail23:40:151
17777993311,11cyclictest27541-21ntp_states21:55:201
17777993310,12cyclictest6704-21/usr/sbin/munin21:10:251
1778299326,15cyclictest30883-21/usr/sbin/munin22:05:162
1778299325,16cyclictest19469-21cut00:05:152
1777799329,10cyclictest808-21snmpd00:09:501
1777799328,11cyclictest15486-21/usr/sbin/munin21:30:231
1777799327,17cyclictest2672-21kworker/u8:022:24:211
1777799326,15cyclictest827-21runrttasks21:03:111
1777799323,20cyclictest31066-21kworker/u8:223:46:191
1777799323,20cyclictest28770-21kworker/u8:123:28:111
17777993213,8cyclictest9698-21interrupts21:15:181
17777993213,8cyclictest9698-21interrupts21:15:181
1777799321,24cyclictest27307-21kworker/u8:000:29:361
17777993210,11cyclictest30961-21cpuspeed_turbos22:05:121
17777993210,10cyclictest5792-21awk23:35:121
17777993210,10cyclictest5792-21awk23:35:121
1777099329,11cyclictest0-21swapper/022:55:010
1778999311,25cyclictest0-21swapper/323:38:553
1778999311,25cyclictest0-21swapper/323:38:553
1778299319,8cyclictest4447-21memory23:30:182
1778299319,13cyclictest25095-21irqstats21:50:172
1778299319,12cyclictest25260-21/usr/sbin/munin19:25:242
17782993110,10cyclictest6468-21diskmemload21:21:362
17782993110,10cyclictest30261-21users22:00:262
1777799318,12cyclictest0-21swapper/123:12:081
1777799317,13cyclictest9507-21/usr/sbin/munin22:30:111
1777099318,11cyclictest2081-21idleruntime-cro21:00:010
1777099314,13cyclictest29427-21munin-run19:35:020
1778299308,13cyclictest7517-21irqstats21:10:192
1778299308,12cyclictest87550irq/128-enp1s0-20:39:082
1778299305,9cyclictest0-21swapper/223:40:082
1777799309,12cyclictest808-21snmpd20:54:111
1777799308,19cyclictest13474-21awk23:50:221
1777799307,10cyclictest0-21swapper/121:25:411
1777799306,12cyclictest0-21swapper/121:35:171
17777993011,15cyclictest24950-21chrt00:15:251
1777099308,10cyclictest6468-21diskmemload23:45:010
1777099302,13cyclictest30654-21munin-run22:05:010
1778299297,13cyclictest21268-21ls21:40:272
1778299297,11cyclictest11434-21missed_timers20:05:212
1778299295,9cyclictest533-21unixbench_multi23:20:252
1778299294,13cyclictest0-21swapper/221:40:022
17782992912,5cyclictest20346-21ntp_states20:25:202
17782992910,7cyclictest21150-21/usr/sbin/munin00:10:102
17782992910,6cyclictest3823-21/usr/sbin/munin22:15:182
17782992910,6cyclictest20836-21df22:55:122
1777799298,9cyclictest21016-21runrttasks20:27:111
1777799297,19cyclictest28108-21sed19:30:141
1777799291,21cyclictest0-21swapper/120:35:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional