You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-02 - 03:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackcslot7s.osadl.org (updated Fri Jan 02, 2026 00:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
327975227840,13sleep00-21swapper/019:05:070
33150102750,6sleep342-21ksoftirqd/320:40:303
328026827147,17sleep30-21swapper/319:05:223
33937312670,5chrt0-21swapper/300:25:223
33937312670,5chrt0-21swapper/300:25:223
328108226640,20sleep20-21swapper/219:08:062
328089426444,14sleep10-21swapper/119:05:391
328136199600,56cyclictest1972-21rtkit-daemon23:13:490
3281367995819,19cyclictest34-21ksoftirqd/220:20:002
3281365995814,31cyclictest1033-21gdbus21:24:401
3281365995814,31cyclictest1033-21gdbus21:24:391
3281365995812,38cyclictest3360643-21seq22:51:061
33865572560,17sleep234-21ksoftirqd/200:05:172
3281365995620,30cyclictest3289764-21awk19:30:261
3281365995613,39cyclictest3389370-21perf00:15:001
3281367995528,15cyclictest34-21ksoftirqd/223:50:232
328136599559,38cyclictest3382335-21seq23:53:561
3281365995521,28cyclictest3373776-21systemd-udevd23:30:131
3281365995512,36cyclictest3311985-21seq20:33:261
3281365995512,36cyclictest3311985-21seq20:33:261
197399550,9rtkit-daemon1972-21rtkit-daemon21:43:131
197399550,9rtkit-daemon1972-21rtkit-daemon21:22:080
197399550,9rtkit-daemon1972-21rtkit-daemon21:22:080
197399550,9rtkit-daemon1972-21rtkit-daemon19:52:151
197399540,9rtkit-daemon1972-21rtkit-daemon22:35:101
197399540,8rtkit-daemon1972-21rtkit-daemon19:37:030
3281367995327,14cyclictest34-21ksoftirqd/223:55:322
3281367995313,22cyclictest34-21ksoftirqd/223:30:162
3281365995315,32cyclictest3316314-21cat20:45:201
3281361995345,6cyclictest161rcuc/020:00:000
197399530,8rtkit-daemon1972-21rtkit-daemon21:08:541
197399530,8rtkit-daemon1972-21rtkit-daemon20:20:291
197399530,8rtkit-daemon1972-21rtkit-daemon00:25:451
197399530,8rtkit-daemon1972-21rtkit-daemon00:25:451
3281365995216,29cyclictest1137-21runrttasks23:06:561
3281365995215,29cyclictest3364775-21latency_hist23:05:011
197399520,8rtkit-daemon1972-21rtkit-daemon21:11:491
197399520,8rtkit-daemon1972-21rtkit-daemon20:42:381
197399520,8rtkit-daemon1972-21rtkit-daemon20:35:071
197399520,8rtkit-daemon1972-21rtkit-daemon19:56:351
3281367995116,18cyclictest34-21ksoftirqd/222:40:232
3281361995142,6cyclictest161rcuc/020:50:030
197399510,6rtkit-daemon1972-21rtkit-daemon21:56:230
197399510,6rtkit-daemon1972-21rtkit-daemon21:00:460
3281371995041,6cyclictest411rcuc/321:40:273
3281371995017,6cyclictest141rcu_preempt00:20:273
3281367995019,10cyclictest34-21ksoftirqd/221:45:322
3281365995015,29cyclictest3349569-21kernelversion22:20:211
3281361995041,6cyclictest161rcuc/023:57:360
328136199502,12cyclictest3396939-21seq00:35:180
3281371994940,6cyclictest411rcuc/323:40:033
3281371994927,7cyclictest42-21ksoftirqd/323:55:113
328136599493,40cyclictest3389699-21sort00:15:121
328136199499,14cyclictest3294792-21expr19:45:160
328136199498,11cyclictest13-21ksoftirqd/020:10:290
33648412480,6sleep34497-21PK-Backend23:05:013
3281367994816,16cyclictest34-21ksoftirqd/222:55:252
3281367994815,18cyclictest34-21ksoftirqd/219:15:042
3281367994812,19cyclictest34-21ksoftirqd/219:29:592
3281365994824,20cyclictest3327767-21unin-run21:20:001
3281365994819,25cyclictest3338960-21sed21:50:211
3281365994814,30cyclictest3331152-21seq21:29:091
3281365994813,29cyclictest3397253-21netstat00:35:251
328136199487,12cyclictest13-21ksoftirqd/021:30:000
328136199486,18cyclictest13-21ksoftirqd/023:00:250
3281361994816,8cyclictest0-21swapper/022:05:190
3281361994816,8cyclictest0-21swapper/022:05:180
3281361994812,18cyclictest13-21ksoftirqd/021:40:020
33424962470,14sleep3411rcuc/322:00:233
328137199475,17cyclictest42-21ksoftirqd/323:39:093
3281371994726,7cyclictest42-21ksoftirqd/320:24:083
328136799478,14cyclictest34-21ksoftirqd/220:25:252
328136799477,12cyclictest34-21ksoftirqd/220:05:162
3281367994710,13cyclictest34-21ksoftirqd/223:50:002
328136599479,32cyclictest438-20systemd-journal20:55:001
328136599478,34cyclictest3305558-21expr20:15:151
3281365994715,26cyclictest3344370-21sh22:05:281
3281365994715,26cyclictest3344370-21sh22:05:281
3281365994715,26cyclictest3283256-21fw_packets19:15:021
3281365994712,31cyclictest3391444-21cpuspeed00:20:141
3281365994712,30cyclictest3340368-21cat21:55:151
3281371994621,22cyclictest3369994-21idleruntime-cro23:20:003
3281367994618,9cyclictest34-21ksoftirqd/219:23:232
3281367994613,18cyclictest34-21ksoftirqd/222:19:562
3281367994613,17cyclictest34-21ksoftirqd/220:00:392
3281367994612,15cyclictest34-21ksoftirqd/200:12:202
3281367994611,19cyclictest34-21ksoftirqd/219:35:242
328136599468,32cyclictest3342497-21cat22:00:221
3281365994615,27cyclictest3292421-21/usr/sbin/munin19:40:131
3281365994613,29cyclictest3321973-21switchtime21:00:331
3281365994611,30cyclictest3303098-21latency_hist20:10:021
3281365994610,32cyclictest3295971-21systemd-run19:50:011
328136199465,14cyclictest13-21ksoftirqd/020:15:020
3281361994614,7cyclictest13-21ksoftirqd/021:45:160
3281361994613,11cyclictest13-21ksoftirqd/020:00:300
3281361994611,19cyclictest13-21ksoftirqd/023:35:240
3281361994610,9cyclictest13-21ksoftirqd/022:20:040
3281367994519,8cyclictest3390738-21taskset00:15:322
3281367994513,15cyclictest34-21ksoftirqd/223:40:132
3281367994510,19cyclictest34-21ksoftirqd/200:35:232
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional