You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 03:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack2slot7s.osadl.org (updated Thu Jun 11, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
279820996543,15cyclictest12650irq/32-eth023:15:260
279820995633,16cyclictest151ktimers/019:25:280
279820995536,13cyclictest151ktimers/019:45:270
27982299524,41cyclictest415269-21rm23:45:282
279820995232,5cyclictest171rcu_preempt23:55:300
27982099521,8cyclictest171rcu_preempt22:40:210
27982099514,41cyclictest348699-21ssh22:00:250
279820995127,18cyclictest12650irq/32-eth022:55:220
27982199504,41cyclictest440511-21ssh00:25:231
27982299492,40cyclictest361375-21ssh22:20:232
27982299492,40cyclictest361375-21ssh22:20:232
279820994927,15cyclictest12650irq/32-eth022:15:250
279820994927,15cyclictest12650irq/32-eth022:15:250
279820994927,14cyclictest151ktimers/019:55:290
279822994837,7cyclictest354029-21systemd-run22:10:022
279821994838,7cyclictest694-21cron00:20:011
279821994838,7cyclictest694-21cron00:20:011
279822994740,4cyclictest388869-21systemd-run23:05:012
279820994716,5cyclictest171rcu_preempt20:00:230
27982299462,36cyclictest355055-21ssh22:10:262
279821994636,6cyclictest433174-21systemd-run00:15:011
279822994536,5cyclictest306839-21systemd-run20:40:022
279822994534,4cyclictest0-21swapper/223:15:282
279820994532,9cyclictest12650irq/32-eth000:30:230
279820994524,13cyclictest431120-21ssh00:10:310
279822994435,6cyclictest421-21dbus-daemon20:10:012
27982099442,31cyclictest393197-21ssh23:10:280
27982199437,3cyclictest171rcu_preempt19:25:281
27982199434,29cyclictest326366-21ssh21:25:211
279821994335,5cyclictest423693-21tar00:00:011
279822994228,10cyclictest405715-21sh23:30:252
27982199422,33cyclictest389869-21ssh23:05:231
279820994226,11cyclictest12650irq/32-eth023:40:260
279822994132,4cyclictest0-21swapper/200:30:252
279822994121,12cyclictest351ktimers/222:35:242
27982199415,28cyclictest383615-21ssh22:55:281
279821994133,5cyclictest382530-21ssh22:55:021
279820994128,5cyclictest0-21swapper/021:40:260
279820994126,12cyclictest314227-21head21:00:370
279822994033,5cyclictest426870-21latency_hist00:05:012
27982299402,30cyclictest393042-21ssh23:10:242
279821994031,5cyclictest373003-21idleruntime-cro22:40:001
27982199401,36cyclictest374006-21ssh22:40:231
279820994033,5cyclictest1003-21mta-sts-daemon23:03:120
279820994032,6cyclictest12650irq/32-eth022:10:280
279822993932,4cyclictest299326-21systemd-run20:15:012
279822993932,4cyclictest299326-21systemd-run20:15:012
279822993927,6cyclictest0-21swapper/223:40:242
27982199394,30cyclictest408992-21ssh23:35:301
27982199392,13cyclictest28-21ksoftirqd/121:20:281
279822993831,3cyclictest0-21swapper/200:00:022
279822993830,5cyclictest281824-21fschecks_time19:15:202
279821993830,5cyclictest367297-21fschecks_time22:30:201
279821993830,5cyclictest367297-21fschecks_time22:30:201
279821993830,5cyclictest360524-21latency_hist22:20:021
279821993830,5cyclictest360524-21latency_hist22:20:021
279821993830,5cyclictest331786-21idleruntime-cro21:35:011
279820993835,2cyclictest0-21swapper/020:05:280
27982099382,33cyclictest319965-21ssh21:15:220
27982099381,22cyclictest351922-21ssh22:05:250
27982299376,14cyclictest430991-21ssh00:10:262
27982199371,6cyclictest171rcu_preempt19:55:291
279821993710,13cyclictest345596-21ssh21:55:281
279820993730,4cyclictest0-21swapper/021:45:230
279820993729,5cyclictest347667-21systemctl22:00:010
27982099372,30cyclictest316808-21ssh21:10:230
279822993628,5cyclictest0-21swapper/223:50:212
279822993627,6cyclictest311310-21systemd-run20:55:012
279822993627,4cyclictest0-21swapper/221:20:252
279822993615,16cyclictest351ktimers/222:30:262
279822993615,16cyclictest351ktimers/222:30:262
27982199364,26cyclictest351813-21ssh22:05:211
27982199364,25cyclictest335962-21sh21:40:231
279821993629,4cyclictest396742-21tail23:15:341
279821993624,8cyclictest332893-21sh21:35:271
27982099362,29cyclictest418329-21ssh23:50:230
27982099362,28cyclictest665-21snmpd20:35:220
279820993618,11cyclictest12650irq/32-eth022:35:250
27982099361,27cyclictest389889-21rm23:05:230
27982299357,23cyclictest349328-21ssh22:00:372
279822993527,5cyclictest1-21systemd00:25:012
279822993527,5cyclictest1-21systemd00:25:012
279822993526,6cyclictest284343-21systemd-run19:25:022
279822993525,6cyclictest300846-21systemd-run20:20:012
279822993525,6cyclictest300846-21systemd-run20:20:012
279821993528,3cyclictest0-21swapper/123:40:241
279821993527,5cyclictest339724-21unixbench_multi21:45:351
279821993525,7cyclictest448964-21sendmail00:40:001
279821993525,7cyclictest448964-21sendmail00:40:001
279821993525,6cyclictest420-21avahi-daemon19:25:021
279821993525,6cyclictest363542-21systemd-run22:25:011
279821993525,6cyclictest363542-21systemd-run22:25:011
279821993524,8cyclictest290332-21systemd-run19:45:011
27982199352,23cyclictest320104-21ssh21:15:281
279821993510,19cyclictest271ktimers/123:50:281
27982299344,23cyclictest335953-21ssh21:40:232
279822993427,4cyclictest411039-21systemd-run23:40:012
27982299342,24cyclictest329663-21ssh21:30:282
279821993427,4cyclictest0-21swapper/119:40:011
279820993426,5cyclictest0-21swapper/021:40:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional