You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-15 - 03:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackcslot7s.osadl.org (updated Fri May 15, 2026 00:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
313935421290,3sleep20-21swapper/220:20:012
313154721280,2sleep00-21swapper/019:55:210
311698721110,4sleep33056-21PK-Backend19:15:193
314187721070,4sleep33056-21PK-Backend20:25:153
321156121000,2sleep33056-21PK-Backend23:45:003
31748702970,3sleep10-21swapper/122:00:121
139099860,73rtkit-daemon0-21swapper/319:09:303
31333682770,2sleep33056-21PK-Backend20:00:213
311345626941,20sleep20-21swapper/219:07:032
311362326444,14sleep00-21swapper/019:09:100
311339326243,13sleep10-21swapper/119:06:141
31641202600,3sleep00-21swapper/021:30:130
31198942600,3sleep20-21swapper/219:25:112
31179312450,2sleep13056-21PK-Backend19:20:011
31185242390,2sleep30-21swapper/319:20:153
3113804993211,6cyclictest3136792-21sed20:10:210
32292502310,4sleep13056-21PK-Backend00:35:151
31382452300,8sleep1261ksoftirqd/120:15:141
311381399309,19cyclictest3145394-21ls20:35:183
139099300,4rtkit-daemon1389-21rtkit-daemon00:14:383
32228732290,3chrt0-21swapper/200:15:192
31296512290,3sleep23056-21PK-Backend19:50:212
311381399291,8cyclictest3137793-21taskset20:15:033
3113813992910,17cyclictest3160619-21/usr/sbin/munin21:20:173
3113804992911,5cyclictest3197266-21seq23:04:350
311381399288,18cyclictest3201602-21expr23:15:133
311381399288,17cyclictest3181826-21cpuspeed_turbos22:20:113
311381399287,5cyclictest3167676-21cat21:40:113
311381399281,9cyclictest3229079-21apt00:35:143
3113813992810,16cyclictest3157151-21/usr/sbin/munin21:10:213
311380499289,6cyclictest3154185-21awk21:00:160
311380499289,5cyclictest3117277-21sed19:15:210
139099280,4rtkit-daemon1389-21rtkit-daemon23:32:212
311381399279,16cyclictest3121183-21latency_hist19:30:013
311381399277,6cyclictest3137333-21munin-run20:15:013
311381399272,8cyclictest3123186-21apt19:35:103
311381399272,21cyclictest3183441-21apt22:25:093
311381399271,4cyclictest0-21swapper/320:20:103
3113804992712,6cyclictest3188376-21cron22:40:000
311381399268,16cyclictest3185378-21grep22:30:123
311381399267,5cyclictest3170053-21sh21:45:203
311381399267,5cyclictest3170053-21sh21:45:203
311381399265,5cyclictest3121455-21dpkg19:30:103
311381399260,2cyclictest31878962chrt22:35:233
311380499269,6cyclictest3192982-21python322:50:210
311380499269,4cyclictest3222426-21expr00:15:130
311380499269,4cyclictest3141470-21grep20:25:110
311380499268,4cyclictest3198569-21timerandwakeup23:05:220
311381399258,14cyclictest3178688-21/usr/sbin/munin22:10:163
311381399257,2cyclictest3225332-21cron00:25:003
311381399256,6cyclictest3163657-21sshd21:27:533
311381399255,5cyclictest3199115-21latency_hist23:10:013
311381399255,18cyclictest3056-21PK-Backend21:05:003
311381399251,7cyclictest3143043-21apt20:30:103
311381399251,3cyclictest0-21swapper/323:10:143
311381399250,23cyclictest3166023-21cpuspeed_turbos21:35:143
311381399250,1cyclictest3056-21PK-Backend19:40:553
311380499258,5cyclictest3216753-21sort00:00:010
311380499258,5cyclictest3208175-21date23:35:010
3113804992511,2cyclictest3213434-21/usr/sbin/munin23:50:210
311380499250,19cyclictest0-21swapper/023:37:340
311381399249,14cyclictest3056-21PK-Backend23:03:503
311381399246,3cyclictest3056-21PK-Backend22:47:543
311381399243,5cyclictest3180060-21ls22:15:123
311381399243,5cyclictest3148473-21expr20:45:123
311381399242,6cyclictest3174505-21dpkg22:00:103
311381399241,7cyclictest436-20systemd-journal00:35:013
311381399241,7cyclictest3207264-21ntp_states23:30:193
311381399241,7cyclictest3147373-21/usr/sbin/munin20:40:213
311381399240,8cyclictest3226151-21/usr/sbin/munin00:25:163
311381399240,8cyclictest3177228-21/usr/sbin/munin22:05:183
311381399240,22cyclictest3056-21PK-Backend00:00:153
311380499248,4cyclictest3156386-21timerandwakeup21:05:210
3113804992411,2cyclictest3149946-21/usr/sbin/munin20:50:200
311380499240,22cyclictest3134479-21diskstats20:05:150
311381399238,14cyclictest3056-21PK-Backend21:54:053
311381399230,8cyclictest3223140-21/usr/sbin/munin00:15:223
311381399230,8cyclictest3164387-21expr21:30:133
311381399230,7cyclictest3129662-21sort19:50:213
311380899230,21cyclictest3217416-21irqstats00:00:151
311380499235,3cyclictest0-21swapper/023:25:130
311380499233,6cyclictest3194116-21apt22:55:120
311380499231,8cyclictest3209995-21apt23:40:120
3113804992318,4cyclictest0-21swapper/020:33:550
3113804992316,5cyclictest883-21dbus-daemon20:25:000
31742862220,4sleep10-21swapper/122:00:001
311381399227,3cyclictest3056-21PK-Backend21:06:143
311381399220,7cyclictest3193194-21users22:50:233
311381399220,6cyclictest3174331-21cut22:00:003
311381399220,20cyclictest3056-21PK-Backend23:59:093
311381399220,20cyclictest3056-21PK-Backend19:45:433
3113811992220,1cyclictest0-21swapper/220:38:082
311381199220,20cyclictest31841412chrt22:25:162
3113808992220,1cyclictest0-21swapper/119:40:451
3113808992220,1cyclictest0-21swapper/100:12:321
3113808992219,2cyclictest3056-21PK-Backend00:17:391
3113808992213,6cyclictest3193578-21apt-get22:55:001
311380899220,21cyclictest3056-21PK-Backend21:32:251
311380899220,21cyclictest0-21swapper/119:36:121
311380899220,20cyclictest3056-21PK-Backend22:21:531
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional