You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-13 - 14:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackcslot7s.osadl.org (updated Wed May 13, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
198158921160,3sleep00-21swapper/019:20:220
206010821140,3sleep30-21swapper/323:05:163
201692821120,3sleep00-21swapper/021:00:220
20269132990,3sleep00-21swapper/021:30:140
139099980,51rtkit-daemon0-21swapper/319:06:073
197495327947,22sleep20-21swapper/219:05:122
197629527638,31sleep00-21swapper/019:08:190
197626927141,24sleep10-21swapper/119:08:001
20055292590,2sleep00-21swapper/020:30:110
20780562480,3sleep00-21swapper/023:55:180
19968942480,3sleep30-21swapper/320:05:163
20708282430,4sleep13056-21PK-Backend23:35:181
1976571993016,12cyclictest883-21dbus-daemon22:45:000
1976571993010,17cyclictest436-20systemd-journal22:55:000
197657199298,19cyclictest2068526-21cat23:30:120
197657199291,25cyclictest2007840-21python320:35:190
197657199291,25cyclictest2007840-21python320:35:190
197657199289,17cyclictest2054134-21latency_hist22:50:010
197657199285,21cyclictest1-21systemd00:19:270
1976571992811,15cyclictest2057923-21tr23:00:140
20145632270,3sleep10-21swapper/120:55:141
197657199279,16cyclictest1987505-21grep19:40:010
197657199279,16cyclictest1987505-21grep19:40:000
197657199277,6cyclictest1-21systemd23:10:000
197657199277,5cyclictest2011048-21ls20:45:130
197657199276,7cyclictest2001878-21sort20:20:120
1976571992717,7cyclictest436-20systemd-journal23:50:000
1976571992716,9cyclictest2076153-21latency23:50:170
1976571992710,15cyclictest2084021-21latency_hist00:15:010
20654012260,3chrt0-21swapper/323:20:163
197657199269,15cyclictest2045377-21perf22:29:560
197657199269,15cyclictest1095-21runrttasks20:07:130
197657199267,17cyclictest1999344-21timerwakeupswit20:10:230
197657199261,4cyclictest0-21swapper/000:35:120
20376752250,4chrt2037673-21grep22:00:192
20110812250,4sleep30-21swapper/320:45:143
1976584992514,8cyclictest1997777-21apt-get20:10:002
197657199259,14cyclictest2156-21gnome-shell19:13:100
197657199259,14cyclictest2071682-21latency_hist23:40:000
197657199259,14cyclictest2043635-21latency_hist22:20:010
197657199259,14cyclictest1095-21runrttasks20:41:420
197657199256,3cyclictest2035254-21cpu21:55:120
197657199255,5cyclictest2033552-21cpuspeed21:50:120
197657199252,7cyclictest2061229-21apt23:10:140
197657199251,9cyclictest2091417-21idleruntime-cro00:35:000
1976571992515,9cyclictest2038414-21sh22:05:000
1976571992515,6cyclictest1095-21runrttasks23:15:220
1976571992513,11cyclictest2049074-21/usr/sbin/munin22:35:210
197657199250,22cyclictest2018280-21grep21:05:160
197658699241,3cyclictest2082934-21df_inode00:10:163
197657199245,3cyclictest2003704-21cpuspeed_turbos20:25:130
197657199241,7cyclictest436-20systemd-journal23:28:380
197657199241,7cyclictest2073609-21dump-pmu-power23:45:000
1976571992417,5cyclictest2015634-21perf21:00:000
197657199240,7cyclictest1994709-21tr20:00:110
1976579992321,1cyclictest0-21swapper/100:35:341
197657199237,5cyclictest2001366-21seq20:18:210
197657199237,2cyclictest20329812chrt21:47:060
197657199236,3cyclictest2056752-21grep22:55:190
197657199236,2cyclictest0-21swapper/000:25:050
197657199236,16cyclictest0-21swapper/019:54:580
197657199236,16cyclictest0-21swapper/000:03:080
197657199235,2cyclictest0-21swapper/021:29:060
197657199231,8cyclictest2040794-21df_inode22:10:130
197657199231,7cyclictest2066436-21idleruntime-cro23:25:010
197657199231,7cyclictest2021079-21sort21:15:120
197657199231,7cyclictest2013299-21python320:50:210
197657199231,5cyclictest2086646-21cpuspeed_turbos00:20:130
197657199230,21cyclictest1978686-21df19:15:020
197658499222,14cyclictest1095-21runrttasks21:40:102
1976584992220,1cyclictest0-21swapper/221:08:262
1976584992215,5cyclictest2043618-21cron22:20:002
1976579992220,1cyclictest3056-21PK-Backend22:57:461
1976579992220,1cyclictest0-21swapper/123:09:561
1976579992218,2cyclictest141rcu_preempt22:50:161
1976579992217,4cyclictest26-21ksoftirqd/100:19:381
1976579992213,7cyclictest2016270-21df_inode21:00:151
197657999220,20cyclictest3056-21PK-Backend21:27:151
197657199222,5cyclictest1985658-21munin-run19:35:000
1976571992220,1cyclictest0-21swapper/021:41:300
197657199221,7cyclictest2024212-21chrt21:24:040
197657199221,3cyclictest2040161-21/usr/sbin/munin22:10:010
20901412210,3sleep33056-21PK-Backend00:30:133
20547862210,2sleep33056-21PK-Backend22:50:173
1976586992118,2cyclictest3056-21PK-Backend23:10:213
1976586992118,2cyclictest3056-21PK-Backend20:22:243
1976586992115,4cyclictest2156-21gnome-shell22:24:093
1976586992113,6cyclictest1989301-21date19:45:003
197658699210,20cyclictest0-21swapper/321:25:163
197658499212,17cyclictest2070801-21grep23:35:182
1976584992119,1cyclictest0-21swapper/223:04:332
1976584992119,1cyclictest0-21swapper/222:25:322
1976584992119,1cyclictest0-21swapper/222:22:422
1976584992119,1cyclictest0-21swapper/221:17:532
1976584992119,1cyclictest0-21swapper/221:04:142
1976584992119,1cyclictest0-21swapper/220:36:362
1976584992119,1cyclictest0-21swapper/220:36:362
1976584992119,1cyclictest0-21swapper/220:25:272
1976584992119,1cyclictest0-21swapper/219:49:042
1976584992119,1cyclictest0-21swapper/219:44:462
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional