You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-29 - 01:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Mon Sep 28, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
196283199851,41cyclictest1963857-21munin-node07:15:012
1962827997631,40cyclictest0-21swapper/008:30:280
196282799754,5cyclictest1660-21snmpd10:15:210
196282799721,5cyclictest2000407-21/usr/sbin/munin10:45:260
1962827997127,40cyclictest1996252-21ptp4l10:20:260
1962827996931,6cyclictest0-21swapper/012:05:100
196282799682,39cyclictest2016732-21grep12:20:300
196282799673,4cyclictest0-21swapper/008:25:240
196282799673,4cyclictest0-21swapper/007:15:010
196282799671,6cyclictest1983449-21tail09:05:290
1962827996629,4cyclictest2009237-21sendmail11:40:010
1962827996628,6cyclictest0-21swapper/008:00:280
1962827996625,10cyclictest0-21swapper/011:00:260
196282799662,34cyclictest0-21swapper/009:15:200
1962827996522,9cyclictest0-21swapper/008:05:210
196282799644,32cyclictest1991671-21tune2fs09:55:210
196282799635,3cyclictest0-21swapper/011:20:000
196282799622,4cyclictest1987460-21irqstats09:30:210
1962827996213,5cyclictest1979385-21gpg-connect-age08:45:000
1962827996213,5cyclictest1979385-21gpg-connect-age08:45:000
196282799621,2cyclictest0-21swapper/012:40:000
1962827996134,23cyclictest0-21swapper/010:10:240
196282799611,13cyclictest2001105-21/usr/sbin/munin10:50:210
1962827996035,20cyclictest167350irq/118-8000000.ethernet-tx007:20:000
196282799602,9cyclictest2010483-21sh11:45:210
196282799602,9cyclictest2010483-21sh11:45:210
1962827996025,8cyclictest0-21swapper/011:40:270
196282999591,21cyclictest0-21swapper/110:00:011
196282799592,9cyclictest2012067-21lsblk11:55:180
1962827995929,8cyclictest47-21kauditd10:34:590
1962827995924,6cyclictest0-21swapper/008:15:020
1962827995913,14cyclictest2005059-21gpgv11:15:000
196282999587,31cyclictest0-21swapper/112:05:021
196282999587,31cyclictest0-21swapper/112:05:021
1962827995831,4cyclictest0-21swapper/010:00:110
196282999572,32cyclictest0-21swapper/108:35:011
1962827995722,5cyclictest0-21swapper/007:10:000
196283199561,14cyclictest0-21swapper/208:35:022
1962827995631,4cyclictest0-21swapper/012:00:170
1962827995631,4cyclictest0-21swapper/012:00:170
196282799562,4cyclictest2007545-21munin-run11:30:000
1962829995328,13cyclictest0-21swapper/111:20:141
1962829995229,11cyclictest0-21swapper/111:15:121
196282799525,22cyclictest2003880-21sendmail_mailqu11:05:260
1962831995042,5cyclictest1977524-21munin-plugin-st08:35:012
1962829995032,14cyclictest0-21swapper/112:35:151
1962829995029,10cyclictest0-21swapper/109:00:121
1962829995028,12cyclictest0-21swapper/108:35:141
1962829995026,12cyclictest0-21swapper/107:25:111
1962829995026,12cyclictest0-21swapper/107:25:111
1962829994935,10cyclictest1988900-21apt-get09:40:171
1962829994935,10cyclictest1988900-21apt-get09:40:171
1962829994931,10cyclictest1998357-21apt-get10:35:181
196282999486,4cyclictest0-21swapper/108:00:021
1962829994830,11cyclictest0-21swapper/109:15:141
1962829994829,12cyclictest1979020-21/usr/sbin/munin08:40:281
1962829994829,12cyclictest1979020-21/usr/sbin/munin08:40:271
1962829994828,13cyclictest0-21swapper/108:05:161
1962829994828,12cyclictest2004399-21/usr/sbin/munin11:10:211
1962829994825,15cyclictest1981248-21/usr/sbin/munin08:55:161
1962829994825,14cyclictest1969265-21/usr/sbin/munin07:45:161
1962829994810,16cyclictest0-21swapper/108:50:021
1962827994839,5cyclictest1970680-21munin-plugin-st07:55:000
196282799481,42cyclictest1258-21in:imuxsock09:00:010
196282799481,42cyclictest0-21swapper/009:20:230
196283199475,24cyclictest0-21swapper/208:45:022
196283199475,24cyclictest0-21swapper/208:45:022
1962831994730,12cyclictest311ktimers/210:40:112
1962829994730,10cyclictest2014507-21apt-get12:10:161
1962829994729,9cyclictest1984327-21/usr/sbin/munin09:10:281
1962829994729,10cyclictest1963576-21grep07:10:301
1962829994728,12cyclictest1989916-21/usr/sbin/munin09:45:201
1962829994725,10cyclictest0-21swapper/107:40:121
1962829994724,14cyclictest1993569-21/usr/sbin/munin10:05:251
1962829994724,11cyclictest0-21swapper/107:50:141
1962829994723,13cyclictest0-21swapper/110:45:111
196282799472,7cyclictest1997089-21ptp4l10:25:260
196282799472,40cyclictest1979579-21/usr/sbin/munin08:45:160
1962829994632,8cyclictest0-21swapper/110:15:291
1962829994630,11cyclictest0-21swapper/111:50:101
1962829994629,12cyclictest1985733-21/usr/sbin/munin09:20:221
1962829994627,10cyclictest0-21swapper/111:40:261
1962829994625,13cyclictest1964473-21/usr/sbin/munin07:15:251
1962829994623,11cyclictest0-21swapper/111:55:131
196282999461,20cyclictest0-21swapper/108:20:011
1962831994539,3cyclictest1998995-21sendmail10:40:002
1962829994534,5cyclictest1971740-21apt-get08:00:161
1962829994529,8cyclictest0-21swapper/112:20:301
1962829994523,13cyclictest1965087-21/usr/sbin/munin07:20:181
1962829994523,11cyclictest0-21swapper/110:55:121
1962829994430,9cyclictest2001512-21sshd10:51:201
1962829994430,10cyclictest1997516-21apt-get10:30:151
1962829994428,8cyclictest1980351-21apt-get08:50:101
1962829994427,10cyclictest1988040-21apt-get09:35:161
1962829994426,11cyclictest1987539-21/usr/sbin/munin09:30:251
1962829994425,11cyclictest2018040-21cut12:30:191
1962829994425,11cyclictest2015597-21/usr/sbin/munin12:15:231
1962829994423,14cyclictest1973836-21/usr/sbin/munin08:10:271
1962827994436,6cyclictest0-21swapper/007:25:130
1962827994436,6cyclictest0-21swapper/007:25:130
1962827994432,8cyclictest0-21swapper/009:45:010
1962827994432,8cyclictest0-21swapper/009:45:000
196282799441,9cyclictest0-21swapper/010:10:010
1962831994335,5cyclictest0-21swapper/211:40:152
1962831994333,5cyclictest0-21swapper/209:00:002
1962831994330,10cyclictest2009231-21munin-run11:40:002
1962831994327,12cyclictest0-21swapper/212:30:252
1962829994333,5cyclictest2003733-21meminfo11:05:241
1962829994331,9cyclictest1992366-21apt-get10:00:151
1962829994324,10cyclictest1996673-21/usr/sbin/munin10:25:191
1962829994323,12cyclictest1967853-21/usr/sbin/munin07:35:261
1962829994322,9cyclictest0-21swapper/112:25:111
1962829994317,19cyclictest1974924-21grep08:15:291
1962827994336,4cyclictest167350irq/118-8000000.ethernet-tx009:00:180
196282799433,5cyclictest1967571-21diskstats07:35:190
1962827994329,10cyclictest0-21swapper/009:50:010
1962829994234,4cyclictest2007746-21apt-get11:30:181
1962829994224,13cyclictest0-21swapper/107:30:141
1962827994234,5cyclictest2015995-21grep12:20:010
1962827994233,4cyclictest0-21swapper/008:25:020
196282799421,3cyclictest0-21swapper/009:55:020
196282799421,38cyclictest2011498-21proc_pri11:50:240
1962831994131,7cyclictest0-21swapper/211:20:012
1962831994117,16cyclictest311ktimers/211:30:172
1962829994134,3cyclictest1983286-21/usr/sbin/munin09:05:271
1962829994131,7cyclictest1991297-21sshd09:54:211
1962829994126,8cyclictest2002855-21/usr/sbin/munin11:00:211
1962829994124,10cyclictest1999474-21irqstats10:40:241
1962829994114,19cyclictest0-21swapper/110:25:021
1962827994131,5cyclictest0-21swapper/012:15:000
196283199403,29cyclictest0-21swapper/208:50:202
1962831994031,5cyclictest1985237-21grep09:15:292
1962831994027,9cyclictest0-21swapper/209:30:262
196283199402,2cyclictest0-21swapper/211:00:012
196283199401,4cyclictest0-21swapper/212:00:012
1962829994028,7cyclictest2009033-21/usr/sbin/munin11:35:271
1962829994027,7cyclictest1986714-21/usr/sbin/munin09:25:261
1962829994027,7cyclictest0-21swapper/111:25:111
1962829994025,10cyclictest0-21swapper/111:45:101
1962829994025,10cyclictest0-21swapper/111:45:101
1962829994021,14cyclictest1994246-21/usr/sbin/munin10:10:201
196282799401,37cyclictest0-21swapper/009:10:020
1962831993921,14cyclictest311ktimers/211:00:122
1962831993921,14cyclictest311ktimers/208:10:122
1962829993926,8cyclictest0-21swapper/108:25:101
1962827993932,4cyclictest167350irq/118-8000000.ethernet-tx008:35:150
1962827993932,4cyclictest0-21swapper/007:30:280
196282799391,8cyclictest1981153-21latency_hist08:55:000
1962831993828,6cyclictest0-21swapper/208:00:282
1962831993826,8cyclictest0-21swapper/211:25:272
1962827993822,14cyclictest0-21swapper/007:20:240
1962827993819,17cyclictest0-21swapper/007:55:220
196282799381,4cyclictest1987000-21/usr/sbin/munin09:30:000
196282799381,35cyclictest0-21swapper/010:35:170
196283199378,8cyclictest2019365-21apt-get12:40:012
1962831993729,4cyclictest0-21swapper/211:05:222
1962831993724,7cyclictest0-21swapper/207:20:272
1962829993722,12cyclictest2013673-21/usr/sbin/munin12:05:151
1962827993730,4cyclictest0-21swapper/008:15:130
1962827993722,13cyclictest0-21swapper/007:40:200
196282799371,4cyclictest0-21swapper/011:35:010
196282799371,34cyclictest0-21swapper/012:30:130
196282799371,2cyclictest0-21swapper/007:45:210
1962831993626,7cyclictest0-21swapper/210:20:292
1962831993626,5cyclictest0-21swapper/209:50:252
1962831993625,7cyclictest0-21swapper/208:05:292
1962831993623,8cyclictest0-21swapper/210:00:202
196283199361,29cyclictest1989737-21/usr/sbin/munin09:45:282
1962827993630,3cyclictest0-21swapper/012:25:250
1962827993629,4cyclictest20850irq/208-8000000.ethernet09:35:190
196282799361,2cyclictest2006065-21apt-get11:20:130
1962831993526,6cyclictest1964715-21grep07:15:272
196283199352,20cyclictest1988037-21/usr/sbin/munin09:35:182
1962831993513,16cyclictest167550irq/134-8000000.ethernet-tx210:45:222
1962831993423,7cyclictest2005093-21latency_hist11:15:012
1962831993422,8cyclictest0-21swapper/210:25:292
196283199341,28cyclictest0-21swapper/207:50:172
1962827993427,4cyclictest20850irq/208-8000000.ethernet10:40:210
1962831993314,13cyclictest19658211/usr/sbin/munin07:25:272
1962831993314,13cyclictest19658211/usr/sbin/munin07:25:272
196283199331,2cyclictest0-21swapper/209:25:012
1962831993225,4cyclictest0-21swapper/208:20:292
1962831993225,3cyclictest0-21swapper/210:30:242
1962831993224,4cyclictest0-21swapper/207:55:192
1962831993223,6cyclictest1-21systemd09:14:322
1962831993222,5cyclictest0-21swapper/208:15:272
1962831993221,7cyclictest0-21swapper/211:50:272
196283199321,29cyclictest0-21swapper/212:20:172
1962831993212,5cyclictest832-21systemd-network09:56:032
1962831993210,15cyclictest0-21swapper/211:25:022
1962831993122,6cyclictest1993203-21/usr/sbin/munin10:05:262
1962831993122,5cyclictest0-21swapper/212:10:272
1962831993118,10cyclictest1995666-21latency_hist10:20:012
1962831993114,14cyclictest167550irq/134-8000000.ethernet-tx210:14:112
1962831993110,4cyclictest832-21systemd-network09:28:422
1962831993110,4cyclictest832-21systemd-network09:08:032
1962829993115,8cyclictest0-21swapper/107:10:011
196282799311,26cyclictest0-21swapper/010:55:170
196283199303,5cyclictest832-21systemd-network12:19:242
1962831993022,5cyclictest30-21rcuc/207:40:262
1962831993013,14cyclictest167550irq/134-8000000.ethernet-tx211:49:272
1962831993013,14cyclictest167550irq/134-8000000.ethernet-tx211:49:272
1962831993012,4cyclictest8321systemd-network09:01:492
1962831992922,5cyclictest30-21rcuc/212:05:212
1962831992921,6cyclictest0-21swapper/209:40:192
1962831992921,6cyclictest0-21swapper/209:40:192
1962831992919,7cyclictest311ktimers/208:25:122
196283199282,18cyclictest32-21ksoftirqd/207:30:162
1962831992821,4cyclictest51-21kcompactd012:25:272
1962831992817,7cyclictest30-21rcuc/210:50:182
1962831992816,8cyclictest0-21swapper/207:45:262
196283199271,24cyclictest0-21swapper/208:45:212
196283199261,23cyclictest0-21swapper/207:35:172
1962831992520,3cyclictest2013483-21latency_hist12:05:012
1962831992520,3cyclictest2013483-21latency_hist12:05:012
1962831992215,5cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional