You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-18 - 20:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Sat Apr 18, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
324522993733,3cyclictest345759-21/usr/sbin/munin07:30:172
324522993631,3cyclictest486037-21kworker/u8:3+flush-259:010:00:142
324517993622,12cyclictest599039-21ntpq11:30:180
324522993529,4cyclictest495808-21ntpq09:50:252
324522993529,4cyclictest252-21systemd-journal10:14:592
324522993328,3cyclictest377084-21apt-get08:00:132
324519993329,3cyclictest252-21systemd-journal08:10:001
324519993328,4cyclictest449905-21gpgv09:10:011
324519993328,4cyclictest392294-21latency_hist08:15:011
324517993328,3cyclictest574114-21apt-get11:10:100
324519993228,3cyclictest361103-21kworker/u8:3+flush-259:009:10:261
324519993227,4cyclictest329695-21kworker/u8:3+flush-259:007:25:181
324522993127,2cyclictest543159-21apt-get10:40:112
324519993126,3cyclictest507189-21apt-get10:05:101
324527992924,3cyclictest428790-21latency_hist08:50:003
324522992925,3cyclictest356508-21apt-get07:40:122
324522992925,2cyclictest376851-21kworker/u8:0+flush-259:008:40:182
324522992924,4cyclictest252-21systemd-journal07:20:002
324522992924,3cyclictest252-21systemd-journal12:15:002
324519992925,3cyclictest615501-21kworker/u8:3+flush-259:011:55:251
324519992925,3cyclictest486037-21kworker/u8:3+flush-259:009:55:131
324527992824,3cyclictest345094-21latency_hist07:30:003
324522992824,3cyclictest397466-21kworker/u8:2+flush-259:009:05:142
324519992825,2cyclictest366578-21kworker/u8:2+flush-259:007:55:001
324517992824,3cyclictest361103-21kworker/u8:3+flush-259:009:05:010
324517992823,4cyclictest548354-21apt-get10:45:110
324527992723,3cyclictest335033-21kworker/u8:0+flush-259:007:30:143
324522992722,4cyclictest252-21systemd-journal09:25:012
324519992721,5cyclictest569001-21apt-get11:05:131
324527992621,3cyclictest252-21systemd-journal09:19:433
324519992620,4cyclictest459652-21ntpq09:15:231
324517992623,2cyclictest509-21rs:main0
324517992622,3cyclictest434126-21gpgv08:55:010
324527992519,4cyclictest610318-21latency_hist11:45:013
324519992519,4cyclictest252-21systemd-journal10:24:591
32451799250,23cyclictest334815-21true07:19:590
324519992420,3cyclictest376851-21kworker/u8:0+flush-259:008:15:151
324519992420,3cyclictest292128-21kworker/u8:1+flush-259:007:40:181
324519992419,3cyclictest252-21systemd-journal12:27:551
324527992321,1cyclictest292128-21kworker/u8:1+flush-259:007:40:153
324527992318,4cyclictest563581-21latency_hist11:00:013
324527992317,4cyclictest481140-21latency_hist09:40:013
324519992319,3cyclictest579108-21gpgv11:15:001
324519992317,4cyclictest252-21systemd-journal11:04:431
324527992216,4cyclictest542899-21latency_hist10:40:003
324522992218,3cyclictest413609-21apt-get08:35:122
324522992213,8cyclictest387473-21cpuspeed_turbos08:10:142
324519992218,2cyclictest532836-21/usr/sbin/munin10:30:131
324519992217,4cyclictest252-21systemd-journal12:20:001
324517992216,4cyclictest496638-21latency_hist09:55:000
324527992117,3cyclictest527476-21kworker/u8:1+flush-259:010:25:223
324527992117,3cyclictest527476-21kworker/u8:1+flush-259:010:25:213
324527992117,3cyclictest252-21systemd-journal12:37:543
324527992115,4cyclictest252-21systemd-journal11:55:003
324527992115,4cyclictest252-21systemd-journal09:25:313
324527992114,5cyclictest450037-21cat09:10:003
324522992116,3cyclictest512065-21latency_hist10:10:012
324522992112,7cyclictest500-21systemd-logind09:44:592
32451799218,12cyclictest609896-21unixbench_singl11:40:250
324517992116,3cyclictest252-21systemd-journal09:39:440
324527992017,2cyclictest594840-21idleruntime-cro11:30:013
32452299200,19cyclictest1-21systemd12:30:002
324519992016,3cyclictest527696-21/usr/sbin/munin10:25:151
324519992016,3cyclictest527696-21/usr/sbin/munin10:25:151
324519992015,4cyclictest429049-21apt-get08:50:121
324519992015,4cyclictest423863-21/usr/sbin/munin08:45:151
324519992015,4cyclictest252-21systemd-journal08:30:011
32451799206,13cyclictest0-21swapper/009:10:010
324517992016,3cyclictest553321-21kworker/u8:2+flush-259:011:05:260
324517992016,3cyclictest350766-21gpgv07:35:000
324527991913,4cyclictest252-21systemd-journal10:19:423
324522991913,4cyclictest252-21systemd-journal11:51:432
324519991917,1cyclictest0-21swapper/110:14:591
324519991915,3cyclictest361103-21kworker/u8:3+flush-259:009:25:141
324519991915,3cyclictest292128-21kworker/u8:1+flush-259:007:30:181
324519991913,4cyclictest589699-21latency_hist11:25:011
32451799197,11cyclictest0-21swapper/011:25:120
32451799196,12cyclictest635589-21unixbench_multi12:05:270
32451799196,12cyclictest0-21swapper/010:00:250
32451799191,4cyclictest651851-21/usr/sbin/munin12:25:130
324517991914,4cyclictest460744-21apt-get09:20:130
324517991913,5cyclictest397441-21latency_hist08:20:000
32451799190,6cyclictest391480-21ntpq08:10:220
324527991812,4cyclictest481570-21diskstats09:40:143
32452299186,10cyclictest625775-21cron11:59:592
32452299185,3cyclictest252-21systemd-journal10:40:002
324519991814,3cyclictest449829-21kworker/u8:0+flush-259:009:45:261
324519991813,4cyclictest521501-21ntpq10:15:221
32451799184,3cyclictest520853-21cut10:15:190
32451799181,5cyclictest516716-21unixbench_multi10:10:240
32451799181,5cyclictest475567-21/usr/sbin/munin09:30:250
324517991815,2cyclictest335033-21kworker/u8:0+flush-259:007:35:160
32451799181,4cyclictest559060-21/usr/sbin/munin10:55:160
32451799181,4cyclictest339055-21ntpq07:20:200
32451799181,3cyclictest252-21systemd-journal08:10:000
324517991813,4cyclictest600207-21/usr/sbin/munin11:35:130
324517991812,5cyclictest490568-21ntpq09:45:320
32451799180,5cyclictest375993-21ntpq07:55:220
32451799180,5cyclictest344187-21ntpq07:25:220
32451799180,4cyclictest501804-21turbostat10:00:000
324527991712,4cyclictest502054-21apt-get10:00:113
32452299174,2cyclictest0-21swapper/211:00:002
324522991714,2cyclictest366578-21kworker/u8:2+flush-259:007:50:172
324522991713,3cyclictest252-21systemd-journal10:30:002
324522991713,3cyclictest252-21systemd-journal10:29:592
324522991711,4cyclictest365684-21ntpq07:45:232
32452299170,4cyclictest501776-21cron09:59:592
324519991715,1cyclictest352365-21kthreadcore07:35:171
324519991711,4cyclictest630035-21ntpq12:00:201
32451799176,9cyclictest0-21swapper/008:45:170
32451799176,1cyclictest0-21swapper/010:05:140
32451799175,1cyclictest637629-21grep12:10:180
32451799173,2cyclictest403116-21fschecks_time08:25:140
32451799171,5cyclictest454539-21/usr/sbin/munin09:10:230
32451799171,4cyclictest583710-21ntpq11:15:220
324517991714,2cyclictest60350irq/132-enp0s29f1:rx-010:30:190
324517991713,3cyclictest527476-21kworker/u8:1+flush-259:010:25:490
324517991713,3cyclictest527476-21kworker/u8:1+flush-259:010:25:490
32451799170,7cyclictest651507-21cron12:25:000
32451799170,5cyclictest466068-21/usr/sbin/munin09:25:120
32451799170,5cyclictest438637-21ntpq08:55:210
32451799170,5cyclictest401696-21/usr/sbin/munin08:20:190
324527991612,2cyclictest397466-21kworker/u8:2+flush-259:008:25:003
32452299166,9cyclictest0-21swapper/210:30:162
32452299164,2cyclictest490-21dbus-daemon07:40:002
32452299161,5cyclictest433971-21munin-run08:55:002
32452299161,4cyclictest491431-21cron09:49:592
324522991612,3cyclictest626011-21/usr/sbin/munin12:00:142
324522991612,3cyclictest361103-21kworker/u8:3+events_unbound07:55:162
324522991612,2cyclictest553508-21kworker/u8:4+flush-259:011:40:162
32452299160,4cyclictest568731-21awk11:04:592
32452299160,4cyclictest342523-21sort07:25:192
324519991612,3cyclictest397466-21kworker/u8:2+flush-259:008:30:171
324519991612,3cyclictest324000-21kworker/u8:2+flush-259:007:15:181
324519991611,4cyclictest376851-21kworker/u8:0+flush-259:008:40:231
324519991611,3cyclictest376794-21cron08:00:011
32451799165,1cyclictest0-21swapper/011:00:180
32451799164,1cyclictest0-21swapper/007:40:190
32451799162,3cyclictest420665-21cut08:40:150
324517991614,1cyclictest60350irq/132-enp0s29f1:rx-010:43:300
324517991614,1cyclictest60350irq/132-enp0s29f1:rx-007:50:160
324517991613,2cyclictest60350irq/132-enp0s29f1:rx-010:22:130
324517991613,2cyclictest60350irq/132-enp0s29f1:rx-007:10:120
324517991612,3cyclictest60350irq/132-enp0s29f1:rx-012:35:160
324517991611,4cyclictest60350irq/132-enp0s29f1:rx-012:19:000
32451799160,4cyclictest615074-21/usr/sbin/munin11:45:250
32451799160,4cyclictest459539-21/usr/sbin/munin09:15:220
32451799160,1cyclictest0-21swapper/007:45:240
324527991513,1cyclictest0-21swapper/310:10:003
324527991512,2cyclictest605152-21cron11:40:013
324527991512,2cyclictest356232-21sh07:39:593
324527991512,1cyclictest0-21swapper/310:55:003
324527991512,1cyclictest0-21swapper/308:55:003
324527991510,3cyclictest646597-21/usr/sbin/munin12:20:143
32452299157,7cyclictest0-21swapper/211:10:012
32452299153,3cyclictest666748-21sshd12:37:532
32452299153,3cyclictest407911-21latency_hist08:30:012
32452299153,2cyclictest579743-21cpuspeed_turbos11:15:132
32452299153,2cyclictest393483-21cut08:15:172
32452299150,8cyclictest651523-21munin-run12:25:002
32452299150,5cyclictest397709-21sshd08:20:102
32452299150,4cyclictest443674-21expr09:00:202
324519991512,2cyclictest557496-21needreboot10:50:191
324519991512,2cyclictest329695-21kworker/u8:3+flush-259:007:20:161
324519991511,3cyclictest553508-21kworker/u8:4+flush-259:011:20:011
32451799155,1cyclictest60350irq/132-enp0s29f1:rx-010:54:330
32451799155,1cyclictest0-21swapper/011:55:170
324517991513,1cyclictest60350irq/132-enp0s29f1:rx-011:50:130
324517991513,1cyclictest60350irq/132-enp0s29f1:rx-011:24:440
32451799150,5cyclictest378568-21grep08:00:170
32451799150,4cyclictest659236-21kthreadcore12:30:170
32451799150,4cyclictest542913-21systemd-run10:40:010
32452799148,4cyclictest252-21systemd-journal11:50:013
324527991412,1cyclictest636045-21munin-run12:10:003
324527991411,2cyclictest0-21swapper/308:35:013
324527991411,2cyclictest0-21swapper/307:55:003
324527991410,3cyclictest397466-21kworker/u8:2+flush-259:010:35:003
324527991410,3cyclictest324000-21kworker/u8:2+flush-259:007:14:153
32452299149,3cyclictest252-21systemd-journal08:50:002
32452299144,1cyclictest0-21swapper/211:10:182
32452299143,3cyclictest480265-21ntpq09:35:232
32452299143,2cyclictest409833-21kthreadcore08:30:182
32452299142,3cyclictest325049-21basename07:10:152
32452299141,4cyclictest469974-21ntpq09:25:212
324522991412,1cyclictest0-21swapper/210:45:152
32452299140,5cyclictest382445-21/usr/sbin/munin08:05:162
32452299140,3cyclictest599974-21idleruntime-cro11:35:012
32452299140,3cyclictest594833-21cron11:30:012
32451999146,6cyclictest252-21systemd-journal10:05:001
324519991412,1cyclictest832-21runrttasks10:45:221
324519991412,1cyclictest595511-21irqcore11:30:141
324519991412,1cyclictest0-21swapper/107:50:001
324519991411,2cyclictest461763-21kthreadcore09:20:181
324519991411,2cyclictest449829-21kworker/u8:0+flush-259:009:50:251
324519991411,2cyclictest443722-21ntp_kernel_err09:00:211
324519991411,2cyclictest434588-21/usr/sbin/munin08:55:231
324519991411,2cyclictest413876-21fschecks_time08:35:161
324519991410,3cyclictest616149-21grep11:50:161
32451799144,2cyclictest412056-21collect208:30:220
324517991413,1cyclictest60350irq/132-enp0s29f1:rx-009:41:330
324527991310,2cyclictest621285-21grep11:55:153
324527991310,2cyclictest435034-21sed08:55:183
32452299139,3cyclictest397466-21kworker/u8:2+flush-259:009:16:482
32452299139,2cyclictest0-21swapper/211:45:192
32452299135,1cyclictest0-21swapper/208:55:182
32452299134,2cyclictest401ktimers/209:10:232
32452299134,1cyclictest553762-21fschecks_time10:50:142
32452299132,3cyclictest519060-21cut10:15:182
32452299132,3cyclictest490-21dbus-daemon12:35:002
32452299131,4cyclictest644209-21cut12:15:182
324522991311,1cyclictest0-21swapper/209:35:002
324522991310,2cyclictest585228-21irqcore11:20:162
32452299130,5cyclictest526558-21/usr/sbin/munin10:20:202
32451999139,2cyclictest641191-21sh12:15:001
32451999137,4cyclictest661818-21latency_hist12:35:011
324519991310,2cyclictest605830-21cut11:40:161
32451999130,3cyclictest486317-21awk09:44:591
32452799129,2cyclictest512736-21irqcore10:10:153
32452799129,2cyclictest501371-21unixbench_singl09:55:253
32452799129,2cyclictest0-21swapper/312:05:003
32452799128,3cyclictest567914-21seq11:00:213
32452799128,2cyclictest455340-21idleruntime-cro09:15:013
32452799124,6cyclictest584142-21grep11:15:243
324527991210,1cyclictest641867-21sed12:15:163
324527991210,1cyclictest0-21swapper/309:25:003
32452299129,2cyclictest601248-21kthreadcore11:35:172
32451999129,2cyclictest324799-21cpuspeed_turbos07:10:121
32451999129,1cyclictest0-21swapper/108:25:001
32451999126,4cyclictest594835-21latency_hist11:30:001
32451999121,10cyclictest0-21swapper/111:40:011
32452799119,1cyclictest0-21swapper/311:15:013
32452799119,1cyclictest0-21swapper/310:45:003
32452799118,2cyclictest657015-21cpuspeed_turbos12:30:133
32452299110,3cyclictest335481-21grep07:20:162
32451999118,2cyclictest646740-21cpuspeed_turbos12:20:131
32451999118,2cyclictest538243-21fschecks_count10:35:151
32452799105,4cyclictest252-21systemd-journal08:25:443
32452799104,4cyclictest361932-21fw_forwarded_lo07:45:173
32451999106,2cyclictest0-21swapper/112:05:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional