You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-29 - 09:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon Jun 29, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
667079994844,3cyclictest765937-21gpgv20:45:013
667074994643,2cyclictest677346-21kworker/u8:2+events_unbound19:45:150
667079994540,3cyclictest854629-21latency_hist22:10:003
667074994237,4cyclictest911702-21kworker/u8:0+events_unbound23:40:240
667078993934,3cyclictest807637-21/usr/sbin/munin21:25:152
667078993832,4cyclictest745180-21latency_hist20:25:012
667078993831,5cyclictest335557-21systemd-journal22:09:392
667074993835,2cyclictest797359-21kworker/u8:2+events_unbound21:15:150
667074993834,3cyclictest963504-21kworker/u8:3+events_unbound00:33:340
667074993834,3cyclictest667287-21kworker/u8:1+events_unbound19:15:210
667074993832,4cyclictest729576-21apt-get20:10:120
667074993734,2cyclictest932751-21kworker/u8:2+events_unbound00:35:240
667074993733,3cyclictest890640-21kworker/u8:2+events_unbound23:11:400
667074993733,3cyclictest843953-21kworker/u8:0+events_unbound22:30:170
667074993733,3cyclictest771445-21kworker/u8:0+events_unbound20:55:220
667074993733,3cyclictest739625-21kworker/u8:2+events_unbound20:53:390
667074993633,2cyclictest932751-21kworker/u8:2+events_unbound23:59:390
667074993633,2cyclictest843953-21kworker/u8:0+events_unbound22:50:200
667074993633,2cyclictest771445-21kworker/u8:0+events_unbound21:08:400
667074993633,2cyclictest677346-21kworker/u8:2+events_unbound19:40:220
667074993632,3cyclictest807628-21kworker/u8:4+events_unbound21:36:420
667074993632,3cyclictest807628-21kworker/u8:4+events_unbound21:27:550
667079993532,2cyclictest713899-21kworker/u8:3+events_unbound20:25:263
667075993532,2cyclictest932751-21kworker/u8:2+events_unbound00:04:371
667074993532,2cyclictest713899-21kworker/u8:3+events_unbound20:30:200
667074993532,2cyclictest713899-21kworker/u8:3+events_unbound20:25:240
667074993531,3cyclictest880362-21kworker/u8:1+events_unbound23:07:410
667074993431,2cyclictest843953-21kworker/u8:0+events_unbound22:10:130
667074993430,3cyclictest677346-21kworker/u8:2+events_unbound19:33:400
667079993329,3cyclictest911702-21kworker/u8:0+flush-259:023:49:593
667079993325,6cyclictest776563-21latency_hist20:55:013
667075993330,2cyclictest921999-21apt-get23:15:011
667074993330,2cyclictest932751-21kworker/u8:2+events_unbound00:05:260
667074993330,2cyclictest880362-21kworker/u8:1+events_unbound23:35:270
667074993330,2cyclictest880362-21kworker/u8:1+events_unbound22:45:240
667074993330,2cyclictest729540-21kworker/u8:1+events_unbound21:10:150
667078993224,6cyclictest890616-21latency_hist22:45:002
667074993229,3cyclictest968800-21kworker/u8:4+events_unbound00:01:410
667074993229,2cyclictest792007-21kworker/u8:3+events_unbound21:45:230
667074993229,2cyclictest739625-21kworker/u8:2+events_unbound21:00:140
667079993126,3cyclictest990160-21/usr/sbin/munin00:20:143
667078993124,5cyclictest766480-21/usr/sbin/munin20:45:132
667074993128,2cyclictest895998-21kworker/u8:3+events_unbound23:25:130
667074993128,2cyclictest880362-21kworker/u8:1+events_unbound23:23:410
667074993128,2cyclictest698619-21kworker/u8:4+events_unbound20:08:400
667079993025,4cyclictest677346-21kworker/u8:2+flush-259:019:30:003
667079993024,4cyclictest838389-21gpgv21:55:003
667075993027,2cyclictest739625-21kworker/u8:2+flush-259:020:30:001
667074993027,2cyclictest968800-21kworker/u8:4+events_unbound00:10:280
667074993027,2cyclictest797359-21kworker/u8:2+events_unbound21:21:400
667074993026,3cyclictest895998-21kworker/u8:3+events_unbound23:00:250
667078992923,4cyclictest900959-21apt-get22:55:002
667075992925,3cyclictest335557-21systemd-journal22:20:391
667074992925,3cyclictest713899-21kworker/u8:3+events_unbound20:47:460
667079992825,2cyclictest677346-21kworker/u8:2+events_unbound19:45:213
667079992822,4cyclictest865139-21/usr/sbin/munin22:20:143
667075992823,4cyclictest984357-21latency_hist00:15:001
667074992825,2cyclictest890640-21kworker/u8:2+flush-259:022:55:390
667074992825,2cyclictest792007-21kworker/u8:3+events_unbound22:05:250
667079992721,3cyclictest995322-21/usr/sbin/munin00:25:143
667079992720,5cyclictest894914-21ntpq22:45:223
667075992723,3cyclictest880362-21kworker/u8:1+flush-259:023:59:591
667075992723,3cyclictest880362-21kworker/u8:1+flush-259:023:15:171
667075992723,3cyclictest335557-21systemd-journal23:35:401
667074992724,2cyclictest729540-21kworker/u8:1+events_unbound21:40:210
667074992721,4cyclictest875206-21latency_hist22:30:010
667079992623,2cyclictest698619-21kworker/u8:4+events_unbound20:19:413
667079992622,3cyclictest729540-21kworker/u8:1+events_unbound21:27:413
667079992622,3cyclictest713899-21kworker/u8:3+events_unbound20:30:143
667079992621,3cyclictest766337-21base6420:45:013
667079992621,3cyclictest708976-21apt-get19:50:133
667075992621,3cyclictest880346-21latency_hist22:35:001
667075992620,4cyclictest859763-21latency_hist22:15:001
667074992623,2cyclictest792007-21kworker/u8:3+events_unbound22:20:280
667074992623,2cyclictest729540-21kworker/u8:1+events_unbound21:30:260
667074992621,4cyclictest885716-21/usr/sbin/munin22:40:150
667079992521,3cyclictest729540-21kworker/u8:1+events_unbound21:10:193
667079992521,3cyclictest713899-21kworker/u8:3+events_unbound20:01:403
667079992519,4cyclictest890640-21kworker/u8:2+flush-259:023:10:163
667078992519,4cyclictest792007-21kworker/u8:3+flush-259:021:45:172
667078992518,5cyclictest1000504-21/usr/sbin/munin00:30:152
667075992522,2cyclictest890640-21kworker/u8:2+events_unbound22:59:581
667075992522,2cyclictest713899-21kworker/u8:3+events_unbound20:44:571
667074992522,2cyclictest792007-21kworker/u8:3+events_unbound22:35:150
667079992420,3cyclictest880362-21kworker/u8:1+flush-259:023:05:013
667079992418,4cyclictest509-21rs:main3
667078992418,4cyclictest719034-21latency_hist20:00:012
667078992417,5cyclictest917053-21/usr/sbin/munin23:10:152
667078992410,4cyclictest843007-21ntpq21:55:202
667075992421,2cyclictest807628-21kworker/u8:4+events_unbound21:27:531
667075992421,2cyclictest729540-21kworker/u8:1+events_unbound21:52:581
667075992419,4cyclictest911939-21apt-get23:05:111
667074992420,3cyclictest500-21systemd-logind21:55:000
667079992321,1cyclictest698619-21kworker/u8:4+events_unbound20:05:203
667079992319,3cyclictest911702-21kworker/u8:0+events_unbound23:36:403
667079992319,3cyclictest792007-21kworker/u8:3+events_unbound22:25:183
667079992319,3cyclictest729540-21kworker/u8:1+flush-259:021:15:253
667078992318,3cyclictest938170-21/usr/sbin/munin23:30:222
667078992316,5cyclictest335557-21systemd-journal20:30:002
667075992320,2cyclictest963504-21kworker/u8:3+events_unbound00:05:031
667075992319,3cyclictest880362-21kworker/u8:1+flush-259:023:35:001
667074992320,2cyclictest989941-21kworker/u8:0+events_unbound00:25:120
667074992320,2cyclictest651759-21kworker/u8:0+events_unbound19:25:150
667074992319,3cyclictest932751-21kworker/u8:2+events_unbound00:15:030
667079992219,2cyclictest651759-21kworker/u8:0+flush-259:019:20:243
667079992218,3cyclictest890640-21kworker/u8:2+events_unbound22:55:153
667079992218,3cyclictest713899-21kworker/u8:3+flush-259:020:10:263
667079992218,2cyclictest843953-21kworker/u8:0+flush-259:022:50:173
66707899225,10cyclictest687672-21munin-run19:30:002
667078992219,2cyclictest838365-21turbostat.cron21:55:002
667075992216,4cyclictest771400-21latency_hist20:50:011
667074992219,2cyclictest968800-21kworker/u8:4+events_unbound00:23:200
667079992118,2cyclictest963504-21kworker/u8:3+events_unbound00:00:233
667079992117,3cyclictest989941-21kworker/u8:0+flush-259:000:38:393
667079992117,3cyclictest677346-21kworker/u8:2+flush-259:019:30:163
667075992118,2cyclictest807628-21kworker/u8:4+flush-259:021:30:191
667074992118,2cyclictest911702-21kworker/u8:0+events_unbound23:46:460
667074992118,2cyclictest880362-21kworker/u8:1+events_unbound23:51:450
667074992118,2cyclictest880362-21kworker/u8:1+events_unbound23:15:260
667079992018,1cyclictest932751-21kworker/u8:2+events_unbound00:15:213
667079992016,3cyclictest932751-21kworker/u8:2+events_unbound00:08:383
667079992014,4cyclictest335557-21systemd-journal19:40:403
667078992017,2cyclictest817742-21cron21:35:002
667078992016,3cyclictest729540-21kworker/u8:1+flush-259:021:00:002
667078992014,4cyclictest677346-21kworker/u8:2+flush-259:019:45:252
667078992013,5cyclictest667287-21kworker/u8:1+flush-259:019:10:162
667075992019,1cyclictest771445-21kworker/u8:0+events_unbound21:09:571
667075992017,2cyclictest771445-21kworker/u8:0+events_unbound21:11:521
667075992016,3cyclictest335557-21systemd-journal21:55:001
667075992013,5cyclictest672161-21latency_hist19:15:001
667074992017,2cyclictest932751-21kworker/u8:2+events_unbound23:33:190
667079991916,2cyclictest895998-21kworker/u8:3+events_unbound23:25:223
667079991916,2cyclictest729540-21kworker/u8:1+flush-259:021:05:263
667079991915,3cyclictest843953-21kworker/u8:0+flush-259:022:40:243
667079991915,3cyclictest729540-21kworker/u8:1+events_unbound21:04:563
667079991915,3cyclictest651759-21kworker/u8:0+events_unbound19:35:193
667079991914,3cyclictest797359-21kworker/u8:2+events_unbound21:20:243
667079991913,4cyclictest864904-21latency_hist22:20:003
667078991913,4cyclictest509-21rs:main2
667075991918,1cyclictest713899-21kworker/u8:3+events_unbound19:55:541
667075991917,2cyclictest989941-21kworker/u8:0+events_unbound00:23:531
667075991917,2cyclictest880362-21kworker/u8:1+events_unbound23:45:001
667075991917,2cyclictest729540-21kworker/u8:1+events_unbound20:33:171
667075991917,2cyclictest713899-21kworker/u8:3+events_unbound20:03:171
667075991917,2cyclictest698619-21kworker/u8:4+events_unbound20:09:121
667075991917,2cyclictest677346-21kworker/u8:2+events_unbound19:45:011
667075991917,2cyclictest677346-21kworker/u8:2+events_unbound19:25:011
667075991917,2cyclictest667287-21kworker/u8:1+events_unbound19:35:301
667075991916,2cyclictest713899-21kworker/u8:3+events_unbound20:36:371
667075991914,4cyclictest677617-21apt-get19:20:131
66707599190,17cyclictest1-21systemd23:55:001
667074991916,2cyclictest698619-21kworker/u8:4+events_unbound20:19:570
667074991915,3cyclictest651759-21kworker/u8:0+events_unbound19:36:570
667074991915,2cyclictest713899-21kworker/u8:3+events_unbound20:20:130
667079991815,2cyclictest771445-21kworker/u8:0+events_unbound20:55:163
667079991814,3cyclictest911702-21kworker/u8:0+events_unbound23:40:153
667079991814,3cyclictest880362-21kworker/u8:1+flush-259:023:52:443
667079991814,3cyclictest807628-21kworker/u8:4+events_unbound21:35:173
667079991814,3cyclictest729540-21kworker/u8:1+flush-259:021:30:253
667079991813,3cyclictest335557-21systemd-journal22:39:393
667079991813,3cyclictest335557-21systemd-journal19:19:553
667078991815,2cyclictest0-21swapper/200:40:012
667078991813,4cyclictest880362-21kworker/u8:1+flush-259:022:48:132
667078991813,4cyclictest713899-21kworker/u8:3+flush-259:020:40:152
667078991812,4cyclictest708734-21kworker/u8:1+flush-259:020:00:252
667075991816,2cyclictest880362-21kworker/u8:1+events_unbound23:43:111
667075991816,2cyclictest880362-21kworker/u8:1+events_unbound23:22:471
667075991816,2cyclictest880362-21kworker/u8:1+events_unbound22:48:581
667075991816,2cyclictest843953-21kworker/u8:0+events_unbound22:52:451
667075991816,2cyclictest739625-21kworker/u8:2+events_unbound20:53:111
667075991816,2cyclictest729540-21kworker/u8:1+events_unbound21:04:501
667075991815,2cyclictest963504-21kworker/u8:3+events_unbound00:27:481
667075991815,2cyclictest895998-21kworker/u8:3+events_unbound23:26:131
667075991815,2cyclictest797359-21kworker/u8:2+events_unbound21:22:311
667075991815,2cyclictest2811569-21kworker/u8:3+events_unbound19:18:501
667075991814,3cyclictest734735-21apt-get20:15:121
667074991815,2cyclictest729540-21kworker/u8:1+flush-259:020:42:500
667074991815,2cyclictest729540-21kworker/u8:1+events_unbound20:37:110
667074991815,2cyclictest698619-21kworker/u8:4+events_unbound19:52:380
667074991812,4cyclictest335557-21systemd-journal19:20:400
667079991714,2cyclictest729540-21kworker/u8:1+flush-259:021:46:443
667079991714,2cyclictest729540-21kworker/u8:1+flush-259:020:39:443
667079991713,3cyclictest895998-21kworker/u8:3+flush-259:023:15:443
667079991713,3cyclictest792007-21kworker/u8:3+events_unbound21:55:133
667078991712,4cyclictest729540-21kworker/u8:1+flush-259:020:37:442
667078991711,4cyclictest738669-21ntpq20:15:212
667078991710,6cyclictest0-21swapper/222:25:002
667078991710,5cyclictest848636-21ntpq22:00:232
667075991715,2cyclictest792007-21kworker/u8:3+events_unbound22:27:371
667075991715,2cyclictest729540-21kworker/u8:1+events_unbound21:18:051
667075991715,2cyclictest677346-21kworker/u8:2+events_unbound19:42:471
667075991715,1cyclictest792007-21kworker/u8:3+events_unbound22:09:381
667075991714,2cyclictest792007-21kworker/u8:3+events_unbound22:03:141
667074991715,2cyclictest843953-21kworker/u8:0+events_unbound22:00:270
667074991714,2cyclictest713899-21kworker/u8:3+events_unbound19:58:410
667079991613,2cyclictest880362-21kworker/u8:1+events_unbound23:34:393
667079991613,2cyclictest843953-21kworker/u8:0+flush-259:022:30:203
667079991613,2cyclictest729540-21kworker/u8:1+flush-259:021:40:203
667079991611,3cyclictest843953-21kworker/u8:0+flush-259:022:00:263
66707899167,5cyclictest901399-21cat22:55:022
667078991614,1cyclictest0-21swapper/221:40:002
667078991610,2cyclictest509-21rs:main2
667075991614,2cyclictest729540-21kworker/u8:1+events_unbound21:38:181
667075991614,2cyclictest708734-21kworker/u8:1+events_unbound19:54:271
667075991613,2cyclictest989941-21kworker/u8:0+events_unbound00:39:501
667074991613,2cyclictest729540-21kworker/u8:1+events_unbound21:59:560
66707899158,5cyclictest932751-21kworker/u8:2+flush-259:000:20:002
667078991511,3cyclictest335557-21systemd-journal23:25:402
66707899151,11cyclictest880337-21awk22:35:012
66707599155,2cyclictest32-21ksoftirqd/122:45:011
66707599153,3cyclictest691618-21cut19:30:191
667075991512,2cyclictest911665-21idleruntime-cro23:05:001
667075991512,2cyclictest843953-21kworker/u8:0+events_unbound22:17:511
667075991512,2cyclictest843953-21kworker/u8:0+events_unbound22:17:511
66707499157,1cyclictest191rcu_preempt22:15:180
66707499157,1cyclictest191rcu_preempt22:15:180
66707999149,4cyclictest335557-21systemd-journal00:34:453
667079991412,1cyclictest967862-21ntpq23:55:213
667079991411,2cyclictest843953-21kworker/u8:0+events_unbound22:15:163
667079991410,3cyclictest729540-21kworker/u8:1+flush-259:022:10:063
66707899149,4cyclictest880362-21kworker/u8:1+flush-259:023:50:262
66707899148,4cyclictest729540-21kworker/u8:1+flush-259:020:33:102
66707899147,5cyclictest984356-21apt-get00:14:592
667078991410,3cyclictest729540-21kworker/u8:1+flush-259:021:40:262
667078991410,2cyclictest1-21systemd00:25:012
66707599141,4cyclictest32-21ksoftirqd/121:40:221
667075991412,2cyclictest729540-21kworker/u8:1+events_unbound21:46:161
667075991410,3cyclictest989048-21ntp_kernel_pll_00:15:231
66707499147,2cyclictest708734-21kworker/u8:1-events_unbound20:00:140
667079991311,1cyclictest713899-21kworker/u8:3+events_unbound20:20:193
667079991310,2cyclictest880362-21kworker/u8:1+events_unbound23:20:123
667079991310,2cyclictest2811569-21kworker/u8:3+events_unbound19:10:243
66707899139,3cyclictest881626-21tr22:35:192
66707899139,3cyclictest739625-21kworker/u8:2+flush-259:021:00:172
66707899139,3cyclictest729318-21munin-run20:10:002
66707899139,3cyclictest667287-21kworker/u8:1+flush-259:019:15:242
66707899138,3cyclictest677346-21kworker/u8:2+flush-259:019:33:102
66707899137,3cyclictest911702-21kworker/u8:0+flush-259:023:35:272
66707899136,1cyclictest0-21swapper/200:04:592
66707599139,1cyclictest191rcu_preempt20:10:141
66707599132,2cyclictest32-21ksoftirqd/122:35:201
66707499138,2cyclictest0-21swapper/019:10:010
667079991210,1cyclictest0-21swapper/323:05:163
66707899129,2cyclictest978718-21unixbench_singl00:05:252
66707899129,2cyclictest698717-21cpuspeed_turbos19:40:122
66707899129,2cyclictest697951-21idleruntime-cro19:40:002
66707899129,2cyclictest0-21swapper/219:55:002
66707899127,3cyclictest948751-21perl23:40:142
66707899126,4cyclictest1-21systemd21:15:012
66707999118,2cyclictest0-21swapper/300:10:193
66707899118,2cyclictest807105-21runrttasks21:21:392
66707899118,1cyclictest0-21swapper/223:20:242
66707899115,4cyclictest787262-21diskstats21:05:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional