You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-09 - 11:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Wed Sep 09, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3874205994641,3cyclictest3879587-21apt-get19:15:141
3874205994438,4cyclictest4135752-21latency_hist23:20:011
3874212993734,2cyclictest3989727-21kworker/u8:0+flush-259:021:10:253
3874202993733,3cyclictest3978818-21kworker/u8:2+flush-259:021:20:260
3874212993633,2cyclictest3948148-21kworker/u8:0+events_unbound20:20:203
3874205993529,4cyclictest4136013-21apt-get23:20:121
3874212993430,3cyclictest3878310-21kworker/u8:3+events_unbound20:00:013
3874205993418,8cyclictest4041480-21cut21:50:001
3874212993229,2cyclictest4145916-21kworker/u8:2+flush-259:023:30:253
3874212993229,2cyclictest3921566-21kworker/u8:1+flush-259:020:05:213
3874208993227,4cyclictest4062845-21kworker/u8:3+flush-259:022:45:002
3874202993228,3cyclictest4115126-21kworker/u8:3+flush-259:000:10:250
3874212993128,3cyclictest4020849-21kworker/u8:0+flush-259:022:10:243
3874212993128,2cyclictest4115126-21kworker/u8:3+events_unbound00:30:183
3874212993127,3cyclictest509-21rs:main3
3874208993124,4cyclictest3895267-21latency_hist19:30:002
3874205993125,4cyclictest335557-21systemd-journal23:30:011
3874205993125,4cyclictest335557-21systemd-journal23:12:171
3874202993127,3cyclictest3995147-21apt-get21:05:110
3874202993127,3cyclictest3958829-21kworker/u8:1+flush-259:020:35:010
3874202993127,3cyclictest3927386-21apt-get20:00:120
3874212993028,2cyclictest3863485-21kworker/u8:0+events_unbound19:15:183
3874212993027,2cyclictest4115126-21kworker/u8:3+flush-259:023:40:253
3874212993027,2cyclictest4099189-21kworker/u8:0+events_unbound23:00:153
3874212993025,3cyclictest4109595-21gpgv22:55:013
3874202993027,2cyclictest4052248-21kworker/u8:1+flush-259:022:05:210
3874212992926,2cyclictest4151285-21kworker/u8:1+flush-259:023:45:213
3874212992926,2cyclictest4052248-21kworker/u8:1+flush-259:022:05:243
3874205992924,3cyclictest3958829-21kworker/u8:1+flush-259:021:10:011
3874205992923,4cyclictest25186-21latency_hist00:40:001
3874202992922,5cyclictest3932326-21apt-get20:05:010
3874212992823,4cyclictest4046839-21cp21:55:003
3874212992823,3cyclictest3983661-21ntpq20:50:223
3874208992824,2cyclictest3958829-21kworker/u8:1+flush-259:021:05:252
3874205992823,4cyclictest3978818-21kworker/u8:2+flush-259:020:50:011
3874202992825,2cyclictest3889477-21kworker/u8:2+flush-259:019:40:250
3874212992724,2cyclictest4099189-21kworker/u8:0+flush-259:023:35:263
3874212992724,2cyclictest3878310-21kworker/u8:3+events_unbound19:10:233
3874212992723,3cyclictest3978818-21kworker/u8:2+flush-259:021:40:133
3874202992721,5cyclictest335557-21systemd-journal22:50:000
3874212992623,2cyclictest4046593-21kworker/u8:2+events_unbound22:25:203
3874212992623,2cyclictest3878310-21kworker/u8:3+events_unbound19:35:193
3874205992619,4cyclictest3906051-21latency_hist19:40:001
3874202992620,4cyclictest15226-21diskstats00:30:130
3874212992522,2cyclictest4115126-21kworker/u8:3+flush-259:000:15:153
3874212992522,2cyclictest4115126-21kworker/u8:3+flush-259:000:10:213
3874212992522,2cyclictest4036632-21kworker/u8:4+events_unbound21:45:153
3874212992522,2cyclictest3978818-21kworker/u8:2+events_unbound21:35:223
3874212992521,3cyclictest3968987-21cron20:40:013
3874212992519,4cyclictest3889670-21apt-get19:25:003
3874208992520,4cyclictest4115126-21kworker/u8:3+flush-259:023:20:262
3874208992519,4cyclictest4051368-21ntpq21:55:242
3874208992519,4cyclictest335557-21systemd-journal21:00:002
3874205992520,4cyclictest4068035-21apt-get22:15:141
3874205992520,4cyclictest4068035-21apt-get22:15:141
3874205992519,5cyclictest3921804-21apt-get19:55:131
3874205992517,5cyclictest4160779-21ntpq23:40:221
3874205992512,12cyclictest4078581-21latency_hist22:25:011
3874202992521,3cyclictest3964031-21kworker/u8:4+flush-259:020:35:230
3874212992421,3cyclictest4135788-21kworker/u8:1+events_unbound23:25:153
3874205992420,3cyclictest335557-21systemd-journal23:55:171
3874202992420,3cyclictest4099189-21kworker/u8:0+events_unbound23:30:150
3874202992420,3cyclictest3953465-21kworker/u8:3+flush-259:020:25:210
3874212992320,2cyclictest3964031-21kworker/u8:4+flush-259:020:45:253
3874212992320,2cyclictest3948148-21kworker/u8:0+flush-259:020:40:163
3874212992320,2cyclictest3863485-21kworker/u8:0+flush-259:019:35:003
3874212992318,4cyclictest3911210-21latency_hist19:45:003
3874212992317,4cyclictest4078301-21cat22:25:003
3874208992320,2cyclictest4115126-21kworker/u8:3+flush-259:000:20:242
3874208992319,3cyclictest4036632-21kworker/u8:4+flush-259:021:45:252
3874202992320,2cyclictest4099189-21kworker/u8:0+flush-259:023:05:000
3874202992319,3cyclictest4072679-21kworker/u8:1+flush-259:022:55:220
3874202992319,3cyclictest4047248-21cat21:55:010
3874202992317,4cyclictest4125439-21latency_hist23:10:000
3874212992219,2cyclictest4046593-21kworker/u8:2+flush-259:022:15:263
3874212992219,2cyclictest4046593-21kworker/u8:2+flush-259:022:15:263
3874212992217,4cyclictest4115126-21kworker/u8:3+flush-259:023:50:193
3874212992216,4cyclictest335557-21systemd-journal23:25:003
3874208992214,5cyclictest3973316-21ntpq20:40:232
3874202992218,3cyclictest4151285-21kworker/u8:1+flush-259:023:55:000
3874202992218,3cyclictest3979336-21kworker/u8:3+flush-259:020:55:250
3874202992218,3cyclictest3964031-21kworker/u8:4+events_unbound20:45:210
3874202992218,3cyclictest3941991-21kworker/u8:2+events_unbound20:15:220
3874202992217,3cyclictest4151504-21/usr/sbin/munin23:35:210
3874202992216,4cyclictest4005739-21diskstats21:15:150
3874212992114,5cyclictest335557-21systemd-journal21:05:003
3874208992118,2cyclictest4057417-21turbostat.cron22:05:002
3874208992117,3cyclictest4177883-21kworker/u8:4+flush-259:000:05:192
3874205992116,3cyclictest3984529-21latency_hist20:55:011
3874205992115,4cyclictest4057673-21apt-get22:05:111
3874205992110,1cyclictest0-21swapper/120:10:011
3874202992117,3cyclictest4135788-21kworker/u8:1+events_unbound23:27:150
3874202992115,4cyclictest3890221-21cp19:25:010
3874212992017,2cyclictest3889477-21kworker/u8:2+events_unbound19:55:003
3874212992016,3cyclictest4193204-21kworker/u8:0+flush-259:000:25:203
3874212992016,3cyclictest4099189-21kworker/u8:0+events_unbound22:47:083
3874212992016,3cyclictest4046593-21kworker/u8:2+events_unbound21:55:043
3874208992016,3cyclictest4099189-21kworker/u8:0+flush-259:022:50:282
3874208992016,3cyclictest3978818-21kworker/u8:2+flush-259:021:00:182
387420599209,2cyclictest4094025-21idleruntime-cro22:40:001
3874205992015,4cyclictest335557-21systemd-journal20:26:171
3874205992015,3cyclictest3989969-21apt-get21:00:131
3874205992014,4cyclictest4015654-21latency_hist21:25:001
3874202992017,2cyclictest4062845-21kworker/u8:3+events_unbound22:38:180
3874202992017,2cyclictest3863485-21kworker/u8:0+flush-259:019:50:260
3874212991916,2cyclictest4072679-21kworker/u8:1+flush-259:022:40:213
3874212991916,2cyclictest3948148-21kworker/u8:0+events_unbound20:29:213
3874212991915,3cyclictest4193204-21kworker/u8:0+flush-259:000:35:253
3874212991915,3cyclictest4115126-21kworker/u8:3+events_unbound23:55:273
3874212991915,3cyclictest4115126-21kworker/u8:3+events_unbound23:10:133
3874212991915,3cyclictest3948148-21kworker/u8:0+events_unbound20:19:573
3874212991914,3cyclictest0-21swapper/300:10:003
3874208991912,4cyclictest335557-21systemd-journal22:35:002
3874205991914,4cyclictest4062878-21apt-get22:10:111
3874205991913,4cyclictest335557-21systemd-journal21:25:181
3874202991917,1cyclictest0-21swapper/000:30:000
3874202991916,2cyclictest3978818-21kworker/u8:2+events_unbound21:41:580
3874202991915,3cyclictest4099189-21kworker/u8:0+events_unbound23:55:230
3874202991915,3cyclictest3911468-21apt-get19:45:090
3874202991914,4cyclictest335557-21systemd-journal00:17:250
3874212991815,2cyclictest3958829-21kworker/u8:1+events_unbound20:59:563
3874212991814,3cyclictest4062845-21kworker/u8:3+events_unbound22:37:203
3874212991814,3cyclictest4046593-21kworker/u8:2+events_unbound22:30:133
3874212991814,3cyclictest4020849-21kworker/u8:0+events_unbound22:02:353
3874212991814,3cyclictest3863485-21kworker/u8:0+flush-259:019:46:333
3874208991815,2cyclictest4047107-21latency_hist21:55:002
3874208991814,3cyclictest4115126-21kworker/u8:3+flush-259:000:10:172
387420599185,4cyclictest4046664-21apt-get21:54:591
3874205991814,3cyclictest4115126-21kworker/u8:3+flush-259:023:50:261
3874202991815,2cyclictest4115126-21kworker/u8:3+events_unbound23:11:180
3874202991815,2cyclictest3978818-21kworker/u8:2+flush-259:021:25:170
3874202991815,2cyclictest3958829-21kworker/u8:1+events_unbound21:10:170
3874202991814,3cyclictest3948148-21kworker/u8:0+events_unbound20:23:180
3874212991714,2cyclictest4115126-21kworker/u8:3+events_unbound00:20:153
3874212991713,3cyclictest3989727-21kworker/u8:0+events_unbound21:16:073
3874212991713,3cyclictest3941991-21kworker/u8:2+events_unbound20:10:223
3874208991715,1cyclictest0-21swapper/221:45:002
3874208991712,4cyclictest3884752-21/usr/sbin/munin19:20:132
3874205991713,3cyclictest4151285-21kworker/u8:1+flush-259:000:15:221
3874205991710,5cyclictest4183087-21munin-node00:05:121
3874202991714,2cyclictest60350irq/132-enp0s29f1:rx-023:15:180
3874202991714,2cyclictest60350irq/132-enp0s29f1:rx-022:50:210
3874202991714,2cyclictest4193204-21kworker/u8:0+flush-259:000:38:530
3874202991713,3cyclictest3978818-21kworker/u8:2+events_unbound21:35:230
3874202991712,4cyclictest4021071-21apt-get21:30:150
3874202991711,4cyclictest335557-21systemd-journal22:31:170
3874212991613,2cyclictest4107455-21kworker/u8:2+flush-259:022:55:163
3874212991613,2cyclictest3953465-21kworker/u8:3+events_unbound20:32:193
3874212991613,2cyclictest3863485-21kworker/u8:0+events_unbound19:25:203
3874212991612,3cyclictest4099189-21kworker/u8:0+flush-259:000:00:053
387420899169,5cyclictest4161647-21latency_hist23:45:012
3874208991612,3cyclictest4193204-21kworker/u8:0+flush-259:000:36:122
3874208991612,3cyclictest3863485-21kworker/u8:0+flush-259:019:35:252
3874208991612,3cyclictest2971-21cron19:54:592
3874208991610,4cyclictest4115126-21kworker/u8:3+flush-259:023:15:002
3874208991610,4cyclictest4110165-21apt-get22:55:122
3874205991610,5cyclictest335557-21systemd-journal00:34:171
3874202991614,1cyclictest60350irq/132-enp0s29f1:rx-000:05:210
3874202991613,2cyclictest60350irq/132-enp0s29f1:rx-023:21:490
3874202991613,2cyclictest60350irq/132-enp0s29f1:rx-020:10:160
3874202991613,2cyclictest60350irq/132-enp0s29f1:rx-019:40:010
3874202991613,2cyclictest4157037-21kworker/u8:2+events_unbound23:40:180
3874202991613,2cyclictest4046593-21kworker/u8:2+flush-259:022:25:190
3874202991613,2cyclictest4036632-21kworker/u8:4+flush-259:021:50:000
3874202991612,3cyclictest3978818-21kworker/u8:2+events_unbound20:50:230
3874202991612,3cyclictest3948148-21kworker/u8:0+events_unbound20:40:130
3874202991612,3cyclictest3869036-21kworker/u8:1+events_unbound19:10:260
3874212991512,2cyclictest4115126-21kworker/u8:3+flush-259:023:05:243
3874212991512,2cyclictest4099189-21kworker/u8:0+flush-259:023:17:203
3874212991511,3cyclictest4020849-21kworker/u8:0+events_unbound21:32:393
387420899159,4cyclictest335557-21systemd-journal20:19:172
3874208991511,3cyclictest3926894-21gpgv20:00:012
387420599159,4cyclictest335557-21systemd-journal20:43:171
387420599158,5cyclictest4151266-21latency_hist23:35:011
387420599158,5cyclictest3916359-21latency_hist19:50:001
3874205991512,2cyclictest4083731-21cron22:29:591
3874205991512,2cyclictest3899960-21ntp_kernel_err19:30:201
3874205991511,3cyclictest4099189-21kworker/u8:0+flush-259:023:35:271
3874205991511,3cyclictest3932669-21apt-key20:05:001
3874202991513,2cyclictest60350irq/132-enp0s29f1:rx-021:53:360
3874202991513,2cyclictest60350irq/132-enp0s29f1:rx-019:55:210
3874202991512,2cyclictest60350irq/132-enp0s29f1:rx-022:40:250
3874202991512,2cyclictest60350irq/132-enp0s29f1:rx-022:20:250
3874202991511,3cyclictest3979336-21kworker/u8:3+events_unbound21:00:280
3874202991511,3cyclictest3863485-21kworker/u8:0+flush-259:019:20:170
387421299149,4cyclictest3978818-21kworker/u8:2+events_unbound21:21:263
3874212991411,2cyclictest4016325-21irqcore21:25:163
3874212991410,3cyclictest3927039-21latency_hist20:00:013
387420899146,5cyclictest335557-21systemd-journal21:35:002
3874208991411,2cyclictest4151789-21fschecks_time23:35:162
3874208991410,3cyclictest4026481-21fschecks_time21:35:152
387420599140,13cyclictest335480-21sshd00:23:171
3874202991412,2cyclictest60350irq/132-enp0s29f1:rx-022:11:050
3874202991412,1cyclictest60350irq/132-enp0s29f1:rx-000:00:010
3874202991412,1cyclictest4115126-21kworker/u8:3+events_unbound00:20:290
3874202991411,3cyclictest4020849-21kworker/u8:0+flush-259:022:00:190
3874202991411,2cyclictest60350irq/132-enp0s29f1:rx-019:15:140
3874202991411,2cyclictest4062845-21kworker/u8:3+flush-259:022:18:480
3874202991411,2cyclictest4062845-21kworker/u8:3+flush-259:022:18:470
387420899139,3cyclictest4046593-21kworker/u8:2+flush-259:022:15:272
387420899139,3cyclictest4046593-21kworker/u8:2+flush-259:022:15:262
387420899139,3cyclictest3953465-21kworker/u8:3+flush-259:020:30:212
387420899137,4cyclictest14799-21latency_hist00:30:002
387420899131,9cyclictest0-21swapper/222:15:002
3874208991310,2cyclictest3954121-21grep20:25:182
3874208991310,2cyclictest20017-21idleruntime-cro00:35:002
387420599139,3cyclictest4193166-21cron00:15:001
387420599139,3cyclictest3948148-21kworker/u8:0+flush-259:020:20:041
387420599136,4cyclictest3943030-21latency_hist20:15:011
3874205991310,2cyclictest4072679-21kworker/u8:1+flush-259:022:45:311
3874205991310,2cyclictest4001423-21kthreadcore21:10:171
3874202991310,2cyclictest60350irq/132-enp0s29f1:rx-023:45:130
3874202991310,2cyclictest60350irq/132-enp0s29f1:rx-019:30:110
387420899128,3cyclictest3978818-21kworker/u8:2+flush-259:021:20:262
387420899126,4cyclictest4078135-21latency_hist22:25:012
387420899121,2cyclictest4405-21awk00:20:012
387420599129,2cyclictest4105027-21irqcore22:50:201
387420599129,2cyclictest3984895-21cpuspeed_turbos20:55:131
387420599127,4cyclictest4084007-21apt-get22:30:111
387420599126,4cyclictest4151285-21kworker/u8:1+flush-259:023:45:061
387420599121,3cyclictest4031103-21awk21:39:591
387420599121,3cyclictest3969012-21munin-plugin-st20:40:011
387420899119,1cyclictest0-21swapper/223:35:012
387420899118,2cyclictest4089549-21irqcore22:35:162
387420899118,2cyclictest4020317-21unixbench_multi21:25:252
387420899118,2cyclictest3911193-21cron19:45:002
387420899117,3cyclictest4115126-21kworker/u8:3+flush-259:023:15:242
387420899116,3cyclictest335557-21systemd-journal23:00:012
387420899111,2cyclictest4125439-21latency_hist23:10:012
387420599119,1cyclictest0-21swapper/121:35:001
387420599115,4cyclictest4052658-21diskstats22:00:151
387420899105,3cyclictest3974543-21cut20:45:142
387420599101,2cyclictest4010461-21awk21:20:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional