You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-28 - 00:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Wed May 27, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3638510994442,1cyclictest577786-21kworker/1:0+pm08:38:211
3638510994440,3cyclictest3888430-21kworker/u8:0+flush-259:011:55:001
3638508994439,3cyclictest3914648-21kworker/u8:4+flush-259:011:40:200
3638508994136,3cyclictest3628460-21kworker/u8:3+events_unbound07:45:010
3638518993934,3cyclictest3950642-21kworker/u8:2+flush-259:012:35:003
3638508993935,3cyclictest3716115-21kworker/u8:0+flush-259:008:50:010
3638508993830,6cyclictest3950031-21ntpq12:05:220
3638513993630,4cyclictest3919753-21base6411:40:002
3638510993631,3cyclictest335557-21systemd-journal08:41:321
3638518993529,4cyclictest3710422-21ntpq08:15:203
3638508993532,2cyclictest3914648-21kworker/u8:4+flush-259:011:45:200
3638508993430,3cyclictest211rcuc/008:45:010
3638508993428,4cyclictest335557-21systemd-journal10:45:000
3638513993326,5cyclictest3658542-21ntpq07:25:212
3638508993328,3cyclictest3789454-21kworker/u8:2+flush-259:009:45:150
3638508993328,3cyclictest3789454-21kworker/u8:2+flush-259:009:45:150
3638518993227,4cyclictest335557-21systemd-journal12:10:013
3638510993226,4cyclictest3830175-21ntpq10:10:191
3638510993127,3cyclictest3805219-21kworker/u8:3+flush-259:010:20:251
3638510993125,4cyclictest3981769-21latency_hist12:40:001
3638513993026,3cyclictest3841568-21cat10:25:012
3638513993025,3cyclictest509-21rs:main2
3638513993024,4cyclictest3893830-21latency_hist11:15:002
3638508993026,3cyclictest3716115-21kworker/u8:0+events_unbound09:01:330
3638510992923,4cyclictest335557-21systemd-journal09:38:321
3638510992923,4cyclictest335557-21systemd-journal07:22:311
3638508992925,3cyclictest3888430-21kworker/u8:0+events_unbound11:54:340
3638508992925,3cyclictest3585191-21kworker/u8:4+events_unbound07:12:390
3638508992923,4cyclictest3857399-21latency_hist10:40:010
3638518992824,3cyclictest3830712-21kworker/u8:2+flush-259:011:05:143
3638510992822,4cyclictest3679616-21ntpq07:45:211
3638510992821,5cyclictest3746554-21ntpq08:50:211
3638518992721,4cyclictest335557-21systemd-journal07:15:003
3638510992723,3cyclictest3888430-21kworker/u8:0+flush-259:011:45:231
3638508992724,2cyclictest3830712-21kworker/u8:2+flush-259:010:45:230
3638508992723,3cyclictest3914648-21kworker/u8:4+events_unbound12:00:210
3638508992723,3cyclictest3914648-21kworker/u8:4+events_unbound12:00:200
3638508992723,3cyclictest3585191-21kworker/u8:4+flush-259:007:15:160
3638513992623,2cyclictest3888430-21kworker/u8:0+flush-259:012:20:002
3638513992621,3cyclictest3716726-21/usr/sbin/munin08:25:212
3638510992620,4cyclictest3857630-21/usr/sbin/munin10:40:131
3638508992623,2cyclictest3585191-21kworker/u8:4+flush-259:007:55:260
3638508992622,3cyclictest3757781-21kworker/u8:2+events_unbound09:07:340
3638508992622,3cyclictest3617959-21kworker/u8:1+events_unbound08:20:190
3638508992618,5cyclictest3680454-21latency_hist07:50:010
3638518992521,3cyclictest335557-21systemd-journal11:30:003
3638508992521,3cyclictest3888430-21kworker/u8:0+events_unbound11:20:230
3638508992521,3cyclictest3628460-21kworker/u8:3+events_unbound08:04:330
3638508992520,4cyclictest3914648-21kworker/u8:4+events_unbound12:13:320
3638508992519,4cyclictest3878032-21kworker/u8:1+flush-259:011:00:110
3638508992518,5cyclictest3638435-21latency_hist07:10:000
3638518992420,3cyclictest3737124-21kworker/u8:3+flush-259:008:55:013
3638518992418,4cyclictest335557-21systemd-journal08:00:003
3638513992419,3cyclictest3920263-21munin-node11:40:102
3638510992420,3cyclictest3888430-21kworker/u8:0+events_unbound12:05:181
3638508992421,2cyclictest3862787-21kworker/u8:0+flush-259:010:50:220
3638508992420,3cyclictest3970588-21ntpq12:25:210
3638508992420,3cyclictest3914648-21kworker/u8:4+flush-259:011:40:000
3638508992420,3cyclictest3747682-21kworker/u8:1+flush-259:009:40:370
3638508992419,4cyclictest3767233-21ntpq09:10:210
3638508992419,4cyclictest335557-21systemd-journal10:20:000
3638508992419,3cyclictest3648979-21apt-get07:20:100
3638508992416,5cyclictest3659625-21cp07:30:010
3638513992319,3cyclictest3950642-21kworker/u8:2+flush-259:012:25:012
3638513992319,3cyclictest3675504-21kworker/u8:0+flush-259:007:45:162
363851399231,20cyclictest1-21systemd08:55:012
3638510992319,3cyclictest3805219-21kworker/u8:3+flush-259:009:50:241
3638510992319,2cyclictest3685598-21sh07:54:591
3638508992320,2cyclictest3955983-21kworker/u8:1+events_unbound12:24:330
3638508992319,3cyclictest3914648-21kworker/u8:4+flush-259:011:55:150
3638508992319,3cyclictest3747682-21kworker/u8:1+events_unbound10:05:130
3638518992216,4cyclictest3701059-21latency_hist08:10:013
3638513992218,3cyclictest3789454-21kworker/u8:2+flush-259:009:40:152
3638513992216,4cyclictest3976584-21latency_hist12:35:012
3638510992218,3cyclictest3585191-21kworker/u8:4+flush-259:008:05:251
3638510992216,4cyclictest335557-21systemd-journal07:39:001
3638510992214,6cyclictest3800043-21latency_hist09:45:011
3638508992218,3cyclictest3747682-21kworker/u8:1+flush-259:009:25:190
3638508992216,4cyclictest509-21rs:main0
3638508992215,5cyclictest3664175-21ntpq07:30:220
3638518992117,3cyclictest3872971-21gpgv10:55:023
3638518992115,4cyclictest3788976-21base6409:35:003
3638518992115,4cyclictest335557-21systemd-journal10:42:323
3638513992116,4cyclictest3951094-21/usr/sbin/munin12:10:132
3638510992118,2cyclictest3976583-21sh12:35:011
3638510992115,4cyclictest3773555-21apt-get09:20:111
3638508992117,3cyclictest3617959-21kworker/u8:1+events_unbound08:15:140
3638508992116,4cyclictest3665265-21apt-get07:35:120
3638508992114,5cyclictest3705276-21ntpq08:10:200
3638518992015,4cyclictest3847042-21latency_hist10:30:013
3638518992014,4cyclictest3752868-21apt-get09:00:123
3638513992018,1cyclictest0-21swapper/208:40:012
3638510992016,3cyclictest3888965-21apt-get11:10:111
3638510992014,4cyclictest3914648-21kworker/u8:4+flush-259:011:35:151
3638510992014,4cyclictest3878640-21/usr/sbin/munin11:00:131
3638508992016,3cyclictest3862787-21kworker/u8:0+flush-259:010:55:160
3638508992014,4cyclictest335557-21systemd-journal08:05:320
3638508992013,5cyclictest3899002-21latency_hist11:20:000
3638518991915,3cyclictest335557-21systemd-journal11:44:593
3638518991914,3cyclictest3794418-21latency_hist09:40:003
3638513991915,3cyclictest3670420-21apt-get07:40:112
3638510991915,3cyclictest3815193-21kworker/u8:0+flush-259:010:35:151
3638510991913,4cyclictest3762933-21latency_hist09:10:001
3638510991912,5cyclictest3956251-21/usr/sbin/munin12:15:141
3638508991916,2cyclictest3747682-21kworker/u8:1+events_unbound09:39:230
3638508991915,3cyclictest3888430-21kworker/u8:0+flush-259:012:30:240
3638508991915,3cyclictest3617959-21kworker/u8:1+flush-259:008:30:220
3638508991913,4cyclictest3841419-21latency_hist10:25:010
3638508991913,4cyclictest3773294-21latency_hist09:20:000
3638518991815,2cyclictest3757781-21kworker/u8:2+flush-259:009:10:173
3638518991814,3cyclictest3628460-21kworker/u8:3+flush-259:008:00:373
3638518991813,4cyclictest3919806-21gpgv11:40:003
3638513991815,2cyclictest3888430-21kworker/u8:0+flush-259:011:51:022
3638513991815,2cyclictest3830712-21kworker/u8:2+flush-259:010:45:262
3638513991813,3cyclictest335557-21systemd-journal10:35:322
3638510991815,2cyclictest3920698-21irqcore11:40:161
3638510991811,5cyclictest3841416-21apt-get10:25:011
3638508991815,2cyclictest3737124-21kworker/u8:3+flush-259:008:55:190
3638508991814,3cyclictest3747682-21kworker/u8:1+events_unbound10:02:060
3638508991814,3cyclictest3747682-21kworker/u8:1+events_unbound09:57:050
3638508991814,3cyclictest3617959-21kworker/u8:1+events_unbound07:50:270
3638518991715,1cyclictest3833639-21kthreadcore10:15:163
3638518991712,4cyclictest3670162-21latency_hist07:40:013
3638513991713,3cyclictest3617959-21kworker/u8:1+flush-259:008:45:242
3638513991713,3cyclictest335557-21systemd-journal09:52:322
3638513991713,3cyclictest335557-21systemd-journal07:30:012
3638510991714,2cyclictest3789004-21latency_hist09:35:001
3638510991712,4cyclictest3815814-21/usr/sbin/munin10:00:191
3638510991711,4cyclictest3971423-21latency_hist12:30:001
3638510991710,2cyclictest2971-21cron09:00:011
3638508991714,2cyclictest3955983-21kworker/u8:1+flush-259:012:15:140
3638508991713,3cyclictest3830712-21kworker/u8:2+flush-259:011:05:140
3638508991713,3cyclictest3716115-21kworker/u8:0+flush-259:008:50:320
3638508991713,3cyclictest3617959-21kworker/u8:1+events_unbound08:39:330
3638508991712,3cyclictest60350irq/132-enp0s29f1:rx-009:50:220
3638518991613,2cyclictest3914648-21kworker/u8:4+flush-259:011:55:233
3638518991613,2cyclictest3898994-21idleruntime-cro11:20:003
3638518991613,2cyclictest3731947-21turbostat.cron08:40:003
3638518991612,3cyclictest3648954-21/usr/sbin/munin07:20:133
3638513991614,1cyclictest3936113-21irqcore11:55:162
3638513991613,2cyclictest3617959-21kworker/u8:1+flush-259:008:45:012
3638513991612,3cyclictest3773314-21kworker/u8:5+flush-259:009:20:152
3638513991611,4cyclictest3842103-21apt-get10:25:112
3638513991611,4cyclictest335557-21systemd-journal11:49:312
3638510991614,1cyclictest3873961-21irqcore10:55:161
3638510991613,2cyclictest3742242-21idleruntime-cro08:50:001
3638510991613,1cyclictest0-21swapper/110:55:001
3638508991612,3cyclictest3888430-21kworker/u8:0+events_unbound11:25:070
3638508991612,3cyclictest3842070-21kworker/u8:4+flush-259:010:30:220
3638508991612,3cyclictest3773314-21kworker/u8:5+flush-259:009:20:230
3638508991611,3cyclictest3805219-21kworker/u8:3+flush-259:010:10:100
3638508991610,4cyclictest3950642-21kworker/u8:2+events_unbound12:39:200
3638518991512,2cyclictest3914648-21kworker/u8:4+flush-259:011:45:043
3638518991512,2cyclictest3659901-21apt-config07:30:003
3638518991511,3cyclictest3585191-21kworker/u8:4+flush-259:007:50:003
3638518991510,3cyclictest335557-21systemd-journal10:15:003
3638513991513,1cyclictest3901538-21kthreadcore11:20:182
3638513991513,1cyclictest0-21swapper/207:25:002
3638513991512,2cyclictest3722908-21kthreadcore08:30:172
3638513991511,3cyclictest3830712-21kworker/u8:2+flush-259:011:00:162
3638513991511,3cyclictest3617959-21kworker/u8:1+flush-259:008:20:232
363851099159,4cyclictest3909518-21/usr/sbin/munin11:30:131
3638510991513,1cyclictest3706207-21idleruntime-cro08:15:001
3638510991511,3cyclictest3914648-21kworker/u8:4+flush-259:012:10:151
3638510991510,3cyclictest3628460-21kworker/u8:3+flush-259:007:25:181
3638508991512,2cyclictest60350irq/132-enp0s29f1:rx-011:10:120
3638508991511,3cyclictest3747682-21kworker/u8:1+events_unbound09:32:160
3638518991412,1cyclictest0-21swapper/307:35:003
3638518991411,2cyclictest3815943-21cpuspeed_turbos10:00:123
3638518991411,2cyclictest3769394-21tr09:15:163
3638518991411,2cyclictest3762962-21kworker/u8:4+flush-259:009:25:003
3638518991411,2cyclictest3716115-21kworker/u8:0+flush-259:008:34:033
3638518991410,3cyclictest3617959-21kworker/u8:1+flush-259:008:42:033
3638513991410,3cyclictest3747682-21kworker/u8:1+flush-259:010:10:222
3638513991410,3cyclictest335557-21systemd-journal09:13:322
363851099148,4cyclictest335557-21systemd-journal10:17:001
363851099146,5cyclictest335557-21systemd-journal09:15:001
3638510991411,2cyclictest3899267-21apt-get11:20:111
3638510991411,2cyclictest0-21swapper/107:30:161
3638510991410,3cyclictest3644098-21fschecks_time07:15:161
3638508991411,2cyclictest60350irq/132-enp0s29f1:rx-010:26:440
363851899139,3cyclictest3930520-21apt-get11:50:103
3638518991311,1cyclictest3971421-21apt12:30:003
3638518991310,2cyclictest3893364-21unixbench_multi11:10:243
3638518991310,2cyclictest3674798-21unixbench_multi07:40:233
3638518991310,2cyclictest0-21swapper/312:15:003
3638518991310,2cyclictest0-21swapper/309:50:013
3638518991310,2cyclictest0-21swapper/309:50:003
363851399139,3cyclictest3805219-21kworker/u8:3+flush-259:010:10:002
3638513991310,2cyclictest3815193-21kworker/u8:0+flush-259:010:00:242
3638513991310,2cyclictest3685592-21sh07:55:002
3638513991310,2cyclictest0-21swapper/207:15:182
3638513991310,1cyclictest0-21swapper/212:00:142
3638513991310,1cyclictest0-21swapper/212:00:142
363851099139,3cyclictest3789454-21kworker/u8:2+flush-259:009:45:241
363851099139,3cyclictest3789454-21kworker/u8:2+flush-259:009:45:241
363851099138,4cyclictest3747682-21kworker/u8:1+flush-259:009:55:051
3638510991310,2cyclictest3888430-21kworker/u8:0+flush-259:011:55:031
3638510991310,2cyclictest2971-21cron12:05:011
3638510991310,2cyclictest2971-21cron12:05:001
3638508991310,2cyclictest60350irq/132-enp0s29f1:rx-011:30:120
363851899129,2cyclictest3883072-21unixbench_multi11:00:233
3638518991210,1cyclictest0-21swapper/310:25:003
3638518991210,1cyclictest0-21swapper/310:00:003
363851399129,2cyclictest3847365-21cpuspeed_turbos10:30:112
363851399129,2cyclictest3747682-21kworker/u8:1+flush-259:008:55:262
3638513991210,1cyclictest0-21swapper/211:15:222
363851099127,3cyclictest3830712-21kworker/u8:2+flush-259:011:15:031
363851899119,1cyclictest3742255-21cron08:50:013
363851899118,2cyclictest3805880-21irqcore09:50:153
363851899118,2cyclictest3758279-21fschecks_time09:05:133
363851899118,2cyclictest3643964-21cpuspeed_turbos07:15:143
363851899110,3cyclictest37989142sort09:40:173
363851399118,2cyclictest3909608-21cpuspeed_turbos11:30:122
363851399118,2cyclictest3695484-21unixbench_singl08:00:262
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional