You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 18:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Tue Jun 16, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
527751995043,5cyclictest335557-21systemd-journal07:45:012
527746994641,3cyclictest824300-21kworker/u8:1+flush-259:011:55:011
527746994537,5cyclictest599948-21ntpq08:15:221
527746994339,3cyclictest814025-21kworker/u8:4+flush-259:012:35:011
527753994237,3cyclictest575256-21/usr/sbin/munin07:55:233
527751993932,5cyclictest585327-21latency_hist08:05:012
527746993932,5cyclictest761206-21ntpq10:50:231
527753993732,3cyclictest621374-21ntpq08:35:233
527746993733,3cyclictest814025-21kworker/u8:4+events_unbound12:15:171
527751993629,5cyclictest335557-21systemd-journal10:51:242
527753993430,3cyclictest543687-21kworker/u8:0+flush-259:007:45:013
527746993431,2cyclictest507302-21kworker/u8:3+flush-259:007:30:161
527746993329,3cyclictest543905-21/usr/sbin/munin07:25:151
527743993327,4cyclictest595611-21latency_hist08:15:000
527753993227,3cyclictest736372-21kworker/u8:0+flush-259:011:40:003
527751993227,3cyclictest335557-21systemd-journal10:48:242
527746993228,3cyclictest720961-21kworker/u8:1+events_unbound11:33:251
527746993228,3cyclictest648429-21kworker/u8:0+flush-259:009:15:201
527743993228,3cyclictest829723-21apt-get12:00:090
527753993127,3cyclictest720961-21kworker/u8:1+flush-259:011:45:013
527746993128,2cyclictest814025-21kworker/u8:4+events_unbound11:55:181
527746993127,3cyclictest690132-21kworker/u8:3+events_unbound10:05:231
527743993125,4cyclictest870845-21latency_hist12:40:010
527751993026,3cyclictest767191-21gpgv11:00:002
527746993025,3cyclictest632727-21gpgv08:50:001
527746993025,3cyclictest335557-21systemd-journal07:22:211
527746993024,4cyclictest643535-21/usr/sbin/munin09:00:201
527753992923,4cyclictest509-21rs:main3
527746992926,2cyclictest569672-21kworker/u8:1+events_unbound07:55:021
527746992925,3cyclictest720961-21kworker/u8:1+events_unbound10:40:241
527746992923,2cyclictest569672-21kworker/u8:1+events_unbound08:25:221
527746992922,5cyclictest538266-21cp07:20:011
527743992924,4cyclictest335557-21systemd-journal10:39:590
527746992824,3cyclictest824300-21kworker/u8:1+events_unbound12:05:001
527746992824,3cyclictest690132-21kworker/u8:3+events_unbound09:48:231
527753992722,3cyclictest569672-21kworker/u8:1+flush-259:008:20:163
527753992721,4cyclictest335557-21systemd-journal08:02:203
527746992723,3cyclictest585558-21kworker/u8:2+events_unbound08:32:211
527746992720,5cyclictest705507-21latency_hist10:00:011
527743992721,4cyclictest854439-21ntpq12:20:200
527753992621,4cyclictest648429-21kworker/u8:0+events_unbound09:50:223
527753992620,4cyclictest616818-21cp08:35:003
527746992622,3cyclictest580181-21kworker/u8:0+flush-259:008:00:181
527746992618,3cyclictest648429-21kworker/u8:0+events_unbound09:25:001
527743992619,5cyclictest782145-21ntpq11:10:200
527743992619,5cyclictest553114-21ntpq07:30:210
527753992521,3cyclictest736372-21kworker/u8:0+flush-259:011:25:013
527753992521,3cyclictest736372-21kworker/u8:0+flush-259:011:25:003
527753992519,4cyclictest720961-21kworker/u8:1+flush-259:010:25:173
527746992522,2cyclictest667924-21kworker/u8:2+flush-259:009:40:161
527746992521,3cyclictest736372-21kworker/u8:0+events_unbound11:15:241
527746992521,3cyclictest690132-21kworker/u8:3+flush-259:010:04:221
52774399259,5cyclictest834863-21apt-get12:05:110
527743992519,4cyclictest819401-21apt-get11:50:120
527753992419,3cyclictest663858-21latency_hist09:20:003
527746992420,3cyclictest736372-21kworker/u8:0+flush-259:010:35:181
527746992420,3cyclictest627608-21kworker/u8:4+flush-259:009:05:151
527746992420,3cyclictest569672-21kworker/u8:1+events_unbound08:10:211
527746992415,7cyclictest638115-21idleruntime-cro08:55:011
52774399247,3cyclictest335557-21systemd-journal12:14:550
52774399240,23cyclictest1-21systemd07:36:200
527753992319,3cyclictest648429-21kworker/u8:0+flush-259:009:30:213
527753992317,5cyclictest860508-21turbostat12:30:013
527753992317,4cyclictest553996-21latency_hist07:35:013
527751992319,3cyclictest611186-21gpgv08:30:002
527751992319,3cyclictest335557-21systemd-journal09:39:062
527746992320,2cyclictest569672-21kworker/u8:1+flush-259:008:08:471
527746992319,3cyclictest736372-21kworker/u8:0+events_unbound11:25:181
527746992319,3cyclictest522430-21kworker/u8:1+events_unbound07:44:201
527753992218,3cyclictest814025-21kworker/u8:4+events_unbound11:55:253
527753992217,3cyclictest335557-21systemd-journal07:28:203
52775399221,19cyclictest1-21systemd11:03:243
527746992219,2cyclictest720961-21kworker/u8:1+events_unbound10:20:211
527746992218,3cyclictest616671-21kworker/u8:3+events_unbound08:35:151
527743992218,3cyclictest746877-21/usr/sbin/munin10:40:200
527743992218,3cyclictest720961-21kworker/u8:1+flush-259:011:35:000
527743992217,3cyclictest772731-21turbostat11:05:000
52774399220,2cyclictest736371-21awk10:30:000
527753992117,3cyclictest335557-21systemd-journal07:20:013
527753992115,4cyclictest532917-21latency_hist07:15:013
527753992114,5cyclictest574762-21base6407:55:013
527751992118,2cyclictest0-21swapper/210:40:002
527746992117,3cyclictest736372-21kworker/u8:0+flush-259:012:05:261
527746992117,3cyclictest690132-21kworker/u8:3+events_unbound10:12:231
527746992117,3cyclictest648429-21kworker/u8:0+events_unbound09:10:231
527746992117,3cyclictest548846-21kworker/u8:4+flush-259:007:45:111
52774399217,2cyclictest568535-21ntpq07:45:200
527743992118,2cyclictest720961-21kworker/u8:1+flush-259:010:20:210
527743992118,2cyclictest0-21swapper/008:35:000
527743992117,3cyclictest814025-21kworker/u8:4+flush-259:011:55:240
527753992015,4cyclictest638352-21/usr/sbin/munin08:55:133
527753992015,4cyclictest638352-21/usr/sbin/munin08:55:133
527751992011,7cyclictest0-21swapper/208:35:002
527746992017,2cyclictest616671-21kworker/u8:3+events_unbound08:40:151
527746992016,3cyclictest648429-21kworker/u8:0+events_unbound10:15:241
527746992015,3cyclictest731483-21/usr/sbin/munin10:25:221
527743992015,4cyclictest569672-21kworker/u8:1+flush-259:008:03:500
52774399200,3cyclictest659654-21irqcore09:15:160
527753991917,2cyclictest736372-21kworker/u8:0+flush-259:010:30:243
527753991915,3cyclictest834623-21kworker/u8:2+flush-259:012:25:013
52775199199,9cyclictest602054-21kthreadcore08:20:172
52775199197,11cyclictest532907-21idleruntime-cro07:15:002
527751991913,4cyclictest674213-21latency_hist09:30:002
527746991913,4cyclictest335557-21systemd-journal11:43:251
527746991912,5cyclictest554424-21diskstats07:35:151
527743991916,2cyclictest767185-21http11:00:000
527743991913,4cyclictest695227-21latency_hist09:50:010
527743991913,4cyclictest335557-21systemd-journal07:55:010
527753991815,2cyclictest736372-21kworker/u8:0+flush-259:011:15:243
527753991815,2cyclictest720961-21kworker/u8:1+events_unbound10:25:013
527753991815,2cyclictest708046-21kthreadcore10:00:173
527753991814,3cyclictest522430-21kworker/u8:1+events_unbound07:15:193
527753991812,4cyclictest736372-21kworker/u8:0+flush-259:011:45:163
527753991812,4cyclictest559145-21latency_hist07:40:013
52775199187,1cyclictest0-21swapper/211:45:012
52775199187,1cyclictest0-21swapper/211:25:242
527751991815,2cyclictest840244-21fschecks_count12:10:152
527746991815,2cyclictest648429-21kworker/u8:0+events_unbound09:36:221
527746991814,3cyclictest736372-21kworker/u8:0+events_unbound10:45:121
527746991813,3cyclictest720961-21kworker/u8:1+events_unbound11:10:161
527743991815,2cyclictest783281-21apt-get11:15:120
527743991815,2cyclictest684112-21ntp_kernel_pll_09:35:220
527743991814,3cyclictest335557-21systemd-journal08:23:210
527743991813,4cyclictest569700-21apt-get07:50:120
527743991812,5cyclictest657815-21ntpq09:10:220
527753991714,2cyclictest716483-21irqcore10:10:183
527753991712,3cyclictest736372-21kworker/u8:0+flush-259:011:10:003
527753991712,3cyclictest667924-21kworker/u8:2+flush-259:009:55:163
527753991712,3cyclictest627608-21kworker/u8:4+flush-259:009:15:003
527753991711,4cyclictest648429-21kworker/u8:0+flush-259:010:15:163
52775199171,7cyclictest0-21swapper/212:25:152
527751991713,3cyclictest736599-21/usr/sbin/munin10:30:132
527751991713,3cyclictest736372-21kworker/u8:0+flush-259:011:20:002
527746991714,2cyclictest824300-21kworker/u8:1+events_unbound12:10:151
527746991714,2cyclictest756956-21kworker/u8:3+events_unbound11:05:211
527746991713,3cyclictest720961-21kworker/u8:1+events_unbound11:35:141
527746991713,3cyclictest548846-21kworker/u8:4+events_unbound07:50:131
527743991713,3cyclictest335557-21systemd-journal11:36:250
527743991710,2cyclictest60350irq/132-enp0s29f1:rx-007:15:140
527753991614,1cyclictest834614-21munin-plugin-st12:05:003
527753991612,3cyclictest788208-21kworker/u8:3+events_unbound11:30:213
527753991611,4cyclictest585558-21kworker/u8:2+flush-259:008:15:003
52775199167,1cyclictest0-21swapper/210:15:102
52775199167,1cyclictest0-21swapper/209:45:132
527751991614,1cyclictest0-21swapper/212:40:012
527751991613,2cyclictest687519-21kthreadcore09:40:182
527751991613,2cyclictest554685-21irqcore07:35:172
527751991611,4cyclictest772990-21apt-get11:05:112
527746991612,3cyclictest762757-21irqcore10:55:161
527746991612,3cyclictest736372-21kworker/u8:0+events_unbound11:47:241
527746991612,3cyclictest667924-21kworker/u8:2+events_unbound09:54:141
52774399169,2cyclictest60350irq/132-enp0s29f1:rx-009:05:230
527743991614,1cyclictest643297-21cron09:00:000
527743991614,1cyclictest643297-21cron09:00:000
527743991614,1cyclictest60350irq/132-enp0s29f1:rx-008:40:250
527743991613,2cyclictest60350irq/132-enp0s29f1:rx-010:50:250
527743991613,2cyclictest60350irq/132-enp0s29f1:rx-009:25:170
527743991613,2cyclictest60350irq/132-enp0s29f1:rx-008:09:420
527743991612,2cyclictest0-21swapper/010:20:000
52775399159,4cyclictest335557-21systemd-journal09:45:003
52775399157,5cyclictest637258-21ntpq08:50:223
527753991512,2cyclictest759474-21kthreadcore10:50:183
527753991512,2cyclictest628063-21irqcore08:45:163
527753991511,3cyclictest746628-21kworker/u8:2+flush-259:010:40:263
527753991511,3cyclictest569672-21kworker/u8:1+flush-259:008:25:163
527753991510,3cyclictest824300-21kworker/u8:1+flush-259:012:10:263
52775199155,2cyclictest0-21swapper/212:20:002
527751991512,2cyclictest709648-21needreboot10:00:192
527751991512,2cyclictest695558-21cpuspeed_turbos09:50:132
527751991510,3cyclictest674823-21cat09:30:012
527746991512,2cyclictest834623-21kworker/u8:2+events_unbound12:20:201
527746991512,2cyclictest648429-21kworker/u8:0+flush-259:009:30:151
527746991512,2cyclictest601456-21irqcore08:20:161
527746991510,4cyclictest648429-21kworker/u8:0+events_unbound09:25:561
527746991510,3cyclictest726129-21kworker/u8:3+events_unbound10:31:261
527743991513,2cyclictest60350irq/132-enp0s29f1:rx-009:20:300
527743991513,1cyclictest60350irq/132-enp0s29f1:rx-011:25:180
527743991513,1cyclictest60350irq/132-enp0s29f1:rx-010:10:200
527743991513,1cyclictest60350irq/132-enp0s29f1:rx-010:06:180
527743991513,1cyclictest60350irq/132-enp0s29f1:rx-007:40:200
527743991511,1cyclictest60350irq/132-enp0s29f1:rx-009:34:140
52775399149,3cyclictest736372-21kworker/u8:0+flush-259:010:35:243
52775399147,5cyclictest681170-21cut09:35:183
527753991411,2cyclictest823797-21unixbench_multi11:50:253
527753991410,3cyclictest814025-21kworker/u8:4+events_unbound12:30:243
52775199149,4cyclictest538715-21cp07:20:012
52775199148,4cyclictest643294-21latency_hist09:00:002
52775199148,4cyclictest643294-21latency_hist09:00:002
527751991412,1cyclictest0-21swapper/208:50:002
527751991411,1cyclictest0-21swapper/211:04:592
527751991410,3cyclictest648429-21kworker/u8:0+flush-259:009:10:242
527746991410,3cyclictest756956-21kworker/u8:3+flush-259:011:00:161
527743991412,2cyclictest61150irq/133-enp0s29f1:tx-007:20:190
527743991412,2cyclictest60350irq/132-enp0s29f1:rx-007:29:170
527743991412,1cyclictest60350irq/132-enp0s29f1:rx-011:45:160
527743991412,1cyclictest60350irq/132-enp0s29f1:rx-010:03:300
527743991412,1cyclictest60350irq/132-enp0s29f1:rx-009:50:230
527743991412,1cyclictest60350irq/132-enp0s29f1:rx-008:49:280
527743991412,1cyclictest60350irq/132-enp0s29f1:rx-008:35:170
527743991412,1cyclictest60350irq/132-enp0s29f1:rx-008:15:140
527743991411,2cyclictest61150irq/133-enp0s29f1:tx-011:05:120
527743991411,2cyclictest60350irq/132-enp0s29f1:rx-011:20:240
527743991411,2cyclictest60350irq/132-enp0s29f1:rx-011:20:240
52775399139,3cyclictest720961-21kworker/u8:1+events_unbound11:10:233
52775399136,5cyclictest569435-21latency_hist07:50:013
52775399130,4cyclictest7564442unixbench_multi10:45:243
52775199139,3cyclictest548846-21kworker/u8:4+flush-259:008:16:262
52775199139,3cyclictest509-21rs:main2
52775199137,4cyclictest538094-21awk07:19:592
52775199136,5cyclictest839780-21latency_hist12:10:012
527751991310,2cyclictest834160-21unixbench_singl12:00:242
527751991310,2cyclictest716493-21irqcore10:10:182
527751991310,2cyclictest700674-21cpuspeed_turbos09:55:142
527751991310,2cyclictest575008-21latency_hist07:55:012
52774699139,3cyclictest569672-21kworker/u8:1+events_unbound08:59:241
52774699139,3cyclictest569672-21kworker/u8:1+events_unbound08:59:241
52774699138,4cyclictest736372-21kworker/u8:0+events_unbound11:21:321
52774699138,4cyclictest736372-21kworker/u8:0+events_unbound11:21:321
527746991310,2cyclictest522430-21kworker/u8:1+events_unbound07:12:131
52774399138,1cyclictest60350irq/132-enp0s29f1:rx-012:15:230
527743991312,1cyclictest60350irq/132-enp0s29f1:rx-010:30:110
527743991311,1cyclictest60350irq/132-enp0s29f1:rx-011:43:230
527743991311,1cyclictest60350irq/132-enp0s29f1:rx-008:50:250
527743991311,1cyclictest60350irq/132-enp0s29f1:rx-008:25:200
527743991310,2cyclictest60350irq/132-enp0s29f1:rx-012:25:220
527743991310,2cyclictest527669-21kworker/u8:4+events_unbound07:10:150
52774399130,12cyclictest335557-21systemd-journal09:41:220
52775399129,2cyclictest643781-21fschecks_time09:00:143
527753991210,1cyclictest481rcuc/312:15:193
52775199129,2cyclictest824300-21kworker/u8:1+flush-259:012:32:552
52775199128,3cyclictest569672-21kworker/u8:1+flush-259:009:00:172
52775199128,2cyclictest0-21swapper/210:10:012
52775199126,4cyclictest335557-21systemd-journal11:14:592
52774699128,3cyclictest824300-21kworker/u8:1+events_unbound12:25:241
52774399129,2cyclictest60350irq/132-enp0s29f1:rx-009:55:130
52774399129,2cyclictest60350irq/132-enp0s29f1:rx-009:00:000
527743991211,1cyclictest60350irq/132-enp0s29f1:rx-012:30:140
52775399117,3cyclictest736372-21kworker/u8:0+flush-259:012:05:203
52775399117,2cyclictest736372-21kworker/u8:0+flush-259:011:00:013
52775199118,2cyclictest824954-21irqcore11:55:172
52775199118,2cyclictest804075-21cpuspeed_turbos11:35:132
52775199118,1cyclictest0-21swapper/211:35:012
52775199116,3cyclictest548846-21kworker/u8:4+flush-259:007:45:152
52775399108,1cyclictest0-21swapper/310:05:153
52775199108,1cyclictest0-21swapper/209:15:132
52775199107,2cyclictest854922-21unixbench_singl12:20:252
5277539996,1cyclictest0-21swapper/308:40:173
5277519995,3cyclictest580298-21date08:00:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional