You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-30 - 16:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Sat May 30, 2026 12:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
514827994643,2cyclictest764427-21kworker/u8:0+events_unbound11:19:591
514827994538,5cyclictest841474-21ntpq12:20:201
514833994236,4cyclictest519942-21latency_hist07:15:003
514827994136,4cyclictest556825-21kworker/u8:2+events_unbound08:05:231
514827993934,3cyclictest519956-21kworker/u8:1+flush-259:007:45:211
514827993933,4cyclictest335557-21systemd-journal12:16:331
514823993932,5cyclictest335557-21systemd-journal07:55:000
514833993834,3cyclictest764560-21latency_hist11:10:013
514827993835,2cyclictest816825-21kworker/u8:3+flush-259:012:10:151
514827993834,2cyclictest744094-21kworker/u8:4+events_unbound11:40:181
514827993833,3cyclictest743879-21kworker/u8:3+flush-259:011:05:191
514823993832,4cyclictest743865-21latency_hist10:50:000
514823993832,4cyclictest675909-21latency_hist09:45:000
514823993832,4cyclictest566192-21ntpq07:55:210
514827993731,4cyclictest335557-21systemd-journal08:58:331
514827993633,2cyclictest499462-21kworker/u8:0+events_unbound07:10:171
514827993631,3cyclictest790877-21kworker/u8:0+events_unbound12:05:181
514831993532,2cyclictest806363-21kworker/u8:2+flush-259:012:20:172
514827993532,2cyclictest567137-21kworker/u8:1+events_unbound08:15:181
514827993530,3cyclictest476768-21kworker/u8:4+events_unbound07:15:241
514827993530,3cyclictest476768-21kworker/u8:4+events_unbound07:15:241
514823993530,4cyclictest775727-21diskstats11:20:140
514833993429,4cyclictest701288-21ntpq10:05:223
514831993429,3cyclictest727969-21latency_hist10:35:012
514827993431,2cyclictest691885-21kworker/u8:0+flush-259:010:45:211
514827993431,2cyclictest556825-21kworker/u8:2+events_unbound07:50:241
514827993430,2cyclictest639751-21kworker/u8:5+events_unbound09:15:161
514827993426,3cyclictest780695-21kworker/u8:2+events_unbound11:25:171
514827993330,2cyclictest556825-21kworker/u8:2+flush-259:008:10:211
514827993328,3cyclictest785865-21/usr/sbin/munin11:30:131
514831993228,3cyclictest701833-21kworker/u8:1+flush-259:010:25:152
514827993229,2cyclictest806363-21kworker/u8:2+events_unbound12:25:231
514823993226,5cyclictest769741-21gpgv11:15:010
514833993128,2cyclictest567137-21kworker/u8:1+flush-259:008:40:153
514831993124,5cyclictest629399-21latency_hist09:00:002
514827993128,2cyclictest744094-21kworker/u8:4+flush-259:010:55:271
514827993128,2cyclictest624243-21kworker/u8:1+events_unbound09:10:191
514827993127,3cyclictest744094-21kworker/u8:4+flush-259:010:50:151
514827993127,3cyclictest692069-21kworker/u8:4+events_unbound10:15:241
514827993127,3cyclictest567137-21kworker/u8:1+events_unbound08:30:151
514833993027,2cyclictest567137-21kworker/u8:1+flush-259:008:15:163
514831993027,2cyclictest613523-21gpgv08:45:002
514827993027,2cyclictest582802-21kworker/u8:3+events_unbound08:20:201
514827993026,3cyclictest744094-21kworker/u8:4+flush-259:011:50:211
514827992926,2cyclictest852931-21kworker/u8:1+flush-259:012:35:201
514827992926,2cyclictest712742-21kworker/u8:2+events_unbound10:40:221
514827992925,3cyclictest743879-21kworker/u8:3+events_unbound11:00:181
514827992925,3cyclictest556825-21kworker/u8:2+flush-259:008:05:011
514827992925,3cyclictest546577-21kworker/u8:0+events_unbound07:40:131
514827992925,3cyclictest519956-21kworker/u8:1+events_unbound07:25:221
514833992825,2cyclictest691885-21kworker/u8:0+flush-259:010:20:193
514831992824,3cyclictest567137-21kworker/u8:1+flush-259:008:30:172
514831992822,4cyclictest785628-21latency_hist11:30:012
514827992825,2cyclictest743879-21kworker/u8:3+flush-259:011:10:221
514827992824,3cyclictest806363-21kworker/u8:2+events_unbound11:58:331
514827992824,3cyclictest525117-21kworker/u8:3+flush-259:007:20:201
514827992824,3cyclictest525117-21kworker/u8:3+flush-259:007:20:201
514827992820,5cyclictest607464-21ntpq08:35:201
514833992723,3cyclictest701833-21kworker/u8:1+flush-259:010:30:143
514831992722,4cyclictest624232-21/usr/sbin/munin08:55:002
514827992723,3cyclictest780489-21kworker/u8:1+events_unbound11:45:191
514833992622,3cyclictest827154-21/usr/sbin/munin12:10:143
514831992622,3cyclictest806363-21kworker/u8:2+events_unbound11:55:232
514831992622,3cyclictest546577-21kworker/u8:0+flush-259:007:55:172
514827992623,2cyclictest582802-21kworker/u8:3+events_unbound08:40:231
514827992623,2cyclictest546577-21kworker/u8:0+events_unbound07:55:241
514827992622,3cyclictest650145-21kworker/u8:2+events_unbound09:55:131
514827992620,4cyclictest718119-21diskstats10:25:131
514823992623,2cyclictest744094-21kworker/u8:4+flush-259:010:55:200
514831992522,2cyclictest519956-21kworker/u8:1+events_unbound07:45:162
514827992522,2cyclictest701833-21kworker/u8:1+events_unbound10:30:191
514827992522,2cyclictest624243-21kworker/u8:1+flush-259:009:00:221
514827992521,3cyclictest691885-21kworker/u8:0+flush-259:010:05:191
514827992518,5cyclictest681092-21latency_hist09:50:001
514823992521,3cyclictest744094-21kworker/u8:4+flush-259:011:45:140
514823992520,3cyclictest335557-21systemd-journal10:06:310
514833992421,2cyclictest780489-21kworker/u8:1+events_unbound11:30:173
514833992421,2cyclictest624243-21kworker/u8:1+flush-259:009:20:253
514833992420,3cyclictest769833-21gpgv11:15:003
514833992420,3cyclictest556825-21kworker/u8:2+flush-259:008:10:213
514831992421,2cyclictest676138-21kworker/u8:4+flush-259:009:45:242
514827992421,2cyclictest744094-21kworker/u8:4+events_unbound11:35:241
514827992420,3cyclictest650145-21kworker/u8:2+flush-259:009:25:151
514827992420,3cyclictest624243-21kworker/u8:1+events_unbound09:30:191
514827992420,3cyclictest335557-21systemd-journal08:50:311
514823992421,2cyclictest582802-21kworker/u8:3+flush-259:008:20:000
514823992420,3cyclictest614151-21kworker/u8:4+flush-259:008:55:000
514823992420,3cyclictest556825-21kworker/u8:2+flush-259:008:40:000
514833992320,2cyclictest832308-21kworker/u8:4+flush-259:012:30:003
514833992320,2cyclictest546577-21kworker/u8:0+flush-259:007:40:173
514833992319,3cyclictest801392-21/usr/sbin/munin11:45:183
514833992319,3cyclictest681604-21base6409:50:003
514833992318,4cyclictest739008-21apt-get10:45:123
514831992320,2cyclictest816825-21kworker/u8:3+events_unbound12:10:192
514831992320,2cyclictest691885-21kworker/u8:0+events_unbound10:15:202
514831992319,3cyclictest744094-21kworker/u8:4+events_unbound11:50:012
514831992319,3cyclictest519956-21kworker/u8:1+events_unbound07:35:172
514831992319,3cyclictest335557-21systemd-journal11:35:002
514831992319,3cyclictest335557-21systemd-journal09:15:012
514831992317,4cyclictest795996-21latency_hist11:40:002
514827992320,2cyclictest556825-21kworker/u8:2+events_unbound08:45:201
514827992317,4cyclictest624243-21kworker/u8:1+flush-259:009:20:191
514823992317,4cyclictest707772-21diskstats10:15:150
514833992220,1cyclictest624243-21kworker/u8:1+events_unbound09:40:193
514833992218,3cyclictest525117-21kworker/u8:3+flush-259:007:35:203
514831992219,2cyclictest712742-21kworker/u8:2+events_unbound10:40:232
514831992219,2cyclictest624243-21kworker/u8:1+flush-259:009:40:232
514831992219,2cyclictest582802-21kworker/u8:3+events_unbound08:20:182
514831992219,2cyclictest556825-21kworker/u8:2+flush-259:008:25:172
514831992218,3cyclictest499462-21kworker/u8:0+events_unbound07:25:002
514831992218,3cyclictest499462-21kworker/u8:0+events_unbound07:25:002
514831992217,4cyclictest335557-21systemd-journal12:36:082
514827992218,3cyclictest556825-21kworker/u8:2+events_unbound08:25:271
514827992218,3cyclictest525117-21kworker/u8:3+events_unbound07:35:271
514823992216,4cyclictest796234-21/usr/sbin/munin11:40:140
514833992118,2cyclictest701833-21kworker/u8:1+events_unbound10:10:183
514833992117,3cyclictest567137-21kworker/u8:1+events_unbound08:30:243
514831992118,2cyclictest764427-21kworker/u8:0+events_unbound11:15:162
514831992118,2cyclictest567137-21kworker/u8:1+flush-259:008:35:192
514831992116,3cyclictest335557-21systemd-journal09:25:002
514827992118,2cyclictest691885-21kworker/u8:0+events_unbound10:00:231
514827992118,2cyclictest665628-21kworker/u8:0+events_unbound09:35:171
514823992118,2cyclictest712742-21kworker/u8:2+events_unbound10:35:220
514823992117,3cyclictest691885-21kworker/u8:0+flush-259:010:20:200
514823992117,2cyclictest826920-21sh12:09:590
514823992115,5cyclictest634537-21latency_hist09:05:000
514833992017,2cyclictest519956-21kworker/u8:1+events_unbound07:30:233
514833992017,2cyclictest519956-21kworker/u8:1+events_unbound07:30:233
514833992016,3cyclictest852931-21kworker/u8:1+events_unbound12:35:203
514833992016,3cyclictest676138-21kworker/u8:4+flush-259:009:50:003
514833992016,3cyclictest567137-21kworker/u8:1+events_unbound08:00:273
514833992016,3cyclictest476768-21kworker/u8:4+flush-259:007:15:053
514833992016,3cyclictest476768-21kworker/u8:4+flush-259:007:15:053
514831992017,2cyclictest701833-21kworker/u8:1+events_unbound10:35:242
514831992017,2cyclictest639751-21kworker/u8:5+events_unbound09:15:182
514831992017,2cyclictest634562-21kworker/u8:0+flush-259:009:05:152
514831992016,3cyclictest624243-21kworker/u8:1+flush-259:009:00:162
514831992016,3cyclictest531236-21cat07:25:022
514827992017,2cyclictest519956-21kworker/u8:1+events_unbound07:30:211
514827992017,2cyclictest519956-21kworker/u8:1+events_unbound07:30:211
514827992016,3cyclictest691885-21kworker/u8:0+events_unbound10:20:331
514823992017,2cyclictest582802-21kworker/u8:3+events_unbound08:40:200
514833991916,2cyclictest832308-21kworker/u8:4+events_unbound12:15:203
514833991916,2cyclictest780489-21kworker/u8:1+events_unbound11:41:023
514833991915,3cyclictest744094-21kworker/u8:4+flush-259:011:50:253
514833991915,3cyclictest613534-21kworker/u8:0+flush-259:008:50:013
514833991915,3cyclictest335557-21systemd-journal12:24:323
514831991917,2cyclictest744094-21kworker/u8:4+events_unbound11:40:222
514831991916,2cyclictest743879-21kworker/u8:3+flush-259:011:05:242
514831991916,2cyclictest546577-21kworker/u8:0+events_unbound07:40:192
514831991915,3cyclictest743879-21kworker/u8:3+events_unbound11:00:152
514831991914,4cyclictest335557-21systemd-journal09:31:322
514827991916,2cyclictest624243-21kworker/u8:1+events_unbound09:40:201
514827991915,3cyclictest712742-21kworker/u8:2+events_unbound10:35:511
514823991915,3cyclictest744094-21kworker/u8:4+flush-259:010:50:250
514833991815,2cyclictest712742-21kworker/u8:2+events_unbound10:25:463
514833991815,2cyclictest650145-21kworker/u8:2+flush-259:009:55:243
514833991815,2cyclictest556825-21kworker/u8:2+events_unbound08:05:263
514833991814,3cyclictest335557-21systemd-journal10:54:563
514833991813,4cyclictest619370-21apt-get08:50:123
51483399180,16cyclictest1-21systemd09:31:323
514831991816,1cyclictest0-21swapper/209:30:012
514831991814,3cyclictest743879-21kworker/u8:3+flush-259:011:10:252
514831991814,3cyclictest556825-21kworker/u8:2+flush-259:008:45:342
514831991814,3cyclictest556825-21kworker/u8:2+events_unbound08:05:152
514827991814,3cyclictest702415-21kworker/u8:3+events_unbound10:10:331
514827991812,4cyclictest681754-21/usr/sbin/munin09:50:211
514823991815,2cyclictest780489-21kworker/u8:1+events_unbound11:30:200
514823991815,2cyclictest701833-21kworker/u8:1+events_unbound10:10:220
514823991815,2cyclictest598743-21irqcore08:30:160
514823991814,3cyclictest650145-21kworker/u8:2+events_unbound09:30:210
514833991714,2cyclictest832308-21kworker/u8:4+events_unbound12:30:203
514833991714,2cyclictest816825-21kworker/u8:3+events_unbound12:00:183
514833991714,2cyclictest816825-21kworker/u8:3+events_unbound12:00:173
514833991714,2cyclictest525117-21kworker/u8:3+flush-259:007:20:153
514833991714,2cyclictest525117-21kworker/u8:3+flush-259:007:20:153
514833991713,3cyclictest780727-21apt-get11:25:103
514833991713,3cyclictest530719-21apt-get07:25:023
514833991711,4cyclictest597149-21ntpq08:25:203
514831991714,2cyclictest701833-21kworker/u8:1+events_unbound10:10:142
514831991714,2cyclictest499462-21kworker/u8:0+events_unbound07:10:232
514831991713,3cyclictest832308-21kworker/u8:4+flush-259:012:30:242
514831991713,3cyclictest790877-21kworker/u8:0+events_unbound12:05:222
514831991713,3cyclictest744094-21kworker/u8:4+events_unbound11:50:242
514831991711,5cyclictest748145-21ntpq10:50:212
514831991711,4cyclictest525229-21gpgv07:20:002
514831991711,4cyclictest525229-21gpgv07:20:002
514827991714,2cyclictest634562-21kworker/u8:0+flush-259:009:05:251
514823991714,2cyclictest816825-21kworker/u8:3+events_unbound12:10:220
514823991714,2cyclictest0-21swapper/009:50:010
514823991713,3cyclictest509-21rs:main0
514823991713,3cyclictest1651126-21kworker/u8:2+flush-259:007:15:250
514823991713,3cyclictest1651126-21kworker/u8:2+flush-259:007:15:250
514823991712,4cyclictest540538-21ntpq07:30:210
514823991712,4cyclictest540538-21ntpq07:30:210
514823991710,5cyclictest618207-21ntpq08:45:200
514833991613,2cyclictest764427-21kworker/u8:0+events_unbound11:20:223
514833991613,2cyclictest525117-21kworker/u8:3+events_unbound07:50:193
514833991612,3cyclictest634562-21kworker/u8:0+events_unbound09:05:183
514833991610,4cyclictest509-21rs:main3
514831991613,2cyclictest567137-21kworker/u8:1+events_unbound08:00:192
514831991612,3cyclictest806363-21kworker/u8:2+flush-259:012:15:212
514831991612,3cyclictest691885-21kworker/u8:0+flush-259:010:45:192
514823991614,1cyclictest519951-21munin-plugin-st07:15:000
514823991613,2cyclictest60350irq/132-enp0s29f1:rx-009:50:180
514833991513,1cyclictest758554-21ntp_kernel_pll_11:00:223
514833991513,1cyclictest0-21swapper/308:59:593
514833991512,2cyclictest624243-21kworker/u8:1+flush-259:009:10:253
514831991513,1cyclictest0-21swapper/210:25:012
514831991512,2cyclictest585133-21kthreadcore08:15:182
514831991511,3cyclictest650145-21kworker/u8:2+flush-259:009:59:372
51482799159,4cyclictest764427-21kworker/u8:0+flush-259:011:20:151
514827991512,2cyclictest816825-21kworker/u8:3+flush-259:012:00:181
514827991512,2cyclictest816825-21kworker/u8:3+flush-259:012:00:171
514823991513,1cyclictest60350irq/132-enp0s29f1:rx-012:35:140
514823991513,1cyclictest60350irq/132-enp0s29f1:rx-012:15:230
514823991513,1cyclictest60350irq/132-enp0s29f1:rx-011:35:020
514823991513,1cyclictest60350irq/132-enp0s29f1:rx-011:05:220
514823991513,1cyclictest60350irq/132-enp0s29f1:rx-008:20:170
514823991513,1cyclictest60350irq/132-enp0s29f1:rx-007:40:120
514823991513,1cyclictest60350irq/132-enp0s29f1:rx-007:20:250
514823991513,1cyclictest60350irq/132-enp0s29f1:rx-007:20:250
514823991512,2cyclictest744094-21kworker/u8:4+events_unbound11:50:230
514823991512,2cyclictest712742-21kworker/u8:2+flush-259:010:40:160
514823991512,2cyclictest60350irq/132-enp0s29f1:rx-012:00:110
514823991512,2cyclictest60350irq/132-enp0s29f1:rx-012:00:110
514823991512,2cyclictest60350irq/132-enp0s29f1:rx-011:19:590
514823991512,2cyclictest525117-21kworker/u8:3+events_unbound07:30:000
514823991510,4cyclictest645178-21/usr/sbin/munin09:15:250
51483399148,4cyclictest733134-21apt-get10:40:013
514833991411,2cyclictest592418-21unixbench_multi08:20:243
514833991410,3cyclictest806363-21kworker/u8:2+flush-259:011:55:213
514833991410,3cyclictest582802-21kworker/u8:3+events_unbound08:35:153
514831991411,2cyclictest540415-21needreboot07:30:192
514831991411,2cyclictest540415-21needreboot07:30:192
514831991411,1cyclictest0-21swapper/208:15:002
514823991413,1cyclictest60350irq/132-enp0s29f1:rx-009:26:460
514823991412,1cyclictest60350irq/132-enp0s29f1:rx-011:55:150
514823991412,1cyclictest60350irq/132-enp0s29f1:rx-009:59:500
514823991412,1cyclictest60350irq/132-enp0s29f1:rx-009:40:010
514823991412,1cyclictest60350irq/132-enp0s29f1:rx-009:05:210
514823991411,2cyclictest60350irq/132-enp0s29f1:rx-012:30:210
514823991411,2cyclictest60350irq/132-enp0s29f1:rx-009:10:140
514823991411,2cyclictest60350irq/132-enp0s29f1:rx-007:35:110
514833991310,2cyclictest795513-21unixbench_multi11:35:243
514833991310,2cyclictest712742-21kworker/u8:2+flush-259:010:40:323
514833991310,2cyclictest656570-21kthreadcore09:25:183
514833991310,2cyclictest629731-21cpuspeed_turbos09:00:123
514831991310,2cyclictest665628-21kworker/u8:0+events_unbound09:35:232
51482799139,3cyclictest806363-21kworker/u8:2+events_unbound12:31:341
514823991311,1cyclictest60350irq/132-enp0s29f1:rx-008:25:140
514823991311,1cyclictest60350irq/132-enp0s29f1:rx-008:11:390
514823991311,1cyclictest60350irq/132-enp0s29f1:rx-007:45:150
514823991310,2cyclictest60350irq/132-enp0s29f1:rx-010:30:180
514823991310,2cyclictest60350irq/132-enp0s29f1:rx-008:00:120
51483399129,2cyclictest826054-21ntp_kernel_pll_12:05:213
51483399128,3cyclictest764427-21kworker/u8:0+flush-259:011:16:383
514833991210,2cyclictest692069-21kworker/u8:4+events_unbound10:15:253
51483199120,4cyclictest693072-21irqcore10:00:152
51482399129,2cyclictest60350irq/132-enp0s29f1:rx-008:10:000
514823991211,1cyclictest60350irq/132-enp0s29f1:rx-011:28:380
514823991211,1cyclictest60350irq/132-enp0s29f1:rx-010:29:530
51483399117,3cyclictest546577-21kworker/u8:0+events_unbound07:57:333
51483199118,2cyclictest764427-21kworker/u8:0+events_unbound11:20:202
51483199117,3cyclictest692069-21kworker/u8:4+flush-259:010:07:372
51482399119,1cyclictest60350irq/132-enp0s29f1:rx-012:20:180
51483399107,2cyclictest1-21systemd07:50:003
5148319997,1cyclictest0-21swapper/207:50:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional