You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 17:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Tue May 05, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
123995994741,4cyclictest248283-21latency_hist09:10:002
123988994539,4cyclictest344430-21latency_hist11:00:000
123997994340,2cyclictest285369-21kworker/u8:2+flush-259:011:29:593
123995993630,4cyclictest129109-21apt-get07:15:012
123988993629,5cyclictest252-21systemd-journal12:39:590
123992993428,4cyclictest284520-21ntpq09:45:211
123997993330,2cyclictest263700-21kworker/u8:0+flush-259:010:15:153
123997993330,2cyclictest1286454-21kworker/u8:2+flush-259:007:55:273
123995993330,3cyclictest370027-21kworker/u8:0+flush-259:011:25:252
123997993228,2cyclictest1286454-21kworker/u8:2+flush-259:008:40:213
123995993228,3cyclictest263700-21kworker/u8:0+flush-259:010:05:002
123995993225,5cyclictest150505-21latency_hist07:35:002
123992993226,4cyclictest416624-21latency_hist12:10:011
123995993128,2cyclictest274040-21kworker/u8:1+flush-259:009:45:232
123995993127,3cyclictest291153-21kworker/u8:3+flush-259:010:05:232
123995993127,3cyclictest1286454-21kworker/u8:2+events_unbound08:40:252
123992993124,5cyclictest252552-21ntpq09:10:221
123995993027,2cyclictest232866-21kworker/u8:3+events_unbound09:35:272
123995993024,4cyclictest176222-21latency_hist08:00:012
123997992926,2cyclictest375179-21kworker/u8:3+flush-259:011:50:263
123997992926,2cyclictest375179-21kworker/u8:3+flush-259:011:50:253
123995992924,3cyclictest252-21systemd-journal08:13:512
123988992925,3cyclictest405919-21kworker/u8:2+flush-259:012:25:170
123997992825,2cyclictest411498-21kworker/u8:0+flush-259:012:05:213
123997992825,2cyclictest1286454-21kworker/u8:2+events_unbound09:15:203
123997992824,3cyclictest263700-21kworker/u8:0+flush-259:009:55:243
123992992822,4cyclictest207368-21/usr/sbin/munin08:30:151
123992992822,4cyclictest190795-21ntpq08:10:211
123988992822,4cyclictest139811-21latency_hist07:25:000
123988992821,5cyclictest154761-21ntpq07:35:210
123997992725,2cyclictest171080-21kworker/u8:1+events_unbound08:49:283
123995992724,2cyclictest285369-21kworker/u8:2+flush-259:010:25:162
123995992724,2cyclictest232866-21kworker/u8:3+events_unbound09:29:572
123995992722,4cyclictest375179-21kworker/u8:3+flush-259:011:45:252
123988992721,4cyclictest252-21systemd-journal11:53:250
123988992721,4cyclictest252-21systemd-journal11:53:250
123997992624,2cyclictest118860-21kworker/u8:3+events_unbound07:27:273
123997992623,2cyclictest375179-21kworker/u8:3+events_unbound11:47:263
123997992623,2cyclictest285369-21kworker/u8:2+flush-259:010:35:113
123997992623,2cyclictest171080-21kworker/u8:1+events_unbound08:05:273
123997992623,2cyclictest118860-21kworker/u8:3+events_unbound07:10:233
123995992622,3cyclictest171080-21kworker/u8:1+events_unbound08:45:142
123995992622,3cyclictest1286454-21kworker/u8:2+events_unbound09:24:562
123995992621,3cyclictest509-21rs:main2
123988992621,4cyclictest427202-21apt-get12:18:200
123988992620,4cyclictest253417-21latency_hist09:15:010
123988992620,4cyclictest252-21systemd-journal09:03:250
123995992522,2cyclictest323814-21kworker/u8:1+flush-259:011:24:592
123995992522,2cyclictest285369-21kworker/u8:2+flush-259:010:20:262
123992992520,4cyclictest238269-21apt-get09:00:121
123997992421,2cyclictest405919-21kworker/u8:2+events_unbound12:25:243
123997992421,2cyclictest308376-21kworker/u8:3+events_unbound10:29:173
123997992421,2cyclictest232866-21kworker/u8:3+flush-259:009:25:263
123997992421,2cyclictest1286454-21kworker/u8:2+events_unbound08:25:143
123997992420,3cyclictest285369-21kworker/u8:2+flush-259:010:45:233
123995992422,2cyclictest375179-21kworker/u8:3+events_unbound11:54:362
123995992422,2cyclictest375179-21kworker/u8:3+events_unbound11:54:352
123995992421,2cyclictest1286454-21kworker/u8:2+events_unbound08:30:172
123995992420,3cyclictest509-21rs:main2
123995992420,3cyclictest263700-21kworker/u8:0+events_unbound09:30:272
123995992420,3cyclictest1286454-21kworker/u8:2+events_unbound08:53:272
123992992419,4cyclictest406558-21apt-get12:00:111
12398899249,4cyclictest416624-21latency_hist12:10:010
123988992419,3cyclictest509-21rs:main0
123995992320,2cyclictest323814-21kworker/u8:1+events_unbound11:15:132
123995992319,3cyclictest118860-21kworker/u8:3+flush-259:007:50:212
123988992318,4cyclictest401376-21apt-get11:55:120
123997992219,2cyclictest263700-21kworker/u8:0+events_unbound10:10:283
123997992219,2cyclictest171080-21kworker/u8:1+events_unbound08:50:133
123997992218,3cyclictest509-21rs:main3
123997992218,3cyclictest442671-21kworker/u8:1+events_unbound12:37:363
123997992218,3cyclictest411498-21kworker/u8:0+events_unbound12:20:343
123997992218,3cyclictest405919-21kworker/u8:2+events_unbound11:56:273
123997992218,3cyclictest285369-21kworker/u8:2+events_unbound10:20:193
123997992218,3cyclictest171080-21kworker/u8:1+flush-259:008:15:213
123995992219,2cyclictest375179-21kworker/u8:3+events_unbound11:30:282
123995992219,2cyclictest1286454-21kworker/u8:2+events_unbound08:20:232
123992992215,4cyclictest252-21systemd-journal09:16:261
12399299220,3cyclictest201972-21awk08:25:001
123997992118,3cyclictest1286454-21kworker/u8:2+events_unbound09:05:233
123997992118,2cyclictest411498-21kworker/u8:0+events_unbound12:14:393
123997992118,2cyclictest323814-21kworker/u8:1+events_unbound11:10:203
123997992115,5cyclictest353835-21ntpq11:05:223
123995992118,2cyclictest405919-21kworker/u8:2+flush-259:012:35:002
123995992118,2cyclictest285369-21kworker/u8:2+events_unbound11:05:252
123995992118,2cyclictest232866-21kworker/u8:3+flush-259:009:10:282
123995992118,2cyclictest171080-21kworker/u8:1+flush-259:008:15:172
123995992118,2cyclictest171080-21kworker/u8:1+flush-259:008:05:262
123995992117,3cyclictest1286454-21kworker/u8:2+events_unbound09:04:272
123995992113,5cyclictest138890-21ntpq07:20:202
12399299218,2cyclictest0-21swapper/111:05:001
123992992115,4cyclictest252-21systemd-journal07:56:261
123988992116,4cyclictest129223-21gpgv07:15:000
123988992115,4cyclictest252-21systemd-journal12:20:270
123988992115,4cyclictest252-21systemd-journal10:55:000
123997992018,2cyclictest375179-21kworker/u8:3+flush-259:011:35:263
123997992018,2cyclictest291153-21kworker/u8:3+events_unbound10:05:133
123997992017,3cyclictest274040-21kworker/u8:1+events_unbound09:45:223
123997992017,2cyclictest422204-21kworker/u8:1+flush-259:012:15:103
123997992017,2cyclictest323814-21kworker/u8:1+flush-259:010:50:223
123997992017,2cyclictest285369-21kworker/u8:2+flush-259:010:40:273
123997992017,2cyclictest274040-21kworker/u8:1+events_unbound09:45:003
123997992017,2cyclictest1286454-21kworker/u8:2+events_unbound07:21:273
123995992017,2cyclictest405919-21kworker/u8:2+events_unbound12:25:222
123995992017,2cyclictest285369-21kworker/u8:2+events_unbound10:50:252
123995992017,2cyclictest263700-21kworker/u8:0+events_unbound10:19:162
123995992014,4cyclictest385627-21latency_hist11:40:002
123992992015,3cyclictest145629-21apt-get07:30:111
123992992013,5cyclictest252-21systemd-journal09:00:001
12398899201,18cyclictest1-21systemd07:29:260
123997991916,2cyclictest405919-21kworker/u8:2+events_unbound12:30:213
123997991915,3cyclictest118860-21kworker/u8:3+events_unbound07:30:013
123995991916,2cyclictest411498-21kworker/u8:0+events_unbound12:21:352
123995991916,2cyclictest405919-21kworker/u8:2+events_unbound12:05:002
123995991916,2cyclictest285369-21kworker/u8:2+flush-259:010:35:212
123995991915,3cyclictest442671-21kworker/u8:1+events_unbound12:38:372
123995991915,3cyclictest375179-21kworker/u8:3+events_unbound11:43:272
123995991915,3cyclictest129344-21gpgv07:15:012
123992991915,3cyclictest129109-21apt-get07:15:021
123992991913,4cyclictest343612-21ntpq10:55:221
123992991913,4cyclictest252-21systemd-journal09:26:271
123997991816,2cyclictest375179-21kworker/u8:3+events_unbound12:03:263
123997991815,3cyclictest1286454-21kworker/u8:2+events_unbound07:44:363
123997991815,2cyclictest375179-21kworker/u8:3+flush-259:011:40:213
123995991815,2cyclictest323814-21kworker/u8:1+events_unbound11:12:252
123995991815,2cyclictest285369-21kworker/u8:2+events_unbound10:30:152
123995991815,2cyclictest118860-21kworker/u8:3+flush-259:007:43:472
123992991816,1cyclictest217420-21grep08:39:591
123992991815,2cyclictest145198-21latency_hist07:30:001
123988991814,2cyclictest60350irq/132-enp0s29f1:rx-010:20:100
123988991811,5cyclictest410569-21ntpq12:00:200
12398899180,6cyclictest420474-21grep12:10:170
123995991714,2cyclictest285369-21kworker/u8:2+events_unbound10:46:262
123995991713,3cyclictest411498-21kworker/u8:0+events_unbound12:10:152
123992991714,2cyclictest313546-21munin-run10:30:001
123992991714,1cyclictest316092-21kthreadcore10:30:171
123992991714,1cyclictest0-21swapper/112:25:001
123992991711,4cyclictest443116-21/usr/sbin/munin12:35:141
123992991710,5cyclictest339245-21latency_hist10:55:001
123988991714,2cyclictest60350irq/132-enp0s29f1:rx-010:26:320
123988991713,2cyclictest160785-21turbostat07:45:000
123988991712,3cyclictest161018-21/usr/sbin/munin07:45:210
123997991613,2cyclictest323814-21kworker/u8:1+flush-259:010:55:103
123997991613,2cyclictest1286454-21kworker/u8:2+events_unbound09:20:143
123997991611,4cyclictest207393-21apt-get08:30:113
123995991614,1cyclictest232866-21kworker/u8:3+events_unbound08:55:262
123995991613,2cyclictest0-21swapper/208:30:002
123995991612,3cyclictest1286454-21kworker/u8:2+events_unbound08:39:262
123995991612,3cyclictest118860-21kworker/u8:3+flush-259:007:45:162
12399299169,5cyclictest252-21systemd-journal10:47:251
123992991613,2cyclictest2971-21cron09:45:001
123992991613,1cyclictest0-21swapper/108:54:591
123992991612,2cyclictest0-21swapper/110:45:001
123992991611,4cyclictest171080-21kworker/u8:1+flush-259:008:30:011
123992991610,5cyclictest252-21systemd-journal10:00:001
12398899164,8cyclictest0-21swapper/009:20:230
123988991614,1cyclictest60350irq/132-enp0s29f1:rx-007:53:520
123988991613,2cyclictest60350irq/132-enp0s29f1:rx-009:52:300
123988991613,2cyclictest60350irq/132-enp0s29f1:rx-007:15:010
123988991611,2cyclictest60350irq/132-enp0s29f1:rx-008:05:150
12398899160,5cyclictest441471-21cut12:30:180
123997991513,1cyclictest0-21swapper/309:35:013
123997991512,2cyclictest232866-21kworker/u8:3+events_unbound09:00:253
123997991512,2cyclictest118860-21kworker/u8:3+events_unbound07:15:183
123997991511,3cyclictest1286454-21kworker/u8:2+flush-259:008:10:173
123997991511,3cyclictest118860-21kworker/u8:3+events_unbound08:00:263
123995991513,2cyclictest411498-21kworker/u8:0+events_unbound12:05:232
123995991513,1cyclictest344432-21latency_hist10:59:592
123995991512,2cyclictest0-21swapper/211:05:002
12399299158,5cyclictest395104-21sshd11:45:211
123992991512,2cyclictest163333-21kthreadcore07:45:181
123992991512,1cyclictest0-21swapper/111:55:211
123992991511,3cyclictest263700-21kworker/u8:0+flush-259:010:15:131
123992991511,3cyclictest1286454-21kworker/u8:2+events_unbound09:05:191
123992991510,3cyclictest155878-21/usr/sbin/munin07:40:181
123988991513,1cyclictest60350irq/132-enp0s29f1:rx-011:39:120
123988991513,1cyclictest60350irq/132-enp0s29f1:rx-011:25:190
123988991513,1cyclictest60350irq/132-enp0s29f1:rx-009:15:120
123988991513,1cyclictest60350irq/132-enp0s29f1:rx-008:40:160
123988991513,1cyclictest60350irq/132-enp0s29f1:rx-008:12:340
123988991513,1cyclictest60350irq/132-enp0s29f1:rx-008:00:240
123988991513,1cyclictest60350irq/132-enp0s29f1:rx-007:55:290
123988991512,2cyclictest60350irq/132-enp0s29f1:rx-011:17:380
123988991512,2cyclictest60350irq/132-enp0s29f1:rx-008:20:100
123988991512,2cyclictest60350irq/132-enp0s29f1:rx-008:15:120
12398899150,6cyclictest349900-21grep11:05:130
12398899150,6cyclictest228299-21cat08:50:150
123997991412,2cyclictest274040-21kworker/u8:1+events_unbound09:50:263
123997991412,1cyclictest0-21swapper/307:50:003
123997991411,2cyclictest232866-21kworker/u8:3+flush-259:009:10:173
123997991411,2cyclictest232866-21kworker/u8:3+events_unbound08:55:183
123995991413,1cyclictest118860-21kworker/u8:3+events_unbound07:25:292
123995991412,2cyclictest274040-21kworker/u8:1+events_unbound09:51:272
123995991412,1cyclictest0-21swapper/208:00:192
12399299149,4cyclictest323814-21kworker/u8:1+flush-259:011:10:441
12399299149,4cyclictest1286454-21kworker/u8:2+flush-259:009:20:171
12399299147,5cyclictest252-21systemd-journal11:35:001
123992991411,2cyclictest396643-21irqcore11:50:161
123992991411,2cyclictest396643-21irqcore11:50:151
123992991410,3cyclictest118860-21kworker/u8:3+flush-259:007:50:231
123988991413,1cyclictest60350irq/132-enp0s29f1:rx-011:21:050
123988991413,1cyclictest60350irq/132-enp0s29f1:rx-011:00:230
12398899141,2cyclictest263943-21apt-get09:25:130
123988991412,2cyclictest60350irq/132-enp0s29f1:rx-009:45:240
123988991412,1cyclictest60350irq/132-enp0s29f1:rx-011:30:230
123988991412,1cyclictest60350irq/132-enp0s29f1:rx-011:10:170
123988991412,1cyclictest60350irq/132-enp0s29f1:rx-010:13:590
123988991412,1cyclictest60350irq/132-enp0s29f1:rx-010:00:570
123988991412,1cyclictest60350irq/132-enp0s29f1:rx-009:55:120
123988991412,1cyclictest60350irq/132-enp0s29f1:rx-009:35:170
123988991411,2cyclictest60350irq/132-enp0s29f1:rx-009:42:070
123988991411,2cyclictest60350irq/132-enp0s29f1:rx-009:31:020
123988991411,2cyclictest60350irq/132-enp0s29f1:rx-008:25:180
123988991411,2cyclictest212929-21irqcore08:35:140
12398899140,4cyclictest328072-21ld10:40:220
12398899140,4cyclictest226825-21ntpq08:45:200
12399799139,3cyclictest308376-21kworker/u8:3+events_unbound10:31:273
123997991310,2cyclictest0-21swapper/308:20:193
123995991310,3cyclictest274040-21kworker/u8:1+events_unbound09:41:272
12399299137,4cyclictest274689-21apt-get09:35:131
12399299131,3cyclictest427388-21awk12:20:001
123992991310,2cyclictest386310-21irqcore11:40:171
123992991310,2cyclictest0-21swapper/107:10:221
123992991310,1cyclictest0-21swapper/108:10:001
123988991312,1cyclictest60350irq/132-enp0s29f1:rx-011:41:370
123988991311,1cyclictest60350irq/132-enp0s29f1:rx-010:32:480
123988991311,1cyclictest60350irq/132-enp0s29f1:rx-008:34:350
12398899130,4cyclictest332558-21cut10:45:170
12398899130,11cyclictest319717-21cut10:35:150
12399799129,2cyclictest166401-21fschecks_time07:50:143
123997991210,2cyclictest263700-21kworker/u8:0+events_unbound10:04:153
123997991210,1cyclictest0-21swapper/311:05:003
12399599129,2cyclictest118860-21kworker/u8:3+flush-259:007:35:202
123995991210,2cyclictest411498-21kworker/u8:0+flush-259:012:18:202
12399299129,2cyclictest292687-21fschecks_time10:05:151
12399299128,3cyclictest273988-21idleruntime-cro09:34:591
12399299128,3cyclictest1286454-21kworker/u8:2+flush-259:007:21:581
12399299125,5cyclictest176480-21apt-get08:00:121
12399299122,5cyclictest227708-21munin-run08:50:001
123988991211,1cyclictest60350irq/132-enp0s29f1:rx-008:56:300
123988991210,1cyclictest60350irq/132-enp0s29f1:rx-009:08:080
12399799119,1cyclictest0-21swapper/307:35:143
12399599117,3cyclictest1286454-21kworker/u8:2+flush-259:009:15:042
12399299119,1cyclictest0-21swapper/112:30:131
12399299118,2cyclictest0-21swapper/108:40:171
12399299118,1cyclictest0-21swapper/110:35:161
12399299117,2cyclictest0-21swapper/111:30:001
12399299117,2cyclictest0-21swapper/110:20:161
12399799107,2cyclictest364555-21unixbench_multi11:15:243
12399599106,3cyclictest263700-21kworker/u8:0+events_unbound10:12:272
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional