You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-26 - 21:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Wed Aug 26, 2026 12:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
517843995248,3cyclictest543617-21kworker/u8:0+flush-259:008:00:232
517843995146,4cyclictest600923-21apt-get08:30:012
517843995146,4cyclictest600923-21apt-get08:30:002
517843995046,3cyclictest663498-21kworker/u8:0+flush-259:009:35:252
517843994945,3cyclictest621698-21kworker/u8:1+flush-259:009:15:242
517843994943,4cyclictest794109-21apt-get11:35:122
517843994846,2cyclictest673808-21kworker/u8:2+events_unbound10:15:102
517843994845,2cyclictest637795-21kworker/u8:2+flush-259:009:05:242
517848994438,4cyclictest517767-21latency_hist07:10:003
517843994339,3cyclictest523158-21kworker/u8:3+flush-259:007:25:012
517843994238,3cyclictest627499-21apt-get08:55:132
517843994138,2cyclictest710096-21kworker/u8:1+flush-259:010:30:262
517840993936,2cyclictest590134-21kworker/u8:5+flush-259:008:45:231
517848993832,4cyclictest590104-21latency_hist08:20:013
517848993832,4cyclictest590104-21latency_hist08:20:003
517843993734,2cyclictest746478-21kworker/u8:0+flush-259:010:55:152
517840993734,2cyclictest538679-21apt-get07:30:101
517840993733,3cyclictest673808-21kworker/u8:2+flush-259:010:50:241
517840993732,3cyclictest804484-21apt-get11:45:121
517838993732,3cyclictest825419-21kworker/u8:1+events_unbound12:30:000
517840993632,3cyclictest600922-21latency_hist08:30:011
517843993532,2cyclictest673808-21kworker/u8:2+events_unbound11:00:232
517843993530,4cyclictest830796-21/usr/sbin/munin12:10:142
517843993431,2cyclictest761994-21kworker/u8:3+events_unbound11:50:242
517843993431,2cyclictest621698-21kworker/u8:1+events_unbound09:40:272
517838993428,4cyclictest335557-21systemd-journal09:10:000
517843993330,2cyclictest710096-21kworker/u8:1+events_unbound10:35:232
517843993330,2cyclictest543617-21kworker/u8:0+flush-259:007:40:162
517843993329,3cyclictest663498-21kworker/u8:0+events_unbound10:10:182
517843993229,2cyclictest761994-21kworker/u8:3+flush-259:011:20:162
517843993229,2cyclictest673808-21kworker/u8:2+flush-259:011:45:162
517843993226,2cyclictest480384-21kworker/u8:1+events_unbound07:25:172
517840993229,2cyclictest512882-21kworker/u8:0+flush-259:007:20:211
517838993230,1cyclictest778130-21kworker/u8:4+events_unbound11:25:170
517843993128,2cyclictest543617-21kworker/u8:0+events_unbound08:10:192
517840993128,2cyclictest778130-21kworker/u8:4+flush-259:011:35:261
517840993128,2cyclictest590134-21kworker/u8:5+flush-259:009:20:211
517838993128,2cyclictest523158-21kworker/u8:3+flush-259:007:15:240
517848993025,4cyclictest554150-21apt-get07:45:123
517843993027,2cyclictest710096-21kworker/u8:1+events_unbound10:20:222
517843993027,2cyclictest621698-21kworker/u8:1+events_unbound08:50:242
517843993027,2cyclictest553908-21kworker/u8:1+events_unbound08:25:142
517840993026,3cyclictest509-21rs:main1
517843992926,2cyclictest746478-21kworker/u8:0+events_unbound11:05:162
517843992926,2cyclictest637795-21kworker/u8:2+flush-259:009:25:162
517843992924,4cyclictest335557-21systemd-journal10:55:002
517848992824,3cyclictest574781-21kworker/u8:2+flush-259:008:30:213
517848992824,3cyclictest574781-21kworker/u8:2+flush-259:008:30:213
517848992823,4cyclictest335557-21systemd-journal08:40:153
517848992822,4cyclictest335557-21systemd-journal12:25:003
517848992811,10cyclictest809400-21latency_hist11:50:013
517840992822,4cyclictest840842-21latency_hist12:20:001
517838992825,2cyclictest538175-21kworker/u8:2+events_unbound07:30:240
517838992823,3cyclictest643051-21apt-get09:10:110
517843992724,2cyclictest663498-21kworker/u8:0+events_unbound10:05:232
517843992724,2cyclictest569416-21kworker/u8:3+events_unbound08:05:202
517838992724,2cyclictest621698-21kworker/u8:1+flush-259:008:50:000
517838992723,3cyclictest710096-21kworker/u8:1+flush-259:010:35:250
517843992623,2cyclictest538175-21kworker/u8:2+events_unbound07:35:202
517843992622,3cyclictest621698-21kworker/u8:1+events_unbound09:03:162
517843992622,3cyclictest543617-21kworker/u8:0+events_unbound08:15:232
517843992622,3cyclictest543617-21kworker/u8:0+events_unbound08:15:232
517840992623,3cyclictest673808-21kworker/u8:2+events_unbound11:28:001
517840992623,2cyclictest663498-21kworker/u8:0+flush-259:009:55:201
517840992622,3cyclictest746478-21kworker/u8:0+events_unbound11:05:121
517843992522,2cyclictest778130-21kworker/u8:4+events_unbound11:25:222
517843992522,2cyclictest590134-21kworker/u8:5+events_unbound08:20:132
517843992521,3cyclictest621698-21kworker/u8:1+events_unbound09:34:172
517840992522,2cyclictest809420-21kworker/u8:5+flush-259:012:05:251
517840992521,3cyclictest553908-21kworker/u8:1+flush-259:007:49:591
517840992520,4cyclictest856372-21latency_hist12:35:011
517838992522,2cyclictest512882-21kworker/u8:0+flush-259:007:20:240
517838992521,3cyclictest736390-21apt-get10:40:100
517843992421,2cyclictest590134-21kworker/u8:5+events_unbound08:45:202
517840992421,2cyclictest574781-21kworker/u8:2+events_unbound08:20:231
517840992420,3cyclictest761994-21kworker/u8:3+flush-259:011:20:201
517838992420,3cyclictest761994-21kworker/u8:3+flush-259:011:20:170
517838992419,3cyclictest543617-21kworker/u8:0+flush-259:008:00:160
517838992418,4cyclictest335557-21systemd-journal07:45:160
517843992320,2cyclictest673808-21kworker/u8:2+flush-259:009:55:232
517843992320,2cyclictest543617-21kworker/u8:0+events_unbound07:55:242
517843992320,2cyclictest507585-21kworker/u8:2+flush-259:007:10:162
517840992319,3cyclictest663498-21kworker/u8:0+flush-259:010:00:201
517838992320,2cyclictest543617-21kworker/u8:0+flush-259:008:25:000
517838992319,3cyclictest606708-21kworker/u8:3+flush-259:008:40:190
517838992319,3cyclictest538175-21kworker/u8:2+flush-259:007:35:210
517848992220,1cyclictest0-21swapper/309:40:003
517848992218,3cyclictest761994-21kworker/u8:3+flush-259:012:10:003
517848992218,3cyclictest648205-21apt-get09:15:103
517848992217,4cyclictest746700-21apt-get10:50:113
517848992217,4cyclictest653361-21apt-get09:20:113
51784899220,20cyclictest1-21systemd07:30:013
517843992219,2cyclictest761994-21kworker/u8:3+events_unbound12:15:212
517843992219,2cyclictest673808-21kworker/u8:2+events_unbound11:10:292
517843992218,3cyclictest663498-21kworker/u8:0+events_unbound10:03:432
517843992218,3cyclictest606708-21kworker/u8:3+flush-259:008:40:192
517843992217,2cyclictest590134-21kworker/u8:5+events_unbound08:35:172
517840992220,1cyclictest523158-21kworker/u8:3+events_unbound07:40:121
517840992217,4cyclictest590220-21gpgv08:20:001
517840992217,4cyclictest590220-21gpgv08:20:001
517838992219,2cyclictest543617-21kworker/u8:0+flush-259:007:50:240
517838992216,4cyclictest830561-21latency_hist12:10:010
517843992118,2cyclictest710096-21kworker/u8:1+events_unbound11:15:272
517843992118,2cyclictest673808-21kworker/u8:2+flush-259:010:25:252
517843992118,2cyclictest523158-21kworker/u8:3+events_unbound07:45:222
517843992118,2cyclictest480384-21kworker/u8:1+events_unbound07:18:072
517840992118,2cyclictest590134-21kworker/u8:5+events_unbound08:43:221
517840992117,3cyclictest673808-21kworker/u8:2+events_unbound10:38:491
517840992115,4cyclictest772325-21latency_hist11:15:001
517840992115,4cyclictest709868-21latency_hist10:15:001
517838992117,3cyclictest590134-21kworker/u8:5+events_unbound08:35:250
517838992115,4cyclictest725380-21latency_hist10:30:000
517848992014,4cyclictest611684-21latency_hist08:40:013
517840992017,2cyclictest543617-21kworker/u8:0+events_unbound08:13:131
517840992016,3cyclictest825419-21kworker/u8:1+events_unbound12:25:221
517840992016,3cyclictest673808-21kworker/u8:2+flush-259:010:45:001
517838992017,2cyclictest621698-21kworker/u8:1+events_unbound09:40:010
517838992016,3cyclictest621698-21kworker/u8:1+events_unbound09:15:240
517848991914,3cyclictest507585-21kworker/u8:2+flush-259:007:10:173
517848991912,5cyclictest715045-21latency_hist10:20:003
517843991915,3cyclictest538175-21kworker/u8:2+events_unbound07:30:072
517840991915,3cyclictest809420-21kworker/u8:5+events_unbound11:55:131
517840991915,3cyclictest663498-21kworker/u8:0+events_unbound09:50:201
517840991915,3cyclictest569416-21kworker/u8:3+flush-259:008:05:241
517840991915,3cyclictest543617-21kworker/u8:0+events_unbound07:50:171
517840991914,3cyclictest761994-21kworker/u8:3+events_unbound11:30:091
517838991917,1cyclictest799024-21sh11:40:000
517838991916,2cyclictest793462-21kworker/u8:0+flush-259:012:00:240
517838991916,2cyclictest663498-21kworker/u8:0+flush-259:009:55:010
517838991916,2cyclictest590134-21kworker/u8:5+flush-259:009:30:200
517838991916,2cyclictest590134-21kworker/u8:5+flush-259:008:25:230
517838991916,2cyclictest543617-21kworker/u8:0+events_unbound07:55:210
517838991915,3cyclictest621698-21kworker/u8:1+events_unbound09:00:200
517838991913,4cyclictest579718-21latency_hist08:10:010
517848991814,3cyclictest793462-21kworker/u8:0+flush-259:011:55:003
517848991814,2cyclictest539094-21irqcore07:30:163
517848991811,5cyclictest710096-21kworker/u8:1+flush-259:010:25:173
517848991811,4cyclictest699582-21latency_hist10:05:003
517843991816,1cyclictest761994-21kworker/u8:3+flush-259:012:00:212
517843991815,2cyclictest825419-21kworker/u8:1+events_unbound12:33:522
517843991815,2cyclictest621698-21kworker/u8:1+events_unbound09:48:372
517843991815,2cyclictest543617-21kworker/u8:0+events_unbound07:50:192
517843991815,2cyclictest2971-21cron09:25:002
517840991815,3cyclictest553908-21kworker/u8:1+events_unbound08:30:201
517840991815,3cyclictest553908-21kworker/u8:1+events_unbound08:30:201
517840991814,3cyclictest710096-21kworker/u8:1+events_unbound10:30:231
517840991812,4cyclictest627235-21latency_hist08:55:011
517838991814,3cyclictest778130-21kworker/u8:4+flush-259:011:30:220
517838991814,3cyclictest621698-21kworker/u8:1+flush-259:008:55:170
517838991813,4cyclictest335557-21systemd-journal11:15:000
51784899178,3cyclictest590950-21diskstats08:20:143
517848991711,4cyclictest684117-21latency_hist09:50:013
517843991715,1cyclictest746435-21munin-plugin-st10:50:002
517843991715,1cyclictest746435-21munin-plugin-st10:50:002
517843991714,2cyclictest825419-21kworker/u8:1+events_unbound12:25:142
517843991714,2cyclictest793462-21kworker/u8:0+events_unbound11:43:002
517843991714,2cyclictest590134-21kworker/u8:5+events_unbound09:13:172
517840991714,2cyclictest793462-21kworker/u8:0+events_unbound12:00:141
517840991713,3cyclictest710096-21kworker/u8:1+flush-259:011:15:241
517840991712,3cyclictest480384-21kworker/u8:1+flush-259:007:25:211
517838991714,2cyclictest673808-21kworker/u8:2+flush-259:010:50:000
517838991714,2cyclictest673808-21kworker/u8:2+flush-259:010:50:000
517838991714,2cyclictest590134-21kworker/u8:5+flush-259:009:20:160
517838991713,3cyclictest523158-21kworker/u8:3+flush-259:007:25:100
51784899169,3cyclictest0-21swapper/308:12:093
51784899163,2cyclictest776635-21ntpq11:15:213
51784899162,4cyclictest600029-21ntpq08:25:203
517848991613,2cyclictest754198-21kthreadcore10:55:173
517848991613,2cyclictest528772-21irqcore07:20:153
517848991612,2cyclictest633696-21kthreadcore09:00:173
517848991612,2cyclictest0-21swapper/311:55:183
517848991612,2cyclictest0-21swapper/311:30:013
517848991612,2cyclictest0-21swapper/307:15:173
517848991611,4cyclictest761994-21kworker/u8:3+flush-259:011:35:003
517840991614,1cyclictest523158-21kworker/u8:3+events_unbound07:15:201
517840991613,2cyclictest793462-21kworker/u8:0+events_unbound11:40:241
517840991613,2cyclictest590134-21kworker/u8:5+events_unbound09:30:211
517840991612,3cyclictest673808-21kworker/u8:2+flush-259:011:50:161
517840991612,3cyclictest566783-21kthreadcore07:55:181
517838991613,2cyclictest60350irq/132-enp0s29f1:rx-011:04:100
517838991613,2cyclictest60350irq/132-enp0s29f1:rx-009:25:250
517838991613,2cyclictest543617-21kworker/u8:0+events_unbound07:40:220
517838991611,4cyclictest335557-21systemd-journal10:31:160
51784899158,1cyclictest191rcu_preempt12:35:253
51784899156,3cyclictest50-21ksoftirqd/311:40:003
51784899151,4cyclictest781426-21cut11:20:183
517848991511,3cyclictest548766-21cron07:40:003
517848991510,4cyclictest658562-21apt-get09:25:123
517843991513,1cyclictest0-21swapper/212:40:012
517840991512,2cyclictest663498-21kworker/u8:0+events_unbound09:45:221
517840991511,3cyclictest694470-21kworker/u8:3+flush-259:010:15:231
517840991511,3cyclictest637795-21kworker/u8:2+events_unbound09:25:221
517840991511,3cyclictest621698-21kworker/u8:1+flush-259:009:35:201
517840991511,3cyclictest543831-21/usr/sbin/munin07:35:141
517840991510,3cyclictest621698-21kworker/u8:1+flush-259:009:40:191
517840991510,3cyclictest0-21swapper/110:45:151
517840991510,3cyclictest0-21swapper/110:45:151
517838991513,2cyclictest60350irq/132-enp0s29f1:rx-010:20:200
517838991513,1cyclictest60350irq/132-enp0s29f1:rx-012:35:160
517838991513,1cyclictest60350irq/132-enp0s29f1:rx-010:01:300
517838991513,1cyclictest60350irq/132-enp0s29f1:rx-008:15:240
517838991513,1cyclictest60350irq/132-enp0s29f1:rx-008:15:240
517838991513,1cyclictest60350irq/132-enp0s29f1:rx-008:10:200
517838991512,2cyclictest825419-21kworker/u8:1+flush-259:012:20:200
517838991512,2cyclictest761994-21kworker/u8:3+flush-259:012:15:240
517838991512,2cyclictest761994-21kworker/u8:3+flush-259:012:10:240
517838991512,2cyclictest710257-21cpuspeed_turbos10:15:120
517838991512,2cyclictest606489-21turbostat08:35:000
517838991512,2cyclictest606489-21turbostat08:35:000
517838991512,2cyclictest60350irq/132-enp0s29f1:rx-010:10:180
517838991512,1cyclictest0-21swapper/012:00:010
517838991511,3cyclictest663498-21kworker/u8:0+flush-259:009:40:000
51784899148,4cyclictest0-21swapper/309:33:353
51784899148,3cyclictest0-21swapper/310:07:373
51784899148,3cyclictest0-21swapper/309:06:433
51784899148,1cyclictest191rcu_preempt10:40:203
51784899142,7cyclictest688354-21ntpq09:50:203
51784899142,2cyclictest709000-21ntpq10:10:213
51784899141,3cyclictest855498-21ntpq12:30:203
517848991412,1cyclictest491ktimers/312:19:593
517848991410,3cyclictest490-21dbus-daemon10:35:003
51784899140,4cyclictest801908-21cut11:40:193
51784899140,4cyclictest735245-21ntpq10:35:213
51784899140,4cyclictest553067-21ntpq07:40:233
517843991411,2cyclictest730771-21kworker/u8:3+events_unbound10:40:222
517843991410,3cyclictest809420-21kworker/u8:5+flush-259:011:55:152
517840991410,3cyclictest590134-21kworker/u8:5+events_unbound08:35:151
517840991410,3cyclictest507585-21kworker/u8:2+flush-259:007:10:201
51783899146,6cyclictest1-21systemd11:20:000
517838991413,1cyclictest60350irq/132-enp0s29f1:rx-011:47:270
517838991412,2cyclictest60350irq/132-enp0s29f1:rx-009:45:250
517838991412,1cyclictest60350irq/132-enp0s29f1:rx-012:30:150
517838991412,1cyclictest60350irq/132-enp0s29f1:rx-011:50:160
517838991412,1cyclictest60350irq/132-enp0s29f1:rx-009:57:040
517838991411,2cyclictest730771-21kworker/u8:3+flush-259:010:50:200
517838991411,2cyclictest60350irq/132-enp0s29f1:rx-011:05:220
51784899139,1cyclictest191rcu_preempt09:55:153
51784899139,1cyclictest191rcu_preempt08:50:133
51784899135,1cyclictest0-21swapper/312:00:203
51784899132,3cyclictest50-21ksoftirqd/312:10:163
51784899132,3cyclictest50-21ksoftirqd/309:10:153
51784899132,2cyclictest572127-21tr08:00:173
51784899132,2cyclictest50-21ksoftirqd/311:10:173
51784899131,2cyclictest745581-21ntpq10:45:243
51784899131,2cyclictest745581-21ntpq10:45:243
51784899131,2cyclictest481rcuc/309:40:213
517848991311,1cyclictest481rcuc/307:53:243
51784399131,2cyclictest191rcu_preempt12:25:002
517843991310,2cyclictest809420-21kworker/u8:5+events_unbound12:08:492
517843991310,2cyclictest778130-21kworker/u8:4+events_unbound11:30:122
51784099139,3cyclictest621698-21kworker/u8:1+flush-259:009:00:241
517840991310,2cyclictest856705-21cpuspeed_turbos12:35:131
517840991310,2cyclictest643117-21cpuspeed_turbos09:10:111
517838991311,1cyclictest60350irq/132-enp0s29f1:rx-010:55:220
517838991311,1cyclictest0-21swapper/007:15:010
51784899129,2cyclictest762378-21cut11:05:133
51784899122,3cyclictest50-21ksoftirqd/312:29:593
51784899121,2cyclictest568498-21ntpq07:55:213
517848991210,1cyclictest491ktimers/310:20:193
51784899120,2cyclictest619432-21ps08:45:173
51784899120,2cyclictest50-21ksoftirqd/311:00:233
51784399120,4cyclictest684672-21gltestperf09:50:152
51784099129,2cyclictest840586-21kworker/u8:0+events_unbound12:20:151
51784099127,4cyclictest621698-21kworker/u8:1+flush-259:009:15:191
51783899128,3cyclictest793462-21kworker/u8:0+events_unbound11:40:140
517838991210,1cyclictest60350irq/132-enp0s29f1:rx-008:50:140
51784899118,2cyclictest627924-21irqcore08:55:183
51784099118,2cyclictest0-21swapper/108:55:161
51784099117,3cyclictest720208-21munin-plugin-st10:25:001
51784099117,3cyclictest694470-21kworker/u8:3+events_unbound10:05:171
51784099108,1cyclictest574736-21latency_hist08:05:001
51784099108,1cyclictest0-21swapper/111:00:261
51784099107,2cyclictest746478-21kworker/u8:0+flush-259:010:56:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional