You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-29 - 10:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Sat Aug 29, 2026 00:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2255024995551,3cyclictest2582448-21apt-get00:25:120
2255024995148,2cyclictest2395089-21kworker/u8:2+events_unbound22:00:230
2255024995043,5cyclictest2400433-21cp21:30:000
2255026994744,2cyclictest2265349-21kworker/u8:3+events_unbound19:35:241
2255024994441,3cyclictest2384410-21kworker/u8:0+events_unbound21:20:220
2255024994338,4cyclictest2358473-21latency_hist20:50:000
2255026994239,2cyclictest2431859-21kworker/u8:1+flush-259:022:25:251
2255026994238,3cyclictest2275659-21kworker/u8:0+flush-259:020:05:231
2255026994237,4cyclictest2353535-21apt-get20:45:101
2255024994236,4cyclictest2483435-21apt-get22:50:130
2255037994036,3cyclictest2587656-21apt-get00:30:113
2255033994035,3cyclictest2281050-21apt-get19:35:112
2255026994035,3cyclictest2421583-21apt-get21:50:111
2255026993835,2cyclictest2431859-21kworker/u8:1+flush-259:022:45:261
2255026993734,2cyclictest2556575-21apt-get00:00:121
2255026993733,3cyclictest2499320-21apt-get23:05:121
2255026993733,3cyclictest2327547-21kworker/u8:4+events_unbound20:35:101
2255026993633,2cyclictest2431859-21kworker/u8:1+flush-259:022:20:161
2255026993631,3cyclictest2400266-21https21:30:001
2255033993528,5cyclictest335557-21systemd-journal20:15:002
2255026993532,2cyclictest2514562-21kworker/u8:1+flush-259:000:10:261
2255026993431,2cyclictest2395089-21kworker/u8:2+events_unbound21:25:251
2255024993330,2cyclictest2431859-21kworker/u8:1+flush-259:022:25:170
2255024993328,4cyclictest2359158-21apt-get20:50:110
2255037993229,2cyclictest2327547-21kworker/u8:4+flush-259:020:40:353
2255026993228,3cyclictest2514562-21kworker/u8:1+flush-259:000:05:241
2255026993228,3cyclictest2478034-21kworker/u8:2+flush-259:023:30:151
2255026993228,3cyclictest2406090-21apt-get21:35:121
2255033993025,4cyclictest2498659-21gpgv23:05:002
2255026993027,2cyclictest2493501-21kworker/u8:3+flush-259:000:15:161
2255026993026,3cyclictest2332774-21kworker/u8:5+events_unbound20:29:201
2255037992923,4cyclictest2383800-21ntpq21:10:213
2255037992825,2cyclictest2327340-21kworker/u8:2+flush-259:020:45:213
2255037992824,3cyclictest2384410-21kworker/u8:0+flush-259:021:20:013
2255026992826,1cyclictest2234780-21kworker/u8:2+events_unbound19:15:251
2255026992823,4cyclictest2390131-21apt-get21:20:101
2255026992823,4cyclictest2369485-21apt-get21:00:111
2255026992823,4cyclictest2322445-21apt-get20:15:121
2255024992825,2cyclictest2275659-21kworker/u8:0+flush-259:019:40:240
2255037992721,4cyclictest2301763-21apt-get19:55:123
2255026992723,3cyclictest2541061-21apt-get23:45:101
2255024992723,3cyclictest2265349-21kworker/u8:3+flush-259:019:25:250
2255024992721,4cyclictest2520339-21/usr/sbin/munin23:25:230
2255033992621,3cyclictest2190844-21kworker/u8:1+flush-259:019:10:372
2255033992620,4cyclictest2275659-21kworker/u8:0+flush-259:019:35:002
2255026992521,3cyclictest2582413-21kworker/u8:4+flush-259:000:30:241
2255026992521,3cyclictest2478034-21kworker/u8:2+events_unbound23:20:151
2255026992519,4cyclictest2269629-21ntpq19:20:211
2255024992522,2cyclictest2265349-21kworker/u8:3+events_unbound20:20:270
2255026992421,2cyclictest2275659-21kworker/u8:0+flush-259:019:55:141
2255024992418,5cyclictest2468132-21diskstats22:35:130
2255033992317,4cyclictest2426496-21latency_hist21:55:012
2255026992320,2cyclictest2327547-21kworker/u8:4+flush-259:021:55:241
2255026992319,3cyclictest2327547-21kworker/u8:4+flush-259:022:10:231
2255024992320,2cyclictest2514562-21kworker/u8:1+events_unbound23:50:240
2255024992319,3cyclictest2327547-21kworker/u8:4+flush-259:022:05:190
2255037992218,2cyclictest2400237-21apt-get21:30:003
2255037992116,3cyclictest2478034-21kworker/u8:2+events_unbound22:55:173
2255033992113,6cyclictest2509549-21cp23:15:012
2255026992118,2cyclictest2514562-21kworker/u8:1+events_unbound23:35:121
2255026992118,2cyclictest2332774-21kworker/u8:5+events_unbound20:30:191
2255024992118,3cyclictest2478034-21kworker/u8:2+flush-259:023:00:240
2255033992017,2cyclictest2478034-21kworker/u8:2+events_unbound22:50:242
2255026992017,2cyclictest2265349-21kworker/u8:3+events_unbound19:25:241
2255026992015,4cyclictest2431866-21/usr/sbin/munin22:00:131
2255024992017,2cyclictest2353295-21kworker/u8:1+events_unbound21:10:240
2255024992017,2cyclictest2327547-21kworker/u8:4+flush-259:021:15:230
2255024992017,2cyclictest2275659-21kworker/u8:0+flush-259:020:00:210
2255024992017,2cyclictest2275659-21kworker/u8:0+flush-259:020:00:200
2255024992016,2cyclictest2405847-21kworker/u8:0+events_unbound21:50:170
2255037991916,2cyclictest2971-21cron21:54:593
2255037991911,5cyclictest335557-21systemd-journal00:25:003
2255033991915,3cyclictest2291370-21kworker/u8:2+flush-259:019:50:002
2255033991915,3cyclictest2275659-21kworker/u8:0+flush-259:020:20:012
2255033991915,2cyclictest0-21swapper/200:30:012
2255033991913,4cyclictest2390291-21diskstats21:20:112
2255026991917,1cyclictest2327547-21kworker/u8:4+events_unbound21:15:171
2255026991916,2cyclictest2514562-21kworker/u8:1+events_unbound23:50:161
2255026991916,2cyclictest2467694-21cron22:35:001
2255026991916,2cyclictest2327547-21kworker/u8:4+events_unbound20:50:171
2255026991915,3cyclictest2190844-21kworker/u8:1+events_unbound19:10:131
2255026991914,3cyclictest2510050-21apt-get23:15:121
2255026991914,3cyclictest0-21swapper/122:39:591
2255026991913,5cyclictest2509466-21cp23:15:011
2255024991916,2cyclictest2493501-21kworker/u8:3+events_unbound00:20:120
2255024991916,2cyclictest2478034-21kworker/u8:2+events_unbound23:40:150
2255024991914,4cyclictest2264414-21ntpq19:15:210
2255037991814,3cyclictest2535672-21kworker/u8:0+flush-259:000:05:163
2255037991814,3cyclictest2520140-21kworker/u8:0+flush-259:023:25:263
2255037991814,3cyclictest2515208-21apt-get23:20:123
2255037991814,3cyclictest2400762-21base6421:30:013
2255037991813,4cyclictest335557-21systemd-journal19:14:593
2255033991815,2cyclictest335557-21systemd-journal21:20:012
2255033991815,2cyclictest2504222-21idleruntime-cro23:09:592
2255033991815,2cyclictest2265289-21cron19:20:002
2255033991812,4cyclictest2327547-21kworker/u8:4+flush-259:021:45:002
2255033991812,4cyclictest2286222-21/usr/sbin/munin19:40:142
2255033991811,5cyclictest2571844-21latency_hist00:15:002
2255024991815,2cyclictest2535672-21kworker/u8:0+events_unbound00:00:220
2255024991815,2cyclictest2369895-21irqcore21:00:150
2255024991815,2cyclictest2332774-21kworker/u8:5+events_unbound20:25:220
2255024991815,2cyclictest2327547-21kworker/u8:4+events_unbound20:35:160
2255037991714,2cyclictest2509390-21gpgv23:15:003
2255033991714,2cyclictest0-21swapper/222:15:002
2255033991713,3cyclictest335557-21systemd-journal23:40:282
2255033991712,4cyclictest2374361-21munin-plugin-st21:05:012
2255033991712,3cyclictest2514562-21kworker/u8:1+flush-259:023:30:012
2255026991715,1cyclictest2581978-21kworker/u8:2+events_unbound00:35:211
2255026991715,1cyclictest2581978-21kworker/u8:2+events_unbound00:35:211
2255026991714,2cyclictest2493501-21kworker/u8:3+events_unbound00:20:181
2255026991714,2cyclictest2275659-21kworker/u8:0+events_unbound19:40:131
2255026991713,3cyclictest2431859-21kworker/u8:1+flush-259:022:40:231
2255024991714,2cyclictest2327547-21kworker/u8:4+flush-259:020:30:240
2255024991714,2cyclictest2327547-21kworker/u8:4+events_unbound21:30:200
2255024991714,2cyclictest2275659-21kworker/u8:0+flush-259:019:45:150
2255024991713,3cyclictest2353295-21kworker/u8:1+events_unbound21:06:280
2255024991713,3cyclictest2327547-21kworker/u8:4+events_unbound21:55:170
225503799169,5cyclictest2497723-21ntpq23:00:213
2255037991610,4cyclictest2395089-21kworker/u8:2+events_unbound22:00:173
2255033991611,4cyclictest335557-21systemd-journal20:50:012
2255026991613,2cyclictest2353295-21kworker/u8:1+flush-259:021:05:151
2255024991614,1cyclictest2556308-21sh00:00:000
2255024991613,2cyclictest61150irq/133-enp0s29f1:tx-019:35:140
2255024991613,2cyclictest60350irq/132-enp0s29f1:rx-000:18:120
2255024991613,2cyclictest2582413-21kworker/u8:4+flush-259:000:32:520
2255024991613,2cyclictest2431859-21kworker/u8:1+flush-259:022:10:210
2255024991613,2cyclictest2265349-21kworker/u8:3+events_unbound19:20:130
2255024991611,4cyclictest2405847-21kworker/u8:0+flush-259:021:45:160
2255024991610,5cyclictest2466846-21ntpq22:30:210
2255024991610,4cyclictest335557-21systemd-journal21:43:270
225502499160,14cyclictest2457419-21true22:24:590
2255037991512,2cyclictest2558898-21kthreadcore00:00:223
2255037991512,2cyclictest2431859-21kworker/u8:1+flush-259:022:15:283
2255037991512,2cyclictest2431859-21kworker/u8:1+flush-259:022:15:283
225503399158,5cyclictest2274775-21ntpq19:25:212
225503399153,6cyclictest2566664-21awk00:10:002
2255033991512,1cyclictest0-21swapper/219:24:592
2255033991510,3cyclictest2296580-21/usr/sbin/munin19:50:212
2255026991512,2cyclictest2493501-21kworker/u8:3+flush-259:023:55:201
2255026991512,2cyclictest2478034-21kworker/u8:2+flush-259:023:40:191
225502699151,13cyclictest490-21dbus-daemon20:15:001
2255026991511,3cyclictest2416429-21apt-get21:45:101
2255026991510,4cyclictest2348361-21apt-get20:40:121
225502499159,4cyclictest2492579-21ntpq22:55:210
225502499158,5cyclictest2478011-21latency_hist22:45:010
2255024991513,1cyclictest60350irq/132-enp0s29f1:rx-023:35:100
2255024991513,1cyclictest60350irq/132-enp0s29f1:rx-023:30:110
2255024991512,2cyclictest60350irq/132-enp0s29f1:rx-020:55:230
2255024991512,2cyclictest60350irq/132-enp0s29f1:rx-020:40:140
2255024991512,2cyclictest60350irq/132-enp0s29f1:rx-019:30:120
2255024991512,2cyclictest2457416-21kworker/u8:0+flush-259:022:45:240
2255024991512,2cyclictest2431859-21kworker/u8:1+flush-259:022:15:180
2255024991512,2cyclictest2431859-21kworker/u8:1+flush-259:022:15:180
2255024991511,3cyclictest2478034-21kworker/u8:2+events_unbound23:20:190
2255024991511,1cyclictest60350irq/132-enp0s29f1:rx-000:05:140
2255037991411,2cyclictest2431859-21kworker/u8:1+flush-259:022:20:193
2255037991411,2cyclictest2416840-21irqcore21:45:163
2255037991411,2cyclictest2265674-21cpuspeed_turbos19:20:133
2255037991410,3cyclictest509-21rs:main3
2255037991410,3cyclictest335557-21systemd-journal20:16:593
2255037991410,2cyclictest2317223-21apt-get20:10:123
2255037991410,2cyclictest0-21swapper/322:40:003
225503399148,4cyclictest2395089-21kworker/u8:2+flush-259:022:00:162
225503399148,4cyclictest2265349-21kworker/u8:3+flush-259:020:05:152
2255033991412,1cyclictest2364070-21awk20:55:002
2255033991411,2cyclictest2493475-21idleruntime-cro23:00:002
2255033991411,2cyclictest2452919-21irqcore22:20:162
2255033991411,2cyclictest0-21swapper/220:45:012
2255033991410,2cyclictest2327547-21kworker/u8:4-events_unbound20:25:012
2255026991411,3cyclictest2327547-21kworker/u8:4+events_unbound21:40:221
2255026991411,2cyclictest2431859-21kworker/u8:1+events_unbound22:15:231
2255026991411,2cyclictest2431859-21kworker/u8:1+events_unbound22:15:231
2255026991411,2cyclictest2327547-21kworker/u8:4+events_unbound20:55:271
2255024991413,1cyclictest60350irq/132-enp0s29f1:rx-021:39:470
2255024991413,1cyclictest60350irq/132-enp0s29f1:rx-019:52:100
2255024991413,1cyclictest60350irq/132-enp0s29f1:rx-000:12:140
2255024991413,0cyclictest60350irq/132-enp0s29f1:rx-023:49:170
2255024991412,1cyclictest60350irq/132-enp0s29f1:rx-020:10:150
2255024991412,1cyclictest60350irq/132-enp0s29f1:rx-020:05:170
2255024991411,2cyclictest2478034-21kworker/u8:2+events_unbound23:10:000
225503799139,3cyclictest2541284-21fschecks_time23:45:133
2255037991311,1cyclictest0-21swapper/319:54:593
2255037991310,2cyclictest2415692-21unixbench_multi21:40:243
2255037991310,2cyclictest2395089-21kworker/u8:2+events_unbound21:35:233
2255037991310,2cyclictest2390197-21cpuspeed_turbos21:20:103
2255037991310,2cyclictest2353295-21kworker/u8:1+flush-259:021:05:213
2255037991310,2cyclictest0-21swapper/322:50:003
225503399138,4cyclictest2493501-21kworker/u8:3+flush-259:023:48:342
225503399138,4cyclictest2265349-21kworker/u8:3+flush-259:020:00:152
225503399138,4cyclictest2265349-21kworker/u8:3+flush-259:020:00:152
225503399137,4cyclictest335557-21systemd-journal21:45:262
2255033991311,1cyclictest0-21swapper/200:00:002
2255033991310,2cyclictest2593333-21grep00:35:172
2255033991310,2cyclictest2593333-21grep00:35:162
2255033991310,2cyclictest2441476-21unixbench_multi22:05:252
2255033991310,2cyclictest2374683-21cpuspeed_turbos21:05:112
2255033991310,2cyclictest0-21swapper/221:30:002
2255026991311,1cyclictest0-21swapper/123:00:001
2255026991310,2cyclictest2311026-21ntp_offset20:00:221
2255026991310,2cyclictest2311026-21ntp_offset20:00:211
2255026991310,2cyclictest2265349-21kworker/u8:3+events_unbound19:30:251
225502499139,3cyclictest2457416-21kworker/u8:0+flush-259:023:10:240
225502499139,3cyclictest2457416-21kworker/u8:0+events_unbound23:15:190
2255024991311,1cyclictest60350irq/132-enp0s29f1:rx-020:15:240
2255024991311,1cyclictest60350irq/132-enp0s29f1:rx-019:55:240
225503799129,2cyclictest2359240-21cpuspeed_turbos20:50:133
225503799129,2cyclictest2279917-21ntp_kernel_pll_19:30:243
225503799128,3cyclictest2265349-21kworker/u8:3+events_unbound20:20:243
2255037991210,1cyclictest2288015-21kthreadcore19:40:163
225503399129,2cyclictest2431617-21idleruntime-cro22:00:002
225503399129,2cyclictest17550irq/130-nvme0q300:35:002
225503399128,3cyclictest2327547-21kworker/u8:4+flush-259:021:00:012
2255033991210,1cyclictest0-21swapper/223:35:012
225502699129,2cyclictest2275659-21kworker/u8:0+events_unbound19:45:261
225502699128,3cyclictest2395089-21kworker/u8:2+flush-259:022:05:041
2255026991210,1cyclictest0-21swapper/123:00:171
225502499129,3cyclictest2234780-21kworker/u8:2+events_unbound19:14:290
225503799118,2cyclictest2551463-21cpuspeed_turbos23:55:133
225503799118,2cyclictest2467295-21unixbench_singl22:30:243
225503799115,4cyclictest2260595-21diskstats19:15:143
225503399118,2cyclictest2473369-21fschecks_time22:40:132
225503399114,5cyclictest335557-21systemd-journal23:16:262
225503399111,7cyclictest2337730-21munin-run20:29:592
225503399110,3cyclictest2462583-21awk22:29:592
225502699119,1cyclictest0-21swapper/122:55:001
225502699118,2cyclictest2520430-21cpuspeed_turbos23:25:131
225502699118,2cyclictest2353295-21kworker/u8:1+events_unbound21:10:141
225503799108,1cyclictest0-21swapper/322:50:143
225503799106,3cyclictest2265349-21kworker/u8:3+flush-259:019:25:283
225503799106,2cyclictest2570924-21ntpq00:10:213
225503399107,2cyclictest2530821-21cpuspeed_turbos23:35:122
225503399104,4cyclictest2546402-21diskstats23:50:132
225502699107,2cyclictest0-21swapper/100:25:231
22550379996,2cyclictest0-21swapper/300:25:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional