You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-30 - 18:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sun Aug 30, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
769265994134,5cyclictest335557-21systemd-journal12:30:000
769276994036,3cyclictest1060966-21kworker/u8:2+flush-259:012:00:253
769270994035,3cyclictest894922-21cat09:10:012
769267994036,3cyclictest920578-21latency_hist09:35:021
769267993936,2cyclictest982696-21kworker/u8:3+flush-259:010:50:251
769270993834,3cyclictest779815-21kworker/u8:2+flush-259:007:55:252
769265993833,4cyclictest883969-21latency_hist09:00:000
769267993734,2cyclictest936080-21kworker/u8:2+flush-259:010:10:241
769267993733,3cyclictest731052-21kworker/u8:1+flush-259:007:50:231
769267993733,3cyclictest1076689-21apt-get12:05:101
769265993733,3cyclictest998728-21apt-get10:50:120
769265993730,5cyclictest1091966-21latency_hist12:20:000
769276993327,4cyclictest894778-21cat09:10:013
769267993328,3cyclictest1071558-21apt-get12:00:121
769265993329,3cyclictest936080-21kworker/u8:2+flush-259:009:55:230
769276993226,4cyclictest1044143-21ntpq11:30:213
769267993229,2cyclictest779815-21kworker/u8:2+flush-259:008:00:241
769267993229,2cyclictest731052-21kworker/u8:1+events_unbound07:40:251
769265993228,3cyclictest910503-21apt-get09:25:110
769265993228,3cyclictest769229-21kworker/u8:4+events_unbound07:15:230
769265993128,2cyclictest731052-21kworker/u8:1+events_unbound07:55:000
769265993127,3cyclictest1003897-21apt-get10:55:110
769265993125,4cyclictest806121-21kworker/u8:0+events_unbound08:45:240
769276993026,3cyclictest731052-21kworker/u8:1+flush-259:007:45:183
769265993026,3cyclictest1060966-21kworker/u8:2+flush-259:012:05:240
769265993024,4cyclictest889120-21latency_hist09:05:010
769267992926,2cyclictest883984-21kworker/u8:0+flush-259:009:15:151
769267992926,2cyclictest872755-21kworker/u8:3+flush-259:009:50:211
769267992925,3cyclictest972563-21kworker/u8:1+events_unbound11:05:111
769276992822,4cyclictest805621-21base6407:45:003
769270992823,3cyclictest335557-21systemd-journal12:15:162
769270992823,3cyclictest1029780-21/usr/sbin/munin11:20:132
769267992825,2cyclictest925757-21kworker/u8:1+flush-259:009:59:591
769267992825,2cyclictest872755-21kworker/u8:3+events_unbound08:50:151
769267992825,2cyclictest731052-21kworker/u8:1+events_unbound07:30:241
769267992724,2cyclictest779815-21kworker/u8:2+events_unbound07:20:241
769267992724,2cyclictest1060966-21kworker/u8:2+flush-259:012:13:011
769267992723,3cyclictest1024570-21kworker/u8:0+events_unbound11:35:161
769265992724,2cyclictest962544-21apt-get10:15:100
769265992724,2cyclictest837480-21kworker/u8:3+flush-259:008:15:230
769265992724,2cyclictest837480-21kworker/u8:3+events_unbound08:25:010
769276992622,2cyclictest785072-21apt-get07:25:133
769267992623,2cyclictest982696-21kworker/u8:3+events_unbound11:00:231
769267992623,2cyclictest972563-21kworker/u8:1+flush-259:010:25:251
769267992623,2cyclictest1060966-21kworker/u8:2+flush-259:012:15:211
769267992622,3cyclictest872755-21kworker/u8:3+events_unbound09:45:291
769267992621,4cyclictest335557-21systemd-journal10:59:591
769270992521,3cyclictest779815-21kworker/u8:2+flush-259:008:00:162
769270992520,3cyclictest1009096-21apt-get11:00:122
769267992522,2cyclictest837480-21kworker/u8:3+flush-259:008:20:151
769267992522,2cyclictest769229-21kworker/u8:4+flush-259:007:15:211
769267992522,2cyclictest1024570-21kworker/u8:0+flush-259:011:55:161
769267992521,3cyclictest1102964-21apt-get12:30:131
769267992519,4cyclictest335557-21systemd-journal08:35:151
769276992418,4cyclictest837702-21/usr/sbin/munin08:15:213
769276992418,4cyclictest1055363-21apt-get11:45:013
769267992421,2cyclictest972563-21kworker/u8:1+events_unbound10:35:241
769267992421,2cyclictest936080-21kworker/u8:2+events_unbound11:20:211
769267992421,2cyclictest1060966-21kworker/u8:2+events_unbound12:25:171
769267992420,3cyclictest1060966-21kworker/u8:2+flush-259:012:20:251
769267992419,3cyclictest920834-21apt-get09:35:101
769265992420,3cyclictest915660-21apt-get09:30:130
769265992420,3cyclictest837480-21kworker/u8:3+flush-259:008:25:250
769276992318,3cyclictest837480-21kworker/u8:3+flush-259:008:30:173
769270992320,2cyclictest925757-21kworker/u8:1+flush-259:010:05:002
769270992320,2cyclictest1060966-21kworker/u8:2+flush-259:012:25:002
769270992319,3cyclictest872755-21kworker/u8:3+flush-259:009:15:262
769267992320,2cyclictest972563-21kworker/u8:1+events_unbound10:40:151
769267992320,2cyclictest972563-21kworker/u8:1+events_unbound10:40:141
769267992319,3cyclictest1060966-21kworker/u8:2+events_unbound12:35:141
769265992316,5cyclictest1112146-21ntpq12:35:220
769276992216,4cyclictest1102692-21latency_hist12:30:003
769270992219,2cyclictest972563-21kworker/u8:1+flush-259:010:40:212
769270992219,2cyclictest972563-21kworker/u8:1+flush-259:010:40:212
769267992219,2cyclictest972563-21kworker/u8:1+events_unbound10:30:231
769267992219,2cyclictest1024570-21kworker/u8:0+flush-259:011:45:191
769267992216,4cyclictest1055364-21latency_hist11:45:011
769265992218,3cyclictest972563-21kworker/u8:1+events_unbound11:30:190
769265992218,3cyclictest972563-21kworker/u8:1+events_unbound11:05:220
769276992117,3cyclictest806121-21kworker/u8:0+flush-259:008:10:243
769270992117,3cyclictest972563-21kworker/u8:1+flush-259:010:25:162
769270992117,3cyclictest335557-21systemd-journal09:34:242
769270992116,3cyclictest873849-21/usr/sbin/munin08:50:232
769267992119,2cyclictest925757-21kworker/u8:1+flush-259:010:15:211
769267992118,2cyclictest925757-21kworker/u8:1+flush-259:010:00:211
769267992118,2cyclictest779815-21kworker/u8:2+events_unbound07:35:231
769267992117,3cyclictest972563-21kworker/u8:1+flush-259:011:25:201
769267992117,3cyclictest972563-21kworker/u8:1+events_unbound11:54:151
769267992114,4cyclictest894488-21cp09:10:011
769265992117,3cyclictest725728-21kworker/u8:3+events_unbound07:10:190
769265992115,4cyclictest811098-21latency_hist07:50:000
769276992015,3cyclictest941379-21base6409:55:013
769270992017,2cyclictest806121-21kworker/u8:0+flush-259:008:40:192
769270992014,4cyclictest335557-21systemd-journal07:29:152
769267992017,2cyclictest837480-21kworker/u8:3+events_unbound08:15:181
769267992016,3cyclictest982696-21kworker/u8:3+events_unbound11:15:221
769267992016,3cyclictest806121-21kworker/u8:0+events_unbound08:44:331
769267992016,3cyclictest779815-21kworker/u8:2+events_unbound08:10:281
769267992016,3cyclictest769229-21kworker/u8:4+events_unbound07:10:231
769267992016,2cyclictest967704-21apt-get10:20:111
769267992015,2cyclictest779326-21kworker/u8:0+events_unbound07:25:241
769267992013,4cyclictest831414-21ntpq08:05:211
769265992017,2cyclictest936080-21kworker/u8:2+flush-259:010:15:000
769265992017,2cyclictest872755-21kworker/u8:3+flush-259:008:50:250
769265992017,2cyclictest1024570-21kworker/u8:0+flush-259:011:50:230
769265992016,3cyclictest779326-21kworker/u8:0+flush-259:007:25:270
769265992014,4cyclictest894305-21latency_hist09:10:000
769276991917,1cyclictest795135-21turbostat.cron07:34:593
769276991915,3cyclictest1102719-21kworker/u8:1+flush-259:012:35:003
769276991913,4cyclictest335557-21systemd-journal08:57:163
769276991913,4cyclictest1055551-21cp11:45:003
769270991915,3cyclictest972563-21kworker/u8:1+flush-259:010:45:252
769270991915,3cyclictest967181-21kworker/u8:0+events_unbound10:20:192
769267991915,3cyclictest872755-21kworker/u8:3+events_unbound09:14:151
769267991915,3cyclictest837480-21kworker/u8:3+events_unbound08:28:171
769265991916,2cyclictest982696-21kworker/u8:3+flush-259:011:15:260
769265991915,3cyclictest779815-21kworker/u8:2+flush-259:008:10:010
769265991913,4cyclictest947035-21/usr/sbin/munin10:00:140
769276991813,3cyclictest894964-21/usr/sbin/munin09:10:223
769270991815,2cyclictest925757-21kworker/u8:1+events_unbound10:15:172
769270991812,4cyclictest858367-21apt-get08:35:112
769270991812,4cyclictest335557-21systemd-journal07:55:002
769267991813,3cyclictest884204-21/usr/sbin/munin09:00:141
769265991815,2cyclictest972563-21kworker/u8:1+flush-259:011:25:200
769265991814,3cyclictest972563-21kworker/u8:1+flush-259:010:35:160
769265991814,3cyclictest967181-21kworker/u8:0+flush-259:010:20:190
769265991812,4cyclictest821880-21latency_hist08:00:000
769265991811,5cyclictest826218-21ntpq08:00:210
769276991714,2cyclictest779815-21kworker/u8:2+flush-259:007:25:003
769270991714,2cyclictest779815-21kworker/u8:2+flush-259:007:35:182
769270991714,2cyclictest769257-21cyclictest09:50:002
769270991713,3cyclictest982696-21kworker/u8:3+flush-259:010:50:252
769270991713,3cyclictest972563-21kworker/u8:1+flush-259:012:00:012
769270991712,3cyclictest852982-21idleruntime-cro08:30:012
769267991714,2cyclictest806121-21kworker/u8:0+events_unbound07:55:271
769265991714,2cyclictest930909-21sh09:45:000
769265991714,2cyclictest872755-21kworker/u8:3+flush-259:009:45:250
769265991714,2cyclictest61150irq/133-enp0s29f1:tx-011:23:130
769265991714,2cyclictest1-21systemd12:00:010
769265991713,3cyclictest972563-21kworker/u8:1+events_unbound10:40:230
769265991713,3cyclictest972563-21kworker/u8:1+events_unbound10:40:220
769265991713,3cyclictest972563-21kworker/u8:1+events_unbound10:25:200
769276991613,2cyclictest972563-21kworker/u8:1+flush-259:010:55:213
769276991613,1cyclictest0-21swapper/310:04:593
769276991612,3cyclictest936080-21kworker/u8:2+flush-259:010:25:003
769270991614,1cyclictest0-21swapper/207:20:012
769270991612,2cyclictest0-21swapper/211:05:242
769270991611,3cyclictest1081620-21kworker/u8:3+flush-259:012:20:202
769267991613,2cyclictest883984-21kworker/u8:0+flush-259:009:20:221
769267991613,2cyclictest837480-21kworker/u8:3+flush-259:008:30:151
769267991613,2cyclictest1019841-21irqcore11:10:161
769265991614,1cyclictest60350irq/132-enp0s29f1:rx-012:10:200
769265991613,2cyclictest982696-21kworker/u8:3+events_unbound11:00:250
769265991612,3cyclictest972563-21kworker/u8:1+events_unbound10:30:110
769265991612,3cyclictest883984-21kworker/u8:0+flush-259:009:20:170
769276991512,2cyclictest873595-21cron08:50:003
769276991511,3cyclictest982696-21kworker/u8:3+flush-259:010:50:173
769276991511,3cyclictest936080-21kworker/u8:2+flush-259:010:10:233
769276991511,3cyclictest335557-21systemd-journal11:20:003
769276991511,3cyclictest1092083-21gpgv12:20:013
76927099159,4cyclictest941216-21awk09:55:002
76927099159,4cyclictest1061206-21apt-get11:50:132
76927099151,5cyclictest946780-21cron09:59:592
769270991512,2cyclictest972563-21kworker/u8:1+flush-259:011:30:272
769270991512,2cyclictest972563-21kworker/u8:1+events_unbound10:35:142
769270991511,3cyclictest731052-21kworker/u8:1+flush-259:008:05:242
769270991511,2cyclictest952662-21sed10:05:152
76926799158,5cyclictest335557-21systemd-journal10:06:131
769267991510,3cyclictest883098-21ntp_kernel_pll_08:55:211
769265991513,2cyclictest61150irq/133-enp0s29f1:tx-011:40:140
769265991513,1cyclictest60350irq/132-enp0s29f1:rx-012:33:230
769265991513,1cyclictest60350irq/132-enp0s29f1:rx-009:38:390
769265991513,1cyclictest60350irq/132-enp0s29f1:rx-009:15:230
769265991513,1cyclictest60350irq/132-enp0s29f1:rx-009:10:140
769265991512,2cyclictest837480-21kworker/u8:3+events_unbound08:35:220
769265991512,2cyclictest60350irq/132-enp0s29f1:rx-011:45:120
769265991512,2cyclictest60350irq/132-enp0s29f1:rx-011:12:550
769265991511,3cyclictest795403-21apt-get07:35:110
769265991511,3cyclictest1024570-21kworker/u8:0+events_unbound11:35:120
769276991411,2cyclictest972563-21kworker/u8:1+flush-259:011:25:053
769276991410,3cyclictest972563-21kworker/u8:1+flush-259:011:40:013
769276991410,2cyclictest0-21swapper/309:25:003
769270991411,2cyclictest925729-21idleruntime-cro09:40:012
769270991410,3cyclictest936080-21kworker/u8:2+flush-259:011:20:012
769267991411,2cyclictest972563-21kworker/u8:1+events_unbound10:45:191
769265991412,1cyclictest60350irq/132-enp0s29f1:rx-007:20:110
769265991411,2cyclictest60350irq/132-enp0s29f1:rx-008:40:130
769265991411,2cyclictest60350irq/132-enp0s29f1:rx-007:30:160
769265991410,3cyclictest925757-21kworker/u8:1+events_unbound09:50:150
769276991311,1cyclictest1251942-21kworker/3:2+events_power_efficient09:15:143
769276991310,2cyclictest920589-21turbostat09:35:003
769276991310,2cyclictest889105-21cron09:05:003
769276991310,2cyclictest845187-21tr08:20:173
769276991310,2cyclictest1084135-21kthreadcore12:10:173
769276991310,2cyclictest0-21swapper/307:15:003
76927099138,3cyclictest805473-21apt-get07:45:002
76927099137,4cyclictest335557-21systemd-journal08:34:142
76927099137,4cyclictest1055983-21base6411:45:022
76927099132,6cyclictest1050198-21munin-run11:40:012
769270991310,2cyclictest800625-21cpuspeed_turbos07:40:142
76926799139,3cyclictest872755-21kworker/u8:3+events_unbound09:25:191
76926599139,3cyclictest982696-21kworker/u8:3+flush-259:010:50:010
76926599139,3cyclictest837480-21kworker/u8:3+events_unbound08:30:210
76927699129,2cyclictest774970-21fschecks_time07:15:143
76927099129,2cyclictest779962-21cut07:20:122
76927099129,1cyclictest0-21swapper/207:15:002
76926799129,2cyclictest872755-21kworker/u8:3+events_unbound09:42:151
76926799129,2cyclictest858146-21kworker/u8:2+events_unbound08:45:121
76926599129,2cyclictest60350irq/132-enp0s29f1:rx-012:20:170
76927699118,2cyclictest769257-21cyclictest10:15:203
76927699111,2cyclictest925729-21awk09:40:013
76927099119,1cyclictest0-21swapper/207:30:222
76927099118,2cyclictest912801-21tr09:25:172
76927099118,2cyclictest1035189-21fschecks_count11:25:132
76927099118,2cyclictest1004073-21fschecks_count10:55:152
76927099117,3cyclictest863538-21kworker/u8:1+flush-259:008:45:202
76927699108,1cyclictest0-21swapper/309:25:153
76927699106,2cyclictest852125-21ntpq08:25:223
76927699104,4cyclictest335557-21systemd-journal12:05:153
76927099107,1cyclictest0-21swapper/212:35:252
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional