You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 19:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri Jun 12, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
282853995854,3cyclictest330014-21kworker/u8:4+flush-259:008:00:253
282843995145,4cyclictest340363-21base6408:05:010
282845994538,5cyclictest459813-21latency_hist10:00:011
282843994437,5cyclictest474901-21ntpq10:10:200
282853994336,5cyclictest594821-21ntpq12:05:213
282848994339,3cyclictest429164-21kworker/u8:4+flush-259:009:50:182
282843994238,3cyclictest350949-21gpgv08:15:010
282843994236,4cyclictest469275-21ntpq10:05:220
282845994136,4cyclictest351582-21/usr/sbin/munin08:15:141
282848993933,4cyclictest574326-21cat11:50:012
282853993835,2cyclictest366881-21kworker/u8:2+flush-259:008:35:003
282848993834,3cyclictest429164-21kworker/u8:4+flush-259:009:45:162
282845993831,5cyclictest422883-21ntpq09:20:221
282853993734,2cyclictest507347-21kworker/u8:1+flush-259:011:25:143
282853993531,3cyclictest522491-21kworker/u8:4+flush-259:011:10:163
282853993531,3cyclictest429164-21kworker/u8:4+flush-259:010:00:163
282843993530,4cyclictest360838-21ntpq08:20:210
282853993427,5cyclictest511835-21dpkg10:49:283
282848993430,3cyclictest424010-21/usr/sbin/munin09:25:242
282845993429,3cyclictest324445-21store07:50:011
282843993427,5cyclictest579385-21latency_hist11:55:000
282843993427,5cyclictest510996-21ntpq10:45:210
282843993427,5cyclictest298314-21latency_hist07:25:010
282848993329,3cyclictest1320527-21kworker/u8:1+flush-259:009:10:002
282848993328,3cyclictest408279-21kworker/u8:3+flush-259:009:15:172
282845993328,3cyclictest568879-21/usr/sbin/munin11:45:191
282853993228,3cyclictest507347-21kworker/u8:1+events_unbound11:05:193
282853993228,3cyclictest429164-21kworker/u8:4+flush-259:009:35:263
282853993228,3cyclictest335557-21systemd-journal12:35:003
282845993226,4cyclictest287107-21ntpq07:10:201
282843993228,3cyclictest335557-21systemd-journal08:45:230
282843993224,4cyclictest537713-21latency_hist11:15:010
282848993128,2cyclictest366881-21kworker/u8:2+flush-259:008:40:172
282848993127,2cyclictest507347-21kworker/u8:1+flush-259:012:25:172
282845993120,9cyclictest509-21rs:main1
282843993125,4cyclictest600868-21latency_hist12:15:000
282843993125,4cyclictest532611-21latency_hist11:10:000
282853993027,2cyclictest240144-21kworker/u8:0+flush-259:007:20:233
282848993024,4cyclictest574016-21gpgv11:50:002
282843993025,3cyclictest460075-21apt-get10:00:110
282848992925,3cyclictest439464-21kworker/u8:3+flush-259:009:45:002
282853992825,2cyclictest428954-21kworker/u8:1+flush-259:010:25:233
282848992825,2cyclictest1320527-21kworker/u8:1+flush-259:009:00:172
282848992824,3cyclictest616336-21kworker/u8:0+flush-259:012:38:252
282848992824,3cyclictest298543-21kworker/u8:3+events_unbound07:30:312
282845992824,3cyclictest340459-21cat08:05:011
282853992723,3cyclictest553387-21kworker/u8:3+events_unbound11:39:583
282853992723,3cyclictest428954-21kworker/u8:1+events_unbound10:15:253
282845992721,4cyclictest282779-21latency_hist07:10:011
282853992623,2cyclictest387531-21kworker/u8:2+flush-259:009:10:213
282853992623,2cyclictest387531-21kworker/u8:2+flush-259:009:10:213
282853992622,3cyclictest387531-21kworker/u8:2+events_unbound08:50:193
282848992623,2cyclictest240144-21kworker/u8:0+flush-259:007:20:242
282848992622,3cyclictest486070-21kworker/u8:3+events_unbound10:40:132
282848992621,3cyclictest335557-21systemd-journal10:49:242
282845992621,4cyclictest335557-21systemd-journal10:50:011
282843992621,3cyclictest330045-21apt-get07:55:100
282848992522,2cyclictest501537-21kworker/u8:2+flush-259:011:00:232
282848992521,3cyclictest537336-21kworker/u8:0+events_unbound11:14:252
282848992521,3cyclictest335250-21kworker/u8:0+flush-259:008:10:012
282848992521,3cyclictest1320527-21kworker/u8:1+events_unbound08:45:132
282848992518,5cyclictest335557-21systemd-journal08:32:242
282845992520,3cyclictest470778-21/usr/sbin/munin10:10:131
28284399259,5cyclictest558361-21latency_hist11:35:000
282843992522,2cyclictest1-21systemd07:45:010
282843992519,5cyclictest625708-21ntpq12:35:180
282843992519,4cyclictest509-21rs:main0
282853992422,2cyclictest387531-21kworker/u8:2+events_unbound09:20:253
282853992421,2cyclictest240144-21kworker/u8:0+flush-259:007:35:193
282853992420,3cyclictest507347-21kworker/u8:1+flush-259:011:30:203
282853992420,3cyclictest501537-21kworker/u8:2+flush-259:010:50:163
282853992420,3cyclictest408279-21kworker/u8:3+events_unbound09:15:273
282853992420,3cyclictest335250-21kworker/u8:0+flush-259:008:21:243
282853992420,3cyclictest1320527-21kworker/u8:1+events_unbound08:45:153
282853992419,4cyclictest470123-21latency_hist10:10:013
282848992422,2cyclictest387531-21kworker/u8:2+flush-259:009:10:242
282848992422,2cyclictest387531-21kworker/u8:2+flush-259:009:10:232
282848992421,2cyclictest600893-21kworker/u8:3+flush-259:012:20:212
282848992421,2cyclictest1320527-21kworker/u8:1+events_unbound08:15:252
282848992420,3cyclictest600893-21kworker/u8:3+events_unbound12:17:252
282848992420,3cyclictest298543-21kworker/u8:3+events_unbound07:44:252
282848992419,3cyclictest491429-21/usr/sbin/munin10:30:182
28284899241,21cyclictest1-21systemd11:29:252
282853992320,3cyclictest240144-21kworker/u8:0+events_unbound07:29:253
282853992320,2cyclictest600893-21kworker/u8:3+events_unbound12:25:253
282853992320,2cyclictest491423-21kworker/u8:0+flush-259:010:30:203
282853992320,2cyclictest392964-21kworker/u8:0+flush-259:009:49:333
282853992320,2cyclictest387531-21kworker/u8:2+flush-259:009:05:213
282853992319,3cyclictest507347-21kworker/u8:1+flush-259:012:00:223
282853992319,3cyclictest465208-21kworker/u8:0+flush-259:010:12:253
282853992319,3cyclictest1320527-21kworker/u8:1+events_unbound07:55:013
282853992318,4cyclictest611176-21latency_hist12:25:013
282853992318,4cyclictest509-21rs:main3
282853992317,4cyclictest579599-21gpgv11:55:003
282848992320,2cyclictest240144-21kworker/u8:0+flush-259:007:35:252
282848992319,2cyclictest1320527-21kworker/u8:1+events_unbound08:10:192
282845992319,3cyclictest601141-21apt-get12:15:121
282845992319,3cyclictest574366-21gpgv11:50:011
282845992319,3cyclictest500-21systemd-logind12:10:001
282853992219,2cyclictest387531-21kworker/u8:2+events_unbound09:30:263
282853992218,3cyclictest553387-21kworker/u8:3+flush-259:011:45:163
282848992218,3cyclictest428954-21kworker/u8:1+flush-259:010:20:232
282848992218,3cyclictest392964-21kworker/u8:0+events_unbound08:55:192
282848992218,3cyclictest335247-21apt-get08:00:112
282845992216,4cyclictest398140-21/usr/sbin/munin09:00:141
28284399228,2cyclictest0-21swapper/009:45:140
28284399224,7cyclictest0-21swapper/009:05:180
282853992118,2cyclictest1320527-21kworker/u8:1+events_unbound09:00:143
282853992118,2cyclictest1320527-21kworker/u8:1+events_unbound07:10:183
282853992117,3cyclictest507347-21kworker/u8:1+events_unbound10:55:163
282853992117,3cyclictest454912-21apt-get09:55:113
282853992117,3cyclictest428954-21kworker/u8:1+flush-259:009:51:263
282853992116,4cyclictest522527-21apt-get11:00:133
282848992118,2cyclictest590756-21kworker/u8:0+flush-259:012:05:262
282848992118,2cyclictest387531-21kworker/u8:2+flush-259:009:39:302
282848992117,3cyclictest507347-21kworker/u8:1+events_unbound12:01:262
282848992117,3cyclictest507347-21kworker/u8:1+events_unbound11:09:272
282848992117,3cyclictest501537-21kworker/u8:2+flush-259:010:50:202
282845992116,3cyclictest563524-21latency_hist11:40:001
282845992116,3cyclictest501782-21apt-get10:40:111
282845992115,4cyclictest439238-21latency_hist09:40:011
282845992110,9cyclictest298581-21apt-get07:25:141
282843992116,3cyclictest335557-21systemd-journal09:22:250
282853992017,2cyclictest408279-21kworker/u8:3+flush-259:009:25:263
282853992016,3cyclictest568665-21kworker/u8:2+events_unbound12:10:183
282853992016,3cyclictest392964-21kworker/u8:0+events_unbound09:41:253
282848992018,2cyclictest387531-21kworker/u8:2+flush-259:009:30:012
282848992016,3cyclictest501537-21kworker/u8:2+events_unbound10:58:262
282848992016,3cyclictest429164-21kworker/u8:4+flush-259:010:04:342
282848992016,3cyclictest1320527-21kworker/u8:1+events_unbound08:20:152
282848992015,4cyclictest470305-21cp10:10:022
282848992014,4cyclictest541956-21ntpq11:15:192
282845992016,3cyclictest314072-21kworker/u8:4+flush-259:007:40:171
282845992014,4cyclictest527451-21latency_hist11:05:011
282845992014,4cyclictest335557-21systemd-journal11:13:241
282843992017,2cyclictest335250-21kworker/u8:0+flush-259:008:29:450
282843992016,3cyclictest351607-21apt-get08:15:110
282843992014,4cyclictest323370-21ntpq07:45:230
282853991916,2cyclictest1320527-21kworker/u8:1+flush-259:008:25:153
282853991915,3cyclictest486070-21kworker/u8:3+flush-259:010:40:193
282853991915,3cyclictest1320527-21kworker/u8:1+flush-259:008:19:163
282853991915,3cyclictest1320527-21kworker/u8:1+flush-259:007:34:073
282848991915,3cyclictest454667-21kworker/u8:2+flush-259:009:55:212
28284599198,8cyclictest480924-21latency_hist10:20:011
28284599197,11cyclictest324883-21apt-get07:50:121
282845991915,3cyclictest449821-21apt-get09:50:141
282843991915,3cyclictest568665-21kworker/u8:2+flush-259:012:15:170
282843991915,3cyclictest548302-21apt-get11:25:110
282853991815,2cyclictest600893-21kworker/u8:3+flush-259:012:15:213
282853991815,2cyclictest240144-21kworker/u8:0+flush-259:007:15:153
282853991813,3cyclictest351335-21gpgv08:15:003
282853991812,4cyclictest335557-21systemd-journal10:23:253
282848991815,2cyclictest568665-21kworker/u8:2+flush-259:011:55:202
282848991815,2cyclictest313865-21kworker/u8:2+events_unbound07:55:142
282848991814,3cyclictest240144-21kworker/u8:0+events_unbound07:25:182
28284599188,9cyclictest580140-21cpuspeed_turbos11:55:121
28284599187,10cyclictest509-21rs:main1
28284599187,10cyclictest361293-21unixbench_singl08:20:241
282845991814,3cyclictest507347-21kworker/u8:1+flush-259:011:30:251
28284599180,1cyclictest0-21swapper/110:35:111
282843991815,2cyclictest563520-21cron11:40:000
282843991813,4cyclictest60350irq/132-enp0s29f1:rx-010:59:020
282843991813,4cyclictest60350irq/132-enp0s29f1:rx-010:26:320
282843991813,4cyclictest60350irq/132-enp0s29f1:rx-007:35:210
282853991715,2cyclictest366881-21kworker/u8:2+events_unbound08:40:203
282853991713,3cyclictest507347-21kworker/u8:1+flush-259:011:23:253
282853991713,3cyclictest392964-21kworker/u8:0+events_unbound08:59:213
282848991714,2cyclictest491423-21kworker/u8:0+flush-259:010:35:222
282848991714,2cyclictest428954-21kworker/u8:1+events_unbound10:28:262
282848991714,2cyclictest1320527-21kworker/u8:1+events_unbound07:45:202
282848991713,3cyclictest387531-21kworker/u8:2+events_unbound08:50:212
282848991713,3cyclictest298543-21kworker/u8:3+flush-259:007:50:212
282848991713,3cyclictest1320527-21kworker/u8:1+flush-259:007:10:192
282845991715,1cyclictest543566-21irqcore11:20:171
282853991614,1cyclictest0-21swapper/307:50:013
282853991612,3cyclictest491423-21kworker/u8:0+flush-259:010:38:313
282853991612,3cyclictest1320527-21kworker/u8:1+events_unbound08:05:023
282853991610,4cyclictest579387-21apt-get11:55:013
282848991614,1cyclictest0-21swapper/210:15:002
282848991612,3cyclictest616336-21kworker/u8:0+events_unbound12:30:112
28284599168,7cyclictest0-21swapper/110:05:251
28284599165,1cyclictest0-21swapper/110:55:201
282845991614,1cyclictest382337-21latency_hist08:45:001
282845991612,3cyclictest387531-21kworker/u8:2+flush-259:009:14:541
282845991612,3cyclictest387531-21kworker/u8:2+flush-259:009:14:541
282845991612,3cyclictest371129-21ntp_kernel_err08:30:211
28284599160,4cyclictest351186-21wc08:15:011
282843991614,1cyclictest507347-21kworker/u8:1+flush-259:011:00:160
282843991613,2cyclictest60350irq/132-enp0s29f1:rx-011:20:000
282843991613,2cyclictest491423-21kworker/u8:0+flush-259:010:30:140
282843991613,2cyclictest0-21swapper/008:45:000
282843991612,2cyclictest0-21swapper/012:05:010
282843991611,4cyclictest60350irq/132-enp0s29f1:rx-007:10:150
282843991610,4cyclictest458901-21ntpq09:55:200
282843991610,4cyclictest454651-21latency_hist09:55:010
282843991610,4cyclictest391893-21ntpq08:50:230
282853991511,3cyclictest507347-21kworker/u8:1+flush-259:011:16:303
282848991512,2cyclictest387531-21kworker/u8:2+flush-259:009:20:272
282848991512,2cyclictest0-21swapper/210:20:012
282848991511,3cyclictest1320527-21kworker/u8:1+flush-259:008:25:112
28284599156,8cyclictest0-21swapper/112:20:241
28284599153,3cyclictest292468-21/usr/sbin/munin07:15:261
28284599152,4cyclictest425051-21kthreadcore09:25:171
28284599152,4cyclictest376795-21unixbench_singl08:35:251
282845991513,1cyclictest600854-21cron12:15:001
282845991513,1cyclictest0-21swapper/110:25:001
282845991513,1cyclictest0-21swapper/108:05:191
282845991512,2cyclictest486316-21apt-get10:25:101
282845991511,3cyclictest507347-21kworker/u8:1+flush-259:011:40:261
282845991511,3cyclictest507347-21kworker/u8:1+flush-259:011:40:251
28284599150,4cyclictest408261-21awk09:10:001
282843991514,1cyclictest60350irq/132-enp0s29f1:rx-010:16:100
282843991513,1cyclictest60350irq/132-enp0s29f1:rx-011:41:120
282843991513,1cyclictest60350irq/132-enp0s29f1:rx-011:41:110
282843991513,1cyclictest60350irq/132-enp0s29f1:rx-010:20:230
282843991512,2cyclictest61150irq/133-enp0s29f1:tx-012:20:180
282843991511,3cyclictest512177-21/usr/sbin/munin10:50:130
282853991411,2cyclictest372578-21fschecks_time08:35:143
282853991410,3cyclictest553387-21kworker/u8:3+events_unbound11:40:233
282853991410,3cyclictest553387-21kworker/u8:3+events_unbound11:40:223
282848991412,2cyclictest240144-21kworker/u8:0+events_unbound07:16:252
282848991410,3cyclictest507347-21kworker/u8:1+flush-259:011:40:002
28284599144,1cyclictest313041-21nvmesmart_nvme007:35:251
28284599143,2cyclictest460928-21irqcore10:00:161
28284599143,1cyclictest0-21swapper/108:45:191
282845991411,2cyclictest512460-21fschecks_time10:50:131
28284599140,4cyclictest542032-21ntpq11:15:191
28284599140,4cyclictest532144-21unixbench_multi11:05:211
28284599140,4cyclictest442154-21grep09:40:181
28284599140,3cyclictest335557-21systemd-journal11:30:001
282843991413,1cyclictest60350irq/132-enp0s29f1:rx-009:29:360
282843991413,1cyclictest60350irq/132-enp0s29f1:rx-009:16:590
282843991412,1cyclictest60350irq/132-enp0s29f1:rx-010:37:170
282843991412,1cyclictest60350irq/132-enp0s29f1:rx-008:55:230
282843991411,2cyclictest60350irq/132-enp0s29f1:rx-012:32:360
282843991410,3cyclictest408523-21apt-get09:10:110
282843991410,3cyclictest408523-21apt-get09:10:110
282848991311,1cyclictest1320527-21kworker/u8:1+events_unbound08:35:172
28284599138,3cyclictest616557-21/usr/sbin/munin12:30:191
282845991310,2cyclictest621916-21fschecks_count12:35:121
28284599130,5cyclictest589192-21ntpq12:00:201
28284599130,5cyclictest334984-21latency_hist08:00:011
28284599130,4cyclictest362250-21sort08:25:141
28284599130,3cyclictest387978-21uniq08:50:151
28284399139,3cyclictest491423-21kworker/u8:0+flush-259:010:44:470
282843991312,1cyclictest60350irq/132-enp0s29f1:rx-008:30:250
282843991312,1cyclictest60350irq/132-enp0s29f1:rx-007:25:190
282843991311,1cyclictest616313-21cron12:30:000
282843991311,1cyclictest0-21swapper/011:50:000
282843991310,2cyclictest60350irq/132-enp0s29f1:rx-012:05:110
282843991310,2cyclictest60350irq/132-enp0s29f1:rx-009:30:180
282843991310,2cyclictest60350irq/132-enp0s29f1:rx-007:30:120
28284599129,2cyclictest491520-21cpuspeed_turbos10:30:101
28284399129,2cyclictest60350irq/132-enp0s29f1:rx-009:35:110
28284399129,2cyclictest341077-21fschecks_count08:05:140
28284399126,3cyclictest439960-21cut09:40:160
282843991211,1cyclictest60350irq/132-enp0s29f1:rx-011:24:140
282843991210,1cyclictest60350irq/132-enp0s29f1:rx-007:15:170
282843991210,1cyclictest0-21swapper/009:05:000
28285399118,2cyclictest1320527-21kworker/u8:1+flush-259:007:55:113
28285399117,3cyclictest600893-21kworker/u8:3+flush-259:012:35:113
28284899119,1cyclictest0-21swapper/211:40:162
28284899119,1cyclictest0-21swapper/211:40:162
28284899118,1cyclictest0-21swapper/212:10:142
28284399119,1cyclictest60350irq/132-enp0s29f1:rx-008:37:380
28284399117,2cyclictest584991-21turbostat12:00:000
28284899107,2cyclictest0-21swapper/211:30:142
28284599108,1cyclictest0-21swapper/109:15:171
28284599108,1cyclictest0-21swapper/108:55:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional