You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-24 - 03:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Thu Sep 24, 2026 00:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
273769910521050,2cyclictest20918-21kworker/0:2+events19:35:420
273889910511049,2cyclictest6986-21kworker/2:1+events23:15:442
273919910501048,2cyclictest29304-21kworker/3:1+events20:39:223
273889910501048,2cyclictest26986-21kworker/2:0+events23:23:402
273769910501048,2cyclictest20918-21kworker/0:2+events19:20:210
273769910501046,2cyclictest25324-21kworker/0:2+events22:13:380
273769910491048,1cyclictest18400-21kworker/0:3+events20:14:100
273769910491047,2cyclictest4975-21kworker/0:1+events23:47:550
273769910491047,2cyclictest4975-21kworker/0:1+events00:31:510
273769910491047,2cyclictest4668-21kworker/0:0+events19:46:520
273769910491047,2cyclictest17830-21kworker/0:2+events00:37:540
273889910481045,3cyclictest25622-21turbostat20:29:562
273769910481046,2cyclictest31716-21kworker/0:1+events22:01:440
273919910471045,1cyclictest14742-21kworker/3:0+events00:00:203
273919910461045,1cyclictest24861-21kworker/3:1+events00:13:163
273839910461045,1cyclictest10355-21kworker/1:2+events21:40:431
273769910461044,2cyclictest14925-21kworker/0:2+events20:25:230
273919910451043,2cyclictest20063-21kworker/3:0+events23:43:173
273919910441043,1cyclictest9173-21kworker/3:1+events23:57:323
273919910441040,4cyclictest22230-21turbostat00:39:543
273889910441042,2cyclictest26986-21kworker/2:0+events23:32:432
273769910441042,2cyclictest4407-21kworker/0:0+events21:59:320
273769910441041,3cyclictest4668-21kworker/0:0+events19:52:560
273769910441041,3cyclictest24223-21turbostat23:04:550
273769910441041,3cyclictest20918-21kworker/0:2+events19:29:260
273919910431042,1cyclictest25765-21kworker/3:2+events21:29:303
273919910431042,1cyclictest20063-21kworker/3:0+events23:13:063
273889910431041,2cyclictest27146-21kworker/2:2+events22:31:032
273889910431039,2cyclictest6986-21kworker/2:1+events23:29:542
273769910431041,2cyclictest4668-21kworker/0:0+events19:43:460
273769910431039,3cyclictest18400-21kworker/0:3+events20:16:140
273919910421040,2cyclictest26604-21kworker/3:2+events23:51:053
273769910421040,2cyclictest20918-21kworker/0:2+events19:12:560
273769910411039,2cyclictest31716-21kworker/0:1+events22:07:340
273769910411039,2cyclictest20918-21kworker/0:2+events19:33:370
273769910411039,2cyclictest12884-21kworker/0:1+events20:02:100
273889910391036,3cyclictest23171-21turbostat20:24:562
273769910391037,2cyclictest18400-21kworker/0:3+events20:06:070
273769910381036,2cyclictest31716-21kworker/0:1+events22:15:210
273889910351033,2cyclictest12363-21turbostat00:29:552
273839910341033,1cyclictest30010-21kworker/1:1+events22:41:521
273919910331031,2cyclictest29304-21kworker/3:1+events20:32:353
273769910331031,2cyclictest18400-21kworker/0:3+events20:51:500
273769910331030,3cyclictest12884-21kworker/0:1+events19:56:490
273919910261025,1cyclictest20063-21kworker/3:0+events23:38:063
273769910261023,3cyclictest9998-21turbostat21:44:550
273839910251024,1cyclictest30010-21kworker/1:1+events22:35:431
273919910231022,1cyclictest4666-21kworker/3:2+events00:21:153
273769910221019,3cyclictest22131-21turbostat22:29:560
273919910201019,1cyclictest24410-21kworker/3:2+events22:20:233
273919910171016,1cyclictest17859-21kworker/3:1+events22:58:063
273919910131010,2cyclictest12331-21kworker/3:0+events21:18:403
273839910121011,1cyclictest30010-21kworker/1:1+events22:48:281
273769910071005,2cyclictest17171-21turbostat22:24:560
273919910061004,2cyclictest14890-21kworker/3:0+events21:50:453
273919910061004,2cyclictest14890-21kworker/3:0+events21:50:443
273919910051002,3cyclictest27272-21turbostat19:14:563
27391991001999,2cyclictest29304-21kworker/3:1+events21:20:453
27376991000996,4cyclictest9249-21turbostat23:54:550
2739199995994,1cyclictest17859-21kworker/3:1+events22:27:583
2739199994993,1cyclictest24861-21kworker/3:1+events00:28:363
2739199993992,1cyclictest14890-21kworker/3:0+events21:48:253
2739199993992,1cyclictest14311-21kworker/3:2+events22:52:113
2739199993991,2cyclictest24861-21kworker/3:1+events00:18:033
2739199988987,1cyclictest12331-21kworker/3:0+events21:13:243
2739199983982,1cyclictest29304-21kworker/3:1+events19:15:443
2737699980977,3cyclictest27041-21turbostat22:34:540
2739199976974,2cyclictest2159-21turbostat20:49:553
2739199974973,1cyclictest25765-21kworker/3:2+events21:39:413
2739199974973,1cyclictest20063-21kworker/3:0+events23:05:443
2739199974973,1cyclictest12331-21kworker/3:0+events21:32:293
2739199970969,1cyclictest31960-21kworker/3:2+events20:43:303
2739199969968,1cyclictest29304-21kworker/3:1+events21:03:433
2739199969968,1cyclictest29304-21kworker/3:1+events20:55:233
2739199965964,1cyclictest23142-21kworker/3:2+events20:21:263
2739199964963,1cyclictest19118-21kworker/3:3+events00:08:483
2739199962962,0cyclictest20063-21kworker/3:0+events23:02:433
2739199962961,1cyclictest29304-21kworker/3:1+events21:07:333
2738399962960,2cyclictest12014-21turbostat23:24:551
2738399939937,2cyclictest14952-21turbostat21:49:551
2739199936934,2cyclictest4541-21turbostat22:44:553
2737699924921,3cyclictest2130-21turbostat23:14:540
2738899921917,4cyclictest24103-21turbostat00:09:552
2739199917914,2cyclictest12235-21turbostat22:19:553
2738399913911,2cyclictest21153-21turbostat20:19:551
2738399908906,2cyclictest4313-21turbostat23:49:541
2737699864861,1cyclictest9493-21turbostat22:49:550
2738899688687,1cyclictest2130-21turbostat23:14:542
2737699688685,3cyclictest19873-21turbostat21:54:560
2737699688685,3cyclictest19873-21turbostat21:54:560
2739199624621,3cyclictest21153-21turbostat20:19:553
2739199618615,3cyclictest4313-21turbostat23:49:543
2739199612610,1cyclictest4178-21turbostat20:54:553
2737699610607,3cyclictest2159-21turbostat20:49:560
2737699602599,3cyclictest31763-21turbostat23:44:550
2738899589586,3cyclictest22131-21turbostat22:29:562
2739199586583,3cyclictest21884-21turbostat23:34:553
2737699583579,4cyclictest23171-21turbostat20:24:550
2737699578576,2cyclictest12363-21turbostat00:29:550
2739199537535,2cyclictest9493-21turbostat22:49:543
2738399531528,3cyclictest5030-21turbostat21:39:561
2737699515513,2cyclictest29324-21turbostat19:19:560
2739199514510,4cyclictest25622-21turbostat20:29:553
2739199501498,3cyclictest9998-21turbostat21:44:553
2738399500498,2cyclictest27041-21turbostat22:34:541
27383992019,1cyclictest67750irq/123-lan23:55:161
27383991919,0cyclictest67750irq/123-lan21:25:561
27383991818,0cyclictest67750irq/123-lan23:37:271
27383991818,0cyclictest67750irq/123-lan23:32:401
27383991818,0cyclictest67750irq/123-lan23:26:541
27383991818,0cyclictest67750irq/123-lan23:16:111
27383991818,0cyclictest67750irq/123-lan22:50:201
27383991818,0cyclictest67750irq/123-lan22:24:311
27383991818,0cyclictest67750irq/123-lan22:17:311
27383991818,0cyclictest67750irq/123-lan22:11:551
27383991818,0cyclictest67750irq/123-lan22:09:231
27383991818,0cyclictest67750irq/123-lan21:15:131
27383991818,0cyclictest67750irq/123-lan20:37:521
27383991818,0cyclictest67750irq/123-lan19:34:581
27383991818,0cyclictest67750irq/123-lan19:22:481
27383991818,0cyclictest67750irq/123-lan00:25:131
27383991818,0cyclictest67750irq/123-lan00:02:231
27383991817,1cyclictest67750irq/123-lan23:04:591
27383991817,1cyclictest67750irq/123-lan21:50:201
27383991817,1cyclictest67750irq/123-lan21:50:201
27383991817,1cyclictest67750irq/123-lan21:21:561
27383991817,1cyclictest67750irq/123-lan00:10:011
27383991717,0cyclictest67750irq/123-lan23:14:591
27383991717,0cyclictest67750irq/123-lan23:00:181
27383991717,0cyclictest67750irq/123-lan22:55:111
27383991717,0cyclictest67750irq/123-lan22:25:111
27383991717,0cyclictest67750irq/123-lan21:58:441
27383991717,0cyclictest67750irq/123-lan21:31:501
27383991717,0cyclictest67750irq/123-lan20:44:051
27383991717,0cyclictest67750irq/123-lan20:30:161
27383991717,0cyclictest67750irq/123-lan20:25:181
27383991717,0cyclictest67750irq/123-lan00:36:371
27383991717,0cyclictest67750irq/123-lan00:31:251
27383991717,0cyclictest67750irq/123-lan00:15:401
27383991716,1cyclictest67750irq/123-lan00:05:171
27383991616,0cyclictest67750irq/123-lan23:52:141
27383991616,0cyclictest67750irq/123-lan22:03:291
27383991616,0cyclictest67750irq/123-lan21:11:571
27383991616,0cyclictest67750irq/123-lan20:50:181
27383991616,0cyclictest67750irq/123-lan20:10:161
27383991616,0cyclictest67750irq/123-lan19:50:131
27383991616,0cyclictest67750irq/123-lan00:24:331
27383991615,1cyclictest67750irq/123-lan20:45:181
27383991615,1cyclictest67750irq/123-lan19:35:141
27383991515,0cyclictest67750irq/123-lan23:40:261
27383991515,0cyclictest67750irq/123-lan21:00:261
27383991515,0cyclictest67750irq/123-lan19:40:181
27383991414,0cyclictest67750irq/123-lan20:20:151
27383991414,0cyclictest67750irq/123-lan19:55:171
27383991414,0cyclictest67750irq/123-lan19:49:411
27383991414,0cyclictest67750irq/123-lan19:25:131
27383991414,0cyclictest67750irq/123-lan19:13:511
27383991212,0cyclictest67750irq/123-lan21:05:141
27383991212,0cyclictest67750irq/123-lan20:55:221
27383991212,0cyclictest67750irq/123-lan20:05:161
27383991212,0cyclictest67750irq/123-lan19:15:161
273889998,1cyclictest784-21snmpd20:55:032
273889998,1cyclictest782-21lldpd21:47:152
273839995,2cyclictest0-21swapper/120:00:181
273919988,0cyclictest784-21snmpd19:53:243
273919988,0cyclictest782-21lldpd23:29:273
273919988,0cyclictest782-21lldpd20:01:543
273919988,0cyclictest782-21lldpd19:44:413
273919986,2cyclictest762-21ntpd00:32:393
273919985,3cyclictest762-21ntpd23:18:343
273889988,0cyclictest784-21snmpd21:22:542
273889988,0cyclictest784-21snmpd20:10:102
273889988,0cyclictest784-21snmpd19:51:012
273889988,0cyclictest784-21snmpd00:12:222
273889988,0cyclictest782-21lldpd22:44:412
273889988,0cyclictest782-21lldpd19:35:032
273889987,1cyclictest784-21snmpd19:33:102
273889987,1cyclictest784-21snmpd00:04:362
273769988,0cyclictest782-21lldpd21:31:470
273769988,0cyclictest782-21lldpd00:15:220
273769987,1cyclictest782-21lldpd00:07:150
273769987,1cyclictest27585-21gltestperf23:35:150
273769987,1cyclictest20591-21cut22:55:150
273919977,0cyclictest784-21snmpd22:01:093
273919977,0cyclictest784-21snmpd19:37:273
273919977,0cyclictest526-21avahi-daemon19:24:083
273919976,1cyclictest784-21snmpd20:05:023
273919976,1cyclictest526-21avahi-daemon22:11:173
273889977,0cyclictest784-21snmpd22:50:362
273889977,0cyclictest784-21snmpd22:03:212
273889977,0cyclictest784-21snmpd00:20:332
273889977,0cyclictest782-21lldpd20:15:502
273889977,0cyclictest782-21lldpd19:26:172
273889976,1cyclictest784-21snmpd23:49:022
273889976,1cyclictest784-21snmpd22:10:052
273889976,1cyclictest784-21snmpd21:36:052
273889976,1cyclictest784-21snmpd20:54:532
273889976,1cyclictest557-21ntp_kernel_pll_23:40:192
273889976,1cyclictest526-21avahi-daemon23:59:512
273889976,1cyclictest526-21avahi-daemon20:49:152
273889976,1cyclictest507-21systemd-resolve22:15:032
273889976,1cyclictest507-21systemd-resolve00:32:322
273889976,1cyclictest4542-21munin-plugin-st22:39:592
273889976,1cyclictest25327-21needreboot23:00:172
273889975,2cyclictest9753-21cat19:45:172
273889975,2cyclictest784-21snmpd21:27:122
273889975,2cyclictest784-21snmpd21:15:372
273889975,2cyclictest784-21snmpd21:09:002
273889974,3cyclictest10324-21cat22:45:132
273889973,3cyclictest245-20systemd-journal22:07:002
273889973,3cyclictest245-20systemd-journal21:33:112
273769977,0cyclictest782-21lldpd23:18:020
273769977,0cyclictest782-21lldpd21:03:060
273769977,0cyclictest782-21lldpd20:37:060
273769977,0cyclictest782-21lldpd20:30:500
273769977,0cyclictest782-21lldpd00:12:260
273769976,1cyclictest784-21snmpd23:30:170
273769976,1cyclictest784-21snmpd00:21:120
273769975,2cyclictest784-21snmpd21:19:070
273769975,2cyclictest12847-21cat23:20:130
273769974,2cyclictest245-20systemd-journal21:05:180
273919964,2cyclictest784-21snmpd19:56:153
273919963,3cyclictest26621-21ssh21:55:203
273919963,2cyclictest31468-21ssh22:34:133
273919963,2cyclictest1462-21ssh22:35:253
273919962,3cyclictest547-21NetworkManager22:08:103
273889966,0cyclictest782-21lldpd20:00:322
273889966,0cyclictest526-21avahi-daemon20:44:482
273889965,1cyclictest31704-21cpuspeed_turbos19:20:122
273889965,1cyclictest0-21swapper/221:10:152
273889964,2cyclictest784-21snmpd22:24:482
273889963,3cyclictest547-21NetworkManager21:50:432
273889963,3cyclictest547-21NetworkManager21:50:422
273889963,3cyclictest547-21NetworkManager00:37:452
273889963,2cyclictest28562-21kworker/u16:1+nfsiod23:07:372
273889963,2cyclictest13050-21ssh21:42:092
273889962,3cyclictest27536-21fw_forwarded_lo23:35:152
273769965,1cyclictest507-21systemd-resolve22:50:110
273769964,2cyclictest784-21snmpd23:27:170
273769963,3cyclictest547-21NetworkManager21:35:290
273769963,2cyclictest6619-21ssh22:40:420
273769963,2cyclictest574-21rs:main0
273769963,2cyclictest31928-21ssh23:06:060
273769963,2cyclictest31215-21ssh21:28:090
273769963,2cyclictest22424-21ssh00:02:310
273769963,2cyclictest17700-21ssh21:46:440
273769963,2cyclictest14744-21ssh21:10:410
273769962,3cyclictest17217-21ssh23:57:090
273919953,2cyclictest12522-21tr23:20:103
273919952,3cyclictest1888-21grep19:25:153
273919952,2cyclictest9976-21cut19:45:183
273919952,2cyclictest20033-21grep20:10:143
273889955,0cyclictest782-21lldpd20:32:142
273889955,0cyclictest526-21avahi-daemon19:57:452
273889954,1cyclictest9198-21gltestperf21:00:122
273889953,2cyclictest784-21snmpd23:52:572
273889953,2cyclictest784-21snmpd19:41:542
273889953,2cyclictest547-21NetworkManager00:15:182
273889952,3cyclictest547-21NetworkManager21:57:062
273889952,2cyclictest27907-21tail19:10:132
273889952,2cyclictest21801-21ssh22:56:222
273889951,3cyclictest30682-21sed19:15:212
273889951,3cyclictest245-20systemd-journal20:39:232
273889951,3cyclictest17949-21memory20:05:192
273769955,0cyclictest782-21lldpd20:40:250
273769952,2cyclictest2417-21ssh22:36:490
273919940,4cyclictest4126-21ntpq19:30:203
273769941,2cyclictest6675-21grep20:55:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional