You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 13:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Wed Dec 31, 2025 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16838991918,1cyclictest65850irq/126-lan21:45:160
16838991817,1cyclictest65850irq/126-lan23:39:200
16838991817,1cyclictest65850irq/126-lan23:25:130
16838991817,1cyclictest65850irq/126-lan21:05:200
16838991716,1cyclictest65850irq/126-lan22:50:190
16838991716,1cyclictest65850irq/126-lan22:40:150
16838991716,1cyclictest65850irq/126-lan21:15:150
16838991716,1cyclictest65850irq/126-lan20:25:150
16838991716,1cyclictest65850irq/126-lan20:00:110
16838991716,1cyclictest65850irq/126-lan19:40:240
16838991715,1cyclictest65850irq/126-lan20:15:140
16838991616,0cyclictest65850irq/126-lan22:35:170
16838991616,0cyclictest65850irq/126-lan19:50:150
16838991616,0cyclictest65850irq/126-lan19:15:160
16838991616,0cyclictest65850irq/126-lan00:05:280
16838991615,1cyclictest65850irq/126-lan23:50:160
16838991615,1cyclictest65850irq/126-lan21:50:160
16838991615,1cyclictest65850irq/126-lan21:25:130
16838991615,1cyclictest65850irq/126-lan20:05:190
16838991615,1cyclictest65850irq/126-lan00:15:220
16838991515,0cyclictest65850irq/126-lan21:40:130
16838991515,0cyclictest65850irq/126-lan21:35:140
16838991515,0cyclictest65850irq/126-lan00:10:140
16838991514,1cyclictest65850irq/126-lan20:30:220
16838991514,1cyclictest65850irq/126-lan19:25:190
16838991514,1cyclictest65850irq/126-lan00:23:490
16838991414,0cyclictest65850irq/126-lan22:25:130
16838991414,0cyclictest65850irq/126-lan22:21:440
16838991414,0cyclictest65850irq/126-lan20:55:140
16838991414,0cyclictest65850irq/126-lan19:10:190
16838991413,1cyclictest65850irq/126-lan22:55:140
16838991413,1cyclictest65850irq/126-lan22:05:140
16838991413,1cyclictest65850irq/126-lan21:20:200
16838991413,1cyclictest65850irq/126-lan20:10:180
16838991413,1cyclictest65850irq/126-lan19:45:210
16838991313,0cyclictest65850irq/126-lan23:40:130
16838991313,0cyclictest65850irq/126-lan20:35:160
16838991312,1cyclictest65850irq/126-lan23:45:140
16838991312,1cyclictest65850irq/126-lan23:19:590
16838991312,1cyclictest65850irq/126-lan23:00:160
16838991312,1cyclictest65850irq/126-lan22:00:150
16838991312,1cyclictest65850irq/126-lan21:55:160
16838991312,1cyclictest65850irq/126-lan20:20:160
16838991312,1cyclictest65850irq/126-lan19:35:170
16838991312,1cyclictest65850irq/126-lan00:35:140
16838991312,1cyclictest65850irq/126-lan00:30:160
16851991212,0cyclictest743-21snmpd19:17:112
16838991212,0cyclictest65850irq/126-lan22:45:160
16838991212,0cyclictest65850irq/126-lan22:32:020
16838991212,0cyclictest65850irq/126-lan22:15:180
16838991212,0cyclictest65850irq/126-lan00:00:140
16838991211,1cyclictest65850irq/126-lan23:24:280
16838991211,1cyclictest65850irq/126-lan23:05:130
16838991211,1cyclictest65850irq/126-lan21:00:160
16838991211,1cyclictest65850irq/126-lan19:34:590
16838991211,1cyclictest65850irq/126-lan00:25:170
16851991111,0cyclictest743-21snmpd19:39:582
16851991111,0cyclictest743-21snmpd19:13:442
16851991111,0cyclictest743-21snmpd00:02:202
16838991111,0cyclictest65850irq/126-lan19:55:140
16838991110,1cyclictest65850irq/126-lan23:55:190
16838991110,1cyclictest65850irq/126-lan22:14:590
16838991110,1cyclictest65850irq/126-lan21:30:170
16838991110,1cyclictest65850irq/126-lan19:20:020
16851991010,0cyclictest743-21snmpd23:40:352
16851991010,0cyclictest743-21snmpd23:35:062
16851991010,0cyclictest743-21snmpd20:40:362
16851991010,0cyclictest743-21snmpd00:29:072
16851991010,0cyclictest21958-21cat19:20:162
16851991010,0cyclictest21345-21cat00:35:152
1683899109,1cyclictest65850irq/126-lan23:30:150
1683899109,1cyclictest65850irq/126-lan23:10:120
168539998,1cyclictest743-21snmpd20:04:273
168519999,0cyclictest743-21snmpd23:13:342
168519999,0cyclictest743-21snmpd22:59:482
168519999,0cyclictest743-21snmpd21:34:262
168519999,0cyclictest743-21snmpd20:19:252
168519999,0cyclictest743-21snmpd19:48:422
168519999,0cyclictest743-21snmpd00:24:552
168519999,0cyclictest6137-21cat20:00:172
168519999,0cyclictest5164-21cat23:55:172
168469998,1cyclictest743-21snmpd22:40:541
168469998,1cyclictest741-21lldpd19:16:181
168389998,1cyclictest743-21snmpd20:47:180
168389998,1cyclictest65850irq/126-lan20:50:180
168539988,0cyclictest743-21snmpd22:10:333
168539988,0cyclictest741-21lldpd22:57:093
168539988,0cyclictest741-21lldpd21:17:323
168539988,0cyclictest741-21lldpd00:26:163
168539987,1cyclictest743-21snmpd20:07:383
168539987,1cyclictest741-21lldpd00:21:583
168539986,2cyclictest743-21snmpd23:45:243
168539986,2cyclictest743-21snmpd23:42:563
168539986,2cyclictest743-21snmpd21:27:013
168539986,2cyclictest743-21snmpd21:24:573
168539986,2cyclictest743-21snmpd21:08:063
168539986,2cyclictest743-21snmpd20:21:023
168539985,3cyclictest743-21snmpd22:09:083
168519988,0cyclictest743-21snmpd23:18:562
168519988,0cyclictest743-21snmpd20:52:292
168519988,0cyclictest741-21lldpd23:53:212
168519988,0cyclictest332-21cat21:05:142
168519987,1cyclictest743-21snmpd00:07:372
168519987,1cyclictest741-21lldpd23:26:362
168519987,1cyclictest741-21lldpd21:35:022
168519986,2cyclictest743-21snmpd22:36:072
168469988,0cyclictest741-21lldpd23:57:371
168469988,0cyclictest741-21lldpd23:22:091
168469988,0cyclictest741-21lldpd20:33:051
168469988,0cyclictest741-21lldpd20:29:501
168469988,0cyclictest741-21lldpd20:23:491
168469988,0cyclictest741-21lldpd20:03:031
168469988,0cyclictest741-21lldpd19:50:261
168469987,1cyclictest743-21snmpd22:55:151
168469987,1cyclictest743-21snmpd19:49:331
168469987,1cyclictest743-21snmpd00:16:211
168469987,1cyclictest741-21lldpd23:01:131
168469987,1cyclictest741-21lldpd20:37:031
168469987,1cyclictest741-21lldpd19:55:201
168469986,2cyclictest743-21snmpd22:53:521
168469986,2cyclictest743-21snmpd21:56:041
168469986,2cyclictest743-21snmpd19:27:441
168469985,2cyclictest22620-21grep20:40:151
168389987,1cyclictest65850irq/126-lan21:10:190
168389987,1cyclictest22589-21gltestperf20:40:150
168539977,0cyclictest743-21snmpd22:21:383
168539977,0cyclictest743-21snmpd22:01:083
168539977,0cyclictest743-21snmpd21:52:043
168539977,0cyclictest743-21snmpd21:43:443
168539977,0cyclictest743-21snmpd20:41:033
168539977,0cyclictest743-21snmpd19:34:563
168539977,0cyclictest743-21snmpd00:30:213
168539977,0cyclictest741-21lldpd23:20:433
168539977,0cyclictest741-21lldpd23:09:013
168539977,0cyclictest741-21lldpd22:27:553
168539977,0cyclictest741-21lldpd21:45:233
168539977,0cyclictest741-21lldpd20:58:433
168539977,0cyclictest741-21lldpd20:16:313
168539976,1cyclictest743-21snmpd21:38:133
168539976,1cyclictest743-21snmpd20:26:023
168539976,1cyclictest743-21snmpd19:29:593
168539976,1cyclictest573-21in:imuxsock00:38:093
168539976,1cyclictest506-21systemd-resolve19:40:423
168539975,2cyclictest743-21snmpd23:54:063
168539975,2cyclictest743-21snmpd22:48:133
168539975,2cyclictest743-21snmpd22:17:453
168539975,2cyclictest743-21snmpd20:39:483
168539975,2cyclictest743-21snmpd19:57:273
168539975,2cyclictest743-21snmpd19:12:173
168539975,2cyclictest743-21snmpd00:13:163
168539975,2cyclictest4826-21cat22:35:143
168519977,0cyclictest743-21snmpd23:49:182
168519977,0cyclictest743-21snmpd23:22:292
168519977,0cyclictest741-21lldpd20:09:122
168519977,0cyclictest741-21lldpd00:14:382
168519976,1cyclictest743-21snmpd23:08:502
168519976,1cyclictest743-21snmpd21:24:062
168519975,2cyclictest743-21snmpd20:20:112
168519975,2cyclictest743-21snmpd20:12:562
168519975,2cyclictest30788-21cat21:00:152
168519973,3cyclictest30180-21diskstats19:40:152
168469977,0cyclictest743-21snmpd21:45:351
168469977,0cyclictest743-21snmpd19:35:031
168469977,0cyclictest743-21snmpd00:14:371
168469977,0cyclictest743-21snmpd00:05:311
168469977,0cyclictest741-21lldpd21:04:171
168469977,0cyclictest16833-21cyclictest21:10:151
168469976,1cyclictest743-21snmpd21:53:431
168469976,1cyclictest743-21snmpd21:41:491
168469976,1cyclictest743-21snmpd20:17:011
168469976,1cyclictest743-21snmpd19:43:101
168469976,1cyclictest743-21snmpd19:31:081
168469976,1cyclictest29130-21cpuspeed_turbos23:35:131
168469975,2cyclictest743-21snmpd22:17:301
168469975,2cyclictest743-21snmpd22:03:391
168469975,2cyclictest743-21snmpd21:35:221
168469975,2cyclictest743-21snmpd21:28:221
168469975,2cyclictest743-21snmpd00:23:011
168539966,0cyclictest743-21snmpd21:55:113
168539966,0cyclictest522-21avahi-daemon00:01:243
168539964,2cyclictest743-21snmpd23:26:343
168539964,2cyclictest743-21snmpd20:12:383
168539963,2cyclictest19074-21ntpq20:30:183
168539962,2cyclictest23349-21cat19:25:003
168519966,0cyclictest743-21snmpd22:33:162
168519966,0cyclictest743-21snmpd19:57:242
168519966,0cyclictest741-21lldpd22:52:082
168519966,0cyclictest741-21lldpd22:09:152
168519966,0cyclictest741-21lldpd21:45:432
168519966,0cyclictest741-21lldpd00:30:432
168519965,1cyclictest522-21avahi-daemon20:26:112
168519964,2cyclictest743-21snmpd22:45:432
168469966,0cyclictest741-21lldpd22:27:471
168469965,1cyclictest6978-21fschecks_count00:00:141
168469965,1cyclictest522-21avahi-daemon23:13:371
168469964,2cyclictest743-21snmpd23:32:591
168469964,2cyclictest743-21snmpd22:49:311
168469964,2cyclictest743-21snmpd21:31:311
168469964,2cyclictest743-21snmpd20:57:451
168469964,2cyclictest743-21snmpd20:10:531
168469963,3cyclictest25372-21grep23:25:131
168469962,3cyclictest2526-21date23:49:591
168469962,3cyclictest21084-21diskstats00:35:141
168539955,0cyclictest743-21snmpd22:34:343
168539955,0cyclictest743-21snmpd19:46:243
168539954,1cyclictest522-21avahi-daemon23:17:243
168539953,2cyclictest743-21snmpd22:50:523
168539953,2cyclictest743-21snmpd20:45:083
168539952,3cyclictest27618-21dpkg19:35:003
168539952,2cyclictest27916-21smartctl23:30:183
168539952,2cyclictest19403-21sed19:15:133
168539952,2cyclictest12945-21grep00:15:133
168539951,3cyclictest6492-21pluginstate23:59:593
168539951,3cyclictest30305-21grep23:35:223
168539951,3cyclictest2759-21grep19:50:223
168539950,4cyclictest2843-21ntpq21:10:193
168519954,1cyclictest29435-21ntpq22:15:172
168519954,1cyclictest23824-21gltestperf19:25:132
168519953,2cyclictest743-21snmpd22:00:322
168519953,2cyclictest743-21snmpd21:10:282
168519953,2cyclictest743-21snmpd20:33:102
168519953,2cyclictest743-21snmpd19:52:132
168519953,2cyclictest717-21ntpd21:43:482
168519953,2cyclictest717-21ntpd20:58:392
168519953,2cyclictest25675-21tr19:30:122
168519953,2cyclictest19646-21kworker/2:0+events_freezable_pwr_efficient21:18:002
168519952,3cyclictest557-21NetworkManager20:37:542
168519952,2cyclictest6881-21cat22:40:152
168519952,2cyclictest575-21rs:main2
168519952,2cyclictest27916-21smartctl23:30:182
168519952,2cyclictest21055-21tr21:55:182
168519952,2cyclictest13883-21wc00:15:212
168519951,3cyclictest19342-21sed21:50:202
168519951,3cyclictest15547-21sensors_temp23:00:212
168469955,0cyclictest741-21lldpd22:10:111
168469955,0cyclictest741-21lldpd20:51:041
168469955,0cyclictest522-21avahi-daemon23:07:441
168469955,0cyclictest522-21avahi-daemon22:05:051
168469955,0cyclictest522-21avahi-daemon00:33:221
168469954,1cyclictest743-21snmpd22:22:451
168469953,2cyclictest743-21snmpd21:24:361
168469953,2cyclictest743-21snmpd19:23:091
168469953,2cyclictest17463-21cat19:10:141
168469952,2cyclictest21351-21ld23:15:171
168469951,3cyclictest5666-21sed22:35:211
168469951,3cyclictest4175-21diskstats21:15:131
168469951,3cyclictest18120-21sed00:25:231
168469950,4cyclictest8451-21ntpq20:05:171
168539943,1cyclictest511ktimers/321:00:143
168539943,1cyclictest511ktimers/300:05:213
168539942,2cyclictest6880-21cat22:40:153
168539941,3cyclictest743-21snmpd21:30:103
168539941,3cyclictest557-21NetworkManager23:00:113
168539940,4cyclictest27052-21ntpq20:50:183
168539940,3cyclictest19387-21ld23:10:163
168519943,1cyclictest0-21swapper/221:25:142
168519942,2cyclictest717-21ntpd22:10:152
168519941,2cyclictest30882-21tr22:20:122
168519940,4cyclictest25014-21ntpq20:45:182
168469943,1cyclictest0-21swapper/122:30:131
168469941,3cyclictest557-21NetworkManager20:45:051
168469941,2cyclictest31344-21cut23:40:141
168469941,2cyclictest2985-21grep23:50:141
168469940,3cyclictest32539-21diskstats21:05:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional