You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-12 - 22:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Thu Mar 12, 2026 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10022994141,0cyclictest3902-21fwupd09:31:190
10031991918,1cyclictest65850irq/126-lan10:23:392
10031991818,0cyclictest65850irq/126-lan12:05:202
10031991817,1cyclictest65850irq/126-lan10:45:162
10031991817,1cyclictest65850irq/126-lan10:40:112
10031991817,1cyclictest65850irq/126-lan09:15:112
10031991717,0cyclictest65850irq/126-lan10:56:272
10031991717,0cyclictest65850irq/126-lan09:00:152
10031991717,0cyclictest65850irq/126-lan08:05:012
10031991717,0cyclictest65850irq/126-lan08:00:162
10031991716,1cyclictest65850irq/126-lan11:20:122
10031991716,1cyclictest65850irq/126-lan08:10:112
10031991716,1cyclictest65850irq/126-lan07:10:102
10031991616,0cyclictest65850irq/126-lan10:50:202
10031991616,0cyclictest65850irq/126-lan10:15:162
10031991616,0cyclictest65850irq/126-lan09:35:232
10031991616,0cyclictest65850irq/126-lan09:20:262
10031991616,0cyclictest65850irq/126-lan08:50:212
10031991616,0cyclictest65850irq/126-lan08:40:122
10031991615,1cyclictest65850irq/126-lan11:30:152
10031991615,1cyclictest65850irq/126-lan10:10:122
10031991615,1cyclictest65850irq/126-lan07:45:132
10031991615,1cyclictest65850irq/126-lan07:40:112
10031991615,1cyclictest65850irq/126-lan07:25:112
10031991515,0cyclictest743-21snmpd09:12:222
10031991515,0cyclictest65850irq/126-lan12:10:112
10031991515,0cyclictest65850irq/126-lan11:25:152
10031991515,0cyclictest65850irq/126-lan09:51:212
10031991515,0cyclictest65850irq/126-lan09:30:172
10031991515,0cyclictest65850irq/126-lan08:45:212
10031991515,0cyclictest65850irq/126-lan08:20:162
10031991515,0cyclictest65850irq/126-lan08:15:492
10031991515,0cyclictest65850irq/126-lan07:50:112
10031991515,0cyclictest65850irq/126-lan07:15:112
10031991514,1cyclictest65850irq/126-lan12:25:152
10031991514,1cyclictest65850irq/126-lan07:30:202
10031991414,0cyclictest65850irq/126-lan08:30:102
10031991414,0cyclictest65850irq/126-lan07:35:132
10031991414,0cyclictest65850irq/126-lan07:20:162
10031991414,0cyclictest25095-21cat10:25:142
10031991414,0cyclictest13210-21cat12:35:132
10031991413,1cyclictest65850irq/126-lan12:30:142
10031991413,1cyclictest65850irq/126-lan12:20:152
10031991413,1cyclictest65850irq/126-lan11:15:142
10031991413,1cyclictest65850irq/126-lan10:00:092
10031991413,1cyclictest65850irq/126-lan08:35:172
10031991313,0cyclictest65850irq/126-lan11:40:152
10031991313,0cyclictest65850irq/126-lan11:35:192
10031991312,1cyclictest65850irq/126-lan11:00:102
10031991312,1cyclictest65850irq/126-lan10:35:122
10031991312,1cyclictest65850irq/126-lan08:25:162
10031991212,0cyclictest65850irq/126-lan11:55:152
10031991212,0cyclictest65850irq/126-lan10:30:162
10031991212,0cyclictest65850irq/126-lan09:05:142
10031991212,0cyclictest65850irq/126-lan08:55:142
10031991212,0cyclictest65850irq/126-lan07:55:142
10031991212,0cyclictest12979-21cat09:55:142
10031991211,1cyclictest65850irq/126-lan11:45:152
10031991211,1cyclictest65850irq/126-lan11:05:162
10031991211,1cyclictest65850irq/126-lan10:05:112
10031991111,0cyclictest65850irq/126-lan12:00:192
10031991111,0cyclictest65850irq/126-lan11:50:132
10031991111,0cyclictest65850irq/126-lan09:45:002
10031991110,1cyclictest65850irq/126-lan11:10:152
1003199109,1cyclictest65850irq/126-lan12:16:212
10031991010,0cyclictest65850irq/126-lan09:40:132
10031991010,0cyclictest65850irq/126-lan09:25:142
100359998,1cyclictest743-21snmpd11:20:403
100359998,1cyclictest741-21lldpd09:48:023
100269998,1cyclictest743-21snmpd08:50:161
100229998,1cyclictest741-21lldpd07:45:290
100359988,0cyclictest743-21snmpd12:26:073
100359988,0cyclictest743-21snmpd11:32:243
100359988,0cyclictest743-21snmpd08:56:183
100359988,0cyclictest743-21snmpd08:30:503
100359988,0cyclictest741-21lldpd12:31:263
100359988,0cyclictest741-21lldpd11:50:243
100359988,0cyclictest741-21lldpd08:47:543
100359987,1cyclictest743-21snmpd09:43:533
100359987,1cyclictest741-21lldpd12:15:483
100359987,1cyclictest522-21avahi-daemon12:00:023
100359986,2cyclictest743-21snmpd11:48:123
100359986,2cyclictest743-21snmpd10:19:473
100359986,2cyclictest743-21snmpd09:25:373
100269988,0cyclictest743-21snmpd12:06:251
100269988,0cyclictest743-21snmpd07:36:351
100269988,0cyclictest741-21lldpd11:41:001
100269988,0cyclictest741-21lldpd09:23:221
100269987,1cyclictest743-21snmpd07:13:451
100269987,1cyclictest741-21lldpd10:19:361
100269987,1cyclictest741-21lldpd10:12:501
100269987,1cyclictest741-21lldpd09:31:201
100269987,1cyclictest741-21lldpd08:12:071
100269986,2cyclictest743-21snmpd11:11:111
100269984,3cyclictest17763-21ntp_states11:25:171
100229988,0cyclictest743-21snmpd12:08:400
100229988,0cyclictest743-21snmpd10:24:570
100229988,0cyclictest743-21snmpd10:00:270
100229988,0cyclictest743-21snmpd09:46:490
100229988,0cyclictest743-21snmpd08:37:180
100229987,1cyclictest743-21snmpd12:04:400
100229987,1cyclictest743-21snmpd10:05:110
100229987,1cyclictest743-21snmpd08:42:420
100229987,1cyclictest741-21lldpd09:10:490
100229987,1cyclictest11944-21cron07:14:590
100229986,2cyclictest743-21snmpd12:34:380
100229986,2cyclictest743-21snmpd11:54:100
100229986,2cyclictest743-21snmpd09:02:540
100359977,0cyclictest743-21snmpd09:53:483
100359977,0cyclictest743-21snmpd09:36:353
100359977,0cyclictest741-21lldpd09:17:143
100359977,0cyclictest741-21lldpd08:00:553
100359977,0cyclictest741-21lldpd07:52:043
100359977,0cyclictest741-21lldpd07:23:083
100359977,0cyclictest522-21avahi-daemon12:37:413
100359977,0cyclictest4438-21sh12:15:003
100359976,1cyclictest877-21fschecks_count12:05:123
100359976,1cyclictest743-21snmpd08:51:313
100359976,1cyclictest743-21snmpd08:29:143
100359976,1cyclictest743-21snmpd08:09:273
100359976,1cyclictest743-21snmpd07:49:083
100359976,1cyclictest573-21in:imuxsock07:41:303
100359976,1cyclictest522-21avahi-daemon09:06:143
100359975,2cyclictest743-21snmpd11:16:593
100359975,2cyclictest743-21snmpd10:34:123
100359975,2cyclictest3879-21dump-pmu-power08:14:593
100359975,2cyclictest24817-21tr10:25:123
100269977,0cyclictest743-21snmpd10:25:161
100269977,0cyclictest743-21snmpd09:42:561
100269977,0cyclictest743-21snmpd08:49:301
100269977,0cyclictest743-21snmpd08:21:181
100269977,0cyclictest743-21snmpd07:56:311
100269977,0cyclictest741-21lldpd12:25:171
100269977,0cyclictest741-21lldpd11:32:051
100269977,0cyclictest741-21lldpd10:37:011
100269977,0cyclictest741-21lldpd10:04:011
100269977,0cyclictest741-21lldpd09:01:501
100269977,0cyclictest741-21lldpd08:29:331
100269977,0cyclictest741-21lldpd08:02:471
100269976,1cyclictest522-21avahi-daemon11:00:151
100269976,1cyclictest522-21avahi-daemon09:35:211
100269976,1cyclictest4822-21cat10:55:141
100269976,1cyclictest340-21dump-pmu-power12:05:011
100269975,2cyclictest743-21snmpd11:49:121
100269975,2cyclictest743-21snmpd10:52:541
100269975,2cyclictest743-21snmpd09:09:541
100269975,2cyclictest743-21snmpd08:06:511
100269975,2cyclictest16699-21cat07:25:141
100269973,3cyclictest12770-21memory08:35:141
100229977,0cyclictest743-21snmpd08:00:220
100229977,0cyclictest741-21lldpd12:27:010
100229977,0cyclictest741-21lldpd07:50:380
100229977,0cyclictest522-21avahi-daemon08:33:000
100229977,0cyclictest522-21avahi-daemon08:25:310
100229976,1cyclictest743-21snmpd11:08:430
100229976,1cyclictest741-21lldpd09:36:380
100229976,1cyclictest23415-21cat11:40:130
100229975,2cyclictest743-21snmpd11:10:370
100229975,2cyclictest743-21snmpd09:59:180
100229975,2cyclictest743-21snmpd09:54:050
100229975,2cyclictest743-21snmpd09:40:050
100229975,2cyclictest743-21snmpd09:21:510
100229975,2cyclictest743-21snmpd08:45:180
100229972,4cyclictest244-20systemd-journal07:28:390
100359966,0cyclictest8768-21gltestperf11:05:133
100359966,0cyclictest743-21snmpd10:50:483
100359966,0cyclictest743-21snmpd09:10:363
100359966,0cyclictest741-21lldpd10:03:033
100359966,0cyclictest741-21lldpd08:37:083
100359966,0cyclictest741-21lldpd07:55:273
100359965,1cyclictest743-21snmpd10:49:453
100359965,1cyclictest741-21lldpd10:11:243
100359965,1cyclictest741-21lldpd09:58:203
100359965,1cyclictest522-21avahi-daemon10:44:213
100359964,2cyclictest743-21snmpd10:07:113
100359964,2cyclictest743-21snmpd07:15:103
100359964,2cyclictest743-21snmpd07:14:573
100359963,2cyclictest244-20systemd-journal08:23:413
100269966,0cyclictest743-21snmpd12:20:171
100269966,0cyclictest743-21snmpd07:31:581
100269965,1cyclictest743-21snmpd09:29:141
100269965,1cyclictest743-21snmpd07:53:081
100269965,1cyclictest741-21lldpd11:58:501
100269964,2cyclictest743-21snmpd10:30:131
100269964,2cyclictest743-21snmpd07:23:341
100269963,3cyclictest10708-21diskstats09:50:121
100269962,3cyclictest11786-21systemctl12:30:191
100229966,0cyclictest743-21snmpd12:14:360
100229966,0cyclictest743-21snmpd10:56:430
100229966,0cyclictest743-21snmpd08:22:270
100229966,0cyclictest741-21lldpd12:19:260
100229966,0cyclictest741-21lldpd11:48:090
100229966,0cyclictest741-21lldpd10:46:100
100229966,0cyclictest741-21lldpd10:43:240
100229966,0cyclictest741-21lldpd07:15:020
100229966,0cyclictest522-21avahi-daemon11:35:040
100229966,0cyclictest522-21avahi-daemon10:15:250
100229966,0cyclictest522-21avahi-daemon07:33:210
100229965,1cyclictest743-21snmpd10:36:150
100229965,1cyclictest743-21snmpd07:39:080
100229965,1cyclictest522-21avahi-daemon10:29:270
100229965,1cyclictest14990-21cpuspeed_turbos11:20:110
100229964,2cyclictest743-21snmpd12:37:140
100229964,2cyclictest743-21snmpd10:54:280
100229964,2cyclictest743-21snmpd10:10:360
100229962,3cyclictest19397-21irqstats11:30:140
100229961,3cyclictest26220-21cut09:09:590
100359955,0cyclictest741-21lldpd11:28:313
100359955,0cyclictest741-21lldpd10:57:163
100359955,0cyclictest522-21avahi-daemon07:36:173
100359954,1cyclictest21029-21cpuspeed_turbos11:35:113
100359953,2cyclictest4133-21apt-get08:15:113
100359952,3cyclictest557-21NetworkManager08:44:223
100359952,3cyclictest19063-21ntpq07:30:163
100359952,2cyclictest244-20systemd-journal10:39:363
100359951,4cyclictest557-21NetworkManager09:33:333
100269955,0cyclictest522-21avahi-daemon10:46:591
100269954,1cyclictest14529-21sh12:40:011
100269954,1cyclictest12931-21ntpq07:15:141
100269953,2cyclictest8964-21cat09:45:131
100269953,2cyclictest743-21snmpd12:16:311
100269952,3cyclictest17446-21ntp_states10:05:161
100269952,2cyclictest3732-21wc12:10:191
100269952,2cyclictest29362-21grep09:15:131
100269952,2cyclictest27311-21cat09:10:151
100269952,2cyclictest244-20systemd-journal11:19:101
100269952,2cyclictest244-20systemd-journal11:06:461
100269951,3cyclictest4417-21cut08:15:131
100269951,3cyclictest27272-21perl11:50:121
100269950,4cyclictest24132-21apt07:44:591
100229955,0cyclictest741-21lldpd09:19:220
100229954,1cyclictest743-21snmpd07:41:340
100229954,1cyclictest7077-21gltestperf12:20:140
100229953,2cyclictest743-21snmpd08:05:210
100229953,2cyclictest743-21snmpd07:23:550
100229953,2cyclictest0-21swapper/007:58:150
100229952,3cyclictest6704-21fw_packets11:00:120
100229952,2cyclictest29790-21ntpq11:55:170
100229952,2cyclictest21572-21sed08:55:210
100229952,2cyclictest18250-21find08:50:100
100229952,2cyclictest17628-21ntp_192.168.11411:25:150
100229951,3cyclictest4794-21grep08:15:150
100229951,2cyclictest3959-21cat08:14:590
100359942,2cyclictest717-21ntpd11:40:113
100359942,2cyclictest22423-21tr09:00:113
100359941,2cyclictest7360-21needreboot12:20:153
100359941,2cyclictest6398-21basename11:00:093
100359941,2cyclictest29025-21dpkg11:55:133
100359940,3cyclictest31645-21ntp_states09:20:173
100359940,3cyclictest244-20systemd-journal11:10:123
100359940,3cyclictest22919-21perl10:20:123
100359940,3cyclictest16271-21dpkg07:25:113
100269943,1cyclictest21792-21ntpq11:35:161
100269942,2cyclictest31646-21sed10:40:171
100269941,2cyclictest575-21rs:main1
100269941,2cyclictest21347-21switchtime08:55:201
100269941,2cyclictest14545-21gltestperf08:40:121
100269940,4cyclictest25185-21ntpq07:45:161
100269940,3cyclictest23003-21tail10:20:121
100269940,3cyclictest11053-21ntp_states08:30:141
100229942,2cyclictest27123-21cat10:30:140
100229942,2cyclictest12521-21dpkg11:15:010
100229940,4cyclictest0-21swapper/009:25:200
100269930,3cyclictest12719-21diskstats09:55:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional