You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 13:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Tue Dec 09, 2025 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28357993030,0cyclictest12547-21fwupd23:13:192
28361991919,0cyclictest66850irq/125-lan22:25:093
28361991918,1cyclictest66850irq/125-lan22:50:193
28361991918,1cyclictest66850irq/125-lan22:36:273
28361991918,1cyclictest66850irq/125-lan22:15:163
28361991918,1cyclictest66850irq/125-lan21:20:223
28361991918,1cyclictest66850irq/125-lan19:49:063
28361991918,1cyclictest66850irq/125-lan00:19:103
28361991818,0cyclictest66850irq/125-lan23:42:353
28361991818,0cyclictest66850irq/125-lan23:06:203
28361991818,0cyclictest66850irq/125-lan22:56:403
28361991818,0cyclictest66850irq/125-lan22:21:053
28361991818,0cyclictest66850irq/125-lan21:51:583
28361991818,0cyclictest66850irq/125-lan21:51:573
28361991818,0cyclictest66850irq/125-lan21:48:373
28361991818,0cyclictest66850irq/125-lan21:40:183
28361991818,0cyclictest66850irq/125-lan21:34:363
28361991818,0cyclictest66850irq/125-lan21:18:423
28361991818,0cyclictest66850irq/125-lan00:35:433
28361991817,1cyclictest66850irq/125-lan23:45:143
28361991817,1cyclictest66850irq/125-lan23:38:373
28361991817,1cyclictest66850irq/125-lan23:31:473
28361991817,1cyclictest66850irq/125-lan23:20:413
28361991817,1cyclictest66850irq/125-lan23:14:483
28361991817,1cyclictest66850irq/125-lan22:40:013
28361991817,1cyclictest66850irq/125-lan21:35:073
28361991817,1cyclictest66850irq/125-lan21:12:223
28361991817,1cyclictest66850irq/125-lan20:35:003
28361991817,1cyclictest66850irq/125-lan00:25:183
28361991817,1cyclictest66850irq/125-lan00:21:443
28361991817,1cyclictest66850irq/125-lan00:08:143
28361991717,0cyclictest66850irq/125-lan23:00:283
28361991717,0cyclictest66850irq/125-lan22:47:273
28361991717,0cyclictest66850irq/125-lan21:57:573
28361991717,0cyclictest66850irq/125-lan21:27:063
28361991717,0cyclictest66850irq/125-lan19:30:213
28361991716,1cyclictest66850irq/125-lan23:57:053
28361991716,1cyclictest66850irq/125-lan23:50:013
28361991716,1cyclictest66850irq/125-lan23:25:143
28361991716,1cyclictest66850irq/125-lan23:15:183
28361991716,1cyclictest66850irq/125-lan22:10:313
28361991716,1cyclictest66850irq/125-lan22:06:303
28361991716,1cyclictest66850irq/125-lan00:30:173
28361991716,1cyclictest66850irq/125-lan00:00:133
28361991616,0cyclictest66850irq/125-lan21:00:163
28361991616,0cyclictest66850irq/125-lan20:50:273
28361991616,0cyclictest66850irq/125-lan00:13:283
28361991615,1cyclictest66850irq/125-lan22:30:303
28361991615,1cyclictest66850irq/125-lan22:02:073
28361991615,1cyclictest66850irq/125-lan21:05:183
28361991615,1cyclictest66850irq/125-lan20:56:523
28361991615,1cyclictest66850irq/125-lan20:40:133
28361991515,0cyclictest66850irq/125-lan20:15:203
28361991515,0cyclictest66850irq/125-lan19:38:293
28361991514,1cyclictest66850irq/125-lan20:20:123
28361991514,1cyclictest66850irq/125-lan20:05:143
28361991514,1cyclictest66850irq/125-lan19:20:223
28361991414,0cyclictest66850irq/125-lan19:55:213
28361991413,1cyclictest66850irq/125-lan19:40:223
28361991313,0cyclictest66850irq/125-lan19:10:153
28361991212,0cyclictest66850irq/125-lan19:50:163
2836199109,1cyclictest66850irq/125-lan20:30:213
2836199109,1cyclictest66850irq/125-lan19:25:013
28361991010,0cyclictest66850irq/125-lan20:25:233
28361991010,0cyclictest66850irq/125-lan20:10:153
28361991010,0cyclictest66850irq/125-lan19:15:223
283619998,1cyclictest66850irq/125-lan20:45:173
283619998,1cyclictest66850irq/125-lan20:00:133
283579998,1cyclictest771-21snmpd22:30:192
283579998,1cyclictest771-21snmpd22:14:272
283579998,1cyclictest771-21snmpd19:41:052
283579998,1cyclictest769-21lldpd22:17:202
283539998,1cyclictest769-21lldpd20:01:281
283539998,1cyclictest524-21avahi-daemon22:55:381
283469998,1cyclictest771-21snmpd20:50:280
283469998,1cyclictest771-21snmpd00:21:490
283579988,0cyclictest771-21snmpd00:32:382
283579988,0cyclictest769-21lldpd23:36:092
283579988,0cyclictest769-21lldpd23:22:022
283579987,1cyclictest771-21snmpd20:52:122
283579987,1cyclictest771-21snmpd00:39:232
283579987,1cyclictest524-21avahi-daemon23:25:002
283579987,1cyclictest517-21systemd-resolve23:59:382
283579987,1cyclictest517-21systemd-resolve19:35:122
283579987,1cyclictest27448-21fschecks_count20:25:152
283579987,1cyclictest12234-21fschecks_count21:40:132
283579986,2cyclictest771-21snmpd23:52:572
283579986,2cyclictest771-21snmpd23:31:152
283579986,2cyclictest771-21snmpd23:05:372
283539988,0cyclictest771-21snmpd22:45:071
283539988,0cyclictest771-21snmpd22:31:491
283539988,0cyclictest771-21snmpd22:23:121
283539988,0cyclictest771-21snmpd00:30:321
283539988,0cyclictest769-21lldpd21:13:201
283539988,0cyclictest769-21lldpd20:44:201
283539988,0cyclictest769-21lldpd20:09:391
283539988,0cyclictest769-21lldpd00:23:061
283539987,1cyclictest771-21snmpd21:40:071
283539987,1cyclictest771-21snmpd00:29:011
283539987,1cyclictest771-21snmpd00:15:011
283539987,1cyclictest769-21lldpd20:22:071
283539987,1cyclictest524-21avahi-daemon22:19:471
283539987,1cyclictest255-20systemd-journal21:46:511
283539986,2cyclictest771-21snmpd22:37:121
283539986,2cyclictest771-21snmpd21:37:471
283539986,2cyclictest771-21snmpd20:11:031
283539986,2cyclictest771-21snmpd19:33:351
283469988,0cyclictest771-21snmpd23:22:320
283469988,0cyclictest771-21snmpd23:16:320
283469988,0cyclictest771-21snmpd23:06:260
283469988,0cyclictest771-21snmpd22:48:340
283469988,0cyclictest771-21snmpd20:46:340
283469988,0cyclictest771-21snmpd20:22:410
283469988,0cyclictest771-21snmpd19:50:340
283469988,0cyclictest769-21lldpd22:15:400
283469988,0cyclictest769-21lldpd21:57:440
283469988,0cyclictest769-21lldpd21:24:310
283469988,0cyclictest769-21lldpd20:58:240
283469988,0cyclictest769-21lldpd00:37:460
283469987,1cyclictest771-21snmpd23:11:400
283469987,1cyclictest771-21snmpd20:37:450
283469987,1cyclictest771-21snmpd19:57:170
283469987,1cyclictest769-21lldpd20:01:480
283579977,0cyclictest771-21snmpd22:47:402
283579977,0cyclictest769-21lldpd22:55:172
283579977,0cyclictest769-21lldpd22:28:562
283579977,0cyclictest769-21lldpd21:55:342
283579977,0cyclictest769-21lldpd21:32:572
283579977,0cyclictest769-21lldpd21:16:492
283579977,0cyclictest769-21lldpd19:46:262
283579977,0cyclictest769-21lldpd00:00:152
283579977,0cyclictest524-21avahi-daemon21:20:202
283579976,1cyclictest771-21snmpd20:30:482
283579976,1cyclictest771-21snmpd00:06:072
283579976,1cyclictest524-21avahi-daemon23:44:242
283579976,1cyclictest255-20systemd-journal22:40:372
283579975,2cyclictest771-21snmpd21:47:412
283579975,2cyclictest771-21snmpd21:36:112
283579975,2cyclictest771-21snmpd20:08:502
283579975,2cyclictest771-21snmpd19:53:252
283579975,2cyclictest771-21snmpd19:23:122
283579973,3cyclictest31142-21df_inode19:15:142
283579973,3cyclictest255-20systemd-journal21:00:062
283539977,0cyclictest769-21lldpd23:20:371
283539977,0cyclictest769-21lldpd21:21:011
283539977,0cyclictest769-21lldpd21:15:091
283539977,0cyclictest769-21lldpd20:29:061
283539976,1cyclictest769-21lldpd20:33:201
283539976,1cyclictest524-21avahi-daemon21:51:351
283539976,1cyclictest524-21avahi-daemon21:51:341
283539976,1cyclictest27089-21kworker/1:1+events23:18:551
283539976,1cyclictest24327-21unixbench_singl23:55:211
283539975,2cyclictest771-21snmpd23:30:541
283469977,0cyclictest769-21lldpd23:00:250
283469977,0cyclictest769-21lldpd21:16:210
283469976,1cyclictest771-21snmpd23:41:050
283469976,1cyclictest771-21snmpd21:51:510
283469976,1cyclictest771-21snmpd21:51:500
283469976,1cyclictest771-21snmpd20:05:080
283469976,1cyclictest771-21snmpd19:24:420
283469976,1cyclictest749-21ntpd22:42:070
283469975,2cyclictest771-21snmpd23:59:510
283469975,2cyclictest771-21snmpd23:35:030
283469975,2cyclictest771-21snmpd21:28:250
283469975,2cyclictest771-21snmpd20:33:150
283469975,2cyclictest771-21snmpd19:26:560
283469975,2cyclictest771-21snmpd19:17:460
283469975,2cyclictest25520-21grep22:55:160
283469973,3cyclictest27140-21ntp_states00:30:190
283579966,0cyclictest771-21snmpd21:50:212
283579966,0cyclictest771-21snmpd21:50:202
283579966,0cyclictest771-21snmpd20:45:072
283579966,0cyclictest769-21lldpd00:16:202
283579966,0cyclictest524-21avahi-daemon19:57:092
283579965,1cyclictest771-21snmpd22:35:392
283579965,1cyclictest771-21snmpd20:41:492
283579965,1cyclictest771-21snmpd00:13:002
283579965,1cyclictest769-21lldpd21:06:022
283579965,1cyclictest524-21avahi-daemon22:02:312
283579965,1cyclictest13685-21nvmesmart_nvme023:45:182
283579964,2cyclictest771-21snmpd20:39:302
283579964,2cyclictest771-21snmpd19:11:072
283579964,2cyclictest17398-21cat00:20:152
283579963,2cyclictest23811-21ssh22:53:382
283579962,3cyclictest1933-21ssh23:03:232
283539966,0cyclictest771-21snmpd22:12:151
283539966,0cyclictest771-21snmpd22:01:331
283539966,0cyclictest771-21snmpd19:44:351
283539966,0cyclictest769-21lldpd23:47:231
283539966,0cyclictest769-21lldpd19:55:361
283539966,0cyclictest769-21lldpd00:05:521
283539966,0cyclictest28341-21cyclictest22:50:161
283539965,1cyclictest771-21snmpd22:07:591
283539965,1cyclictest771-21snmpd20:45:131
283539965,1cyclictest771-21snmpd19:16:091
283539965,1cyclictest524-21avahi-daemon23:14:021
283539965,1cyclictest10272-21cat22:40:151
283539964,2cyclictest749-21ntpd19:35:111
283539964,2cyclictest550-21NetworkManager19:25:281
283539963,2cyclictest586-21rs:main1
283539963,2cyclictest255-20systemd-journal21:59:171
283539962,3cyclictest3944-21ssh21:31:261
283539962,3cyclictest3373-21ntp_states23:35:181
283539962,3cyclictest29730-21ssh22:27:391
283539962,3cyclictest29437-21sed23:30:001
283539962,3cyclictest10045-21ssh23:41:431
283469966,0cyclictest771-21snmpd22:07:200
283469966,0cyclictest771-21snmpd19:31:350
283469966,0cyclictest771-21snmpd00:01:010
283469966,0cyclictest769-21lldpd21:49:220
283469966,0cyclictest524-21avahi-daemon21:35:400
283469966,0cyclictest524-21avahi-daemon19:43:330
283469965,1cyclictest771-21snmpd23:33:210
283469965,1cyclictest771-21snmpd00:10:510
283469965,1cyclictest21054-21cpuspeed_turbos22:20:120
283469963,3cyclictest944-21apt-get20:40:110
283469963,3cyclictest4913-21ssh22:35:150
283469963,2cyclictest586-21rs:main0
283469963,0cyclictest30946-21ssh22:29:240
283469960,6cyclictest255-20systemd-journal00:05:090
283579955,0cyclictest771-21snmpd19:25:012
283579954,1cyclictest771-21snmpd20:10:242
283579954,1cyclictest421ktimers/223:15:022
283579953,2cyclictest5390-21ntpq19:30:172
283579952,2cyclictest7187-21ssh22:06:012
283579952,2cyclictest30606-21ssh21:25:312
283579952,2cyclictest25953-21ntp_192.168.11420:20:152
283579952,2cyclictest24502-21sed20:15:212
283579952,2cyclictest23927-21ssh22:22:252
283579952,2cyclictest23036-21grep00:25:222
283579952,2cyclictest17295-21cat20:00:172
283579952,2cyclictest16140-21ssh21:12:002
283539955,0cyclictest771-21snmpd23:00:351
283539954,1cyclictest771-21snmpd19:51:131
283539954,1cyclictest769-21lldpd21:07:511
283539953,2cyclictest771-21snmpd20:16:481
283539953,2cyclictest550-21NetworkManager23:51:321
283539952,2cyclictest596-21ssh21:29:001
283539952,2cyclictest586-21rs:main1
283539952,2cyclictest31855-21cat20:35:151
283539952,2cyclictest255-20systemd-journal23:05:581
283539952,2cyclictest255-20systemd-journal19:11:181
283539952,2cyclictest10709-21apt-get19:45:121
283539951,3cyclictest915-21fw_forwarded_lo19:20:131
283539951,3cyclictest7764-21ntp_kernel_pll_20:55:201
283539951,3cyclictest5427-21irqstats20:50:151
283539950,3cyclictest10772-21ls21:05:011
283469954,1cyclictest9462-21cat21:00:170
283469954,1cyclictest771-21snmpd23:54:400
283469954,1cyclictest22442-21ntpq00:25:180
283469954,1cyclictest20856-21cpuspeed_turbos20:10:130
283469953,2cyclictest771-21snmpd21:08:160
283469953,2cyclictest771-21snmpd19:37:370
283469953,2cyclictest0-21swapper/022:30:080
283469952,3cyclictest2381-21seq22:01:290
283469952,2cyclictest4358-21ssh21:32:020
283469952,2cyclictest24017-21latency_hist23:24:590
283469952,2cyclictest21065-21ssh22:50:210
283469952,2cyclictest13980-21expr21:10:160
283469952,2cyclictest13656-21ld23:45:180
283469952,2cyclictest13559-21rm22:12:320
283469952,2cyclictest12022-21ssh21:40:120
283469950,4cyclictest24028-21ntpq20:15:180
283579943,1cyclictest7333-21cut20:55:182
283539943,1cyclictest749-21ntpd00:35:091
283469941,2cyclictest28699-21expr19:10:160
283469940,4cyclictest28057-21ntpq20:25:180
283469940,3cyclictest10726-21grep19:45:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional