You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 06:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Fri Nov 21, 2025 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17951994039,1cyclictest22971-21fwupd22:04:553
17951991918,1cyclictest66850irq/125-lan23:40:183
17951991918,1cyclictest66850irq/125-lan23:17:073
17951991918,1cyclictest66850irq/125-lan22:54:023
17951991918,1cyclictest66850irq/125-lan00:03:353
17951991818,0cyclictest66850irq/125-lan23:57:543
17951991818,0cyclictest66850irq/125-lan23:08:043
17951991818,0cyclictest66850irq/125-lan22:15:203
17951991818,0cyclictest66850irq/125-lan22:10:503
17951991818,0cyclictest66850irq/125-lan22:06:453
17951991818,0cyclictest66850irq/125-lan21:40:053
17951991818,0cyclictest66850irq/125-lan20:20:163
17951991818,0cyclictest66850irq/125-lan00:28:113
17951991818,0cyclictest66850irq/125-lan00:10:363
17951991817,1cyclictest66850irq/125-lan23:49:033
17951991817,1cyclictest66850irq/125-lan23:37:523
17951991817,1cyclictest66850irq/125-lan23:30:183
17951991817,1cyclictest66850irq/125-lan23:25:333
17951991817,1cyclictest66850irq/125-lan23:01:323
17951991817,1cyclictest66850irq/125-lan22:55:333
17951991817,1cyclictest66850irq/125-lan22:41:473
17951991817,1cyclictest66850irq/125-lan21:55:293
17951991817,1cyclictest66850irq/125-lan21:46:383
17951991817,1cyclictest66850irq/125-lan21:35:133
17951991817,1cyclictest66850irq/125-lan21:24:363
17951991817,1cyclictest66850irq/125-lan20:05:143
17951991817,1cyclictest66850irq/125-lan00:39:293
17951991817,1cyclictest66850irq/125-lan00:30:203
17951991817,1cyclictest66850irq/125-lan00:15:353
17951991817,1cyclictest66850irq/125-lan00:05:173
17951991816,2cyclictest66850irq/125-lan23:10:123
17951991717,0cyclictest66850irq/125-lan23:50:253
17951991717,0cyclictest66850irq/125-lan23:20:573
17951991717,0cyclictest66850irq/125-lan22:35:103
17951991717,0cyclictest66850irq/125-lan22:21:153
17951991717,0cyclictest66850irq/125-lan21:25:173
17951991717,0cyclictest66850irq/125-lan20:55:543
17951991717,0cyclictest66850irq/125-lan20:45:443
17951991717,0cyclictest66850irq/125-lan19:43:533
17951991717,0cyclictest66850irq/125-lan00:21:333
17951991716,1cyclictest66850irq/125-lan22:49:223
17951991716,1cyclictest66850irq/125-lan22:33:503
17951991716,1cyclictest66850irq/125-lan22:25:253
17951991716,1cyclictest66850irq/125-lan21:34:213
17951991716,1cyclictest66850irq/125-lan21:10:213
17951991716,1cyclictest66850irq/125-lan20:17:003
17951991716,1cyclictest66850irq/125-lan19:50:143
17939991717,0cyclictest771-21snmpd19:42:440
17951991615,1cyclictest66850irq/125-lan21:50:143
17951991615,1cyclictest66850irq/125-lan21:15:213
17951991615,1cyclictest66850irq/125-lan21:05:203
17951991615,1cyclictest66850irq/125-lan21:01:533
17951991615,1cyclictest66850irq/125-lan20:40:173
17951991615,1cyclictest66850irq/125-lan20:25:183
17951991615,1cyclictest66850irq/125-lan20:10:223
17951991615,1cyclictest66850irq/125-lan19:45:193
17939991616,0cyclictest771-21snmpd21:18:110
17939991616,0cyclictest771-21snmpd19:30:070
17951991514,1cyclictest66850irq/125-lan20:50:173
17951991514,1cyclictest66850irq/125-lan20:35:203
17951991514,1cyclictest66850irq/125-lan20:30:263
17951991514,1cyclictest66850irq/125-lan19:20:123
17951991414,0cyclictest66850irq/125-lan20:04:503
17951991413,1cyclictest66850irq/125-lan19:30:183
17939991414,0cyclictest771-21snmpd22:15:540
17939991414,0cyclictest771-21snmpd20:20:260
17939991414,0cyclictest15478-21cat22:30:150
17951991313,0cyclictest66850irq/125-lan19:59:513
17951991313,0cyclictest66850irq/125-lan19:17:163
17939991313,0cyclictest771-21snmpd20:52:060
17939991312,1cyclictest771-21snmpd20:01:590
17939991212,0cyclictest771-21snmpd22:12:440
17939991212,0cyclictest771-21snmpd20:44:390
17939991212,0cyclictest771-21snmpd20:19:180
17939991212,0cyclictest771-21snmpd19:55:140
17939991212,0cyclictest771-21snmpd19:49:040
17939991212,0cyclictest771-21snmpd00:37:080
17939991212,0cyclictest771-21snmpd00:05:220
17939991212,0cyclictest20908-21cat20:35:140
17939991212,0cyclictest20568-21cat19:15:140
17939991212,0cyclictest16861-21cat20:25:170
17951991110,1cyclictest66850irq/125-lan19:35:173
1794499118,0cyclictest771-21snmpd22:54:451
17939991111,0cyclictest771-21snmpd23:20:230
17939991111,0cyclictest771-21snmpd21:30:320
1795199109,1cyclictest66850irq/125-lan19:25:213
1794499108,0cyclictest769-21lldpd23:48:431
179489998,1cyclictest771-21snmpd23:11:282
179489998,1cyclictest771-21snmpd20:09:412
179449998,1cyclictest771-21snmpd21:17:531
179449998,1cyclictest771-21snmpd20:54:481
179449998,1cyclictest771-21snmpd00:35:141
179399998,1cyclictest771-21snmpd22:07:570
179399998,1cyclictest771-21snmpd19:35:070
179519988,0cyclictest769-21lldpd19:10:403
179489988,0cyclictest771-21snmpd21:41:292
179489988,0cyclictest769-21lldpd20:55:382
179489988,0cyclictest769-21lldpd19:48:382
179489988,0cyclictest769-21lldpd19:42:412
179489987,1cyclictest771-21snmpd21:36:072
179489987,1cyclictest517-21systemd-resolve22:15:422
179489987,1cyclictest517-21systemd-resolve22:11:172
179489986,2cyclictest771-21snmpd23:50:002
179489986,2cyclictest771-21snmpd21:53:592
179489986,2cyclictest771-21snmpd21:45:362
179489986,2cyclictest771-21snmpd20:48:032
179489985,3cyclictest771-21snmpd23:08:222
179449988,0cyclictest771-21snmpd22:26:181
179449988,0cyclictest771-21snmpd20:41:251
179449988,0cyclictest771-21snmpd19:24:001
179449988,0cyclictest769-21lldpd23:52:451
179449988,0cyclictest769-21lldpd22:04:131
179449988,0cyclictest769-21lldpd00:10:181
179449987,1cyclictest771-21snmpd19:55:531
179449987,1cyclictest771-21snmpd19:14:371
179449987,1cyclictest524-21avahi-daemon23:39:131
179449987,1cyclictest524-21avahi-daemon23:32:391
179449986,2cyclictest771-21snmpd23:20:321
179449986,2cyclictest771-21snmpd21:24:041
179449986,2cyclictest771-21snmpd00:07:251
179449986,2cyclictest749-21ntpd21:05:581
179449986,2cyclictest749-21ntpd20:16:071
179449986,2cyclictest749-21ntpd19:16:001
179399988,0cyclictest771-21snmpd22:20:580
179399988,0cyclictest771-21snmpd21:59:500
179399988,0cyclictest769-21lldpd23:46:530
179399988,0cyclictest769-21lldpd23:14:130
179399988,0cyclictest769-21lldpd22:36:360
179399988,0cyclictest769-21lldpd20:58:300
179399988,0cyclictest769-21lldpd00:22:490
179399988,0cyclictest769-21lldpd00:02:150
179399987,1cyclictest771-21snmpd22:26:000
179399986,2cyclictest771-21snmpd21:24:550
179399986,2cyclictest749-21ntpd23:38:330
179399986,2cyclictest749-21ntpd23:30:490
179399986,2cyclictest749-21ntpd22:47:500
179489977,0cyclictest771-21snmpd23:38:172
179489977,0cyclictest771-21snmpd23:28:522
179489977,0cyclictest771-21snmpd00:22:032
179489977,0cyclictest769-21lldpd23:01:282
179489977,0cyclictest769-21lldpd22:34:202
179489977,0cyclictest769-21lldpd20:24:272
179489976,1cyclictest771-21snmpd22:57:342
179489976,1cyclictest771-21snmpd21:03:302
179489976,1cyclictest771-21snmpd00:37:562
179489976,1cyclictest524-21avahi-daemon23:30:212
179489976,1cyclictest1-21systemd00:32:042
179489975,2cyclictest771-21snmpd20:30:472
179489975,2cyclictest771-21snmpd00:10:122
179489973,3cyclictest9308-21ssh21:15:242
179489973,3cyclictest29812-21ssh23:19:212
179489973,3cyclictest255-20systemd-journal19:50:192
179489973,3cyclictest24524-21ssh21:31:222
179449977,0cyclictest771-21snmpd23:26:431
179449977,0cyclictest771-21snmpd21:51:231
179449977,0cyclictest771-21snmpd20:23:171
179449977,0cyclictest771-21snmpd00:25:151
179449977,0cyclictest771-21snmpd00:22:011
179449977,0cyclictest769-21lldpd23:07:431
179449977,0cyclictest769-21lldpd22:47:281
179449977,0cyclictest769-21lldpd21:58:481
179449977,0cyclictest769-21lldpd21:44:321
179449977,0cyclictest769-21lldpd20:31:111
179449977,0cyclictest769-21lldpd00:33:331
179449977,0cyclictest769-21lldpd00:04:351
179449976,1cyclictest771-21snmpd19:48:371
179449976,1cyclictest771-21snmpd19:39:011
179449976,1cyclictest524-21avahi-daemon22:13:011
179449976,1cyclictest517-21systemd-resolve22:41:561
179449975,2cyclictest771-21snmpd21:13:531
179449975,2cyclictest771-21snmpd20:36:381
179449975,2cyclictest771-21snmpd20:25:121
179449975,2cyclictest749-21ntpd21:01:071
179449975,2cyclictest749-21ntpd20:55:151
179449973,3cyclictest6589-21ssh21:46:181
179449973,3cyclictest18444-21diskstats23:40:131
179399977,0cyclictest771-21snmpd23:29:430
179399977,0cyclictest771-21snmpd20:48:340
179399977,0cyclictest771-21snmpd20:05:020
179399977,0cyclictest771-21snmpd19:50:550
179399977,0cyclictest769-21lldpd21:52:240
179399977,0cyclictest769-21lldpd21:28:440
179399976,1cyclictest749-21ntpd23:40:160
179399976,1cyclictest749-21ntpd23:16:250
179399976,1cyclictest749-21ntpd23:03:030
179399976,1cyclictest749-21ntpd21:37:240
179399976,1cyclictest5992-21tail21:45:230
179399975,2cyclictest749-21ntpd22:55:540
179399975,2cyclictest749-21ntpd22:43:310
179399975,2cyclictest749-21ntpd22:00:120
179399975,2cyclictest749-21ntpd21:10:220
179399975,2cyclictest749-21ntpd00:25:490
179399975,2cyclictest749-21ntpd00:15:160
179399975,2cyclictest749-21ntpd00:13:390
179489966,0cyclictest22865-21sed20:40:172
179489965,1cyclictest771-21snmpd23:52:142
179489965,1cyclictest771-21snmpd21:55:422
179489965,1cyclictest769-21lldpd23:21:212
179489965,1cyclictest524-21avahi-daemon21:20:302
179489965,1cyclictest2809-21cpuspeed_turbos21:10:122
179489965,1cyclictest19894-21idleruntime-cro19:15:012
179489964,2cyclictest771-21snmpd22:53:482
179489963,3cyclictest550-21NetworkManager00:15:382
179489963,3cyclictest27216-21ntp_192.168.11420:50:162
179489963,3cyclictest26497-21fw_packets19:30:142
179489963,2cyclictest32215-21ssh00:29:002
179489962,4cyclictest550-21NetworkManager19:27:122
179489962,3cyclictest771-21snmpd21:05:092
179489962,3cyclictest7536-21ssh00:00:482
179489962,3cyclictest3428-21ssh23:56:562
179489962,3cyclictest21277-21ssh23:42:472
179489962,3cyclictest12504-21ssh00:06:172
179449965,1cyclictest8787-21cat20:05:131
179449965,1cyclictest769-21lldpd23:11:211
179449965,1cyclictest524-21avahi-daemon21:29:411
179449965,1cyclictest524-21avahi-daemon19:25:081
179449965,1cyclictest331ktimers/100:15:191
179449965,1cyclictest27917-21gltestperf21:35:141
179449965,1cyclictest0-21swapper/121:35:011
179449964,2cyclictest771-21snmpd19:43:201
179449963,3cyclictest19791-21apt-get22:35:121
179449962,3cyclictest26825-21ssh22:08:311
179449962,3cyclictest17756-21ssh22:32:251
179449960,6cyclictest1337-21grep23:55:151
179399966,0cyclictest771-21snmpd23:09:260
179399966,0cyclictest517-21systemd-resolve21:03:050
179399965,1cyclictest769-21lldpd21:05:150
179399965,1cyclictest524-21avahi-daemon19:21:010
179399965,1cyclictest24545-21gltestperf19:25:150
179399964,2cyclictest749-21ntpd21:40:200
179399964,2cyclictest749-21ntpd20:30:200
179399963,3cyclictest945-21apt-get23:55:130
179399960,5cyclictest29077-21ntpq23:50:180
179489955,0cyclictest771-21snmpd22:42:482
179489955,0cyclictest769-21lldpd22:35:052
179489954,1cyclictest769-21lldpd21:26:242
179489954,1cyclictest21898-21idleruntime-cro19:20:002
179489954,1cyclictest19424-21ntpq22:00:172
179489953,2cyclictest771-21snmpd20:15:382
179489953,2cyclictest771-21snmpd20:14:452
179489953,2cyclictest22604-21cat19:20:132
179489952,3cyclictest28509-21fw_forwarded_lo19:35:142
179489952,3cyclictest16696-21perl20:25:152
179489952,3cyclictest10198-21ssh22:25:072
179489951,3cyclictest6388-21ntpq22:20:182
179489951,3cyclictest29195-21ssh22:45:102
179489951,3cyclictest23704-21fw_packets22:05:132
179489950,4cyclictest21224-21ntpq20:35:162
179449955,0cyclictest769-21lldpd19:53:221
179449955,0cyclictest524-21avahi-daemon20:10:101
179449954,1cyclictest771-21snmpd22:16:301
179449954,1cyclictest11411-21cpuspeed_turbos23:00:121
179449952,2cyclictest8152-21ssh22:22:071
179449952,2cyclictest27763-21sshd19:32:481
179449952,2cyclictest27463-21ssh23:15:431
179449952,2cyclictest10508-21seq22:59:191
179449950,4cyclictest26008-21seq20:47:011
179399952,2cyclictest3293-21ssh00:32:070
179399952,2cyclictest2999-21ssh22:50:220
179489942,2cyclictest6613-21tune2fs20:00:142
179489940,3cyclictest4874-21/usr/sbin/munin19:55:172
179449940,4cyclictest7114-21ntpq20:00:181
179399942,2cyclictest221rcuc/020:10:160
179399940,3cyclictest18106-21/usr/sbin/munin19:10:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional