You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 18:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Mon Nov 24, 2025 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13059992019,1cyclictest66850irq/125-lan09:22:313
13059991918,1cyclictest66850irq/125-lan11:25:173
13059991918,1cyclictest66850irq/125-lan09:25:223
13059991818,0cyclictest66850irq/125-lan11:50:593
13059991818,0cyclictest66850irq/125-lan11:48:303
13059991818,0cyclictest66850irq/125-lan11:16:403
13059991818,0cyclictest66850irq/125-lan10:38:593
13059991818,0cyclictest66850irq/125-lan10:25:213
13059991817,1cyclictest66850irq/125-lan12:30:203
13059991817,1cyclictest66850irq/125-lan12:07:563
13059991817,1cyclictest66850irq/125-lan10:55:143
13059991817,1cyclictest66850irq/125-lan10:30:143
13059991817,1cyclictest66850irq/125-lan10:07:583
13059991817,1cyclictest66850irq/125-lan09:45:153
13059991817,1cyclictest66850irq/125-lan08:05:203
13059991717,0cyclictest66850irq/125-lan12:24:173
13059991717,0cyclictest66850irq/125-lan12:19:443
13059991717,0cyclictest66850irq/125-lan11:56:593
13059991717,0cyclictest66850irq/125-lan11:31:563
13059991717,0cyclictest66850irq/125-lan11:22:583
13059991717,0cyclictest66850irq/125-lan11:00:493
13059991717,0cyclictest66850irq/125-lan10:50:003
13059991717,0cyclictest66850irq/125-lan10:22:003
13059991717,0cyclictest66850irq/125-lan10:15:143
13059991717,0cyclictest66850irq/125-lan09:59:163
13059991717,0cyclictest66850irq/125-lan09:15:213
13059991717,0cyclictest66850irq/125-lan08:35:193
13059991717,0cyclictest66850irq/125-lan08:32:073
13059991717,0cyclictest66850irq/125-lan08:20:053
13059991717,0cyclictest66850irq/125-lan07:30:153
13059991716,1cyclictest66850irq/125-lan12:35:373
13059991716,1cyclictest66850irq/125-lan12:10:023
13059991716,1cyclictest66850irq/125-lan12:01:023
13059991716,1cyclictest66850irq/125-lan11:41:203
13059991716,1cyclictest66850irq/125-lan10:10:073
13059991716,1cyclictest66850irq/125-lan10:02:053
13059991716,1cyclictest66850irq/125-lan09:51:443
13059991716,1cyclictest66850irq/125-lan08:10:163
13059991716,1cyclictest66850irq/125-lan07:55:003
13059991616,0cyclictest66850irq/125-lan11:38:093
13059991616,0cyclictest66850irq/125-lan11:10:243
13059991616,0cyclictest66850irq/125-lan11:06:573
13059991616,0cyclictest66850irq/125-lan10:45:033
13059991616,0cyclictest66850irq/125-lan10:41:123
13059991616,0cyclictest66850irq/125-lan09:30:153
13059991616,0cyclictest66850irq/125-lan09:10:153
13059991616,0cyclictest66850irq/125-lan08:17:433
13059991616,0cyclictest66850irq/125-lan08:00:173
13059991616,0cyclictest66850irq/125-lan07:59:273
13059991616,0cyclictest66850irq/125-lan07:20:093
13059991615,1cyclictest66850irq/125-lan09:40:413
13059991615,1cyclictest66850irq/125-lan09:37:003
13059991615,1cyclictest66850irq/125-lan09:05:203
13059991615,1cyclictest66850irq/125-lan09:00:143
13059991515,0cyclictest66850irq/125-lan08:51:303
13059991515,0cyclictest66850irq/125-lan08:45:223
13059991515,0cyclictest66850irq/125-lan07:25:203
13059991515,0cyclictest66850irq/125-lan07:17:223
13059991515,0cyclictest66850irq/125-lan07:13:173
13059991514,1cyclictest66850irq/125-lan12:26:223
13059991514,1cyclictest66850irq/125-lan07:40:123
13059991414,0cyclictest66850irq/125-lan08:55:143
13059991414,0cyclictest66850irq/125-lan08:40:153
13059991413,1cyclictest66850irq/125-lan07:35:163
1305699118,3cyclictest771-21snmpd07:47:012
13059991010,0cyclictest66850irq/125-lan08:25:183
13059991010,0cyclictest66850irq/125-lan07:45:163
1305699108,2cyclictest769-21lldpd08:17:532
1305699107,3cyclictest771-21snmpd11:15:202
1305699107,3cyclictest771-21snmpd09:38:472
1305699105,4cyclictest771-21snmpd08:41:422
130569998,1cyclictest771-21snmpd07:21:162
130569997,2cyclictest769-21lldpd09:50:362
130569997,2cyclictest524-21avahi-daemon11:02:542
130569996,3cyclictest9884-21gltestperf08:20:152
130569996,3cyclictest771-21snmpd10:29:552
130569996,3cyclictest771-21snmpd09:44:082
130569996,3cyclictest771-21snmpd08:13:382
130569996,3cyclictest771-21snmpd07:10:452
130569995,4cyclictest771-21snmpd10:39:022
130569995,4cyclictest771-21snmpd08:09:232
130569991,3cyclictest550-21NetworkManager12:00:312
130569991,2cyclictest17758-21kworker/u16:2+xprtiod10:56:442
130569990,2cyclictest30349-21diskmemload10:04:092
130569990,2cyclictest28713-21sh09:45:302
130519998,1cyclictest771-21snmpd09:40:351
130469998,1cyclictest771-21snmpd10:22:490
130469998,1cyclictest771-21snmpd07:31:430
130469998,1cyclictest769-21lldpd09:25:180
130469998,1cyclictest524-21avahi-daemon12:25:530
130569987,1cyclictest771-21snmpd07:28:102
130569987,1cyclictest769-21lldpd10:40:152
130569987,1cyclictest30906-21fschecks_count09:10:132
130569986,2cyclictest771-21snmpd07:50:502
130569986,2cyclictest771-21snmpd07:42:342
130569986,2cyclictest749-21ntpd09:16:102
130569986,2cyclictest749-21ntpd08:30:252
130569985,3cyclictest524-21avahi-daemon08:27:422
130569984,4cyclictest771-21snmpd09:05:162
130569983,5cyclictest550-21NetworkManager11:34:252
130569982,6cyclictest369-21ssh12:19:072
130569982,6cyclictest19932-21wc12:05:152
130569982,5cyclictest4234-21pluginstate09:55:182
130569982,3cyclictest27995-21ssh12:13:492
130569982,3cyclictest16282-21rm10:46:362
130569982,2cyclictest255-20systemd-journal10:15:122
130569981,3cyclictest15715-21irqstats07:15:152
130569980,3cyclictest609-21/usr/sbin/munin11:05:232
130569980,2cyclictest30349-21diskmemload11:44:272
130569980,2cyclictest13958-21cat12:00:002
130519988,0cyclictest771-21snmpd11:45:091
130519988,0cyclictest771-21snmpd11:42:541
130519988,0cyclictest771-21snmpd11:21:541
130519988,0cyclictest769-21lldpd10:31:451
130519987,1cyclictest771-21snmpd10:17:001
130519987,1cyclictest771-21snmpd09:53:451
130519987,1cyclictest771-21snmpd09:32:081
130519987,1cyclictest769-21lldpd11:27:541
130519987,1cyclictest769-21lldpd07:26:321
130519987,1cyclictest524-21avahi-daemon10:37:551
130519987,1cyclictest524-21avahi-daemon08:44:401
130519987,1cyclictest517-21systemd-resolve11:35:401
130519986,2cyclictest771-21snmpd11:57:511
130519986,2cyclictest771-21snmpd08:18:441
130519986,2cyclictest771-21snmpd08:08:591
130519984,3cyclictest255-20systemd-journal11:08:101
130469988,0cyclictest771-21snmpd09:15:340
130469988,0cyclictest771-21snmpd07:49:560
130469988,0cyclictest769-21lldpd11:55:060
130469988,0cyclictest769-21lldpd11:42:500
130469988,0cyclictest769-21lldpd10:51:120
130469987,1cyclictest771-21snmpd11:33:090
130469987,1cyclictest771-21snmpd09:24:230
130469987,1cyclictest771-21snmpd07:36:370
130469986,2cyclictest771-21snmpd12:21:520
130469986,2cyclictest771-21snmpd10:48:280
130469986,2cyclictest771-21snmpd10:25:000
130469986,2cyclictest771-21snmpd10:06:220
130469986,2cyclictest771-21snmpd10:04:180
130569977,0cyclictest771-21snmpd12:30:292
130569977,0cyclictest771-21snmpd10:54:442
130569977,0cyclictest769-21lldpd07:33:362
130569975,2cyclictest771-21snmpd12:20:172
130569975,2cyclictest517-21systemd-resolve09:00:092
130569973,4cyclictest550-21NetworkManager10:12:122
130569972,5cyclictest5263-21find11:50:132
130569972,2cyclictest22497-21cut08:50:112
130569972,1cyclictest7039-21sh11:14:532
130569971,3cyclictest31500-21apt-config07:55:002
130569971,2cyclictest15646-21apt08:35:122
130569970,4cyclictest16213-21diskstats11:25:132
130569970,3cyclictest7383-21/usr/sbin/munin09:20:172
130569970,3cyclictest6557-21ntpq12:25:172
130569970,3cyclictest26464-21sed11:35:212
130569970,3cyclictest26367-21ssh10:21:082
130569970,3cyclictest24626-21/usr/sbin/munin08:55:142
130569970,3cyclictest23786-21irqstats07:35:152
130569970,3cyclictest20408-21/usr/sbin/munin08:45:142
130569970,3cyclictest17719-21ssh09:32:502
130569970,3cyclictest1679-21diskstats08:00:122
130569970,3cyclictest15358-21awk12:35:172
130569970,3cyclictest13479-21ssh11:20:572
130569970,3cyclictest12011-21/usr/sbin/munin10:05:152
130569970,3cyclictest11713-21cat09:25:222
130569970,3cyclictest1164-21fw_packets10:30:142
130569970,3cyclictest1006-21/usr/sbin/munin11:45:142
130519977,0cyclictest771-21snmpd09:16:371
130519977,0cyclictest771-21snmpd08:38:391
130519977,0cyclictest771-21snmpd07:41:101
130519977,0cyclictest517-21systemd-resolve11:10:431
130519976,1cyclictest771-21snmpd10:51:261
130519976,1cyclictest771-21snmpd10:42:521
130519976,1cyclictest771-21snmpd10:24:221
130519976,1cyclictest771-21snmpd10:00:541
130519976,1cyclictest771-21snmpd09:21:461
130519976,1cyclictest769-21lldpd12:17:271
130519976,1cyclictest524-21avahi-daemon12:03:251
130519976,1cyclictest524-21avahi-daemon11:34:471
130519975,2cyclictest771-21snmpd12:07:501
130519975,2cyclictest771-21snmpd10:13:001
130519975,2cyclictest771-21snmpd07:53:231
130519975,2cyclictest771-21snmpd07:32:401
130519975,2cyclictest13674-21cat07:10:141
130519974,2cyclictest255-20systemd-journal09:46:211
130469977,0cyclictest771-21snmpd11:05:060
130469977,0cyclictest771-21snmpd09:36:540
130469977,0cyclictest771-21snmpd07:16:310
130469977,0cyclictest769-21lldpd12:15:090
130469977,0cyclictest769-21lldpd10:42:490
130469977,0cyclictest769-21lldpd10:15:210
130469976,1cyclictest771-21snmpd09:33:440
130469976,1cyclictest771-21snmpd08:41:120
130469976,1cyclictest769-21lldpd12:06:220
130469976,1cyclictest769-21lldpd07:29:060
130469976,1cyclictest524-21avahi-daemon11:52:190
130469976,1cyclictest20456-21kworker/0:2+events_freezable_pwr_efficient09:00:160
130469976,1cyclictest15719-21cpuspeed_turbos08:35:130
130469975,2cyclictest771-21snmpd10:39:200
130469975,2cyclictest771-21snmpd07:50:230
130469973,3cyclictest255-20systemd-journal12:36:540
130469970,0cyclictest7547-21apt-get08:15:120
130519966,0cyclictest771-21snmpd12:35:561
130519966,0cyclictest771-21snmpd10:06:521
130519966,0cyclictest771-21snmpd08:14:531
130519966,0cyclictest769-21lldpd09:10:441
130519966,0cyclictest524-21avahi-daemon08:47:101
130519965,1cyclictest14505-21sh09:30:001
130519963,2cyclictest7759-21ssh12:26:261
130519962,3cyclictest5800-21ssh09:57:281
130519962,3cyclictest27121-21date11:00:001
130519962,3cyclictest13554-21ssh12:33:551
130469966,0cyclictest771-21snmpd12:03:100
130469966,0cyclictest771-21snmpd11:20:150
130469966,0cyclictest771-21snmpd09:09:200
130469966,0cyclictest771-21snmpd08:52:070
130469966,0cyclictest771-21snmpd08:23:420
130469966,0cyclictest769-21lldpd11:28:580
130469966,0cyclictest524-21avahi-daemon08:57:030
130469966,0cyclictest524-21avahi-daemon07:43:040
130469965,1cyclictest771-21snmpd12:14:350
130469965,1cyclictest517-21systemd-resolve10:13:200
130469964,2cyclictest771-21snmpd12:31:470
130469964,2cyclictest771-21snmpd11:18:230
130469964,2cyclictest771-21snmpd10:58:310
130469964,2cyclictest771-21snmpd07:58:050
130469964,2cyclictest3950-21cat08:05:150
130469963,2cyclictest4417-21ssh11:49:130
130469962,3cyclictest6224-21ssh11:13:200
130469962,3cyclictest27377-21tr11:00:120
130519955,0cyclictest771-21snmpd12:10:491
130519955,0cyclictest524-21avahi-daemon08:50:031
130519955,0cyclictest524-21avahi-daemon07:15:071
130519954,1cyclictest524-21avahi-daemon08:25:121
130519954,1cyclictest28952-21fschecks_count10:25:131
130519954,1cyclictest14521-21cat10:45:151
130519953,2cyclictest771-21snmpd09:36:351
130519953,2cyclictest771-21snmpd08:23:001
130519953,2cyclictest771-21snmpd07:45:281
130519953,2cyclictest17734-21cat07:20:131
130519953,2cyclictest0-21swapper/109:00:001
130519952,2cyclictest6973-21ssh11:50:521
130519952,2cyclictest30368-21ssh11:03:091
130519951,3cyclictest7350-21ssh11:15:011
130519951,3cyclictest24490-21sed07:35:211
130519951,3cyclictest15388-21awk08:35:001
130469955,0cyclictest769-21lldpd07:20:400
130469954,1cyclictest771-21snmpd09:46:350
130469954,1cyclictest771-21snmpd08:03:530
130469953,2cyclictest586-21rs:main0
130469952,2cyclictest6286-21ntpq08:10:160
130469952,2cyclictest4376-21ssh09:55:200
130469952,2cyclictest32410-21ld09:50:180
130469952,2cyclictest24583-21sed09:40:220
130469952,2cyclictest2064-21sed10:30:210
130469951,3cyclictest32027-21grep09:10:210
130519943,1cyclictest28763-21df09:05:141
130519941,2cyclictest32759-21open_files07:55:181
130519941,2cyclictest1231-21ssh12:20:031
130519940,3cyclictest27397-21/usr/sbin/munin09:00:161
130519940,3cyclictest1806-21fw_forwarded_lo08:00:131
130469942,2cyclictest0-21swapper/008:25:090
130469941,2cyclictest20208-21expr08:45:130
130469941,2cyclictest13951-21sh07:10:160
130469940,3cyclictest13908-21fw_forwarded_lo08:30:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional