You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 02:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Wed Nov 19, 2025 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15973991919,0cyclictest66850irq/125-lan11:22:481
15973991918,1cyclictest66850irq/125-lan11:11:321
15973991918,1cyclictest66850irq/125-lan10:46:571
15973991918,1cyclictest66850irq/125-lan10:42:161
15973991918,1cyclictest66850irq/125-lan10:10:141
15973991918,1cyclictest66850irq/125-lan09:45:001
15973991918,1cyclictest66850irq/125-lan09:20:151
15973991918,1cyclictest66850irq/125-lan09:15:181
15973991818,0cyclictest66850irq/125-lan11:50:181
15973991818,0cyclictest66850irq/125-lan10:33:301
15973991818,0cyclictest66850irq/125-lan09:55:251
15973991818,0cyclictest66850irq/125-lan09:46:091
15973991817,1cyclictest66850irq/125-lan12:35:221
15973991817,1cyclictest66850irq/125-lan12:21:051
15973991817,1cyclictest66850irq/125-lan12:15:191
15973991817,1cyclictest66850irq/125-lan12:04:051
15973991817,1cyclictest66850irq/125-lan11:07:231
15973991817,1cyclictest66850irq/125-lan11:00:161
15973991817,1cyclictest66850irq/125-lan10:50:501
15973991817,1cyclictest66850irq/125-lan10:21:091
15973991817,1cyclictest66850irq/125-lan09:50:191
15973991817,1cyclictest66850irq/125-lan09:34:271
15973991817,1cyclictest66850irq/125-lan09:10:551
15973991817,1cyclictest66850irq/125-lan07:20:221
15973991717,0cyclictest66850irq/125-lan12:29:411
15973991717,0cyclictest66850irq/125-lan11:46:571
15973991717,0cyclictest66850irq/125-lan11:31:531
15973991717,0cyclictest66850irq/125-lan10:38:381
15973991717,0cyclictest66850irq/125-lan10:17:311
15973991717,0cyclictest66850irq/125-lan08:50:121
15973991717,0cyclictest66850irq/125-lan07:55:181
15973991716,1cyclictest66850irq/125-lan11:44:591
15973991716,1cyclictest66850irq/125-lan11:36:011
15973991716,1cyclictest66850irq/125-lan11:25:171
15973991716,1cyclictest66850irq/125-lan11:17:301
15973991716,1cyclictest66850irq/125-lan10:56:331
15973991716,1cyclictest66850irq/125-lan10:00:181
15973991716,1cyclictest66850irq/125-lan08:45:121
15973991616,0cyclictest66850irq/125-lan12:31:051
15973991616,0cyclictest66850irq/125-lan11:58:151
15973991616,0cyclictest66850irq/125-lan10:28:101
15973991616,0cyclictest66850irq/125-lan10:05:201
15973991616,0cyclictest66850irq/125-lan09:25:211
15973991616,0cyclictest66850irq/125-lan09:00:211
15973991616,0cyclictest66850irq/125-lan07:50:161
15973991616,0cyclictest66850irq/125-lan07:25:121
15973991616,0cyclictest66850irq/125-lan07:10:131
15973991615,1cyclictest66850irq/125-lan12:07:301
15973991615,1cyclictest66850irq/125-lan09:35:191
15973991615,1cyclictest66850irq/125-lan08:37:331
15973991615,1cyclictest66850irq/125-lan08:15:141
15973991514,1cyclictest66850irq/125-lan08:25:121
15973991514,1cyclictest66850irq/125-lan08:10:161
15973991514,1cyclictest66850irq/125-lan07:30:181
15973991414,0cyclictest66850irq/125-lan08:33:241
15973991413,1cyclictest66850irq/125-lan12:10:211
15973991413,1cyclictest66850irq/125-lan08:55:161
15973991413,1cyclictest66850irq/125-lan08:05:161
15973991313,0cyclictest66850irq/125-lan07:40:221
15973991313,0cyclictest66850irq/125-lan07:35:201
15973991312,1cyclictest66850irq/125-lan09:05:221
15973991312,1cyclictest66850irq/125-lan08:20:171
15973991312,1cyclictest66850irq/125-lan08:00:011
15973991312,1cyclictest66850irq/125-lan07:45:191
15973991211,1cyclictest66850irq/125-lan07:15:181
159809998,1cyclictest771-21snmpd09:16:123
159809998,1cyclictest769-21lldpd11:21:563
159809998,1cyclictest524-21avahi-daemon12:11:293
159769998,1cyclictest6770-21cut11:50:002
159769998,1cyclictest517-21systemd-resolve12:18:472
159769998,1cyclictest517-21systemd-resolve11:07:432
159739998,1cyclictest66850irq/125-lan08:40:181
159809988,0cyclictest769-21lldpd11:58:423
159809988,0cyclictest769-21lldpd10:51:303
159809988,0cyclictest769-21lldpd09:26:023
159809988,0cyclictest769-21lldpd08:45:043
159809988,0cyclictest769-21lldpd07:30:273
159809987,1cyclictest771-21snmpd12:08:423
159809987,1cyclictest771-21snmpd11:12:113
159809987,1cyclictest771-21snmpd10:25:303
159809987,1cyclictest771-21snmpd09:50:553
159809987,1cyclictest771-21snmpd09:14:433
159809987,1cyclictest524-21avahi-daemon10:21:073
159809987,1cyclictest25574-21cpuspeed_turbos08:50:123
159809986,2cyclictest771-21snmpd10:10:093
159809986,2cyclictest13815-21cat08:20:153
159809985,2cyclictest771-21snmpd09:30:003
159769988,0cyclictest771-21snmpd11:26:172
159769988,0cyclictest771-21snmpd07:48:002
159769988,0cyclictest769-21lldpd12:27:382
159769988,0cyclictest769-21lldpd10:57:392
159769987,1cyclictest771-21snmpd11:42:482
159769987,1cyclictest517-21systemd-resolve12:07:442
159769987,1cyclictest255-20systemd-journal09:52:502
159769986,2cyclictest771-21snmpd11:31:142
159769986,2cyclictest771-21snmpd08:51:592
159769986,2cyclictest771-21snmpd07:17:362
159769986,2cyclictest25093-21cat07:30:162
159699988,0cyclictest771-21snmpd12:39:230
159699988,0cyclictest769-21lldpd10:23:140
159699988,0cyclictest769-21lldpd09:51:010
159699988,0cyclictest769-21lldpd08:25:550
159699987,1cyclictest771-21snmpd12:11:300
159699987,1cyclictest771-21snmpd11:38:410
159699987,1cyclictest771-21snmpd11:17:470
159699987,1cyclictest771-21snmpd07:32:450
159699987,1cyclictest524-21avahi-daemon11:48:370
159699987,1cyclictest524-21avahi-daemon11:33:410
159699987,1cyclictest524-21avahi-daemon10:55:270
159699987,1cyclictest524-21avahi-daemon10:44:370
159699987,1cyclictest524-21avahi-daemon09:27:020
159699987,1cyclictest19800-21gltestperf08:35:140
159699986,2cyclictest771-21snmpd09:02:510
159699986,2cyclictest749-21ntpd12:20:010
159809977,0cyclictest771-21snmpd12:33:053
159809977,0cyclictest771-21snmpd09:24:573
159809977,0cyclictest771-21snmpd08:26:593
159809977,0cyclictest771-21snmpd07:51:403
159809977,0cyclictest769-21lldpd12:38:163
159809977,0cyclictest769-21lldpd11:53:233
159809977,0cyclictest769-21lldpd10:46:033
159809977,0cyclictest769-21lldpd10:36:543
159809977,0cyclictest30473-21needreboot11:00:193
159809976,1cyclictest771-21snmpd10:55:193
159809976,1cyclictest771-21snmpd09:56:473
159809976,1cyclictest771-21snmpd08:56:273
159809976,1cyclictest769-21lldpd11:36:113
159809976,1cyclictest524-21avahi-daemon07:59:013
159809976,1cyclictest517-21systemd-resolve12:28:033
159809976,1cyclictest517-21systemd-resolve11:25:413
159809976,1cyclictest517-21systemd-resolve11:17:563
159809975,2cyclictest23502-21cat11:30:153
159809974,3cyclictest255-20systemd-journal11:44:253
159809974,2cyclictest771-21snmpd08:32:313
159809973,3cyclictest255-20systemd-journal09:40:053
159769977,0cyclictest771-21snmpd10:15:032
159769977,0cyclictest769-21lldpd12:39:042
159769977,0cyclictest769-21lldpd11:36:392
159769977,0cyclictest769-21lldpd10:35:042
159769977,0cyclictest769-21lldpd10:23:162
159769977,0cyclictest769-21lldpd09:55:282
159769977,0cyclictest769-21lldpd09:43:022
159769977,0cyclictest769-21lldpd08:14:332
159769977,0cyclictest769-21lldpd07:40:092
159769977,0cyclictest769-21lldpd07:36:442
159769976,1cyclictest771-21snmpd09:02:142
159769976,1cyclictest524-21avahi-daemon11:18:322
159769976,1cyclictest19686-21fschecks_time08:35:132
159769975,2cyclictest771-21snmpd12:33:232
159769975,2cyclictest771-21snmpd12:23:542
159769975,2cyclictest771-21snmpd11:51:202
159769975,2cyclictest771-21snmpd10:43:072
159769975,2cyclictest771-21snmpd10:26:062
159769975,2cyclictest771-21snmpd09:27:222
159769973,3cyclictest550-21NetworkManager09:15:432
159699977,0cyclictest771-21snmpd10:25:110
159699977,0cyclictest771-21snmpd09:41:400
159699977,0cyclictest771-21snmpd09:17:220
159699977,0cyclictest771-21snmpd07:53:180
159699977,0cyclictest769-21lldpd12:34:550
159699977,0cyclictest769-21lldpd11:08:400
159699977,0cyclictest769-21lldpd10:49:170
159699977,0cyclictest769-21lldpd10:36:080
159699977,0cyclictest769-21lldpd07:49:530
159699976,1cyclictest771-21snmpd10:31:210
159699976,1cyclictest771-21snmpd09:58:460
159699976,1cyclictest771-21snmpd08:47:180
159699976,1cyclictest771-21snmpd07:26:040
159699976,1cyclictest769-21lldpd11:56:270
159699976,1cyclictest769-21lldpd08:54:240
159699976,1cyclictest584-21in:imuxsock11:29:440
159699976,1cyclictest517-21systemd-resolve10:15:070
159699976,1cyclictest30531-21cpuspeed_turbos09:45:150
159699975,2cyclictest771-21snmpd12:25:210
159699975,2cyclictest771-21snmpd08:09:280
159699973,3cyclictest255-20systemd-journal07:20:200
159809966,0cyclictest771-21snmpd11:06:463
159809966,0cyclictest769-21lldpd09:08:263
159809966,0cyclictest769-21lldpd08:15:423
159809966,0cyclictest769-21lldpd08:12:153
159809966,0cyclictest769-21lldpd08:07:113
159809966,0cyclictest586-21rs:main3
159809965,1cyclictest771-21snmpd12:00:313
159809965,1cyclictest771-21snmpd08:01:073
159809965,1cyclictest524-21avahi-daemon07:10:163
159809964,2cyclictest550-21NetworkManager12:18:013
159809963,2cyclictest255-20systemd-journal12:23:413
159769966,0cyclictest771-21snmpd10:07:022
159769966,0cyclictest771-21snmpd08:57:362
159769966,0cyclictest769-21lldpd12:11:302
159769966,0cyclictest769-21lldpd07:52:082
159769965,1cyclictest771-21snmpd08:40:302
159769965,1cyclictest771-21snmpd07:55:012
159769965,1cyclictest771-21snmpd07:22:192
159769965,1cyclictest524-21avahi-daemon12:02:132
159769965,1cyclictest13485-21tr08:20:132
159769964,2cyclictest771-21snmpd11:58:212
159769964,2cyclictest30224-21cat11:00:172
159769963,2cyclictest22499-21ssh10:14:502
159769963,2cyclictest20039-21ssh10:49:112
159769962,3cyclictest17176-21awk08:30:012
159769960,6cyclictest550-21NetworkManager10:01:352
159699966,0cyclictest771-21snmpd11:52:290
159699966,0cyclictest769-21lldpd12:16:100
159699966,0cyclictest769-21lldpd11:12:300
159699965,1cyclictest771-21snmpd10:11:230
159699965,1cyclictest771-21snmpd08:57:150
159699965,1cyclictest769-21lldpd10:03:240
159699965,1cyclictest769-21lldpd09:22:210
159699965,1cyclictest32450-21kworker/0:0+events09:35:160
159699965,1cyclictest32450-21kworker/0:0+events08:30:190
159699963,3cyclictest771-21snmpd08:18:490
159699963,3cyclictest550-21NetworkManager10:52:170
159699963,2cyclictest586-21rs:main0
159699963,2cyclictest586-21rs:main0
159699963,2cyclictest31604-21ssh11:01:000
159699962,3cyclictest30129-21seq07:40:230
159699960,3cyclictest17904-21munin-run07:15:000
159809955,0cyclictest524-21avahi-daemon07:45:503
159809955,0cyclictest23034-21gltestperf07:25:153
159809955,0cyclictest21927-21cpu09:35:133
159809954,1cyclictest771-21snmpd07:22:013
159809954,1cyclictest26754-21cpuspeed_turbos07:35:153
159809953,2cyclictest771-21snmpd11:47:363
159809953,2cyclictest771-21snmpd08:37:263
159809953,2cyclictest749-21ntpd10:34:583
159809953,2cyclictest11925-21ssh10:40:143
159809952,3cyclictest749-21ntpd10:15:123
159809952,2cyclictest32033-21ssh09:45:593
159809952,2cyclictest14412-21sh10:04:593
159809952,2cyclictest12387-21ssh10:01:113
159769955,0cyclictest524-21avahi-daemon08:19:112
159769954,1cyclictest771-21snmpd10:50:182
159769954,1cyclictest771-21snmpd09:30:582
159769954,1cyclictest6171-21cpuspeed_turbos11:10:142
159769953,2cyclictest550-21NetworkManager10:34:362
159769952,3cyclictest550-21NetworkManager11:20:212
159769952,3cyclictest24119-21seq07:26:412
159769951,3cyclictest9896-21df09:20:142
159769951,3cyclictest24192-21seq09:37:102
159769950,4cyclictest2534-21ntpq09:10:192
159699955,0cyclictest769-21lldpd07:18:490
159699954,1cyclictest771-21snmpd08:10:230
159699954,1cyclictest524-21avahi-daemon10:08:320
159699953,2cyclictest749-21ntpd09:05:050
159699952,2cyclictest4077-21seq09:12:050
159699952,2cyclictest32251-21ssh11:40:220
159699952,2cyclictest2956-21grep07:55:140
159699952,2cyclictest20423-21ssh09:32:530
159699951,3cyclictest15899-21sed11:20:240
159699950,3cyclictest21880-21awk12:05:190
159809942,2cyclictest749-21ntpd07:40:023
159809941,2cyclictest30277-21sed09:00:193
159809940,3cyclictest18343-21diskstats07:15:143
159769943,1cyclictest31636-21cpuspeed_turbos09:05:132
159769942,2cyclictest24061-21sed08:45:152
159769941,3cyclictest749-21ntpd08:30:142
159769941,2cyclictest6096-21ntpq08:00:202
159769941,2cyclictest31715-21cat09:45:262
159769940,4cyclictest8179-21ntpq08:05:172
159699943,1cyclictest13593-21fschecks_count08:20:140
159699942,2cyclictest5612-21head08:00:160
159699941,2cyclictest21457-21acpi08:40:150
159769930,3cyclictest16233-21/usr/sbin/munin07:10:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional