You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-16 - 20:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Mon Jun 16, 2025 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7028992018,2cyclictest66850irq/125-lan12:17:293
7028991918,1cyclictest66850irq/125-lan12:29:023
7028991918,1cyclictest66850irq/125-lan12:11:423
7028991918,1cyclictest66850irq/125-lan12:05:203
7028991918,1cyclictest66850irq/125-lan11:57:013
7028991918,1cyclictest66850irq/125-lan11:53:343
7028991918,1cyclictest66850irq/125-lan11:43:393
7028991918,1cyclictest66850irq/125-lan10:10:193
7028991918,1cyclictest66850irq/125-lan09:07:123
7028991917,2cyclictest66850irq/125-lan12:02:563
7028991917,2cyclictest66850irq/125-lan10:18:223
7028991818,0cyclictest66850irq/125-lan12:22:093
7028991818,0cyclictest66850irq/125-lan11:47:463
7028991818,0cyclictest66850irq/125-lan10:26:033
7028991818,0cyclictest66850irq/125-lan09:29:303
7028991818,0cyclictest66850irq/125-lan07:31:523
7028991817,1cyclictest66850irq/125-lan11:18:463
7028991817,1cyclictest66850irq/125-lan11:10:273
7028991817,1cyclictest66850irq/125-lan10:08:203
7028991817,1cyclictest66850irq/125-lan09:53:273
7028991817,1cyclictest66850irq/125-lan09:47:433
7028991817,1cyclictest66850irq/125-lan09:35:203
7028991817,1cyclictest66850irq/125-lan09:20:163
7028991817,1cyclictest66850irq/125-lan09:15:063
7028991817,1cyclictest66850irq/125-lan08:50:243
7028991816,2cyclictest66850irq/125-lan12:35:593
7028991816,2cyclictest66850irq/125-lan11:20:213
7028991816,2cyclictest66850irq/125-lan10:56:353
7028991816,2cyclictest66850irq/125-lan09:10:213
7028991816,2cyclictest66850irq/125-lan09:00:273
7028991816,2cyclictest66850irq/125-lan08:05:153
7028991816,2cyclictest66850irq/125-lan08:00:183
7028991816,2cyclictest66850irq/125-lan07:50:143
7028991815,3cyclictest66850irq/125-lan11:05:223
7016991818,0cyclictest771-21snmpd12:13:171
7016991818,0cyclictest771-21snmpd11:39:141
7016991818,0cyclictest771-21snmpd11:28:141
7016991818,0cyclictest771-21snmpd09:16:261
7016991818,0cyclictest771-21snmpd08:15:031
7016991818,0cyclictest771-21snmpd08:13:541
7016991818,0cyclictest771-21snmpd07:23:351
7016991818,0cyclictest2547-21cat12:25:181
7016991818,0cyclictest18517-21cat08:55:171
7016991818,0cyclictest15164-21cat10:15:161
7028991717,0cyclictest66850irq/125-lan12:30:083
7028991717,0cyclictest66850irq/125-lan10:40:163
7028991717,0cyclictest66850irq/125-lan10:02:213
7028991716,1cyclictest66850irq/125-lan11:35:213
7028991716,1cyclictest66850irq/125-lan11:34:553
7028991716,1cyclictest66850irq/125-lan11:27:033
7028991716,1cyclictest66850irq/125-lan10:51:193
7028991716,1cyclictest66850irq/125-lan10:45:233
7028991716,1cyclictest66850irq/125-lan09:55:133
7028991716,1cyclictest66850irq/125-lan09:30:453
7028991715,2cyclictest66850irq/125-lan10:23:133
7016991717,0cyclictest771-21snmpd12:36:311
7016991717,0cyclictest771-21snmpd09:57:521
7016991717,0cyclictest771-21snmpd09:48:161
7028991616,0cyclictest66850irq/125-lan11:00:143
7028991616,0cyclictest66850irq/125-lan08:20:233
7028991616,0cyclictest66850irq/125-lan07:25:133
7028991615,1cyclictest66850irq/125-lan10:31:553
7028991615,1cyclictest66850irq/125-lan09:40:023
7028991615,1cyclictest66850irq/125-lan08:40:153
7028991615,1cyclictest66850irq/125-lan08:15:173
7028991615,1cyclictest66850irq/125-lan07:10:113
7028991614,2cyclictest66850irq/125-lan10:35:203
7028991614,2cyclictest66850irq/125-lan07:55:133
7028991613,3cyclictest66850irq/125-lan07:15:093
7028991514,1cyclictest66850irq/125-lan08:30:223
7028991514,1cyclictest66850irq/125-lan07:45:123
7028991513,2cyclictest66850irq/125-lan07:40:123
7028991313,0cyclictest66850irq/125-lan08:25:133
7028991312,1cyclictest66850irq/125-lan08:45:223
7028991312,1cyclictest66850irq/125-lan07:35:193
7028991312,1cyclictest66850irq/125-lan07:20:213
7028991211,1cyclictest66850irq/125-lan08:35:243
70239998,1cyclictest771-21snmpd12:34:452
70239998,1cyclictest771-21snmpd11:10:392
70239998,1cyclictest771-21snmpd08:00:582
70239998,1cyclictest771-21snmpd07:12:582
70169998,1cyclictest771-21snmpd11:05:161
70169998,1cyclictest769-21lldpd11:02:351
70169998,1cyclictest524-21avahi-daemon10:25:151
70119998,1cyclictest771-21snmpd11:27:110
70119998,1cyclictest771-21snmpd08:00:120
70119998,1cyclictest769-21lldpd10:03:120
70289988,0cyclictest771-21snmpd08:11:333
70289987,1cyclictest66850irq/125-lan08:55:173
70239988,0cyclictest771-21snmpd11:38:412
70239988,0cyclictest771-21snmpd11:29:012
70239988,0cyclictest771-21snmpd10:27:202
70239988,0cyclictest769-21lldpd11:53:332
70239988,0cyclictest769-21lldpd08:55:192
70239988,0cyclictest769-21lldpd08:30:522
70239987,1cyclictest769-21lldpd08:16:572
70239987,1cyclictest769-21lldpd08:05:142
70239987,1cyclictest517-21systemd-resolve08:20:152
70239986,2cyclictest9470-21grep09:30:202
70239986,2cyclictest771-21snmpd12:15:532
70239986,2cyclictest771-21snmpd12:03:022
70239986,2cyclictest771-21snmpd11:01:542
70239986,2cyclictest771-21snmpd08:27:102
70239985,2cyclictest771-21snmpd09:50:012
70169988,0cyclictest771-21snmpd07:38:441
70169988,0cyclictest769-21lldpd09:32:221
70169987,1cyclictest771-21snmpd12:09:091
70169987,1cyclictest771-21snmpd11:31:161
70169987,1cyclictest771-21snmpd10:38:301
70169987,1cyclictest769-21lldpd08:02:381
70169987,1cyclictest517-21systemd-resolve10:14:191
70169986,2cyclictest771-21snmpd09:11:561
70169986,2cyclictest771-21snmpd07:43:531
70169986,2cyclictest749-21ntpd12:33:111
70169986,2cyclictest749-21ntpd12:20:311
70169986,2cyclictest749-21ntpd11:59:351
70169986,2cyclictest749-21ntpd11:51:251
70169986,2cyclictest749-21ntpd11:40:221
70169986,2cyclictest749-21ntpd10:34:071
70169986,2cyclictest749-21ntpd10:01:481
70169986,2cyclictest749-21ntpd09:51:251
70169986,2cyclictest749-21ntpd09:41:141
70119988,0cyclictest771-21snmpd12:27:040
70119988,0cyclictest771-21snmpd10:12:130
70119988,0cyclictest769-21lldpd11:16:290
70119988,0cyclictest769-21lldpd10:38:210
70119988,0cyclictest769-21lldpd10:26:580
70119988,0cyclictest769-21lldpd08:47:150
70119988,0cyclictest769-21lldpd08:22:300
70119988,0cyclictest769-21lldpd07:50:500
70119987,1cyclictest771-21snmpd08:58:350
70119987,1cyclictest769-21lldpd09:07:080
70119986,2cyclictest771-21snmpd08:42:460
70119986,2cyclictest771-21snmpd07:43:050
70119986,2cyclictest771-21snmpd07:31:110
70119985,3cyclictest771-21snmpd07:10:220
70239977,0cyclictest771-21snmpd08:12:182
70239977,0cyclictest769-21lldpd12:26:162
70239977,0cyclictest769-21lldpd11:22:562
70239977,0cyclictest769-21lldpd10:44:372
70239977,0cyclictest769-21lldpd08:46:182
70239977,0cyclictest769-21lldpd08:39:552
70239976,1cyclictest771-21snmpd08:44:252
70239976,1cyclictest771-21snmpd07:46:522
70239976,1cyclictest517-21systemd-resolve09:05:442
70239975,2cyclictest771-21snmpd11:56:142
70239975,2cyclictest771-21snmpd09:20:062
70239975,2cyclictest771-21snmpd09:18:542
70239973,3cyclictest21101-21ssh09:44:562
70239973,3cyclictest15705-21apt-get07:30:122
70169977,0cyclictest524-21avahi-daemon11:22:551
70169976,1cyclictest771-21snmpd07:52:031
70169976,1cyclictest749-21ntpd12:18:061
70169976,1cyclictest749-21ntpd11:10:251
70169976,1cyclictest749-21ntpd10:55:231
70169976,1cyclictest749-21ntpd10:54:541
70169976,1cyclictest749-21ntpd10:05:091
70169975,2cyclictest771-21snmpd08:25:191
70169975,2cyclictest771-21snmpd08:06:481
70169975,2cyclictest749-21ntpd12:00:181
70169975,2cyclictest749-21ntpd09:35:511
70169975,2cyclictest5449-21gpgv08:25:001
70119977,0cyclictest771-21snmpd10:33:230
70119977,0cyclictest771-21snmpd09:25:240
70119977,0cyclictest769-21lldpd12:02:540
70119977,0cyclictest769-21lldpd10:51:330
70119977,0cyclictest4334-21needreboot11:20:190
70119977,0cyclictest27598-21dump-pmu-power08:00:000
70119976,1cyclictest771-21snmpd09:50:440
70119976,1cyclictest524-21avahi-daemon11:52:090
70119976,1cyclictest1-21systemd08:15:030
70119975,2cyclictest771-21snmpd08:14:000
70119973,3cyclictest255-20systemd-journal10:47:360
70119973,3cyclictest19597-21memory10:20:190
70239966,0cyclictest771-21snmpd10:50:252
70239966,0cyclictest771-21snmpd10:47:502
70239966,0cyclictest771-21snmpd09:35:002
70239966,0cyclictest769-21lldpd12:23:432
70239966,0cyclictest769-21lldpd11:41:132
70239966,0cyclictest769-21lldpd10:05:112
70239966,0cyclictest769-21lldpd08:54:192
70239965,1cyclictest771-21snmpd10:20:092
70239965,1cyclictest771-21snmpd09:12:592
70239965,1cyclictest771-21snmpd07:52:452
70239965,1cyclictest524-21avahi-daemon09:55:092
70239964,2cyclictest550-21NetworkManager09:49:332
70239963,2cyclictest25141-21ntpq11:05:182
70239963,2cyclictest12744-21sed07:20:222
70239962,3cyclictest3481-21ssh10:00:412
70239962,3cyclictest32676-21cut11:15:202
70239962,3cyclictest255-20systemd-journal09:26:322
70169966,0cyclictest771-21snmpd10:46:111
70169966,0cyclictest771-21snmpd09:25:271
70169966,0cyclictest771-21snmpd08:43:011
70169966,0cyclictest769-21lldpd07:15:131
70169966,0cyclictest769-21lldpd07:13:041
70169966,0cyclictest255-20systemd-journal10:21:361
70169964,2cyclictest749-21ntpd07:45:011
70169963,2cyclictest255-20systemd-journal09:22:031
70169962,3cyclictest6430-21ssh10:42:191
70169962,3cyclictest287-21systemd-udevd08:48:211
70169962,3cyclictest26652-21apt11:45:161
70119966,0cyclictest7760-21cron08:30:000
70119966,0cyclictest771-21snmpd09:11:050
70119966,0cyclictest771-21snmpd07:26:050
70119966,0cyclictest771-21snmpd07:22:560
70119966,0cyclictest769-21lldpd09:33:120
70119966,0cyclictest769-21lldpd08:50:530
70119965,1cyclictest524-21avahi-daemon12:16:430
70119965,1cyclictest517-21systemd-resolve11:49:080
70119965,1cyclictest13394-21nvmesmart_nvme011:30:200
70119964,2cyclictest771-21snmpd11:05:360
70119964,2cyclictest771-21snmpd09:18:150
70119964,2cyclictest771-21snmpd07:37:410
70119963,3cyclictest9244-21grep08:30:220
70119963,3cyclictest20679-21memory09:00:200
70119963,2cyclictest749-21ntpd09:40:170
70119963,2cyclictest255-20systemd-journal09:45:410
70119963,2cyclictest255-20systemd-journal09:23:590
70119963,2cyclictest14231-21wc09:35:230
70119962,3cyclictest7844-21diskstats12:30:150
70119962,3cyclictest255-20systemd-journal09:56:090
70119962,3cyclictest14875-21ssh12:35:390
70239955,0cyclictest771-21snmpd07:29:562
70239954,1cyclictest771-21snmpd07:15:072
70239954,1cyclictest517-21systemd-resolve12:10:572
70239954,1cyclictest421ktimers/210:10:312
70239953,2cyclictest749-21ntpd07:57:042
70239953,2cyclictest550-21NetworkManager12:35:022
70239952,3cyclictest771-21snmpd09:00:452
70239952,3cyclictest12764-21perl11:30:162
70239952,2cyclictest17919-21rm10:18:192
70239952,2cyclictest16851-21sed10:55:162
70239952,2cyclictest14534-21grep12:05:162
70239951,3cyclictest26489-21ssh11:45:012
70239951,3cyclictest20093-21fw_forwarded_lo07:40:132
70239951,3cyclictest17883-21diskstats07:35:122
70239950,4cyclictest32509-21ntpq10:35:242
70239950,4cyclictest28243-21ntpq10:30:202
70169955,0cyclictest771-21snmpd09:01:471
70169955,0cyclictest771-21snmpd08:53:501
70169954,1cyclictest771-21snmpd08:30:521
70169952,2cyclictest2537-21sh11:18:451
70169952,2cyclictest10153-21cut08:35:161
70169951,3cyclictest14857-21sed07:25:211
70169950,2cyclictest0-21swapper/107:30:181
70119955,0cyclictest771-21snmpd10:06:110
70119954,1cyclictest771-21snmpd10:40:170
70119954,1cyclictest29617-21turbostat08:09:550
70119954,1cyclictest21509-21ntpq11:00:190
70119954,1cyclictest171ktimers/011:35:540
70119953,2cyclictest771-21snmpd11:12:190
70119953,2cyclictest550-21NetworkManager12:05:010
70119952,2cyclictest29684-21nfs_client12:20:160
70119952,2cyclictest255-20systemd-journal10:56:240
70119952,2cyclictest17458-21sshd10:17:350
70119952,2cyclictest11120-21cat08:35:240
70119952,2cyclictest10458-21ntpq07:15:180
70119951,3cyclictest4118-21dpkg11:55:020
70119951,3cyclictest22742-21ssh12:14:180
70119950,4cyclictest23166-21users11:40:270
70169941,2cyclictest26306-21tr07:55:141
70169941,2cyclictest22507-21grep09:05:181
70119940,3cyclictest22675-21ntpq07:45:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional