You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 20:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Sat Nov 29, 2025 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4881994343,0cyclictest6580-21fwupd07:12:143
4881991918,1cyclictest66850irq/125-lan10:13:573
4881991918,1cyclictest66850irq/125-lan09:45:073
4881991918,1cyclictest66850irq/125-lan09:20:163
4881991818,0cyclictest771-21snmpd12:32:003
4881991818,0cyclictest771-21snmpd11:32:163
4881991818,0cyclictest66850irq/125-lan12:20:263
4881991818,0cyclictest66850irq/125-lan11:15:183
4881991818,0cyclictest66850irq/125-lan10:03:423
4881991817,1cyclictest66850irq/125-lan11:45:143
4881991817,1cyclictest66850irq/125-lan11:42:413
4881991817,1cyclictest66850irq/125-lan10:33:203
4881991817,1cyclictest66850irq/125-lan10:20:153
4881991817,1cyclictest66850irq/125-lan10:18:313
4881991817,1cyclictest66850irq/125-lan09:32:133
4881991717,0cyclictest771-21snmpd11:14:423
4881991717,0cyclictest771-21snmpd10:40:283
4881991717,0cyclictest66850irq/125-lan12:35:053
4881991717,0cyclictest66850irq/125-lan12:05:443
4881991717,0cyclictest66850irq/125-lan11:54:213
4881991717,0cyclictest66850irq/125-lan11:00:163
4881991717,0cyclictest66850irq/125-lan10:55:143
4881991717,0cyclictest66850irq/125-lan10:50:203
4881991717,0cyclictest66850irq/125-lan10:46:343
4881991717,0cyclictest66850irq/125-lan10:25:183
4881991717,0cyclictest66850irq/125-lan09:58:033
4881991717,0cyclictest66850irq/125-lan09:50:193
4881991717,0cyclictest66850irq/125-lan09:28:193
4881991717,0cyclictest66850irq/125-lan08:30:173
4881991717,0cyclictest66850irq/125-lan08:00:023
4881991717,0cyclictest66850irq/125-lan07:58:013
4881991716,1cyclictest66850irq/125-lan12:17:133
4881991716,1cyclictest66850irq/125-lan12:13:043
4881991716,1cyclictest66850irq/125-lan12:00:223
4881991716,1cyclictest66850irq/125-lan11:58:243
4881991716,1cyclictest66850irq/125-lan11:35:033
4881991716,1cyclictest66850irq/125-lan11:22:023
4881991716,1cyclictest66850irq/125-lan10:35:233
4881991716,1cyclictest66850irq/125-lan10:05:013
4881991716,1cyclictest66850irq/125-lan09:15:083
4881991716,1cyclictest66850irq/125-lan09:10:173
4879991717,0cyclictest771-21snmpd09:20:172
4881991616,0cyclictest9988-21cat12:25:173
4881991616,0cyclictest771-21snmpd08:36:403
4881991616,0cyclictest771-21snmpd08:20:453
4881991616,0cyclictest771-21snmpd07:46:473
4881991616,0cyclictest771-21snmpd07:17:563
4881991616,0cyclictest66850irq/125-lan11:05:523
4881991616,0cyclictest66850irq/125-lan09:35:143
4881991616,0cyclictest66850irq/125-lan09:10:003
4881991616,0cyclictest66850irq/125-lan09:00:133
4881991616,0cyclictest66850irq/125-lan08:50:233
4881991616,0cyclictest66850irq/125-lan08:43:183
4881991616,0cyclictest66850irq/125-lan08:25:213
4881991615,1cyclictest66850irq/125-lan11:27:133
4881991615,1cyclictest66850irq/125-lan09:41:393
4881991615,1cyclictest66850irq/125-lan08:55:053
4881991615,1cyclictest66850irq/125-lan08:10:003
4881991515,0cyclictest66850irq/125-lan07:42:043
4879991515,0cyclictest771-21snmpd11:00:542
4879991515,0cyclictest771-21snmpd10:45:172
4879991515,0cyclictest771-21snmpd10:18:012
4879991515,0cyclictest771-21snmpd08:51:012
4881991414,0cyclictest66850irq/125-lan08:17:203
4881991414,0cyclictest66850irq/125-lan08:10:133
4881991414,0cyclictest66850irq/125-lan07:20:233
4881991413,1cyclictest66850irq/125-lan07:55:003
4879991414,0cyclictest771-21snmpd12:12:082
4879991414,0cyclictest771-21snmpd10:55:152
4879991414,0cyclictest771-21snmpd10:29:172
4879991414,0cyclictest771-21snmpd10:03:522
4879991414,0cyclictest771-21snmpd09:25:592
4879991414,0cyclictest771-21snmpd07:12:462
4875991414,0cyclictest771-21snmpd11:15:531
4881991313,0cyclictest66850irq/125-lan08:47:163
4881991313,0cyclictest66850irq/125-lan07:33:293
4881991313,0cyclictest66850irq/125-lan07:25:183
4879991313,0cyclictest771-21snmpd12:04:172
4879991313,0cyclictest771-21snmpd11:49:142
4879991313,0cyclictest771-21snmpd09:19:232
4879991313,0cyclictest771-21snmpd08:56:312
4879991313,0cyclictest771-21snmpd07:39:382
4879991313,0cyclictest771-21snmpd07:17:592
4879991313,0cyclictest25772-21cat08:00:162
4879991311,2cyclictest749-21ntpd09:38:392
4875991313,0cyclictest771-21snmpd09:14:191
4875991313,0cyclictest771-21snmpd09:02:591
4875991313,0cyclictest11954-21cat08:45:151
4875991312,1cyclictest771-21snmpd09:27:441
4881991211,1cyclictest66850irq/125-lan07:39:213
4875991212,0cyclictest771-21snmpd12:36:001
4875991212,0cyclictest771-21snmpd12:34:001
4875991212,0cyclictest771-21snmpd12:08:021
4875991212,0cyclictest771-21snmpd11:57:171
4875991212,0cyclictest771-21snmpd10:16:071
4875991212,0cyclictest771-21snmpd09:59:521
4875991212,0cyclictest771-21snmpd09:50:061
4875991212,0cyclictest771-21snmpd09:38:301
4875991212,0cyclictest771-21snmpd08:30:221
4875991212,0cyclictest771-21snmpd07:50:091
4875991212,0cyclictest30558-21cat11:40:171
4875991211,1cyclictest749-21ntpd10:51:571
4875991210,2cyclictest749-21ntpd09:41:181
4879991111,0cyclictest771-21snmpd11:06:452
4875991111,0cyclictest771-21snmpd11:54:561
4875991111,0cyclictest771-21snmpd11:31:341
4875991111,0cyclictest771-21snmpd11:25:041
4875991111,0cyclictest771-21snmpd11:22:281
4875991111,0cyclictest771-21snmpd10:48:231
4875991111,0cyclictest771-21snmpd10:36:441
4875991111,0cyclictest771-21snmpd10:07:581
4875991111,0cyclictest771-21snmpd09:31:301
4875991111,0cyclictest771-21snmpd08:50:131
4875991111,0cyclictest771-21snmpd08:37:371
4875991111,0cyclictest771-21snmpd07:20:321
4875991111,0cyclictest3351-21cat11:10:161
4875991111,0cyclictest32226-21cat08:15:151
4875991111,0cyclictest27764-21cat08:05:161
487999109,1cyclictest749-21ntpd09:32:412
4879991010,0cyclictest771-21snmpd10:30:052
4875991010,0cyclictest771-21snmpd10:28:051
4875991010,0cyclictest771-21snmpd08:44:241
4875991010,0cyclictest771-21snmpd08:03:361
4875991010,0cyclictest771-21snmpd07:37:321
48799998,1cyclictest524-21avahi-daemon07:53:372
48799996,3cyclictest771-21snmpd11:51:472
48759998,1cyclictest769-21lldpd11:00:451
48759998,1cyclictest524-21avahi-daemon09:15:311
48799988,0cyclictest771-21snmpd08:45:372
48799988,0cyclictest769-21lldpd09:56:532
48799986,2cyclictest771-21snmpd12:05:562
48799986,2cyclictest771-21snmpd10:23:472
48799986,2cyclictest771-21snmpd10:11:302
48799986,2cyclictest771-21snmpd07:28:522
48799986,2cyclictest749-21ntpd12:30:592
48799986,2cyclictest749-21ntpd12:29:292
48799986,2cyclictest749-21ntpd12:21:072
48799986,2cyclictest749-21ntpd11:55:242
48799986,2cyclictest749-21ntpd10:07:572
48799986,2cyclictest749-21ntpd09:10:082
48799986,2cyclictest749-21ntpd07:20:172
48799986,2cyclictest29069-21idleruntime-cro08:10:002
48759988,0cyclictest769-21lldpd12:01:361
48759988,0cyclictest769-21lldpd10:34:431
48759987,1cyclictest584-21in:imuxsock07:55:161
48759986,2cyclictest771-21snmpd12:22:121
48759986,2cyclictest771-21snmpd09:47:451
48759986,2cyclictest749-21ntpd10:55:171
48719988,0cyclictest771-21snmpd10:22:280
48719988,0cyclictest771-21snmpd09:48:540
48719988,0cyclictest769-21lldpd12:14:580
48719988,0cyclictest769-21lldpd12:00:100
48719988,0cyclictest769-21lldpd11:54:360
48719988,0cyclictest524-21avahi-daemon07:10:000
48719987,1cyclictest771-21snmpd12:21:360
48719987,1cyclictest771-21snmpd07:57:510
48719987,1cyclictest524-21avahi-daemon09:53:570
48719987,1cyclictest524-21avahi-daemon09:18:110
48719986,2cyclictest771-21snmpd09:56:550
48719986,2cyclictest771-21snmpd08:01:420
48799977,0cyclictest771-21snmpd11:29:492
48799977,0cyclictest771-21snmpd08:32:552
48799977,0cyclictest771-21snmpd08:16:302
48799977,0cyclictest769-21lldpd11:10:012
48799976,1cyclictest7591-21cpuspeed_turbos11:15:132
48799976,1cyclictest524-21avahi-daemon08:25:552
48799976,1cyclictest2083-21needreboot08:20:162
48799975,2cyclictest771-21snmpd11:30:132
48799975,2cyclictest771-21snmpd11:20:432
48799975,2cyclictest771-21snmpd10:40:232
48799975,2cyclictest771-21snmpd09:08:292
48799975,2cyclictest749-21ntpd12:16:592
48799975,2cyclictest749-21ntpd11:41:502
48799975,2cyclictest749-21ntpd10:35:272
48799975,2cyclictest749-21ntpd07:55:182
48799974,2cyclictest255-20systemd-journal09:52:572
48759977,0cyclictest771-21snmpd08:28:241
48759977,0cyclictest769-21lldpd07:16:481
48759976,1cyclictest524-21avahi-daemon09:22:551
48759976,1cyclictest29974-21fschecks_count08:10:151
48759975,2cyclictest771-21snmpd12:17:331
48759975,2cyclictest771-21snmpd08:56:101
48759975,2cyclictest749-21ntpd10:40:211
48759975,2cyclictest749-21ntpd10:14:361
48719977,0cyclictest771-21snmpd11:46:010
48719977,0cyclictest771-21snmpd09:08:050
48719977,0cyclictest771-21snmpd09:01:080
48719977,0cyclictest771-21snmpd08:22:490
48719977,0cyclictest769-21lldpd10:00:180
48719977,0cyclictest769-21lldpd09:42:160
48719977,0cyclictest769-21lldpd09:31:120
48719977,0cyclictest524-21avahi-daemon10:19:160
48719976,1cyclictest771-21snmpd11:44:490
48719976,1cyclictest771-21snmpd11:04:230
48719976,1cyclictest771-21snmpd10:58:540
48719976,1cyclictest771-21snmpd10:35:380
48719976,1cyclictest771-21snmpd07:24:230
48719976,1cyclictest524-21avahi-daemon07:52:530
48719976,1cyclictest3865-21pmu-power11:10:200
48719976,1cyclictest255-20systemd-journal08:31:240
48719976,1cyclictest22598-21cat09:10:140
48719975,2cyclictest771-21snmpd08:12:420
48719975,2cyclictest771-21snmpd07:33:290
48719973,3cyclictest255-20systemd-journal11:32:130
48719973,3cyclictest255-20systemd-journal10:51:140
48799966,0cyclictest771-21snmpd11:37:582
48799965,1cyclictest771-21snmpd12:35:542
48799965,1cyclictest749-21ntpd07:30:192
48799964,2cyclictest771-21snmpd09:40:322
48799964,2cyclictest771-21snmpd08:44:152
48799964,2cyclictest771-21snmpd08:35:222
48799964,2cyclictest749-21ntpd10:51:152
48799964,2cyclictest749-21ntpd09:46:252
48759966,0cyclictest769-21lldpd12:29:051
48759966,0cyclictest769-21lldpd07:49:181
48759966,0cyclictest769-21lldpd07:43:211
48759966,0cyclictest769-21lldpd07:32:021
48759965,1cyclictest771-21snmpd11:46:281
48759965,1cyclictest749-21ntpd10:02:111
48759965,1cyclictest749-21ntpd09:05:161
48759965,1cyclictest25881-21head11:35:151
48759964,2cyclictest749-21ntpd10:21:331
48759963,3cyclictest550-21NetworkManager12:10:291
48759963,3cyclictest11924-21seq07:25:161
48759963,2cyclictest5735-21cut07:10:151
48759962,3cyclictest1578-21df08:20:121
48719966,0cyclictest771-21snmpd08:26:430
48719966,0cyclictest769-21lldpd12:37:140
48719966,0cyclictest769-21lldpd11:19:580
48719966,0cyclictest16277-21sh12:00:000
48719965,1cyclictest771-21snmpd12:28:540
48719965,1cyclictest771-21snmpd11:36:430
48719965,1cyclictest771-21snmpd10:25:140
48719965,1cyclictest769-21lldpd08:05:130
48719965,1cyclictest4721-21unixbench_multi09:25:220
48719965,1cyclictest16399-21cat08:55:150
48719965,1cyclictest11849-21tail08:45:150
48719964,2cyclictest771-21snmpd07:27:310
48719962,3cyclictest17555-21fw_packets07:40:140
48719962,3cyclictest15588-21ssh09:38:420
48719962,3cyclictest11903-21ssh11:20:120
48719961,5cyclictest550-21NetworkManager08:54:180
48799954,1cyclictest749-21ntpd07:40:142
48799953,2cyclictest749-21ntpd08:10:212
48799952,2cyclictest19565-21gltestperf07:45:142
48759952,2cyclictest31059-21df_inode11:05:131
48719955,0cyclictest771-21snmpd07:49:360
48719954,1cyclictest524-21avahi-daemon07:35:250
48719954,1cyclictest15096-21cpuspeed_turbos12:30:140
48719952,3cyclictest16-21ksoftirqd/008:36:000
48719952,2cyclictest8210-21grep10:40:180
48719952,2cyclictest32476-21ssh11:05:370
48719952,2cyclictest255-20systemd-journal10:31:240
48719952,2cyclictest22134-21smartctl12:05:200
48719952,2cyclictest17244-21sh11:25:200
48719951,4cyclictest550-21NetworkManager07:19:390
48719951,3cyclictest31233-21ssh09:20:000
48719951,3cyclictest12917-21memory10:10:170
48719950,5cyclictest31815-21expr12:15:160
48799940,3cyclictest18296-21fw_conntrack09:00:152
48719941,3cyclictest32582-21ld08:15:180
48719941,2cyclictest7325-21apt-config10:05:010
48719941,2cyclictest12327-21grep10:45:150
48719940,3cyclictest9686-21diskstats08:40:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional