You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 18:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Mon Dec 01, 2025 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2453992019,1cyclictest66850irq/125-lan12:05:521
2453991918,1cyclictest66850irq/125-lan11:45:191
2453991918,1cyclictest66850irq/125-lan10:00:181
2453991918,1cyclictest66850irq/125-lan09:23:491
2453991917,1cyclictest66850irq/125-lan10:36:141
2453991818,0cyclictest66850irq/125-lan11:56:561
2453991818,0cyclictest66850irq/125-lan10:47:311
2453991818,0cyclictest66850irq/125-lan09:43:491
2453991817,1cyclictest66850irq/125-lan12:25:221
2453991817,1cyclictest66850irq/125-lan12:20:211
2453991817,1cyclictest66850irq/125-lan12:16:451
2453991817,1cyclictest66850irq/125-lan12:11:291
2453991817,1cyclictest66850irq/125-lan11:11:041
2453991817,1cyclictest66850irq/125-lan11:00:321
2453991817,1cyclictest66850irq/125-lan10:51:131
2453991817,1cyclictest66850irq/125-lan10:31:551
2453991817,1cyclictest66850irq/125-lan10:16:331
2453991817,1cyclictest66850irq/125-lan09:50:301
2453991817,1cyclictest66850irq/125-lan09:25:471
2453991817,1cyclictest66850irq/125-lan08:40:221
2456991717,0cyclictest771-21snmpd09:56:222
2456991717,0cyclictest771-21snmpd08:33:192
2453991717,0cyclictest66850irq/125-lan11:23:261
2453991717,0cyclictest66850irq/125-lan10:42:141
2453991717,0cyclictest66850irq/125-lan09:45:581
2453991717,0cyclictest66850irq/125-lan07:50:591
2453991717,0cyclictest66850irq/125-lan07:35:201
2453991717,0cyclictest66850irq/125-lan07:20:201
2453991716,1cyclictest66850irq/125-lan12:35:211
2453991716,1cyclictest66850irq/125-lan12:30:131
2453991716,1cyclictest66850irq/125-lan11:40:221
2453991716,1cyclictest66850irq/125-lan11:15:231
2453991716,1cyclictest66850irq/125-lan11:05:191
2453991716,1cyclictest66850irq/125-lan10:55:481
2453991716,1cyclictest66850irq/125-lan10:24:051
2453991716,1cyclictest66850irq/125-lan10:10:001
2453991716,1cyclictest66850irq/125-lan10:08:131
2453991716,1cyclictest66850irq/125-lan09:36:201
2453991716,1cyclictest66850irq/125-lan09:31:161
2453991716,1cyclictest66850irq/125-lan09:18:021
2453991716,1cyclictest66850irq/125-lan09:12:081
2453991716,1cyclictest66850irq/125-lan08:35:241
2453991716,1cyclictest66850irq/125-lan07:55:141
2456991616,0cyclictest771-21snmpd12:10:222
2456991616,0cyclictest771-21snmpd11:48:312
2456991616,0cyclictest771-21snmpd09:36:022
2456991616,0cyclictest771-21snmpd07:38:012
2456991616,0cyclictest30506-21cat10:00:142
2453991616,0cyclictest66850irq/125-lan10:27:521
2453991616,0cyclictest66850irq/125-lan09:58:341
2453991616,0cyclictest66850irq/125-lan08:45:171
2453991616,0cyclictest66850irq/125-lan07:40:171
2453991616,0cyclictest66850irq/125-lan07:31:501
2453991615,1cyclictest66850irq/125-lan12:02:591
2453991615,1cyclictest66850irq/125-lan11:50:161
2453991615,1cyclictest66850irq/125-lan11:25:121
2453991615,1cyclictest66850irq/125-lan08:30:191
2453991615,1cyclictest66850irq/125-lan07:15:201
2456991515,0cyclictest771-21snmpd12:37:332
2456991515,0cyclictest771-21snmpd09:23:412
2456991515,0cyclictest771-21snmpd09:05:192
2456991515,0cyclictest771-21snmpd08:52:492
2456991515,0cyclictest18811-21cat11:00:162
2456991515,0cyclictest15727-21cat10:20:142
2456991515,0cyclictest15680-21cat07:40:132
2453991515,0cyclictest66850irq/125-lan11:36:521
2453991515,0cyclictest66850irq/125-lan09:06:491
2453991515,0cyclictest66850irq/125-lan08:57:051
2453991515,0cyclictest66850irq/125-lan08:50:111
2453991515,0cyclictest66850irq/125-lan08:15:381
2453991515,0cyclictest66850irq/125-lan07:26:501
2453991514,1cyclictest66850irq/125-lan11:30:171
2453991514,1cyclictest66850irq/125-lan08:20:211
2456991414,0cyclictest771-21snmpd10:41:352
2456991414,0cyclictest771-21snmpd09:46:572
2456991414,0cyclictest771-21snmpd08:55:382
2456991414,0cyclictest771-21snmpd07:24:392
2456991414,0cyclictest4157-21cat11:20:142
2453991413,1cyclictest66850irq/125-lan08:25:191
2453991413,1cyclictest66850irq/125-lan08:00:161
2453991313,0cyclictest66850irq/125-lan09:03:031
2456991211,1cyclictest749-21ntpd10:14:342
2453991212,0cyclictest66850irq/125-lan07:45:161
245099118,3cyclictest771-21snmpd10:27:550
245099118,3cyclictest771-21snmpd08:46:490
2453991010,0cyclictest66850irq/125-lan08:10:101
2453991010,0cyclictest66850irq/125-lan08:07:371
245099108,2cyclictest771-21snmpd10:22:110
245099107,3cyclictest771-21snmpd10:50:110
245099107,3cyclictest771-21snmpd08:04:030
245099107,3cyclictest769-21lldpd09:42:500
245099106,4cyclictest771-21snmpd11:26:540
245099106,4cyclictest771-21snmpd08:11:170
24609998,1cyclictest769-21lldpd09:46:053
24609998,1cyclictest769-21lldpd09:26:183
24569998,1cyclictest771-21snmpd12:01:322
24569998,1cyclictest524-21avahi-daemon10:06:552
24569996,3cyclictest749-21ntpd12:30:462
24539998,1cyclictest771-21snmpd07:10:451
24509997,2cyclictest517-21systemd-resolve09:25:560
24509996,3cyclictest769-21lldpd12:18:310
24509996,3cyclictest769-21lldpd12:02:290
24509994,2cyclictest771-21snmpd10:48:020
24509993,3cyclictest255-20systemd-journal11:23:350
24509993,3cyclictest255-20systemd-journal10:00:160
24509993,3cyclictest1402-21ssh11:16:420
24509993,2cyclictest28825-21ssh11:10:240
24509993,2cyclictest1336-21ssh12:25:520
24509993,2cyclictest13149-21ssh12:38:120
24509992,4cyclictest17091-21uniq12:10:130
24509992,3cyclictest550-21NetworkManager11:59:570
24509990,5cyclictest19116-21ntpq11:00:180
24509990,4cyclictest0-21swapper/011:52:450
24609988,0cyclictest771-21snmpd10:47:293
24609988,0cyclictest771-21snmpd07:31:443
24609988,0cyclictest771-21snmpd07:29:013
24609988,0cyclictest769-21lldpd10:57:283
24609988,0cyclictest769-21lldpd09:16:023
24609988,0cyclictest769-21lldpd08:35:173
24609987,1cyclictest771-21snmpd11:46:343
24609987,1cyclictest524-21avahi-daemon10:52:503
24609987,1cyclictest524-21avahi-daemon10:31:143
24609987,1cyclictest524-21avahi-daemon09:10:233
24609987,1cyclictest517-21systemd-resolve12:10:113
24609987,1cyclictest517-21systemd-resolve11:20:363
24609986,2cyclictest771-21snmpd11:55:253
24609986,2cyclictest771-21snmpd11:52:023
24609986,2cyclictest771-21snmpd08:21:393
24609986,2cyclictest771-21snmpd07:13:093
24609985,3cyclictest771-21snmpd10:15:403
24569988,0cyclictest771-21snmpd08:24:182
24569988,0cyclictest771-21snmpd07:49:302
24569988,0cyclictest769-21lldpd11:35:222
24569988,0cyclictest769-21lldpd09:31:022
24569987,1cyclictest771-21snmpd12:08:022
24569987,1cyclictest771-21snmpd07:59:292
24569987,1cyclictest524-21avahi-daemon11:59:032
24569987,1cyclictest524-21avahi-daemon10:38:212
24569986,2cyclictest771-21snmpd11:54:112
24569986,2cyclictest771-21snmpd08:08:502
24569986,2cyclictest771-21snmpd07:51:562
24569986,2cyclictest749-21ntpd12:29:092
24569986,2cyclictest749-21ntpd12:21:142
24569986,2cyclictest749-21ntpd12:15:242
24569986,2cyclictest749-21ntpd11:40:022
24569986,2cyclictest749-21ntpd11:25:322
24569986,2cyclictest749-21ntpd11:10:272
24569986,2cyclictest749-21ntpd11:06:042
24569986,2cyclictest749-21ntpd10:15:062
24569986,2cyclictest749-21ntpd09:41:012
24569986,2cyclictest749-21ntpd09:00:192
24569986,2cyclictest749-21ntpd07:25:182
24509988,0cyclictest769-21lldpd10:30:410
24509987,1cyclictest771-21snmpd10:37:440
24509987,1cyclictest771-21snmpd09:00:530
24509987,1cyclictest771-21snmpd07:42:430
24509987,1cyclictest769-21lldpd08:56:250
24509986,2cyclictest771-21snmpd11:07:210
24509986,2cyclictest771-21snmpd09:46:420
24509986,2cyclictest749-21ntpd09:33:110
24509986,2cyclictest749-21ntpd09:12:140
24509986,2cyclictest749-21ntpd08:54:160
24509986,2cyclictest749-21ntpd07:10:080
24509985,3cyclictest771-21snmpd11:33:370
24509983,2cyclictest771-21snmpd10:57:410
24509983,2cyclictest771-21snmpd07:46:410
24509982,3cyclictest550-21NetworkManager11:36:050
24509982,3cyclictest550-21NetworkManager09:15:350
24509982,2cyclictest550-21NetworkManager09:50:020
24509982,2cyclictest4574-21ssh10:07:170
24509982,2cyclictest30141-21ssh12:23:000
24509982,2cyclictest29409-21ssh09:22:140
24509982,2cyclictest26627-21df_inode11:45:140
24509980,4cyclictest5480-21ntpq07:15:170
24609977,0cyclictest771-21snmpd11:11:243
24609977,0cyclictest771-21snmpd10:27:083
24609977,0cyclictest769-21lldpd09:02:043
24609977,0cyclictest769-21lldpd08:33:323
24609977,0cyclictest769-21lldpd08:15:513
24609977,0cyclictest769-21lldpd07:16:443
24609976,1cyclictest771-21snmpd08:12:003
24609976,1cyclictest769-21lldpd10:03:593
24609976,1cyclictest524-21avahi-daemon10:37:213
24609976,1cyclictest524-21avahi-daemon09:41:423
24609975,2cyclictest771-21snmpd10:40:293
24609975,2cyclictest771-21snmpd10:24:163
24609975,2cyclictest771-21snmpd07:47:023
24609973,3cyclictest29743-21ssh12:22:263
24569977,0cyclictest771-21snmpd09:25:172
24569977,0cyclictest771-21snmpd08:40:522
24569976,1cyclictest771-21snmpd09:50:512
24569976,1cyclictest771-21snmpd09:15:142
24569976,1cyclictest749-21ntpd10:46:542
24569976,1cyclictest749-21ntpd10:28:182
24569976,1cyclictest10867-21cut08:50:002
24569975,2cyclictest771-21snmpd11:19:122
24569975,2cyclictest771-21snmpd08:03:062
24569975,2cyclictest771-21snmpd07:30:472
24569975,2cyclictest749-21ntpd10:33:282
24509977,0cyclictest769-21lldpd09:39:010
24509976,1cyclictest771-21snmpd07:34:410
24509976,1cyclictest769-21lldpd12:06:150
24509974,0cyclictest584-21in:imuxsock08:32:030
24509973,1cyclictest31829-21cat08:20:150
24509971,2cyclictest8954-21cat07:25:000
24509971,2cyclictest4571-21awk12:30:010
24609966,0cyclictest771-21snmpd12:29:563
24609966,0cyclictest771-21snmpd12:15:533
24609966,0cyclictest771-21snmpd07:54:323
24609966,0cyclictest769-21lldpd08:07:263
24609966,0cyclictest769-21lldpd07:57:093
24609966,0cyclictest2443-21cyclictest08:45:003
24609965,1cyclictest749-21ntpd11:30:393
24609965,1cyclictest524-21avahi-daemon11:16:133
24609965,1cyclictest517-21systemd-resolve11:01:413
24609965,1cyclictest511ktimers/309:50:053
24609963,3cyclictest1315-21fw_forwarded_lo08:25:143
24609962,3cyclictest30093-21ssh09:23:233
24609962,3cyclictest26243-21ntpq09:55:173
24609962,3cyclictest22851-21apt-get11:05:113
24609962,3cyclictest19593-21ssh11:36:413
24569966,0cyclictest517-21systemd-resolve08:29:292
24569965,1cyclictest524-21avahi-daemon07:10:082
24509965,1cyclictest771-21snmpd08:15:180
24509965,1cyclictest18930-21idleruntime-cro09:10:000
24509965,1cyclictest171ktimers/007:25:140
24509964,2cyclictest13612-21cat07:35:140
24509963,3cyclictest550-21NetworkManager10:40:170
24509963,3cyclictest255-20systemd-journal07:52:480
24509963,2cyclictest12590-21ssh10:15:580
24509963,0cyclictest18934-21diskmemload10:10:390
24509962,3cyclictest5067-21https08:35:140
24509960,3cyclictest22063-21ntpq07:55:180
24609955,0cyclictest769-21lldpd08:55:463
24609955,0cyclictest584-21in:imuxsock07:23:493
24609954,1cyclictest771-21snmpd07:44:373
24609954,1cyclictest11191-21cpuspeed_turbos08:50:113
24609954,1cyclictest0-21swapper/312:05:163
24609953,2cyclictest771-21snmpd07:37:583
24609953,2cyclictest550-21NetworkManager12:01:483
24609953,2cyclictest550-21NetworkManager11:25:053
24609952,3cyclictest8214-21ssh10:10:593
24609952,2cyclictest7529-21ssh12:32:073
24609952,2cyclictest23958-21ssh11:41:113
24609952,2cyclictest17771-21cat09:05:173
24609952,2cyclictest11770-21rm12:36:063
24609951,4cyclictest550-21NetworkManager10:05:293
24609951,3cyclictest7614-21apt09:35:113
24609951,3cyclictest3585-21diskstats09:30:123
24569955,0cyclictest771-21snmpd11:33:462
24569955,0cyclictest769-21lldpd08:15:032
24569953,2cyclictest771-21snmpd10:53:442
24569952,2cyclictest17791-21ssh10:59:392
24509954,1cyclictest771-21snmpd08:26:030
24509951,3cyclictest28542-21ssh09:58:050
24509950,4cyclictest22862-21ntpq11:40:180
24609943,1cyclictest0-21swapper/308:45:153
24609940,4cyclictest24054-21ntpq08:00:153
24569942,2cyclictest27670-21tail08:10:132
24569941,3cyclictest4646-21awk07:15:122
24569940,2cyclictest1136150kworker/u16:0+xprtiod09:10:092
24509941,3cyclictest7832-21ntpq08:40:150
24509940,3cyclictest25635-21fw_forwarded_lo08:05:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional