You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-27 - 05:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Wed Aug 27, 2025 00:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9193993030,0cyclictest13080-21fwupd23:39:020
9193992019,1cyclictest66850irq/125-lan20:48:550
9193992018,2cyclictest66850irq/125-lan20:40:120
9193991918,1cyclictest66850irq/125-lan23:25:180
9193991918,1cyclictest66850irq/125-lan22:00:200
9193991918,1cyclictest66850irq/125-lan21:15:210
9193991918,1cyclictest66850irq/125-lan21:05:000
9193991818,0cyclictest66850irq/125-lan23:06:090
9193991818,0cyclictest66850irq/125-lan22:05:130
9193991818,0cyclictest66850irq/125-lan21:33:540
9193991818,0cyclictest66850irq/125-lan21:24:120
9193991818,0cyclictest66850irq/125-lan19:36:310
9193991817,1cyclictest66850irq/125-lan23:51:310
9193991817,1cyclictest66850irq/125-lan23:15:230
9193991817,1cyclictest66850irq/125-lan23:14:060
9193991817,1cyclictest66850irq/125-lan22:53:150
9193991817,1cyclictest66850irq/125-lan22:32:540
9193991817,1cyclictest66850irq/125-lan21:55:150
9193991817,1cyclictest66850irq/125-lan21:49:330
9193991817,1cyclictest66850irq/125-lan21:42:570
9193991817,1cyclictest66850irq/125-lan20:12:290
9193991817,1cyclictest66850irq/125-lan00:27:250
9193991817,1cyclictest66850irq/125-lan00:10:190
9193991717,0cyclictest66850irq/125-lan23:42:440
9193991717,0cyclictest66850irq/125-lan23:00:180
9193991717,0cyclictest66850irq/125-lan22:35:590
9193991717,0cyclictest66850irq/125-lan22:18:100
9193991717,0cyclictest66850irq/125-lan22:10:120
9193991717,0cyclictest66850irq/125-lan20:55:200
9193991717,0cyclictest66850irq/125-lan00:33:020
9193991717,0cyclictest66850irq/125-lan00:05:320
9193991716,1cyclictest66850irq/125-lan23:45:270
9193991716,1cyclictest66850irq/125-lan22:56:010
9193991716,1cyclictest66850irq/125-lan22:40:430
9193991716,1cyclictest66850irq/125-lan21:50:160
9193991716,1cyclictest66850irq/125-lan21:25:190
9193991716,1cyclictest66850irq/125-lan21:00:140
9193991716,1cyclictest66850irq/125-lan20:50:170
9193991716,1cyclictest66850irq/125-lan20:35:230
9193991716,1cyclictest66850irq/125-lan20:20:000
9193991716,1cyclictest66850irq/125-lan19:45:190
9193991716,1cyclictest66850irq/125-lan00:22:270
9193991716,1cyclictest66850irq/125-lan00:18:390
9193991714,3cyclictest749-21ntpd00:00:130
9193991616,0cyclictest66850irq/125-lan22:25:070
9193991616,0cyclictest66850irq/125-lan21:35:000
9193991616,0cyclictest66850irq/125-lan21:11:340
9193991616,0cyclictest66850irq/125-lan20:01:350
9193991616,0cyclictest66850irq/125-lan19:55:230
9193991616,0cyclictest66850irq/125-lan19:15:140
9193991615,1cyclictest66850irq/125-lan23:55:150
9193991615,1cyclictest66850irq/125-lan23:24:390
9193991615,1cyclictest66850irq/125-lan22:45:460
9193991615,1cyclictest66850irq/125-lan22:20:320
9193991615,1cyclictest66850irq/125-lan20:15:150
9193991615,1cyclictest66850irq/125-lan19:50:150
9193991615,1cyclictest66850irq/125-lan19:40:170
9193991615,1cyclictest66850irq/125-lan00:35:420
9193991515,0cyclictest66850irq/125-lan23:32:080
9193991514,1cyclictest66850irq/125-lan19:32:280
9193991514,1cyclictest66850irq/125-lan19:25:140
9193991414,0cyclictest66850irq/125-lan20:05:240
9193991414,0cyclictest66850irq/125-lan19:20:210
9193991313,0cyclictest66850irq/125-lan20:30:140
9193991312,1cyclictest66850irq/125-lan20:25:170
9193991211,1cyclictest66850irq/125-lan19:10:150
92039998,1cyclictest771-21snmpd00:17:503
92039998,1cyclictest769-21lldpd19:15:143
91989998,1cyclictest771-21snmpd22:17:192
91989998,1cyclictest769-21lldpd23:36:132
91989998,1cyclictest769-21lldpd21:12:392
91989998,1cyclictest524-21avahi-daemon21:41:372
91959998,1cyclictest771-21snmpd19:14:481
91959998,1cyclictest769-21lldpd00:38:521
91959998,1cyclictest524-21avahi-daemon00:24:341
92039988,0cyclictest771-21snmpd23:58:353
92039988,0cyclictest771-21snmpd23:33:583
92039988,0cyclictest771-21snmpd23:11:513
92039988,0cyclictest771-21snmpd21:25:023
92039988,0cyclictest771-21snmpd21:08:533
92039988,0cyclictest771-21snmpd20:37:133
92039988,0cyclictest771-21snmpd19:23:073
92039988,0cyclictest769-21lldpd23:03:043
92039988,0cyclictest769-21lldpd22:56:323
92039988,0cyclictest769-21lldpd00:08:453
92039987,1cyclictest769-21lldpd22:25:163
92039987,1cyclictest524-21avahi-daemon23:09:353
92039987,1cyclictest524-21avahi-daemon00:25:383
92039987,1cyclictest517-21systemd-resolve21:44:113
92039987,1cyclictest517-21systemd-resolve19:40:203
92039986,2cyclictest771-21snmpd22:48:203
92039986,2cyclictest771-21snmpd22:41:143
92039986,2cyclictest771-21snmpd21:34:353
92039986,2cyclictest771-21snmpd21:20:233
92039986,2cyclictest771-21snmpd20:54:103
92039986,2cyclictest771-21snmpd00:39:423
91989988,0cyclictest771-21snmpd21:34:442
91989988,0cyclictest769-21lldpd22:28:422
91989988,0cyclictest769-21lldpd21:07:552
91989988,0cyclictest769-21lldpd19:18:342
91989987,1cyclictest524-21avahi-daemon20:15:232
91989986,2cyclictest771-21snmpd23:31:402
91989986,2cyclictest771-21snmpd21:55:372
91959988,0cyclictest771-21snmpd23:26:131
91959988,0cyclictest771-21snmpd22:10:161
91959988,0cyclictest769-21lldpd23:36:521
91959988,0cyclictest769-21lldpd22:50:581
91959988,0cyclictest769-21lldpd22:22:401
91959988,0cyclictest769-21lldpd20:53:531
91959988,0cyclictest769-21lldpd19:56:501
91959988,0cyclictest769-21lldpd19:17:501
91959987,1cyclictest771-21snmpd20:21:451
91959987,1cyclictest771-21snmpd19:44:351
91959987,1cyclictest771-21snmpd00:29:421
91959987,1cyclictest771-21snmpd00:05:381
91959987,1cyclictest524-21avahi-daemon23:02:591
91959987,1cyclictest3048-21cups-browsed00:00:051
91959986,2cyclictest771-21snmpd23:40:461
91959986,2cyclictest771-21snmpd21:27:091
91959986,2cyclictest771-21snmpd21:07:591
92039977,0cyclictest771-21snmpd21:12:563
92039977,0cyclictest771-21snmpd20:13:273
92039977,0cyclictest771-21snmpd19:25:153
92039977,0cyclictest769-21lldpd23:50:513
92039977,0cyclictest769-21lldpd23:47:533
92039977,0cyclictest769-21lldpd21:57:223
92039977,0cyclictest769-21lldpd21:39:563
92039977,0cyclictest769-21lldpd21:19:553
92039977,0cyclictest769-21lldpd20:56:313
92039977,0cyclictest769-21lldpd20:41:133
92039977,0cyclictest769-21lldpd20:05:083
92039977,0cyclictest769-21lldpd00:13:253
92039977,0cyclictest769-21lldpd00:04:033
92039976,1cyclictest769-21lldpd19:11:133
92039975,2cyclictest771-21snmpd19:37:023
92039973,4cyclictest550-21NetworkManager00:30:463
92039973,3cyclictest255-20systemd-journal22:31:393
91989977,0cyclictest771-21snmpd23:06:032
91989977,0cyclictest771-21snmpd23:04:002
91989977,0cyclictest771-21snmpd19:14:362
91989977,0cyclictest769-21lldpd23:25:282
91989977,0cyclictest769-21lldpd23:15:062
91989977,0cyclictest769-21lldpd22:35:542
91989977,0cyclictest769-21lldpd21:39:302
91989977,0cyclictest769-21lldpd19:42:342
91989977,0cyclictest769-21lldpd00:36:442
91989977,0cyclictest769-21lldpd00:01:472
91989976,1cyclictest771-21snmpd22:57:122
91989976,1cyclictest771-21snmpd22:47:202
91989976,1cyclictest771-21snmpd19:59:412
91989976,1cyclictest769-21lldpd19:45:242
91989976,1cyclictest524-21avahi-daemon21:24:052
91989975,2cyclictest771-21snmpd21:01:282
91989975,2cyclictest771-21snmpd20:36:342
91989974,3cyclictest771-21snmpd19:28:032
91959977,0cyclictest771-21snmpd23:45:221
91959977,0cyclictest771-21snmpd23:20:411
91959977,0cyclictest771-21snmpd20:28:581
91959977,0cyclictest769-21lldpd23:51:151
91959976,1cyclictest771-21snmpd23:19:421
91959976,1cyclictest771-21snmpd22:27:171
91959976,1cyclictest771-21snmpd00:13:291
91959976,1cyclictest769-21lldpd23:10:481
91959976,1cyclictest524-21avahi-daemon22:35:111
91959976,1cyclictest524-21avahi-daemon00:33:141
91959976,1cyclictest517-21systemd-resolve23:30:301
91959976,1cyclictest517-21systemd-resolve21:44:411
91959976,1cyclictest12023-21gltestperf20:35:201
91959975,2cyclictest771-21snmpd20:04:501
91959973,3cyclictest255-20systemd-journal21:52:011
92039966,0cyclictest771-21snmpd22:00:303
92039966,0cyclictest771-21snmpd19:32:493
92039966,0cyclictest524-21avahi-daemon20:33:233
92039965,1cyclictest771-21snmpd21:53:063
92039965,1cyclictest771-21snmpd00:24:363
92039965,1cyclictest517-21systemd-resolve23:35:063
92039965,1cyclictest26811-21cpuspeed_turbos23:20:183
92039964,2cyclictest550-21NetworkManager23:17:413
92039962,3cyclictest30466-21ssh21:45:323
92039962,3cyclictest24233-21fw_forwarded_lo19:45:163
92039960,6cyclictest28990-21apt22:50:133
91989965,1cyclictest8610-21cpuspeed_turbos21:25:142
91989965,1cyclictest524-21avahi-daemon00:06:562
91989965,1cyclictest517-21systemd-resolve00:16:482
91989965,1cyclictest30638-21cat23:55:152
91989965,1cyclictest1697-21cpuspeed_turbos20:10:162
91989965,1cyclictest16402-21cpuspeed_turbos23:10:182
91989965,1cyclictest10087-21gltestperf20:30:132
91989964,2cyclictest771-21snmpd23:53:052
91989964,2cyclictest771-21snmpd23:43:492
91989964,2cyclictest771-21snmpd22:31:532
91989964,2cyclictest771-21snmpd20:29:372
91989964,2cyclictest771-21snmpd00:12:112
91989964,2cyclictest27193-21cat23:20:202
91989963,3cyclictest550-21NetworkManager22:40:472
91989963,3cyclictest550-21NetworkManager21:54:252
91989963,2cyclictest586-21rs:main2
91989963,2cyclictest255-20systemd-journal22:53:272
91989962,3cyclictest32609-21ssh21:15:482
91989962,3cyclictest23057-21ssh22:10:292
91989961,2cyclictest17560-21cat20:49:592
91989960,5cyclictest32693-21ssh21:48:502
91959966,0cyclictest771-21snmpd20:47:091
91959966,0cyclictest769-21lldpd22:18:201
91959966,0cyclictest769-21lldpd20:14:411
91959965,1cyclictest524-21avahi-daemon22:34:091
91959965,1cyclictest19192-21fschecks_time21:35:171
91959964,2cyclictest771-21snmpd22:56:301
91959964,2cyclictest771-21snmpd20:06:001
91959964,2cyclictest771-21snmpd19:34:071
91959964,2cyclictest550-21NetworkManager22:44:171
91959964,2cyclictest22264-21cat21:00:151
91959963,3cyclictest550-21NetworkManager21:20:271
91959963,3cyclictest24039-21apt-get22:45:121
91959962,3cyclictest17382-21ssh00:15:351
92039954,1cyclictest524-21avahi-daemon20:23:143
92039954,1cyclictest0-21swapper/320:15:203
92039953,2cyclictest771-21snmpd21:02:523
92039953,2cyclictest550-21NetworkManager23:25:013
92039953,2cyclictest550-21NetworkManager22:06:293
92039952,3cyclictest550-21NetworkManager20:26:563
92039952,3cyclictest26137-21ssh22:14:573
92039952,3cyclictest25947-21apt-get19:50:133
92039952,2cyclictest27419-21grep22:15:173
92039952,2cyclictest1831-21ssh22:22:083
92039952,2cyclictest15628-21ssh22:35:313
92039951,3cyclictest17305-21ssh23:42:573
91989953,2cyclictest771-21snmpd22:20:492
91989953,2cyclictest771-21snmpd20:50:312
91989953,2cyclictest771-21snmpd00:20:292
91989952,3cyclictest771-21snmpd20:06:032
91989952,3cyclictest26984-21sensors_temp19:50:212
91989952,3cyclictest20819-21mailstats20:55:202
91989952,2cyclictest18269-21ssh22:05:472
91989951,3cyclictest13724-21fw_forwarded_lo19:20:142
91989950,4cyclictest20420-21ntpq23:45:232
91989950,4cyclictest15041-21grep20:40:212
91989950,2cyclictest2443750ssh00:25:042
91959955,0cyclictest771-21snmpd19:26:011
91959955,0cyclictest769-21lldpd20:30:261
91959954,1cyclictest13849-21gltestperf21:30:131
91959953,2cyclictest771-21snmpd19:53:291
91959953,2cyclictest586-21rs:main1
91959953,2cyclictest550-21NetworkManager22:07:011
91959953,1cyclictest5785-21kworker/u16:1+nfsiod21:15:101
91959952,3cyclictest550-21NetworkManager19:22:211
91959952,2cyclictest6909-21grep21:55:161
91959952,2cyclictest26923-21ssh21:10:191
91959952,2cyclictest255-20systemd-journal20:16:291
91959952,2cyclictest21108-21seq19:38:511
91959952,2cyclictest14861-21ssh23:08:301
91959951,3cyclictest29461-21memory21:45:151
91959950,4cyclictest20544-21ntpq20:55:171
92039943,1cyclictest0-21swapper/320:00:173
92039940,3cyclictest28792-21ntp_states19:55:183
92039940,3cyclictest15934-21diskstats20:45:163
91989942,2cyclictest5739-21grep20:20:142
91989942,2cyclictest5595-21kworker/u16:3+nfsiod22:00:062
91989941,2cyclictest30331-21grep20:00:152
91989941,2cyclictest19102-21seq19:33:542
91989940,4cyclictest20258-21ntpq19:35:192
91959941,2cyclictest29746-21apt-key23:55:001
91959941,2cyclictest14893-21grep20:40:211
91959940,4cyclictest11541-21ssh22:00:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional