You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 23:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Fri May 02, 2025 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6142991918,1cyclictest65850irq/126-lan12:29:162
6142991918,1cyclictest65850irq/126-lan12:21:292
6142991918,1cyclictest65850irq/126-lan11:35:152
6142991918,1cyclictest65850irq/126-lan11:10:012
6142991918,1cyclictest65850irq/126-lan09:33:462
6142991818,0cyclictest65850irq/126-lan10:58:232
6142991818,0cyclictest65850irq/126-lan09:50:502
6142991818,0cyclictest65850irq/126-lan07:50:142
6142991817,1cyclictest65850irq/126-lan12:32:502
6142991817,1cyclictest65850irq/126-lan12:15:062
6142991817,1cyclictest65850irq/126-lan12:12:112
6142991817,1cyclictest65850irq/126-lan10:51:202
6142991817,1cyclictest65850irq/126-lan10:35:202
6142991817,1cyclictest65850irq/126-lan10:20:182
6142991817,1cyclictest65850irq/126-lan10:20:182
6142991817,1cyclictest65850irq/126-lan10:10:162
6142991817,1cyclictest65850irq/126-lan10:00:202
6142991817,1cyclictest65850irq/126-lan09:36:062
6142991817,1cyclictest65850irq/126-lan09:19:482
6142991817,1cyclictest65850irq/126-lan07:40:122
6142991717,0cyclictest65850irq/126-lan11:57:012
6142991717,0cyclictest65850irq/126-lan11:30:152
6142991717,0cyclictest65850irq/126-lan11:15:132
6142991717,0cyclictest65850irq/126-lan11:00:182
6142991717,0cyclictest65850irq/126-lan09:29:232
6142991717,0cyclictest65850irq/126-lan09:20:172
6142991717,0cyclictest65850irq/126-lan09:10:412
6142991717,0cyclictest65850irq/126-lan08:46:252
6142991717,0cyclictest65850irq/126-lan07:45:192
6142991716,1cyclictest65850irq/126-lan12:37:252
6142991716,1cyclictest65850irq/126-lan12:05:152
6142991716,1cyclictest65850irq/126-lan12:00:172
6142991716,1cyclictest65850irq/126-lan11:45:372
6142991716,1cyclictest65850irq/126-lan11:40:212
6142991716,1cyclictest65850irq/126-lan11:14:552
6142991716,1cyclictest65850irq/126-lan10:47:082
6142991716,1cyclictest65850irq/126-lan10:30:162
6142991716,1cyclictest65850irq/126-lan10:25:322
6142991716,1cyclictest65850irq/126-lan10:07:582
6142991716,1cyclictest65850irq/126-lan09:45:162
6142991716,1cyclictest65850irq/126-lan08:20:172
6142991616,0cyclictest65850irq/126-lan11:53:012
6142991616,0cyclictest65850irq/126-lan11:20:102
6142991616,0cyclictest65850irq/126-lan10:40:492
6142991616,0cyclictest65850irq/126-lan08:05:122
6142991616,0cyclictest65850irq/126-lan07:28:112
6142991616,0cyclictest65850irq/126-lan07:10:162
6142991615,1cyclictest65850irq/126-lan09:44:472
6142991615,1cyclictest65850irq/126-lan07:15:172
6142991515,0cyclictest65850irq/126-lan11:25:152
6142991514,1cyclictest65850irq/126-lan10:19:092
6142991414,0cyclictest65850irq/126-lan09:59:172
6142991414,0cyclictest65850irq/126-lan08:25:162
6142991413,1cyclictest65850irq/126-lan08:55:132
6142991413,1cyclictest65850irq/126-lan07:35:172
6142991313,0cyclictest65850irq/126-lan07:20:122
6142991312,1cyclictest65850irq/126-lan08:40:162
6142991312,1cyclictest65850irq/126-lan08:35:172
6142991312,1cyclictest65850irq/126-lan08:00:182
613299138,1cyclictest506-21avahi-daemon10:37:050
6142991211,1cyclictest65850irq/126-lan09:00:172
6142991211,1cyclictest65850irq/126-lan07:30:182
6142991110,1cyclictest65850irq/126-lan08:15:142
6142991110,1cyclictest65850irq/126-lan08:10:292
6142991010,0cyclictest65850irq/126-lan08:30:142
613299108,0cyclictest763-21lldpd11:41:190
613299107,1cyclictest506-21avahi-daemon07:47:590
61469998,1cyclictest765-21snmpd10:03:053
61469998,1cyclictest506-21avahi-daemon12:29:073
61469998,1cyclictest254-20systemd-journal12:00:213
61469996,2cyclictest765-21snmpd10:16:413
61429998,1cyclictest65850irq/126-lan08:50:112
61389998,1cyclictest765-21snmpd11:21:461
61389998,1cyclictest765-21snmpd08:46:031
61389998,1cyclictest765-21snmpd07:14:121
61329998,1cyclictest765-21snmpd08:31:110
61469988,0cyclictest765-21snmpd11:15:223
61469988,0cyclictest765-21snmpd07:18:363
61469988,0cyclictest763-21lldpd10:43:403
61469988,0cyclictest763-21lldpd09:47:013
61469988,0cyclictest763-21lldpd09:33:213
61469987,1cyclictest765-21snmpd10:27:203
61469987,1cyclictest763-21lldpd10:32:303
61469987,1cyclictest506-21avahi-daemon10:12:083
61469986,2cyclictest765-21snmpd11:58:173
61469986,2cyclictest765-21snmpd11:23:403
61469986,2cyclictest765-21snmpd09:51:253
61429988,0cyclictest65850irq/126-lan07:55:122
61389988,0cyclictest765-21snmpd12:22:571
61389988,0cyclictest765-21snmpd11:00:181
61389988,0cyclictest765-21snmpd10:07:591
61389988,0cyclictest765-21snmpd08:55:561
61389988,0cyclictest765-21snmpd08:24:201
61389988,0cyclictest765-21snmpd07:58:581
61389988,0cyclictest763-21lldpd11:08:151
61389988,0cyclictest763-21lldpd09:38:321
61389988,0cyclictest763-21lldpd08:35:261
61389987,1cyclictest765-21snmpd08:15:351
61389987,1cyclictest765-21snmpd07:51:001
61389987,1cyclictest765-21snmpd07:33:041
61389987,1cyclictest763-21lldpd07:23:141
61389987,1cyclictest20811-21sh10:00:011
61389986,2cyclictest765-21snmpd12:31:181
61389986,2cyclictest765-21snmpd09:11:531
61389983,5cyclictest530-21NetworkManager10:44:441
61329988,0cyclictest765-21snmpd10:27:280
61329988,0cyclictest765-21snmpd08:50:300
61329988,0cyclictest765-21snmpd07:58:150
61329988,0cyclictest765-21snmpd07:54:250
61329988,0cyclictest763-21lldpd11:56:010
61329988,0cyclictest763-21lldpd11:08:390
61329988,0cyclictest763-21lldpd09:56:280
61329988,0cyclictest763-21lldpd09:29:170
61329987,1cyclictest765-21snmpd12:27:210
61329987,1cyclictest765-21snmpd09:41:190
61329987,1cyclictest765-21snmpd08:36:050
61329987,1cyclictest763-21lldpd07:36:270
61329987,1cyclictest506-21avahi-daemon11:34:390
61329986,2cyclictest765-21snmpd12:06:530
61329986,2cyclictest765-21snmpd11:10:160
61329986,2cyclictest765-21snmpd09:05:210
61469977,0cyclictest763-21lldpd09:58:153
61469976,1cyclictest765-21snmpd10:38:063
61469976,1cyclictest765-21snmpd08:47:303
61469976,1cyclictest765-21snmpd08:10:053
61469976,1cyclictest506-21avahi-daemon12:19:223
61469976,1cyclictest506-21avahi-daemon11:44:103
61469976,1cyclictest506-21avahi-daemon10:24:033
61469976,1cyclictest506-21avahi-daemon10:24:033
61469976,1cyclictest506-21avahi-daemon08:35:163
61469975,2cyclictest765-21snmpd12:32:203
61469975,2cyclictest765-21snmpd11:50:143
61469975,2cyclictest765-21snmpd09:00:423
61469975,2cyclictest765-21snmpd07:44:433
61469975,2cyclictest765-21snmpd07:30:163
61469975,2cyclictest765-21snmpd07:28:043
61469975,2cyclictest739-21ntpd12:10:163
61469975,2cyclictest739-21ntpd07:50:133
61469973,3cyclictest3646-21ssh12:09:183
61469973,3cyclictest15139-21ssh11:12:223
61469972,5cyclictest530-21NetworkManager09:12:233
61389977,0cyclictest765-21snmpd08:12:341
61389977,0cyclictest765-21snmpd07:16:361
61389977,0cyclictest763-21lldpd12:02:431
61389977,0cyclictest763-21lldpd11:51:531
61389977,0cyclictest763-21lldpd11:40:571
61389977,0cyclictest763-21lldpd10:56:581
61389977,0cyclictest763-21lldpd10:47:201
61389977,0cyclictest763-21lldpd09:28:181
61389977,0cyclictest763-21lldpd09:01:111
61389976,1cyclictest765-21snmpd12:35:481
61389976,1cyclictest506-21avahi-daemon12:11:031
61389976,1cyclictest506-21avahi-daemon10:11:571
61389976,1cyclictest499-21systemd-resolve11:34:031
61389975,2cyclictest765-21snmpd10:51:091
61389975,2cyclictest765-21snmpd09:22:161
61389975,2cyclictest765-21snmpd08:27:311
61389973,3cyclictest13180-21ssh11:10:101
61389972,5cyclictest530-21NetworkManager08:30:391
61329977,0cyclictest765-21snmpd10:55:090
61329977,0cyclictest765-21snmpd08:11:100
61329977,0cyclictest765-21snmpd07:31:220
61329977,0cyclictest763-21lldpd11:16:500
61329977,0cyclictest763-21lldpd09:12:540
61329977,0cyclictest763-21lldpd08:46:410
61329977,0cyclictest763-21lldpd08:42:390
61329977,0cyclictest506-21avahi-daemon10:47:030
61329976,1cyclictest765-21snmpd10:43:570
61329976,1cyclictest765-21snmpd10:34:290
61329976,1cyclictest506-21avahi-daemon12:14:030
61329976,1cyclictest506-21avahi-daemon10:53:330
61329976,1cyclictest506-21avahi-daemon10:08:270
61329976,1cyclictest506-21avahi-daemon09:00:380
61329976,1cyclictest17038-21needreboot07:40:140
61329973,3cyclictest254-20systemd-journal10:24:470
61329973,3cyclictest254-20systemd-journal10:24:470
61469966,0cyclictest765-21snmpd07:22:083
61469966,0cyclictest763-21lldpd11:47:133
61469965,1cyclictest9930-21needreboot11:05:173
61469965,1cyclictest506-21avahi-daemon08:34:353
61469965,1cyclictest24896-21cpuspeed_turbos10:05:143
61469964,2cyclictest765-21snmpd11:34:523
61469964,2cyclictest765-21snmpd08:40:563
61469964,2cyclictest765-21snmpd08:09:253
61469963,2cyclictest765-21snmpd11:27:433
61469963,2cyclictest3691-21ssh09:37:103
61469962,3cyclictest32509-21ssh12:35:243
61469962,3cyclictest22561-21idleruntime-cro09:20:013
61429966,0cyclictest765-21snmpd09:08:182
61389966,0cyclictest765-21snmpd10:04:351
61389966,0cyclictest765-21snmpd07:45:101
61389966,0cyclictest763-21lldpd07:28:331
61389965,1cyclictest765-21snmpd08:05:271
61389965,1cyclictest506-21avahi-daemon11:45:451
61389965,1cyclictest506-21avahi-daemon10:28:361
61389964,2cyclictest765-21snmpd12:19:151
61389963,2cyclictest554-21rs:main1
61389963,2cyclictest554-21rs:main1
61389963,2cyclictest10901-21ssh09:46:311
61389961,4cyclictest13462-21strings10:30:181
61329966,0cyclictest765-21snmpd12:16:060
61329966,0cyclictest763-21lldpd12:39:400
61329966,0cyclictest506-21avahi-daemon11:49:040
61329966,0cyclictest506-21avahi-daemon08:16:350
61329966,0cyclictest499-21systemd-resolve10:13:010
61329965,1cyclictest765-21snmpd08:07:140
61329965,1cyclictest506-21avahi-daemon11:53:260
61329965,1cyclictest506-21avahi-daemon09:45:010
61329965,1cyclictest23055-21fschecks_count09:20:140
61329964,2cyclictest765-21snmpd11:36:490
61329964,2cyclictest765-21snmpd09:53:520
61329963,2cyclictest765-21snmpd12:20:300
61329963,2cyclictest27103-21ntpq12:00:170
61329963,2cyclictest25794-21ssh12:30:020
61329962,3cyclictest254-20systemd-journal10:00:080
61329962,3cyclictest22118-21ntp_states11:20:150
61329962,3cyclictest21916-21ssh09:18:550
61469953,2cyclictest765-21snmpd11:35:283
61469953,2cyclictest765-21snmpd08:02:493
61469953,2cyclictest739-21ntpd08:25:073
61469953,2cyclictest739-21ntpd08:24:283
61469953,2cyclictest15412-21ntpq07:35:203
61469952,3cyclictest530-21NetworkManager09:40:153
61469952,3cyclictest254-20systemd-journal09:27:113
61469952,2cyclictest554-21rs:main3
61469952,2cyclictest5488-21df11:00:133
61469952,2cyclictest530-21NetworkManager10:55:073
61469951,3cyclictest6560-21grep07:10:153
61469951,3cyclictest16915-21sh12:21:003
61389955,0cyclictest765-21snmpd08:50:151
61389955,0cyclictest506-21avahi-daemon09:08:281
61389954,1cyclictest763-21lldpd08:00:301
61389954,1cyclictest17139-21ntpq07:40:161
61389954,1cyclictest1243-21hddtemp_smartct10:15:161
61389953,2cyclictest765-21snmpd11:36:371
61389953,2cyclictest765-21snmpd10:20:171
61389953,2cyclictest765-21snmpd10:20:171
61389952,2cyclictest554-21rs:main1
61389952,2cyclictest5382-21ls09:40:131
61389952,2cyclictest26451-21ntpq11:25:201
61389951,3cyclictest30440-21perl09:30:171
61389951,3cyclictest21368-21fw_forwarded_lo11:55:151
61389950,4cyclictest16946-21ssh10:35:141
61329954,1cyclictest506-21avahi-daemon07:28:000
61329954,1cyclictest30498-21cpuspeed_turbos08:20:160
61329953,2cyclictest8734-21ntp_states07:15:170
61329952,3cyclictest10000-21fw_forwarded_lo07:20:130
61329952,2cyclictest6046-21ld11:00:170
61329952,2cyclictest3649-21ssh10:18:200
61329952,2cyclictest31279-21ssh09:30:310
61329952,2cyclictest26299-21ssh11:25:180
61329952,2cyclictest1560-21ssh09:35:080
61469943,1cyclictest8852-21collect208:50:163
61469943,1cyclictest0-21swapper/309:05:143
61469941,3cyclictest18331-21df_inode07:45:173
61469940,3cyclictest9960-21diskstats08:55:153
61469940,3cyclictest29948-21grep10:50:133
61469940,3cyclictest22152-21diskstats07:55:163
61389942,2cyclictest765-21snmpd08:41:041
61389941,2cyclictest20938-21gltestperf12:25:161
61389941,2cyclictest17031-21rm11:15:061
61389941,2cyclictest15503-21cut07:35:211
61329943,1cyclictest171ktimers/008:25:140
61329943,1cyclictest0-21swapper/008:00:150
61329941,2cyclictest6404-21ls07:10:140
61329940,2cyclictest0-21swapper/008:55:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional