You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-09 - 07:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Fri May 09, 2025 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27598992019,1cyclictest65850irq/126-lan21:30:381
27598991918,1cyclictest65850irq/126-lan22:33:271
27598991918,1cyclictest65850irq/126-lan22:25:151
27598991918,1cyclictest65850irq/126-lan21:15:181
27598991918,1cyclictest65850irq/126-lan00:30:121
27598991918,1cyclictest65850irq/126-lan00:05:031
27598991918,1cyclictest65850irq/126-lan00:02:161
27598991818,0cyclictest65850irq/126-lan23:45:551
27598991818,0cyclictest65850irq/126-lan22:47:071
27598991818,0cyclictest65850irq/126-lan22:02:051
27598991818,0cyclictest65850irq/126-lan21:27:441
27598991818,0cyclictest65850irq/126-lan19:25:001
27598991817,1cyclictest65850irq/126-lan23:22:031
27598991817,1cyclictest65850irq/126-lan23:15:111
27598991817,1cyclictest65850irq/126-lan23:10:141
27598991817,1cyclictest65850irq/126-lan22:57:441
27598991817,1cyclictest65850irq/126-lan22:05:151
27598991817,1cyclictest65850irq/126-lan21:49:541
27598991817,1cyclictest65850irq/126-lan21:35:151
27598991817,1cyclictest65850irq/126-lan00:36:021
27598991817,1cyclictest65850irq/126-lan00:20:171
27598991816,2cyclictest65850irq/126-lan21:50:151
27598991717,0cyclictest65850irq/126-lan22:15:211
27598991717,0cyclictest65850irq/126-lan21:21:511
27598991717,0cyclictest65850irq/126-lan21:00:131
27598991716,1cyclictest65850irq/126-lan23:56:491
27598991716,1cyclictest65850irq/126-lan23:40:181
27598991716,1cyclictest65850irq/126-lan23:37:541
27598991716,1cyclictest65850irq/126-lan23:25:201
27598991716,1cyclictest65850irq/126-lan23:00:291
27598991716,1cyclictest65850irq/126-lan22:50:191
27598991716,1cyclictest65850irq/126-lan22:40:231
27598991716,1cyclictest65850irq/126-lan22:37:391
27598991716,1cyclictest65850irq/126-lan21:10:191
27598991716,1cyclictest65850irq/126-lan20:50:151
27598991716,1cyclictest65850irq/126-lan19:30:151
27598991716,1cyclictest65850irq/126-lan00:15:531
27598991616,0cyclictest65850irq/126-lan20:10:151
27598991616,0cyclictest65850irq/126-lan00:25:131
27598991616,0cyclictest65850irq/126-lan00:10:191
27598991615,1cyclictest65850irq/126-lan23:52:581
27598991615,1cyclictest65850irq/126-lan23:05:301
27598991615,1cyclictest65850irq/126-lan22:22:121
27598991615,1cyclictest65850irq/126-lan21:56:461
27598991615,1cyclictest65850irq/126-lan21:40:291
27598991615,1cyclictest65850irq/126-lan20:00:111
27594991615,1cyclictest6633-21kworker/0:2+events22:28:200
27607991515,0cyclictest765-21snmpd19:56:143
27607991515,0cyclictest765-21snmpd00:31:063
27607991515,0cyclictest739-21ntpd20:30:173
27598991515,0cyclictest65850irq/126-lan22:10:311
27598991515,0cyclictest65850irq/126-lan20:16:111
27598991515,0cyclictest65850irq/126-lan19:15:141
27598991514,1cyclictest65850irq/126-lan23:30:231
27607991414,0cyclictest765-21snmpd22:40:303
27607991414,0cyclictest765-21snmpd22:16:403
27607991414,0cyclictest765-21snmpd22:02:123
27607991414,0cyclictest765-21snmpd19:30:523
27607991414,0cyclictest739-21ntpd23:39:593
27607991414,0cyclictest739-21ntpd23:23:253
27607991414,0cyclictest2632-21cat21:45:143
27607991414,0cyclictest11137-21cat21:55:133
27607991413,1cyclictest765-21snmpd21:09:173
27598991414,0cyclictest65850irq/126-lan20:08:121
27598991414,0cyclictest65850irq/126-lan19:20:101
27598991413,1cyclictest65850irq/126-lan20:35:131
27598991413,1cyclictest65850irq/126-lan19:48:241
27607991313,0cyclictest765-21snmpd23:15:553
27607991313,0cyclictest765-21snmpd22:50:083
27607991313,0cyclictest765-21snmpd20:13:483
27607991313,0cyclictest765-21snmpd19:26:343
27607991313,0cyclictest765-21snmpd00:22:243
27607991313,0cyclictest765-21snmpd00:01:353
27607991313,0cyclictest739-21ntpd21:53:543
27607991313,0cyclictest739-21ntpd21:40:143
27607991313,0cyclictest739-21ntpd21:24:323
27607991313,0cyclictest3606-21cat23:00:153
27607991313,0cyclictest18216-21cat21:25:193
27598991313,0cyclictest65850irq/126-lan21:05:131
27598991313,0cyclictest65850irq/126-lan20:25:181
27598991313,0cyclictest65850irq/126-lan20:25:171
27598991313,0cyclictest65850irq/126-lan19:41:121
27598991313,0cyclictest65850irq/126-lan19:35:151
27607991212,0cyclictest765-21snmpd22:47:143
27607991212,0cyclictest765-21snmpd21:35:153
27607991212,0cyclictest765-21snmpd21:32:293
27607991212,0cyclictest765-21snmpd20:29:043
27607991212,0cyclictest765-21snmpd20:29:033
27607991212,0cyclictest765-21snmpd20:20:193
27607991212,0cyclictest765-21snmpd19:42:233
27607991212,0cyclictest739-21ntpd00:05:113
27598991212,0cyclictest65850irq/126-lan20:45:151
27598991212,0cyclictest65850irq/126-lan19:55:121
27598991212,0cyclictest65850irq/126-lan19:50:101
27598991111,0cyclictest65850irq/126-lan20:20:131
27598991110,1cyclictest65850irq/126-lan19:10:141
276079999,0cyclictest765-21snmpd21:16:083
276079998,1cyclictest765-21snmpd22:20:493
275989998,1cyclictest65850irq/126-lan20:55:171
275989998,1cyclictest65850irq/126-lan20:30:161
275949998,1cyclictest765-21snmpd20:45:190
275949998,1cyclictest765-21snmpd20:30:210
275949998,1cyclictest765-21snmpd00:06:530
275949998,1cyclictest506-21avahi-daemon23:14:350
276079988,0cyclictest765-21snmpd22:26:563
276079988,0cyclictest763-21lldpd23:34:063
276079988,0cyclictest763-21lldpd23:11:113
276079988,0cyclictest763-21lldpd22:06:443
276079987,1cyclictest765-21snmpd20:51:263
276079987,1cyclictest499-21systemd-resolve22:39:053
276079987,1cyclictest499-21systemd-resolve20:15:193
276079986,2cyclictest765-21snmpd23:59:083
276079986,2cyclictest765-21snmpd23:51:343
276079985,2cyclictest765-21snmpd23:09:143
276039988,0cyclictest765-21snmpd23:25:582
276039988,0cyclictest765-21snmpd22:15:432
276039988,0cyclictest763-21lldpd23:58:292
276039988,0cyclictest763-21lldpd23:45:202
276039988,0cyclictest763-21lldpd23:14:392
276039988,0cyclictest763-21lldpd22:43:432
276039988,0cyclictest763-21lldpd22:03:512
276039988,0cyclictest763-21lldpd21:30:232
276039988,0cyclictest763-21lldpd19:11:452
276039988,0cyclictest763-21lldpd00:12:052
276039988,0cyclictest763-21lldpd00:09:302
276039988,0cyclictest763-21lldpd00:01:062
276039987,1cyclictest765-21snmpd23:50:162
276039987,1cyclictest763-21lldpd20:26:592
276039987,1cyclictest763-21lldpd20:26:582
276039987,1cyclictest19808-21cut22:05:142
276039986,2cyclictest765-21snmpd23:19:042
276039986,2cyclictest765-21snmpd20:18:122
276039986,2cyclictest765-21snmpd20:03:082
275949988,0cyclictest765-21snmpd22:54:560
275949988,0cyclictest763-21lldpd23:56:010
275949988,0cyclictest763-21lldpd23:20:430
275949988,0cyclictest763-21lldpd20:39:470
275949987,1cyclictest765-21snmpd22:59:080
275949987,1cyclictest765-21snmpd20:01:020
275949987,1cyclictest765-21snmpd00:35:510
275949987,1cyclictest763-21lldpd19:49:550
275949987,1cyclictest506-21avahi-daemon22:36:230
275949987,1cyclictest506-21avahi-daemon21:26:470
275949987,1cyclictest506-21avahi-daemon20:50:190
275949987,1cyclictest506-21avahi-daemon20:15:150
275949987,1cyclictest506-21avahi-daemon00:33:240
275949987,1cyclictest506-21avahi-daemon00:25:460
275949986,2cyclictest765-21snmpd20:08:270
275949986,2cyclictest765-21snmpd19:44:120
275949986,2cyclictest32488-21cat20:55:170
276079977,0cyclictest765-21snmpd22:57:543
276079977,0cyclictest765-21snmpd22:31:523
276079977,0cyclictest765-21snmpd21:10:313
276079977,0cyclictest765-21snmpd19:50:393
276079976,1cyclictest506-21avahi-daemon00:12:463
276079976,1cyclictest27141-21fschecks_count20:40:123
276079976,1cyclictest25699-21head23:25:233
276079975,2cyclictest765-21snmpd19:39:093
276079973,3cyclictest2169-21ssh00:15:373
276039977,0cyclictest765-21snmpd23:23:482
276039977,0cyclictest765-21snmpd21:39:512
276039977,0cyclictest765-21snmpd20:54:232
276039977,0cyclictest765-21snmpd19:48:562
276039977,0cyclictest763-21lldpd22:25:112
276039977,0cyclictest763-21lldpd22:23:562
276039977,0cyclictest763-21lldpd21:57:342
276039977,0cyclictest763-21lldpd21:46:372
276039977,0cyclictest763-21lldpd21:26:082
276039977,0cyclictest763-21lldpd20:14:242
276039976,1cyclictest765-21snmpd20:49:222
276039976,1cyclictest765-21snmpd00:25:202
276039976,1cyclictest506-21avahi-daemon20:39:542
276039975,2cyclictest765-21snmpd23:01:212
276039975,2cyclictest765-21snmpd22:39:252
276039975,2cyclictest765-21snmpd20:55:222
276039975,2cyclictest765-21snmpd20:22:242
275949977,0cyclictest765-21snmpd23:16:520
275949977,0cyclictest763-21lldpd22:03:460
275949977,0cyclictest763-21lldpd21:20:370
275949977,0cyclictest506-21avahi-daemon21:06:370
275949976,1cyclictest763-21lldpd19:22:510
275949976,1cyclictest506-21avahi-daemon23:40:080
275949976,1cyclictest506-21avahi-daemon22:31:140
275949975,2cyclictest765-21snmpd21:57:040
275949975,2cyclictest765-21snmpd21:30:380
275949975,2cyclictest765-21snmpd19:35:200
275949974,2cyclictest254-20systemd-journal21:51:120
276079966,0cyclictest763-21lldpd21:01:083
276079966,0cyclictest763-21lldpd20:56:583
276079966,0cyclictest763-21lldpd20:46:203
276079965,1cyclictest765-21snmpd19:21:563
276079965,1cyclictest765-21snmpd00:38:303
276079964,2cyclictest765-21snmpd19:14:373
276079963,3cyclictest530-21NetworkManager20:05:173
276039966,0cyclictest765-21snmpd00:21:272
276039966,0cyclictest765-21snmpd00:16:002
276039966,0cyclictest763-21lldpd19:24:182
276039966,0cyclictest763-21lldpd19:15:512
276039966,0cyclictest506-21avahi-daemon19:25:442
276039965,1cyclictest765-21snmpd22:48:362
276039965,1cyclictest765-21snmpd20:06:282
276039965,1cyclictest765-21snmpd19:30:342
276039965,1cyclictest763-21lldpd22:51:242
276039965,1cyclictest7162-21ntp_kernel_pll_21:50:192
276039965,1cyclictest499-21systemd-resolve23:39:582
276039965,1cyclictest499-21systemd-resolve23:33:152
276039963,3cyclictest530-21NetworkManager21:43:532
276039962,3cyclictest4981-21apt-get23:40:122
276039962,3cyclictest4815-21df_inode19:35:142
276039962,3cyclictest24022-21fw_conntrack22:10:142
276039962,3cyclictest11521-21ssh22:32:172
275949966,0cyclictest765-21snmpd22:11:050
275949966,0cyclictest765-21snmpd20:42:050
275949966,0cyclictest765-21snmpd19:16:310
275949965,1cyclictest765-21snmpd23:38:560
275949965,1cyclictest765-21snmpd22:41:290
275949965,1cyclictest765-21snmpd21:43:550
275949965,1cyclictest765-21snmpd21:13:390
275949965,1cyclictest763-21lldpd21:17:180
275949965,1cyclictest26380-21fschecks_count21:35:130
275949965,0cyclictest0-21swapper/023:30:240
275949964,2cyclictest765-21snmpd19:55:300
275949964,2cyclictest765-21snmpd00:17:360
275949963,3cyclictest530-21NetworkManager22:47:020
275949963,3cyclictest530-21NetworkManager20:20:170
275949963,3cyclictest530-21NetworkManager00:00:530
275949963,2cyclictest27119-21ssh23:27:460
275949963,2cyclictest254-20systemd-journal19:10:130
275949963,2cyclictest254-20systemd-journal00:20:130
275949963,2cyclictest254-20systemd-journal00:12:040
275949962,3cyclictest7814-21grep23:05:140
275949962,3cyclictest3893-21ssh21:46:190
275949960,5cyclictest21555-21ssh22:06:580
276079955,0cyclictest765-21snmpd23:40:023
276079955,0cyclictest765-21snmpd19:15:073
276079953,2cyclictest765-21snmpd22:10:043
276079953,2cyclictest765-21snmpd20:04:113
276079953,2cyclictest530-21NetworkManager23:45:413
276079953,2cyclictest530-21NetworkManager00:29:203
276079952,2cyclictest554-21rs:main3
276039954,1cyclictest765-21snmpd21:00:252
276039953,2cyclictest765-21snmpd19:56:062
276039953,2cyclictest3704-21ntpq21:05:182
276039953,2cyclictest14072-21grep21:20:182
276039952,3cyclictest530-21NetworkManager00:35:552
276039952,3cyclictest1721-21sshd22:58:192
276039952,2cyclictest9877-21ntpq21:15:162
276039952,2cyclictest27465-21uname20:40:142
276039952,2cyclictest254-20systemd-journal21:12:482
276039952,2cyclictest24227-21ld20:30:172
276039952,2cyclictest14087-21rm00:31:582
275949955,0cyclictest506-21avahi-daemon19:33:520
275949955,0cyclictest0-21swapper/020:13:250
275949954,1cyclictest763-21lldpd21:01:480
275949953,2cyclictest739-21ntpd23:00:150
275949952,3cyclictest530-21NetworkManager23:47:110
275949952,2cyclictest9994-21cat19:50:110
275949952,2cyclictest28990-21awk22:15:210
275949952,2cyclictest16870-21ssh23:54:130
275949951,3cyclictest1488-21sed22:20:170
275949950,3cyclictest23329-21munin-run20:30:010
275949950,3cyclictest23329-21munin-run20:30:000
276079940,3cyclictest25842-21ntp_192.168.11420:35:143
276039943,1cyclictest10328-21ntpq19:50:152
276039941,3cyclictest7731-21cut23:05:142
276039941,2cyclictest6336-21cat19:40:102
275989940,3cyclictest27559-21ntpq20:40:141
275949940,4cyclictest1460-21ntpq19:25:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional