You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-31 - 11:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Fri Jul 31, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18743992019,1cyclictest65850irq/126-lan20:20:210
18743991918,1cyclictest65850irq/126-lan21:22:050
18743991818,0cyclictest65850irq/126-lan23:05:220
18743991817,1cyclictest65850irq/126-lan23:15:160
18743991817,1cyclictest65850irq/126-lan22:40:150
18743991817,1cyclictest65850irq/126-lan22:25:130
18743991817,1cyclictest65850irq/126-lan22:21:410
18743991817,1cyclictest65850irq/126-lan21:56:510
18743991817,1cyclictest65850irq/126-lan21:26:180
18743991717,0cyclictest65850irq/126-lan20:50:140
18743991717,0cyclictest65850irq/126-lan19:45:130
18743991716,1cyclictest65850irq/126-lan22:10:130
18743991716,1cyclictest65850irq/126-lan22:05:120
18743991716,1cyclictest65850irq/126-lan21:05:130
18743991716,1cyclictest65850irq/126-lan20:50:010
18743991716,1cyclictest65850irq/126-lan19:25:180
18743991716,1cyclictest65850irq/126-lan19:15:170
18743991616,0cyclictest65850irq/126-lan23:30:510
18743991616,0cyclictest65850irq/126-lan23:25:000
18743991616,0cyclictest65850irq/126-lan22:55:130
18743991616,0cyclictest65850irq/126-lan21:35:220
18743991616,0cyclictest65850irq/126-lan00:35:200
18743991615,1cyclictest65850irq/126-lan23:50:200
18743991615,1cyclictest65850irq/126-lan20:55:130
18743991615,1cyclictest65850irq/126-lan20:40:000
18743991615,1cyclictest65850irq/126-lan20:29:120
18743991615,1cyclictest65850irq/126-lan20:00:210
18743991615,1cyclictest65850irq/126-lan19:50:160
18750991515,0cyclictest743-21snmpd21:25:351
18743991515,0cyclictest65850irq/126-lan23:20:100
18743991515,0cyclictest65850irq/126-lan22:15:150
18743991515,0cyclictest65850irq/126-lan20:30:110
18743991515,0cyclictest65850irq/126-lan20:17:120
18743991515,0cyclictest65850irq/126-lan20:06:120
18743991514,1cyclictest65850irq/126-lan23:55:160
18743991514,1cyclictest65850irq/126-lan23:45:170
18743991514,1cyclictest65850irq/126-lan23:40:210
18743991514,1cyclictest65850irq/126-lan23:39:590
18743991514,1cyclictest65850irq/126-lan22:00:130
18743991514,1cyclictest65850irq/126-lan21:15:190
18743991514,1cyclictest65850irq/126-lan20:40:160
18743991514,1cyclictest65850irq/126-lan19:55:210
18743991514,1cyclictest65850irq/126-lan19:30:190
18743991514,1cyclictest65850irq/126-lan19:20:110
18761991414,0cyclictest743-21snmpd20:32:573
18750991414,0cyclictest743-21snmpd23:01:001
18750991414,0cyclictest743-21snmpd22:19:561
18750991414,0cyclictest743-21snmpd21:37:391
18750991414,0cyclictest743-21snmpd19:19:071
18750991414,0cyclictest743-21snmpd19:10:041
18750991414,0cyclictest25042-21cat20:40:131
18750991414,0cyclictest1949-21cat19:45:141
18750991414,0cyclictest18133-21cat20:25:141
18750991414,0cyclictest1473-21cat22:20:131
18743991414,0cyclictest65850irq/126-lan22:45:200
18743991414,0cyclictest65850irq/126-lan22:30:120
18743991414,0cyclictest65850irq/126-lan22:30:110
18743991414,0cyclictest65850irq/126-lan21:45:150
18743991414,0cyclictest65850irq/126-lan00:27:260
18743991413,1cyclictest65850irq/126-lan21:30:150
18743991413,1cyclictest65850irq/126-lan19:10:140
18743991413,1cyclictest65850irq/126-lan00:00:010
18761991313,0cyclictest743-21snmpd00:33:213
18750991313,0cyclictest743-21snmpd23:43:161
18750991313,0cyclictest743-21snmpd23:13:431
18750991313,0cyclictest743-21snmpd22:52:411
18750991313,0cyclictest743-21snmpd21:17:381
18750991313,0cyclictest743-21snmpd21:11:321
18750991313,0cyclictest743-21snmpd20:45:521
18750991313,0cyclictest743-21snmpd20:33:331
18750991313,0cyclictest743-21snmpd19:59:501
18750991313,0cyclictest4660-21cat23:45:141
18743991313,0cyclictest65850irq/126-lan22:50:120
18743991313,0cyclictest65850irq/126-lan21:00:190
18743991312,1cyclictest65850irq/126-lan00:30:130
18761991212,0cyclictest743-21snmpd23:53:173
18761991212,0cyclictest743-21snmpd21:59:523
18761991212,0cyclictest743-21snmpd20:47:193
18761991212,0cyclictest743-21snmpd20:17:423
18743991212,0cyclictest65850irq/126-lan00:10:190
18743991211,1cyclictest65850irq/126-lan00:20:180
18761991111,0cyclictest9662-21cat21:20:143
18761991111,0cyclictest743-21snmpd23:48:523
18761991111,0cyclictest743-21snmpd23:30:433
18761991111,0cyclictest743-21snmpd21:49:453
18761991111,0cyclictest743-21snmpd19:14:013
18761991111,0cyclictest23850-21cat19:20:143
18743991111,0cyclictest65850irq/126-lan00:15:150
18743991110,1cyclictest65850irq/126-lan22:35:120
18743991110,1cyclictest65850irq/126-lan21:50:120
18743991110,1cyclictest65850irq/126-lan19:40:000
18743991110,1cyclictest65850irq/126-lan00:08:040
18761991010,0cyclictest743-21snmpd23:39:373
18761991010,0cyclictest743-21snmpd23:28:233
18761991010,0cyclictest743-21snmpd23:09:153
18761991010,0cyclictest743-21snmpd22:59:483
18761991010,0cyclictest743-21snmpd22:33:113
18761991010,0cyclictest743-21snmpd22:33:113
18761991010,0cyclictest743-21snmpd22:17:163
18761991010,0cyclictest743-21snmpd22:12:443
18761991010,0cyclictest743-21snmpd21:44:223
18761991010,0cyclictest743-21snmpd21:26:563
18761991010,0cyclictest743-21snmpd21:15:593
18761991010,0cyclictest743-21snmpd20:58:113
18761991010,0cyclictest743-21snmpd20:40:253
18761991010,0cyclictest743-21snmpd19:25:583
18761991010,0cyclictest743-21snmpd19:19:043
18761991010,0cyclictest5598-21cat21:10:163
18761991010,0cyclictest3960-21cat19:50:133
18761991010,0cyclictest3598-21cat21:05:123
18761991010,0cyclictest25789-21cat22:00:143
18761991010,0cyclictest18149-21cat20:25:153
1874399109,1cyclictest65850irq/126-lan23:00:180
1874399109,1cyclictest65850irq/126-lan21:40:160
1874399109,1cyclictest65850irq/126-lan21:10:220
187619999,0cyclictest743-21snmpd23:18:213
187619999,0cyclictest743-21snmpd22:43:173
187619999,0cyclictest743-21snmpd22:08:313
187619999,0cyclictest743-21snmpd20:52:133
187619999,0cyclictest743-21snmpd20:22:063
187619999,0cyclictest743-21snmpd19:39:563
187619999,0cyclictest743-21snmpd00:21:243
187619999,0cyclictest32328-21cat19:40:133
187619998,1cyclictest743-21snmpd23:21:513
187619998,1cyclictest743-21snmpd23:11:463
187619998,1cyclictest743-21snmpd21:39:033
187619996,3cyclictest743-21snmpd22:50:023
187559998,1cyclictest743-21snmpd21:52:242
187559998,1cyclictest743-21snmpd21:43:392
187559998,1cyclictest743-21snmpd21:10:472
187559998,1cyclictest743-21snmpd19:30:042
187559998,1cyclictest741-21lldpd22:20:142
187509998,1cyclictest743-21snmpd22:35:171
187439999,0cyclictest65850irq/126-lan20:10:110
187619988,0cyclictest741-21lldpd20:35:523
187619987,1cyclictest741-21lldpd20:02:323
187619987,1cyclictest1528-21gltestperf21:00:143
187619987,1cyclictest11980-21gltestperf20:10:133
187619986,2cyclictest743-21snmpd19:58:353
187559988,0cyclictest743-21snmpd23:21:122
187559988,0cyclictest743-21snmpd20:16:332
187559988,0cyclictest743-21snmpd20:11:312
187559988,0cyclictest741-21lldpd22:54:242
187559988,0cyclictest741-21lldpd00:08:032
187559987,1cyclictest743-21snmpd21:24:082
187559987,1cyclictest741-21lldpd23:50:572
187559987,1cyclictest4281-21ntp_kernel_pll_19:50:152
187559986,2cyclictest743-21snmpd23:46:252
187559986,2cyclictest743-21snmpd23:36:252
187559986,2cyclictest743-21snmpd21:45:392
187559986,2cyclictest743-21snmpd20:38:012
187559986,2cyclictest743-21snmpd20:08:212
187559986,2cyclictest743-21snmpd00:24:332
187509988,0cyclictest743-21snmpd22:11:281
187509988,0cyclictest741-21lldpd21:34:141
187509987,1cyclictest743-21snmpd23:26:291
187509987,1cyclictest743-21snmpd21:50:541
187509987,1cyclictest741-21lldpd23:57:071
187619977,0cyclictest743-21snmpd20:09:393
187619977,0cyclictest743-21snmpd19:30:163
187619977,0cyclictest743-21snmpd00:02:053
187559977,0cyclictest743-21snmpd21:02:492
187559977,0cyclictest741-21lldpd20:42:502
187559977,0cyclictest741-21lldpd19:23:512
187559977,0cyclictest741-21lldpd00:18:262
187559976,1cyclictest743-21snmpd21:36:272
187559975,2cyclictest743-21snmpd22:01:192
187559975,2cyclictest743-21snmpd19:11:462
187559975,2cyclictest743-21snmpd00:14:202
187559973,3cyclictest7473-21fw_forwarded_lo21:15:152
187559972,4cyclictest244-20systemd-journal19:15:342
187509977,0cyclictest743-21snmpd22:56:461
187509977,0cyclictest743-21snmpd20:52:401
187509977,0cyclictest743-21snmpd00:38:301
187509977,0cyclictest741-21lldpd23:22:141
187509977,0cyclictest741-21lldpd22:30:591
187509977,0cyclictest741-21lldpd22:30:581
187509977,0cyclictest741-21lldpd21:59:011
187509977,0cyclictest741-21lldpd00:09:171
187509976,1cyclictest743-21snmpd21:01:161
187509976,1cyclictest743-21snmpd20:06:321
187509975,2cyclictest743-21snmpd19:39:021
187509975,2cyclictest3961-21cat19:50:131
187439977,0cyclictest65850irq/126-lan19:40:110
187619966,0cyclictest743-21snmpd00:00:003
187619963,2cyclictest575-21rs:main3
187619962,3cyclictest1602-21memory22:20:143
187619962,3cyclictest12753-21awk00:05:133
187559966,0cyclictest743-21snmpd22:26:442
187559966,0cyclictest743-21snmpd00:03:112
187559966,0cyclictest741-21lldpd20:21:502
187559966,0cyclictest741-21lldpd19:29:012
187559965,1cyclictest506-21systemd-resolve21:10:002
187559965,1cyclictest32345-21cat19:40:132
187559965,1cyclictest12002-21nvmesmart_nvme022:45:172
187559964,2cyclictest743-21snmpd23:59:022
187559964,2cyclictest743-21snmpd20:55:342
187509966,0cyclictest743-21snmpd23:37:551
187509966,0cyclictest743-21snmpd21:47:281
187509966,0cyclictest743-21snmpd20:24:331
187509966,0cyclictest743-21snmpd00:10:441
187509966,0cyclictest741-21lldpd22:48:381
187509966,0cyclictest741-21lldpd00:19:321
187509966,0cyclictest6592-21gltestperf23:50:121
187509965,1cyclictest743-21snmpd22:05:041
187509965,1cyclictest741-21lldpd23:34:511
187509965,1cyclictest20915-21cpuspeed_turbos00:25:131
187509965,1cyclictest17359-21cpuspeed_turbos21:40:121
187509963,2cyclictest717-21ntpd23:05:201
187509962,3cyclictest24234-21df_inode23:15:131
187509962,3cyclictest23762-21sed19:20:131
187509961,5cyclictest557-21NetworkManager20:03:071
187619955,0cyclictest741-21lldpd19:45:313
187619954,1cyclictest7806-21ntpq22:35:153
187619953,2cyclictest717-21ntpd22:47:133
187619952,2cyclictest19937-21grep23:05:003
187619952,2cyclictest15521-21ld00:10:213
187619951,4cyclictest557-21NetworkManager22:25:283
187619951,0cyclictest191rcu_preempt00:25:253
187619950,5cyclictest21370-21awk21:50:123
187559955,0cyclictest743-21snmpd23:14:282
187559954,1cyclictest7347-21fschecks_time22:35:122
187559954,1cyclictest20766-21ntpq23:05:182
187559953,2cyclictest743-21snmpd23:33:162
187559953,2cyclictest743-21snmpd22:43:062
187559953,2cyclictest743-21snmpd19:37:222
187559953,2cyclictest31395-21apt-get22:15:102
187559953,2cyclictest28489-21grep23:25:162
187559953,2cyclictest27799-21cat22:05:142
187559953,2cyclictest24504-21cat23:15:142
187559953,2cyclictest23332-21apt-get21:55:122
187559952,3cyclictest557-21NetworkManager22:32:052
187559952,3cyclictest557-21NetworkManager22:32:052
187559952,2cyclictest8295-21ld20:00:162
187559952,2cyclictest575-21rs:main2
187559952,2cyclictest27626-21sed20:45:142
187559952,2cyclictest19287-21sed23:00:252
187559951,3cyclictest21652-21grep00:25:182
187559951,3cyclictest18979-21awk20:25:212
187509955,0cyclictest743-21snmpd22:29:141
187509955,0cyclictest741-21lldpd20:15:201
187509954,1cyclictest11796-21df20:10:121
187509953,2cyclictest717-21ntpd19:40:051
187509952,3cyclictest557-21NetworkManager20:58:581
187509952,2cyclictest28215-21ld19:30:191
187509952,2cyclictest12521-21latency_hist00:05:001
187509951,3cyclictest9410-21fw_forwarded_lo22:40:141
187509950,4cyclictest23690-21ntpq00:30:181
187619943,1cyclictest13313-21cpuspeed_turbos21:30:123
187619943,1cyclictest0-21swapper/300:15:123
187619941,2cyclictest3891-21sshd23:44:133
187559943,1cyclictest21941-21kworker/2:1+events21:30:242
187559942,2cyclictest743-21snmpd22:10:072
187559942,2cyclictest2086-21gpg-connect-age23:40:012
187559942,2cyclictest19814-21grep20:30:112
187559941,2cyclictest24967-21cpuspeed_turbos00:35:122
187559941,2cyclictest23096-21cut00:30:142
187559941,2cyclictest1855-21gltestperf19:45:132
187559940,3cyclictest5841-21fw_packets19:55:152
187559940,3cyclictest29878-21/usr/sbin/munin20:50:132
187559940,3cyclictest11399-21/usr/sbin/munin21:25:132
187509942,2cyclictest717-21ntpd22:00:131
187509941,2cyclictest3761-21sed21:05:131
187509941,2cyclictest21500-21https20:35:001
187509941,2cyclictest19199-21head00:20:141
187509940,4cyclictest26204-21ntpq19:25:171
187509940,3cyclictest10026-21ntpq21:20:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional