You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-18 - 00:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Fri Apr 17, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18858992018,2cyclictest65850irq/126-lan07:25:221
18858991917,2cyclictest65850irq/126-lan11:35:161
18858991917,2cyclictest65850irq/126-lan09:55:191
18858991817,1cyclictest65850irq/126-lan10:54:201
18858991817,1cyclictest65850irq/126-lan10:15:151
18858991817,1cyclictest65850irq/126-lan08:43:401
18858991817,1cyclictest65850irq/126-lan08:25:221
18858991816,2cyclictest65850irq/126-lan11:50:181
18858991717,0cyclictest65850irq/126-lan12:33:191
18858991717,0cyclictest65850irq/126-lan12:11:191
18858991717,0cyclictest65850irq/126-lan11:49:501
18858991716,1cyclictest65850irq/126-lan10:38:591
18858991716,1cyclictest65850irq/126-lan10:10:141
18858991716,1cyclictest65850irq/126-lan09:25:201
18858991716,1cyclictest65850irq/126-lan08:00:201
18858991716,1cyclictest65850irq/126-lan07:30:191
18858991716,1cyclictest65850irq/126-lan07:10:201
18858991715,2cyclictest65850irq/126-lan10:00:131
18858991616,0cyclictest65850irq/126-lan11:25:121
18858991616,0cyclictest65850irq/126-lan11:15:191
18858991615,1cyclictest65850irq/126-lan12:25:221
18858991615,1cyclictest65850irq/126-lan11:40:171
18858991615,1cyclictest65850irq/126-lan11:30:161
18858991615,1cyclictest65850irq/126-lan11:20:211
18858991615,1cyclictest65850irq/126-lan11:01:201
18858991615,1cyclictest65850irq/126-lan10:45:151
18858991615,1cyclictest65850irq/126-lan09:10:121
18858991615,1cyclictest65850irq/126-lan09:05:151
18858991615,1cyclictest65850irq/126-lan09:00:201
18858991615,1cyclictest65850irq/126-lan08:50:111
18856991615,1cyclictest743-21snmpd07:45:350
18858991515,0cyclictest65850irq/126-lan07:20:191
18858991514,1cyclictest65850irq/126-lan12:00:091
18858991514,1cyclictest65850irq/126-lan11:10:201
18858991514,1cyclictest65850irq/126-lan11:05:181
18858991514,1cyclictest65850irq/126-lan09:31:571
18858991514,1cyclictest65850irq/126-lan08:55:151
18858991514,1cyclictest65850irq/126-lan08:35:171
18858991514,1cyclictest65850irq/126-lan08:15:121
18858991514,1cyclictest65850irq/126-lan08:10:131
18858991514,1cyclictest65850irq/126-lan07:55:121
18858991513,2cyclictest65850irq/126-lan12:20:141
18858991513,2cyclictest65850irq/126-lan12:05:151
18858991513,2cyclictest65850irq/126-lan10:55:191
18856991515,0cyclictest743-21snmpd11:05:430
18856991515,0cyclictest743-21snmpd10:18:530
18856991515,0cyclictest743-21snmpd09:04:050
18856991515,0cyclictest14192-21cat08:15:140
18858991414,0cyclictest65850irq/126-lan09:40:161
18858991413,1cyclictest65850irq/126-lan12:20:001
18858991413,1cyclictest65850irq/126-lan10:40:121
18858991413,1cyclictest65850irq/126-lan10:30:151
18858991413,1cyclictest65850irq/126-lan10:05:131
18858991413,1cyclictest65850irq/126-lan08:05:101
18856991414,0cyclictest743-21snmpd12:16:470
18856991414,0cyclictest743-21snmpd12:03:230
18856991414,0cyclictest743-21snmpd08:58:430
18856991414,0cyclictest743-21snmpd08:41:170
18856991414,0cyclictest743-21snmpd08:27:310
18858991312,1cyclictest65850irq/126-lan07:45:141
18858991312,1cyclictest65850irq/126-lan07:40:201
18858991311,2cyclictest65850irq/126-lan09:49:571
18856991313,0cyclictest743-21snmpd11:58:060
18856991313,0cyclictest743-21snmpd11:41:460
18856991313,0cyclictest743-21snmpd11:22:370
18856991313,0cyclictest743-21snmpd11:19:510
18856991313,0cyclictest743-21snmpd11:03:090
18856991313,0cyclictest743-21snmpd10:56:060
18856991313,0cyclictest743-21snmpd10:25:280
18856991313,0cyclictest743-21snmpd10:00:230
18856991313,0cyclictest743-21snmpd09:40:150
18856991313,0cyclictest743-21snmpd09:37:300
18856991313,0cyclictest743-21snmpd09:32:040
18856991313,0cyclictest743-21snmpd09:21:440
18856991313,0cyclictest743-21snmpd09:10:590
18856991313,0cyclictest743-21snmpd08:50:400
18856991313,0cyclictest743-21snmpd08:34:580
18856991313,0cyclictest743-21snmpd08:14:400
18856991313,0cyclictest743-21snmpd07:36:430
18858991212,0cyclictest65850irq/126-lan12:00:001
18858991212,0cyclictest65850irq/126-lan07:50:121
18858991211,1cyclictest65850irq/126-lan08:30:131
18856991212,0cyclictest743-21snmpd10:51:450
18856991212,0cyclictest743-21snmpd10:42:320
18856991212,0cyclictest743-21snmpd09:29:140
18856991212,0cyclictest743-21snmpd07:21:250
18856991212,0cyclictest743-21snmpd07:19:070
18856991212,0cyclictest31855-21cat11:35:150
18856991212,0cyclictest21700-21cat12:30:140
1886699118,3cyclictest741-21lldpd08:06:493
1885899118,3cyclictest65850irq/126-lan10:25:151
18858991111,0cyclictest65850irq/126-lan12:35:151
18858991111,0cyclictest65850irq/126-lan09:38:461
18858991110,1cyclictest65850irq/126-lan10:20:001
18858991110,1cyclictest65850irq/126-lan09:20:131
18858991110,1cyclictest65850irq/126-lan09:19:591
18858991110,1cyclictest65850irq/126-lan08:20:201
18858991110,1cyclictest65850irq/126-lan07:35:141
1886699107,3cyclictest743-21snmpd10:06:553
1886699107,3cyclictest743-21snmpd08:35:463
1886699107,3cyclictest741-21lldpd09:39:193
1886699107,3cyclictest741-21lldpd07:33:373
1886699107,3cyclictest741-21lldpd07:23:393
1886699107,3cyclictest717-21ntpd10:47:423
1886699106,4cyclictest743-21snmpd07:56:113
1885899109,1cyclictest65850irq/126-lan08:45:161
188669996,3cyclictest743-21snmpd09:52:303
188669996,3cyclictest741-21lldpd09:44:143
188669996,3cyclictest741-21lldpd08:49:023
188669995,4cyclictest743-21snmpd11:36:353
188669995,4cyclictest14841-21cat10:55:133
188669994,5cyclictest743-21snmpd08:01:383
188669993,3cyclictest557-21NetworkManager11:20:123
188669993,3cyclictest27690-21head11:25:143
188639998,1cyclictest741-21lldpd07:23:342
188639996,3cyclictest743-21snmpd11:44:162
188589998,1cyclictest65850irq/126-lan07:15:171
188569998,1cyclictest743-21snmpd10:07:130
188669988,0cyclictest741-21lldpd09:01:343
188669987,1cyclictest743-21snmpd07:16:433
188669987,1cyclictest741-21lldpd10:03:153
188669986,2cyclictest743-21snmpd10:37:143
188669986,2cyclictest506-21systemd-resolve11:32:043
188669985,3cyclictest741-21lldpd11:55:263
188669984,4cyclictest743-21snmpd12:03:263
188669984,4cyclictest743-21snmpd09:27:393
188669983,2cyclictest743-21snmpd10:15:563
188669983,1cyclictest0-21swapper/310:20:163
188669982,3cyclictest5269-21awk09:10:213
188669982,3cyclictest19532-21seq09:45:383
188669981,3cyclictest2280-21fw_forwarded_lo09:05:133
188669980,4cyclictest1975-21ntpq07:45:143
188669980,3cyclictest23157-21rt-features09:55:203
188669980,3cyclictest22047-21/usr/sbin/munin12:30:173
188669980,3cyclictest19779-21/usr/sbin/munin07:10:163
188669980,2cyclictest26856-21cat07:30:003
188639988,0cyclictest743-21snmpd11:01:212
188639988,0cyclictest743-21snmpd10:52:122
188639988,0cyclictest741-21lldpd11:51:512
188639988,0cyclictest741-21lldpd10:33:422
188639987,1cyclictest743-21snmpd11:38:382
188639987,1cyclictest743-21snmpd10:46:592
188639986,2cyclictest743-21snmpd09:42:362
188639986,2cyclictest743-21snmpd09:24:052
188639986,2cyclictest743-21snmpd07:56:412
188639982,3cyclictest14006-21cat09:34:592
188589988,0cyclictest65850irq/126-lan09:50:141
188569988,0cyclictest741-21lldpd11:50:590
188569988,0cyclictest741-21lldpd09:59:390
188569987,1cyclictest741-21lldpd08:02:350
188569986,2cyclictest743-21snmpd11:45:310
188669977,0cyclictest741-21lldpd12:37:203
188669977,0cyclictest522-21avahi-daemon08:59:293
188669976,1cyclictest743-21snmpd11:52:413
188669976,1cyclictest743-21snmpd10:32:063
188669976,1cyclictest743-21snmpd10:13:433
188669976,1cyclictest741-21lldpd09:18:243
188669976,1cyclictest28649-21head08:50:103
188669976,1cyclictest24207-21cut11:15:173
188669976,1cyclictest15875-21cpuspeed_turbos08:20:123
188669976,1cyclictest1124-21cpuspeed_turbos11:40:113
188669975,2cyclictest717-21ntpd12:25:153
188669972,2cyclictest743-21snmpd11:12:453
188669972,2cyclictest575-21rs:main3
188669972,2cyclictest15595-21cut08:20:003
188669971,3cyclictest11587-21irqstats12:05:143
188669971,2cyclictest4061-21wc11:45:183
188669970,4cyclictest29894-21ntpq07:35:153
188669970,3cyclictest31602-21/usr/sbin/munin07:40:113
188669970,3cyclictest25654-21users08:40:213
188669970,3cyclictest2291-21/usr/sbin/munin10:25:123
188669970,3cyclictest20647-21/usr/sbin/munin08:30:143
188669970,3cyclictest19621-21ntpq11:05:153
188669970,3cyclictest19040-21ntpq08:25:163
188669970,3cyclictest17528-21fw_forwarded_lo12:20:133
188669970,3cyclictest15963-21ntpq12:15:153
188669970,3cyclictest13742-21missed_timers12:10:133
188669970,3cyclictest12872-21ntpq09:30:163
188669970,3cyclictest12565-21df_inode10:50:123
188669970,3cyclictest11326-21/usr/sbin/munin08:10:113
188639977,0cyclictest743-21snmpd09:39:152
188639977,0cyclictest743-21snmpd09:18:352
188639977,0cyclictest743-21snmpd08:47:552
188639977,0cyclictest743-21snmpd08:01:052
188639977,0cyclictest743-21snmpd07:35:082
188639977,0cyclictest741-21lldpd09:05:422
188639977,0cyclictest741-21lldpd08:51:022
188639977,0cyclictest741-21lldpd07:44:052
188639977,0cyclictest522-21avahi-daemon07:54:462
188639976,1cyclictest9381-21fschecks_time12:00:112
188639976,1cyclictest743-21snmpd12:22:222
188639976,1cyclictest743-21snmpd08:32:062
188639976,1cyclictest741-21lldpd10:14:532
188639976,1cyclictest22219-21unixbench_singl11:10:202
188639976,1cyclictest19153-21fschecks_time11:05:132
188639975,2cyclictest743-21snmpd12:38:002
188639975,2cyclictest743-21snmpd12:34:152
188639975,2cyclictest743-21snmpd12:11:532
188639975,2cyclictest743-21snmpd11:32:072
188639975,2cyclictest743-21snmpd11:15:182
188639975,2cyclictest743-21snmpd10:19:532
188639975,2cyclictest743-21snmpd08:35:372
188639975,2cyclictest743-21snmpd08:06:322
188639975,2cyclictest27530-21cat07:30:132
188569977,0cyclictest743-21snmpd12:35:180
188569977,0cyclictest741-21lldpd12:12:480
188569977,0cyclictest741-21lldpd09:08:080
188569977,0cyclictest741-21lldpd07:55:480
188569975,2cyclictest743-21snmpd11:32:010
188569973,3cyclictest15956-21df08:20:120
188669960,3cyclictest9082-21ntpq10:40:153
188669960,3cyclictest8834-21ntpq09:20:163
188669960,3cyclictest3411-21df07:50:133
188639966,0cyclictest741-21lldpd10:05:032
188639966,0cyclictest741-21lldpd08:55:252
188639966,0cyclictest741-21lldpd08:17:542
188639965,1cyclictest743-21snmpd11:56:022
188639965,1cyclictest557-21NetworkManager09:55:142
188639964,2cyclictest743-21snmpd11:29:162
188639964,2cyclictest743-21snmpd10:24:372
188639964,2cyclictest743-21snmpd08:11:392
188639963,3cyclictest557-21NetworkManager09:10:022
188639962,3cyclictest25467-21sed08:40:212
188639961,5cyclictest557-21NetworkManager10:03:392
188569966,0cyclictest741-21lldpd10:20:090
188569966,0cyclictest741-21lldpd10:12:230
188569966,0cyclictest741-21lldpd09:54:070
188569966,0cyclictest741-21lldpd07:31:170
188569964,2cyclictest743-21snmpd07:53:020
188569964,2cyclictest743-21snmpd07:43:260
188639955,0cyclictest743-21snmpd09:52:062
188639955,0cyclictest743-21snmpd07:25:132
188639954,1cyclictest743-21snmpd10:29:052
188639954,1cyclictest522-21avahi-daemon11:20:302
188639954,1cyclictest16553-21ntpq08:20:162
188639953,2cyclictest8378-21apt-get10:40:112
188639953,2cyclictest743-21snmpd09:02:592
188639953,2cyclictest717-21ntpd09:45:162
188639953,2cyclictest15193-21apt12:15:102
188639952,2cyclictest3813-21sed11:45:152
188639952,2cyclictest244-20systemd-journal09:28:282
188569954,1cyclictest0-21swapper/009:45:130
188569953,2cyclictest743-21snmpd10:35:360
188569952,2cyclictest27679-21fw_packets11:25:140
188569952,2cyclictest25625-21cat07:25:160
188569952,2cyclictest244-20systemd-journal10:30:020
188569952,2cyclictest23277-21wc08:35:190
188569952,2cyclictest20979-21tr11:10:110
188569952,2cyclictest19578-21sed07:10:140
188569952,2cyclictest18537-21sed12:20:190
188569951,3cyclictest11687-21memory12:05:140
188639942,2cyclictest20303-21grep07:10:202
188639941,2cyclictest244-20systemd-journal10:36:382
188639941,2cyclictest1500-21tune2fs07:45:112
188639941,2cyclictest14613-21tune2fs10:55:112
188639941,2cyclictest11518-21smartctl12:05:142
188639940,4cyclictest21041-21apt-get07:15:112
188639940,3cyclictest20066-21ntpq12:25:182
188639940,3cyclictest18401-21diskstats08:25:122
188569944,0cyclictest506-21systemd-resolve10:46:340
188569943,1cyclictest0-21swapper/012:25:130
188569941,2cyclictest6587-21sed09:15:150
188569941,2cyclictest26301-21cat08:45:110
188569941,2cyclictest11209-21date08:10:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional