You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 22:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Fri May 22, 2026 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7357991818,0cyclictest65850irq/126-lan12:25:211
7357991818,0cyclictest65850irq/126-lan12:05:191
7357991818,0cyclictest65850irq/126-lan11:35:151
7357991818,0cyclictest65850irq/126-lan09:37:081
7357991817,1cyclictest65850irq/126-lan11:59:551
7357991817,1cyclictest65850irq/126-lan08:25:121
7357991717,0cyclictest65850irq/126-lan11:15:121
7357991717,0cyclictest65850irq/126-lan10:23:441
7357991717,0cyclictest65850irq/126-lan09:00:181
7357991717,0cyclictest65850irq/126-lan08:50:011
7357991717,0cyclictest65850irq/126-lan08:20:151
7357991717,0cyclictest65850irq/126-lan07:40:141
7357991717,0cyclictest65850irq/126-lan07:20:111
7357991716,1cyclictest65850irq/126-lan12:15:121
7357991716,1cyclictest65850irq/126-lan07:45:181
7357991616,0cyclictest65850irq/126-lan12:10:131
7357991616,0cyclictest65850irq/126-lan11:50:181
7357991616,0cyclictest65850irq/126-lan11:25:201
7357991616,0cyclictest65850irq/126-lan11:20:191
7357991616,0cyclictest65850irq/126-lan10:45:141
7357991616,0cyclictest65850irq/126-lan10:25:191
7357991616,0cyclictest65850irq/126-lan10:11:071
7357991616,0cyclictest65850irq/126-lan09:50:121
7357991616,0cyclictest65850irq/126-lan07:55:011
7357991615,1cyclictest65850irq/126-lan12:00:181
7357991615,1cyclictest65850irq/126-lan09:55:131
7357991615,1cyclictest65850irq/126-lan09:10:001
7357991615,1cyclictest65850irq/126-lan07:35:161
7357991615,1cyclictest65850irq/126-lan07:25:521
7357991515,0cyclictest65850irq/126-lan12:30:191
7357991515,0cyclictest65850irq/126-lan11:40:191
7357991515,0cyclictest65850irq/126-lan11:10:101
7357991515,0cyclictest65850irq/126-lan10:05:181
7357991515,0cyclictest65850irq/126-lan09:48:271
7357991515,0cyclictest65850irq/126-lan09:25:161
7357991515,0cyclictest65850irq/126-lan08:44:131
7357991514,1cyclictest65850irq/126-lan12:20:151
7357991514,1cyclictest65850irq/126-lan11:49:071
7357991514,1cyclictest65850irq/126-lan11:05:211
7357991514,1cyclictest65850irq/126-lan10:35:121
7357991414,0cyclictest65850irq/126-lan10:50:001
7357991414,0cyclictest65850irq/126-lan10:40:141
7357991414,0cyclictest65850irq/126-lan10:30:121
7357991414,0cyclictest65850irq/126-lan10:18:181
7357991414,0cyclictest65850irq/126-lan09:40:151
7357991414,0cyclictest65850irq/126-lan09:30:161
7357991414,0cyclictest65850irq/126-lan07:15:121
7357991413,1cyclictest65850irq/126-lan12:35:191
7357991413,1cyclictest15101-21kworker/1:1+events09:15:021
7357991412,1cyclictest65850irq/126-lan08:55:111
7357991313,0cyclictest65850irq/126-lan11:30:191
7357991313,0cyclictest65850irq/126-lan09:10:171
7357991313,0cyclictest65850irq/126-lan08:35:171
7357991313,0cyclictest65850irq/126-lan08:15:001
7357991313,0cyclictest65850irq/126-lan08:14:591
7357991313,0cyclictest65850irq/126-lan07:30:201
7357991312,1cyclictest65850irq/126-lan10:55:201
7357991212,0cyclictest65850irq/126-lan11:00:141
7357991212,0cyclictest65850irq/126-lan09:20:191
7357991212,0cyclictest65850irq/126-lan08:05:151
736299114,5cyclictest10477-21ntpq12:30:152
7357991111,0cyclictest65850irq/126-lan08:00:191
7357991110,1cyclictest65850irq/126-lan08:45:131
7357991110,1cyclictest65850irq/126-lan08:30:151
736299108,2cyclictest743-21snmpd11:28:502
736299105,3cyclictest1364-21cat10:50:132
736299100,3cyclictest32412-21/usr/sbin/munin08:10:132
7357991010,0cyclictest65850irq/126-lan10:00:201
73679998,1cyclictest743-21snmpd09:41:103
73679998,1cyclictest741-21lldpd11:12:213
73629997,2cyclictest743-21snmpd11:00:582
73629996,3cyclictest8202-21cat12:25:142
73629992,6cyclictest743-21snmpd10:15:112
73629991,5cyclictest12221-21needreboot07:20:142
73629990,3cyclictest18518-21taskset11:30:192
73509998,1cyclictest743-21snmpd07:37:000
73679988,0cyclictest743-21snmpd12:33:283
73679988,0cyclictest743-21snmpd10:46:303
73679988,0cyclictest743-21snmpd07:10:193
73679988,0cyclictest741-21lldpd09:50:583
73679988,0cyclictest741-21lldpd09:25:293
73679987,1cyclictest741-21lldpd11:49:053
73679986,2cyclictest743-21snmpd12:27:133
73679986,2cyclictest743-21snmpd07:50:243
73629988,0cyclictest743-21snmpd11:15:012
73629988,0cyclictest743-21snmpd09:52:172
73629988,0cyclictest741-21lldpd10:36:222
73629987,1cyclictest23635-21ntp_kernel_err09:05:162
73629986,2cyclictest743-21snmpd12:15:092
73629986,2cyclictest743-21snmpd10:55:462
73629986,2cyclictest743-21snmpd09:36:462
73629986,2cyclictest743-21snmpd08:27:292
73629986,2cyclictest743-21snmpd07:57:012
73629985,3cyclictest506-21systemd-resolve11:45:002
73629985,3cyclictest20454-21gltestperf07:40:132
73629982,6cyclictest557-21NetworkManager07:17:122
73629982,6cyclictest25219-21fw_conntrack09:10:122
73629982,5cyclictest4497-21diskstats08:20:122
73629980,3cyclictest19298-21ntp_states08:55:172
73579988,0cyclictest741-21lldpd07:11:421
73509988,0cyclictest743-21snmpd11:41:320
73509988,0cyclictest743-21snmpd10:49:510
73509988,0cyclictest743-21snmpd10:40:300
73509988,0cyclictest741-21lldpd11:00:330
73509988,0cyclictest506-21systemd-resolve10:27:310
73509987,1cyclictest741-21lldpd12:10:470
73509987,1cyclictest13359-21cut07:25:000
73509986,2cyclictest743-21snmpd12:07:270
73509986,2cyclictest743-21snmpd10:54:220
73509986,2cyclictest743-21snmpd09:21:150
73509986,2cyclictest717-21ntpd08:10:190
73509986,2cyclictest717-21ntpd07:19:010
73679977,0cyclictest743-21snmpd12:07:183
73679977,0cyclictest743-21snmpd10:37:173
73679977,0cyclictest743-21snmpd10:04:233
73679977,0cyclictest743-21snmpd09:46:133
73679977,0cyclictest743-21snmpd09:18:473
73679977,0cyclictest741-21lldpd10:20:343
73679977,0cyclictest741-21lldpd08:50:193
73679977,0cyclictest741-21lldpd08:14:523
73679976,1cyclictest743-21snmpd10:27:483
73679976,1cyclictest743-21snmpd09:32:343
73679976,1cyclictest522-21avahi-daemon11:55:083
73679976,1cyclictest19630-21cat10:15:143
73679975,2cyclictest743-21snmpd12:11:193
73679975,2cyclictest743-21snmpd11:54:183
73679975,2cyclictest743-21snmpd11:43:503
73679975,2cyclictest743-21snmpd11:25:503
73679975,2cyclictest743-21snmpd11:24:233
73679975,2cyclictest743-21snmpd07:58:243
73679975,2cyclictest743-21snmpd07:24:243
73679974,2cyclictest743-21snmpd10:10:053
73629977,0cyclictest743-21snmpd11:59:032
73629977,0cyclictest743-21snmpd11:39:592
73629977,0cyclictest743-21snmpd09:23:132
73629977,0cyclictest743-21snmpd07:39:512
73629976,1cyclictest743-21snmpd08:05:132
73629976,1cyclictest741-21lldpd07:48:282
73629976,1cyclictest717-21ntpd10:20:122
73629976,1cyclictest15924-21gltestperf07:30:132
73629973,4cyclictest10777-21cpuspeed_turbos09:55:122
73629971,3cyclictest25693-21if_lan10:30:142
73629971,2cyclictest864-21grep10:50:002
73629971,2cyclictest757-21expr09:30:112
73629970,4cyclictest8284-21ntpq07:10:152
73629970,4cyclictest25969-21hddtemp_smartct11:50:132
73629970,4cyclictest24967-21ntpq07:50:162
73629970,4cyclictest14588-21diskstats08:45:122
73629970,4cyclictest13541-21ntpq10:00:162
73629970,4cyclictest12632-21ntpq12:35:182
73629970,4cyclictest11243-21ntpq08:35:192
73629970,3cyclictest7951-21grep09:45:202
73629970,3cyclictest7291-21fw_conntrack11:05:132
73629970,3cyclictest29784-21df12:00:122
73629970,3cyclictest29624-21grep10:40:142
73629970,3cyclictest29052-21ntp_states08:00:172
73629970,3cyclictest28719-21idleruntime-cro09:20:002
73629970,3cyclictest24740-21timerwakeupswit11:45:192
73629970,3cyclictest17297-21ntpq08:50:172
73629970,3cyclictest14339-21tail11:20:202
73629970,3cyclictest12800-21hddtemp_smartct08:40:142
73629970,2cyclictest32509-21chrt09:27:212
73629970,2cyclictest0-21swapper/207:25:112
73579977,0cyclictest743-21snmpd07:51:091
73509977,0cyclictest743-21snmpd09:28:580
73509977,0cyclictest741-21lldpd12:37:060
73509977,0cyclictest741-21lldpd10:17:160
73509977,0cyclictest741-21lldpd09:15:210
73509977,0cyclictest522-21avahi-daemon07:10:520
73509976,1cyclictest743-21snmpd12:31:020
73509976,1cyclictest743-21snmpd12:01:120
73509976,1cyclictest743-21snmpd10:37:060
73509976,1cyclictest743-21snmpd10:31:180
73509976,1cyclictest743-21snmpd09:06:020
73509976,1cyclictest743-21snmpd09:00:060
73509976,1cyclictest743-21snmpd08:37:410
73509976,1cyclictest741-21lldpd08:08:360
73509976,1cyclictest717-21ntpd11:30:020
73509976,1cyclictest717-21ntpd11:25:140
73509976,1cyclictest573-21in:imuxsock09:13:560
73509976,1cyclictest2359-21cpuspeed_turbos08:15:100
73509975,2cyclictest743-21snmpd11:11:010
73509975,2cyclictest743-21snmpd08:55:060
73509975,2cyclictest743-21snmpd07:53:060
73509975,2cyclictest717-21ntpd11:35:020
73509975,2cyclictest717-21ntpd09:43:080
73679966,0cyclictest743-21snmpd12:02:063
73679966,0cyclictest743-21snmpd11:07:193
73679966,0cyclictest743-21snmpd08:58:453
73679966,0cyclictest743-21snmpd08:38:053
73679966,0cyclictest743-21snmpd07:33:063
73679966,0cyclictest743-21snmpd07:25:143
73679966,0cyclictest741-21lldpd08:17:203
73679966,0cyclictest741-21lldpd07:43:173
73679966,0cyclictest522-21avahi-daemon10:57:143
73679965,1cyclictest522-21avahi-daemon10:05:133
73679965,1cyclictest522-21avahi-daemon07:47:113
73679965,1cyclictest506-21systemd-resolve12:17:193
73679964,2cyclictest743-21snmpd11:39:083
73679964,2cyclictest743-21snmpd09:37:523
73679963,3cyclictest29272-21fw_packets09:20:123
73679963,3cyclictest1226-21perl10:50:123
73679962,4cyclictest557-21NetworkManager10:40:493
73679962,3cyclictest6878-21sed08:25:143
73679962,3cyclictest26096-21ntp_states10:30:173
73629966,0cyclictest741-21lldpd12:20:042
73629963,3cyclictest557-21NetworkManager10:05:082
73629961,2cyclictest31760-21sed12:05:002
73629961,1cyclictest0-21swapper/211:10:112
73629960,3cyclictest8521-21df08:30:112
73629960,3cyclictest4711-21/usr/sbin/munin09:40:112
73629960,3cyclictest23404-21df10:25:102
73629960,3cyclictest21654-21ntpq09:00:162
73629960,3cyclictest1849-21diskstats12:10:122
73629960,2cyclictest4069-21basename08:19:592
73629960,2cyclictest17144-21sed10:10:132
73509966,0cyclictest743-21snmpd11:51:120
73509966,0cyclictest741-21lldpd10:00:060
73509966,0cyclictest741-21lldpd08:41:370
73509966,0cyclictest741-21lldpd07:31:050
73509966,0cyclictest741-21lldpd07:26:200
73509965,1cyclictest743-21snmpd11:57:030
73509965,1cyclictest717-21ntpd11:17:070
73509965,1cyclictest717-21ntpd10:10:220
73509965,1cyclictest522-21avahi-daemon08:01:540
73509963,3cyclictest23520-21users07:45:210
73509963,2cyclictest7553-21cut09:45:170
73509962,3cyclictest7195-21ntpq08:25:170
73679955,0cyclictest743-21snmpd12:39:223
73679955,0cyclictest743-21snmpd09:01:173
73679955,0cyclictest743-21snmpd08:09:013
73679955,0cyclictest741-21lldpd08:48:123
73679955,0cyclictest522-21avahi-daemon08:24:233
73679954,1cyclictest522-21avahi-daemon08:03:313
73679954,1cyclictest13266-21ntpq08:40:183
73679953,1cyclictest0-21swapper/312:20:163
73679952,3cyclictest19375-21sed07:35:233
73679952,2cyclictest25718-21ntpq09:10:163
73679952,2cyclictest12189-21sed11:15:203
73679952,2cyclictest11449-21ld09:55:163
73679951,3cyclictest18647-21sed11:30:213
73509955,0cyclictest743-21snmpd11:20:070
73509954,1cyclictest244-20systemd-journal08:45:100
73509953,2cyclictest743-21snmpd11:08:430
73509953,2cyclictest743-21snmpd08:32:320
73509953,2cyclictest717-21ntpd12:27:310
73509953,2cyclictest717-21ntpd12:15:220
73509953,2cyclictest717-21ntpd10:06:340
73509953,2cyclictest717-21ntpd09:30:020
73509953,2cyclictest16858-21cat08:50:140
73509952,3cyclictest6031-21fw_packets12:20:120
73509952,3cyclictest557-21NetworkManager08:20:130
73509952,2cyclictest4095-21wc10:55:180
73509952,2cyclictest20148-21awk07:40:110
73509952,2cyclictest10963-21cut09:55:130
73509951,3cyclictest22091-21ntp_states10:20:170
73509950,4cyclictest8869-21fschecks_count09:50:110
73679942,2cyclictest743-21snmpd08:31:593
73679941,2cyclictest23248-21grep09:05:143
73679940,3cyclictest9923-21expr07:15:143
73679940,3cyclictest5154-21diskstats11:00:133
73509941,2cyclictest23551-21find11:45:100
73509940,3cyclictest2794-21diskstats09:35:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional