You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-13 - 07:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Fri Mar 13, 2026 00:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18434991918,1cyclictest65850irq/126-lan20:32:212
18434991818,0cyclictest65850irq/126-lan23:27:492
18434991818,0cyclictest65850irq/126-lan20:02:202
18434991817,1cyclictest65850irq/126-lan23:35:212
18434991817,1cyclictest65850irq/126-lan22:30:172
18434991817,1cyclictest65850irq/126-lan21:55:142
18434991817,1cyclictest65850irq/126-lan19:25:162
18434991717,0cyclictest65850irq/126-lan21:50:192
18434991717,0cyclictest65850irq/126-lan00:22:332
18434991716,1cyclictest65850irq/126-lan23:50:152
18434991716,1cyclictest65850irq/126-lan23:20:212
18434991716,1cyclictest65850irq/126-lan23:00:132
18434991716,1cyclictest65850irq/126-lan21:10:142
18434991716,1cyclictest65850irq/126-lan19:40:182
18434991716,1cyclictest65850irq/126-lan19:30:212
18434991716,1cyclictest65850irq/126-lan19:20:112
18434991716,1cyclictest65850irq/126-lan19:10:142
18434991616,0cyclictest65850irq/126-lan23:10:162
18434991615,1cyclictest65850irq/126-lan22:45:212
18434991615,1cyclictest65850irq/126-lan22:25:132
18434991615,1cyclictest65850irq/126-lan22:05:002
18434991615,1cyclictest65850irq/126-lan21:40:142
18434991615,1cyclictest65850irq/126-lan21:25:212
18434991615,1cyclictest65850irq/126-lan21:00:212
18434991615,1cyclictest65850irq/126-lan20:36:522
18434991615,1cyclictest65850irq/126-lan20:15:012
18434991615,1cyclictest65850irq/126-lan00:35:152
18434991615,1cyclictest65850irq/126-lan00:15:002
18434991515,0cyclictest65850irq/126-lan22:55:142
18434991515,0cyclictest65850irq/126-lan00:17:222
18434991514,1cyclictest65850irq/126-lan22:10:152
18434991514,1cyclictest65850irq/126-lan20:55:212
18434991514,1cyclictest65850irq/126-lan19:55:132
18434991514,1cyclictest65850irq/126-lan00:25:202
18434991414,0cyclictest65850irq/126-lan22:40:012
18434991414,0cyclictest65850irq/126-lan21:34:212
18434991413,1cyclictest65850irq/126-lan23:35:002
18434991413,1cyclictest65850irq/126-lan22:35:192
18434991413,1cyclictest65850irq/126-lan21:05:152
18434991413,1cyclictest65850irq/126-lan20:50:002
18434991413,1cyclictest65850irq/126-lan20:25:132
18434991413,1cyclictest65850irq/126-lan20:10:132
18434991413,1cyclictest65850irq/126-lan00:30:132
18434991413,1cyclictest65850irq/126-lan00:00:172
18434991313,0cyclictest65850irq/126-lan23:45:102
18434991313,0cyclictest65850irq/126-lan23:15:162
18434991313,0cyclictest65850irq/126-lan20:24:202
18434991313,0cyclictest65850irq/126-lan19:50:202
18434991313,0cyclictest65850irq/126-lan19:45:122
18434991313,0cyclictest65850irq/126-lan00:07:212
18434991312,1cyclictest65850irq/126-lan22:50:122
18434991312,1cyclictest65850irq/126-lan19:15:132
18434991212,0cyclictest65850irq/126-lan22:20:002
18434991212,0cyclictest65850irq/126-lan22:02:112
18434991110,1cyclictest65850irq/126-lan21:45:152
18434991110,1cyclictest65850irq/126-lan20:05:202
1843499109,1cyclictest65850irq/126-lan23:05:152
1843499109,1cyclictest65850irq/126-lan22:20:142
1843499109,1cyclictest65850irq/126-lan19:35:162
18434991010,0cyclictest65850irq/126-lan21:15:292
1842199106,3cyclictest743-21snmpd21:22:130
184389998,1cyclictest743-21snmpd20:07:173
184349999,0cyclictest65850irq/126-lan23:55:142
184349999,0cyclictest65850irq/126-lan20:44:072
184349998,1cyclictest65850irq/126-lan23:40:212
184349998,1cyclictest65850irq/126-lan20:50:162
184299999,0cyclictest743-21snmpd00:33:161
184299998,1cyclictest743-21snmpd23:18:181
184299998,1cyclictest743-21snmpd22:02:121
184299996,1cyclictest191rcu_preempt19:41:291
184219998,1cyclictest743-21snmpd23:37:340
184389988,0cyclictest743-21snmpd22:26:043
184389988,0cyclictest743-21snmpd20:38:123
184389988,0cyclictest743-21snmpd00:32:043
184389988,0cyclictest743-21snmpd00:20:443
184389988,0cyclictest741-21lldpd00:35:383
184389987,1cyclictest743-21snmpd22:10:063
184389987,1cyclictest741-21lldpd23:23:213
184389986,2cyclictest743-21snmpd20:19:233
184389986,2cyclictest743-21snmpd19:18:303
184389986,2cyclictest743-21snmpd00:13:143
184349987,1cyclictest741-21lldpd21:20:522
184349987,1cyclictest65850irq/126-lan21:35:112
184299988,0cyclictest743-21snmpd23:53:071
184299988,0cyclictest743-21snmpd19:16:181
184299988,0cyclictest741-21lldpd23:03:001
184299988,0cyclictest741-21lldpd19:10:571
184299988,0cyclictest741-21lldpd00:07:411
184299987,1cyclictest743-21snmpd23:34:541
184299987,1cyclictest743-21snmpd22:16:511
184299987,1cyclictest743-21snmpd19:38:521
184299986,2cyclictest743-21snmpd21:39:531
184299986,2cyclictest743-21snmpd21:13:341
184299986,2cyclictest743-21snmpd20:08:561
184299986,2cyclictest743-21snmpd20:00:091
184299982,3cyclictest18510-21hddtemp_smartct00:20:131
184299981,5cyclictest26658-21chrt19:27:431
184299981,5cyclictest20963-21ntpq00:25:201
184299981,5cyclictest15056-21seq22:50:271
184299981,4cyclictest32573-21ntpq23:35:151
184299981,3cyclictest26522-21ntpq23:20:161
184299981,3cyclictest22540-21seq21:52:351
184299981,3cyclictest17131-21seq22:56:171
184299981,3cyclictest1540-21runrttasks22:20:051
184299980,4cyclictest2713-21ntpq21:05:171
184299980,4cyclictest24021-21systemctl21:55:201
184299980,4cyclictest10594-21sed21:25:151
184219988,0cyclictest743-21snmpd00:23:080
184219988,0cyclictest741-21lldpd22:49:040
184219988,0cyclictest741-21lldpd21:36:590
184219988,0cyclictest741-21lldpd21:30:450
184219988,0cyclictest741-21lldpd19:22:590
184219987,1cyclictest743-21snmpd21:14:370
184219987,1cyclictest743-21snmpd21:01:310
184219987,1cyclictest743-21snmpd20:16:590
184219987,1cyclictest743-21snmpd00:06:410
184219987,1cyclictest741-21lldpd23:32:120
184219987,1cyclictest741-21lldpd23:12:170
184219987,1cyclictest741-21lldpd21:05:010
184219987,1cyclictest29615-21cron20:55:010
184219986,2cyclictest743-21snmpd20:45:150
184389977,0cyclictest743-21snmpd23:45:103
184389977,0cyclictest743-21snmpd22:51:353
184389977,0cyclictest743-21snmpd22:43:083
184389977,0cyclictest743-21snmpd22:20:043
184389977,0cyclictest743-21snmpd19:35:523
184389977,0cyclictest741-21lldpd21:49:513
184389977,0cyclictest741-21lldpd20:33:353
184389977,0cyclictest522-21avahi-daemon20:24:573
184389976,1cyclictest743-21snmpd23:00:053
184389975,2cyclictest743-21snmpd22:19:253
184389975,2cyclictest743-21snmpd21:36:273
184389975,2cyclictest743-21snmpd21:05:283
184389975,2cyclictest743-21snmpd00:26:203
184389975,2cyclictest1214-21cat19:45:133
184299977,0cyclictest743-21snmpd23:05:411
184299977,0cyclictest741-21lldpd23:10:121
184299977,0cyclictest741-21lldpd20:40:321
184299977,0cyclictest741-21lldpd00:12:491
184299976,1cyclictest743-21snmpd21:20:461
184299976,1cyclictest741-21lldpd22:41:471
184299976,1cyclictest741-21lldpd00:35:121
184299975,2cyclictest743-21snmpd19:52:111
184299972,3cyclictest8781-21ntpq23:55:171
184299972,3cyclictest6347-21ntpq22:30:161
184299971,5cyclictest2291-21chrt19:47:041
184299971,5cyclictest12456-21seq21:30:061
184299971,4cyclictest2264-21ntpq23:40:151
184299971,4cyclictest19546-21munin-run20:30:001
184299971,4cyclictest17703-21chrt00:18:351
184299971,4cyclictest12477-21ntpq22:45:171
184299971,4cyclictest10861-21ntpq00:00:171
184299971,4cyclictest0-21swapper/120:55:171
184299971,3cyclictest9182-21chrt22:37:481
184299971,3cyclictest747-21runrttasks20:10:051
184299971,3cyclictest647-21ntpq21:00:161
184299971,3cyclictest4219-21ntp_192.168.11423:45:161
184299971,3cyclictest29273-21chrt20:50:441
184299971,3cyclictest28529-21ntp_192.168.11423:25:161
184299971,3cyclictest26813-21ps20:45:181
184299971,3cyclictest20028-21seq21:46:431
184299971,3cyclictest14121-21hddtemp_smartct20:15:131
184299971,2cyclictest28142-21cut22:05:141
184299971,2cyclictest17370-21taskset21:40:171
184299970,5cyclictest22618-21ntpq20:35:181
184299970,1cyclictest15773-21apt-get20:20:131
184219977,0cyclictest743-21snmpd23:03:380
184219977,0cyclictest741-21lldpd23:48:580
184219977,0cyclictest741-21lldpd20:44:220
184219976,1cyclictest743-21snmpd23:55:370
184219976,1cyclictest743-21snmpd22:54:320
184219976,1cyclictest743-21snmpd19:30:010
184219975,2cyclictest743-21snmpd22:11:490
184219975,2cyclictest743-21snmpd20:27:000
184219975,2cyclictest743-21snmpd20:21:080
184219974,2cyclictest743-21snmpd00:00:020
184389966,0cyclictest743-21snmpd23:57:083
184389966,0cyclictest743-21snmpd21:52:523
184389966,0cyclictest743-21snmpd19:11:363
184389966,0cyclictest741-21lldpd22:46:403
184389966,0cyclictest741-21lldpd22:33:443
184389966,0cyclictest741-21lldpd20:41:263
184389966,0cyclictest741-21lldpd19:31:273
184389966,0cyclictest741-21lldpd19:21:513
184389965,1cyclictest522-21avahi-daemon20:52:263
184389965,1cyclictest4061-21cpuspeed_turbos21:10:133
184389964,2cyclictest309-21cat21:00:143
184389964,2cyclictest30290-21cat23:30:133
184389963,3cyclictest557-21NetworkManager20:45:273
184299965,1cyclictest741-21lldpd21:15:011
184299961,3cyclictest4437-21ntpq22:25:181
184299961,3cyclictest23870-21ntpq19:20:151
184299961,1cyclictest0-21swapper/119:30:161
184299960,4cyclictest29675-21cut22:10:121
184299960,3cyclictest4790-21/usr/sbin/munin19:55:121
184299960,2cyclictest20615-21ntpq20:30:181
184219966,0cyclictest743-21snmpd23:07:350
184219966,0cyclictest743-21snmpd21:56:460
184219966,0cyclictest741-21lldpd23:22:330
184219966,0cyclictest741-21lldpd23:16:220
184219966,0cyclictest741-21lldpd22:19:280
184219966,0cyclictest741-21lldpd19:55:160
184219965,1cyclictest743-21snmpd20:00:290
184219965,1cyclictest743-21snmpd19:54:020
184219965,1cyclictest522-21avahi-daemon22:57:190
184219965,1cyclictest3889-21gltestperf22:25:140
184219964,2cyclictest743-21snmpd21:19:460
184219964,2cyclictest743-21snmpd00:11:590
184219963,3cyclictest2221-21ld23:40:150
184219962,3cyclictest6386-21ntp_states23:50:170
184219962,3cyclictest26813-21users22:00:200
184219961,2cyclictest7524-21cat22:35:000
184389955,0cyclictest741-21lldpd22:55:073
184389955,0cyclictest741-21lldpd00:05:253
184389955,0cyclictest522-21avahi-daemon20:27:173
184389954,1cyclictest32029-21ntpq19:40:183
184389954,1cyclictest23079-21cpuspeed_turbos21:55:133
184389954,1cyclictest12753-21fschecks_time21:30:123
184389953,2cyclictest743-21snmpd21:26:503
184389953,2cyclictest24864-21sed23:15:203
184389953,2cyclictest1848-21sed23:40:133
184389953,2cyclictest0-21swapper/322:10:013
184389952,3cyclictest743-21snmpd21:15:103
184389952,2cyclictest9269-21cat21:20:213
184389952,2cyclictest25936-21ntp_states19:25:173
184389952,2cyclictest244-20systemd-journal00:00:183
184389952,2cyclictest20707-21ps23:05:183
184389951,3cyclictest12107-21ld20:10:153
184389950,4cyclictest16813-21ntpq00:15:163
184219955,0cyclictest743-21snmpd19:11:060
184219955,0cyclictest741-21lldpd21:40:190
184219955,0cyclictest741-21lldpd20:13:180
184219955,0cyclictest741-21lldpd20:08:260
184219955,0cyclictest741-21lldpd19:46:340
184219955,0cyclictest741-21lldpd19:41:040
184219955,0cyclictest522-21avahi-daemon00:33:210
184219954,1cyclictest743-21snmpd22:09:120
184219953,2cyclictest743-21snmpd23:28:090
184219953,0cyclictest0-21swapper/000:35:120
184219952,3cyclictest9756-21cut22:40:110
184219952,3cyclictest743-21snmpd19:26:580
184219952,2cyclictest21322-21tail21:50:130
184219952,2cyclictest10385-21gltestperf21:25:140
184219951,3cyclictest2780-21cat22:20:200
184219951,3cyclictest17405-21awk00:15:220
184219950,4cyclictest18722-21diskstats21:45:110
184389943,1cyclictest3525-21ntpq19:50:153
184389942,2cyclictest31972-21grep23:35:113
184389942,2cyclictest25722-21tune2fs22:00:123
184389941,3cyclictest7619-21apt-get22:35:113
184389941,3cyclictest5584-21ntpq19:55:173
184389940,4cyclictest7993-21ntpq20:00:153
184389940,4cyclictest30650-21ntpq20:55:173
184389940,3cyclictest5824-21fw_conntrack23:50:133
184389940,3cyclictest27996-21diskstats23:25:143
184389940,3cyclictest22318-21memory23:10:143
184389940,3cyclictest16831-21fw_forwarded_lo21:40:133
184219942,2cyclictest29264-21cut19:35:110
184219942,2cyclictest20309-21entropy00:25:160
184219941,2cyclictest717-21ntpd20:35:190
184219941,2cyclictest30059-21entropy20:55:130
184219941,2cyclictest244-20systemd-journal19:15:160
184219940,4cyclictest8464-21ntpq22:35:160
184219940,3cyclictest20541-21ntpq20:30:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional