You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-28 - 07:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Tue Apr 28, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12992991818,0cyclictest65850irq/126-lan22:05:151
12992991818,0cyclictest65850irq/126-lan21:11:091
12992991818,0cyclictest65850irq/126-lan19:20:131
12992991817,1cyclictest65850irq/126-lan23:54:531
12992991817,1cyclictest65850irq/126-lan19:55:171
12992991817,1cyclictest65850irq/126-lan19:36:491
12992991717,0cyclictest65850irq/126-lan22:12:231
12992991717,0cyclictest65850irq/126-lan21:00:141
12992991717,0cyclictest65850irq/126-lan19:49:451
12992991716,1cyclictest65850irq/126-lan23:55:191
12992991716,1cyclictest65850irq/126-lan23:45:151
12992991716,1cyclictest65850irq/126-lan23:43:431
12992991716,1cyclictest65850irq/126-lan23:05:181
12992991716,1cyclictest65850irq/126-lan22:35:081
12992991716,1cyclictest65850irq/126-lan00:05:181
12992991616,0cyclictest65850irq/126-lan21:32:441
12992991616,0cyclictest65850irq/126-lan20:50:171
12992991615,1cyclictest65850irq/126-lan23:00:161
12992991615,1cyclictest65850irq/126-lan22:50:221
12992991615,1cyclictest65850irq/126-lan21:40:131
12992991615,1cyclictest65850irq/126-lan20:59:101
12992991615,1cyclictest65850irq/126-lan20:45:181
12992991615,1cyclictest65850irq/126-lan19:15:191
12992991515,0cyclictest65850irq/126-lan23:38:431
12992991515,0cyclictest65850irq/126-lan23:10:151
12992991515,0cyclictest65850irq/126-lan22:25:201
12992991515,0cyclictest65850irq/126-lan22:20:161
12992991515,0cyclictest65850irq/126-lan22:17:441
12992991515,0cyclictest65850irq/126-lan21:55:221
12992991515,0cyclictest65850irq/126-lan21:05:141
12992991515,0cyclictest65850irq/126-lan20:26:451
12992991515,0cyclictest65850irq/126-lan20:15:381
12992991515,0cyclictest65850irq/126-lan19:30:131
12992991514,1cyclictest65850irq/126-lan21:50:131
12992991514,1cyclictest65850irq/126-lan21:20:141
12992991514,1cyclictest65850irq/126-lan19:25:121
12992991514,1cyclictest65850irq/126-lan00:30:211
12992991514,1cyclictest65850irq/126-lan00:00:001
12992991414,0cyclictest65850irq/126-lan21:25:191
12992991414,0cyclictest65850irq/126-lan19:40:211
12992991414,0cyclictest65850irq/126-lan00:15:181
12992991413,1cyclictest65850irq/126-lan23:30:131
12992991413,1cyclictest65850irq/126-lan23:25:181
12992991413,1cyclictest65850irq/126-lan22:55:171
12992991413,1cyclictest65850irq/126-lan19:50:121
12992991413,1cyclictest65850irq/126-lan19:10:121
12992991413,1cyclictest65850irq/126-lan00:35:171
12992991413,1cyclictest65850irq/126-lan00:20:151
12992991413,1cyclictest65850irq/126-lan00:10:151
12992991313,0cyclictest65850irq/126-lan20:30:201
12992991313,0cyclictest65850irq/126-lan20:00:181
12992991312,1cyclictest65850irq/126-lan22:40:141
12992991212,0cyclictest65850irq/126-lan23:20:191
12992991212,0cyclictest65850irq/126-lan23:15:141
12992991212,0cyclictest65850irq/126-lan20:40:001
12992991212,0cyclictest65850irq/126-lan00:25:141
12992991211,1cyclictest65850irq/126-lan22:30:411
12992991211,1cyclictest65850irq/126-lan20:20:201
12992991211,1cyclictest65850irq/126-lan20:05:201
12992991111,0cyclictest65850irq/126-lan21:18:441
1299299109,1cyclictest65850irq/126-lan20:10:001
129999998,1cyclictest743-21snmpd22:17:523
129999998,1cyclictest743-21snmpd21:46:083
129999998,1cyclictest743-21snmpd19:41:293
129999998,1cyclictest741-21lldpd00:16:033
129969998,1cyclictest743-21snmpd20:31:212
129929998,1cyclictest65850irq/126-lan22:00:151
129929998,1cyclictest65850irq/126-lan21:39:591
129929998,1cyclictest65850irq/126-lan20:35:151
129879998,1cyclictest743-21snmpd22:38:110
129879998,1cyclictest743-21snmpd20:05:340
129879998,1cyclictest743-21snmpd19:50:510
129999988,0cyclictest743-21snmpd23:51:083
129999988,0cyclictest743-21snmpd23:35:193
129999988,0cyclictest743-21snmpd21:56:373
129999988,0cyclictest743-21snmpd20:51:353
129999988,0cyclictest743-21snmpd00:39:393
129999988,0cyclictest741-21lldpd22:53:073
129999988,0cyclictest741-21lldpd21:27:413
129999987,1cyclictest743-21snmpd23:01:123
129999987,1cyclictest743-21snmpd22:35:223
129999987,1cyclictest743-21snmpd21:53:283
129999987,1cyclictest741-21lldpd19:52:023
129999987,1cyclictest741-21lldpd19:28:283
129999986,2cyclictest743-21snmpd23:27:343
129999986,2cyclictest743-21snmpd23:16:153
129999986,2cyclictest743-21snmpd21:41:093
129999986,2cyclictest743-21snmpd19:19:443
129969988,0cyclictest743-21snmpd23:52:022
129969988,0cyclictest743-21snmpd20:29:252
129969988,0cyclictest743-21snmpd19:39:482
129969988,0cyclictest741-21lldpd23:44:372
129969988,0cyclictest741-21lldpd23:24:412
129969988,0cyclictest741-21lldpd21:05:512
129969987,1cyclictest743-21snmpd21:18:262
129969987,1cyclictest743-21snmpd20:10:392
129969987,1cyclictest741-21lldpd23:47:512
129969987,1cyclictest741-21lldpd21:46:432
129969987,1cyclictest11710-21needreboot21:40:162
129969986,2cyclictest743-21snmpd22:35:552
129969986,2cyclictest743-21snmpd21:30:562
129969986,2cyclictest743-21snmpd20:55:292
129969986,2cyclictest743-21snmpd00:27:122
129929988,0cyclictest741-21lldpd21:45:391
129879988,0cyclictest743-21snmpd22:01:580
129879988,0cyclictest743-21snmpd20:21:430
129879988,0cyclictest741-21lldpd23:56:130
129879988,0cyclictest741-21lldpd23:47:310
129879988,0cyclictest741-21lldpd20:39:440
129879987,1cyclictest743-21snmpd23:30:040
129879987,1cyclictest743-21snmpd21:38:170
129879987,1cyclictest743-21snmpd20:13:250
129879987,1cyclictest743-21snmpd00:03:410
129879987,1cyclictest741-21lldpd20:59:050
129879987,1cyclictest741-21lldpd20:49:560
129879987,1cyclictest741-21lldpd19:58:360
129879987,1cyclictest522-21avahi-daemon19:10:050
129879983,5cyclictest557-21NetworkManager19:35:250
129999977,0cyclictest743-21snmpd22:59:513
129999977,0cyclictest741-21lldpd22:44:183
129999977,0cyclictest741-21lldpd20:30:503
129999977,0cyclictest741-21lldpd19:30:433
129999977,0cyclictest522-21avahi-daemon23:59:183
129999976,1cyclictest743-21snmpd23:22:543
129999976,1cyclictest743-21snmpd21:09:413
129999976,1cyclictest743-21snmpd00:09:113
129999976,1cyclictest741-21lldpd22:07:003
129999975,2cyclictest743-21snmpd20:49:403
129999975,2cyclictest743-21snmpd20:12:363
129999975,2cyclictest743-21snmpd19:12:073
129999975,2cyclictest743-21snmpd00:26:593
129999975,2cyclictest3854-21cat20:05:153
129969977,0cyclictest743-21snmpd23:56:022
129969977,0cyclictest743-21snmpd23:15:332
129969977,0cyclictest743-21snmpd22:28:352
129969977,0cyclictest743-21snmpd00:16:052
129969977,0cyclictest741-21lldpd22:42:062
129969976,1cyclictest743-21snmpd19:31:122
129969976,1cyclictest743-21snmpd00:20:092
129969975,2cyclictest743-21snmpd23:31:042
129969975,2cyclictest743-21snmpd23:25:282
129969975,2cyclictest743-21snmpd23:12:542
129969975,2cyclictest743-21snmpd21:56:552
129969975,2cyclictest743-21snmpd20:41:582
129969975,2cyclictest743-21snmpd20:07:012
129969975,2cyclictest743-21snmpd19:57:302
129969975,2cyclictest743-21snmpd00:37:092
129929976,1cyclictest65850irq/126-lan22:45:241
129879977,0cyclictest743-21snmpd21:58:490
129879977,0cyclictest743-21snmpd19:45:200
129879977,0cyclictest741-21lldpd20:44:450
129879977,0cyclictest741-21lldpd19:31:240
129879977,0cyclictest522-21avahi-daemon19:25:510
129879976,1cyclictest8015-21apt-config21:35:000
129879976,1cyclictest743-21snmpd21:00:050
129879976,1cyclictest743-21snmpd19:24:150
129879976,1cyclictest522-21avahi-daemon21:18:500
129879976,1cyclictest17236-21fschecks_count23:15:140
129879975,2cyclictest743-21snmpd23:22:190
129879975,2cyclictest743-21snmpd22:21:480
129879975,2cyclictest743-21snmpd21:45:390
129879975,2cyclictest743-21snmpd19:42:000
129879975,2cyclictest743-21snmpd00:11:140
129879974,3cyclictest743-21snmpd22:34:230
129879974,3cyclictest743-21snmpd21:40:120
129999966,0cyclictest743-21snmpd23:44:133
129999966,0cyclictest743-21snmpd21:35:123
129999966,0cyclictest741-21lldpd20:04:343
129999966,0cyclictest741-21lldpd19:39:403
129999966,0cyclictest741-21lldpd00:03:353
129999966,0cyclictest522-21avahi-daemon20:22:053
129999964,2cyclictest743-21snmpd23:07:053
129999964,2cyclictest743-21snmpd20:17:253
129969966,0cyclictest743-21snmpd23:00:122
129969966,0cyclictest743-21snmpd22:46:052
129969966,0cyclictest743-21snmpd22:06:062
129969966,0cyclictest741-21lldpd20:20:002
129969965,1cyclictest8705-21cpuspeed_turbos21:35:122
129969965,1cyclictest743-21snmpd22:52:412
129969965,1cyclictest741-21lldpd00:34:222
129969965,1cyclictest20023-21cat20:45:142
129969964,2cyclictest743-21snmpd21:25:002
129969964,2cyclictest743-21snmpd00:06:202
129969964,2cyclictest30517-21cat21:10:152
129969964,2cyclictest30192-21cat19:50:142
129969963,3cyclictest21741-21df20:50:112
129969963,2cyclictest244-20systemd-journal23:35:062
129879966,0cyclictest741-21lldpd21:28:010
129879966,0cyclictest741-21lldpd00:06:370
129879966,0cyclictest522-21avahi-daemon22:13:070
129879965,1cyclictest743-21snmpd23:11:020
129879964,2cyclictest743-21snmpd21:54:210
129879964,2cyclictest743-21snmpd20:00:030
129879963,2cyclictest23511-21cat20:55:000
129879963,0cyclictest9762-21ntpq22:55:170
129879962,3cyclictest28923-21ntp_states21:05:170
129879962,3cyclictest26325-21sed23:35:210
129879962,3cyclictest21913-21ntp_states23:25:170
129879962,3cyclictest13939-21awk23:05:190
129999955,0cyclictest741-21lldpd21:24:453
129999955,0cyclictest522-21avahi-daemon19:59:363
129999954,1cyclictest743-21snmpd22:20:103
129999954,1cyclictest743-21snmpd20:36:403
129999954,1cyclictest741-21lldpd21:30:123
129999954,1cyclictest30373-21ntpq23:45:183
129999954,1cyclictest24645-21needreboot20:55:153
129999954,1cyclictest15399-21gltestperf23:10:143
129999953,2cyclictest743-21snmpd19:45:033
129999953,2cyclictest743-21snmpd19:23:443
129999953,2cyclictest23204-21tr23:30:103
129999952,3cyclictest557-21NetworkManager21:00:193
129999952,2cyclictest5693-21ntpq22:45:193
129999952,2cyclictest32758-21grep21:15:163
129999952,2cyclictest244-20systemd-journal22:26:033
129999952,2cyclictest11874-21sed20:25:133
129999951,4cyclictest557-21NetworkManager22:03:353
129969955,0cyclictest18278-21switchtime19:20:202
129969954,1cyclictest743-21snmpd22:31:442
129969954,1cyclictest743-21snmpd22:16:252
129969953,2cyclictest743-21snmpd19:42:532
129969953,2cyclictest743-21snmpd00:00:202
129969953,2cyclictest15572-21sed19:15:162
129969952,3cyclictest743-21snmpd22:20:032
129969952,3cyclictest557-21NetworkManager22:02:292
129969952,2cyclictest8951-21apt22:55:122
129969952,2cyclictest8035-21sed20:15:162
129969952,2cyclictest575-21rs:main2
129969952,2cyclictest27156-21threads21:00:172
129969951,4cyclictest557-21NetworkManager21:29:062
129969951,3cyclictest14376-21seq23:05:282
129879955,0cyclictest741-21lldpd22:25:480
129879955,0cyclictest522-21avahi-daemon23:42:570
129879955,0cyclictest522-21avahi-daemon21:10:120
129879953,2cyclictest743-21snmpd22:15:040
129879953,2cyclictest11926-21cat20:25:150
129879953,0cyclictest0-21swapper/023:00:130
129879952,3cyclictest557-21NetworkManager22:51:370
129879952,3cyclictest557-21NetworkManager00:29:590
129879952,2cyclictest2595-21ld21:20:160
129879951,2cyclictest14070-21cat00:25:000
129879950,4cyclictest3624-21ntpq22:40:160
129879950,4cyclictest10439-21ntpq00:15:180
129999942,2cyclictest0-21swapper/321:10:163
129999941,2cyclictest8419-21ld00:10:173
129999941,2cyclictest32015-21ntp_kernel_pll_22:30:173
129999941,2cyclictest24039-21ld22:10:163
129999940,3cyclictest17736-21diskstats20:40:143
129999940,3cyclictest13028-21ntp_states00:20:183
129969943,1cyclictest23166-21/usr/sbin/munin22:10:112
129969942,2cyclictest7754-21grep00:10:122
129969941,2cyclictest29128-21seq19:45:442
129969940,4cyclictest20002-21ntpq19:25:152
129969940,3cyclictest2250-21ntp_states20:00:182
129969940,3cyclictest15930-21basename20:35:142
129969940,3cyclictest15636-21cat21:50:162
129879943,1cyclictest16016-21ntpq19:15:190
129879942,2cyclictest743-21snmpd00:35:030
129879941,2cyclictest5595-21strings22:45:180
129879941,2cyclictest21841-21strings22:05:140
129879941,2cyclictest13885-21cut20:30:130
129879940,4cyclictest16975-21ntpq00:30:170
129879940,3cyclictest32296-21ntpq23:50:150
129999930,3cyclictest16657-21if_lan00:30:143
129879930,3cyclictest7425-21/usr/sbin/munin20:15:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional