You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 11:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Wed Jul 22, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22584992017,1cyclictest65850irq/126-lan23:05:190
22584991918,1cyclictest65850irq/126-lan23:35:130
22584991918,1cyclictest65850irq/126-lan23:10:180
22584991918,1cyclictest65850irq/126-lan22:40:120
22584991818,0cyclictest65850irq/126-lan20:15:130
22584991817,0cyclictest65850irq/126-lan21:16:020
22584991817,0cyclictest65850irq/126-lan21:16:020
22584991717,0cyclictest65850irq/126-lan22:55:140
22584991717,0cyclictest65850irq/126-lan22:30:020
22584991717,0cyclictest65850irq/126-lan21:35:150
22584991717,0cyclictest65850irq/126-lan20:35:150
22584991717,0cyclictest65850irq/126-lan00:39:220
22584991716,1cyclictest65850irq/126-lan23:50:170
22584991716,1cyclictest65850irq/126-lan21:00:170
22584991716,1cyclictest65850irq/126-lan19:50:100
22584991716,1cyclictest65850irq/126-lan00:25:140
22584991716,1cyclictest65850irq/126-lan00:10:160
22584991716,1cyclictest65850irq/126-lan00:05:160
22584991616,0cyclictest65850irq/126-lan20:25:130
22584991616,0cyclictest65850irq/126-lan19:40:210
22584991615,1cyclictest65850irq/126-lan23:15:150
22584991615,1cyclictest65850irq/126-lan23:00:190
22584991615,1cyclictest65850irq/126-lan22:25:140
22584991615,1cyclictest65850irq/126-lan22:20:110
22584991615,1cyclictest65850irq/126-lan22:05:240
22584991615,1cyclictest65850irq/126-lan21:40:150
22584991615,1cyclictest65850irq/126-lan21:25:150
22584991615,1cyclictest65850irq/126-lan20:55:470
22584991615,1cyclictest65850irq/126-lan20:45:120
22584991515,0cyclictest65850irq/126-lan22:15:130
22584991515,0cyclictest65850irq/126-lan20:40:200
22584991515,0cyclictest65850irq/126-lan19:30:130
22584991514,1cyclictest65850irq/126-lan23:45:170
22584991514,1cyclictest65850irq/126-lan23:40:140
22584991514,1cyclictest65850irq/126-lan22:45:170
22584991514,1cyclictest65850irq/126-lan21:45:130
22584991514,1cyclictest65850irq/126-lan20:10:010
22584991514,1cyclictest65850irq/126-lan20:05:140
22584991514,1cyclictest65850irq/126-lan00:20:140
22584991514,1cyclictest65850irq/126-lan00:00:210
22584991414,0cyclictest65850irq/126-lan19:36:180
22584991413,1cyclictest65850irq/126-lan23:30:110
22584991413,1cyclictest65850irq/126-lan21:50:140
22584991413,1cyclictest65850irq/126-lan21:20:160
22584991413,1cyclictest65850irq/126-lan21:20:160
22584991413,1cyclictest65850irq/126-lan20:50:200
22584991413,1cyclictest65850irq/126-lan20:04:180
22584991413,1cyclictest65850irq/126-lan00:15:210
22584991313,0cyclictest65850irq/126-lan21:10:140
22584991312,1cyclictest65850irq/126-lan23:20:130
22584991312,1cyclictest65850irq/126-lan22:00:170
22584991312,1cyclictest65850irq/126-lan21:30:120
22584991312,1cyclictest65850irq/126-lan20:30:210
22584991312,1cyclictest65850irq/126-lan19:55:220
22584991312,1cyclictest65850irq/126-lan19:45:200
22584991312,1cyclictest65850irq/126-lan19:25:130
22584991312,1cyclictest65850irq/126-lan19:20:200
22584991312,1cyclictest65850irq/126-lan19:15:160
22584991312,1cyclictest65850irq/126-lan00:34:040
22584991212,0cyclictest65850irq/126-lan22:35:220
22584991211,1cyclictest65850irq/126-lan21:05:160
22584991111,0cyclictest65850irq/126-lan22:50:000
22584991111,0cyclictest65850irq/126-lan19:10:170
22584991110,1cyclictest65850irq/126-lan20:20:190
22593991010,0cyclictest13380-21fwupd20:05:012
2258499109,1cyclictest65850irq/126-lan22:10:150
2258499109,1cyclictest65850irq/126-lan21:55:140
22584991010,0cyclictest65850irq/126-lan23:25:120
225999998,1cyclictest743-21snmpd00:13:563
225999998,1cyclictest743-21snmpd00:06:473
225999998,1cyclictest741-21lldpd22:13:223
225999998,1cyclictest741-21lldpd21:34:593
225939998,1cyclictest743-21snmpd23:25:102
225939998,1cyclictest743-21snmpd22:36:452
225939998,1cyclictest741-21lldpd23:53:542
225899998,1cyclictest743-21snmpd21:00:291
225849999,0cyclictest65850irq/126-lan23:55:150
225999988,0cyclictest743-21snmpd23:28:163
225999988,0cyclictest743-21snmpd22:31:473
225999988,0cyclictest741-21lldpd22:35:033
225999988,0cyclictest741-21lldpd19:27:033
225999988,0cyclictest741-21lldpd00:25:523
225999987,1cyclictest743-21snmpd23:20:013
225999987,1cyclictest743-21snmpd21:59:223
225999987,1cyclictest743-21snmpd19:57:033
225999987,1cyclictest743-21snmpd19:43:293
225999987,1cyclictest741-21lldpd23:59:003
225999987,1cyclictest741-21lldpd22:21:103
225999987,1cyclictest741-21lldpd20:07:243
225999986,2cyclictest743-21snmpd23:50:383
225999986,2cyclictest743-21snmpd23:02:123
225999986,2cyclictest743-21snmpd22:49:533
225999986,2cyclictest743-21snmpd21:14:273
225999986,2cyclictest743-21snmpd20:55:263
225999986,2cyclictest743-21snmpd20:37:433
225939988,0cyclictest743-21snmpd20:47:412
225939988,0cyclictest743-21snmpd19:55:032
225939988,0cyclictest741-21lldpd20:16:342
225939988,0cyclictest741-21lldpd19:40:142
225939987,1cyclictest741-21lldpd23:00:232
225939987,1cyclictest25663-21fschecks_count23:10:142
225939986,2cyclictest743-21snmpd23:35:042
225939986,2cyclictest743-21snmpd22:21:532
225939986,2cyclictest743-21snmpd21:26:482
225939986,2cyclictest743-21snmpd19:28:262
225939985,3cyclictest743-21snmpd21:51:342
225899988,0cyclictest743-21snmpd23:22:031
225899988,0cyclictest743-21snmpd19:24:561
225899988,0cyclictest743-21snmpd00:11:391
225899987,1cyclictest743-21snmpd23:17:271
225899987,1cyclictest743-21snmpd22:51:091
225899987,1cyclictest743-21snmpd21:36:541
225899987,1cyclictest743-21snmpd19:34:501
225899987,1cyclictest743-21snmpd19:17:531
225899986,2cyclictest743-21snmpd23:32:521
225899986,2cyclictest743-21snmpd22:29:291
225899986,2cyclictest743-21snmpd22:20:511
225899986,2cyclictest743-21snmpd20:46:591
225899986,2cyclictest743-21snmpd20:25:191
225899986,2cyclictest743-21snmpd19:54:061
225899986,2cyclictest743-21snmpd00:38:451
225899986,2cyclictest31228-21cat22:05:181
225899985,3cyclictest743-21snmpd00:26:481
225999977,0cyclictest741-21lldpd22:15:343
225999977,0cyclictest741-21lldpd19:46:203
225999977,0cyclictest522-21avahi-daemon19:11:543
225999976,1cyclictest743-21snmpd23:48:433
225999976,1cyclictest743-21snmpd22:59:303
225999976,1cyclictest743-21snmpd22:25:323
225999976,1cyclictest743-21snmpd21:52:433
225999976,1cyclictest743-21snmpd21:22:213
225999976,1cyclictest743-21snmpd21:22:213
225999976,1cyclictest743-21snmpd20:32:373
225999976,1cyclictest522-21avahi-daemon23:36:153
225999975,2cyclictest743-21snmpd22:04:583
225999975,2cyclictest743-21snmpd20:50:533
225999973,3cyclictest13389-21ntp_states22:40:173
225939977,0cyclictest743-21snmpd23:41:462
225939977,0cyclictest743-21snmpd23:19:362
225939977,0cyclictest743-21snmpd22:45:532
225939977,0cyclictest743-21snmpd22:18:052
225939977,0cyclictest741-21lldpd20:36:192
225939977,0cyclictest741-21lldpd20:04:482
225939977,0cyclictest741-21lldpd00:08:002
225939976,1cyclictest20257-21/usr/sbin/munin21:40:192
225939976,1cyclictest19564-21cron21:40:002
225939975,2cyclictest743-21snmpd20:40:552
225939975,2cyclictest743-21snmpd19:11:252
225939975,2cyclictest16124-21tail21:30:142
225939974,3cyclictest20775-21users22:55:232
225939973,3cyclictest17817-21ntp_states22:50:172
225899977,0cyclictest743-21snmpd23:57:231
225899977,0cyclictest743-21snmpd22:10:431
225899977,0cyclictest743-21snmpd22:00:551
225899977,0cyclictest743-21snmpd00:17:231
225899977,0cyclictest741-21lldpd19:47:461
225899977,0cyclictest741-21lldpd19:11:291
225899977,0cyclictest506-21systemd-resolve23:41:351
225899976,1cyclictest743-21snmpd22:55:151
225899976,1cyclictest743-21snmpd21:29:031
225899975,2cyclictest743-21snmpd23:50:101
225899975,2cyclictest743-21snmpd21:58:371
225899975,2cyclictest743-21snmpd00:24:321
225899975,2cyclictest743-21snmpd00:01:471
225899972,5cyclictest557-21NetworkManager22:41:401
225999966,0cyclictest741-21lldpd19:36:023
225999966,0cyclictest741-21lldpd19:31:273
225999966,0cyclictest522-21avahi-daemon00:15:373
225999965,1cyclictest743-21snmpd23:11:363
225999965,1cyclictest743-21snmpd22:05:403
225999965,1cyclictest743-21snmpd21:42:403
225999965,1cyclictest743-21snmpd20:49:293
225999965,1cyclictest743-21snmpd20:15:013
225999964,2cyclictest743-21snmpd23:16:543
225999964,2cyclictest743-21snmpd21:45:313
225999964,2cyclictest743-21snmpd00:22:113
225999964,2cyclictest13736-21cat00:00:153
225999962,3cyclictest5423-21diskstats21:05:153
225999962,3cyclictest244-20systemd-journal20:22:043
225939966,0cyclictest743-21snmpd23:34:462
225939966,0cyclictest743-21snmpd00:12:412
225939966,0cyclictest741-21lldpd21:56:162
225939966,0cyclictest741-21lldpd21:09:592
225939966,0cyclictest5420-21cpuspeed_turbos19:45:142
225939965,1cyclictest743-21snmpd20:28:162
225939965,1cyclictest522-21avahi-daemon22:44:322
225939965,1cyclictest522-21avahi-daemon22:04:432
225939965,1cyclictest31661-21cpuspeed_turbos20:50:122
225939965,1cyclictest244-20systemd-journal22:05:172
225939964,2cyclictest743-21snmpd23:24:342
225939964,2cyclictest743-21snmpd22:32:292
225939964,2cyclictest743-21snmpd19:53:482
225939964,2cyclictest743-21snmpd19:16:012
225939963,3cyclictest23975-21df00:25:152
225939963,2cyclictest8134-21ntpq21:10:192
225939963,2cyclictest244-20systemd-journal23:48:212
225939962,3cyclictest22226-21ntp_states00:20:172
225899966,0cyclictest743-21snmpd20:52:471
225899966,0cyclictest741-21lldpd21:49:421
225899966,0cyclictest741-21lldpd20:32:091
225899966,0cyclictest522-21avahi-daemon23:06:541
225899966,0cyclictest522-21avahi-daemon22:39:031
225899966,0cyclictest17199-21idleruntime-cro20:15:001
225899964,2cyclictest743-21snmpd20:58:021
225899964,2cyclictest743-21snmpd20:38:281
225899962,3cyclictest4378-21sed23:35:201
225899960,5cyclictest4444-21seq19:42:261
225999955,0cyclictest743-21snmpd23:40:313
225999954,1cyclictest27954-21hddtemp_smartct20:40:163
225999954,1cyclictest23260-21munin-plugin-st20:30:003
225999953,2cyclictest743-21snmpd23:05:523
225999953,2cyclictest743-21snmpd20:02:333
225999953,2cyclictest743-21snmpd19:24:053
225999952,2cyclictest16537-21date22:50:013
225999951,3cyclictest9978-21ntp_192.168.11421:15:153
225999951,3cyclictest9978-21ntp_192.168.11421:15:153
225999951,3cyclictest244-20systemd-journal00:36:353
225999950,4cyclictest8161-21ntpq19:50:153
225939955,0cyclictest573-21in:imuxsock22:10:592
225939955,0cyclictest23617-21head21:45:212
225939954,1cyclictest741-21lldpd00:36:062
225939954,1cyclictest522-21avahi-daemon19:35:172
225939954,1cyclictest24243-21ntp_kernel_err20:30:162
225939954,1cyclictest11953-21ntpq23:55:162
225939953,2cyclictest743-21snmpd21:03:442
225939952,2cyclictest575-21rs:main2
225939952,2cyclictest12607-21ld21:20:212
225939952,2cyclictest12607-21ld21:20:202
225939951,4cyclictest557-21NetworkManager23:06:212
225939951,4cyclictest557-21NetworkManager19:33:482
225939950,4cyclictest10135-21ntpq21:15:172
225939950,4cyclictest10135-21ntpq21:15:172
225899955,0cyclictest743-21snmpd21:20:211
225899955,0cyclictest743-21snmpd21:20:211
225899955,0cyclictest743-21snmpd19:29:471
225899955,0cyclictest741-21lldpd20:41:451
225899955,0cyclictest741-21lldpd00:31:381
225899955,0cyclictest522-21avahi-daemon23:02:381
225899954,1cyclictest743-21snmpd21:50:371
225899954,1cyclictest2657-21fschecks_time22:15:131
225899954,1cyclictest19747-21fschecks_time20:20:131
225899954,1cyclictest13502-21cpuspeed_turbos20:05:121
225899954,1cyclictest11115-21sendmail20:00:001
225899953,2cyclictest743-21snmpd21:30:241
225899952,3cyclictest9443-21diskstats21:15:121
225899952,3cyclictest9443-21diskstats21:15:121
225899952,2cyclictest244-20systemd-journal20:04:251
225899952,2cyclictest19042-21seq20:18:091
225899950,4cyclictest21106-21ntpq21:40:181
225999942,2cyclictest717-21ntpd20:10:133
225999942,2cyclictest1594-21cat23:30:143
225999941,2cyclictest575-21rs:main3
225999941,2cyclictest3475-21sort21:00:143
225999941,2cyclictest18369-21cat21:35:163
225999940,3cyclictest26417-21diskstats00:30:113
225999940,3cyclictest25240-21/usr/sbin/munin19:15:143
225939942,2cyclictest743-21snmpd00:15:082
225939941,2cyclictest6853-21cut22:25:152
225939941,2cyclictest15744-21grep20:10:152
225939941,2cyclictest14300-21grep00:00:192
225939941,2cyclictest1211-21dpkg20:55:132
225939940,3cyclictest28213-21ps19:20:162
225939940,3cyclictest19488-21dpkg20:20:122
225899944,0cyclictest741-21lldpd22:46:251
225899942,2cyclictest743-21snmpd21:10:151
225899941,2cyclictest32379-21sh23:25:161
225899940,4cyclictest26308-21ntpq23:10:181
225899940,3cyclictest8660-21diskstats22:30:141
225899940,3cyclictest8064-21ntpq23:45:181
225899940,3cyclictest5460-21fschecks_count21:05:161
225899940,3cyclictest16154-21ntp_states00:05:171
225899940,3cyclictest1042-21diskstats19:35:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional