You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-15 - 06:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Sun Mar 15, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6384991918,1cyclictest65850irq/126-lan21:25:171
6384991918,1cyclictest65850irq/126-lan20:30:221
6384991918,1cyclictest65850irq/126-lan00:30:141
6389991818,0cyclictest743-21snmpd19:11:222
6384991818,0cyclictest65850irq/126-lan23:25:211
6384991818,0cyclictest65850irq/126-lan20:44:051
6384991817,1cyclictest65850irq/126-lan23:15:151
6384991817,1cyclictest65850irq/126-lan22:25:211
6384991817,1cyclictest65850irq/126-lan21:00:211
6384991817,1cyclictest65850irq/126-lan20:20:191
6384991817,1cyclictest65850irq/126-lan19:18:221
6384991817,1cyclictest65850irq/126-lan00:20:081
6389991717,0cyclictest743-21snmpd23:53:002
6389991717,0cyclictest743-21snmpd23:23:532
6389991717,0cyclictest743-21snmpd21:14:582
6389991717,0cyclictest743-21snmpd21:01:012
6389991717,0cyclictest743-21snmpd20:44:542
6389991717,0cyclictest743-21snmpd00:23:432
6389991717,0cyclictest743-21snmpd00:06:432
6389991717,0cyclictest32429-21cat21:30:132
6384991717,0cyclictest65850irq/126-lan22:35:181
6384991717,0cyclictest65850irq/126-lan21:07:251
6384991716,1cyclictest65850irq/126-lan23:00:111
6384991716,1cyclictest65850irq/126-lan22:56:561
6384991716,1cyclictest65850irq/126-lan22:30:201
6384991716,1cyclictest65850irq/126-lan22:00:171
6384991716,1cyclictest65850irq/126-lan21:20:091
6384991716,1cyclictest65850irq/126-lan19:20:151
6389991616,0cyclictest743-21snmpd23:14:232
6389991616,0cyclictest743-21snmpd22:08:502
6389991616,0cyclictest743-21snmpd21:29:412
6389991616,0cyclictest743-21snmpd19:54:532
6389991616,0cyclictest32114-21cat20:10:142
6384991616,0cyclictest65850irq/126-lan21:31:401
6384991615,1cyclictest65850irq/126-lan23:20:191
6384991615,1cyclictest65850irq/126-lan22:20:191
6384991615,1cyclictest65850irq/126-lan22:10:121
6384991615,1cyclictest65850irq/126-lan21:55:191
6384991615,1cyclictest65850irq/126-lan21:50:121
6384991615,1cyclictest65850irq/126-lan20:25:121
6384991615,1cyclictest65850irq/126-lan19:50:181
6384991615,1cyclictest65850irq/126-lan19:35:131
6384991515,0cyclictest65850irq/126-lan22:50:171
6384991515,0cyclictest65850irq/126-lan20:45:211
6384991515,0cyclictest65850irq/126-lan20:00:101
6384991515,0cyclictest65850irq/126-lan00:35:141
6384991514,1cyclictest65850irq/126-lan22:40:191
6384991514,1cyclictest65850irq/126-lan20:10:001
6389991414,0cyclictest743-21snmpd21:05:012
6384991414,0cyclictest65850irq/126-lan22:49:351
6384991414,0cyclictest65850irq/126-lan21:43:191
6384991414,0cyclictest65850irq/126-lan21:35:141
6384991414,0cyclictest65850irq/126-lan19:14:021
6384991413,1cyclictest65850irq/126-lan21:15:131
6384991413,1cyclictest65850irq/126-lan20:50:121
6384991413,1cyclictest65850irq/126-lan19:40:161
6384991413,1cyclictest65850irq/126-lan00:25:121
6389991313,0cyclictest743-21snmpd22:10:032
6384991313,0cyclictest65850irq/126-lan23:06:191
6384991312,1cyclictest65850irq/126-lan23:50:191
6384991312,1cyclictest65850irq/126-lan20:55:141
6384991312,1cyclictest65850irq/126-lan20:05:191
6384991212,0cyclictest65850irq/126-lan23:55:201
6384991212,0cyclictest65850irq/126-lan20:35:171
6384991211,1cyclictest65850irq/126-lan23:40:201
6384991211,1cyclictest65850irq/126-lan23:30:151
6384991211,1cyclictest65850irq/126-lan21:45:131
6384991211,1cyclictest65850irq/126-lan20:16:191
6384991211,1cyclictest65850irq/126-lan19:46:381
6384991211,1cyclictest65850irq/126-lan19:25:141
6384991211,1cyclictest65850irq/126-lan00:15:131
6384991211,1cyclictest65850irq/126-lan00:05:151
6384991111,0cyclictest65850irq/126-lan21:10:171
6384991110,1cyclictest65850irq/126-lan23:35:131
638499109,1cyclictest65850irq/126-lan00:00:171
6384991010,0cyclictest65850irq/126-lan23:10:181
6384991010,0cyclictest65850irq/126-lan22:15:161
63939998,1cyclictest743-21snmpd22:49:043
63939998,1cyclictest743-21snmpd21:09:493
63939997,2cyclictest15166-21idleruntime-cro20:49:593
63899998,1cyclictest743-21snmpd22:30:152
63899998,1cyclictest743-21snmpd20:15:342
63849999,0cyclictest65850irq/126-lan22:05:191
63849998,1cyclictest65850irq/126-lan23:45:121
63769998,1cyclictest743-21snmpd20:23:300
63769998,1cyclictest741-21lldpd22:23:320
63939988,0cyclictest743-21snmpd22:54:493
63939988,0cyclictest743-21snmpd21:46:503
63939988,0cyclictest743-21snmpd20:13:533
63939988,0cyclictest743-21snmpd20:05:503
63939988,0cyclictest741-21lldpd22:05:383
63939987,1cyclictest743-21snmpd19:33:393
63939987,1cyclictest743-21snmpd19:16:133
63939987,1cyclictest741-21lldpd23:36:273
63939986,2cyclictest743-21snmpd23:28:533
63939986,2cyclictest743-21snmpd23:03:583
63939986,2cyclictest743-21snmpd21:50:503
63899988,0cyclictest743-21snmpd23:18:232
63899988,0cyclictest743-21snmpd00:30:042
63899988,0cyclictest743-21snmpd00:19:372
63899988,0cyclictest741-21lldpd20:06:502
63899987,1cyclictest743-21snmpd22:29:272
63899987,1cyclictest244-20systemd-journal21:15:222
63899986,2cyclictest743-21snmpd22:48:372
63899986,2cyclictest743-21snmpd22:17:572
63899986,2cyclictest743-21snmpd20:28:332
63899986,2cyclictest743-21snmpd19:38:462
63849987,1cyclictest743-21snmpd19:30:001
63849987,1cyclictest65850irq/126-lan00:10:211
63769988,0cyclictest743-21snmpd23:50:240
63769988,0cyclictest743-21snmpd22:13:030
63769988,0cyclictest741-21lldpd23:43:130
63769988,0cyclictest741-21lldpd22:57:390
63769988,0cyclictest741-21lldpd00:20:570
63769987,1cyclictest743-21snmpd21:23:060
63769987,1cyclictest741-21lldpd22:25:440
63769987,1cyclictest741-21lldpd19:37:430
63769986,2cyclictest743-21snmpd22:01:390
63769986,2cyclictest743-21snmpd20:39:470
63769986,1cyclictest743-21snmpd23:48:210
63939977,0cyclictest743-21snmpd19:56:353
63939977,0cyclictest741-21lldpd23:09:223
63939977,0cyclictest741-21lldpd22:15:453
63939977,0cyclictest741-21lldpd20:23:183
63939977,0cyclictest741-21lldpd19:47:563
63939976,1cyclictest743-21snmpd22:34:373
63939976,1cyclictest743-21snmpd22:25:123
63939976,1cyclictest741-21lldpd00:13:313
63939976,1cyclictest522-21avahi-daemon21:10:143
63939976,1cyclictest522-21avahi-daemon20:35:233
63939976,1cyclictest522-21avahi-daemon19:41:203
63939976,1cyclictest32228-21fschecks_time21:30:123
63939976,1cyclictest28525-21gltestperf00:00:143
63939975,2cyclictest743-21snmpd22:23:203
63939975,2cyclictest743-21snmpd20:59:403
63939975,2cyclictest743-21snmpd19:25:523
63939975,2cyclictest743-21snmpd00:22:373
63899977,0cyclictest743-21snmpd23:58:302
63899977,0cyclictest743-21snmpd22:39:252
63899977,0cyclictest743-21snmpd21:55:322
63899977,0cyclictest743-21snmpd21:52:312
63899977,0cyclictest741-21lldpd21:24:332
63899977,0cyclictest741-21lldpd19:55:042
63899977,0cyclictest741-21lldpd19:30:502
63899976,1cyclictest743-21snmpd23:05:232
63899975,2cyclictest743-21snmpd23:32:262
63899975,2cyclictest743-21snmpd20:33:542
63899975,2cyclictest743-21snmpd00:01:272
63769977,0cyclictest743-21snmpd19:47:320
63769977,0cyclictest741-21lldpd22:46:440
63769977,0cyclictest741-21lldpd21:09:020
63769977,0cyclictest741-21lldpd00:27:050
63769977,0cyclictest506-21systemd-resolve20:25:330
63769976,1cyclictest743-21snmpd23:31:110
63769976,1cyclictest743-21snmpd23:28:440
63769976,1cyclictest743-21snmpd22:30:420
63769976,1cyclictest522-21avahi-daemon00:30:210
63769976,1cyclictest30501-21fschecks_time00:05:130
63769975,2cyclictest743-21snmpd20:06:200
63769975,2cyclictest743-21snmpd19:52:020
63769975,2cyclictest743-21snmpd19:22:520
63939966,0cyclictest743-21snmpd23:53:123
63939966,0cyclictest743-21snmpd21:38:353
63939966,0cyclictest743-21snmpd21:20:193
63939966,0cyclictest743-21snmpd21:02:073
63939966,0cyclictest743-21snmpd00:28:163
63939966,0cyclictest741-21lldpd20:52:543
63939966,0cyclictest741-21lldpd20:40:543
63939966,0cyclictest741-21lldpd00:07:393
63939965,1cyclictest743-21snmpd23:16:083
63939965,1cyclictest741-21lldpd23:21:523
63939965,1cyclictest741-21lldpd22:11:233
63939965,1cyclictest522-21avahi-daemon20:33:463
63939965,1cyclictest22435-21gltestperf23:45:143
63939964,2cyclictest743-21snmpd22:37:283
63939963,3cyclictest557-21NetworkManager21:40:163
63899966,0cyclictest741-21lldpd23:35:272
63899966,0cyclictest741-21lldpd00:37:492
63899965,1cyclictest8656-21cpuspeed_turbos19:15:122
63899965,1cyclictest5639-21/usr/sbin/munin21:45:182
63899964,2cyclictest743-21snmpd23:43:142
63899964,2cyclictest743-21snmpd22:00:542
63899964,2cyclictest743-21snmpd20:55:102
63899964,2cyclictest743-21snmpd19:25:042
63899964,2cyclictest557-21NetworkManager00:25:222
63899964,2cyclictest3994-21cat23:00:142
63849965,1cyclictest65850irq/126-lan19:55:201
63769966,0cyclictest743-21snmpd20:59:460
63769966,0cyclictest741-21lldpd22:53:360
63769966,0cyclictest741-21lldpd20:40:520
63769965,1cyclictest743-21snmpd21:31:500
63769965,1cyclictest743-21snmpd20:02:080
63769965,1cyclictest26604-21cat23:55:140
63769964,2cyclictest743-21snmpd23:07:170
63769964,2cyclictest743-21snmpd21:27:470
63769964,2cyclictest743-21snmpd19:58:290
63769962,3cyclictest8716-21users20:30:220
63769962,3cyclictest2876-21find00:15:190
63769962,3cyclictest1846-21memory20:15:160
63769961,2cyclictest13553-21cat23:25:000
63939955,0cyclictest522-21avahi-daemon22:57:573
63939955,0cyclictest522-21avahi-daemon21:28:503
63939955,0cyclictest522-21avahi-daemon20:27:393
63939955,0cyclictest522-21avahi-daemon00:18:183
63939954,1cyclictest8350-21ntpq23:10:183
63939954,1cyclictest743-21snmpd21:17:403
63939954,1cyclictest522-21avahi-daemon23:56:383
63939954,1cyclictest10468-21ntpq21:55:173
63939953,2cyclictest10672-21ntpq00:35:163
63939952,3cyclictest557-21NetworkManager20:15:343
63939952,2cyclictest244-20systemd-journal19:50:363
63939952,2cyclictest18353-21cat19:35:203
63939951,3cyclictest244-20systemd-journal23:30:463
63899954,1cyclictest743-21snmpd00:14:222
63899954,1cyclictest13871-21apt-config23:24:592
63899953,2cyclictest3328-21apt-get20:20:102
63899952,3cyclictest557-21NetworkManager22:51:312
63899952,2cyclictest717-21ntpd20:45:162
63899952,2cyclictest575-21rs:main2
63899952,2cyclictest575-21rs:main2
63899952,2cyclictest4791-21sed21:40:202
63899952,2cyclictest2894-21awk21:35:192
63899952,2cyclictest23392-21cat19:49:592
63899952,2cyclictest15791-21sed20:50:132
63769955,0cyclictest743-21snmpd00:13:340
63769955,0cyclictest741-21lldpd23:36:510
63769955,0cyclictest522-21avahi-daemon19:41:060
63769954,1cyclictest743-21snmpd20:53:300
63769954,1cyclictest743-21snmpd00:37:260
63769954,1cyclictest522-21avahi-daemon19:18:430
63769954,1cyclictest4168-21needreboot23:00:150
63769954,1cyclictest31743-21cpuspeed_turbos20:10:110
63769953,2cyclictest743-21snmpd19:27:550
63769952,3cyclictest28680-21grep22:40:130
63769952,2cyclictest244-20systemd-journal21:43:100
63769952,2cyclictest24163-21grep21:10:150
63769952,2cyclictest11044-21grep21:55:210
63939943,1cyclictest511ktimers/320:00:143
63939942,2cyclictest743-21snmpd22:41:103
63939942,2cyclictest743-21snmpd19:10:483
63939942,2cyclictest11979-21tune2fs22:00:133
63939941,2cyclictest10925-21grep19:20:133
63939940,4cyclictest557-21NetworkManager23:40:123
63939940,3cyclictest8103-21diskstats00:30:123
63899943,1cyclictest0-21swapper/222:55:092
63899941,2cyclictest27646-21apt-get20:00:102
63899941,2cyclictest19388-21dpkg19:40:002
63899940,3cyclictest9359-21find20:35:112
63899940,3cyclictest22839-21ntp_192.168.11423:45:162
63899940,3cyclictest10789-21diskstats19:20:122
63769942,2cyclictest743-21snmpd20:45:090
63769942,2cyclictest26464-21tr22:35:160
63769942,2cyclictest25595-21tr21:15:120
63769941,3cyclictest7740-21df_inode23:10:140
63769941,2cyclictest8042-21grep21:50:130
63769941,2cyclictest7624-21wc19:10:210
63769941,2cyclictest15056-21tail19:30:130
63769940,3cyclictest6373-21ntpq21:45:150
63769940,3cyclictest28521-21fw_forwarded_lo00:00:140
63769940,3cyclictest19763-21perl21:00:130
63769940,3cyclictest17932-21diskstats22:15:140
63769940,3cyclictest1789-21diskstats21:35:120
63769940,3cyclictest14576-21ntpq22:05:160
63769940,3cyclictest10444-21ntpq23:15:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional