You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-15 - 03:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Wed Jul 15, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29018991918,1cyclictest65850irq/126-lan22:30:170
29018991918,1cyclictest65850irq/126-lan22:00:180
29018991817,1cyclictest65850irq/126-lan23:00:210
29018991817,1cyclictest65850irq/126-lan20:50:140
29018991817,1cyclictest65850irq/126-lan20:15:170
29018991817,1cyclictest65850irq/126-lan19:10:160
29018991717,0cyclictest65850irq/126-lan22:49:080
29018991717,0cyclictest65850irq/126-lan22:15:230
29018991717,0cyclictest65850irq/126-lan21:35:220
29018991717,0cyclictest65850irq/126-lan00:35:170
29018991716,1cyclictest65850irq/126-lan23:53:440
29018991716,1cyclictest65850irq/126-lan23:25:150
29018991716,1cyclictest65850irq/126-lan22:50:180
29018991716,1cyclictest65850irq/126-lan21:40:210
29018991716,1cyclictest65850irq/126-lan20:55:130
29018991716,1cyclictest65850irq/126-lan20:20:190
29018991716,1cyclictest65850irq/126-lan19:25:000
29018991716,1cyclictest65850irq/126-lan00:30:190
29018991716,1cyclictest65850irq/126-lan00:20:140
29018991616,0cyclictest65850irq/126-lan23:47:510
29018991616,0cyclictest65850irq/126-lan21:20:100
29018991615,1cyclictest65850irq/126-lan23:10:130
29018991615,1cyclictest65850irq/126-lan22:40:140
29018991615,1cyclictest65850irq/126-lan22:25:120
29018991615,1cyclictest65850irq/126-lan21:50:180
29018991615,1cyclictest65850irq/126-lan19:50:220
29018991515,0cyclictest65850irq/126-lan22:20:210
29018991515,0cyclictest65850irq/126-lan21:45:150
29018991515,0cyclictest65850irq/126-lan21:25:160
29018991515,0cyclictest65850irq/126-lan19:15:140
29018991515,0cyclictest65850irq/126-lan00:10:190
29018991514,1cyclictest65850irq/126-lan23:33:150
29018991514,1cyclictest65850irq/126-lan23:22:300
29018991514,1cyclictest65850irq/126-lan20:41:000
29018991514,1cyclictest65850irq/126-lan20:10:220
29018991514,1cyclictest65850irq/126-lan00:25:130
29018991514,1cyclictest65850irq/126-lan00:15:170
29018991414,0cyclictest65850irq/126-lan22:35:200
29018991414,0cyclictest65850irq/126-lan19:30:130
29018991413,1cyclictest65850irq/126-lan22:55:190
29018991413,1cyclictest65850irq/126-lan21:55:120
29018991413,1cyclictest65850irq/126-lan21:15:220
29018991413,1cyclictest65850irq/126-lan20:35:030
29018991413,1cyclictest65850irq/126-lan20:35:000
29018991413,1cyclictest65850irq/126-lan19:55:170
29018991413,1cyclictest65850irq/126-lan00:05:130
29018991413,1cyclictest65850irq/126-lan00:00:230
29018991313,0cyclictest65850irq/126-lan21:30:160
29018991313,0cyclictest65850irq/126-lan21:05:110
29018991313,0cyclictest65850irq/126-lan19:40:160
29018991312,1cyclictest65850irq/126-lan23:05:160
29018991312,1cyclictest65850irq/126-lan22:10:130
29018991312,1cyclictest65850irq/126-lan20:03:430
29018991312,1cyclictest65850irq/126-lan19:25:330
2902899128,4cyclictest743-21snmpd00:05:572
29018991212,0cyclictest65850irq/126-lan23:55:210
29018991212,0cyclictest65850irq/126-lan19:35:160
29018991211,1cyclictest65850irq/126-lan23:40:190
29018991211,1cyclictest65850irq/126-lan22:05:180
29018991211,1cyclictest65850irq/126-lan20:45:000
29018991211,1cyclictest65850irq/126-lan19:45:180
2902899118,3cyclictest743-21snmpd21:58:442
2902899118,3cyclictest741-21lldpd21:54:282
29018991111,0cyclictest65850irq/126-lan20:05:000
29018991110,1cyclictest65850irq/126-lan21:10:140
29018991110,1cyclictest65850irq/126-lan20:25:220
2902899108,2cyclictest741-21lldpd19:49:512
2902899106,4cyclictest743-21snmpd23:57:542
2902899106,4cyclictest743-21snmpd00:25:162
2902899106,1cyclictest741-21lldpd23:02:232
2902899105,2cyclictest743-21snmpd20:02:012
290339998,1cyclictest743-21snmpd20:50:453
290339998,1cyclictest743-21snmpd19:29:573
290289996,3cyclictest743-21snmpd23:18:232
290289996,3cyclictest743-21snmpd21:21:462
290189998,1cyclictest65850irq/126-lan21:00:130
290339988,0cyclictest743-21snmpd20:45:383
290339988,0cyclictest743-21snmpd20:40:543
290339988,0cyclictest741-21lldpd22:52:003
290339988,0cyclictest741-21lldpd22:35:123
290339988,0cyclictest741-21lldpd20:26:133
290339988,0cyclictest741-21lldpd00:29:563
290339987,1cyclictest743-21snmpd23:41:513
290339987,1cyclictest743-21snmpd21:37:053
290339987,1cyclictest743-21snmpd21:21:223
290339987,1cyclictest741-21lldpd23:10:313
290339987,1cyclictest26107-21cut23:00:003
290339987,1cyclictest14163-21fschecks_time21:10:133
290339986,2cyclictest743-21snmpd00:23:073
290339984,3cyclictest890-21ntp_states23:15:183
290289988,0cyclictest743-21snmpd21:40:262
290289988,0cyclictest743-21snmpd20:16:222
290289988,0cyclictest743-21snmpd19:39:582
290289988,0cyclictest743-21snmpd19:24:332
290289988,0cyclictest741-21lldpd00:33:202
290289987,1cyclictest743-21snmpd21:47:022
290289987,1cyclictest741-21lldpd22:16:332
290289986,2cyclictest743-21snmpd22:29:572
290289986,2cyclictest743-21snmpd21:00:042
290289986,2cyclictest743-21snmpd00:00:062
290289985,1cyclictest741-21lldpd21:28:082
290289985,0cyclictest5842-21gltestperf19:30:122
290239988,0cyclictest743-21snmpd21:39:251
290239988,0cyclictest743-21snmpd20:20:291
290239988,0cyclictest743-21snmpd20:09:531
290239988,0cyclictest741-21lldpd19:23:381
290239987,1cyclictest743-21snmpd00:28:191
290239987,1cyclictest743-21snmpd00:21:311
290239987,1cyclictest741-21lldpd20:45:331
290239980,5cyclictest14277-21ntpq19:50:171
290189988,0cyclictest741-21lldpd23:35:420
290339977,0cyclictest743-21snmpd21:30:473
290339977,0cyclictest743-21snmpd19:21:063
290339977,0cyclictest741-21lldpd23:08:153
290339977,0cyclictest741-21lldpd21:15:193
290339977,0cyclictest741-21lldpd21:04:083
290339977,0cyclictest741-21lldpd20:14:053
290339977,0cyclictest741-21lldpd20:08:153
290339977,0cyclictest522-21avahi-daemon19:31:453
290339977,0cyclictest522-21avahi-daemon00:34:203
290339976,1cyclictest743-21snmpd21:47:533
290339976,1cyclictest743-21snmpd19:57:323
290339976,1cyclictest21087-21gltestperf00:05:143
290339976,1cyclictest16994-21gltestperf23:55:133
290339976,1cyclictest14948-21gltestperf23:50:143
290339976,1cyclictest11625-21cpuspeed_turbos19:45:133
290339975,2cyclictest743-21snmpd22:41:013
290339975,2cyclictest743-21snmpd22:28:093
290339975,2cyclictest743-21snmpd22:03:573
290339975,2cyclictest743-21snmpd20:57:373
290339975,2cyclictest12311-21cat21:05:143
290289977,0cyclictest743-21snmpd20:45:082
290289977,0cyclictest743-21snmpd20:28:512
290289977,0cyclictest743-21snmpd20:24:532
290289977,0cyclictest741-21lldpd22:46:152
290289977,0cyclictest741-21lldpd22:20:042
290289976,1cyclictest743-21snmpd21:19:012
290289976,1cyclictest743-21snmpd21:13:012
290289976,1cyclictest717-21ntpd20:50:142
290289976,1cyclictest10646-21cpuspeed_turbos23:40:092
290289975,2cyclictest743-21snmpd22:55:102
290289975,2cyclictest743-21snmpd22:06:022
290289975,2cyclictest743-21snmpd20:40:302
290289975,2cyclictest743-21snmpd00:35:252
290289972,2cyclictest19101-21ld22:40:172
290239977,0cyclictest743-21snmpd20:27:031
290239977,0cyclictest743-21snmpd19:42:401
290239977,0cyclictest741-21lldpd19:25:561
290239977,0cyclictest741-21lldpd19:13:521
290239976,1cyclictest743-21snmpd21:27:201
290239976,1cyclictest29060-21needreboot23:05:161
290239976,1cyclictest27120-21cut21:40:161
290239976,1cyclictest15775-21fschecks_count19:55:141
290239976,0cyclictest191rcu_preempt23:10:191
290239976,0cyclictest191rcu_preempt22:51:161
290239976,0cyclictest191rcu_preempt21:00:001
290239976,0cyclictest191rcu_preempt19:19:591
290239975,2cyclictest743-21snmpd22:37:191
290239975,2cyclictest743-21snmpd22:24:241
290239975,2cyclictest743-21snmpd20:52:091
290239975,2cyclictest743-21snmpd20:44:481
290239975,2cyclictest743-21snmpd00:18:121
290239975,2cyclictest717-21ntpd23:35:401
290239975,2cyclictest717-21ntpd20:35:131
290239975,2cyclictest717-21ntpd20:00:101
290239975,0cyclictest191rcu_preempt00:05:211
290239974,2cyclictest0-21swapper/121:51:451
290239973,3cyclictest0-21swapper/100:10:131
290239972,3cyclictest34-21ksoftirqd/122:40:171
290239972,1cyclictest0-21swapper/120:30:191
290239972,1cyclictest0-21swapper/119:49:591
290239970,5cyclictest8953-21ntpq22:15:181
290239970,5cyclictest18733-21grep00:00:131
290189975,2cyclictest743-21snmpd23:17:290
290339966,0cyclictest743-21snmpd19:15:333
290339966,0cyclictest741-21lldpd23:04:113
290339966,0cyclictest522-21avahi-daemon19:12:423
290339966,0cyclictest20472-21dump-pmu-power00:05:003
290339965,1cyclictest743-21snmpd19:40:213
290339965,1cyclictest522-21avahi-daemon22:45:023
290339965,1cyclictest522-21avahi-daemon22:10:213
290339965,1cyclictest2743-21grep23:20:163
290339965,1cyclictest26718-21fschecks_time21:40:143
290339963,3cyclictest4257-21diskstats23:25:133
290339962,3cyclictest25309-21memory00:15:173
290339962,3cyclictest244-20systemd-journal21:55:093
290289966,0cyclictest743-21snmpd21:30:172
290289966,0cyclictest743-21snmpd20:38:212
290289966,0cyclictest743-21snmpd00:21:282
290289966,0cyclictest741-21lldpd23:34:162
290289966,0cyclictest741-21lldpd20:31:132
290289965,1cyclictest13624-21cron21:10:002
290289964,2cyclictest743-21snmpd22:33:522
290289964,2cyclictest743-21snmpd19:55:172
290289964,2cyclictest743-21snmpd00:17:332
290289964,2cyclictest717-21ntpd23:05:142
290289962,3cyclictest5390-21grep23:25:222
290289962,3cyclictest244-20systemd-journal22:35:162
290239966,0cyclictest741-21lldpd22:00:261
290239966,0cyclictest741-21lldpd21:13:301
290239966,0cyclictest741-21lldpd21:08:421
290239966,0cyclictest29011-21cyclictest19:35:101
290239966,0cyclictest12316-21cpuspeed_turbos22:25:121
290239965,1cyclictest743-21snmpd23:41:301
290239965,1cyclictest2282-21fschecks_count23:20:141
290239965,1cyclictest21980-21cut20:10:151
290239965,0cyclictest191rcu_preempt23:15:161
290239965,0cyclictest191rcu_preempt22:05:051
290239965,0cyclictest191rcu_preempt20:15:201
290239964,1cyclictest743-21snmpd22:30:181
290239964,0cyclictest191rcu_preempt21:15:441
290239964,0cyclictest191rcu_preempt21:00:181
290239963,1cyclictest34-21ksoftirqd/123:45:161
290239963,1cyclictest34-21ksoftirqd/123:00:161
290239963,1cyclictest191rcu_preempt23:25:181
290239963,1cyclictest191rcu_preempt22:10:191
290239962,3cyclictest21345-21tr22:45:201
290239960,4cyclictest34-21ksoftirqd/121:30:161
290239960,4cyclictest34-21ksoftirqd/119:30:141
290239960,4cyclictest29319-21ntpq21:45:181
290239960,3cyclictest34-21ksoftirqd/123:55:171
290239960,3cyclictest34-21ksoftirqd/123:00:001
290339955,0cyclictest743-21snmpd20:31:353
290339955,0cyclictest741-21lldpd00:38:113
290339954,1cyclictest8614-21cpuspeed_turbos23:35:133
290339953,2cyclictest743-21snmpd22:06:483
290339953,2cyclictest743-21snmpd20:35:183
290339953,2cyclictest743-21snmpd19:51:163
290339952,2cyclictest26495-21grep20:20:183
290339952,2cyclictest24504-21ntpq20:15:173
290339952,2cyclictest23645-21grep00:10:193
290339952,2cyclictest21064-21sed21:25:213
290289954,1cyclictest9584-21munin-plugin-st21:00:002
290289954,1cyclictest22414-21ntpq20:10:182
290289953,2cyclictest743-21snmpd23:11:322
290289953,2cyclictest743-21snmpd19:44:552
290289953,2cyclictest743-21snmpd19:10:152
290289953,2cyclictest557-21NetworkManager23:20:162
290289952,3cyclictest13923-21sed19:50:142
290289952,2cyclictest25036-21sed21:35:172
290289952,2cyclictest244-20systemd-journal23:51:072
290289951,4cyclictest557-21NetworkManager20:06:362
290289951,3cyclictest6690-21cat22:10:172
290289950,4cyclictest32026-21ntpq19:15:162
290289950,4cyclictest2906-21ntpq22:00:162
290239953,0cyclictest191rcu_preempt21:20:181
290239950,2cyclictest34-21ksoftirqd/123:30:161
290239950,2cyclictest34-21ksoftirqd/121:55:121
290239950,2cyclictest34-21ksoftirqd/100:35:131
290239950,2cyclictest34-21ksoftirqd/100:30:151
290239950,1cyclictest0-21swapper/123:50:171
290339944,0cyclictest743-21snmpd22:19:593
290339943,1cyclictest743-21snmpd23:32:023
290339943,1cyclictest522-21avahi-daemon23:45:163
290339941,2cyclictest7883-21sed19:35:143
290339941,2cyclictest244-20systemd-journal20:00:303
290339940,3cyclictest31319-21/usr/sbin/munin21:50:183
290339940,3cyclictest14424-21diskstats22:30:123
290289943,1cyclictest3548-21cpuspeed_turbos19:25:122
290289942,2cyclictest557-21NetworkManager23:45:112
290289942,2cyclictest22762-21grep00:10:122
290289941,2cyclictest22631-21grep22:50:152
290289940,3cyclictest8542-21dpkg23:35:122
290339930,2cyclictest8194-21apt-get22:15:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional