You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-04 - 02:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Fri Jul 03, 2026 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27519991919,0cyclictest743-21snmpd09:02:031
27513991918,1cyclictest65850irq/126-lan11:50:130
27519991818,0cyclictest743-21snmpd12:35:511
27519991818,0cyclictest743-21snmpd12:02:261
27519991818,0cyclictest743-21snmpd11:50:111
27513991818,0cyclictest65850irq/126-lan07:56:320
27513991817,1cyclictest65850irq/126-lan12:17:000
27513991817,1cyclictest65850irq/126-lan11:15:120
27513991817,1cyclictest65850irq/126-lan10:55:230
27513991717,0cyclictest65850irq/126-lan12:25:120
27513991717,0cyclictest65850irq/126-lan11:35:150
27513991717,0cyclictest65850irq/126-lan11:25:160
27513991717,0cyclictest65850irq/126-lan10:45:130
27513991717,0cyclictest65850irq/126-lan09:05:160
27513991717,0cyclictest65850irq/126-lan09:00:190
27513991716,1cyclictest65850irq/126-lan11:00:130
27513991716,1cyclictest65850irq/126-lan10:40:180
27513991716,1cyclictest65850irq/126-lan10:15:230
27513991716,1cyclictest65850irq/126-lan09:55:110
27513991716,1cyclictest65850irq/126-lan09:45:210
27513991716,1cyclictest65850irq/126-lan08:12:130
27513991716,1cyclictest65850irq/126-lan07:45:160
27513991716,1cyclictest65850irq/126-lan07:40:130
27519991616,0cyclictest743-21snmpd08:13:011
27513991616,0cyclictest65850irq/126-lan12:00:180
27513991616,0cyclictest65850irq/126-lan10:10:140
27513991616,0cyclictest65850irq/126-lan09:40:120
27513991616,0cyclictest65850irq/126-lan09:39:260
27513991616,0cyclictest65850irq/126-lan09:20:130
27513991616,0cyclictest65850irq/126-lan08:34:130
27513991616,0cyclictest65850irq/126-lan07:15:160
27513991615,1cyclictest65850irq/126-lan11:40:120
27513991615,1cyclictest65850irq/126-lan10:35:180
27513991615,1cyclictest65850irq/126-lan07:35:130
27513991515,0cyclictest65850irq/126-lan11:32:180
27513991515,0cyclictest65850irq/126-lan10:24:140
27513991515,0cyclictest65850irq/126-lan10:00:120
27513991515,0cyclictest65850irq/126-lan09:19:260
27513991515,0cyclictest65850irq/126-lan08:55:140
27513991515,0cyclictest65850irq/126-lan08:20:140
27513991515,0cyclictest65850irq/126-lan07:25:110
27513991514,1cyclictest65850irq/126-lan10:50:180
27513991514,1cyclictest65850irq/126-lan10:05:220
27513991514,1cyclictest65850irq/126-lan08:40:200
27513991514,1cyclictest65850irq/126-lan07:20:180
27513991414,0cyclictest65850irq/126-lan12:05:170
27513991414,0cyclictest65850irq/126-lan09:54:320
27513991413,1cyclictest65850irq/126-lan11:55:200
27513991413,1cyclictest65850irq/126-lan11:45:150
27513991413,1cyclictest65850irq/126-lan10:25:180
27513991413,1cyclictest65850irq/126-lan09:10:110
27513991413,1cyclictest65850irq/126-lan08:05:190
27513991413,1cyclictest65850irq/126-lan07:50:190
27513991413,1cyclictest65850irq/126-lan07:30:120
27513991313,0cyclictest65850irq/126-lan12:30:110
27513991313,0cyclictest65850irq/126-lan11:09:200
27513991313,0cyclictest65850irq/126-lan07:10:200
27513991312,1cyclictest65850irq/126-lan12:35:100
27513991312,1cyclictest65850irq/126-lan12:20:110
27513991312,1cyclictest65850irq/126-lan11:20:140
27513991312,1cyclictest65850irq/126-lan10:34:370
27513991312,1cyclictest65850irq/126-lan09:25:160
27513991312,1cyclictest65850irq/126-lan08:35:170
27513991312,1cyclictest65850irq/126-lan08:15:130
27513991312,1cyclictest65850irq/126-lan08:00:170
27513991212,0cyclictest65850irq/126-lan11:10:190
27513991211,1cyclictest65850irq/126-lan08:25:130
275289998,1cyclictest743-21snmpd10:09:563
275289992,4cyclictest25728-21cut12:20:003
275239998,1cyclictest743-21snmpd12:18:482
275199998,1cyclictest743-21snmpd12:24:151
275199998,1cyclictest743-21snmpd09:07:451
275199998,1cyclictest741-21lldpd08:23:301
275199998,1cyclictest741-21lldpd08:03:411
275199998,1cyclictest741-21lldpd07:40:111
275139998,1cyclictest743-21snmpd12:12:000
275139998,1cyclictest65850irq/126-lan08:50:170
275289988,0cyclictest743-21snmpd09:57:553
275289988,0cyclictest741-21lldpd09:30:493
275289988,0cyclictest741-21lldpd08:20:103
275289987,1cyclictest743-21snmpd10:13:203
275289987,1cyclictest743-21snmpd09:45:103
275289987,0cyclictest191rcu_preempt11:15:183
275289986,2cyclictest743-21snmpd11:57:413
275289986,2cyclictest743-21snmpd07:25:273
275289986,2cyclictest743-21snmpd07:12:083
275289985,0cyclictest191rcu_preempt08:32:533
275289983,2cyclictest52-21ksoftirqd/309:40:123
275289980,5cyclictest8664-21ntpq09:00:193
275239988,0cyclictest741-21lldpd12:26:542
275239988,0cyclictest741-21lldpd11:45:592
275239988,0cyclictest741-21lldpd08:27:462
275239988,0cyclictest741-21lldpd08:24:342
275239988,0cyclictest741-21lldpd07:30:092
275239988,0cyclictest741-21lldpd07:26:332
275239987,1cyclictest8508-21needreboot09:00:162
275239987,1cyclictest743-21snmpd09:21:452
275239987,1cyclictest743-21snmpd08:55:302
275239987,1cyclictest743-21snmpd07:57:192
275239987,1cyclictest741-21lldpd07:43:012
275239986,2cyclictest9458-21cat10:20:152
275239986,2cyclictest743-21snmpd10:09:052
275239986,2cyclictest743-21snmpd09:53:132
275239986,2cyclictest743-21snmpd09:35:402
275239986,2cyclictest743-21snmpd08:52:422
275239986,2cyclictest743-21snmpd08:19:292
275239986,2cyclictest743-21snmpd08:10:582
275199988,0cyclictest743-21snmpd12:29:161
275199988,0cyclictest743-21snmpd11:18:461
275199988,0cyclictest743-21snmpd10:15:051
275199988,0cyclictest743-21snmpd10:11:261
275199988,0cyclictest743-21snmpd09:34:161
275199988,0cyclictest741-21lldpd10:21:361
275199988,0cyclictest741-21lldpd09:48:571
275199988,0cyclictest741-21lldpd09:28:191
275199987,1cyclictest743-21snmpd11:33:221
275199987,1cyclictest743-21snmpd07:20:541
275199987,1cyclictest17678-21cpuspeed_turbos10:40:151
275199986,2cyclictest743-21snmpd10:26:051
275199986,2cyclictest743-21snmpd10:03:231
275139988,0cyclictest741-21lldpd08:48:280
275139988,0cyclictest65850irq/126-lan09:30:110
275289977,0cyclictest743-21snmpd08:59:123
275289977,0cyclictest743-21snmpd08:48:173
275289977,0cyclictest741-21lldpd12:21:053
275289977,0cyclictest741-21lldpd10:38:233
275289977,0cyclictest741-21lldpd10:21:523
275289977,0cyclictest741-21lldpd10:16:073
275289976,1cyclictest522-21avahi-daemon10:43:153
275289976,0cyclictest191rcu_preempt11:09:303
275289975,1cyclictest191rcu_preempt08:39:083
275289975,0cyclictest191rcu_preempt11:40:143
275289975,0cyclictest191rcu_preempt09:15:123
275289975,0cyclictest191rcu_preempt07:40:183
275289974,1cyclictest191rcu_preempt10:25:183
275289974,0cyclictest191rcu_preempt10:45:173
275289973,2cyclictest52-21ksoftirqd/308:40:203
275289973,2cyclictest52-21ksoftirqd/307:50:123
275289973,2cyclictest0-21swapper/312:07:463
275289973,2cyclictest0-21swapper/309:25:163
275289973,2cyclictest0-21swapper/308:10:183
275289973,1cyclictest52-21ksoftirqd/311:25:163
275289973,1cyclictest191rcu_preempt11:30:163
275289972,3cyclictest52-21ksoftirqd/309:10:153
275289972,3cyclictest0-21swapper/308:15:143
275289972,2cyclictest52-21ksoftirqd/308:00:113
275289972,1cyclictest0-21swapper/309:55:003
275289971,3cyclictest52-21ksoftirqd/310:55:253
275289971,3cyclictest52-21ksoftirqd/307:35:203
275289970,4cyclictest32163-21cat07:20:123
275289970,4cyclictest15119-21cat07:55:213
275239977,0cyclictest743-21snmpd09:28:492
275239977,0cyclictest743-21snmpd09:19:362
275239977,0cyclictest743-21snmpd07:51:072
275239977,0cyclictest741-21lldpd12:30:432
275239977,0cyclictest741-21lldpd11:50:332
275239977,0cyclictest741-21lldpd11:12:282
275239977,0cyclictest741-21lldpd10:33:382
275239977,0cyclictest741-21lldpd09:47:512
275239977,0cyclictest741-21lldpd08:40:202
275239977,0cyclictest741-21lldpd07:47:052
275239977,0cyclictest741-21lldpd07:15:352
275239976,1cyclictest743-21snmpd11:55:482
275239976,1cyclictest743-21snmpd10:48:002
275239976,1cyclictest506-21systemd-resolve11:40:172
275239975,2cyclictest743-21snmpd12:35:092
275239975,2cyclictest743-21snmpd11:07:512
275239975,2cyclictest743-21snmpd11:00:542
275239975,2cyclictest743-21snmpd08:09:462
275239975,2cyclictest743-21snmpd07:21:062
275239975,2cyclictest28138-21cat07:10:172
275199977,0cyclictest741-21lldpd12:34:131
275199977,0cyclictest741-21lldpd09:15:371
275199977,0cyclictest741-21lldpd09:14:071
275199977,0cyclictest741-21lldpd07:37:551
275199976,1cyclictest743-21snmpd11:11:211
275199976,1cyclictest743-21snmpd10:48:361
275199976,1cyclictest743-21snmpd08:36:261
275199976,1cyclictest743-21snmpd08:27:051
275199976,1cyclictest743-21snmpd08:17:101
275199976,1cyclictest506-21systemd-resolve09:20:121
275199975,2cyclictest743-21snmpd11:45:321
275199975,2cyclictest743-21snmpd11:42:051
275199975,2cyclictest743-21snmpd11:38:221
275199975,2cyclictest743-21snmpd11:22:161
275199974,2cyclictest244-20systemd-journal11:56:591
275199973,3cyclictest4644-21ntp_states08:50:171
275199973,1cyclictest191rcu_preempt09:45:001
275199972,3cyclictest575-21rs:main1
275289966,0cyclictest741-21lldpd09:35:353
275289965,1cyclictest743-21snmpd09:05:033
275289965,1cyclictest550-21cpuspeed_turbos10:00:123
275289965,0cyclictest191rcu_preempt12:00:073
275289964,2cyclictest27502-21cyclictest12:32:133
275289964,2cyclictest27502-21cyclictest11:52:153
275289964,2cyclictest27502-21cyclictest10:31:143
275289963,1cyclictest52-21ksoftirqd/308:05:153
275289963,1cyclictest191rcu_preempt11:20:163
275289963,1cyclictest191rcu_preempt11:10:133
275289963,0cyclictest191rcu_preempt12:25:123
275289962,3cyclictest22456-21wc12:10:153
275289962,2cyclictest0-21swapper/311:45:133
275289962,2cyclictest0-21swapper/311:05:003
275289961,3cyclictest52-21ksoftirqd/311:35:143
275289961,1cyclictest0-21swapper/312:35:123
275289960,4cyclictest31718-21date07:20:003
275289960,3cyclictest52-21ksoftirqd/310:50:213
275289960,3cyclictest26926-21modprobe08:25:183
275239966,0cyclictest743-21snmpd10:38:422
275239966,0cyclictest743-21snmpd10:12:142
275239966,0cyclictest741-21lldpd11:36:272
275239966,0cyclictest741-21lldpd08:30:272
275239966,0cyclictest522-21avahi-daemon11:25:012
275239965,1cyclictest743-21snmpd12:07:322
275239965,1cyclictest743-21snmpd10:57:332
275239965,1cyclictest743-21snmpd10:26:082
275239965,1cyclictest743-21snmpd09:55:252
275239965,1cyclictest6705-21nvmesmart_nvme007:35:202
275239964,2cyclictest743-21snmpd12:10:062
275239964,2cyclictest743-21snmpd09:30:162
275239963,3cyclictest557-21NetworkManager11:20:052
275239963,3cyclictest17575-21apt-get10:40:152
275239962,3cyclictest31850-21diskstats11:15:132
275199966,0cyclictest743-21snmpd11:27:591
275199966,0cyclictest743-21snmpd08:08:521
275199966,0cyclictest743-21snmpd07:50:521
275199966,0cyclictest743-21snmpd07:25:061
275199966,0cyclictest741-21lldpd09:50:051
275199965,1cyclictest743-21snmpd12:12:551
275199965,1cyclictest743-21snmpd10:07:211
275199965,1cyclictest6074-21fschecks_time08:55:151
275199965,1cyclictest27502-21cyclictest07:15:161
275199964,2cyclictest743-21snmpd07:34:571
275199964,0cyclictest191rcu_preempt10:35:271
275199961,3cyclictest16889-21kworker/1:0-events09:35:141
275199960,4cyclictest9933-21apt-get07:45:121
275289954,1cyclictest501rcuc/309:20:163
275289951,2cyclictest4101-21head08:50:133
275289950,3cyclictest52-21ksoftirqd/307:30:113
275289950,2cyclictest52-21ksoftirqd/307:45:013
275239955,0cyclictest741-21lldpd09:05:102
275239954,1cyclictest743-21snmpd10:00:222
275239953,2cyclictest743-21snmpd11:30:282
275239952,3cyclictest557-21NetworkManager08:47:172
275239952,3cyclictest244-20systemd-journal12:01:442
275239952,2cyclictest575-21rs:main2
275239952,2cyclictest26422-21dpkg12:20:112
275199955,0cyclictest741-21lldpd10:56:281
275199955,0cyclictest24309-21gltestperf12:15:141
275199954,1cyclictest0-21swapper/107:10:141
275199954,0cyclictest191rcu_preempt08:40:171
275199953,2cyclictest743-21snmpd09:56:221
275199952,3cyclictest557-21NetworkManager10:50:251
275199952,2cyclictest28230-21wc11:05:171
275199951,3cyclictest20099-21awk12:05:141
275199951,2cyclictest34-21ksoftirqd/110:30:391
275199950,4cyclictest28271-21df08:30:131
275199950,2cyclictest26012-21gltestperf11:00:131
275239942,2cyclictest24608-21cut09:40:122
275239941,2cyclictest16638-21cut08:00:152
275239940,4cyclictest30125-21apt-get08:35:122
275239940,4cyclictest22312-21ntpq10:50:172
275239940,4cyclictest12663-21ntpq09:10:162
275199941,1cyclictest191rcu_preempt08:45:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional