You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-06 - 20:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Wed May 06, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2814991918,1cyclictest65850irq/126-lan10:15:141
2814991918,1cyclictest65850irq/126-lan10:04:591
2814991918,1cyclictest65850irq/126-lan09:25:211
2814991817,1cyclictest65850irq/126-lan12:35:201
2814991817,1cyclictest65850irq/126-lan10:20:121
2814991817,1cyclictest65850irq/126-lan08:55:181
2814991717,0cyclictest65850irq/126-lan12:33:511
2814991717,0cyclictest65850irq/126-lan11:25:471
2814991717,0cyclictest65850irq/126-lan10:31:461
2814991716,1cyclictest65850irq/126-lan12:05:141
2814991716,1cyclictest65850irq/126-lan11:30:131
2814991716,1cyclictest65850irq/126-lan10:05:111
2814991716,1cyclictest65850irq/126-lan09:45:201
2814991716,1cyclictest65850irq/126-lan09:40:191
2814991716,1cyclictest65850irq/126-lan09:35:161
2814991716,1cyclictest65850irq/126-lan08:20:161
2814991716,1cyclictest65850irq/126-lan08:00:201
2814991716,1cyclictest65850irq/126-lan07:15:231
2814991616,0cyclictest65850irq/126-lan10:10:161
2814991616,0cyclictest65850irq/126-lan09:20:181
2814991616,0cyclictest65850irq/126-lan08:46:571
2814991616,0cyclictest65850irq/126-lan08:40:331
2814991616,0cyclictest65850irq/126-lan08:15:181
2814991616,0cyclictest65850irq/126-lan08:05:051
2814991616,0cyclictest65850irq/126-lan07:25:031
2814991615,1cyclictest65850irq/126-lan12:00:141
2814991615,1cyclictest65850irq/126-lan11:10:171
2814991615,1cyclictest65850irq/126-lan09:30:121
2814991615,1cyclictest65850irq/126-lan08:30:101
2814991615,1cyclictest65850irq/126-lan08:10:111
2814991615,1cyclictest65850irq/126-lan07:45:121
2814991515,0cyclictest65850irq/126-lan08:50:211
2814991515,0cyclictest65850irq/126-lan08:26:571
2814991515,0cyclictest65850irq/126-lan07:43:141
2814991514,1cyclictest65850irq/126-lan12:17:011
2814991514,1cyclictest65850irq/126-lan11:55:131
2814991514,1cyclictest65850irq/126-lan10:55:161
2814991514,1cyclictest65850irq/126-lan09:50:111
2814991514,1cyclictest65850irq/126-lan09:00:191
2814991514,1cyclictest65850irq/126-lan07:50:201
2814991414,0cyclictest65850irq/126-lan10:37:451
2814991414,0cyclictest65850irq/126-lan07:30:181
2814991413,1cyclictest65850irq/126-lan11:35:131
2814991413,1cyclictest65850irq/126-lan11:20:171
2814991413,1cyclictest65850irq/126-lan11:00:141
2814991413,1cyclictest65850irq/126-lan10:50:011
2814991413,1cyclictest65850irq/126-lan10:40:221
2814991413,1cyclictest65850irq/126-lan10:25:101
2814991413,1cyclictest65850irq/126-lan07:55:351
2814991313,0cyclictest65850irq/126-lan11:18:461
2814991313,0cyclictest65850irq/126-lan09:10:461
2814991312,1cyclictest65850irq/126-lan12:10:131
2814991312,1cyclictest65850irq/126-lan11:05:201
2814991312,1cyclictest65850irq/126-lan09:55:121
2814991312,1cyclictest65850irq/126-lan07:20:111
2814991212,0cyclictest65850irq/126-lan12:20:181
2814991211,1cyclictest65850irq/126-lan11:40:151
2814991211,1cyclictest65850irq/126-lan09:05:171
2814991111,0cyclictest65850irq/126-lan11:50:191
2814991111,0cyclictest65850irq/126-lan11:45:171
2814991111,0cyclictest65850irq/126-lan10:46:451
2814991111,0cyclictest65850irq/126-lan07:14:451
2814991110,1cyclictest65850irq/126-lan12:25:111
2814991110,1cyclictest65850irq/126-lan08:35:141
2814991110,1cyclictest65850irq/126-lan07:35:121
28239998,1cyclictest743-21snmpd07:53:263
28189998,1cyclictest743-21snmpd11:42:192
28189998,1cyclictest743-21snmpd09:29:062
28069998,1cyclictest743-21snmpd12:01:440
28069998,1cyclictest743-21snmpd11:08:440
28069998,1cyclictest743-21snmpd09:09:070
28069998,1cyclictest743-21snmpd07:53:120
28069998,1cyclictest741-21lldpd09:37:060
28239988,0cyclictest743-21snmpd11:41:463
28239988,0cyclictest743-21snmpd11:17:113
28239988,0cyclictest743-21snmpd10:21:503
28239988,0cyclictest741-21lldpd10:58:503
28239987,1cyclictest743-21snmpd12:26:133
28239987,1cyclictest743-21snmpd09:51:043
28239987,1cyclictest28054-21cut10:45:173
28239986,2cyclictest743-21snmpd12:30:063
28239986,2cyclictest743-21snmpd12:01:203
28239986,2cyclictest743-21snmpd08:06:093
28189988,0cyclictest743-21snmpd12:34:182
28189988,0cyclictest741-21lldpd11:39:042
28189988,0cyclictest741-21lldpd10:33:372
28189988,0cyclictest741-21lldpd09:18:442
28189988,0cyclictest741-21lldpd08:36:502
28189988,0cyclictest741-21lldpd07:51:452
28189988,0cyclictest741-21lldpd07:37:462
28189986,2cyclictest7470-21cat07:20:132
28189986,2cyclictest743-21snmpd12:19:292
28189986,2cyclictest743-21snmpd12:05:132
28189986,2cyclictest743-21snmpd09:04:342
28189985,2cyclictest743-21snmpd12:20:202
28189985,1cyclictest24631-21ntpq11:55:162
28189984,2cyclictest10604-21apt-get10:05:102
28189981,6cyclictest0-21swapper/208:50:142
28189981,5cyclictest3852-21ntpq07:10:172
28189981,5cyclictest23298-21diskstats10:35:112
28189981,5cyclictest19824-21ntpq10:25:142
28189981,5cyclictest14743-21ntpq08:55:162
28069988,0cyclictest743-21snmpd11:55:240
28069988,0cyclictest743-21snmpd08:42:580
28069988,0cyclictest741-21lldpd11:32:130
28069988,0cyclictest741-21lldpd10:40:260
28069987,1cyclictest743-21snmpd10:25:410
28069987,1cyclictest743-21snmpd08:55:350
28069987,1cyclictest743-21snmpd08:06:570
28069987,1cyclictest743-21snmpd07:19:590
28069987,1cyclictest741-21lldpd12:19:130
28069987,1cyclictest741-21lldpd11:02:020
28069986,2cyclictest743-21snmpd09:12:290
28069986,2cyclictest743-21snmpd07:23:500
28069986,2cyclictest26858-21cat09:25:140
28239977,0cyclictest743-21snmpd10:26:593
28239977,0cyclictest743-21snmpd08:19:043
28239977,0cyclictest743-21snmpd08:02:093
28239977,0cyclictest743-21snmpd07:55:113
28239977,0cyclictest741-21lldpd12:13:113
28239977,0cyclictest741-21lldpd12:06:243
28239977,0cyclictest741-21lldpd10:32:053
28239977,0cyclictest741-21lldpd10:13:193
28239977,0cyclictest741-21lldpd09:06:563
28239977,0cyclictest741-21lldpd09:00:493
28239977,0cyclictest741-21lldpd08:32:463
28239977,0cyclictest741-21lldpd07:31:313
28239976,1cyclictest743-21snmpd11:02:533
28239976,1cyclictest743-21snmpd09:57:163
28239975,2cyclictest743-21snmpd10:39:553
28239975,2cyclictest743-21snmpd08:51:083
28239975,2cyclictest743-21snmpd07:46:423
28239975,2cyclictest3425-21cat07:10:143
28239973,3cyclictest22022-21df11:50:113
28189977,0cyclictest743-21snmpd09:25:002
28189977,0cyclictest743-21snmpd08:41:002
28189977,0cyclictest741-21lldpd11:11:242
28189977,0cyclictest741-21lldpd09:08:322
28189977,0cyclictest741-21lldpd08:31:032
28189976,1cyclictest743-21snmpd12:11:372
28189976,1cyclictest743-21snmpd11:29:012
28189976,1cyclictest743-21snmpd11:09:022
28189976,1cyclictest32364-21fschecks_count08:20:132
28189975,2cyclictest743-21snmpd10:45:312
28189975,2cyclictest22296-21cat11:50:132
28189972,2cyclictest0-21swapper/210:16:042
28189971,4cyclictest6837-21ntp_192.168.11409:55:172
28189971,4cyclictest29911-21latency_hist08:14:592
28189971,4cyclictest2484-21ntpq08:25:152
28189970,5cyclictest9029-21ntpq10:00:152
28189970,5cyclictest30508-21hddtemp_smartct08:15:132
28189970,5cyclictest29221-21ntpq09:30:162
28189970,5cyclictest18785-21ntpq07:45:162
28189970,4cyclictest26729-21runrttasks10:42:552
28189970,4cyclictest10145-21perl08:45:112
28189970,3cyclictest31914-21fw_conntrack10:55:132
28149977,0cyclictest65850irq/126-lan09:15:111
28069977,0cyclictest743-21snmpd12:12:550
28069977,0cyclictest743-21snmpd11:22:200
28069977,0cyclictest743-21snmpd10:33:410
28069977,0cyclictest743-21snmpd09:23:530
28069977,0cyclictest743-21snmpd08:30:570
28069977,0cyclictest743-21snmpd08:25:360
28069977,0cyclictest741-21lldpd11:35:020
28069977,0cyclictest741-21lldpd10:55:160
28069977,0cyclictest741-21lldpd10:47:000
28069976,1cyclictest743-21snmpd07:38:360
28069975,2cyclictest743-21snmpd12:06:350
28069975,2cyclictest743-21snmpd11:18:180
28069975,2cyclictest743-21snmpd10:54:370
28069975,2cyclictest743-21snmpd10:12:580
28069975,2cyclictest743-21snmpd09:45:380
28069975,2cyclictest743-21snmpd08:13:210
28069975,2cyclictest743-21snmpd07:13:400
28069970,5cyclictest22726-21ld11:50:170
28239966,0cyclictest741-21lldpd10:08:173
28239966,0cyclictest741-21lldpd08:41:393
28239966,0cyclictest741-21lldpd08:10:033
28239966,0cyclictest741-21lldpd07:27:123
28239966,0cyclictest741-21lldpd07:18:273
28239966,0cyclictest25652-21dump-pmu-power12:00:003
28239965,1cyclictest743-21snmpd09:49:083
28239965,1cyclictest743-21snmpd08:39:133
28239965,1cyclictest743-21snmpd08:28:243
28239965,1cyclictest16616-21latency_hist10:19:593
28239964,2cyclictest743-21snmpd08:56:463
28239964,2cyclictest743-21snmpd07:44:563
28239963,2cyclictest1000-21ls09:40:193
28239962,3cyclictest13668-21df_inode07:35:113
28189966,0cyclictest522-21avahi-daemon12:03:202
28189965,1cyclictest743-21snmpd11:22:322
28189965,1cyclictest743-21snmpd09:48:232
28189963,2cyclictest0-21swapper/207:25:102
28189961,3cyclictest9315-21runrttasks12:39:192
28189961,3cyclictest8100-21ntpq11:15:172
28189961,3cyclictest5778-21ntpq07:15:182
28189961,3cyclictest22825-21ntpq07:55:152
28189961,3cyclictest2102-21ntpq11:00:172
28189961,3cyclictest17921-21ntp_states10:20:162
28189961,3cyclictest14156-21modprobe11:30:162
28189961,1cyclictest26839-21ntpq08:05:162
28189961,1cyclictest16018-21apt-get07:40:112
28189960,4cyclictest308-21fw_conntrack09:40:142
28189960,4cyclictest20721-21ntpq11:45:182
28189960,3cyclictest4443-21ntp_states12:25:152
28189960,3cyclictest24869-21ntpq08:00:172
28189960,3cyclictest20575-21sed09:10:162
28189960,3cyclictest11823-21ntpq07:30:172
28189960,2cyclictest31206-21ntpq09:35:162
28069966,0cyclictest743-21snmpd11:40:190
28069965,1cyclictest743-21snmpd10:05:480
28069965,1cyclictest743-21snmpd07:25:190
28069965,1cyclictest6800-21grep09:55:160
28069965,1cyclictest573-21in:imuxsock07:43:470
28069965,1cyclictest522-21avahi-daemon12:37:560
28069965,1cyclictest522-21avahi-daemon08:50:230
28069964,2cyclictest743-21snmpd08:17:240
28069964,2cyclictest743-21snmpd07:34:080
28069964,2cyclictest207-21jbd2/nvme0n1p2-812:28:450
28239954,1cyclictest743-21snmpd11:13:513
28239954,1cyclictest0-21swapper/312:20:123
28239953,2cyclictest743-21snmpd09:25:263
28239952,3cyclictest7926-21fw_conntrack12:35:133
28239952,3cyclictest28443-21dpkg09:30:113
28239952,3cyclictest20250-21tail09:10:133
28239952,3cyclictest11073-21sed08:45:193
28239952,2cyclictest611-21nvmesmart_nvme008:20:183
28239952,2cyclictest3941-21grep11:05:143
28239952,2cyclictest31788-21grep09:35:213
28239952,2cyclictest20894-21cut11:45:203
28239952,2cyclictest16716-21sed11:35:223
28239951,3cyclictest25768-21users09:20:213
28189952,1cyclictest191rcu_preempt09:50:162
28189951,2cyclictest0-21swapper/210:49:592
28189950,3cyclictest12908-21fw_forwarded_lo10:10:132
28069955,0cyclictest743-21snmpd12:30:120
28069955,0cyclictest743-21snmpd10:15:040
28069955,0cyclictest741-21lldpd07:57:200
28069955,0cyclictest522-21avahi-daemon08:04:570
28069953,2cyclictest8749-21sed10:00:130
28069953,2cyclictest557-21NetworkManager09:40:180
28069953,2cyclictest4567-21cat09:50:120
28069952,3cyclictest5581-21perl11:10:130
28069952,2cyclictest1613-21cut08:25:000
28069952,2cyclictest10493-21cut08:45:140
28069951,3cyclictest11688-21grep11:25:130
28069950,5cyclictest557-21NetworkManager12:21:020
28239943,1cyclictest13525-21kworker/3:0-mm_percpu_wq10:50:023
28239942,2cyclictest8276-21expr10:00:103
28239941,2cyclictest26112-21proc_pri10:40:203
28239941,2cyclictest11441-21tr11:25:113
28239941,2cyclictest10079-21ldconfig11:20:153
28239940,3cyclictest7211-21diskstats07:20:123
28239940,3cyclictest321-21ntpq12:15:183
28239940,3cyclictest22411-21irqstats09:15:133
28239940,3cyclictest14286-21/usr/sbin/munin11:30:173
28069942,2cyclictest743-21snmpd09:15:070
28069942,2cyclictest29158-21ld09:30:150
28069942,2cyclictest17517-21cat10:20:130
28069942,0cyclictest0-21swapper/008:35:060
28069941,2cyclictest20070-21grep11:45:130
28069940,4cyclictest18866-21ntp_states07:45:160
28069940,3cyclictest16468-21memory09:00:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional