You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-11 - 13:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot3s.osadl.org (updated Fri Jul 11, 2025 00:43:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9412319303,5sleep30-21swapper/319:06:223
10822317309,5sleep20-21swapper/219:08:102
11122316302,5sleep00-21swapper/019:08:320
9292313306,4sleep10-21swapper/119:06:131
1603992950,294cyclictest31214-21kworker/u16:3+efi_rts_wq22:45:123
1603992950,293cyclictest31214-21kworker/u16:3+efi_rts_wq23:05:123
1602992950,293cyclictest27924-21kworker/u16:1+efi_rts_wq23:15:162
1603992940,293cyclictest31214-21kworker/u16:3+efi_rts_wq21:45:143
1598992940,293cyclictest31214-21kworker/u16:3+efi_rts_wq21:35:130
1602992930,292cyclictest31214-21kworker/u16:3+efi_rts_wq23:25:162
1598992930,292cyclictest25049-21kworker/u16:0+efi_rts_wq19:55:140
1603992920,291cyclictest31214-21kworker/u16:3+efi_rts_wq19:20:033
1598992920,291cyclictest31686-21kworker/u16:1+efi_rts_wq00:20:150
1598992900,289cyclictest25049-21kworker/u16:0+efi_rts_wq20:05:120
1598992890,288cyclictest31214-21kworker/u16:3+efi_rts_wq22:15:370
1598992890,288cyclictest25049-21kworker/u16:0+efi_rts_wq22:10:360
1598992890,288cyclictest25049-21kworker/u16:0+efi_rts_wq20:30:160
1603992830,281cyclictest22137-21kworker/u16:1+efi_rts_wq23:45:133
1602992830,282cyclictest31214-21kworker/u16:3+efi_rts_wq22:45:122
1602992830,282cyclictest25049-21kworker/u16:0+efi_rts_wq22:15:112
1603992820,281cyclictest25049-21kworker/u16:0+efi_rts_wq20:30:153
1598992820,281cyclictest25049-21kworker/u16:0+efi_rts_wq22:25:150
1598992810,280cyclictest26791-21kworker/u16:0+efi_rts_wq23:55:130
1598992800,279cyclictest31214-21kworker/u16:3+efi_rts_wq22:00:160
1599992790,278cyclictest31214-21kworker/u16:3+efi_rts_wq21:05:151
1598992790,278cyclictest31214-21kworker/u16:3+efi_rts_wq21:05:160
1603992780,277cyclictest25049-21kworker/u16:0+efi_rts_wq21:15:133
1603992780,277cyclictest25049-21kworker/u16:0+efi_rts_wq20:55:143
1602992780,277cyclictest25049-21kworker/u16:0+efi_rts_wq20:25:132
1602992780,277cyclictest24482-21kworker/u16:2+efi_rts_wq00:10:122
1603992760,275cyclictest25049-21kworker/u16:0+efi_rts_wq21:50:123
1602992760,275cyclictest24482-21kworker/u16:2+efi_rts_wq00:35:152
1599992760,275cyclictest31214-21kworker/u16:3+efi_rts_wq23:05:121
1599992760,275cyclictest31214-21kworker/u16:3+efi_rts_wq21:20:261
1599992760,275cyclictest25049-21kworker/u16:0+efi_rts_wq20:00:161
1599992760,275cyclictest25049-21kworker/u16:0+efi_rts_wq19:45:171
1598992760,275cyclictest31214-21kworker/u16:3+efi_rts_wq19:50:160
1603992750,274cyclictest31214-21kworker/u16:3+efi_rts_wq21:55:153
1603992730,272cyclictest25049-21kworker/u16:0+efi_rts_wq20:25:143
1603992730,272cyclictest11041-21kworker/u16:0+efi_rts_wq23:30:133
1603992730,272cyclictest11041-21kworker/u16:0+efi_rts_wq23:20:133
1602992730,272cyclictest31214-21kworker/u16:3+efi_rts_wq20:40:162
1599992730,272cyclictest27924-21kworker/u16:1+efi_rts_wq23:15:501
1598992730,272cyclictest31686-21kworker/u16:1+efi_rts_wq00:06:000
1603992720,271cyclictest31214-21kworker/u16:3+efi_rts_wq20:00:103
1603992710,270cyclictest25049-21kworker/u16:0+efi_rts_wq20:50:213
1603992700,269cyclictest25049-21kworker/u16:0+efi_rts_wq21:00:163
1603992690,268cyclictest31214-21kworker/u16:3+efi_rts_wq22:55:123
1603992690,268cyclictest24482-21kworker/u16:2+efi_rts_wq00:11:003
1602992690,267cyclictest25049-21kworker/u16:0+efi_rts_wq22:35:152
1599992680,267cyclictest31686-21kworker/u16:1+efi_rts_wq00:20:151
1603992660,265cyclictest31214-21kworker/u16:3+efi_rts_wq22:15:103
1602992650,264cyclictest25049-21kworker/u16:0+efi_rts_wq22:20:142
1598992650,264cyclictest31214-21kworker/u16:3+efi_rts_wq19:25:140
1599992640,261cyclictest25049-21kworker/u16:0+efi_rts_wq21:10:171
1599992640,261cyclictest25049-21kworker/u16:0+efi_rts_wq21:10:161
1603992630,262cyclictest25049-21kworker/u16:0+efi_rts_wq20:15:163
1602992630,262cyclictest25049-21kworker/u16:0+efi_rts_wq20:35:172
1599992630,262cyclictest25049-21kworker/u16:0+efi_rts_wq20:50:161
1598992630,262cyclictest31214-21kworker/u16:3+efi_rts_wq22:50:130
1602992620,259cyclictest26791-21kworker/u16:0+efi_rts_wq23:55:132
1598992620,261cyclictest31214-21kworker/u16:3+efi_rts_wq19:30:130
1602992600,259cyclictest25049-21kworker/u16:0+efi_rts_wq21:00:162
1602992580,257cyclictest31686-21kworker/u16:1+efi_rts_wq00:25:162
1603992570,256cyclictest24482-21kworker/u16:2+efi_rts_wq00:00:163
1603992560,255cyclictest31214-21kworker/u16:3+efi_rts_wq22:50:143
1599992560,255cyclictest31214-21kworker/u16:3+efi_rts_wq20:40:191
1599992560,255cyclictest25049-21kworker/u16:0+efi_rts_wq20:30:181
1599992560,253cyclictest31214-21kworker/u16:3+efi_rts_wq22:50:141
1599992540,253cyclictest31214-21kworker/u16:3+efi_rts_wq20:45:141
1603992530,252cyclictest31214-21kworker/u16:3+efi_rts_wq22:10:143
1603992530,252cyclictest31214-21kworker/u16:3+efi_rts_wq22:00:153
1599992520,251cyclictest31214-21kworker/u16:3+efi_rts_wq23:40:131
1603992510,250cyclictest27924-21kworker/u16:1+efi_rts_wq23:00:163
1598992510,250cyclictest25049-21kworker/u16:0+efi_rts_wq19:10:140
1599992490,248cyclictest25049-21kworker/u16:0+efi_rts_wq19:20:151
1603992480,247cyclictest31214-21kworker/u16:3+efi_rts_wq19:25:153
1599992480,247cyclictest25049-21kworker/u16:0+efi_rts_wq21:30:131
1599992480,247cyclictest25049-21kworker/u16:0+efi_rts_wq19:35:141
1599992470,246cyclictest31214-21kworker/u16:3+efi_rts_wq19:15:151
1603992460,245cyclictest31214-21kworker/u16:3+efi_rts_wq21:25:193
1602992460,245cyclictest25049-21kworker/u16:0+efi_rts_wq19:30:052
1598992460,244cyclictest25049-21kworker/u16:0+efi_rts_wq20:55:210
1598992450,244cyclictest31214-21kworker/u16:3+efi_rts_wq21:20:180
1602992430,242cyclictest11041-21kworker/u16:0+efi_rts_wq23:40:132
1602992400,239cyclictest25049-21kworker/u16:0+efi_rts_wq19:15:022
1603992380,237cyclictest25049-21kworker/u16:0+efi_rts_wq19:50:093
1599992380,237cyclictest31214-21kworker/u16:3+efi_rts_wq23:10:131
1599992370,236cyclictest25049-21kworker/u16:0+efi_rts_wq19:40:071
1599992360,235cyclictest31214-21kworker/u16:3+efi_rts_wq22:40:141
1602992340,233cyclictest31214-21kworker/u16:3+efi_rts_wq23:35:132
1599992320,231cyclictest24482-21kworker/u16:2+efi_rts_wq00:26:051
1603992300,229cyclictest31214-21kworker/u16:3+efi_rts_wq20:45:143
1603992300,229cyclictest25049-21kworker/u16:0+efi_rts_wq21:40:293
1599992270,226cyclictest25049-21kworker/u16:0+efi_rts_wq20:35:131
1599992270,225cyclictest31214-21kworker/u16:3+efi_rts_wq22:30:161
1602992240,223cyclictest27924-21kworker/u16:1+efi_rts_wq23:00:162
1602992220,221cyclictest31214-21kworker/u16:3+efi_rts_wq22:05:122
1598992200,219cyclictest31686-21kworker/u16:1+efi_rts_wq00:31:050
1603992180,217cyclictest27924-21kworker/u16:1+efi_rts_wq23:15:163
1599992180,217cyclictest31214-21kworker/u16:3+efi_rts_wq22:05:121
1603992170,216cyclictest25049-21kworker/u16:0+efi_rts_wq21:10:173
1603992170,216cyclictest25049-21kworker/u16:0+efi_rts_wq21:10:163
1603992160,215cyclictest31214-21kworker/u16:3+efi_rts_wq19:55:103
1598992130,212cyclictest31214-21kworker/u16:3+efi_rts_wq22:40:410
1598992130,212cyclictest31214-21kworker/u16:3+efi_rts_wq20:10:140
1603992120,211cyclictest31214-21kworker/u16:3+efi_rts_wq21:05:153
1599992110,210cyclictest11041-21kworker/u16:0+efi_rts_wq23:20:121
1598992110,210cyclictest25049-21kworker/u16:0+efi_rts_wq21:50:130
1602992100,209cyclictest24482-21kworker/u16:2+efi_rts_wq00:00:162
1599992100,209cyclictest25049-21kworker/u16:0+efi_rts_wq20:55:141
1603992090,207cyclictest25049-21kworker/u16:0+efi_rts_wq22:30:403
1602992090,208cyclictest31214-21kworker/u16:3+efi_rts_wq23:05:122
1603992080,207cyclictest31686-21kworker/u16:1+efi_rts_wq00:15:123
1599992080,207cyclictest25049-21kworker/u16:0+efi_rts_wq21:25:271
1602992070,206cyclictest25049-21kworker/u16:0+efi_rts_wq19:45:172
1599992070,206cyclictest11041-21kworker/u16:0+efi_rts_wq23:30:121
1603992060,205cyclictest11041-21kworker/u16:0+efi_rts_wq23:35:533
1602992060,205cyclictest31214-21kworker/u16:3+efi_rts_wq19:50:152
1599992040,203cyclictest24482-21kworker/u16:2+efi_rts_wq23:55:581
1598992040,203cyclictest25049-21kworker/u16:0+efi_rts_wq20:00:160
1598992030,202cyclictest25049-21kworker/u16:0+efi_rts_wq20:20:150
1603992010,200cyclictest31214-21kworker/u16:3+efi_rts_wq19:35:073
1602992000,199cyclictest25049-21kworker/u16:0+efi_rts_wq20:10:132
1603991970,196cyclictest31214-21kworker/u16:3+efi_rts_wq22:05:143
1603991970,196cyclictest27924-21kworker/u16:1+efi_rts_wq23:10:143
1602991970,196cyclictest31214-21kworker/u16:3+efi_rts_wq19:40:122
1598991930,192cyclictest31214-21kworker/u16:3+efi_rts_wq21:25:180
1603991900,189cyclictest31686-21kworker/u16:1+efi_rts_wq00:05:153
1603991890,188cyclictest25049-21kworker/u16:0+efi_rts_wq20:20:153
1602991890,188cyclictest31686-21kworker/u16:1+efi_rts_wq00:16:032
1602991890,188cyclictest11041-21kworker/u16:0+efi_rts_wq23:20:142
1599991850,184cyclictest31214-21kworker/u16:3+efi_rts_wq19:30:131
1603991840,183cyclictest31214-21kworker/u16:3+efi_rts_wq21:20:163
1603991820,181cyclictest31214-21kworker/u16:3+efi_rts_wq23:25:163
1598991820,181cyclictest25049-21kworker/u16:0+efi_rts_wq21:15:250
1603991800,179cyclictest31214-21kworker/u16:3+efi_rts_wq21:30:283
1599991780,177cyclictest27924-21kworker/u16:1+efi_rts_wq22:55:451
1599991760,175cyclictest25049-21kworker/u16:0+efi_rts_wq21:45:301
1599991740,173cyclictest22137-21kworker/u16:1+efi_rts_wq23:45:561
1599991690,168cyclictest31214-21kworker/u16:3+efi_rts_wq23:35:131
1599991690,168cyclictest25049-21kworker/u16:0+efi_rts_wq22:20:131
1603991680,167cyclictest31214-21kworker/u16:3+efi_rts_wq23:40:133
1599991680,167cyclictest31686-21kworker/u16:1+efi_rts_wq00:30:121
1602991660,165cyclictest25049-21kworker/u16:0+efi_rts_wq21:30:122
1603991630,162cyclictest25049-21kworker/u16:0+efi_rts_wq20:10:133
1603991620,159cyclictest25049-21kworker/u16:0+efi_rts_wq19:10:133
1598991580,158cyclictest11041-21kworker/u16:0+efi_rts_wq23:30:520
1602991570,156cyclictest31214-21kworker/u16:3+efi_rts_wq22:40:142
1599991570,154cyclictest31686-21kworker/u16:1+efi_rts_wq00:00:581
1602991560,155cyclictest31214-21kworker/u16:3+efi_rts_wq21:20:162
1599991530,152cyclictest27924-21kworker/u16:1+efi_rts_wq23:00:161
1603991520,151cyclictest24482-21kworker/u16:2+efi_rts_wq23:50:153
1598991360,135cyclictest31214-21kworker/u16:3+efi_rts_wq19:45:080
1598991310,130cyclictest25049-21kworker/u16:0+efi_rts_wq20:50:160
1603991300,129cyclictest25049-21kworker/u16:0+efi_rts_wq22:35:403
1603991260,125cyclictest31214-21kworker/u16:3+efi_rts_wq20:05:183
1603991250,124cyclictest25049-21kworker/u16:0+efi_rts_wq22:20:373
1602991160,115cyclictest25049-21kworker/u16:0+efi_rts_wq21:35:302
1602991140,113cyclictest26791-21kworker/u16:0+efi_rts_wq23:50:562
1599991110,110cyclictest25049-21kworker/u16:0+efi_rts_wq22:25:151
1599991090,108cyclictest31214-21kworker/u16:3+efi_rts_wq22:10:141
1602991040,103cyclictest31214-21kworker/u16:3+efi_rts_wq22:30:162
1602991030,102cyclictest25049-21kworker/u16:0+efi_rts_wq22:25:382
1598991030,102cyclictest31214-21kworker/u16:3+efi_rts_wq21:40:130
1598991020,101cyclictest24482-21kworker/u16:2+efi_rts_wq23:50:150
1602991010,100cyclictest31214-21kworker/u16:3+efi_rts_wq21:55:322
159999990,98cyclictest25049-21kworker/u16:0+efi_rts_wq22:35:141
1603993630,4cyclictest14756-21cat00:35:173
1603993329,4cyclictest15797-21cat19:40:143
1603993229,2cyclictest799-21snmpd21:36:543
1603993229,2cyclictest799-21snmpd00:25:533
1602993229,2cyclictest799-21snmpd22:54:412
1602993229,2cyclictest799-21snmpd19:25:512
1599993229,2cyclictest799-21snmpd22:00:131
1598993230,2cyclictest799-21snmpd20:36:580
1603993130,1cyclictest799-21snmpd19:31:233
1603993126,4cyclictest799-21snmpd20:41:503
1602993130,1cyclictest799-21snmpd00:31:282
1599993130,1cyclictest799-21snmpd21:52:031
1599993129,2cyclictest799-21snmpd00:14:491
1599993128,2cyclictest799-21snmpd00:09:351
1598993130,1cyclictest799-21snmpd23:27:270
1598993130,1cyclictest799-21snmpd22:36:370
1598993130,1cyclictest10873-21kworker/0:0+events23:13:320
1598993129,2cyclictest799-21snmpd21:46:590
1598993129,2cyclictest799-21snmpd21:01:040
1598993128,2cyclictest799-21snmpd20:41:140
1603993028,2cyclictest799-21snmpd00:22:133
1602993029,1cyclictest799-21snmpd23:30:322
1602993029,1cyclictest799-21snmpd19:39:062
1602993028,2cyclictest799-21snmpd19:13:402
1602993027,2cyclictest799-21snmpd21:15:512
1599993029,1cyclictest799-21snmpd21:57:271
1599993029,1cyclictest799-21snmpd19:12:131
1598993030,0cyclictest29606-21kworker/0:1+events21:30:390
1598993030,0cyclictest29606-21kworker/0:1+events21:10:230
1598993030,0cyclictest29606-21kworker/0:1+events21:10:220
1598993030,0cyclictest29606-21kworker/0:1+events20:15:320
1598993030,0cyclictest29606-21kworker/0:1+events19:44:090
1598993030,0cyclictest29606-21kworker/0:1+events19:21:360
1598993030,0cyclictest22126-21kworker/0:1+events23:36:230
1598993030,0cyclictest13319-21kworker/0:1+events23:23:180
1598993029,1cyclictest799-21snmpd20:47:340
1603992928,1cyclictest799-21snmpd19:49:063
1603992928,1cyclictest799-21snmpd19:18:263
1602992928,1cyclictest799-21snmpd21:45:292
1602992928,1cyclictest799-21snmpd20:51:532
1602992928,1cyclictest799-21snmpd20:08:072
1602992927,2cyclictest799-21snmpd23:47:432
1602992927,2cyclictest799-21snmpd20:15:152
1602992927,2cyclictest7211-21cat19:20:172
1599992928,1cyclictest799-21snmpd20:22:461
1599992927,2cyclictest799-21snmpd22:17:271
1599992927,2cyclictest799-21snmpd21:15:571
1599992927,2cyclictest799-21snmpd19:25:181
1599992926,3cyclictest799-21snmpd23:51:481
1598992929,0cyclictest30956-21kworker/0:2+events23:15:010
1598992929,0cyclictest30956-21kworker/0:2+events23:06:250
1598992929,0cyclictest30956-21kworker/0:2+events23:00:560
1598992929,0cyclictest29606-21kworker/0:1+events22:20:290
1598992929,0cyclictest29606-21kworker/0:1+events22:05:480
1598992929,0cyclictest29606-21kworker/0:1+events21:55:080
1598992929,0cyclictest29606-21kworker/0:1+events20:25:040
1598992929,0cyclictest29606-21kworker/0:1+events19:36:160
1598992929,0cyclictest29606-21kworker/0:1+events19:16:210
1598992929,0cyclictest28090-21kworker/0:1+events22:45:590
1598992929,0cyclictest22126-21kworker/0:1+events23:41:080
1598992929,0cyclictest22126-21kworker/0:1+events00:35:040
1598992929,0cyclictest22126-21kworker/0:1+events00:25:040
1598992929,0cyclictest22126-21kworker/0:1+events00:15:050
1598992929,0cyclictest22126-21kworker/0:1+events00:10:240
1598992929,0cyclictest22126-21kworker/0:1+events00:00:020
1598992928,1cyclictest21409-21kworker/0:0+events22:32:250
1598992928,1cyclictest1242-21kworker/0:1+events22:56:510
1598992927,2cyclictest799-21snmpd23:47:400
1602992827,1cyclictest799-21snmpd20:32:172
1599992828,0cyclictest31214-21kworker/u16:3+atlantic21:40:391
1599992827,1cyclictest799-21snmpd20:18:451
1599992827,1cyclictest799-21snmpd20:09:391
1599992826,2cyclictest799-21snmpd00:17:111
1602992726,1cyclictest799-21snmpd20:01:272
1602992725,2cyclictest799-21snmpd21:41:562
1602992725,2cyclictest21992-21cat19:55:172
1599992726,1cyclictest799-21snmpd23:25:541
1599992726,1cyclictest799-21snmpd00:39:081
1599992725,2cyclictest799-21snmpd19:57:481
1603992625,1cyclictest799-21snmpd22:40:053
1603992625,1cyclictest799-21snmpd00:30:373
1602992625,1cyclictest799-21snmpd00:05:052
1602992625,1cyclictest74150irq/139-enp1s022:55:582
1599992625,1cyclictest29744-21cat22:45:141
1599992624,2cyclictest28204-21cat20:10:161
1602992524,1cyclictest799-21snmpd23:12:542
1602992524,1cyclictest799-21snmpd22:12:522
1602992523,2cyclictest799-21snmpd20:59:162
1599992321,2cyclictest799-21snmpd21:38:471
1603992119,2cyclictest799-21snmpd23:57:343
1602992120,1cyclictest799-21snmpd20:49:552
1602992119,2cyclictest799-21snmpd21:28:272
1602992018,2cyclictest799-21snmpd22:00:252
1602991918,1cyclictest799-21snmpd21:15:002
1602991918,1cyclictest799-21snmpd21:14:592
1602991615,1cyclictest799-21snmpd20:20:402
1602991413,1cyclictest799-21snmpd00:21:192
1599991413,1cyclictest799-21snmpd20:25:121
1603991210,2cyclictest19940-21cat22:25:173
16029987,1cyclictest799-21snmpd21:08:582
16039976,1cyclictest7653-21idleruntime-cro20:40:003
16029965,1cyclictest799-21snmpd21:54:302
15999965,1cyclictest19850-21basename19:50:161
15999965,1cyclictest17011-21fw_packets21:00:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional