You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 07:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot3s.osadl.org (updated Tue Dec 02, 2025 00:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
292292317310,5sleep20-21swapper/219:05:282
293672316302,5sleep10-21swapper/119:07:151
294322315307,5sleep30-21swapper/319:08:053
292622315307,5sleep00-21swapper/019:05:540
29845993040,301cyclictest10877-21kworker/u16:3+efi_rts_wq21:25:151
29845993030,302cyclictest23595-21kworker/u16:3+efi_rts_wq19:20:131
29845993020,301cyclictest27507-21kworker/u16:4+efi_rts_wq21:40:151
29842993010,300cyclictest30679-21kworker/u16:3+efi_rts_wq20:30:150
29845992990,297cyclictest28561-21kworker/u16:2+efi_rts_wq21:05:141
29846992980,297cyclictest1344-21kworker/u16:1+efi_rts_wq23:10:132
29842992980,297cyclictest3832-21kworker/u16:3+efi_rts_wq23:56:240
29847992970,296cyclictest23595-21kworker/u16:3+efi_rts_wq19:30:113
29847992970,295cyclictest15377-21kworker/u16:1+efi_rts_wq21:20:133
29847992950,294cyclictest28561-21kworker/u16:2+efi_rts_wq20:25:153
29842992950,294cyclictest15377-21kworker/u16:1+efi_rts_wq21:30:490
29847992940,293cyclictest22308-21kworker/u16:1+efi_rts_wq00:00:133
29846992940,293cyclictest28561-21kworker/u16:2+efi_rts_wq20:25:152
29846992940,293cyclictest27507-21kworker/u16:4+efi_rts_wq21:40:162
29846992930,292cyclictest31367-21kworker/u16:2+efi_rts_wq19:45:152
29842992930,292cyclictest3832-21kworker/u16:3+efi_rts_wq00:36:320
29847992920,291cyclictest15377-21kworker/u16:1+efi_rts_wq21:45:143
29845992920,291cyclictest15377-21kworker/u16:1+efi_rts_wq21:45:131
29842992920,291cyclictest31952-21kworker/u16:0+efi_rts_wq21:55:150
29846992890,288cyclictest7538-21kworker/u16:1+efi_rts_wq22:21:012
29846992890,287cyclictest31952-21kworker/u16:0+efi_rts_wq22:35:152
29845992890,288cyclictest3832-21kworker/u16:3+efi_rts_wq23:10:131
29845992860,284cyclictest3832-21kworker/u16:3+efi_rts_wq23:15:141
29847992850,281cyclictest3832-21kworker/u16:3+efi_rts_wq00:05:123
29845992830,282cyclictest3832-21kworker/u16:3+efi_rts_wq00:35:141
29842992830,282cyclictest31952-21kworker/u16:0+efi_rts_wq22:36:070
29842992830,282cyclictest31367-21kworker/u16:2+efi_rts_wq19:25:150
29847992820,281cyclictest6331-21kworker/u16:0+efi_rts_wq20:35:243
29847992810,280cyclictest20840-21kworker/u16:2+efi_rts_wq23:06:133
29845992800,279cyclictest23595-21kworker/u16:3+efi_rts_wq20:05:181
29845992800,277cyclictest3832-21kworker/u16:3+efi_rts_wq23:40:141
29846992790,278cyclictest8738-21kworker/u16:2+efi_rts_wq23:20:132
29847992780,276cyclictest8738-21kworker/u16:2+efi_rts_wq23:50:123
29847992780,276cyclictest28561-21kworker/u16:2+efi_rts_wq20:55:163
29845992780,277cyclictest375-21kworker/u16:1+efi_rts_wq20:50:141
29845992780,276cyclictest8738-21kworker/u16:2+efi_rts_wq00:25:131
29846992770,276cyclictest3832-21kworker/u16:3+efi_rts_wq23:16:152
29846992760,275cyclictest6331-21kworker/u16:0+efi_rts_wq19:40:132
29845992760,275cyclictest3832-21kworker/u16:3+efi_rts_wq00:01:251
29847992740,273cyclictest13672-21kworker/u16:1+efi_rts_wq23:35:153
29846992740,273cyclictest3832-21kworker/u16:3+efi_rts_wq00:15:132
29847992730,272cyclictest23595-21kworker/u16:3+efi_rts_wq20:05:193
29847992720,271cyclictest22308-21kworker/u16:1+efi_rts_wq00:20:123
29842992720,271cyclictest3832-21kworker/u16:3+efi_rts_wq23:30:150
29847992700,269cyclictest31952-21kworker/u16:0+efi_rts_wq22:00:133
29846992700,269cyclictest31952-21kworker/u16:0+efi_rts_wq22:31:032
29846992700,269cyclictest23595-21kworker/u16:3+efi_rts_wq19:30:142
29845992700,269cyclictest6331-21kworker/u16:0+efi_rts_wq20:20:141
29846992690,268cyclictest30679-21kworker/u16:3+efi_rts_wq20:30:142
29846992690,268cyclictest15377-21kworker/u16:1+efi_rts_wq21:30:132
29845992690,267cyclictest20840-21kworker/u16:2+efi_rts_wq23:00:151
29845992680,266cyclictest8738-21kworker/u16:2+efi_rts_wq23:20:131
29845992670,265cyclictest3832-21kworker/u16:3+efi_rts_wq23:55:141
29845992670,263cyclictest31952-21kworker/u16:0+efi_rts_wq22:50:121
29847992650,264cyclictest6331-21kworker/u16:0+efi_rts_wq20:15:143
29842992640,263cyclictest31952-21kworker/u16:0+efi_rts_wq22:10:130
29847992630,262cyclictest7538-21kworker/u16:1+efi_rts_wq22:30:143
29842992630,262cyclictest6331-21kworker/u16:0+efi_rts_wq19:40:150
29842992630,261cyclictest3832-21kworker/u16:3+efi_rts_wq00:30:100
29845992620,261cyclictest23595-21kworker/u16:3+efi_rts_wq19:50:161
29847992610,260cyclictest8738-21kworker/u16:2+efi_rts_wq23:25:143
29845992610,260cyclictest31367-21kworker/u16:2+efi_rts_wq19:25:151
29845992610,260cyclictest23595-21kworker/u16:3+efi_rts_wq19:35:141
29842992610,260cyclictest375-21kworker/u16:1+efi_rts_wq20:50:140
29847992600,259cyclictest20840-21kworker/u16:2+efi_rts_wq23:00:143
29846992600,259cyclictest375-21kworker/u16:1+efi_rts_wq20:45:152
29847992590,258cyclictest23595-21kworker/u16:3+efi_rts_wq19:50:133
29847992580,257cyclictest10877-21kworker/u16:3+efi_rts_wq21:15:123
29842992570,256cyclictest2462-21kworker/u16:1+efi_rts_wq19:15:010
29842992570,256cyclictest19216-21kworker/u16:2+efi_rts_wq22:00:570
29846992550,254cyclictest15377-21kworker/u16:1+efi_rts_wq21:45:502
29842992550,254cyclictest10877-21kworker/u16:3+efi_rts_wq21:25:150
29847992540,253cyclictest13301-21kworker/u16:0+efi_rts_wq21:10:133
29846992530,252cyclictest31367-21kworker/u16:2+efi_rts_wq19:15:142
29845992500,249cyclictest31952-21kworker/u16:0+efi_rts_wq22:05:581
29847992490,247cyclictest23595-21kworker/u16:3+efi_rts_wq19:35:143
29845992490,248cyclictest31952-21kworker/u16:0+efi_rts_wq22:46:101
29842992470,246cyclictest31952-21kworker/u16:0+efi_rts_wq23:05:160
29847992460,245cyclictest27507-21kworker/u16:4+efi_rts_wq21:40:503
29846992460,245cyclictest31952-21kworker/u16:0+efi_rts_wq21:50:142
29846992440,242cyclictest20840-21kworker/u16:2+efi_rts_wq22:45:142
29845992430,242cyclictest31952-21kworker/u16:0+efi_rts_wq22:15:131
29845992430,242cyclictest31952-21kworker/u16:0+efi_rts_wq21:50:521
29845992430,242cyclictest17383-21kworker/u16:1+efi_rts_wq20:10:131
29846992420,241cyclictest27507-21kworker/u16:4+efi_rts_wq22:41:082
29845992420,241cyclictest3832-21kworker/u16:3+efi_rts_wq00:10:151
29845992410,240cyclictest10877-21kworker/u16:3+efi_rts_wq21:20:481
29842992400,239cyclictest6331-21kworker/u16:0+efi_rts_wq19:55:140
29842992380,237cyclictest27507-21kworker/u16:4+efi_rts_wq22:55:140
29845992370,236cyclictest15377-21kworker/u16:1+efi_rts_wq21:15:451
29845992360,235cyclictest8738-21kworker/u16:2+efi_rts_wq00:21:291
29842992360,235cyclictest15377-21kworker/u16:1+efi_rts_wq21:35:130
29846992350,234cyclictest23595-21kworker/u16:3+efi_rts_wq20:00:162
29846992350,234cyclictest23595-21kworker/u16:3+efi_rts_wq20:00:162
29847992340,233cyclictest375-21kworker/u16:1+efi_rts_wq20:45:153
29847992330,232cyclictest31952-21kworker/u16:0+efi_rts_wq21:55:543
29842992330,231cyclictest2462-21kworker/u16:1+efi_rts_wq19:10:120
29846992300,229cyclictest10877-21kworker/u16:3+efi_rts_wq21:00:152
29842992300,229cyclictest6331-21kworker/u16:0+efi_rts_wq20:15:140
29846992290,228cyclictest10877-21kworker/u16:3+efi_rts_wq21:15:122
29846992280,227cyclictest13672-21kworker/u16:1+efi_rts_wq23:35:152
29842992280,227cyclictest6331-21kworker/u16:0+efi_rts_wq19:35:130
29842992240,223cyclictest27507-21kworker/u16:4+efi_rts_wq22:25:140
29846992220,221cyclictest27507-21kworker/u16:4+efi_rts_wq22:55:142
29845992220,221cyclictest20840-21kworker/u16:2+efi_rts_wq22:56:111
29847992210,220cyclictest3832-21kworker/u16:3+efi_rts_wq23:55:153
29846992200,219cyclictest6331-21kworker/u16:0+efi_rts_wq20:20:142
29845992190,218cyclictest27507-21kworker/u16:4+efi_rts_wq22:10:591
29846992170,216cyclictest6331-21kworker/u16:0+efi_rts_wq20:35:132
29846992130,212cyclictest31952-21kworker/u16:0+efi_rts_wq22:15:132
29847992120,211cyclictest31367-21kworker/u16:2+efi_rts_wq19:45:133
29845992110,210cyclictest8738-21kworker/u16:2+efi_rts_wq00:16:281
29845992110,210cyclictest27507-21kworker/u16:4+efi_rts_wq22:40:131
29842992110,210cyclictest20014-21kworker/u16:0+efi_rts_wq23:45:110
29847992070,206cyclictest3832-21kworker/u16:3+efi_rts_wq23:30:153
29846992070,206cyclictest31952-21kworker/u16:0+efi_rts_wq23:05:162
29846992060,205cyclictest7538-21kworker/u16:1+efi_rts_wq22:26:022
29842992060,205cyclictest10877-21kworker/u16:3+efi_rts_wq21:00:430
29846992020,201cyclictest20014-21kworker/u16:0+efi_rts_wq23:45:122
29842992010,200cyclictest8738-21kworker/u16:2+efi_rts_wq23:21:160
29842992010,200cyclictest10877-21kworker/u16:3+efi_rts_wq21:15:110
29845991990,197cyclictest2462-21kworker/u16:1+efi_rts_wq19:15:011
29846991980,197cyclictest31952-21kworker/u16:0+efi_rts_wq22:05:122
29846991970,196cyclictest22308-21kworker/u16:1+efi_rts_wq00:20:122
29842991970,196cyclictest20840-21kworker/u16:2+efi_rts_wq22:51:110
29846991960,195cyclictest13301-21kworker/u16:0+efi_rts_wq21:10:132
29845991950,194cyclictest7538-21kworker/u16:1+efi_rts_wq22:30:131
29842991950,194cyclictest31367-21kworker/u16:2+efi_rts_wq19:20:100
29846991930,192cyclictest31952-21kworker/u16:0+efi_rts_wq21:55:142
29845991830,182cyclictest3832-21kworker/u16:3+efi_rts_wq00:31:311
29845991820,181cyclictest23595-21kworker/u16:3+efi_rts_wq20:00:161
29845991820,181cyclictest23595-21kworker/u16:3+efi_rts_wq20:00:151
29842991820,181cyclictest17383-21kworker/u16:1+efi_rts_wq20:20:220
29842991800,179cyclictest20014-21kworker/u16:0+efi_rts_wq23:41:220
29842991770,176cyclictest375-21kworker/u16:1+efi_rts_wq20:45:390
29842991760,175cyclictest28561-21kworker/u16:2+efi_rts_wq20:25:230
29847991730,172cyclictest31952-21kworker/u16:0+efi_rts_wq22:50:133
29845991720,170cyclictest31952-21kworker/u16:0+efi_rts_wq22:35:151
29842991670,165cyclictest28561-21kworker/u16:2+efi_rts_wq20:40:140
29847991600,159cyclictest28561-21kworker/u16:2+efi_rts_wq20:40:383
29846991600,159cyclictest22308-21kworker/u16:1+efi_rts_wq23:51:242
29845991600,159cyclictest6331-21kworker/u16:0+efi_rts_wq20:35:141
29846991550,153cyclictest28561-21kworker/u16:2+efi_rts_wq20:55:422
29846991500,149cyclictest15377-21kworker/u16:1+efi_rts_wq21:35:482
29845991470,146cyclictest6331-21kworker/u16:0+efi_rts_wq19:55:141
29842991470,146cyclictest7538-21kworker/u16:1+efi_rts_wq22:30:130
29846991450,144cyclictest31952-21kworker/u16:0+efi_rts_wq22:10:122
29842991450,144cyclictest8738-21kworker/u16:2+efi_rts_wq23:50:130
29847991430,142cyclictest3832-21kworker/u16:3+efi_rts_wq00:10:153
29845991430,142cyclictest8738-21kworker/u16:2+efi_rts_wq23:25:141
29846991390,138cyclictest28561-21kworker/u16:2+efi_rts_wq20:40:132
29845991340,133cyclictest15377-21kworker/u16:1+efi_rts_wq21:35:121
29842991340,133cyclictest20840-21kworker/u16:2+efi_rts_wq23:00:150
29847991300,127cyclictest3832-21kworker/u16:3+efi_rts_wq00:15:133
29845991300,129cyclictest19937-21kworker/u16:0+efi_rts_wq19:10:071
29846991270,127cyclictest8738-21kworker/u16:2+efi_rts_wq23:26:172
29846991230,121cyclictest15377-21kworker/u16:1+efi_rts_wq21:20:132
602021160,0sleep06018-21rm23:11:350
29845991120,112cyclictest28561-21kworker/u16:2+efi_rts_wq20:55:161
29846991100,109cyclictest31367-21kworker/u16:2+efi_rts_wq19:25:112
29842991090,108cyclictest28561-21kworker/u16:2+efi_rts_wq21:05:430
29846991070,106cyclictest19216-21kworker/u16:2+efi_rts_wq21:25:472
29845991070,107cyclictest8738-21kworker/u16:2+efi_rts_wq23:46:221
29847993330,2cyclictest795-21snmpd22:12:583
29847993230,2cyclictest795-21snmpd21:27:423
29845993230,2cyclictest795-21snmpd20:48:291
29845993229,2cyclictest795-21snmpd20:32:061
29842993229,3cyclictest795-21snmpd22:47:290
29842993229,2cyclictest795-21snmpd20:39:010
29847993130,1cyclictest795-21snmpd23:23:353
29847993130,1cyclictest795-21snmpd22:56:533
29847993130,1cyclictest795-21snmpd19:25:203
29847993129,2cyclictest795-21snmpd20:10:273
29847993129,2cyclictest795-21snmpd19:40:503
29847993129,2cyclictest6683-21cat22:05:143
29847993129,1cyclictest795-21snmpd22:35:383
29846993130,1cyclictest795-21snmpd23:59:332
29846993130,1cyclictest795-21snmpd23:41:522
29845993129,2cyclictest795-21snmpd21:33:211
29845993129,2cyclictest795-21snmpd19:42:571
29842993130,1cyclictest795-21snmpd19:45:050
29842993128,2cyclictest795-21snmpd21:49:330
29842993128,2cyclictest795-21snmpd21:10:260
29847993029,1cyclictest795-21snmpd21:34:093
29847993029,1cyclictest795-21snmpd19:20:313
29847993028,2cyclictest795-21snmpd23:46:073
29847993028,2cyclictest795-21snmpd23:40:043
29847993028,2cyclictest795-21snmpd22:45:173
29847993028,2cyclictest795-21snmpd21:04:103
29847993027,2cyclictest795-21snmpd00:36:173
29846993029,1cyclictest795-21snmpd23:02:382
29846993029,1cyclictest795-21snmpd21:09:142
29846993029,1cyclictest795-21snmpd00:35:442
29846993029,1cyclictest795-21snmpd00:07:032
29846993028,2cyclictest795-21snmpd00:01:432
29845993029,1cyclictest795-21snmpd19:47:121
29842993029,1cyclictest795-21snmpd22:06:100
29842993029,1cyclictest795-21snmpd21:52:150
29842993029,1cyclictest795-21snmpd19:32:140
29847992928,1cyclictest795-21snmpd19:19:413
29847992928,1cyclictest30724-21kworker/3:3+events23:17:553
29847992927,1cyclictest16677-21kworker/3:2+events22:40:173
29847992926,2cyclictest795-21snmpd20:53:553
29846992929,0cyclictest795-21snmpd20:18:402
29846992929,0cyclictest795-21snmpd20:09:572
29846992928,1cyclictest795-21snmpd23:32:462
29846992927,2cyclictest795-21snmpd19:11:342
29845992928,1cyclictest795-21snmpd23:32:131
29845992928,1cyclictest795-21snmpd22:21:521
29845992928,1cyclictest795-21snmpd21:13:051
29845992927,2cyclictest795-21snmpd23:05:511
29845992927,2cyclictest3587-21cat20:40:161
29845992926,2cyclictest795-21snmpd22:27:081
29842992928,1cyclictest795-21snmpd00:05:100
29842992927,2cyclictest795-21snmpd21:24:000
29847992828,0cyclictest30724-21kworker/3:3+events23:10:363
29847992827,1cyclictest795-21snmpd20:34:183
29847992827,1cyclictest795-21snmpd20:02:513
29847992827,1cyclictest795-21snmpd20:02:513
29847992827,1cyclictest795-21snmpd19:55:213
29846992827,1cyclictest795-21snmpd19:54:212
29846992827,1cyclictest795-21snmpd19:37:442
29845992827,1cyclictest795-21snmpd23:54:161
29845992827,1cyclictest795-21snmpd20:25:521
29845992826,2cyclictest795-21snmpd21:58:131
29845992825,2cyclictest795-21snmpd22:00:041
29845992825,2cyclictest795-21snmpd20:18:461
29842992827,1cyclictest795-21snmpd00:22:250
29842992826,1cyclictest795-21snmpd22:20:120
29842992825,2cyclictest795-21snmpd00:25:350
29847992726,1cyclictest795-21snmpd00:31:413
29846992726,1cyclictest795-21snmpd00:13:052
29846992725,2cyclictest795-21snmpd20:53:012
29845992725,2cyclictest795-21snmpd00:06:061
29842992726,1cyclictest795-21snmpd23:36:120
29842992726,1cyclictest795-21snmpd23:29:560
29842992725,2cyclictest795-21snmpd20:13:030
29842992725,2cyclictest795-21snmpd20:06:450
29842992725,2cyclictest795-21snmpd19:50:180
29846992625,1cyclictest8253-21cat00:30:132
29842992625,1cyclictest795-21snmpd20:59:550
29847992523,2cyclictest795-21snmpd22:22:163
29847992523,1cyclictest795-21snmpd21:50:423
29847992522,2cyclictest795-21snmpd22:18:393
29846992523,2cyclictest795-21snmpd20:13:592
29842992524,1cyclictest795-21snmpd22:40:220
29842992523,1cyclictest28709-21cat21:40:170
29847992423,1cyclictest795-21snmpd21:08:023
29846992423,1cyclictest31952-21kworker/u16:0+atlantic22:52:222
29846992422,2cyclictest795-21snmpd00:29:592
29842992423,1cyclictest795-21snmpd22:19:310
29842992423,1cyclictest795-21snmpd00:04:070
29847992222,0cyclictest4426-21kworker/3:1+events22:25:213
29847992221,1cyclictest795-21snmpd20:23:283
29846992221,1cyclictest795-21snmpd22:00:312
29845992220,2cyclictest795-21snmpd21:02:201
29842992220,2cyclictest795-21snmpd23:15:500
29847992121,0cyclictest4426-21kworker/3:1+events21:35:193
29847992020,0cyclictest905-21kworker/3:0+events00:25:183
29842992019,1cyclictest795-21snmpd20:04:150
29842992019,1cyclictest795-21snmpd20:04:140
29847991919,0cyclictest31625-21kworker/3:0+events19:10:153
29845991716,1cyclictest795-21snmpd23:37:301
29845991615,1cyclictest795-21snmpd19:34:291
29842991615,1cyclictest795-21snmpd00:13:380
29842991514,1cyclictest795-21snmpd00:19:440
298469987,1cyclictest17331-21cat19:55:172
298469954,1cyclictest2524-21cat19:20:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional