You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-21 - 11:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot3s.osadl.org (updated Tue Oct 21, 2025 00:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
133592320306,5sleep30-21swapper/319:09:303
131452318304,5sleep20-21swapper/219:06:462
131792315307,5sleep10-21swapper/119:07:121
132192314307,5sleep00-21swapper/019:07:390
13668992950,294cyclictest5092-21kworker/u16:2+efi_rts_wq19:15:143
13668992930,292cyclictest7398-21kworker/u16:0+efi_rts_wq20:15:153
13665992930,292cyclictest5092-21kworker/u16:2+efi_rts_wq21:50:130
13667992910,290cyclictest5092-21kworker/u16:2+efi_rts_wq19:55:152
13667992900,289cyclictest5092-21kworker/u16:2+efi_rts_wq21:45:152
13668992890,288cyclictest11184-21kworker/u16:3+efi_rts_wq23:10:143
13666992890,288cyclictest23643-21kworker/u16:1+efi_rts_wq00:30:421
13668992880,287cyclictest5092-21kworker/u16:2+efi_rts_wq19:39:533
13667992880,287cyclictest5092-21kworker/u16:2+efi_rts_wq20:05:132
13667992870,286cyclictest5092-21kworker/u16:2+efi_rts_wq22:00:182
13668992860,285cyclictest16166-21kworker/u16:0+efi_rts_wq00:15:393
13668992850,284cyclictest5092-21kworker/u16:2+efi_rts_wq22:10:143
13665992850,284cyclictest11184-21kworker/u16:3+efi_rts_wq22:35:160
13668992840,283cyclictest5092-21kworker/u16:2+efi_rts_wq21:25:143
13665992840,283cyclictest5092-21kworker/u16:2+efi_rts_wq22:05:180
13668992830,280cyclictest5092-21kworker/u16:2+efi_rts_wq22:00:153
13665992830,282cyclictest16166-21kworker/u16:0+efi_rts_wq23:20:150
13665992830,280cyclictest23643-21kworker/u16:1+efi_rts_wq00:00:140
13668992820,281cyclictest5092-21kworker/u16:2+efi_rts_wq22:20:133
13668992820,281cyclictest5092-21kworker/u16:2+efi_rts_wq21:45:133
13668992820,281cyclictest5092-21kworker/u16:2+efi_rts_wq20:20:153
13668992800,279cyclictest5092-21kworker/u16:2+efi_rts_wq20:35:053
13666992800,278cyclictest11184-21kworker/u16:3+efi_rts_wq23:00:151
13666992800,278cyclictest11184-21kworker/u16:3+efi_rts_wq23:00:151
13667992780,277cyclictest23643-21kworker/u16:1+efi_rts_wq23:35:142
13665992780,277cyclictest11184-21kworker/u16:3+efi_rts_wq21:55:170
13666992770,276cyclictest939-21kworker/u16:0+efi_rts_wq22:50:131
13665992770,276cyclictest16166-21kworker/u16:0+efi_rts_wq23:45:130
13665992760,275cyclictest5092-21kworker/u16:2+efi_rts_wq20:20:000
13665992760,275cyclictest16166-21kworker/u16:0+efi_rts_wq00:15:130
13668992750,274cyclictest5092-21kworker/u16:2+efi_rts_wq20:55:073
13666992740,273cyclictest11184-21kworker/u16:3+efi_rts_wq22:30:221
13665992740,273cyclictest23643-21kworker/u16:1+efi_rts_wq00:35:140
13666992720,271cyclictest11184-21kworker/u16:3+efi_rts_wq22:35:161
13665992720,271cyclictest23643-21kworker/u16:1+efi_rts_wq00:05:380
13667992710,270cyclictest7398-21kworker/u16:0+efi_rts_wq19:50:112
13667992700,269cyclictest23643-21kworker/u16:1+efi_rts_wq23:55:122
13667992690,268cyclictest7398-21kworker/u16:0+efi_rts_wq19:44:532
13667992690,268cyclictest7398-21kworker/u16:0+efi_rts_wq19:14:482
13665992680,267cyclictest5092-21kworker/u16:2+efi_rts_wq22:25:170
13665992670,266cyclictest11184-21kworker/u16:3+efi_rts_wq22:15:120
13668992650,264cyclictest21173-21kworker/u16:2+efi_rts_wq23:25:183
13666992640,263cyclictest5092-21kworker/u16:2+efi_rts_wq22:20:201
13666992640,263cyclictest5092-21kworker/u16:2+efi_rts_wq20:30:151
13666992640,263cyclictest5092-21kworker/u16:2+efi_rts_wq19:10:121
13665992640,262cyclictest16166-21kworker/u16:0+efi_rts_wq23:50:140
13668992630,262cyclictest23643-21kworker/u16:1+efi_rts_wq00:35:433
13668992610,260cyclictest5092-21kworker/u16:2+efi_rts_wq19:29:523
13668992610,260cyclictest23643-21kworker/u16:1+efi_rts_wq00:25:413
13666992610,260cyclictest11184-21kworker/u16:3+efi_rts_wq22:40:131
13668992590,258cyclictest11184-21kworker/u16:3+efi_rts_wq21:35:143
13665992590,258cyclictest11184-21kworker/u16:3+efi_rts_wq21:10:130
13668992580,257cyclictest11184-21kworker/u16:3+efi_rts_wq21:00:083
13668992570,256cyclictest16166-21kworker/u16:0+efi_rts_wq23:30:133
13668992560,255cyclictest5092-21kworker/u16:2+efi_rts_wq19:45:183
13668992560,255cyclictest16166-21kworker/u16:0+efi_rts_wq23:40:143
13666992560,255cyclictest5092-21kworker/u16:2+efi_rts_wq19:55:151
13668992550,254cyclictest16166-21kworker/u16:0+efi_rts_wq00:10:143
13666992550,254cyclictest11184-21kworker/u16:3+efi_rts_wq23:05:141
13668992540,252cyclictest16166-21kworker/u16:0+efi_rts_wq23:45:143
13667992540,253cyclictest11184-21kworker/u16:3+efi_rts_wq21:40:142
13668992490,248cyclictest23643-21kworker/u16:1+efi_rts_wq00:05:133
13668992490,248cyclictest11184-21kworker/u16:3+efi_rts_wq23:15:303
13668992480,247cyclictest5092-21kworker/u16:2+efi_rts_wq21:05:143
13668992470,246cyclictest11184-21kworker/u16:3+efi_rts_wq21:20:113
13667992470,246cyclictest5092-21kworker/u16:2+efi_rts_wq22:10:202
13666992470,246cyclictest7398-21kworker/u16:0+efi_rts_wq19:54:551
13665992470,246cyclictest16166-21kworker/u16:0+efi_rts_wq00:20:160
13665992450,244cyclictest7398-21kworker/u16:0+efi_rts_wq20:00:120
13665992450,244cyclictest7398-21kworker/u16:0+efi_rts_wq19:40:110
13668992440,242cyclictest16166-21kworker/u16:0+efi_rts_wq00:30:123
13665992440,243cyclictest5092-21kworker/u16:2+efi_rts_wq20:55:140
13665992440,243cyclictest23643-21kworker/u16:1+efi_rts_wq23:55:360
13666992430,242cyclictest7398-21kworker/u16:0+efi_rts_wq20:25:021
13666992430,242cyclictest16166-21kworker/u16:0+efi_rts_wq23:30:131
13668992420,241cyclictest5092-21kworker/u16:2+efi_rts_wq21:10:103
13666992420,241cyclictest23643-21kworker/u16:1+efi_rts_wq23:55:121
13666992420,241cyclictest23643-21kworker/u16:1+efi_rts_wq23:50:351
13665992420,241cyclictest11184-21kworker/u16:3+efi_rts_wq21:15:150
13668992410,240cyclictest939-21kworker/u16:0+efi_rts_wq22:55:153
13665992410,240cyclictest11184-21kworker/u16:3+efi_rts_wq20:50:150
13668992400,239cyclictest23643-21kworker/u16:1+efi_rts_wq00:00:373
13666992400,239cyclictest5092-21kworker/u16:2+efi_rts_wq20:45:061
13668992390,238cyclictest5092-21kworker/u16:2+efi_rts_wq22:05:143
13665992380,237cyclictest7398-21kworker/u16:0+efi_rts_wq19:30:150
13667992370,236cyclictest5092-21kworker/u16:2+efi_rts_wq20:25:142
13666992350,234cyclictest16166-21kworker/u16:0+efi_rts_wq23:15:131
13666992330,232cyclictest7398-21kworker/u16:0+efi_rts_wq19:15:001
13668992310,230cyclictest11184-21kworker/u16:3+efi_rts_wq22:45:133
13668992310,230cyclictest11184-21kworker/u16:3+efi_rts_wq20:45:123
13668992310,229cyclictest11184-21kworker/u16:3+efi_rts_wq21:55:173
13667992310,230cyclictest5092-21kworker/u16:2+efi_rts_wq21:05:142
13668992300,229cyclictest11184-21kworker/u16:3+efi_rts_wq21:40:103
13667992300,229cyclictest5092-21kworker/u16:2+efi_rts_wq19:25:132
13665992300,229cyclictest5092-21kworker/u16:2+efi_rts_wq21:20:120
13665992300,226cyclictest7398-21kworker/u16:0+efi_rts_wq20:10:120
13667992280,227cyclictest11184-21kworker/u16:3+efi_rts_wq23:05:152
13666992280,227cyclictest16166-21kworker/u16:0+efi_rts_wq23:20:151
13667992240,223cyclictest7398-21kworker/u16:0+efi_rts_wq19:20:162
13665992240,223cyclictest5092-21kworker/u16:2+efi_rts_wq19:15:130
13667992230,222cyclictest16166-21kworker/u16:0+efi_rts_wq23:30:132
13668992220,221cyclictest11184-21kworker/u16:3+efi_rts_wq21:30:133
13665992180,216cyclictest11184-21kworker/u16:3+efi_rts_wq22:45:130
13665992160,215cyclictest5092-21kworker/u16:2+efi_rts_wq20:30:030
13665992120,211cyclictest21173-21kworker/u16:2+efi_rts_wq23:25:170
13667992100,209cyclictest5092-21kworker/u16:2+efi_rts_wq20:55:142
13667992100,209cyclictest11184-21kworker/u16:3+efi_rts_wq20:35:132
13667992090,207cyclictest939-21kworker/u16:0+efi_rts_wq22:55:152
13666992090,208cyclictest5092-21kworker/u16:2+efi_rts_wq19:24:501
13665992080,207cyclictest5092-21kworker/u16:2+efi_rts_wq19:10:120
13667992060,205cyclictest5092-21kworker/u16:2+efi_rts_wq21:00:122
13666992060,205cyclictest10964-21kworker/u16:1+efi_rts_wq23:10:131
13667992040,203cyclictest16166-21kworker/u16:0+efi_rts_wq00:10:142
13668992030,202cyclictest11184-21kworker/u16:3+efi_rts_wq21:15:153
13668992010,200cyclictest5092-21kworker/u16:2+efi_rts_wq21:50:163
13667992000,199cyclictest5092-21kworker/u16:2+efi_rts_wq21:55:172
13666992000,199cyclictest5092-21kworker/u16:2+efi_rts_wq20:40:131
13667991990,198cyclictest5092-21kworker/u16:2+efi_rts_wq21:30:132
13665991960,195cyclictest5092-21kworker/u16:2+efi_rts_wq21:00:130
13668991920,191cyclictest7398-21kworker/u16:0+efi_rts_wq19:40:113
13666991900,189cyclictest5092-21kworker/u16:2+efi_rts_wq21:45:131
13668991870,186cyclictest7398-21kworker/u16:0+efi_rts_wq20:00:123
13668991870,186cyclictest7398-21kworker/u16:0+efi_rts_wq19:30:153
13665991780,177cyclictest11184-21kworker/u16:3+efi_rts_wq23:00:150
13665991780,177cyclictest11184-21kworker/u16:3+efi_rts_wq23:00:150
13665991770,176cyclictest23643-21kworker/u16:1+efi_rts_wq00:25:160
13668991750,174cyclictest5092-21kworker/u16:2+efi_rts_wq20:40:133
13665991740,173cyclictest23643-21kworker/u16:1+efi_rts_wq23:35:130
13668991670,166cyclictest5092-21kworker/u16:2+efi_rts_wq20:25:153
13666991670,166cyclictest23643-21kworker/u16:1+efi_rts_wq23:35:141
13666991660,166cyclictest5092-21kworker/u16:2+efi_rts_wq21:25:131
13668991640,161cyclictest11184-21kworker/u16:3+efi_rts_wq22:35:163
13665991500,149cyclictest11184-21kworker/u16:3+efi_rts_wq22:30:140
13667991460,145cyclictest23643-21kworker/u16:1+efi_rts_wq00:05:122
13665991370,136cyclictest23643-21kworker/u16:1+efi_rts_wq23:30:310
13666991290,128cyclictest16166-21kworker/u16:0+efi_rts_wq23:40:131
13668991280,127cyclictest11184-21kworker/u16:3+efi_rts_wq22:30:143
13666991270,127cyclictest16166-21kworker/u16:0+efi_rts_wq00:10:381
13665991180,117cyclictest11184-21kworker/u16:3+efi_rts_wq22:50:260
13667991080,108cyclictest16166-21kworker/u16:0+efi_rts_wq23:40:332
13666991040,103cyclictest939-21kworker/u16:0+efi_rts_wq22:55:151
13665991030,102cyclictest11184-21kworker/u16:3+efi_rts_wq23:10:290
13666991000,100cyclictest5092-21kworker/u16:2+efi_rts_wq22:25:171
1366799990,99cyclictest11184-21kworker/u16:3+efi_rts_wq23:00:282
1366799990,99cyclictest11184-21kworker/u16:3+efi_rts_wq23:00:272
13668993230,2cyclictest799-21snmpd20:34:383
13667993230,2cyclictest799-21snmpd20:13:282
13667993230,1cyclictest799-21snmpd21:53:102
1366799320,32cyclictest28366-21sshd23:28:242
13666993230,2cyclictest799-21snmpd20:00:371
13665993230,2cyclictest799-21snmpd20:36:320
13665993230,1cyclictest799-21snmpd20:45:140
13665993229,3cyclictest799-21snmpd22:21:050
13665993228,4cyclictest799-21snmpd23:17:580
13668993130,1cyclictest799-21snmpd22:29:513
13667993130,1cyclictest799-21snmpd20:01:132
13667993130,1cyclictest799-21snmpd19:18:102
13667993130,1cyclictest799-21snmpd00:39:222
13667993130,1cyclictest23643-21kworker/u16:1+events_unbound23:54:002
13667993129,2cyclictest799-21snmpd21:14:362
13667993129,2cyclictest799-21snmpd20:23:142
13666993129,2cyclictest799-21snmpd22:18:321
13666993129,2cyclictest799-21snmpd00:09:301
13665993130,1cyclictest799-21snmpd22:42:330
13665993129,2cyclictest808-21lldpd20:16:110
13665993129,2cyclictest799-21snmpd22:57:040
13665993129,1cyclictest799-21snmpd19:50:130
13665993128,3cyclictest799-21snmpd19:49:250
13665993126,4cyclictest799-21snmpd19:55:070
13668993029,1cyclictest9957-21cat22:50:153
13668993029,1cyclictest799-21snmpd23:54:543
13667993029,1cyclictest799-21snmpd00:25:282
13667993028,2cyclictest799-21snmpd22:52:142
13667993028,2cyclictest799-21snmpd22:43:162
13667993027,3cyclictest799-21snmpd22:36:092
13666993030,0cyclictest5092-21kworker/u16:2+atlantic22:09:581
13666993030,0cyclictest5092-21kworker/u16:2+atlantic21:33:441
13666993030,0cyclictest5092-21kworker/u16:2+atlantic20:10:301
13666993030,0cyclictest5092-21kworker/u16:2+atlantic19:42:481
13666993030,0cyclictest23643-21kworker/u16:1+atlantic00:28:401
13666993030,0cyclictest22916-21kworker/u16:3+atlantic00:39:181
13666993030,0cyclictest11184-21kworker/u16:3+atlantic21:08:081
13666993029,1cyclictest799-21snmpd20:08:281
13666993029,1cyclictest799-21snmpd19:37:151
1366699300,0cyclictest0-21swapper/121:20:241
13665993030,0cyclictest9829-21kworker/0:0+events21:38:200
13665993029,1cyclictest799-21snmpd23:05:370
13665993027,3cyclictest799-21snmpd00:33:140
13668992928,1cyclictest799-21snmpd19:57:473
13668992927,2cyclictest799-21snmpd22:19:593
13668992927,2cyclictest799-21snmpd20:09:143
13667992929,0cyclictest799-21snmpd23:20:342
13667992928,1cyclictest799-21snmpd22:25:452
13666992929,0cyclictest5092-21kworker/u16:2+atlantic21:12:241
13666992928,1cyclictest799-21snmpd21:15:151
13666992927,2cyclictest18059-21cat20:35:151
13665992929,0cyclictest9829-21kworker/0:0+events21:49:080
13665992929,0cyclictest10340-21kworker/0:1+events00:11:170
13665992928,1cyclictest799-21snmpd21:30:320
13665992928,1cyclictest799-21snmpd20:07:250
13665992925,1cyclictest799-21snmpd19:28:450
13665992924,2cyclictest799-21snmpd20:25:590
13668992828,0cyclictest799-21snmpd23:00:313
13668992828,0cyclictest799-21snmpd23:00:313
13667992828,0cyclictest11184-21kworker/u16:3+atlantic21:23:462
13667992827,1cyclictest799-21snmpd22:05:502
13667992827,1cyclictest799-21snmpd00:01:182
13667992826,2cyclictest799-21snmpd19:48:012
13667992825,3cyclictest0-21swapper/200:19:362
13666992827,1cyclictest799-21snmpd21:59:561
13666992827,1cyclictest799-21snmpd20:56:061
13666992827,1cyclictest799-21snmpd20:22:351
13666992827,1cyclictest799-21snmpd19:34:271
13665992828,0cyclictest15793-21kworker/0:1+events22:11:560
13668992726,1cyclictest799-21snmpd23:59:133
13667992727,0cyclictest799-21snmpd23:11:102
13667992726,1cyclictest799-21snmpd23:47:382
13667992725,2cyclictest799-21snmpd23:19:132
13666992726,1cyclictest799-21snmpd22:00:451
13666992726,1cyclictest799-21snmpd21:40:591
13665992727,0cyclictest551-21kworker/0:1+events23:43:180
13665992726,1cyclictest799-21snmpd21:08:090
13665992723,1cyclictest19719-21cat22:00:160
13668992626,0cyclictest16166-21kworker/u16:0+atlantic23:21:483
13668992626,0cyclictest10964-21kworker/u16:1+atlantic23:05:293
13668992624,2cyclictest799-21snmpd22:44:453
13668992624,2cyclictest799-21snmpd20:51:033
13668992624,2cyclictest799-21snmpd00:20:223
13667992625,1cyclictest799-21snmpd22:30:132
13667992625,1cyclictest799-21snmpd21:28:222
13667992625,1cyclictest799-21snmpd20:17:382
13666992624,2cyclictest799-21snmpd22:13:211
13666992624,2cyclictest799-21snmpd21:36:131
13666992624,2cyclictest799-21snmpd20:18:111
13665992624,2cyclictest799-21snmpd19:36:060
13668992524,1cyclictest799-21snmpd19:22:513
13667992525,0cyclictest7398-21kworker/u16:0+atlantic19:32:502
13667992525,0cyclictest5092-21kworker/u16:2+atlantic20:41:482
13667992523,2cyclictest799-21snmpd20:48:152
13666992524,1cyclictest799-21snmpd20:52:151
13666992523,2cyclictest799-21snmpd23:47:021
13666992523,2cyclictest799-21snmpd21:53:141
13665992524,1cyclictest799-21snmpd20:42:300
13668992423,1cyclictest799-21snmpd20:10:583
13667992423,1cyclictest799-21snmpd22:45:152
13667992423,1cyclictest799-21snmpd21:17:452
13667992423,1cyclictest799-21snmpd20:31:322
13667992423,1cyclictest799-21snmpd00:24:462
13666992423,1cyclictest799-21snmpd21:01:061
13668992323,0cyclictest7398-21kworker/u16:0+atlantic19:54:523
13667992322,1cyclictest799-21snmpd22:18:262
13666992322,1cyclictest799-21snmpd19:46:491
13666992322,1cyclictest16166-21kworker/u16:0+atlantic23:25:221
13665992322,1cyclictest799-21snmpd19:24:240
13668992222,0cyclictest74050irq/138-enp1s023:36:293
13668992220,2cyclictest799-21snmpd19:11:003
13666992221,1cyclictest799-21snmpd22:48:331
13666992120,1cyclictest799-21snmpd00:02:451
13667991918,1cyclictest799-21snmpd20:53:062
13666991917,2cyclictest799-21snmpd00:18:361
13665991818,0cyclictest9829-21kworker/0:0+events21:41:560
13667991715,0cyclictest0-21swapper/219:38:002
13666991716,1cyclictest799-21snmpd19:27:181
13666991514,1cyclictest799-21snmpd00:23:521
136679988,0cyclictest799-21snmpd00:32:012
136679986,2cyclictest28343-21cat22:20:162
136679954,1cyclictest10555-21sh21:40:002
136659954,1cyclictest6245-21grep21:25:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional