You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 14:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot3s.osadl.org (updated Sun Nov 23, 2025 00:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
34672334312,5sleep30-21swapper/319:09:193
34402315308,5sleep10-21swapper/119:08:571
32122315308,5sleep20-21swapper/219:06:012
32152314306,5sleep00-21swapper/019:06:030
3790993020,299cyclictest20978-21kworker/u16:2+efi_rts_wq21:40:142
3790993010,300cyclictest384-21kworker/u16:3+efi_rts_wq23:05:122
3789993000,299cyclictest20978-21kworker/u16:2+efi_rts_wq21:05:141
3791992990,297cyclictest20141-21kworker/u16:1+efi_rts_wq23:55:163
3790992980,297cyclictest20978-21kworker/u16:2+efi_rts_wq21:45:072
3788992980,297cyclictest30335-21kworker/u16:0+efi_rts_wq23:45:310
3790992970,296cyclictest3838-21kworker/u16:1+efi_rts_wq22:25:132
3790992970,295cyclictest30335-21kworker/u16:0+efi_rts_wq22:50:152
3789992970,295cyclictest3838-21kworker/u16:1+efi_rts_wq22:35:171
3790992940,293cyclictest20978-21kworker/u16:2+efi_rts_wq19:55:152
3788992940,293cyclictest384-21kworker/u16:3+efi_rts_wq23:00:230
3790992930,292cyclictest384-21kworker/u16:3+efi_rts_wq23:10:132
3790992920,291cyclictest20978-21kworker/u16:2+efi_rts_wq21:55:142
3790992910,290cyclictest3838-21kworker/u16:1+efi_rts_wq21:50:082
3788992910,290cyclictest20978-21kworker/u16:2+efi_rts_wq20:24:520
3791992900,289cyclictest3838-21kworker/u16:1+efi_rts_wq20:20:143
3789992900,289cyclictest3838-21kworker/u16:1+efi_rts_wq20:15:151
3788992900,289cyclictest20978-21kworker/u16:2+efi_rts_wq20:40:140
3789992890,288cyclictest3838-21kworker/u16:1+efi_rts_wq22:25:131
3789992880,287cyclictest20978-21kworker/u16:2+efi_rts_wq19:30:151
3790992870,286cyclictest3838-21kworker/u16:1+efi_rts_wq19:34:412
3791992850,284cyclictest20141-21kworker/u16:1+efi_rts_wq23:30:283
3788992840,283cyclictest20141-21kworker/u16:1+efi_rts_wq23:30:130
3791992830,282cyclictest1415-21kworker/u16:3+efi_rts_wq00:30:143
3788992830,282cyclictest3838-21kworker/u16:1+efi_rts_wq22:20:130
3788992820,281cyclictest3838-21kworker/u16:1+efi_rts_wq19:15:130
3788992820,280cyclictest384-21kworker/u16:3+efi_rts_wq23:25:150
3791992810,280cyclictest384-21kworker/u16:3+efi_rts_wq23:00:133
3788992810,279cyclictest3838-21kworker/u16:1+efi_rts_wq22:45:130
3790992800,279cyclictest20141-21kworker/u16:1+efi_rts_wq23:50:122
3789992790,278cyclictest30335-21kworker/u16:0+efi_rts_wq00:25:141
3789992790,278cyclictest20141-21kworker/u16:1+efi_rts_wq23:55:161
3791992780,277cyclictest384-21kworker/u16:3+efi_rts_wq23:10:143
3791992780,277cyclictest3838-21kworker/u16:1+efi_rts_wq19:45:133
3791992780,277cyclictest20978-21kworker/u16:2+efi_rts_wq21:55:143
3789992780,277cyclictest3838-21kworker/u16:1+efi_rts_wq22:40:131
3789992760,275cyclictest30335-21kworker/u16:0+efi_rts_wq23:15:251
3790992750,274cyclictest3838-21kworker/u16:1+efi_rts_wq21:35:052
3788992750,274cyclictest3838-21kworker/u16:1+efi_rts_wq21:04:590
3788992740,273cyclictest3838-21kworker/u16:1+efi_rts_wq22:15:130
3791992730,272cyclictest20978-21kworker/u16:2+efi_rts_wq21:30:123
3790992730,272cyclictest20978-21kworker/u16:2+efi_rts_wq20:35:142
3790992730,270cyclictest20978-21kworker/u16:2+efi_rts_wq21:05:142
3789992730,272cyclictest30335-21kworker/u16:0+efi_rts_wq23:45:141
3788992730,271cyclictest20141-21kworker/u16:1+efi_rts_wq23:40:130
3791992720,271cyclictest20978-21kworker/u16:2+efi_rts_wq21:00:133
3791992680,267cyclictest3838-21kworker/u16:1+efi_rts_wq20:15:153
3791992680,267cyclictest20978-21kworker/u16:2+efi_rts_wq19:30:143
3791992680,267cyclictest1415-21kworker/u16:3+efi_rts_wq00:10:133
3790992670,266cyclictest3838-21kworker/u16:1+efi_rts_wq22:05:122
3790992670,266cyclictest1415-21kworker/u16:3+efi_rts_wq00:25:392
3790992640,263cyclictest3838-21kworker/u16:1+efi_rts_wq19:45:132
3789992630,260cyclictest20978-21kworker/u16:2+efi_rts_wq19:55:151
3788992630,262cyclictest20141-21kworker/u16:1+efi_rts_wq23:55:160
3791992610,260cyclictest20978-21kworker/u16:2+efi_rts_wq19:50:123
3789992610,260cyclictest3838-21kworker/u16:1+efi_rts_wq19:10:151
3789992600,259cyclictest3838-21kworker/u16:1+efi_rts_wq22:45:131
3788992600,259cyclictest3838-21kworker/u16:1+efi_rts_wq20:25:160
3790992580,257cyclictest384-21kworker/u16:3+efi_rts_wq23:20:122
3788992580,257cyclictest20978-21kworker/u16:2+efi_rts_wq21:30:110
3790992570,255cyclictest3838-21kworker/u16:1+efi_rts_wq22:20:142
3788992570,256cyclictest30335-21kworker/u16:0+efi_rts_wq00:35:140
3791992560,255cyclictest30335-21kworker/u16:0+efi_rts_wq00:05:123
3791992560,253cyclictest20141-21kworker/u16:1+efi_rts_wq23:35:123
3791992550,254cyclictest3838-21kworker/u16:1+efi_rts_wq22:00:133
3791992550,254cyclictest20978-21kworker/u16:2+efi_rts_wq21:45:143
3789992550,253cyclictest3838-21kworker/u16:1+efi_rts_wq22:30:131
3788992550,254cyclictest30335-21kworker/u16:0+efi_rts_wq22:55:220
3791992540,253cyclictest3838-21kworker/u16:1+efi_rts_wq19:40:153
3791992540,253cyclictest20978-21kworker/u16:2+efi_rts_wq20:00:143
3790992540,253cyclictest30335-21kworker/u16:0+efi_rts_wq00:15:132
3789992540,253cyclictest3838-21kworker/u16:1+efi_rts_wq20:55:141
3788992540,251cyclictest20978-21kworker/u16:2+efi_rts_wq20:35:140
3790992530,252cyclictest3838-21kworker/u16:1+efi_rts_wq19:25:152
3791992520,251cyclictest3838-21kworker/u16:1+efi_rts_wq19:29:403
3789992520,251cyclictest3838-21kworker/u16:1+efi_rts_wq22:55:131
3791992510,250cyclictest20978-21kworker/u16:2+efi_rts_wq21:15:143
3790992510,250cyclictest1415-21kworker/u16:3+efi_rts_wq00:20:152
3790992490,248cyclictest20978-21kworker/u16:2+efi_rts_wq19:19:392
3788992490,247cyclictest1415-21kworker/u16:3+efi_rts_wq00:30:140
3791992470,246cyclictest3838-21kworker/u16:1+efi_rts_wq22:25:153
3789992470,246cyclictest3838-21kworker/u16:1+efi_rts_wq20:54:571
3791992460,245cyclictest20978-21kworker/u16:2+efi_rts_wq19:20:123
3791992440,243cyclictest30335-21kworker/u16:0+efi_rts_wq00:35:143
3790992440,243cyclictest20978-21kworker/u16:2+efi_rts_wq20:09:482
3789992440,242cyclictest3838-21kworker/u16:1+efi_rts_wq21:20:141
3789992440,242cyclictest3838-21kworker/u16:1+efi_rts_wq21:20:141
3788992440,242cyclictest20978-21kworker/u16:2+efi_rts_wq22:05:110
3789992410,240cyclictest384-21kworker/u16:3+efi_rts_wq23:25:151
3790992390,238cyclictest20978-21kworker/u16:2+efi_rts_wq21:15:142
3788992390,238cyclictest3838-21kworker/u16:1+efi_rts_wq20:50:140
3791992380,237cyclictest30335-21kworker/u16:0+efi_rts_wq00:15:133
3788992380,237cyclictest3838-21kworker/u16:1+efi_rts_wq20:45:140
3788992380,237cyclictest30335-21kworker/u16:0+efi_rts_wq00:00:330
3790992370,236cyclictest30335-21kworker/u16:0+efi_rts_wq23:15:142
3789992370,236cyclictest3838-21kworker/u16:1+efi_rts_wq21:50:131
3790992350,234cyclictest20978-21kworker/u16:2+efi_rts_wq20:34:532
3790992320,231cyclictest3838-21kworker/u16:1+efi_rts_wq20:50:142
3788992320,231cyclictest30335-21kworker/u16:0+efi_rts_wq00:25:140
3791992310,230cyclictest3838-21kworker/u16:1+efi_rts_wq21:25:153
3789992280,227cyclictest30335-21kworker/u16:0+efi_rts_wq23:05:241
3788992240,223cyclictest20978-21kworker/u16:2+efi_rts_wq21:45:150
3789992230,222cyclictest20141-21kworker/u16:1+efi_rts_wq23:50:121
3790992150,214cyclictest1415-21kworker/u16:3+efi_rts_wq00:35:402
3788992150,214cyclictest3838-21kworker/u16:1+efi_rts_wq21:20:030
3788992150,214cyclictest3838-21kworker/u16:1+efi_rts_wq21:20:020
3788992130,211cyclictest3838-21kworker/u16:1+efi_rts_wq21:50:120
3790992080,207cyclictest20978-21kworker/u16:2+efi_rts_wq19:35:142
3791992060,205cyclictest3838-21kworker/u16:1+efi_rts_wq22:55:143
3790992040,202cyclictest3838-21kworker/u16:1+efi_rts_wq22:35:152
3788992040,203cyclictest1415-21kworker/u16:3+efi_rts_wq00:20:160
3791992030,202cyclictest20978-21kworker/u16:2+efi_rts_wq21:05:143
3791992020,201cyclictest3838-21kworker/u16:1+efi_rts_wq19:59:463
3791992020,201cyclictest20978-21kworker/u16:2+efi_rts_wq19:35:143
3789992000,199cyclictest30335-21kworker/u16:0+efi_rts_wq00:20:371
3790991980,197cyclictest20978-21kworker/u16:2+efi_rts_wq19:54:452
3791991970,195cyclictest30335-21kworker/u16:0+efi_rts_wq23:45:143
3790991960,195cyclictest20141-21kworker/u16:1+efi_rts_wq23:35:122
3789991960,195cyclictest3838-21kworker/u16:1+efi_rts_wq20:10:141
3789991960,195cyclictest30335-21kworker/u16:0+efi_rts_wq23:20:251
3790991930,192cyclictest20978-21kworker/u16:2+efi_rts_wq20:44:552
3789991930,192cyclictest20978-21kworker/u16:2+efi_rts_wq22:10:121
3788991920,191cyclictest3838-21kworker/u16:1+efi_rts_wq21:10:130
3791991880,187cyclictest20978-21kworker/u16:2+efi_rts_wq20:05:143
3790991850,183cyclictest3838-21kworker/u16:1+efi_rts_wq22:30:142
3788991830,182cyclictest20978-21kworker/u16:2+efi_rts_wq19:20:130
3788991820,181cyclictest20978-21kworker/u16:2+efi_rts_wq20:30:130
3788991800,179cyclictest3838-21kworker/u16:1+efi_rts_wq19:10:150
3791991790,177cyclictest30335-21kworker/u16:0+efi_rts_wq00:00:163
3788991780,177cyclictest20978-21kworker/u16:2+efi_rts_wq20:05:150
3790991730,172cyclictest20978-21kworker/u16:2+efi_rts_wq20:00:152
3791991680,165cyclictest3838-21kworker/u16:1+efi_rts_wq22:35:153
3791991610,160cyclictest3838-21kworker/u16:1+efi_rts_wq19:14:373
3788991590,158cyclictest3838-21kworker/u16:1+efi_rts_wq19:25:150
3790991580,157cyclictest3838-21kworker/u16:1+efi_rts_wq21:10:132
3788991580,154cyclictest3838-21kworker/u16:1+efi_rts_wq21:25:150
3790991490,148cyclictest1415-21kworker/u16:3+efi_rts_wq00:10:122
3791991470,146cyclictest384-21kworker/u16:3+efi_rts_wq23:20:123
3789991460,145cyclictest3838-21kworker/u16:1+efi_rts_wq20:05:151
3790991400,140cyclictest20978-21kworker/u16:2+efi_rts_wq19:24:392
3788991390,138cyclictest3838-21kworker/u16:1+efi_rts_wq20:10:140
3788991380,138cyclictest30335-21kworker/u16:0+efi_rts_wq22:50:150
3788991380,137cyclictest1415-21kworker/u16:3+efi_rts_wq00:10:360
3791991370,136cyclictest3838-21kworker/u16:1+efi_rts_wq22:45:193
3790991370,136cyclictest3838-21kworker/u16:1+efi_rts_wq20:10:142
3790991360,135cyclictest3838-21kworker/u16:1+efi_rts_wq20:25:162
3789991360,135cyclictest30335-21kworker/u16:0+efi_rts_wq00:05:121
3791991340,133cyclictest20978-21kworker/u16:2+efi_rts_wq19:15:013
3788991330,132cyclictest3838-21kworker/u16:1+efi_rts_wq21:15:010
3788991300,129cyclictest20978-21kworker/u16:2+efi_rts_wq20:19:500
3789991290,126cyclictest3838-21kworker/u16:1+efi_rts_wq22:00:121
3790991260,125cyclictest20141-21kworker/u16:1+efi_rts_wq23:40:132
3791991250,124cyclictest20978-21kworker/u16:2+efi_rts_wq20:14:483
3790991220,122cyclictest384-21kworker/u16:3+efi_rts_wq23:25:272
3790991220,121cyclictest3838-21kworker/u16:1+efi_rts_wq22:45:132
3789991190,118cyclictest20978-21kworker/u16:2+efi_rts_wq21:40:141
3788991170,116cyclictest384-21kworker/u16:3+efi_rts_wq23:20:120
3790991050,104cyclictest20978-21kworker/u16:2+efi_rts_wq22:10:122
3791993229,2cyclictest795-21snmpd00:28:303
3790993230,2cyclictest795-21snmpd00:09:112
3789993229,2cyclictest795-21snmpd20:33:421
3789993229,2cyclictest795-21snmpd19:50:041
3789993229,2cyclictest795-21snmpd19:20:581
3788993230,2cyclictest795-21snmpd19:37:430
3791993128,2cyclictest795-21snmpd21:54:043
3790993129,2cyclictest795-21snmpd23:56:232
3789993129,2cyclictest795-21snmpd22:06:201
3789993129,2cyclictest795-21snmpd21:57:411
3789993129,2cyclictest795-21snmpd21:26:551
3789993129,2cyclictest795-21snmpd20:45:031
3789993129,2cyclictest795-21snmpd20:38:421
3788993129,2cyclictest795-21snmpd22:02:370
3788993128,2cyclictest795-21snmpd21:42:330
3788993128,2cyclictest795-21snmpd19:52:070
3791993029,1cyclictest795-21snmpd23:52:533
3791993029,1cyclictest795-21snmpd22:43:093
3791993029,1cyclictest795-21snmpd22:32:573
3791993029,1cyclictest795-21snmpd22:20:413
3791993029,1cyclictest795-21snmpd22:14:173
3791993029,1cyclictest795-21snmpd22:07:083
3790993029,1cyclictest795-21snmpd22:42:272
3790993029,1cyclictest795-21snmpd22:03:082
3790993028,2cyclictest795-21snmpd21:32:222
3790993028,2cyclictest795-21snmpd19:41:402
3790993027,3cyclictest795-21snmpd23:30:492
3789993029,1cyclictest795-21snmpd22:24:431
3789993029,1cyclictest795-21snmpd20:01:381
3789993029,1cyclictest795-21snmpd19:45:521
3789993029,1cyclictest795-21snmpd19:42:461
3789993029,1cyclictest795-21snmpd19:27:071
3789993029,1cyclictest795-21snmpd19:18:041
3789993029,1cyclictest795-21snmpd00:10:521
3789993029,1cyclictest795-21snmpd00:02:341
3789993028,2cyclictest795-21snmpd21:35:251
3788993028,2cyclictest795-21snmpd23:35:250
3788993028,2cyclictest795-21snmpd23:11:010
3788993028,2cyclictest795-21snmpd00:18:060
3788993027,2cyclictest9790-21cat21:55:160
3791992928,1cyclictest795-21snmpd23:27:433
3791992928,1cyclictest795-21snmpd23:15:553
3791992928,1cyclictest795-21snmpd20:30:073
3791992927,2cyclictest795-21snmpd21:38:583
3791992927,2cyclictest795-21snmpd20:40:293
3790992928,1cyclictest795-21snmpd20:24:522
3789992928,1cyclictest795-21snmpd23:36:581
3789992928,1cyclictest795-21snmpd23:01:111
3789992928,1cyclictest795-21snmpd21:46:251
3789992928,1cyclictest795-21snmpd21:10:091
3789992928,1cyclictest795-21snmpd00:33:471
3789992927,2cyclictest795-21snmpd00:39:121
3788992929,0cyclictest73950irq/132-enp1s023:08:280
3788992929,0cyclictest25339-21kworker/0:3+events22:34:510
3788992929,0cyclictest25235-21kworker/0:1+events22:38:030
3788992929,0cyclictest20979-21kworker/0:1+events22:10:390
3788992929,0cyclictest20979-21kworker/0:1+events20:03:230
3788992928,1cyclictest795-21snmpd23:15:520
3788992928,1cyclictest795-21snmpd19:47:280
3791992827,1cyclictest795-21snmpd22:15:143
3791992826,2cyclictest795-21snmpd21:12:563
3791992825,2cyclictest795-21snmpd20:46:003
3790992828,0cyclictest74050irq/133-enp1s000:00:052
3790992828,0cyclictest30335-21kworker/u16:0+atlantic23:49:312
3790992828,0cyclictest30335-21kworker/u16:0+atlantic23:03:592
3790992827,1cyclictest795-21snmpd22:18:442
3789992828,0cyclictest30335-21kworker/u16:0+atlantic23:31:421
3789992827,1cyclictest795-21snmpd19:36:131
3789992826,2cyclictest795-21snmpd21:05:001
3789992825,2cyclictest795-21snmpd22:15:111
3791992726,1cyclictest795-21snmpd23:40:103
3791992726,1cyclictest795-21snmpd21:40:013
3791992726,1cyclictest795-21snmpd20:38:183
3790992725,2cyclictest795-21snmpd22:59:362
3788992727,0cyclictest3514-21kworker/0:4+events00:05:510
3788992727,0cyclictest28919-21kworker/0:0+events23:50:250
3788992727,0cyclictest25235-21kworker/0:1+events22:40:570
3788992726,1cyclictest795-21snmpd20:55:540
3791992625,1cyclictest795-21snmpd20:28:053
3790992626,0cyclictest3838-21kworker/u16:1+atlantic21:20:112
3790992626,0cyclictest3838-21kworker/u16:1+atlantic21:20:112
3790992625,1cyclictest795-21snmpd19:11:202
3790992625,1cyclictest795-21snmpd00:32:352
3789992625,1cyclictest795-21snmpd20:24:381
3788992626,0cyclictest20979-21kworker/0:1+events21:35:070
3788992626,0cyclictest19983-21kworker/0:0+events22:28:270
3788992625,1cyclictest795-21snmpd19:55:470
3788992625,1cyclictest795-21snmpd19:30:370
3790992525,0cyclictest20978-21kworker/u16:2+atlantic20:46:452
3789992525,0cyclictest30335-21kworker/u16:0+atlantic23:43:041
3789992524,1cyclictest795-21snmpd23:11:151
3791992423,1cyclictest795-21snmpd23:07:303
3791992423,1cyclictest795-21snmpd21:24:223
3791992423,1cyclictest795-21snmpd21:24:223
3791992423,1cyclictest795-21snmpd20:59:303
3789992423,1cyclictest795-21snmpd22:53:111
3789992423,1cyclictest795-21snmpd20:40:031
3791992322,1cyclictest795-21snmpd22:53:093
3790992221,1cyclictest795-21snmpd20:15:352
3788992221,1cyclictest20979-21kworker/0:1+events21:08:400
3790992121,0cyclictest3838-21kworker/u16:1+atlantic21:25:512
3790992121,0cyclictest3838-21kworker/u16:1+atlantic21:00:592
3790992121,0cyclictest20978-21kworker/u16:2+atlantic20:55:592
3788992019,1cyclictest20979-21kworker/0:1+events19:43:290
3791991918,1cyclictest795-21snmpd00:21:123
3789991917,2cyclictest31840-21cat21:30:141
3791991816,2cyclictest795-21snmpd20:50:233
3789991816,2cyclictest795-21snmpd20:29:471
3789991714,2cyclictest795-21snmpd21:15:121
37899954,1cyclictest10046-21sed00:20:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional