You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-10 - 05:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sun May 10, 2026 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26276210998,6sleep30-21swapper/319:05:553
26659210885,18sleep00-21swapper/019:09:320
26510210897,6sleep10-21swapper/119:07:371
2218621060,0sleep00-21swapper/023:10:160
25595210379,16sleep20-21swapper/219:05:132
133582780,0sleep30-21swapper/319:55:173
318352720,4sleep02672199cyclictest00:32:520
54812640,0sleep00-21swapper/019:35:520
26723994527,16cyclictest0-21swapper/222:30:112
26721993415,17cyclictest0-21swapper/019:50:110
297122280,0sleep30-21swapper/322:42:083
250292260,1sleep110217-21diskmemload21:25:151
2672499221,19cyclictest0-21swapper/320:20:103
2672499210,19cyclictest0-21swapper/323:20:133
2672299201,18cyclictest0-21swapper/120:20:111
44842190,0sleep30-21swapper/323:26:013
277092190,0sleep20-21swapper/222:05:002
26723991916,2cyclictest14013-21kworker/u8:121:37:042
26724991811,5cyclictest27910-21sh21:29:043
26723991815,2cyclictest16118-21kworker/u8:120:22:042
2672399180,16cyclictest0-21swapper/220:35:112
289402170,0sleep00-21swapper/022:05:180
2672499171,3cyclictest0-21swapper/322:15:153
26723991714,2cyclictest23700-21kworker/u8:122:15:042
2672399170,12cyclictest0-21swapper/223:07:052
2672499163,8cyclictest5280-21chrt21:40:003
26724991613,2cyclictest18123-21kworker/u8:022:31:053
26724991613,2cyclictest14027-21kworker/u8:223:45:043
26724991612,2cyclictest14013-21kworker/u8:121:15:043
2672399162,2cyclictest0-21swapper/223:30:052
26723991613,2cyclictest9922-21kworker/u8:321:07:052
26723991613,2cyclictest6143-21kworker/u8:019:58:042
26723991613,2cyclictest5467-21kworker/u8:221:59:052
26723991613,2cyclictest29694-21kworker/u8:319:31:042
26723991613,2cyclictest28256-21kworker/u8:020:42:022
26723991613,2cyclictest23700-21kworker/u8:122:12:042
2672399160,2cyclictest0-21swapper/221:41:042
2672399160,13cyclictest27428-21head20:30:182
2672299160,14cyclictest0-21swapper/121:35:101
2672499151,2cyclictest0-21swapper/321:23:013
26724991512,2cyclictest28043-21kworker/u8:000:30:013
26724991512,2cyclictest19127-21kworker/u8:000:04:043
26724991512,2cyclictest1433-21kworker/u8:222:52:063
26724991512,2cyclictest1433-21kworker/u8:222:52:053
26724991510,3cyclictest30919-21uname23:55:183
2672499150,13cyclictest31528-21runrttasks22:45:053
26723991512,2cyclictest6402-21kworker/u8:023:12:012
26723991512,2cyclictest3323-21kworker/u8:020:57:052
26723991512,2cyclictest29694-21kworker/u8:319:42:042
26723991512,2cyclictest27351-21kworker/u8:123:52:012
26723991512,2cyclictest24048-21kworker/u8:221:04:042
26723991512,2cyclictest24048-21kworker/u8:220:49:042
26723991512,2cyclictest23226-21kworker/u8:200:32:042
26723991512,2cyclictest2205-21kworker/u8:123:35:042
26723991512,2cyclictest19127-21kworker/u8:000:02:042
26723991512,2cyclictest16118-21kworker/u8:120:09:052
26723991512,2cyclictest11850-21kworker/u8:122:42:042
2672399150,2cyclictest0-21swapper/200:05:042
2672399150,13cyclictest0-21swapper/222:54:562
2672399150,13cyclictest0-21swapper/222:54:562
2672399150,10cyclictest0-21swapper/200:15:042
2672199150,13cyclictest0-21swapper/021:45:200
2672199150,13cyclictest0-21swapper/021:14:000
26724991411,2cyclictest10217-21diskmemload23:30:203
26724991411,2cyclictest10217-21diskmemload22:22:513
26724991411,2cyclictest0-21swapper/323:04:303
26724991411,2cyclictest0-21swapper/323:04:303
26724991411,2cyclictest0-21swapper/322:00:103
26724991411,2cyclictest0-21swapper/320:00:103
2672499140,2cyclictest20831-21timerwakeupswit21:56:043
2672499140,12cyclictest26591-21sh23:50:313
2672499140,12cyclictest0-21swapper/323:15:163
2672499140,12cyclictest0-21swapper/300:05:113
26723991411,2cyclictest9922-21kworker/u8:321:11:042
26723991411,2cyclictest24546-21kworker/u8:223:24:052
26723991411,2cyclictest21265-21kworker/u8:119:11:052
26723991411,2cyclictest1900-21kworker/u8:100:37:042
26723991411,2cyclictest11850-21kworker/u8:122:59:042
26723991411,2cyclictest11850-21kworker/u8:122:59:042
26723991410,2cyclictest0-21swapper/200:25:192
2672399140,9cyclictest0-21swapper/200:20:052
2672399140,2cyclictest0-21swapper/223:28:362
2672399140,2cyclictest0-21swapper/222:21:022
2672399140,2cyclictest0-21swapper/220:50:052
2672399140,2cyclictest0-21swapper/220:10:162
2672399140,13cyclictest0-21swapper/222:39:262
2672399140,12cyclictest0-21swapper/223:18:042
2672399140,12cyclictest0-21swapper/221:52:432
2672299142,6cyclictest0-21swapper/123:40:001
2672299142,6cyclictest0-21swapper/120:40:001
2672299142,6cyclictest0-21swapper/100:35:011
2672299141,3cyclictest31569-21ssh00:32:181
2672299141,3cyclictest0-21swapper/122:55:421
2672299141,3cyclictest0-21swapper/122:55:411
2672299141,11cyclictest0-21swapper/121:55:141
2672299141,10cyclictest0-21swapper/121:00:001
2672299140,12cyclictest0-21swapper/100:01:411
2672199149,3cyclictest16407-21ssh21:15:490
2672199149,3cyclictest0-21swapper/023:05:010
2672199149,3cyclictest0-21swapper/023:05:000
26721991411,2cyclictest0-21swapper/023:22:100
26721991410,2cyclictest28589-21apt-get20:35:110
2672199140,12cyclictest0-21swapper/023:10:000
26724991310,2cyclictest14433-21ssh21:50:053
26724991310,2cyclictest0-21swapper/323:35:463
26724991310,2cyclictest0-21swapper/323:09:343
26724991310,2cyclictest0-21swapper/322:25:383
26724991310,2cyclictest0-21swapper/322:05:023
26724991310,2cyclictest0-21swapper/319:35:193
2672499130,2cyclictest9552-21mailstats21:06:023
2672499130,2cyclictest8833-21ssh21:43:343
2672499130,2cyclictest0-21swapper/321:48:233
2672499130,12cyclictest0-21swapper/322:57:103
2672499130,12cyclictest0-21swapper/322:57:103
2672499130,12cyclictest0-21swapper/322:13:503
2672499130,12cyclictest0-21swapper/321:30:023
2672499130,12cyclictest0-21swapper/321:14:223
2672499130,12cyclictest0-21swapper/319:50:183
2672499130,12cyclictest0-21swapper/300:37:503
2672499130,12cyclictest0-21swapper/300:26:203
2672499130,12cyclictest0-21swapper/300:15:123
2672499130,12cyclictest0-21swapper/300:11:403
26723991310,2cyclictest29694-21kworker/u8:319:25:042
26723991310,2cyclictest0-21swapper/223:55:152
26723991310,2cyclictest0-21swapper/221:16:022
26723991310,2cyclictest0-21swapper/200:13:072
2672399130,2cyclictest0-21swapper/223:00:072
2672399130,2cyclictest0-21swapper/223:00:062
2672399130,2cyclictest0-21swapper/221:46:172
2672399130,11cyclictest0-21swapper/223:47:292
2672299139,2cyclictest0-21swapper/123:20:311
2672299135,3cyclictest10567-21cut21:45:161
2672299132,6cyclictest0-21swapper/100:09:591
2672299131,10cyclictest0-21swapper/120:45:191
2672299131,10cyclictest0-21swapper/119:36:041
26722991310,2cyclictest0-21swapper/122:20:171
26722991310,2cyclictest0-21swapper/121:20:411
2672299130,2cyclictest0-21swapper/123:11:501
2672299130,2cyclictest0-21swapper/123:00:161
2672299130,2cyclictest0-21swapper/123:00:151
2672299130,2cyclictest0-21swapper/121:05:191
2672299130,11cyclictest0-21swapper/122:15:181
2672299130,11cyclictest0-21swapper/121:18:431
2672199134,3cyclictest274-21jbd2/sda1-800:40:000
2672199132,7cyclictest0-21swapper/019:42:580
2672199132,6cyclictest0-21swapper/022:45:000
2672199131,7cyclictest0-21swapper/022:05:000
2672199131,3cyclictest0-21swapper/020:15:000
26721991310,2cyclictest0-21swapper/020:16:010
2672199130,2cyclictest28807-21apt-get21:30:120
2672199130,2cyclictest0-21swapper/023:57:490
2672199130,2cyclictest0-21swapper/021:42:090
166922130,2sleep20-21swapper/223:40:122
2672499129,2cyclictest0-21swapper/321:01:023
2672499129,2cyclictest0-21swapper/319:20:303
2672499129,2cyclictest0-21swapper/300:20:063
2672499126,4cyclictest23065-21ssh22:35:123
2672499120,2cyclictest0-21swapper/323:40:153
2672499120,2cyclictest0-21swapper/319:30:153
2672499120,11cyclictest0-21swapper/323:10:413
2672499120,11cyclictest0-21swapper/320:26:053
2672399129,2cyclictest0-21swapper/222:05:212
2672399129,2cyclictest0-21swapper/221:25:142
2672399129,2cyclictest0-21swapper/221:21:582
2672399129,2cyclictest0-21swapper/220:25:122
2672399120,2cyclictest0-21swapper/222:25:042
2672399120,2cyclictest0-21swapper/219:35:142
2672399120,1cyclictest0-21swapper/220:15:162
2672399120,11cyclictest0-21swapper/221:30:282
2672399120,10cyclictest28931-21kworker/u8:022:46:052
2672299129,2cyclictest10217-21diskmemload23:05:131
2672299129,2cyclictest0-21swapper/123:47:281
2672299129,2cyclictest0-21swapper/121:33:301
2672299129,2cyclictest0-21swapper/120:10:141
2672299127,3cyclictest32534-21munin-node1
2672299127,3cyclictest16460-21apt23:40:091
2672299121,9cyclictest30669-21munin-node1
2672299121,9cyclictest2233-21munin-node1
2672299121,3cyclictest8450-21munin-node1
2672299121,3cyclictest8450-21munin-node1
2672299121,3cyclictest7471-21cut23:30:121
2672299121,3cyclictest25944-21grep23:50:131
2672299121,3cyclictest0-21swapper/121:00:131
2672299121,3cyclictest0-21swapper/119:26:031
2672299120,3cyclictest0-21swapper/122:36:031
2672299120,3cyclictest0-21swapper/121:50:101
2672299120,2cyclictest0-21swapper/122:45:421
2672299120,2cyclictest0-21swapper/120:26:021
2672299120,2cyclictest0-21swapper/120:00:161
2672299120,11cyclictest0-21swapper/123:27:551
2672299120,11cyclictest0-21swapper/122:30:121
2672299120,11cyclictest0-21swapper/122:26:021
2672299120,11cyclictest0-21swapper/121:10:131
2672299120,11cyclictest0-21swapper/120:15:191
2672299120,10cyclictest0-21swapper/120:00:011
2672199129,2cyclictest10217-21diskmemload21:25:590
2672199129,2cyclictest0-21swapper/023:52:490
2672199129,2cyclictest0-21swapper/000:11:030
2672199127,3cyclictest24945-21ssh23:49:440
2672199123,6cyclictest9756-21ssh22:56:030
2672199123,6cyclictest9756-21ssh22:56:020
2672199122,7cyclictest0-21swapper/020:47:020
2672199122,7cyclictest0-21swapper/020:09:580
2672199122,7cyclictest0-21swapper/019:47:580
2672199122,7cyclictest0-21swapper/019:47:580
2672199121,9cyclictest0-21swapper/019:35:000
2672199121,6cyclictest0-21swapper/022:40:010
2672199120,6cyclictest0-21swapper/000:09:590
2672199120,3cyclictest24021-21vmstat20:21:030
2672199120,2cyclictest0-21swapper/022:50:100
2672199120,2cyclictest0-21swapper/022:50:100
2672199120,11cyclictest0-21swapper/021:55:120
2672199120,11cyclictest0-21swapper/020:40:120
2672199120,10cyclictest0-21swapper/022:16:290
238702120,2sleep10-21swapper/100:24:131
198392120,1sleep00-21swapper/021:20:150
177492120,2sleep00-21swapper/023:40:380
284712110,1sleep00-21swapper/000:29:460
2672499118,2cyclictest29694-21kworker/u8:319:27:043
2672499118,2cyclictest28238-21kworker/u8:219:13:043
2672499118,2cyclictest24048-21kworker/u8:220:39:043
2672499118,2cyclictest16118-21kworker/u8:120:06:053
2672499118,2cyclictest0-21swapper/320:55:153
2672499118,2cyclictest0-21swapper/320:50:013
2672499110,1cyclictest0-21swapper/319:19:243
2672499110,10cyclictest0-21swapper/320:40:193
2672399118,2cyclictest6143-21kworker/u8:019:46:052
2672399118,2cyclictest6143-21kworker/u8:019:46:042
2672299118,2cyclictest0-21swapper/121:41:021
2672299117,2cyclictest207150irq/24-eth123:55:131
2672299116,3cyclictest28641-21apt19:15:111
2672299116,3cyclictest16208-21fschecks_time00:15:141
2672299116,3cyclictest0-21swapper/122:07:001
2672299111,8cyclictest6438-21munin-node1
2672299111,3cyclictest27256-21aten2.4_r3power22:40:101
2672299111,3cyclictest0-21swapper/122:50:131
2672299111,3cyclictest0-21swapper/122:50:131
2672299111,3cyclictest0-21swapper/119:10:181
2672299110,9cyclictest26013-21dpkg23:15:111
2672299110,9cyclictest25278-21gltestperf00:25:161
2672299110,9cyclictest2206-21munin-node1
2672299110,9cyclictest0-21swapper/120:05:121
2672299110,9cyclictest0-21swapper/119:50:141
2672299110,3cyclictest26568-21munin-node1
2672299110,3cyclictest0-21swapper/122:00:211
2672199118,2cyclictest10217-21diskmemload00:15:000
2672199118,2cyclictest0-21swapper/000:02:490
2672199111,6cyclictest0-21swapper/022:11:030
2672199110,9cyclictest0-21swapper/023:32:530
2672199110,9cyclictest0-21swapper/022:21:090
2672199110,9cyclictest0-21swapper/021:35:360
2672499105,3cyclictest7798-21timerwakeupswit19:41:023
2672499105,3cyclictest19073-21perl20:10:133
2672399107,2cyclictest0-21swapper/219:54:582
2672299105,3cyclictest29155-21grep20:35:141
2672299100,8cyclictest0-21swapper/100:10:141
2672199107,2cyclictest0-21swapper/023:16:440
2672199105,3cyclictest21804-21ls00:21:040
2672199102,6cyclictest0-21swapper/019:25:000
2672199102,5cyclictest0-21swapper/020:04:580
2672199100,9cyclictest0-21swapper/023:26:370
2672199100,6cyclictest0-21swapper/022:31:270
267249994,3cyclictest8576-21head19:45:133
267249994,3cyclictest8576-21head19:45:123
267249994,3cyclictest3728-21runrttasks20:45:033
267249994,3cyclictest27641-21pzem_voltage20:31:013
267249994,3cyclictest20766-21tr20:15:143
267239994,3cyclictest15913-21grep20:01:012
267239994,3cyclictest0-21swapper/219:15:152
267219996,2cyclictest0-21swapper/021:50:110
267219996,2cyclictest0-21swapper/021:00:130
267219994,3cyclictest28078-21sh22:40:160
267219994,3cyclictest26989-21fschecks_count20:30:140
267219994,3cyclictest2206-21munin-node0
267219994,3cyclictest17322sleep019:26:290
267219994,3cyclictest15861-21ssh22:26:270
267219994,3cyclictest12867-21sh23:35:180
267219994,3cyclictest12601-21aten2.4_r3power19:55:130
267219993,4cyclictest25657-21fgrep20:26:000
267219990,8cyclictest0-21swapper/019:10:160
267219990,6cyclictest0-21swapper/019:15:470
267239983,3cyclictest31080-21awk19:20:142
267219983,3cyclictest5300-21open_files20:55:200
267219983,3cyclictest0-21swapper/021:06:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional