You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-24 - 15:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Tue Mar 24, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
90802116105,6sleep00-21swapper/007:08:070
9087211594,16sleep20-21swapper/207:08:132
9004211396,12sleep10-21swapper/107:07:081
90282111100,6sleep30-21swapper/307:07:263
53802790,0sleep20-21swapper/210:29:442
11442730,5sleep2925699cyclictest09:51:012
192562660,1sleep00-21swapper/007:34:030
112992320,0sleep30-21swapper/312:15:593
925799220,21cyclictest0-21swapper/311:45:013
294992220,0sleep30-21swapper/309:13:423
224542200,1sleep20-21swapper/210:46:242
9256991916,2cyclictest6059-21kworker/u8:110:31:042
9256991916,2cyclictest2775-21kworker/u8:012:18:052
322262190,0sleep20-21swapper/212:05:002
9256991815,2cyclictest2992-21kworker/u8:209:22:042
9256991815,2cyclictest25200-21kworker/u8:209:44:012
9256991815,2cyclictest25200-21kworker/u8:209:44:012
925599171,14cyclictest207150irq/24-eth107:15:111
9254991714,2cyclictest13542-21kworker/u8:211:15:040
9256991613,2cyclictest8051-21kworker/u8:011:52:042
925599161,13cyclictest25931-21munin-node1
925599161,13cyclictest0-21swapper/112:35:111
925599161,13cyclictest0-21swapper/107:55:141
115142160,0sleep20-21swapper/211:09:442
925799151,12cyclictest16851-21ssh10:07:123
925799150,13cyclictest0-21swapper/312:14:583
925699152,9cyclictest0-21swapper/209:56:012
925699151,3cyclictest21368-21ssh10:11:452
9256991512,2cyclictest868-21kworker/u8:208:20:052
9256991512,2cyclictest29424-21kworker/u8:009:37:042
9256991512,2cyclictest17277-21kworker/u8:109:46:042
9256991512,2cyclictest17141-21kworker/u8:312:26:052
925699151,12cyclictest0-21swapper/211:30:002
925699150,2cyclictest0-21swapper/210:55:042
925599151,2cyclictest15696-21apt-get08:45:111
925599150,3cyclictest0-21swapper/110:15:181
925599150,13cyclictest25538-21diskmemload10:52:381
925599150,13cyclictest22475-21tail07:40:161
9254991512,2cyclictest0-21swapper/012:37:260
13222151,3sleep01557-21users09:51:030
925799141,2cyclictest735-21iostat12:05:153
9257991411,2cyclictest0-21swapper/311:51:183
9257991411,2cyclictest0-21swapper/310:17:503
9257991411,2cyclictest0-21swapper/310:04:493
9257991411,2cyclictest0-21swapper/309:25:483
9257991410,2cyclictest0-21swapper/308:35:193
925799140,3cyclictest31140-21sh12:03:233
925799140,2cyclictest0-21swapper/310:50:383
925799140,2cyclictest0-21swapper/310:21:183
925799140,13cyclictest0-21swapper/312:35:083
925799140,13cyclictest0-21swapper/312:20:383
925799140,13cyclictest0-21swapper/310:47:583
925799140,13cyclictest0-21swapper/310:25:183
925799140,13cyclictest0-21swapper/309:35:183
925799140,12cyclictest22885-21ssh12:28:293
925799140,12cyclictest13491-21modprobe09:30:153
925799140,12cyclictest0-21swapper/311:14:063
925799140,12cyclictest0-21swapper/311:06:043
925799140,12cyclictest0-21swapper/310:31:103
925799140,12cyclictest0-21swapper/309:57:083
9256991411,2cyclictest28782sleep211:34:352
9256991411,2cyclictest23434-21kworker/u8:209:13:042
9256991411,2cyclictest17277-21kworker/u8:110:08:052
9256991411,2cyclictest17277-21kworker/u8:110:01:042
9256991411,2cyclictest13660-21kworker/u8:010:41:042
925699140,12cyclictest0-21swapper/212:20:132
925599142,7cyclictest0-21swapper/107:35:011
925599141,2cyclictest2231-21apt-get11:00:121
9255991410,2cyclictest0-21swapper/111:41:481
925599140,3cyclictest0-21swapper/107:30:161
925599140,13cyclictest0-21swapper/112:00:181
925599140,13cyclictest0-21swapper/111:45:001
925599140,13cyclictest0-21swapper/109:21:371
925599140,12cyclictest29896-21ssh09:47:051
9254991411,2cyclictest17277-21kworker/u8:109:56:010
9254991411,2cyclictest0-21swapper/012:08:060
9254991411,2cyclictest0-21swapper/009:22:570
925499140,2cyclictest0-21swapper/010:47:060
925499140,2cyclictest0-21swapper/009:32:360
925499140,13cyclictest0-21swapper/012:25:160
135352140,2sleep013545-21ssh12:18:540
95502130,2sleep10-21swapper/111:06:401
93492130,2sleep20-21swapper/211:40:162
925799139,2cyclictest27642-21ssh11:25:353
925799132,7cyclictest0-21swapper/307:37:583
9257991310,2cyclictest28708-21ssh09:45:513
9257991310,2cyclictest25538-21diskmemload10:35:023
9257991310,2cyclictest0-21swapper/311:16:143
9257991310,2cyclictest0-21swapper/310:55:013
9257991310,2cyclictest0-21swapper/310:40:293
9257991310,2cyclictest0-21swapper/310:13:033
9257991310,2cyclictest0-21swapper/309:52:373
925799130,2cyclictest2226-21munin-node3
925799130,2cyclictest18121-21hddtemp_smartct07:30:143
925799130,2cyclictest0-21swapper/312:32:343
925799130,2cyclictest0-21swapper/309:41:193
925799130,2cyclictest0-21swapper/309:41:193
925799130,2cyclictest0-21swapper/309:20:153
925799130,2cyclictest0-21swapper/308:45:123
925799130,12cyclictest0-21swapper/311:59:383
925799130,12cyclictest0-21swapper/311:35:463
925799130,12cyclictest0-21swapper/311:21:033
925799130,12cyclictest0-21swapper/309:16:533
925799130,12cyclictest0-21swapper/307:11:023
925799130,11cyclictest0-21swapper/311:30:413
925699139,3cyclictest5261-21ssh11:02:282
925699131,3cyclictest11475-21munin-node2
9256991310,2cyclictest7186-21kworker/u8:107:22:012
925699130,2cyclictest0-21swapper/211:55:132
925699130,2cyclictest0-21swapper/211:36:042
925699130,2cyclictest0-21swapper/211:20:042
925699130,12cyclictest0-21swapper/210:50:372
925699130,11cyclictest0-21swapper/212:36:412
925699130,11cyclictest0-21swapper/210:21:052
925599138,3cyclictest2140-21taskset12:06:171
925599138,3cyclictest0-21swapper/110:47:411
925599131,9cyclictest0-21swapper/108:10:131
9255991311,1cyclictest0-21swapper/111:37:181
925599131,10cyclictest0-21swapper/108:41:011
925599131,10cyclictest0-21swapper/107:45:151
9255991310,2cyclictest25538-21diskmemload11:33:121
9255991310,2cyclictest207150irq/24-eth110:40:071
9255991310,2cyclictest207150irq/24-eth109:27:201
9255991310,2cyclictest0-21swapper/110:25:511
9255991310,2cyclictest0-21swapper/109:40:031
9255991310,2cyclictest0-21swapper/109:40:031
9255991310,2cyclictest0-21swapper/108:30:481
925599130,2cyclictest25538-21diskmemload11:19:221
925599130,1cyclictest0-21swapper/111:28:481
925599130,12cyclictest0-21swapper/112:20:081
925599130,12cyclictest0-21swapper/111:10:001
925599130,12cyclictest0-21swapper/110:58:271
925599130,12cyclictest0-21swapper/110:36:271
925599130,12cyclictest0-21swapper/110:03:371
925599130,12cyclictest0-21swapper/109:52:171
925599130,12cyclictest0-21swapper/109:30:151
925599130,11cyclictest0-21swapper/110:21:211
925499131,2cyclictest0-21swapper/012:14:250
9254991310,2cyclictest3152-21nscd11:03:220
9254991310,2cyclictest20380-21kworker/u8:210:55:040
9254991310,2cyclictest0-21swapper/011:46:120
9254991310,2cyclictest0-21swapper/011:23:140
9254991310,2cyclictest0-21swapper/010:38:380
9254991310,2cyclictest0-21swapper/010:27:140
9254991310,2cyclictest0-21swapper/010:20:140
9254991310,2cyclictest0-21swapper/009:25:130
9254991310,2cyclictest0-21swapper/009:16:090
9254991310,2cyclictest0-21swapper/007:20:120
925499130,2cyclictest9014-21latency_hist10:00:010
925499130,2cyclictest31330-21sendmail08:01:250
925499130,2cyclictest1389-21apt-get08:10:120
925499130,2cyclictest0-21swapper/011:44:360
925499130,2cyclictest0-21swapper/011:38:250
925499130,2cyclictest0-21swapper/009:40:070
925499130,2cyclictest0-21swapper/009:40:060
925499130,2cyclictest0-21swapper/007:50:150
925499130,12cyclictest0-21swapper/011:11:260
925499130,12cyclictest0-21swapper/010:51:560
925499130,12cyclictest0-21swapper/010:09:270
925499130,12cyclictest0-21swapper/008:26:040
925499130,12cyclictest0-21swapper/007:15:260
925499130,11cyclictest21741-21ssh11:53:460
48872131,2sleep23649-21snmpd12:10:022
41252130,2sleep10-21swapper/108:15:191
305772130,2sleep10-21swapper/109:15:051
221452130,2sleep00-21swapper/010:13:000
195842130,2sleep00-21swapper/010:44:260
925799129,2cyclictest0-21swapper/311:40:033
925799129,2cyclictest0-21swapper/307:20:163
925799129,2cyclictest0-21swapper/307:15:133
925799128,2cyclictest16189-21iostat_ios07:25:163
925799122,7cyclictest0-21swapper/308:09:583
925799122,7cyclictest0-21swapper/307:43:583
925799120,11cyclictest0-21swapper/308:25:193
925799120,11cyclictest0-21swapper/308:10:193
925699129,2cyclictest868-21kworker/u8:208:10:042
925699129,2cyclictest8051-21kworker/u8:011:45:042
925699129,2cyclictest7186-21kworker/u8:107:28:022
925699129,2cyclictest3427-21kworker/u8:108:27:042
925699129,2cyclictest19756-21kworker/u8:207:53:052
925699129,2cyclictest17831-21kworker/u8:208:54:012
925699129,2cyclictest17229-21kworker/u8:007:42:042
925699129,2cyclictest0-21swapper/212:08:332
925699129,2cyclictest0-21swapper/211:15:242
925699129,2cyclictest0-21swapper/210:36:072
925699127,3cyclictest31334-21ethtool09:15:162
925699120,2cyclictest0-21swapper/212:30:582
925699120,11cyclictest0-21swapper/210:16:412
925599129,2cyclictest0-21swapper/112:25:271
925599129,2cyclictest0-21swapper/111:50:191
925599129,2cyclictest0-21swapper/110:14:171
925599127,3cyclictest9787-21ssh12:15:111
925599127,3cyclictest9466-21munin-node1
925599127,3cyclictest24272-21cut11:55:491
925599121,9cyclictest8076-21grep08:25:151
925599121,9cyclictest5369-21apt-get08:20:051
925599121,9cyclictest15513-21munin-node1
925599121,9cyclictest0-21swapper/109:55:171
925599121,9cyclictest0-21swapper/108:50:121
925599121,9cyclictest0-21swapper/108:35:131
925599121,3cyclictest22104-21apt09:40:001
925599120,2cyclictest0-21swapper/111:24:221
925599120,11cyclictest0-21swapper/112:31:321
925599120,11cyclictest0-21swapper/112:10:431
925599120,11cyclictest0-21swapper/110:31:311
925599120,10cyclictest25538-21diskmemload10:05:051
925499129,2cyclictest25538-21diskmemload09:35:160
925499129,2cyclictest0-21swapper/011:55:130
925499129,2cyclictest0-21swapper/011:31:460
925499129,2cyclictest0-21swapper/011:06:530
925499129,2cyclictest0-21swapper/010:19:210
925499129,2cyclictest0-21swapper/008:56:050
925499129,2cyclictest0-21swapper/008:20:060
925499120,2cyclictest0-21swapper/012:01:080
925499120,11cyclictest15700-21ssh12:20:220
925499120,11cyclictest0-21swapper/012:33:240
925499120,11cyclictest0-21swapper/011:28:050
925499120,11cyclictest0-21swapper/009:10:090
925499120,11cyclictest0-21swapper/008:51:030
925499120,11cyclictest0-21swapper/007:45:500
925499120,11cyclictest0-21swapper/007:35:160
925499120,11cyclictest0-21swapper/007:10:110
925499120,10cyclictest7123-21ssh10:30:350
925799112,6cyclictest0-21swapper/308:50:013
925699118,2cyclictest3427-21kworker/u8:109:06:062
925699118,2cyclictest3427-21kworker/u8:109:02:042
925699118,2cyclictest3427-21kworker/u8:108:15:052
925699110,2cyclictest0-21swapper/211:10:072
925599111,8cyclictest0-21swapper/107:20:121
925599111,3cyclictest0-21swapper/108:00:191
925599110,9cyclictest0-21swapper/108:55:121
925599110,2cyclictest0-21swapper/109:05:251
925499118,2cyclictest0-21swapper/009:48:440
925499118,2cyclictest0-21swapper/008:18:250
925799107,2cyclictest0-21swapper/308:59:203
925799107,2cyclictest0-21swapper/308:20:293
925799102,7cyclictest0-21swapper/307:53:583
925799100,7cyclictest10754-21awk08:30:583
925799100,7cyclictest0-21swapper/309:08:583
925799100,7cyclictest0-21swapper/308:17:583
925699107,2cyclictest3427-21kworker/u8:108:49:042
925699107,2cyclictest3427-21kworker/u8:108:35:042
925699107,2cyclictest19756-21kworker/u8:207:38:042
925699105,3cyclictest25060-21grep07:46:032
925699104,4cyclictest19773-21tail08:55:122
925699104,4cyclictest12898-21cut09:30:132
925699100,2cyclictest0-21swapper/208:00:122
925599100,8cyclictest25639-21apt-get07:50:111
925599100,8cyclictest0-21swapper/109:00:141
92579996,2cyclictest0-21swapper/309:01:483
92579994,3cyclictest29801-21telnet08:00:133
92579994,3cyclictest14526-21needreboot08:40:173
92579993,3cyclictest27680-21telnet07:55:133
92579990,2cyclictest0-21swapper/307:45:023
92569996,2cyclictest7186-21kworker/u8:107:30:012
92569994,3cyclictest29009-21unixbench_multi07:56:032
92569994,3cyclictest0-21swapper/209:25:062
92559994,3cyclictest31823-21chrt08:05:001
92549996,2cyclictest0-21swapper/007:56:050
92549994,3cyclictest9776-21head08:30:110
92549991,6cyclictest11650-21kworker/0:109:05:140
17290290,1sleep00-21swapper/007:29:550
11148290,1sleep20-21swapper/208:31:192
92569984,2cyclictest0-21swapper/208:40:142
92569983,3cyclictest31930-21aten2.4-expect08:05:122
92569983,3cyclictest10433-21processes07:10:182
92549984,3cyclictest14580-21ntpq08:40:170
92549983,3cyclictest22130-21fschecks_time07:40:140
92549983,3cyclictest15825-21aten2.4_r3power08:45:120
92549980,7cyclictest0-21swapper/009:02:060
92549970,6cyclictest0-21swapper/008:35:300
92549970,6cyclictest0-21swapper/008:05:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional