You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-21 - 04:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sat Mar 21, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29773211797,15sleep00-21swapper/019:08:440
243021170,1sleep02428-21ssh23:45:260
29729211693,18sleep10-21swapper/119:08:081
29741211497,12sleep30-21swapper/319:08:183
29715211193,12sleep20-21swapper/219:07:572
47592810,1sleep0101ktimersoftd/023:15:010
146862800,1sleep0101ktimersoftd/022:50:510
322892750,1sleep00-21swapper/022:01:450
273972680,0sleep00-21swapper/021:56:400
157602530,1sleep115759-21ssh00:33:331
29903993817,19cyclictest0-21swapper/222:05:122
29903993617,18cyclictest0-21swapper/200:05:112
214912250,5sleep12990299cyclictest22:58:221
42892230,1sleep30-21swapper/300:21:013
2990299221,19cyclictest0-21swapper/122:10:111
29901992211,9cyclictest0-21swapper/022:05:110
2990199220,1cyclictest0-21swapper/019:10:090
2990299210,2cyclictest0-21swapper/119:25:121
249492210,1sleep10-21swapper/123:01:141
2990499201,16cyclictest7195-21ssh22:10:113
2990199201,2cyclictest0-21swapper/020:35:120
2990199200,2cyclictest0-21swapper/023:50:110
2990399192,15cyclictest0-21swapper/200:17:582
297912190,1sleep20-21swapper/200:14:592
2990399180,17cyclictest0-21swapper/200:24:012
2990199171,14cyclictest0-21swapper/023:15:210
29904991611,3cyclictest0-21swapper/300:00:153
2990299161,13cyclictest0-21swapper/123:59:401
2990299160,14cyclictest31495-21kworker/u8:021:41:041
29901991611,3cyclictest29899-21turbostat20:30:000
29901991611,3cyclictest0-21swapper/021:05:120
2990499151,12cyclictest2088-21ssh00:19:553
29904991510,3cyclictest0-21swapper/321:45:593
2990499150,13cyclictest0-21swapper/322:45:123
2990399154,9cyclictest13752-21diskmemload22:26:392
2990299152,8cyclictest17788-21copy22:55:001
2990299152,7cyclictest0-21swapper/122:25:011
2990299151,5cyclictest6837-21grep23:16:031
2990299151,3cyclictest16372-21hddtemp_smartct00:00:141
2990299151,3cyclictest0-21swapper/100:36:271
2990199151,3cyclictest32431-21df19:15:130
2990199151,12cyclictest30510-21ssh21:26:110
2990199151,12cyclictest16063-21ssh00:34:020
29901991510,3cyclictest23878-21ssh22:26:350
2990199150,13cyclictest0-21swapper/023:55:190
2990199150,13cyclictest0-21swapper/022:56:210
2990499141,2cyclictest9924-21apt-get19:40:103
2990499140,3cyclictest27646-21ssh21:24:133
2990499140,3cyclictest21836-21date20:10:003
2990499140,2cyclictest0-21swapper/323:16:153
2990499140,2cyclictest0-21swapper/319:25:113
2990499140,12cyclictest0-21swapper/323:01:243
2990499140,12cyclictest0-21swapper/322:22:323
2990499140,12cyclictest0-21swapper/321:26:423
2990499140,12cyclictest0-21swapper/300:35:153
2990499140,12cyclictest0-21swapper/300:33:343
2990399143,10cyclictest17456-1kworker/u9:123:29:302
2990399142,11cyclictest0-21swapper/200:25:012
29903991411,2cyclictest0-21swapper/223:20:112
29903991411,2cyclictest0-21swapper/222:57:402
2990399141,11cyclictest17382-21sh00:01:012
2990399140,2cyclictest0-21swapper/222:38:292
2990399140,2cyclictest0-21swapper/221:15:182
2990399140,13cyclictest0-21swapper/219:55:292
2990399140,12cyclictest19967-21sed21:50:002
2990399140,12cyclictest0-21swapper/221:30:152
2990399140,12cyclictest0-21swapper/221:20:122
2990299141,7cyclictest0-21swapper/120:05:001
2990299141,11cyclictest5467-21apt-get21:35:061
2990199141,2cyclictest3728-21runrttasks21:44:250
29901991411,2cyclictest25594-21ssh23:35:520
29901991410,2cyclictest0-21swapper/021:10:170
2990199140,3cyclictest19794-21sed20:05:000
2990199140,2cyclictest0-21swapper/000:01:020
2990199140,13cyclictest0-21swapper/021:18:310
2990199140,12cyclictest13752-21diskmemload23:21:140
2990199140,12cyclictest0-21swapper/022:43:570
2990199140,12cyclictest0-21swapper/021:30:390
2990199140,12cyclictest0-21swapper/019:25:110
82682130,2sleep30-21swapper/321:36:513
45012130,2sleep00-21swapper/020:45:150
29904991310,2cyclictest0-21swapper/323:56:263
29904991310,2cyclictest0-21swapper/323:34:553
29904991310,2cyclictest0-21swapper/323:05:453
29904991310,2cyclictest0-21swapper/322:37:553
29904991310,2cyclictest0-21swapper/322:25:123
29904991310,2cyclictest0-21swapper/322:05:543
29904991310,2cyclictest0-21swapper/321:54:223
29904991310,2cyclictest0-21swapper/321:33:333
29904991310,2cyclictest0-21swapper/321:11:143
29904991310,2cyclictest0-21swapper/320:56:033
29904991310,2cyclictest0-21swapper/320:36:013
29904991310,2cyclictest0-21swapper/300:25:443
29904991310,2cyclictest0-21swapper/300:06:343
2990499130,2cyclictest5104-21ssh23:48:433
2990499130,2cyclictest0-21swapper/323:50:243
2990499130,2cyclictest0-21swapper/323:37:033
2990499130,2cyclictest0-21swapper/323:25:033
2990499130,11cyclictest28371-21ssh00:12:433
2990399139,2cyclictest23435-21grep20:11:022
2990399138,3cyclictest0-21swapper/200:35:142
29903991310,2cyclictest0-21swapper/223:40:302
29903991310,2cyclictest0-21swapper/222:46:502
29903991310,2cyclictest0-21swapper/222:02:292
29903991310,2cyclictest0-21swapper/221:35:092
29903991310,2cyclictest0-21swapper/219:11:002
2990399130,2cyclictest2838-21awk20:41:022
2990299138,3cyclictest8592-21iostat20:55:151
2990299131,6cyclictest0-21swapper/123:06:201
2990299131,2cyclictest18562-21taskset23:29:131
29902991310,2cyclictest0-21swapper/123:44:551
2990299130,2cyclictest0-21swapper/123:36:021
2990299130,2cyclictest0-21swapper/100:28:301
2990299130,12cyclictest0-21swapper/123:45:131
2990299130,11cyclictest22542-21grep20:10:131
2990299130,11cyclictest13752-21diskmemload23:53:411
2990299130,11cyclictest13752-21diskmemload00:21:571
2990299130,11cyclictest0-21swapper/100:11:391
2990299130,11cyclictest0-21swapper/100:08:181
2990199132,6cyclictest0-21swapper/021:00:010
2990199132,6cyclictest0-21swapper/020:05:010
2990199131,6cyclictest0-21swapper/019:20:000
29901991310,2cyclictest0-21swapper/023:30:090
29901991310,2cyclictest0-21swapper/023:00:410
29901991310,2cyclictest0-21swapper/022:47:480
29901991310,2cyclictest0-21swapper/022:20:370
29901991310,2cyclictest0-21swapper/021:52:370
29901991310,2cyclictest0-21swapper/021:45:580
29901991310,2cyclictest0-21swapper/021:21:520
29901991310,2cyclictest0-21swapper/019:55:140
29901991310,2cyclictest0-21swapper/000:35:340
29901991310,2cyclictest0-21swapper/000:25:160
29901991310,2cyclictest0-21swapper/000:21:210
29901991310,2cyclictest0-21swapper/000:07:010
2990199130,2cyclictest0-21swapper/022:37:170
2990199130,2cyclictest0-21swapper/000:17:110
2990199130,12cyclictest0-21swapper/022:30:210
2990199130,12cyclictest0-21swapper/021:36:290
2990199130,12cyclictest0-21swapper/019:51:010
2990199130,12cyclictest0-21swapper/019:30:100
2990199130,11cyclictest31080-21kworker/u8:323:07:040
282942130,2sleep00-21swapper/000:12:370
46012120,2sleep10-21swapper/121:33:421
327232120,2sleep20-21swapper/221:29:412
2990499129,2cyclictest0-21swapper/322:31:353
2990499129,2cyclictest0-21swapper/322:01:033
2990499127,3cyclictest12522-21perl22:15:133
2990499120,2cyclictest0-21swapper/323:20:433
2990499120,2cyclictest0-21swapper/322:50:183
2990499120,2cyclictest0-21swapper/321:16:533
2990499120,11cyclictest0-21swapper/323:44:153
2990499120,11cyclictest0-21swapper/323:11:553
2990499120,11cyclictest0-21swapper/322:55:233
2990499120,11cyclictest0-21swapper/322:40:533
2990499120,11cyclictest0-21swapper/321:55:553
2990499120,11cyclictest0-21swapper/321:40:253
2990399129,2cyclictest0-21swapper/223:19:502
2990399129,2cyclictest0-21swapper/220:50:142
2990399127,3cyclictest32473-21tail23:10:092
2990399122,7cyclictest0-21swapper/219:52:592
2990399121,2cyclictest20240-21ssh21:50:102
2990399120,2cyclictest0-21swapper/200:30:182
2990399120,11cyclictest0-21swapper/223:05:122
2990399120,11cyclictest0-21swapper/222:21:502
2990399120,11cyclictest0-21swapper/219:41:022
2990299129,2cyclictest19390-21apt-get23:30:111
2990299129,2cyclictest0-21swapper/122:47:521
2990299129,2cyclictest0-21swapper/120:30:191
2990299129,2cyclictest0-21swapper/100:15:491
2990299127,3cyclictest0-21swapper/119:50:181
2990299121,9cyclictest26498-21head22:30:121
2990299121,9cyclictest0-21swapper/121:50:071
2990299121,9cyclictest0-21swapper/121:10:111
2990299121,9cyclictest0-21swapper/120:20:161
2990299121,9cyclictest0-21swapper/119:30:161
2990299121,3cyclictest9950-21munin-node1
2990299121,3cyclictest9853-21aten2.4_r3power23:20:121
2990299121,3cyclictest25043-21munin-node1
2990299120,3cyclictest0-21swapper/119:20:591
2990299120,2cyclictest0-21swapper/122:42:221
2990299120,2cyclictest0-21swapper/119:45:181
2990299120,11cyclictest0-21swapper/123:11:211
2990299120,11cyclictest0-21swapper/121:05:401
2990199129,2cyclictest0-21swapper/020:20:150
2990199120,2cyclictest0-21swapper/023:25:580
2990199120,2cyclictest0-21swapper/022:11:070
2990199120,11cyclictest0-21swapper/023:42:400
2990199120,11cyclictest0-21swapper/022:16:170
2990199120,11cyclictest0-21swapper/020:10:120
2990199120,11cyclictest0-21swapper/019:45:130
264052120,2sleep20-21swapper/223:03:322
2990499118,2cyclictest0-21swapper/320:25:033
2990499116,3cyclictest27490-21grep20:21:033
2990499112,5cyclictest0-21swapper/319:10:593
2990499111,5cyclictest0-21swapper/321:05:003
2990399118,2cyclictest0-21swapper/219:30:492
2990399118,2cyclictest0-21swapper/219:25:162
2990399112,7cyclictest0-21swapper/222:13:582
2990399112,5cyclictest0-21swapper/220:31:002
2990399111,7cyclictest4562-21gdm-simple-gree20:21:582
2990399111,6cyclictest0-21swapper/219:20:592
2990399110,8cyclictest11113-21python21:01:012
2990399110,2cyclictest0-21swapper/221:42:382
2990299116,3cyclictest0-21swapper/122:01:021
2990299116,3cyclictest0-21swapper/120:50:151
2990299111,8cyclictest28872-21df_inode21:25:121
2990299111,8cyclictest0-21swapper/121:15:171
2990299111,3cyclictest17024-21python21:45:591
2990299111,3cyclictest0-21swapper/120:25:161
2990299110,9cyclictest32124-21munin-node1
2990299110,9cyclictest24788-21cat20:15:171
2990299110,9cyclictest2044-21df_abs20:40:151
2990299110,9cyclictest0-21swapper/120:45:121
2990299110,9cyclictest0-21swapper/119:55:121
2990299110,3cyclictest7895-21munin-node1
2990299110,3cyclictest0-21swapper/122:35:171
2990299110,3cyclictest0-21swapper/122:06:021
2990199111,7cyclictest0-21swapper/019:43:020
2990199110,10cyclictest0-21swapper/020:16:450
265582110,2sleep20-21swapper/221:55:582
132392110,8sleep113251-21sh22:15:371
2990499101,5cyclictest0-21swapper/319:55:013
2990499100,7cyclictest0-21swapper/320:11:003
2990499100,2cyclictest0-21swapper/320:40:113
2990399107,2cyclictest0-21swapper/223:50:102
2990399107,2cyclictest0-21swapper/222:50:092
2990399105,3cyclictest19632-21cpuspeed_turbos23:30:132
2990399103,6cyclictest0-21swapper/222:17:042
2990399102,7cyclictest0-21swapper/220:26:582
2990399102,6cyclictest0-21swapper/223:46:162
2990399102,6cyclictest0-21swapper/222:32:592
2990399100,9cyclictest17891-21ssh21:13:582
2990399100,7cyclictest3688-21Xorg20:49:582
2990399100,7cyclictest0-21swapper/223:56:582
2990399100,7cyclictest0-21swapper/220:39:582
2990399100,7cyclictest0-21swapper/220:01:582
2990399100,7cyclictest0-21swapper/219:46:582
2990399100,7cyclictest0-21swapper/219:17:012
2990299105,3cyclictest32122-21munin-node1
2990299101,2cyclictest23669-21apt-get21:20:111
2990299100,8cyclictest0-21swapper/119:40:191
2990299100,2cyclictest0-21swapper/120:05:131
2990199107,2cyclictest0-21swapper/020:40:460
2990199105,3cyclictest10344-21sh21:00:140
2990199103,2cyclictest0-21swapper/020:50:040
2990199102,5cyclictest0-21swapper/019:36:000
2990199101,6cyclictest0-21swapper/020:30:520
299049996,2cyclictest0-21swapper/319:35:133
299049994,3cyclictest274-21jbd2/sda1-819:45:213
299049994,3cyclictest16684-21latency19:55:163
299049994,3cyclictest0-21swapper/320:45:113
299049994,3cyclictest0-21swapper/320:01:043
299049993,4cyclictest6858-21ps20:50:183
299049992,5cyclictest0-21swapper/321:05:583
299049990,7cyclictest0-21swapper/320:32:463
299049990,2cyclictest0-21swapper/319:30:153
299039994,3cyclictest3455-21ssh22:40:042
299039991,5cyclictest0-21swapper/221:05:092
299039990,5cyclictest0-21swapper/219:40:002
299039990,2cyclictest0-21swapper/223:37:232
299039990,2cyclictest0-21swapper/220:16:032
299029996,2cyclictest0-21swapper/119:10:111
299029990,8cyclictest0-21swapper/122:20:121
299049984,2cyclictest32452-21df_abs19:15:133
299049983,3cyclictest24047-21aten2.4_r3power20:15:123
299049983,3cyclictest1857-21cpu19:20:113
299039984,3cyclictest3187-21ntpd20:55:172
20754280,5sleep20-21swapper/220:05:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional