You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-03 - 10:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Sun May 03, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14082115104,6sleep10-21swapper/119:07:521
32242210278,18sleep00-21swapper/019:05:060
1452210184,12sleep20-21swapper/219:08:242
129129988,6sleep30-21swapper/319:06:203
59642780,1sleep20-21swapper/220:40:582
106372740,1sleep00-21swapper/023:58:200
284902720,0sleep10-21swapper/120:16:021
162612510,1sleep30-21swapper/319:45:193
1603994323,18cyclictest0-21swapper/219:15:122
160499361,17cyclictest0-21swapper/321:40:103
1603993617,18cyclictest0-21swapper/222:50:112
62502330,2sleep229-21rcuc/200:29:002
1602993315,16cyclictest0-21swapper/121:50:131
160199280,26cyclictest0-21swapper/022:15:130
160499258,15cyclictest0-21swapper/321:50:133
54242240,1sleep30-21swapper/323:16:513
49982240,0sleep00-21swapper/021:31:100
247712230,1sleep2301ktimersoftd/222:28:202
160399230,2cyclictest0-21swapper/200:30:122
150522230,0sleep10-21swapper/122:17:441
91972220,2sleep339-21ksoftirqd/320:50:123
160399221,19cyclictest12128-21ssh22:15:132
160499210,19cyclictest0-21swapper/323:40:113
160499210,19cyclictest0-21swapper/321:35:133
160199210,2cyclictest0-21swapper/000:30:120
160199210,19cyclictest0-21swapper/022:20:110
160499200,2cyclictest0-21swapper/323:30:113
160399200,18cyclictest0-21swapper/222:20:112
220742190,0sleep00-21swapper/000:10:190
160299190,17cyclictest7178-21ssh00:30:121
72582180,1sleep10-21swapper/120:45:141
62292180,0sleep00-21swapper/022:08:290
305952170,1sleep00-21swapper/022:00:120
160499161,13cyclictest7822-21apt-get19:25:073
160499161,13cyclictest27465-21python21:56:013
160499161,13cyclictest1879-21aten2.4-expect19:10:113
160499160,13cyclictest0-21swapper/323:09:303
160299161,3cyclictest8364-21irqstats23:20:161
1602991610,4cyclictest0-21swapper/100:23:551
19822150,1sleep10-21swapper/122:39:051
160499151,12cyclictest0-21swapper/300:10:143
1604991510,3cyclictest25505-21ssh21:19:343
1604991510,3cyclictest15833-21ssh22:53:373
1604991510,3cyclictest0-21swapper/323:00:123
1604991510,3cyclictest0-21swapper/319:20:113
160499150,3cyclictest21059-21latency_hist21:50:003
160499150,13cyclictest0-21swapper/323:25:353
1603991512,2cyclictest0-21swapper/220:10:112
1603991510,3cyclictest3578-21iostat_ios21:30:152
160399150,13cyclictest25469-21ssh21:19:312
160399150,13cyclictest0-21swapper/223:17:312
1602991511,2cyclictest0-21swapper/119:45:301
160299150,13cyclictest5549-21runrttasks23:17:041
160199151,12cyclictest0-21swapper/019:35:160
1601991510,3cyclictest5289-21fschecks_count20:40:120
280682140,2sleep00-21swapper/021:21:120
1604991411,2cyclictest16721-21diskmemload00:00:053
1604991411,2cyclictest0-21swapper/322:57:243
160499140,3cyclictest17270-21irqstats00:05:173
160499140,2cyclictest27152-21ssh00:15:553
1603991411,2cyclictest0-21swapper/221:11:112
1603991411,2cyclictest0-21swapper/200:10:402
160399141,11cyclictest10892-21munin-node2
1603991410,2cyclictest16721-21diskmemload00:06:312
160399140,2cyclictest0-21swapper/223:25:012
160399140,2cyclictest0-21swapper/223:20:502
160399140,2cyclictest0-21swapper/223:13:502
160399140,2cyclictest0-21swapper/222:33:002
160399140,13cyclictest0-21swapper/221:47:012
160399140,12cyclictest8560-21fschecks_time19:25:142
160399140,12cyclictest24705-21ssh23:38:222
160399140,12cyclictest0-21swapper/223:05:372
160399140,12cyclictest0-21swapper/221:27:312
160399140,12cyclictest0-21swapper/220:25:112
160299149,3cyclictest18162-21ssh21:10:251
160299149,3cyclictest1815-21sensors_temp20:31:011
160299149,3cyclictest0-21swapper/122:20:431
1602991412,1cyclictest0-21swapper/123:04:341
1602991411,2cyclictest0-21swapper/122:41:141
1602991411,2cyclictest0-21swapper/122:34:241
1602991411,2cyclictest0-21swapper/119:11:031
1602991411,2cyclictest0-21swapper/100:02:431
1602991410,2cyclictest0-21swapper/123:10:041
1602991410,2cyclictest0-21swapper/122:50:061
160299140,2cyclictest0-21swapper/122:48:031
160299140,13cyclictest0-21swapper/123:45:141
160299140,12cyclictest16721-21diskmemload23:56:581
160299140,12cyclictest16721-21diskmemload23:26:571
160299140,12cyclictest0-21swapper/122:00:521
160299140,12cyclictest0-21swapper/121:40:161
160299140,12cyclictest0-21swapper/119:55:151
160299140,12cyclictest0-21swapper/100:39:131
160199142,6cyclictest0-21swapper/021:15:010
160199140,12cyclictest12134-21aten2.4_r3power00:00:120
1604991310,2cyclictest0-21swapper/323:55:353
1604991310,2cyclictest0-21swapper/323:20:343
1604991310,2cyclictest0-21swapper/322:36:303
1604991310,2cyclictest0-21swapper/321:28:343
1604991310,2cyclictest0-21swapper/319:35:153
1604991310,2cyclictest0-21swapper/300:35:343
1604991310,2cyclictest0-21swapper/300:25:193
1604991310,2cyclictest0-21swapper/300:20:253
160499130,2cyclictest0-21swapper/322:30:123
160499130,2cyclictest0-21swapper/322:23:053
160499130,2cyclictest0-21swapper/322:15:453
160499130,2cyclictest0-21swapper/321:21:203
160499130,2cyclictest0-21swapper/321:11:453
160499130,2cyclictest0-21swapper/300:30:143
160499130,12cyclictest0-21swapper/323:46:153
160499130,12cyclictest0-21swapper/323:36:033
160499130,12cyclictest0-21swapper/323:11:153
160499130,12cyclictest0-21swapper/322:26:353
160499130,12cyclictest0-21swapper/322:10:193
160499130,12cyclictest0-21swapper/320:10:183
160499130,11cyclictest0-21swapper/322:03:433
160499130,11cyclictest0-21swapper/321:30:373
1603991310,2cyclictest7348-21ssh23:55:122
1603991310,2cyclictest29095-21apt-get20:20:102
1603991310,2cyclictest29095-21apt-get20:20:092
1603991310,2cyclictest1785-21ssh22:04:032
1603991310,2cyclictest0-21swapper/223:54:322
1603991310,2cyclictest0-21swapper/222:44:212
1603991310,2cyclictest0-21swapper/222:10:112
1603991310,2cyclictest0-21swapper/221:58:112
1603991310,2cyclictest0-21swapper/219:40:172
160399130,2cyclictest32561-21ssh23:46:102
160399130,2cyclictest0-21swapper/223:00:172
160399130,2cyclictest0-21swapper/221:50:412
160399130,2cyclictest0-21swapper/221:20:532
160399130,2cyclictest0-21swapper/200:17:212
160399130,12cyclictest0-21swapper/221:38:312
160399130,12cyclictest0-21swapper/200:37:502
160299131,7cyclictest0-21swapper/120:05:011
1602991310,2cyclictest16721-21diskmemload23:51:441
1602991310,2cyclictest0-21swapper/123:38:031
1602991310,2cyclictest0-21swapper/123:31:531
1602991310,2cyclictest0-21swapper/121:39:241
1602991310,2cyclictest0-21swapper/121:20:101
1602991310,2cyclictest0-21swapper/100:25:031
160299130,2cyclictest0-21swapper/122:25:501
160299130,2cyclictest0-21swapper/121:30:101
160299130,12cyclictest0-21swapper/122:55:041
160299130,12cyclictest0-21swapper/121:49:331
160299130,12cyclictest0-21swapper/120:36:031
160299130,12cyclictest0-21swapper/100:15:541
160299130,11cyclictest0-21swapper/121:15:091
160299130,11cyclictest0-21swapper/100:06:221
160199138,3cyclictest30729-21sh22:35:100
160199133,6cyclictest0-21swapper/020:31:010
160199131,7cyclictest0-21swapper/022:45:000
160199131,6cyclictest0-21swapper/023:00:010
1601991310,2cyclictest0-21swapper/023:05:020
1601991310,2cyclictest0-21swapper/000:35:120
160199130,11cyclictest23382-21kworker/u8:222:31:050
160199130,11cyclictest0-21swapper/021:54:110
106092130,2sleep00-21swapper/023:22:500
76752120,2sleep00-21swapper/021:35:120
40482120,2sleep10-21swapper/122:05:471
160499129,2cyclictest0-21swapper/323:50:113
160499129,2cyclictest0-21swapper/320:01:033
160499129,2cyclictest0-21swapper/319:15:133
160499127,3cyclictest24424-21grep20:06:033
160499122,7cyclictest0-21swapper/319:44:593
160499122,7cyclictest0-21swapper/319:34:013
160499120,2cyclictest0-21swapper/322:45:093
160499120,2cyclictest0-21swapper/320:36:053
160499120,2cyclictest0-21swapper/320:25:153
160499120,11cyclictest0-21swapper/322:40:093
160499120,11cyclictest0-21swapper/322:05:113
160499120,11cyclictest0-21swapper/320:55:123
160399129,2cyclictest0-21swapper/223:40:222
160399129,2cyclictest0-21swapper/223:30:192
160399129,2cyclictest0-21swapper/222:39:192
160399129,2cyclictest0-21swapper/221:44:432
160399129,2cyclictest0-21swapper/219:50:192
160399129,2cyclictest0-21swapper/219:30:142
160399122,7cyclictest0-21swapper/220:49:022
160399122,7cyclictest0-21swapper/219:13:022
160399120,2cyclictest19197-21ssh22:56:362
160399120,11cyclictest0-21swapper/222:45:422
160399120,11cyclictest0-21swapper/222:06:112
160399120,11cyclictest0-21swapper/220:30:182
160399120,11cyclictest0-21swapper/219:55:182
160399120,11cyclictest0-21swapper/219:45:552
160399120,11cyclictest0-21swapper/200:24:112
160399120,11cyclictest0-21swapper/200:00:162
160299129,2cyclictest0-21swapper/120:50:181
160299129,2cyclictest0-21swapper/120:20:491
160299129,2cyclictest0-21swapper/120:20:481
160299129,2cyclictest0-21swapper/119:25:071
160299127,3cyclictest0-21swapper/123:05:121
160299122,5cyclictest0-21swapper/119:35:001
160299121,9cyclictest21088-21apt-get00:10:121
160299120,2cyclictest0-21swapper/123:41:351
160299120,2cyclictest0-21swapper/121:25:561
160299120,11cyclictest0-21swapper/121:55:251
160299120,11cyclictest0-21swapper/119:40:121
160199129,2cyclictest0-21swapper/000:15:200
160199127,3cyclictest31002-21df21:25:130
160199126,4cyclictest28007-21wc20:15:170
160199121,9cyclictest30892-21munin-run20:25:010
160199121,9cyclictest30892-21munin-run20:25:010
160199120,2cyclictest0-21swapper/021:45:150
160199120,2cyclictest0-21swapper/019:25:120
160199120,10cyclictest5521-21ssh23:17:010
160499111,7cyclictest0-21swapper/319:52:593
160399118,2cyclictest0-21swapper/220:50:172
160399118,2cyclictest0-21swapper/220:36:042
160399112,6cyclictest0-21swapper/219:36:012
160299118,2cyclictest0-21swapper/120:10:141
160299118,2cyclictest0-21swapper/119:15:181
160299117,2cyclictest0-21swapper/121:05:151
160299117,2cyclictest0-21swapper/120:05:151
160299111,8cyclictest7831-21gpgv19:24:591
160299111,8cyclictest7466-21apt-get22:10:121
160299111,7cyclictest0-21swapper/119:53:591
160299111,3cyclictest0-21swapper/121:00:171
160299111,2cyclictest4865-21munin-node1
160299110,3cyclictest0-21swapper/120:25:101
160199118,2cyclictest16721-21diskmemload23:10:120
160199118,2cyclictest0-21swapper/021:42:420
160199113,4cyclictest0-21swapper/019:48:040
160199112,7cyclictest0-21swapper/019:43:590
160199112,7cyclictest0-21swapper/019:22:580
160199112,6cyclictest0-21swapper/021:56:000
160199111,7cyclictest0-21swapper/020:04:590
160199111,6cyclictest23711-21sh21:16:300
160199111,6cyclictest0-21swapper/021:06:020
160199111,6cyclictest0-21swapper/020:06:160
160199110,9cyclictest0-21swapper/000:25:160
160199110,2cyclictest6939-21ssh23:54:510
160199110,10cyclictest0-21swapper/023:38:010
160199110,10cyclictest0-21swapper/022:48:310
160199110,10cyclictest0-21swapper/020:26:000
160499107,2cyclictest0-21swapper/320:30:193
160499102,5cyclictest0-21swapper/320:24:593
160499102,5cyclictest0-21swapper/320:24:583
160399105,3cyclictest3649-21snmpd21:01:272
160399100,7cyclictest0-21swapper/219:20:012
160299103,4cyclictest0-21swapper/120:55:041
160199108,1cyclictest0-21swapper/023:25:000
160199105,3cyclictest26530-21ssh23:40:130
160199105,3cyclictest16721-21diskmemload23:45:110
160199102,5cyclictest0-21swapper/023:35:010
160199102,5cyclictest0-21swapper/000:09:590
160199101,3cyclictest0-21swapper/022:25:260
160199100,9cyclictest8480-21kworker/u8:220:57:040
160199100,9cyclictest0-21swapper/020:50:170
160199100,9cyclictest0-21swapper/019:31:050
160199100,6cyclictest0-21swapper/021:01:020
160199100,6cyclictest0-21swapper/019:16:070
160199100,2cyclictest0-21swapper/000:23:430
133152100,7sleep313493-21hddtemp_smartct21:00:163
16049996,2cyclictest0-21swapper/319:55:143
16049994,3cyclictest7328-21fschecks_count20:45:153
16049994,3cyclictest6074-21grep20:40:593
16049994,3cyclictest27399-21df_abs20:15:123
16049993,4cyclictest15794-21tr21:05:173
16039994,3cyclictest15411-21fschecks_time21:05:142
16029990,7cyclictest0-21swapper/119:35:111
16019996,2cyclictest0-21swapper/023:00:100
16019996,2cyclictest0-21swapper/020:45:150
16019996,2cyclictest0-21swapper/019:51:050
16019994,3cyclictest8436-21open_files22:10:170
16019994,3cyclictest3198-21cut20:35:150
16019994,3cyclictest2562-21latency19:10:150
16019994,3cyclictest19459-21fschecks_count19:55:140
16019994,3cyclictest12585-21cpu22:50:120
16019990,7cyclictest0-21swapper/020:11:010
16039984,2cyclictest27216-21aten2.4-expect20:15:112
16039983,3cyclictest23691-21modprobe20:05:162
16039980,7cyclictest0-21swapper/220:00:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional